Mindbeam

Machine Learning Engineer - Pre Training at Mindbeam (United States)

Mindbeam· United States· $150k–$190k·

Role details

Salary
$150k–$190k
Work type
Remote
Employment
Full-Time
Skills
PythonPyTorchTensorFlowJAXDockerKubernetesGPU schedulingMemory optimizationParallelism strategiesHigh-performance computing

Summary

Design and optimize large-scale pre-training pipelines for foundation models, implementing distributed training strategies and fault-tolerance systems while collaborating with researchers to translate experiments into production-ready workflows.

Job description

About Mindbeam

We are building the next-generation AI infrastructure for open source and enterprise. Our work is deeply research-oriented and passionate about developing ground-breaking innovations to take state-of-the-art AI applications to the next level. What drives us is not only advancing technology, but empowering the people behind it. We are a community of researchers, engineers, and visionaries who believe that collaboration, curiosity, and openness fuel progress. If you’re motivated by impact and inspired to build tools that others can build upon, you’ll be in the right place.

Mission Design and optimize large-scale pre-training systems that power Mindbeam’s generative AI models.

Role Expectations

  • Build scalable pre-training pipelines for foundation models, optimizing throughput and efficiency.
  • Implement distributed training strategies across GPUs/TPUs and high-performance clusters.
  • Collaborate with researchers to translate experimental setups into production-ready workflows.
  • Develop monitoring and fault-tolerance systems to ensure reliable large-scale training.
  • Continuously benchmark and tune performance across hardware and software stacks.

Background

  • Bachelor’s, Master’s, or PhD in Computer Science, Engineering, or related field—or equivalent experience.
  • 2+ years of experience with large-scale model training and distributed systems.
  • Strong coding skills in Python and familiarity with ML frameworks (PyTorch, TensorFlow, JAX).
  • Experience with GPU scheduling, memory optimization, and parallelism strategies.
  • Comfort with containerized and orchestrated environments (Docker/Kubernetes).
  • Understanding of high-performance computing and networking bottlenecks.

About You

You thrive on scale and complexity. You enjoy solving system-level bottlenecks, pushing hardware and software to their limits, and working closely with researchers to accelerate cutting-edge AI development.

Why work at Mindbeam

  • Culture: Small, early-stage team (~8 employees) with a high density of talent from top organizations (Amazon Web Services, JPMorgan Chase, Cleveland Clinic, UC Berkeley, etc.). Emphasis on breakthrough performance and energy efficiency.
  • Remote/Hybrid/Office: Not explicitly stated. Headquarters in New York City; likely hybrid given NYC base.
  • Notable Perks: Opportunity to work on cutting-edge AI infrastructure with significant impact on cost and energy. Founding team access. Open source contributions.
  • Engineering Culture: Research-heavy (two research scientists on staff), open-source friendly (GitHub), and hands-on with GPU and system optimization.

Application questions