Software Engineer - ML Infrastructure
- Location
- San Francisco, California, United States
- Work mode
- On-site
- Employment type
- Full-time
About the job
About the company
Our client is a healthcare technology company developing AI-enabled imaging tools. Researchers and engineers work together on production machine learning systems for clinical applications.
The role
Raydar is recruiting for this role on behalf of our client. Own ML infrastructure across distributed training, reinforcement learning, and production serving. You will establish engineering practices and help researchers translate experiments into reliable systems.
What you'll do
- Build distributed training infrastructure with parallelism and checkpointing.
- Develop reinforcement-learning infrastructure for rollout generation, reward models, and experience collection.
- Partner with researchers to turn experimental workflows into production systems.
- Build data loading and preprocessing pipelines for multimodal datasets.
- Improve model serving, canary deployment, monitoring, and rollout tooling. Requirements What we're looking for
- 6+ years of ML infrastructure or distributed systems experience.
- Strong Python and hands-on production ML serving experience.
- Kubernetes and Docker experience with GPU scheduling, autoscaling, and reproducible environments.
- Distributed training expertise in PyTorch or JAX, including FSDP, DeepSpeed, or comparable approaches.
- Experience with RL or online-learning loops, logging, checkpointing, and evaluation.
- Breadth across the ML infrastructure stack plus technical leadership or mentoring experience.
Bonus points
- Startup experience.
- A/B testing and production ML experimentation platforms.
- A computer science or other STEM degree. Benefits Compensation and benefits
- Base salary: USD 250,000 to 300,000 per year.
- Equity: Competitive equity.
Location and work model
- San Francisco, California, United States.
- Five days per week onsite.
- Visa transfers and new visa sponsorships are supported.
From Raydar's careers page (Workable), checked 30 Oct 2026.
How to apply
- Select Apply on apply.workable.com. It opens Raydar's own application form in a new tab, run on Workable.
- Fill in the form and upload your résumé there. Jobiwork never sees your application.
- Raydar will reply to you directly. No real employer asks you for money to apply.
Posted 19 Sept 2026 · checked 30 Oct 2026 · Report this job