Staff Machine Learning Engineer, Hippocratic AI
Applied Science
More information about location
5 days a week in office (Palo Alto, CA)
Large Language Model for healthcare
Open for applications
Large Language Model for healthcare
21-100 employees
Open for applications
More information about location
5 days a week in office (Palo Alto, CA)
21-100 employees
Company mission
Hippocratic AI’s mission is to develop the first safest focused Large Language Model (LLM) for healthcare.
Role
Who you are
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field; PhD is a plus
- 7+ years of industry experience building and deploying ML systems, ideally with focus on LLMs or deep learning
- Strong software engineering skills and experience developing in Python
- Deep experience with ML frameworks like PyTorch or TensorFlow
- Familiarity with distributed training frameworks (e.g., DeepSpeed, FSDP, Horovod)
- Proven experience designing, implementing, and scaling ML pipelines for large models
- Experience with cloud platforms (e.g., AWS, GCP, Azure) and container orchestration (e.g., Kubernetes, Docker)
- Exposure to healthcare, clinical, or life sciences data is a strong plus
What the job involves
- Staff Machine Learning Engineers at Hippocratic AI are foundational to the design, deployment, and optimization of cutting-edge ML systems powering our next-generation, safety-focused generative AI for healthcare
- You’ll work closely with research scientists and product teams to build scalable infrastructure and models that support robust, real-time, and personalized conversational AI capabilities
- We are seeking an experienced Staff Machine Learning Engineer to lead the development of machine learning pipelines, contribute to training and inference systems for Large Language Models (LLMs), and drive the productionization of ML models that directly impact healthcare delivery and patient outcomes
- This role is both strategic and hands-on, perfect for someone excited about technical leadership in a fast-paced, mission-driven environment
- Designing scalable, high-performance infrastructure for LLM training, fine-tuning, and inference
- Building ML pipelines and tooling for experimentation, evaluation, and deployment
- Optimizing model performance and efficiency in production environments
- Collaborating cross-functionally to integrate ML solutions into end-user applications
- Maintaining compliance with healthcare standards of safety, privacy, and reliability
- As a Staff ML Engineer at Hippocratic AI, you’ll have a seat at the table in technical decision-making, partner closely with product and research leads, and help define the roadmap for scalable, safe ML systems
- This role offers the chance to be deeply embedded in a team of engineers and scientists pioneering the future of healthcare-focused AI
Our take
The healthcare system is under increasing pressure to improve performance and patient outcomes, while battling inefficient operations and an ongoing staff shortage. Hippocratic AI hopes to help the industry address these issues, by supplying LLM-powered healthcare agents.
Hippocratic's agents can be employed in a number of scenarios, for example follow-ups with discharged patients, health risk assessments, or pre-op chats. Rather than delivering one conversational agent, the company has specified models that deal with different conditions - just one part of its safety-focussed approach.
By taking measures such as getting real nurses to assess its AI, Hippocratic solidifies this commitment to safety. The company has seen significant investment which it will use to fund further safety tests and develop its product moving forwards.
Kirsty
Company Specialist at Welcome to the Jungle
Company
Funding (last 2 of 5 rounds)
Jan 2025
$141m
SERIES B
Sep 2024
$17m
SERIES A
Total funding: $276m
Company HQ
University South, Palo Alto, CA
Leadership
Munjal Shah
(CEO)Formerly CEO and Co-founder of Health IQ. Also co-founded Like.com, which was acquired by Google, and Andale Inc that was acquired by Vendio and then Alibaba.
Vishal Parikh
(CPO)Co-founded Health IQ, where they worked as CTO, CRO then CPO. Founded and was a Software Architect at Motiv Power Systems.
Meenesh Bhimani MD, MHA
(Chief Medical Officer)Former COO of El Camino Health. Has worked in several roles at O'Connor Hospital, most recently Hospital Executive/COO. Earned their MD at The Johns Hopkins University School of Medicine.
Subhabrata Mukherjee
(Chief Scientific Officer)Was Principal Researcher at Microsoft Research (MSR) Redmond for 4 years, and before that a Machine Learning Scientist at Amazon. Earned a PhD from the Max Planck Institute for Informatics.
Alex Miller
(COO)Previously Co-founder and SVP of Engineering and Sales Operations at Health IQ. Also co-founded and was CTO at Jump Gaming.
Saad Godil
(CTO)Previously spent 15 years at NVIDIA, as Director of Verification (GPU) then Director of Applied Deep Learning Research.
Kim Parikh
(SVP - Data & Content)Former VP of Strategy and Operations at Health IQ. Also worked in High Yield and Leveraged Finance at PIMCO, and Derivatives And Leveraged Finance at Western Asset Management.
Debajyoti Datta
(AI Research Scientist)Earned a PhD in Machine Learning from the University of Virginia. Has worked as a Machine Learning Engineer for x.ai, Research Engineer for Crossing Minds and Machine Learning Fellow at Intuition Machines.
Paul Gamble
(Director of Clinical AI)Was a Clinician Scientist at Google for 3.5 years, and prior to this a Data Scientist at In-Q-Tel.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 34 more jobs at Hippocratic AI