Staff Machine Learning Engineer, Hippocratic AI

Applied Science

Salary not provided
AWS
Docker
Kubernetes
GCP
Python
Tensorflow
Azure
PyTorch
Senior and Expert level
San Francisco Bay Area

More information about location

5 days a week in office (Palo Alto, CA)

Hippocratic AI

Large Language Model for healthcare

Be an early applicant

Hippocratic AI

Large Language Model for healthcare

21-100 employees

HealthcareB2BArtificial IntelligenceEnterpriseDeep TechSaaS

Be an early applicant

Salary not provided
AWS
Docker
Kubernetes
GCP
Python
Tensorflow
Azure
PyTorch
Senior and Expert level
San Francisco Bay Area

More information about location

5 days a week in office (Palo Alto, CA)

21-100 employees

HealthcareB2BArtificial IntelligenceEnterpriseDeep TechSaaS

Company mission

Hippocratic AI’s mission is to develop the first safest focused Large Language Model (LLM) for healthcare.

Role

Who you are

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field; PhD is a plus
  • 7+ years of industry experience building and deploying ML systems, ideally with focus on LLMs or deep learning
  • Strong software engineering skills and experience developing in Python
  • Deep experience with ML frameworks like PyTorch or TensorFlow
  • Familiarity with distributed training frameworks (e.g., DeepSpeed, FSDP, Horovod)
  • Proven experience designing, implementing, and scaling ML pipelines for large models
  • Experience with cloud platforms (e.g., AWS, GCP, Azure) and container orchestration (e.g., Kubernetes, Docker)
  • Exposure to healthcare, clinical, or life sciences data is a strong plus

What the job involves

  • Staff Machine Learning Engineers at Hippocratic AI are foundational to the design, deployment, and optimization of cutting-edge ML systems powering our next-generation, safety-focused generative AI for healthcare
  • You’ll work closely with research scientists and product teams to build scalable infrastructure and models that support robust, real-time, and personalized conversational AI capabilities
  • We are seeking an experienced Staff Machine Learning Engineer to lead the development of machine learning pipelines, contribute to training and inference systems for Large Language Models (LLMs), and drive the productionization of ML models that directly impact healthcare delivery and patient outcomes
  • This role is both strategic and hands-on, perfect for someone excited about technical leadership in a fast-paced, mission-driven environment
  • Designing scalable, high-performance infrastructure for LLM training, fine-tuning, and inference
  • Building ML pipelines and tooling for experimentation, evaluation, and deployment
  • Optimizing model performance and efficiency in production environments
  • Collaborating cross-functionally to integrate ML solutions into end-user applications
  • Maintaining compliance with healthcare standards of safety, privacy, and reliability
  • As a Staff ML Engineer at Hippocratic AI, you’ll have a seat at the table in technical decision-making, partner closely with product and research leads, and help define the roadmap for scalable, safe ML systems
  • This role offers the chance to be deeply embedded in a team of engineers and scientists pioneering the future of healthcare-focused AI

Share this job

View 31 more jobs at Hippocratic AI

Company

Funding (last 2 of 5 rounds)

Jan 2025

$141m

SERIES B

Sep 2024

$17m

SERIES A

Total funding: $276m

Our take

The healthcare system is under increasing pressure to improve performance and patient outcomes, while battling inefficient operations and an ongoing staff shortage. Hippocratic AI hopes to help the industry address these issues, by supplying LLM-powered healthcare agents.

Hippocratic's agents can be employed in a number of scenarios, for example follow-ups with discharged patients, health risk assessments, or pre-op chats. Rather than delivering one conversational agent, the company has specified models that deal with different conditions - just one part of its safety-focussed approach.

By taking measures such as getting real nurses to assess its AI, Hippocratic solidifies this commitment to safety. The company has seen significant investment which it will use to fund further safety tests and develop its product moving forwards.

Kirsty headshot

Kirsty

Company Specialist at Welcome to the Jungle