Senior Machine Learning Infrastructure Engineer, Hippocratic AI
Office located in Palo Alto, CA
Large Language Model for healthcare
Job no longer available
Large Language Model for healthcare
101-200 employees
Job no longer available
Office located in Palo Alto, CA
101-200 employees
Company mission
To close the growing shortage of healthcare workers worldwide.
Role
Who you are
- The ideal candidate will have hands-on experience with infrastructure orchestration tools such as Kubernetes and Terraform, as well as a strong understanding of multi-cloud environments
- 3-5 years of experience in infrastructure engineering, DevOps, or a related field.
- Experience with enterprise GPUs such as H200, H100, A100
- Proficiency with Kubernetes, Terraform, and other IAC tools
- Familiarity with multi-cloud environments and cloud-native services (e.g., AWS Lambda, Google Cloud Run, Azure Functions)
- Programming skills in Python, Bash, or a similar language for automation and scripting
- Basic understanding of ML workflows and frameworks like TensorFlow, PyTorch, or Hugging Face is a plus.Soft Skills:
- Strong problem-solving skills and attention to detail
- Good communication and collaboration abilities to work effectively with cross-functional teams
- Eagerness to learn new technologies and improve existing systems.
- Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent work experience)
What the job involves
- We are seeking a skilled ML Infrastructure Engineer to help design, build, and maintain a robust orchestration platform for managing a diverse set of Large Language Models (LLMs)
- This role offers the opportunity to work on cutting-edge technologies and play a key part in scaling our AI infrastructure
- Build and maintain infrastructure for deploying and managing LLMs at scale
- Implement automated processes using Kubernetes and Infrastructure as Code (IAC) tools like Terraform.
- Contribute to the development and optimization of an orchestration platform for managing a heterogeneous set of LLMs
- Monitor and troubleshoot issues in the platform to ensure high availability and performance.
- Deploy and manage resources across multiple cloud platforms (e.g., AWS, Azure, Google Cloud)
- Optimize cloud resource usage for cost efficiency and scalability.
- Work closely with ML engineers and DevOps teams to ensure smooth deployment and operation of AI models
- Provide feedback on system designs and recommend improvements to infrastructure workflows.
- Implement tools and processes to monitor system health, identify bottlenecks, and improve model lifecycle management
- Perform capacity planning to support growing infrastructure needs
Our take
The healthcare system is under increasing pressure to improve performance and patient outcomes, while battling inefficient operations and an ongoing staff shortage. Hippocratic AI hopes to help the industry address these issues, by supplying LLM-powered healthcare agents.
Hippocratic's agents can be employed in a number of scenarios, for example follow-ups with discharged patients, health risk assessments, or pre-op chats. Rather than delivering one conversational agent, the company has specified models that deal with different conditions - just one part of its safety-focussed approach.
By taking measures such as getting real nurses to assess its AI, Hippocratic solidifies this commitment to safety. And it's seen significant investments which its using to further fund safety tests as well as develop its product. Most recently, it has partnered with EUCALIA to bring generative AI to Japan, putting the company on a good growth trajectory.
Kirsty
Company Specialist at Welcome to the Jungle
Company
Funding (last 2 of 5 rounds)
Jan 2025
$141m
SERIES B
Sep 2024
$17m
SERIES A
Total funding: $276m
Company HQ
Ventura, Palo Alto, CA
Leadership
Munjal Shah
(Co-Founder & CEO)Formerly CEO and Co-founder of Health IQ. Also co-founded Like.com, which was acquired by Google, and Andale Inc that was acquired by Vendio and then Alibaba.
Vishal Parikh
(Co-Founder & CPO)Co-founded Health IQ, where they worked as CTO, CRO then CPO. Founded and was a Software Architect at Motiv Power Systems.
Meenesh Bhimani MD, MHA
(Co-Founder & Chief Medical Officer)Former COO of El Camino Health. Has worked in several roles at O'Connor Hospital, most recently Hospital Executive/COO. Earned their MD at The Johns Hopkins University School of Medicine.
Subhabrata Mukherjee
(Co-Founder & Chief Scientific Officer)Was Principal Researcher at Microsoft Research (MSR) Redmond for 4 years, and before that a Machine Learning Scientist at Amazon. Earned a PhD from the Max Planck Institute for Informatics.
Alex Miller
(Co-Founder & COO)Previously Co-founder and SVP of Engineering and Sales Operations at Health IQ. Also co-founded and was CTO at Jump Gaming.
Saad Godil
(Co-Founder & CTO)Previously spent 15 years at NVIDIA, as Director of Verification (GPU) then Director of Applied Deep Learning Research.
Kim Parikh
(Co-Founder & SVP - Data & Content)Former VP of Strategy and Operations at Health IQ. Also worked in High Yield and Leveraged Finance at PIMCO, and Derivatives And Leveraged Finance at Western Asset Management.
Debajyoti Datta
(Co-Founder & AI Research Scientist)Earned a PhD in Machine Learning from the University of Virginia. Has worked as a Machine Learning Engineer for x.ai, Research Engineer for Crossing Minds and Machine Learning Fellow at Intuition Machines.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 21 more jobs at Hippocratic AI