Machine Learning Platform Engineer, Stability AI
$130-190k
+ Stock options
Open source generative AI company
Job no longer available
Open source generative AI company
101-200 employees
Job no longer available
$130-190k
+ Stock options
101-200 employees
Company mission
To activate humanity's potential through generative AI.
Role
Who you are
- 8 years of experience in cloud computing, API development, and a deep understanding of High-Performance Computing environments, particularly in an AWS setting
- Strong knowledge of HPC cluster management and job scheduling with Slurm and AWS HyperPod
- Proficiency in programming languages such as Python and Typescript, essential for API development and integration within AWS and/or Cloudflare worker environments
- Demonstrated expertise in API design, implementation, and maintenance, ensuring security and performance best practices within AWS and Cloudflare
- Knowledge of containerization technologies (e.g., Docker, Kubernetes) for deployment of APIs within AWS, Cloudflare, and HPC systems
- Experience with automating CI/CD pipelines
- Familiarity with authentication and authorization protocols (e.g., OAuth, JWT) to ensure secure data exchange between AWS, Cloudflare, and HPC environments
- Strong problem-solving skills and the ability to troubleshoot complex issues related to API integrations in a hybrid cloud-HPC setup, particularly in AWS and Cloudflare environments
- Excellent communication and collaboration skills to work effectively with diverse teams and stakeholders in AWS and Cloudflare ecosystems
What the job involves
- We are currently looking for a skilled Sr. ML Platform Engineer with specialized focus on Cloud Infrastructure that includes API development to facilitate seamless integration and interaction between cloud-based services and High-Performance Computing (HPC) environments
- The successful candidate will play a pivotal role in designing and implementing APIs that enable efficient communication and data exchange between cloud platforms and HPC systems
- Design, develop, and maintain robust APIs that facilitate communication and data exchange between cloud-based services, particularly AWS, and HPC environments
- Collaborate with cross-functional teams to understand the unique requirements of both cloud based services and HPC systems, ensuring that the APIs developed meet the specific needs of these environments
- Implement best practices for API design, including security, scalability, and performance optimization to ensure efficient interaction between cloud services and HPC clusters
- Utilize services such as Cloudflare to enhance API performance, security, and reliability in the cloud-to-HPC communication, optimizing for speed and resilience
- Work closely with HPC engineers to identify and address integration challenges, striving for seamless connectivity between diverse systems and cloud-based platforms
- Drive innovation by proposing and implementing new API strategies, enhancing the efficiency and functionality of data exchange between AWS, Cloudflare workers, on-premise HPC environments
- Create comprehensive documentation and provide training to internal teams on the use and integration of developed APIs, focusing on AWS and Cloudflare environments
- Monitor API performance and address issues related to data transfer, ensuring reliability and consistent operation between AWS, Cloudflare, and HPC systems (Slurm/AWS HyperPod)
- Collaborate with the security team to ensure that the APIs comply with industry standards and best practices for data privacy and protection, especially in AWS and Cloudflare environments
- Participating in incident management and root cause analysis to improve system reliability
- Build containers with REST APIs for Gen AI functionality and host them on AWS and Azure
Our take
Stability AI is an AI-driven visual art company that designs and implements an open AI tool that creates images based on text input. Through collective intelligence and augmented technology, Stability AI is helping research communities develop cutting-edge AI models for image, language, audio, video, 3D content, biotech and other scientific research.
Working in partnership with Electronic Arts (EA), Stability AI is co-developing next-generation generative AI model and workflows designed to empower artists, designers, and developers across interactive entertainment. By embedding its research teams directly alongside EA's creative talent, Stability AI is advancing image-to-3D, text-to-3D, and volumetric media tools that accelerate world-building, rapid prototyping, and visual storytelling. This collaboration highlights Stability AI's growing leadership i multimodal and 3D generative AI, and its mission to put powerful, creator-centric tools in the hands of global creative industries.
The company is also focused on expanding its creative sector offerings, hiring legendary filmmaker James Cameron to bring an artistic perspective to its suite of storytelling tools. This exciting development will further help Stability AI push the boundaries of AI-driven media and help on its mission to transform visual storytelling.
Freddie
Company Specialist at Welcome to the Jungle
Company
Funding (last 2 of 3 rounds)
Jun 2024
$80m
EARLY VC
Oct 2023
$50m
CONVERTIBLE
Total funding: $231m
Company HQ
Notting Hill, London, UK
Share this job
View 7 more jobs at Stability AI