AI Infrastructure Engineer, Fireworks AI
$170-180k
Office located in Redwood City, CA
Generative AI platform enabling rapid scaling for developers and businesses
Be an early applicant
Generative AI platform enabling rapid scaling for developers and businesses
21-100 employees
Be an early applicant
$170-180k
Office located in Redwood City, CA
21-100 employees
Company mission
To help every organization unleash the full power of artificial intelligence
Role
Who you are
- Bachelor’s degree or the equivalent in Computer Science, Computer Engineering or a related field
- Three (3) years of experience with ML infrastructure (PyTorch, Vertex AI, and Sagemaker) or related experience
- Experience with one or more search engine, recommendations, natural language processing, personalization, or similar applied ML domain
- Experience with building, scaling, and optimizing distributed enterprise-grade Machine Learning systems
- Experience with architectural patterns of large-scale software applications
- Experience with publishing papers in machine learning and/or computer vision conferences and journals
- Experience with large-scale machine learning techniques like semi-supervised learning, weakly-supervised learning, and online adaptation of ML models
- Experience with publishing machine learning domains such as computer vision and natural language processing
What the job involves
- Design core, backend software components. Interface with other teams to incorporate their innovations and vice versa
- Conduct design and code reviews. Analyze and improve efficiency, scalability, and stability of various system resources
- Design and implement the hardware and software infrastructure required for AI projects
- Procure, configure, and manage servers, GPUs, TPUs, and other hardware resources
- Set up cloud-based environments (e.g., AWS, Azure, GCP) for AI workloads
- Deploy and manage distributed computing clusters (e.g., Kubernetes) for AI model training and inference
- Optimize cluster performance and resource allocation for AI workloads
- Monitor cluster health and troubleshoot issues as they arise
- Architect and maintain data storage solutions (e.g., data lakes, databases) for AI datasets
- Ensure data security, access controls, and data versioning. Implement data pipelines for efficient data ingestion and preprocessing
- Develop and maintain automation scripts and tools for infrastructure provisioning and scaling
- Implement continuous integration and continuous deployment (CI/CD) pipelines for AI models
- Orchestrate workflows for training, evaluation, and deployment of AI models
- Optimize infrastructure to handle large-scale AI workloads efficiently
- Monitor and analyze system performance, making adjustments as needed
- Implement load balancing and scaling strategies to meet demand
- Implement security best practices to protect AI infrastructure and data
- Stay up-to-date with security vulnerabilities and apply patches and updates
- Ensure compliance with relevant data privacy and regulatory requirements
- Collaborate with data scientists and AI engineers to understand their infrastructure needs
- Provide technical support and troubleshooting assistance for AI infrastructure issues
- Train and educate team members on best practices for using AI infrastructure
Our take
Whilst the development of generative AI is thought to be the reserve of large companies like Open AI, smaller startups such as Firework.AI are making this technology easier to access and develop for smaller companies wanting to handle specific business needs using AI. As an open-source model API, it has one of the largest user bases - with over 12,000 users leveraging Fireworks.AI’s software.
Though lacking the brand name recognition of generative AI developers like Google and Meta, Fireworks.AI differentiates itself in a market crowded with large competitors through its unique approach to deploying its software. It creates smaller, production-grade, customisable generative AI models that can be launched privately and securely, rather than the non-private and inflexible models built by larger companies.
After its 2024 Series B round of $52 million, Fireworks.AI has been valued at over $550 million, an impressive sum for a David in a sea of Goliaths. The company plans to use its funding to develop compound AI systems that can orchestrate across multiple single models. It will be interesting to see how the company evolves with its potentially disruptive business approach to generative AI.
Freddie
Company Specialist at Welcome to the Jungle
Company
Funding (2 rounds)
Jul 2024
$52m
SERIES B
Mar 2024
$25m
SERIES A
Total funding: $77m
Company HQ
Redwood City, CA
Leadership
Lin Qiao
(CEO)Previously Senior Director of Engineering at Meta, Tech Lead at Linkedin, Research Staff Member at IBM Almaden Research Center and an Advisory Software Engineer at IBM Silicon Valley Lab.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 11 more jobs at Fireworks AI