Member of Technical Staff, Fireworks AI
$175-220k
+ Equity
Generative AI platform enabling rapid scaling for developers and businesses
Be an early applicant
Generative AI platform enabling rapid scaling for developers and businesses
101-200 employees
Be an early applicant
$175-220k
+ Equity
101-200 employees
Company mission
To help every organization unleash the full power of artificial intelligence.
Role
Who you are
- Bachelor's degree or equivalent in Computer Science or related field plus four (4) years of experience in software engineering or related role
- 4 years of experience designing, building, and optimizing large-scale backend infrastructure and distributed data systems (e.g., PostgreSQL, MySQL, DynamoDB, Apache Spark, Apache Flink, Apache Kafka) in cloud environments (AWS, GCP, Azure, or equivalent), including cloud-native platforms, core infrastructure components, and optimization techniques (caching, indexing, sharding, replication, transactions, ACID)
- 4 years of experience with major server-side programming languages and frameworks (e.g., Python, C++, Go, TypeScript)
- 4 years of experience writing technical design documentation, leading cross-functional projects, and collaborating with cross-functional teams to achieve business impact
- 3 years of experience developing and maintaining data processing and API systems, including client-server communication frameworks (e.g., gRPC, Thrift)
- 3 years of experience conducting A/B testing and scientific experimentation (e.g., Statsig, Meta Deltoid, Optimizely) to measure software impact
- 3 years of experience conducting coding interviews and providing systematic feedback for engineering candidates
- 2 years of experience with cloud-native tools and infrastructure, such as Docker and Kubernetes
- 2 years of experience defining and implementing data-driven metrics to support company or team goals
What the job involves
- As a Training Infrastructure Engineer, you'll design, develop, and maintain large-scale backend and cloud-native infrastructure to support distributed machine learning training, inference, and data processing pipelines for our generative AI platform
- You'll architect scalable, resilient backend infrastructure, lead technical design discussions, mentor engineers, and establish best practices for large-scale machine learning systems
- Architect and build scalable, resilient backend infrastructure to support distributed training, inference, and data processing pipelines
- Lead technical design discussions, mentor engineers, and establish best practices for large-scale machine learning systems
- Design and implement core backend services with a focus on efficiency and low latency
- Drive infrastructure optimization initiatives for compute cost, storage lifecycle management, and network performance
- Collaborate with machine learning, DevOps, and product teams to translate research and product requirements into robust infrastructure solutions
- Evaluate and integrate cloud-native and open-source technologies such as Kubernetes, Ray, Kubeflow, and MLFlow to enhance platform reliability
- Own end-to-end systems from design to deployment, emphasizing reliability, fault tolerance, and operational excellence
Our take
Whilst the development of generative AI is thought to be the reserve of large companies like Open AI, smaller startups such as Firework AI are making this technology easier to access and develop for smaller companies wanting to handle specific business needs using AI. As an open-source model API, it has one of the largest user bases - with over 12,000 users leveraging Fireworks AI’s software.
Though lacking the brand name recognition of generative AI developers like Google and Meta, Fireworks AI differentiates itself in a market crowded with large competitors through its unique approach to deploying its software. It creates smaller, production-grade, customizable generative AI models that can be launched privately and securely, rather than the non-private and inflexible models built by larger companies.
After its 2025 Series C round of $250M, Fireworks AI has been valued at over $4B, an impressive sum for a David in a sea of Goliaths. The company plans to use its funding to reshape AI infrastructure as well as expand globally. It will be interesting to see how the company evolves with its potentially disruptive business approach to generative AI.
Freddie
Company Specialist at Welcome to the Jungle
Company
Funding (last 2 of 3 rounds)
Oct 2025
$230m
SERIES C
Jul 2024
$52m
SERIES B
Total funding: $307m
Company HQ
Redwood City, CA
Leadership
Lin Qiao
(Co-Founder & CEO)Previously a Senior Director of Engineering at Meta, a Tech Lead at Linkedin, a Research Staff Member at IBM Almaden Research Center and an Advisory Software Engineer at IBM Silicon Valley Lab.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 29 more jobs at Fireworks AI