Software Engineer, Fireworks AI

Backend Infrastructure

$160-190k

PyTorch

Sagemaker

Senior and Expert level

New York

San Francisco Bay Area

More information about location

3+ days a week in office

Generative AI platform enabling rapid scaling for developers and businesses

Job no longer available

Generative AI platform enabling rapid scaling for developers and businesses

21-100 employees

B2BArtificial IntelligenceSaaS

Job no longer available

$160-190k

PyTorch

Sagemaker

Senior and Expert level

New York

San Francisco Bay Area

More information about location

3+ days a week in office

21-100 employees

B2BArtificial IntelligenceSaaS

Company mission

To help every organization unleash the full power of artificial intelligence

Job

Company

Role

Who you are

Bachelor’s degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
5+ years experience working in ML infra (PyTorch, Vertex AI, Sagemaker, etc.)
Experience building, scaling, and optimizing enterprise-grade Machine Learning systems

Desirable

Experience in AI or large scale infrastructure
Master’s or PhD degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience

What the job involves

As a Backend Software Engineer, you’ll be responsible for designing and developing the core backend systems that power Fireworks AI’s high-performance generative AI platform. Your work will focus on ensuring efficiency, scalability, and stability in handling AI workloads
Design and build core backend software components, ensuring efficiency, scalability, and stability of system resources
Conduct design/code reviews and collaborate with cross-functional teams
Continuously analyze and optimize infrastructure efficiency for AI workloads (compute, storage, networking)

Our take

Whilst the development of generative AI is thought to be the reserve of large companies like Open AI, smaller startups such as Firework.AI are making this technology easier to access and develop for smaller companies wanting to handle specific business needs using AI. As an open-source model API, it has one of the largest user bases - with over 12,000 users leveraging Fireworks.AI’s software.

Though lacking the brand name recognition of generative AI developers like Google and Meta, Fireworks.AI differentiates itself in a market crowded with large competitors through its unique approach to deploying its software. It creates smaller, production-grade, customisable generative AI models that can be launched privately and securely, rather than the non-private and inflexible models built by larger companies.

After its 2024 Series B round of $52 million, Fireworks.AI has been valued at over $550 million, an impressive sum for a David in a sea of Goliaths. The company plans to use its funding to develop compound AI systems that can orchestrate across multiple single models. It will be interesting to see how the company evolves with its potentially disruptive business approach to generative AI.

Freddie

Company Specialist at Welcome to the Jungle

Company

Funding (2 rounds)

Jul 2024

$52m

SERIES B

Mar 2024

$25m

SERIES A

Total funding: $77m

Company HQ

Redwood City, CA

Leadership

Lin Qiao

(CEO)

Previously Senior Director of Engineering at Meta, Tech Lead at Linkedin, Research Staff Member at IBM Almaden Research Center and an Advisory Software Engineer at IBM Silicon Valley Lab.

Salary benchmarks

We don't have enough data yet to provide salary benchmarks for this role.

Submit your salary to help other candidates with crowdsourced salary estimates.

Share this job

View 10 more jobs at Fireworks AI