Senior Site Reliability Engineer, Fireworks AI
More information about location
3 days a week in office (Redwood City, CA)
Generative AI platform enabling rapid scaling for developers and businesses
Be an early applicant
Generative AI platform enabling rapid scaling for developers and businesses
21-100 employees
Be an early applicant
More information about location
3 days a week in office (Redwood City, CA)
21-100 employees
Company mission
To help every organization unleash the full power of artificial intelligence
Role
Who you are
- This role is for someone passionate about operating highly robust, observable, and automated systems and enabling customer successes
- Bachelor's degree in Computer Science, related technical field, or equivalent practical experience
- 5+ years of experience in Site Reliability Engineering, DevOps, or a similar role focused on large-scale production systems
- Deep expertise in SRE principles and practices, including SLOs, SLIs, operational automation, incident management, and post-mortems
- Extensive hands-on experience with public cloud platforms (AWS, GCP, Azure), including compute, networking, storage, and database services
- Strong experience with containerization technologies (Docker) and orchestration platforms (Kubernetes)
- Proficiency in designing and implementing robust monitoring, logging, and alerting systems using tools like Prometheus, Grafana, ELK stack, and distributed tracing
- Solid programming/scripting skills in at least one language (e.g., Python, Go) for automation and tool development
- In-depth knowledge of Linux operating systems, networking fundamentals, and system debugging
- Proven ability to troubleshoot complex issues across the entire stack
- Excellent communication, collaboration, and problem-solving skills
- Willingness to participate in on-call rotations
Desirable
- Experience of managing data center grade GPU clusters with GPU (and peripherals like HBM and RDMA enabled networking) monitoring, troubleshooting, and fixing
- Experience with machine learning infrastructure, model serving, or distributed AI frameworks
- Hands-on experience in security and data protection
What the job involves
- As a Senior Site Reliability Engineer (SRE) at Fireworks AI, you will play a critical role in making our world-scale virtual AI cloud reliable, performant, and efficient
- You will apply your expertise in large-scale distributed systems, cloud infrastructure, and operational excellence
- You will partner closely with world-class software engineers and AI experts to scale cutting-edge AI platforms to meet the fast-growing demands and ever-evolving application paradigms
- Ensuring System Reliability: Ensure systems are designed and implemented with high availability, scalability, and performance. Focus on fault tolerance, disaster recovery, identifying and removing scaling bottlenecks, and performance optimization across our multi-cloud infrastructure
- Incident Management & Response: Lead efforts in incident detection, response, and resolution for critical production issues. Drive post-mortems to identify root causes and implement preventative measures to improve system reliability
- Observability & Monitoring: Develop, implement, and maintain comprehensive monitoring, alerting, logging, and tracing solutions to provide deep insights into system health and performance
- Automation & Toil Reduction: Identify and automate repetitive operational tasks to reduce toil and improve operational efficiency. Develop tools and scripts to streamline deployments, scaling, and system management
- Capacity Planning & Performance Tuning: Work proactively on capacity planning to ensure our infrastructure can gracefully handle growth and peak loads. Optimize system performance and resource utilization
- Reliability Best Practices: Collaborate with software engineers to embed reliability principles (e.g., SLOs, SLIs, error budgets) into the development lifecycle, promoting a culture of operational excellence
- On-call Rotation: Participate in a periodic on-call rotation to support our production environment and respond to critical alerts
Our take
Whilst the development of generative AI is thought to be the reserve of large companies like Open AI, smaller startups such as Firework.AI are making this technology easier to access and develop for smaller companies wanting to handle specific business needs using AI. As an open-source model API, it has one of the largest user bases - with over 12,000 users leveraging Fireworks.AI’s software.
Though lacking the brand name recognition of generative AI developers like Google and Meta, Fireworks.AI differentiates itself in a market crowded with large competitors through its unique approach to deploying its software. It creates smaller, production-grade, customisable generative AI models that can be launched privately and securely, rather than the non-private and inflexible models built by larger companies.
After its 2024 Series B round of $52 million, Fireworks.AI has been valued at over $550 million, an impressive sum for a David in a sea of Goliaths. The company plans to use its funding to develop compound AI systems that can orchestrate across multiple single models. It will be interesting to see how the company evolves with its potentially disruptive business approach to generative AI.
Freddie
Company Specialist at Welcome to the Jungle
Company
Funding (2 rounds)
Jul 2024
$52m
SERIES B
Mar 2024
$25m
SERIES A
Total funding: $77m
Company HQ
Redwood City, CA
Leadership
Lin Qiao
(CEO)Previously Senior Director of Engineering at Meta, Tech Lead at Linkedin, Research Staff Member at IBM Almaden Research Center and an Advisory Software Engineer at IBM Silicon Valley Lab.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 16 more jobs at Fireworks AI