Principal Site Reliability Engineer, Groq
GroqCloud
$165.2-332.3k
+ Equity
AI semiconductor chip manufacturer
Job no longer available
AI semiconductor chip manufacturer
201-500 employees
Job no longer available
$165.2-332.3k
+ Equity
201-500 employees
Company mission
To increase developer velocity in machine learning by leading the way with simple, fast, innovative solutions.
Role
Who you are
- Proven SRE experience: Extensive background in managing high-availability systems across multiple cloud or data center environments
- Technical versatility: Proficiency in modern programming languages with a readiness to engage daily with Golang, Rust, Python, C++, Terraform, Flux
- Systems expertise: Advanced understanding of Linux, Kubernetes, Cilium (eBPF), Prometheus, PostgreSQL, BigQuery
- Network savvy: Robust knowledge in networking, high-performance computing, and observability
- Orchestration mastery: Experienced in developing software that orchestrates vast and complex systems and infrastructures
- CI/CD obsessed: Strong familiarity with Git and modern GitOps based software development lifecycle practices
- Leadership and collaboration: Demonstrated ability to lead initiatives and collaborate effectively with dispersed teams to achieve rapid results
- Analytically minded: Skilled in dissecting and resolving multifaceted system and hardware issues
- Passion for performance: A passion for obsessing about performance and highly reliable software and hardware
What the job involves
- Your mission is to ensure the reliability of our APIs as customers route their AI workloads through Groq’s insanely fast, purpose-built hardware and software systems, ensuring seamless performance and exceptional service delivery
- Enhance system reliability: Refine our operational practices to increase uptime and resilience, notably reducing downtime and securing consistent performance across multiple regions
- System troubleshooting: Lead investigations to determine root causes of system failures and develop scripts to repair and automate the upkeep of infrastructure components
- Observability enhancement: Implement comprehensive monitoring (tracing, metrics, logging, alerting) to swiftly pinpoint, diagnose, and resolve system issues
- Smart orchestration: Collaborate closely with teams to facilitate their applications’ transition to Kubernetes, ensuring seamless migrations and optimal performance, while enhancing automated health checks for fully autonomous scheduling
- Resilient systems: Develop tools and strategies to enhance application robustness against network and dependency issues
- Improved performance: At Groq, every nanosecond counts. Aid teams in optimizing consistent system responsiveness to enhance customer interactions
- Trustworthy system data: Assist and enable engineering teams to have a clear understanding of how the infrastructure and their systems are performing
- Self-healing systems: Write tooling (Go, Rust, C++, Python) to assist our infrastructure to self-diagnose and self-heal. This could be measuring fiber optic latency or on-chip sensors one day, writing Kubernetes Daemonsets/CRDs the next, then working in Go-based HTTP systems
- Security and compliance: Uphold the highest security standards to safeguard customer data, aligning with stringent compliance protocols
- Efficient incident response: Manage critical system incidents as a first responder, ensuring swift resolution and comprehensive post-incident analyses with implemented remediations
Our take
Groq is an exciting semiconductor startup focused on creating advanced chips designed specifically for AI applications, particularly for AI inference, where models use trained data to deliver fast responses.
Groq aims to challenge Nvidia's dominance by focusing on speed and efficiency for AI deployment. While Nvidia's GPUs handle both training and running AI models, Groq's LPUs are optimized for inference tasks. With a recent $640M funding round, Groq plans to scale up and deploy over 100,000 LPUs by 2025.
To achieve this, the company has partnered with companies like Meta and Samsung, as well as sovereign entities like Saudi Aramco, showcasing the company's growth and potential. With its exciting technology, Groq is well-positioned to play a significant role in the AI chip market in the coming years.
Steph
Company Specialist at Welcome to the Jungle
Insights
-19% employee growth in 12 months
Company
Funding (last 2 of 6 rounds)
Sep 2025
$750m
LATE VC
Aug 2024
$640m
SERIES D
Total funding: $1.8bn
Company HQ
Old Mountain View, Mountain View, CA
Leadership
Jonathan Ross
(Founder & CEO)Majored in Mathematics and Computer Science at NYU. Joined Google as a Software Engineer in 2011, and was promoted to Hardware Engineer in 2013. Co-founded Google's Tensor Processing Unit. Was also a Rapid Evaluator at Google X, and then founded Groq in 2016, acting as its CTO before becoming the CEO in 2018.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job