Staff Infrastructure Engineer, Groq

GroqCloud

$226-305k

+ Equity

Kubernetes

GCP

Terraform

Rust

Prometheus

Grafana

Git

flux

Senior and Expert level

San Francisco Bay Area

2 days a week in office (Palo Alto, CA)

AI semiconductor chip manufacturer

Job no longer available

AI semiconductor chip manufacturer

201-500 employees

B2BArtificial IntelligenceManufacturingMachine Learning

Job no longer available

$226-305k

+ Equity

Kubernetes

GCP

Terraform

Rust

Prometheus

Grafana

Git

flux

Senior and Expert level

San Francisco Bay Area

2 days a week in office (Palo Alto, CA)

201-500 employees

B2BArtificial IntelligenceManufacturingMachine Learning

Company mission

To increase developer velocity in machine learning by leading the way with simple, fast, innovative solutions.

Job

Company

Role

Who you are

6+ years of experience in software engineering or a related field
4+ years experience with GCP (especially VPC, Hybrid Networking, IAM, and GKE).
Actively working with modern Infrastructure-as-Code technologies (Kubernetes, Terraform, Flux/ArgoCD, Kustomize, Crossplane)
Experience with open-source monitoring tool (Prometheus, Grafana, VictoriaMetrics, VictoriaLogging and Alert Manager)
Deep experience in cloud technologies, global scale applications, and automation
Familiarity with multi-region deployments, including the associated networking, latency, and failover challenges
History of debugging production issues, mitigating, and driving efficient resolution
Comfortable reading, writing, and debugging software in multiple languages, especially Go and Rust
Thorough understanding of cloud-security best practices and modern compliance controls
Humility - Egos are checked at the door
Collaborative & Team Savvy - We make up the smartest person in the room, together
Growth & Giver Mindset - Learn it all versus know it all, we share knowledge generously
Curious & Innovative - Take a creative approach to projects, problems, and design
Passion, Grit, & Boldness - no limit thinking, fueling informed risk taking

What the job involves

Design, build, and maintain the infrastructure of GroqCloud as we 100x traffic in the coming year
Infrastructure Development: Design, build, and automate cloud infrastructure using Terraform to support a wide variety of needs
Service Deployment & Orchestration: Build and manage robust deployment pipelines and GitOps workflows into Kubernetes-based environments
Continuously improve CI/CD processes to facilitate rapid, reliable rollouts of new features and services, ensuring minimal downtime and maximum velocity
System troubleshooting: Lead investigations to determine root causes of system failures and develop scripts to repair and automate the upkeep of infrastructure components
Observability enhancement: Implement comprehensive monitoring (tracing, metrics, logging, alerting) to swiftly pinpoint, diagnose, and resolve system issues
Efficient incident response: Manage critical system incidents as a first responder, ensuring swift resolution and comprehensive post-incident analyses with implemented remediations
Cross Functional Collaboration: Collaborate with software engineers, platform & networking engineers, product managers and sales to enable feature delivery

Our take

Groq is an exciting semiconductor startup focused on creating advanced chips designed specifically for AI applications, particularly for AI inference, where models use trained data to deliver fast responses.

Groq aims to challenge Nvidia's dominance by focusing on speed and efficiency for AI deployment. While Nvidia's GPUs handle both training and running AI models, Groq's LPUs are optimized for inference tasks. With a recent $640M funding round, Groq plans to scale up and deploy over 100,000 LPUs by 2025.

To achieve this, the company has partnered with companies like Meta and Samsung, as well as sovereign entities like Saudi Aramco, showcasing the company's growth and potential. With its exciting technology, Groq is well-positioned to play a significant role in the AI chip market in the coming years.

Steph

Company Specialist at Welcome to the Jungle

Insights

Top investors

-19% employee growth in 12 months

Glassdoor (2.7)

Company

Funding (last 2 of 6 rounds)

Sep 2025

$750m

LATE VC

Aug 2024

$640m

SERIES D

Total funding: $1.8bn

Company HQ

Old Mountain View, Mountain View, CA

Leadership

Jonathan Ross

(Founder & CEO)

Majored in Mathematics and Computer Science at NYU. Joined Google as a Software Engineer in 2011, and was promoted to Hardware Engineer in 2013. Co-founded Google's Tensor Processing Unit. Was also a Rapid Evaluator at Google X, and then founded Groq in 2016, acting as its CTO before becoming the CEO in 2018.

Salary benchmarks

We don't have enough data yet to provide salary benchmarks for this role.

Submit your salary to help other candidates with crowdsourced salary estimates.

Share this job