Director of Engineering, Groq
Compute
$300-375k
+ Equity
Office located in Palo Alto, CA
AI semiconductor chip manufacturer
Be an early applicant
AI semiconductor chip manufacturer
201-500 employees
Be an early applicant
$300-375k
+ Equity
Office located in Palo Alto, CA
201-500 employees
Company mission
To increase developer velocity in machine learning by leading the way with simple, fast, innovative solutions.
Role
Who you are
- Proven leadership experience in highly technical engineering environments, with a track record of delivering innovative platform solutions and effectively leading, motivating, and developing high-performing engineering teams
- Demonstrated excellence in communication, negotiation, and interpersonal interactions across executives, cross-functional stakeholders, and team members, with a strong ability to influence and drive organizational change
- Extensive experience architecting and building large-scale hyperscaler compute platforms
- Deep technical expertise with container orchestration, high-performance computing environments, infrastructure automation tools, and cloud-native technologies
- Strong familiarity with data center networking, compute hardware, and infrastructure performance tuning
- Humility - Egos are checked at the door
- Collaborative & Team Savvy - We make up the smartest person in the room, together
- Growth & Giver Mindset - Learn it all versus know it all, we share knowledge generously
- Curious & Innovative - Take a creative approach to projects, problems, and design
- Passion, Grit, & Boldness - no limit thinking, fueling informed risk taking
What the job involves
- Lead the Compute team in building and operating the world’s largest hyperscaler specifically designed for AI inference, tailored to Groq’s hardware across our global data center footprint
- The Compute team develops the foundational compute platform and critical services, including Datacenter Infrastructure Management (DCIM), hardware inventory systems, container and inference orchestration frameworks, observability and monitoring tools, and data center operations automation
- Your role is pivotal in defining, implementing, and scaling Groq’s hyperscaler infrastructure
- Architect and oversee the development of Groq’s hyperscale compute platform, ensuring scalability, reliability, and security
- Lead highly technical engineering teams focused on container orchestration, hardware provisioning, and platform automation
- Own and continuously enhance Groq’s hyperscaler infrastructure, operating across multiple global data centers
- Provide technical leadership in infrastructure automation, containerization technologies, and high-performance computing architecture
- Define and execute technical roadmaps that advance Groq’s capability to manage large-scale infrastructure efficiently
Our take
Groq is an exciting semiconductor startup focused on creating advanced chips designed specifically for AI applications, particularly for AI inference, where models use trained data to deliver fast responses.
Groq aims to challenge Nvidia's dominance by focusing on speed and efficiency for AI deployment. While Nvidia's GPUs handle both training and running AI models, Groq's LPUs are optimized for inference tasks. With a recent $640M funding round, Groq plans to scale up and deploy over 100,000 LPUs by 2025.
To achieve this, the company has partnered with companies like Meta and Samsung, as well as sovereign entities like Saudi Aramco, showcasing the company's growth and potential. With its exciting technology, Groq is well-positioned to play a significant role in the AI chip market in the coming years.
Steph
Company Specialist at Welcome to the Jungle
Insights
-19% employee growth in 12 months
Company
Funding (last 2 of 5 rounds)
Aug 2024
$640m
SERIES D
Jul 2024
$300m
SERIES D
Total funding: $1.3bn
Company HQ
Old Mountain View, Mountain View, CA
Leadership
Jonathan Ross
(Founder & CEO)Majored in Mathematics and Computer Science at NYU. Joined Google as a Software Engineer in 2011, and was promoted to Hardware Engineer in 2013. Co-founded Google's Tensor Processing Unit. Was also a Rapid Evaluator at Google X, and then founded Groq in 2016, acting as its CTO before becoming the CEO in 2018.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 5 more jobs at Groq