Cloud Backend Engineering Intern, Groq

Salary not provided

The US pay range for our technical internships is $30-$50 / per hour

GCP

San Francisco Bay Area

Toronto

AI semiconductor chip manufacturer

Job no longer available

AI semiconductor chip manufacturer

201-500 employees

B2BArtificial IntelligenceManufacturingMachine Learning

Job no longer available

Salary not provided

The US pay range for our technical internships is $30-$50 / per hour

GCP

San Francisco Bay Area

Toronto

201-500 employees

B2BArtificial IntelligenceManufacturingMachine Learning

Company mission

To increase developer velocity in machine learning by leading the way with simple, fast, innovative solutions.

Job

Company

Role

Who you are

Pursuing a degree in computer science, engineering, or a related field
A demonstrated interest in Generative AI. Candidates with experience building on Groq’s apis will be given extra consideration
Experience building services in a cloud environment such as GCP
Strong problem-solving skills
Must be authorized to work in the United States or Canada

What the job involves

Groq's Summer Internship Program runs from May - September and is full-time during the duration of the internship
As a cloud engineering intern, you will have the opportunity to work on development, deployment, instrumentation, and maintenance of scalable and highly available services on our cloud environment, Google Cloud Platform (GCP)
You will work closely with our team to build cloud-native solutions, automation scripts, backend apis, and implement monitoring and logging tools
This is an excellent opportunity to gain hands-on experience with cloud computing, and to develop skills around reliability, performance, devops practices, CI/CD and more
Assist in the design and deployment of cloud infrastructure to support AI and machine learning workloads on Groq hardware
Automate cloud operations using Infrastructure-as-Code (IaC)
Gain experience with CI/CD pipelines, cloud monitoring, and troubleshooting to ensure system reliability
Build out our inference apis and the apis that service Groq’s console experience
Drive availability and performance improvements across our inference apis
Collaborate with members across teams to build and release software quickly

Our take

Groq is an exciting semiconductor startup focused on creating advanced chips designed specifically for AI applications, particularly for AI inference, where models use trained data to deliver fast responses.

Groq aims to challenge Nvidia's dominance by focusing on speed and efficiency for AI deployment. While Nvidia's GPUs handle both training and running AI models, Groq's LPUs are optimized for inference tasks. With a recent $640M funding round, Groq plans to scale up and deploy over 100,000 LPUs by 2025.

To achieve this, the company has partnered with companies like Meta and Samsung, as well as sovereign entities like Saudi Aramco, showcasing the company's growth and potential. With its exciting technology, Groq is well-positioned to play a significant role in the AI chip market in the coming years.

Steph

Company Specialist at Welcome to the Jungle

Insights

Top investors

-19% employee growth in 12 months

Glassdoor (2.7)

Company

Funding (last 2 of 6 rounds)

Sep 2025

$750m

LATE VC

Aug 2024

$640m

SERIES D

Total funding: $1.8bn

Company HQ

Old Mountain View, Mountain View, CA

Leadership

Jonathan Ross

(Founder & CEO)

Majored in Mathematics and Computer Science at NYU. Joined Google as a Software Engineer in 2011, and was promoted to Hardware Engineer in 2013. Co-founded Google's Tensor Processing Unit. Was also a Rapid Evaluator at Google X, and then founded Groq in 2016, acting as its CTO before becoming the CEO in 2018.

Salary benchmarks

We don't have enough data yet to provide salary benchmarks for this role.

Submit your salary to help other candidates with crowdsourced salary estimates.

Share this job