Staff Software Engineer, Groq

Salary not provided

+ Equity

Kubernetes

Kafka

Terraform

Prometheus

Grafana

BigQuery

REST API

Golang

Senior and Expert level

Remote from US

AI semiconductor chip manufacturer

Job no longer available

AI semiconductor chip manufacturer

201-500 employees

B2BArtificial IntelligenceManufacturingMachine Learning

Job no longer available

Salary not provided

+ Equity

Kubernetes

Kafka

Terraform

Prometheus

Grafana

BigQuery

REST API

Golang

Senior and Expert level

Remote from US

201-500 employees

B2BArtificial IntelligenceManufacturingMachine Learning

Company mission

To increase developer velocity in machine learning by leading the way with simple, fast, innovative solutions.

Job

Company

Role

Who you are

6+ years of software development experience
3+ years writing software in Go as your primary language
Passion for LLMs and knowledge of how to interact with them (constrained decoding, output safeguards, etc)
Strong understanding of API design principles and RESTful architectures
Familiarity with multi-region application deployment and associated challenges
Experience with Kubernetes, Terraform, PubSub/Kafka/Pulsar, and Stytch
Experience with Bigquery, Honeycomb, Prometheus + Grafana
Experience building customer facing RESTful APIs
Familiarity with streaming architectures and real-time data processing building large data processing flows
Experience shipping code to production daily
Authorized to work in the United States
Available to work US Pacific hours

What the job involves

Build the APIs and services that will enable over 1M developers to run incredibly fast inference workloads on GroqCloud
Design & Build APIs: Design, develop, and maintain scalable, high-performance backend systems and customer facing APIs that support our inference and console experiences
Infrastructure Deployment: Provision and deploy services into our Kubernetes-based environment
Testing and Validation: Develop and implement automated testing frameworks and test suites to ensure software quality and reliability. Write tests at all levels and scopes of Groq’s systems using best practices and pragmatic, scalable testing philosophy
Monitoring and Observability: Ensure that we understand the performance and quality of our services running in production and can swiftly respond when needed
Cross Functional Collaboration: Collaborate with product, design, and other engineers to ship features from idea to production

Our take

Groq is an exciting semiconductor startup focused on creating advanced chips designed specifically for AI applications, particularly for AI inference, where models use trained data to deliver fast responses.

Groq aims to challenge Nvidia's dominance by focusing on speed and efficiency for AI deployment. While Nvidia's GPUs handle both training and running AI models, Groq's LPUs are optimized for inference tasks. With a recent $640M funding round, Groq plans to scale up and deploy over 100,000 LPUs by 2025.

To achieve this, the company has partnered with companies like Meta and Samsung, as well as sovereign entities like Saudi Aramco, showcasing the company's growth and potential. With its exciting technology, Groq is well-positioned to play a significant role in the AI chip market in the coming years.

Steph

Company Specialist at Welcome to the Jungle

Insights

Top investors

-19% employee growth in 12 months

Glassdoor (2.7)

Company

Funding (last 2 of 5 rounds)

Aug 2024

$640m

SERIES D

Jul 2024

$300m

SERIES D

Total funding: $1.3bn

Company HQ

Old Mountain View, Mountain View, CA

Leadership

Jonathan Ross

(Founder & CEO)

Majored in Mathematics and Computer Science at NYU. Joined Google as a Software Engineer in 2011, and was promoted to Hardware Engineer in 2013. Co-founded Google's Tensor Processing Unit. Was also a Rapid Evaluator at Google X, and then founded Groq in 2016, acting as its CTO before becoming the CEO in 2018.

Share this job

View 4 more jobs at Groq