Software Engineer, Snowflake

LLM infrastructure

$195-287.5k

+ This role is eligible to participate in Snowflake’s bonus and equity plan.

AWS

Docker

Kubernetes

GCP

Python

Java

Elasticsearch

C++

Hadoop

Azure

Spark

Junior and Mid level

San Francisco Bay Area

3-5 days a week in office (San Mateo, CA)

AI Data Cloud for data sharing and app building

Job no longer available

AI Data Cloud for data sharing and app building

1001+ employees

B2BArtificial IntelligenceData storageEnterpriseAnalyticsMachine LearningSaaSData AnalysisCloud ComputingData Sharing

Job no longer available

$195-287.5k

+ This role is eligible to participate in Snowflake’s bonus and equity plan.

AWS

Docker

Kubernetes

GCP

Python

Java

Elasticsearch

C++

Hadoop

Azure

Spark

Junior and Mid level

San Francisco Bay Area

3-5 days a week in office (San Mateo, CA)

1001+ employees

B2BArtificial IntelligenceData storageEnterpriseAnalyticsMachine LearningSaaSData AnalysisCloud ComputingData Sharing

Company mission

On a mission to mobilize the world's data.

Job

Company

Role

Who you are

We are seeking a skilled and experienced Infrastructure Engineer to join our AI/ML organization
Have 2+ years of industry experience designing, building, and supporting Internet serving infrastructure, machine learning platforms, machine learning services and frameworks
Experience working with vLLM or similar technologies
Proficiency in cloud computing platforms such as AWS, Azure, or GCP
Strong programming skills in at least one of Python, Go, Java, C++
Experience with containerization and orchestration tools such as Docker and Kubernetes
Solid understanding of distributed computing, parallel processing, and data storage systems (e.g., Hadoop, Spark, Elasticsearch)
Knowledge of security best practices and data protection measures in AI environments
Excellent problem-solving skills and ability to troubleshoot complex issues in a production environment
Strong communication skills and ability to collaborate effectively in a cross-functional team environment
BS/MS/PhD in Computer Science, Engineering, or a related field

What the job involves

In this role, you will be responsible for designing, developing, and maintaining the infrastructure that supports serving large language models with world class performance and availability
Contribute to the open source vLLM inference engine
Design and implement scalable infrastructure solutions to support the deployment of large language models
Optimize compute, storage, and networking resources to enhance the performance and cost-efficiency of LLM operations
Develop and maintain tools for monitoring and managing LLM performance, including resource utilization, latency, and throughput
Implement security measures and best practices to protect sensitive data processed by LLMs
Troubleshoot and resolve infrastructure issues in a timely manner, ensuring minimal disruption to model deployment and availability
Stay updated with advancements in AI infrastructure technologies and contribute to the adoption of new tools and frameworks
Document infrastructure designs, processes, and configurations for knowledge sharing and training purposes
Provide technical guidance and mentorship to junior members of the infrastructure team

Our take

Developed as a fresh alternative to the archaic systems of data governance and information silos, Snowflake is a frictionless cloud data platform that removes the barriers preventing organizations of all sizes from unleashing the true value of their data.

The company equips organizations with a single, integrated platform that offers the only data warehouse built for the cloud; instant, secure and governed access to their entire network of data; and a core architecture to enable many types of data workloads, including a single platform for developing modern data applications.

Major competitors include Azure, SQL and AWS, and Snowflake has managed to keep ahead of the competition, cementing itself as a global force. Across its 1300+ partners, the company's cloud manages over 250PB of data (with more than 515 million data workloads running every day). Its continued focus on product R&D and partnership expansion have Snowflake well-positioned to manage itself amidst the competition.

Freddie

Company Specialist at Welcome to the Jungle

Insights

Top investors

37% employee growth in 12 months

Glassdoor (3.9)

Company

Funding (last 2 of 9 rounds)

Feb 2020

$479m

LATE VC

Oct 2018

$450m

LATE VC

Total funding: $1.4bn

Company benefits

Comprehensive health insurance plans
Health savings accounts
Robust retirement plans
Life and disability insurance
Weekly online lunch and learns
Virtual workout classes
Ergonomic work-from-home equipment
On-demand mental health and wellness programs
Fertility benefits and family planning resources
Generous time-off and various leave plans
Onsite and Remote Work
Employee discounts and pre-tax selections
New hire equity + Employee Stock Purchase Plan (ESPP)
Quarterly bonus or commission program

Company HQ

Bozeman, MT

Leadership

Benoit Dageville

(Co-Founder)

Benoit, a leading expert in parallel execution and self-tuning databases, founded Snowflake after 10+ years at Oracle as a lead architect. He holds a PhD in Computer Science and has 270+ patents.

Thierry Cruanes

(Co-Founder)

Thierry is a leading expert in query optimization and parallel execution. He has a PhD in Computer Science with a focus in Database Systems and is a named inventor on 200+ patents.

Sridhar Ramaswamy

(Chief Executive Officer)

Sridhar joined Snowflake in 2023 via the Neeva acquisition as SVP of AI and later became CEO. He co-founded Neeva and previously led Google’s Ads business, growing it from $1.5B to $100B.

Salary benchmarks

We don't have enough data yet to provide salary benchmarks for this role.

Submit your salary to help other candidates with crowdsourced salary estimates.

Share this job

View 189 more jobs at Snowflake