Software Engineer, Snowflake
LLM infrastructure
$195-287.5k
+ This role is eligible to participate in Snowflake’s bonus and equity plan.
3-5 days a week in office (San Mateo, CA)
Cloud data platform providing data warehouse-as-a-service for the cloud
Be an early applicant
Cloud data platform providing data warehouse-as-a-service for the cloud
1001+ employees
Be an early applicant
$195-287.5k
+ This role is eligible to participate in Snowflake’s bonus and equity plan.
3-5 days a week in office (San Mateo, CA)
1001+ employees
Company mission
On a mission to mobilize the world's data.
Role
Who you are
- We are seeking a skilled and experienced Infrastructure Engineer to join our AI/ML organization
- Have 2+ years of industry experience designing, building, and supporting Internet serving infrastructure, machine learning platforms, machine learning services and frameworks
- Experience working with vLLM or similar technologies
- Proficiency in cloud computing platforms such as AWS, Azure, or GCP
- Strong programming skills in at least one of Python, Go, Java, C++
- Experience with containerization and orchestration tools such as Docker and Kubernetes
- Solid understanding of distributed computing, parallel processing, and data storage systems (e.g., Hadoop, Spark, Elasticsearch)
- Knowledge of security best practices and data protection measures in AI environments
- Excellent problem-solving skills and ability to troubleshoot complex issues in a production environment
- Strong communication skills and ability to collaborate effectively in a cross-functional team environment
- BS/MS/PhD in Computer Science, Engineering, or a related field
What the job involves
- In this role, you will be responsible for designing, developing, and maintaining the infrastructure that supports serving large language models with world class performance and availability
- Contribute to the open source vLLM inference engine
- Design and implement scalable infrastructure solutions to support the deployment of large language models
- Optimize compute, storage, and networking resources to enhance the performance and cost-efficiency of LLM operations
- Develop and maintain tools for monitoring and managing LLM performance, including resource utilization, latency, and throughput
- Implement security measures and best practices to protect sensitive data processed by LLMs
- Troubleshoot and resolve infrastructure issues in a timely manner, ensuring minimal disruption to model deployment and availability
- Stay updated with advancements in AI infrastructure technologies and contribute to the adoption of new tools and frameworks
- Document infrastructure designs, processes, and configurations for knowledge sharing and training purposes
- Provide technical guidance and mentorship to junior members of the infrastructure team
Our take
Developed as a fresh alternative to the archaic systems of data governance and information silos, Snowflake is a frictionless cloud data platform that removes the barriers preventing organizations of all sizes from unleashing the true value of their data.
The company equips organizations with a single, integrated platform that offers the only data warehouse built for the cloud; instant, secure and governed access to their entire network of data; and a core architecture to enable many types of data workloads, including a single platform for developing modern data applications.
Major competitors include Azure, SQL and AWS, and Snowflake has managed to keep ahead of the competition, cementing itself as a global force. Across its 1300+ partners, the company's cloud manages over 250PB of data (with more than 515 million data workloads running every day). Its continued focus on product R&D and partnership expansion have Snowflake well-positioned to manage itself amidst the competition.
Freddie
Company Specialist at Welcome to the Jungle
Insights
Company
Funding (last 2 of 9 rounds)
Feb 2020
$479m
LATE VC
Oct 2018
$450m
LATE VC
Total funding: $1.4bn
Company benefits
- Comprehensive health insurance plans
- Health savings accounts
- Robust retirement plans
- Life and disability insurance
- Weekly online lunch and learns
- Virtual workout classes
- Ergonomic work-from-home equipment
- On-demand mental health and wellness programs
- Fertility benefits and family planning resources
- Generous time-off and various leave plans
- Onsite and Remote Work
- Employee discounts and pre-tax selections
- New hire equity + Employee Stock Purchase Plan (ESPP)
- Quarterly bonus or commission program
Company values
- Put Customers First - We only succeed when our customers succeed
- Integrity Always - Be open, honest and respectful
- Think Big - Be ambitious and have big goals
- Be Excellent - Quality and excellence count in everything we do
- Get It Done - Results matter. Work hard and smart
- Own It - Build our product and our company like it’s yours, because it is
- Make Each Other the Best - Treat people with kindness and respect
- Embrace Each Other's Differences - Accept and appreciate everyone from every walk of life
Company HQ
Bozeman, MT
Articles
Leadership
Benoit Dageville
(Co-Founder)Benoit, a leading expert in parallel execution and self-tuning databases, founded Snowflake after 10+ years at Oracle as a lead architect. He holds a PhD in Computer Science and has 270+ patents.
Thierry Cruanes
(Co-Founder)Thierry is a leading expert in query optimization and parallel execution. He has a PhD in Computer Science with a focus in Database Systems and is a named inventor on 200+ patents.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Diversity, Equity & Inclusion at Snowflake
- At Snowflake, embracing each others’ differences is a core value of our organization. We recognize and appreciate the importance of creating an environment in which all employees feel valued, included, and empowered to do their best work and bring great ideas to the table. Promoting the values of diversity and fostering an inclusive workplace culture takes each of us working together, caring deeply, and acting intentionally.
- Since Day 1, Snowflake and its culture belong to each of us, We “own it.” Owning it means we continually look for ways to improve and it’s in that spirit that our Diversity Council was formed. Our Council spans every functional area with an eye towards diverse representation across a range of demographics - 50% female, 50% persons of color, 21% LGBTQ, 7% persons with disabilities, and four generations. The Council narrowed in on three priority areas to focus our initiatives and impact positive change.
- 1. Enabling employee and community readiness by creating focus groups and using data to reveal deeper insights into our community and our specific needs and challenges to guide our future efforts and target initiatives.
- 2. Empowering employees’ voices by organizing outlets for conversation, spotlighting different employee stories, building mentorship programs, and supporting cultural inclusion.
- 3. Building external partnerships to broaden demographic representation in our candidate pipeline and educational partnerships to enable equitable opportunities for generations to come.
- As a company of action, we are committed to managing and measuring our forward progress around diversity and inclusion. And because we are a data company, the approach of gaining insights from the data, setting targets, measuring results, and iterating is in our DNA. We have put in place the foundational groundwork to ensure diversity, equity, and inclusion for right now and for the future of Snowflake.
Share this job
View 181 more jobs at Snowflake