Staff Machine Learning Engineer, Reddit
AI Serving
$253.3-354.6k
+ Equity
Online platform for thoughts, experiences & discussions
Job no longer available
Online platform for thoughts, experiences & discussions
1001+ employees
Job no longer available
$253.3-354.6k
+ Equity
1001+ employees
Company mission
To empower communities, and make their knowledge accessible to all.
Role
Who you are
- 7+ years of experience in ML Engineering, AI Platform Engineering, or Cloud AI Deployment roles
- Have experience operating orchestration systems such as Kubernetes at scale
- Deep experience with cloud-based technologies for supporting an ML platform, including tools like AWS, Google Cloud Storage, infrastructure-as-code (Terraform), and more
- Proficiency with the common programming languages and frameworks of ML, such as Go, Python, etc
- Excellent communication skills with the ability to articulate technical AI concepts to non-technical stakeholders
- Strong focus on scalability, reliability, performance, and ease of use. You are an undying advocate for platform users and have a deep intuition for the genAI product development lifecycle
- Strong knowledge of model serving, inference pipelines, monitoring, and observability for AI systems is a plus
- Strong proficiency in Python and deep experience with modern AI/ML frameworks (Triton, Dynamo, vLLM, Pytorch)
What the job involves
- The Machine Learning Platform team at Reddit is a high-impact team that owns the infrastructure that powers recommendations, content discovery, user and content quantification, while directly impacting other teams such as Growth, Ads, Feeds, and Core Machine Learning teams
- As a Staff Machine Learning Engineer, you will lead the development of a large-scale ML Inference Platform at Reddit
- Lead the end-to-end design, implementation, and maintenance of a highly available, low-latency GPU-based model serving system for search, ranking, and LLMs supporting Millions of QPS
- Design and develop ML and Generative AI systems in cloud-based production environments on Kubernetes at scale
- Rapidly develop prototypes and develop a high-performance feature hydration and processing system as a part of the inference stack - including routing, caching, and batching
- Lead a unified GPU model export framework to support converting trained models into optimized GPU inference models
- Strong understanding of real-time ML observability to track feature/model performance
- Experience working with LLM serving online at scale
- Built an E2E inference performance benchmarking framework
- Deep Understanding of multi-cluster compute environment and network topology that is specific to ML inference use cases
Application process
- In select roles and locations, the interviews will be recorded, transcribed and summarized by artificial intelligence (AI). You will have the opportunity to opt out of recording, transcription and summarization prior to any scheduled interviews
Our take
Reddits is an online platform that hosts thousands of message board communities (known as subreddits) designed to foster authentic human connection. With more than 130,000 communities covering everything from food, entertainment and sports, to niche interests for highly specific audiences, there's virtually a space for everyone.
The platform attracts over 120 million daily users and billions of monthly page views. While these figures are smaller than those of social media giants like Facebook and X, Reddit stands out by offering easily discoverable communities where users can dive deep into virtually any topic imaginable.
Today, Reddit continues to grow its user base and expand its reach, remaining a unique hub for conversation, connection and shared interests. With its strong community-driven model and steady revenue streams, it's most definitely positioned to stay a central part of online culture for years to come.
Kirsty
Company Specialist at Welcome to the Jungle
Insights
57% employee growth in 12 months
Company
Funding (last 2 of 6 rounds)
Aug 2021
$410m
SERIES F
Feb 2021
$250m
SERIES E
Total funding: $1.2bn
Company benefits
- Comprehensive health benefits
- Flexible vacation & Reddit global days off
- Family planning funds & 4+ months paid parental leave
- Personal & professional development funds
- Paid volunteer time off
- Workspace & home office benefits
Company HQ
SoMa, San Francisco, CA
Leadership
Steve Huffman
(CEO & Founder)After co-founding Reddit in 2005, they stepped away from the company to co-found Hipmunk, where they were the CTO for 5 years. They returned to Reddit in 2015, and have been the CEO since.
Share this job
View 143 more jobs at Reddit