Data Scientist, Roblox
Foundation AI, PhD Early Career, 2026
$185.9-221.4k
+ Equity
More information about location
3-5 days a week in office (San Mateo, CA)
Online gaming and entertainment platform
Be an early applicant
Online gaming and entertainment platform
1001+ employees
Be an early applicant
$185.9-221.4k
+ Equity
More information about location
3-5 days a week in office (San Mateo, CA)
1001+ employees
Company mission
To connect a billion people with optimism and civility.
Role
Who you are
- Possess or pursuing a PhD or equivalent in Statistics, Economics, Computer Science, Applied Math, Physics, Engineering, or a related quantitative field
- Technical Proficiency: Strong proficiency in SQL (Hive/Spark) for manipulating large datasets and scripting languages (Python or R) for analysis and modeling
- Experimentation and Causal Inference: A solid grounding in experimentation, causal inference, and statistical analysis, including test design and metric design for feature impact
- Problem Solving: A demonstrated track record of framing ambiguous problems, designing analytical approaches, and solving open-ended data science problems that drive business impact
- Learning Agility: Ability to effectively and responsibly use AI tools to enhance productivity and a passion for continuously improving methods in a fast-evolving field
- GenAI Familiarity: Familiarity with GenAI models and safety/quality evaluation methods. Expertise in the model training lifecycle is a plus (e.g., fine-tuning, RLHF, or synthetic data generation)
- Applied Research Background: A track record of applied research or publications in relevant technical fields is highly valued
What the job involves
- The Data Science & Analytics organization's mission is to increase our speed, frequency, and acumen in making decisions at scale by instilling a data-influenced approach to building products. We cover a wide area of the data spectrum, including analytical data engineering, product analytics, experimentation, causal inference, statistical modeling, and machine learning
- Aligned and partnered with product verticals, we use this extensive tool belt to discover new opportunities and unmet use cases, influence and craft the product roadmap, and prioritize, build data products, and measure impact on our community of players and developers
- Our team’s mission is to enable Roblox Creators to bring GenAI capabilities to millions of users. We drive this innovation with a core commitment to safety, responsibility, and quality
- As a Data Scientist, you will play a critical role in evaluation and optimization for user-facing GenAI systems (such as text, image, video, 3D, 4D). You will define how we measure safety, responsibility, quality, and efficiency. You will combine annotation analysis, design of experiments, causal inference, model-based evaluation methods (such as LLM-as-a-judge), optimization algorithm, and AI models to drive product decisions and model improvements
- Develop Evaluation Frameworks: Design and operationalize rigorous evaluation systems for either GenAI features (text, image, video, 3D, 4D). This includes eval experiment design, dataset design, label reliability analysis, and implementing and finetuning LLM-as-judge methods
- Run Rigorous Experiments: Conduct online experiments (A/B tests) and causal inference to quantify the impact of GenAI features. You will identify opportunities, measure lift, and ensure statistical rigor
- Define Success Metrics: Partner with cross-functional teams to define leading/lagging indicators for GenAI feature user satisfaction, business success, and safety
- Build Automated Systems: Research and apply state-of-the-art methodologies to build reproducible evaluation tooling that lift rigor and efficiency across the company
- Conduct Applied Research at the Frontier: Maintain an active pulse on the intersection of Gen AI and Data Science. You will innovate on methodology and techniques to solve unique business challenges while contributing to the broader field in the technical community
Application process
- You may redact age, date of birth, and dates of attendance/graduation from your resume if you prefer
Our take
Online gaming may be a well-established space, but Roblox has distinguished itself as a leader by empowering its community to build, share, and profit from their own creations, turning game development into an accessible, rewarding ecosystem for millions of users.
In addition to standard games, the platform offers virtual worlds and other experiences to explore and interact with. Its platform provides an online ecosystem for millions to create, socialize, chat, and explore immersive experiences with friends. In fact, in the US its used by two-thirds of children aged 9 to 12.
While the platform does face scrutiny over users safety (particularly given its young audience) the company's efforts to strengthen parental controls and open dialogue through initiatives like its new Parents Council signal a growing commitment to addressing these challenges. At the same time, its financial performance and creator-focused investments underscore a business in very strong health. With record payouts to developers, an expanding older player base, and a platform that increasingly rewards creative talent, Roblox's trajectory remains one of innovation and impressive growth.
Freddie
Company Specialist at Welcome to the Jungle
Insights
25% employee growth in 12 months
Company
Funding (last 2 of 9 rounds)
Jan 2021
$520m
SERIES H
Feb 2020
$150m
SERIES G
Total funding: $922.8m
Company HQ
South San Mateo, San Mateo, CA
Leadership
David Baszucki
(Founder & CEO)Studied Electrical Engineering at Stanford before founding Knowledge Revolution in 1990, where they spent 9 years as CEO. They worked as VP of MSC.Software for 2 years, and started Roblox in 2005.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 180 more jobs at Roblox