Software Engineer, OpenAI
Model Inference
$200-370k
3+ days a week in office
AI research and development platform
Job no longer available
AI research and development platform
1001+ employees
Job no longer available
$200-370k
3+ days a week in office
1001+ employees
Company mission
To ensure that artificial general intelligence benefits all of humanity.
Role
Who you are
- Have experience with high-throughput scheduling as a service, particularly at supercomputing scale
- Are proficient in testing, debugging, and maintaining systems written in low-level systems languages, particularly C++ or Go
- Either know or can quickly learn the fundamentals of modern AI architectures
- Have at least 3 years of professional software engineering experience
- Know network technologies inside and out from L1 to L7
- Own problems end-to-end, and are willing to pick up whatever knowledge you're missing to get the job done
- Have a good intuition for when off-the-shelf solutions will work, and build tools to accelerate your own workflow quickly if they won’t
- Have the ability to move fast in an environment where things are sometimes loosely defined and may have competing priorities or deadlines
What the job involves
- We're looking for an engineer to join our team at OpenAI to help us scale up our critical inference infrastructure, which efficiently services every customer request to use our state-of-the-art AI models, including GPT-4 and Dall-E
- Improve the reliability, security, scalability, and observability of our distributed inference infrastructure
- Build tools to give us visibility into our bottlenecks and sources of instability and then design and implement solutions to address the highest priority issues
- Ensure the most efficient use of a constellation of different state-of-the-art AI models deployed on a large, heterogeneous fleet of Azure VMs under Kubernetes
Our take
OpenAI aims to research and deploy AGI (Artificial General Intelligence) that is safe, controllable and beneficial to all of humanity. The company began its mission by developing an API that can solve language-based tasks, such as answering written questions or pulling up relevant documents based on a query.
Following the launch of ChatGPT in November 2022, which gained more than 1 million users in its first 5 days and is already worth billions, OpenAI announced a paid version named ChatGPT Plus which will be launched in the US first.
It is worth noting that OpenAI is not without controversy. Its products have sparked conversations regarding the morals and implications of AI tools, and recent investigations have uncovered misalignments between the company's public commitments and its alleged operations behind closed doors.
Whilst AI applications can be found in a vast variety of tech startups, this generally consists of the automation of algorithmic tasks such as data analysis and organization. OpenAI’s approach to designing true human-like artificial intelligence is futuristic, but with support from its high-profile partners (such as Microsoft), an annualised revenue reported at $ 2 billion in 2023, and the clear success of its products have the company well set to continue bringing advanced AI to the public.
Kirsty
Company Specialist at Welcome to the Jungle
Insights
42% employee growth in 12 months
Company
Funding (last 2 of 10 rounds)
Feb 2026
$110bn
LATE VC
Dec 2025
$1bn
LATE VC
Total funding: $179.9bn
Company benefits
- Health/Dental/Vision Insurance
- Flexible spending account for healthcare and dependent care
- Mental healthcare service
- Fertility treatment coverage
- 401(k) with generous matching
- 20-week paid parental leave
- Life insurance (complimentary)
- AD&D insurance (complimentary)
- Short-term/long-term disability insurance (complimentary)
- Optional buy-up life insurance
- Flexible work hours and unlimited paid time off (we encourage 4+ weeks per year)
- Annual learning & development stipend
- Regular team happy hours and outings
- Daily catered lunch and dinner
- Travel to domestic conferences
Company HQ
Mission District, San Francisco, CA
Leadership
Sam Altman
(CEO)Former Y Combinator President & Chairman.
Ilya Sutskever
(Chief Scientist)Initially served as the company's Research Director, then became Chief Scientist in 2018. Co-founded DNNResearch and previously worked at Google as a Research Scientist.
Greg Brockman
(President & Chairman)Previously served as CTO of the company. Founding Engineer and former CTO of Stripe.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job