AI Inference Engineer, Perplexity AI
$190-240k
+ Equity
Conversational AI-powered search tool
Job no longer available
Conversational AI-powered search tool
21-100 employees
Job no longer available
$190-240k
+ Equity
21-100 employees
Company mission
To advance the way people discover and share information.
Role
Who you are
- Experience with ML systems and deep learning frameworks (e.g. PyTorch, TensorFlow, ONNX)
- Familiarity with common LLM architectures and inference optimization techniques (e.g. continuous batching, quantization, etc.)
- Experience with deploying reliable, distributed, real-time model serving at scale
- (Optional) Understanding of GPU architectures or experience with GPU kernel programming using CUDA
What the job involves
- We are looking for an AI Inference to join our growing team. Our current stack is Python, C++, TensorRT-LLM, Kubernetes
- You will have the opportunity to work on large-scale deployment of machine learning models for real-time inference
- Develop APIs for AI inference that will be used by both internal and external customers
- Benchmark and address bottlenecks throughout our inference stack
- Improve the reliability and observability of our systems and respond to system outages
- Explore novel research and implement LLM inference optimizations
Salary benchmarks
Our take
As artificial intelligence continues to drive changes in both business operations and day-to-day lives, Perplexity AI delivers an intelligent search engine powered by conversational AI, to improve search outcomes and "unlock the power of knowledge" for all.
Reaching impressive heights of 10 million monthly visits, Perplexity's "ask anything" method of search is clearly a popular one. What sets it apart from other search engines is in its answers, which are concise and fully cited, responding to the user query rather than simply providing a place in which they can scroll to find it themselves.
The company has raised substantial funding, with contributions from former execs at companies like OpenAI, Meta, and Quora, demonstrating the interest that it has drummed up in the space. Having doubled its annual recurring revenue between 2023 and 24, this investment will allow Perplexity AI to continue building out its product, and accelerate growth into the future.
Kirsty
Company Specialist at Welcome to the Jungle
Insights
Few candidates hear
back within 2 weeks
Company
Funding (last 2 of 6 rounds)
Dec 2024
$500m
LATE VC
May 2024
$250m
LATE VC
Total funding: $915m
Company benefits
- Equity
- Comprehensive health, dental, and vision insurance for you and your dependents
- 401(k)
- Generous home-office stipend
Company values
- Ownership - You want to build something special. Something you want to share, something you are proud of, something that keeps you up at night if it’s not good enough
- Velocity - Rush into the unknown, build something, test it, share it, make it better. You understand that velocity comes from decisiveness, execution skills, and investment in systems that scale
- Utility - In the midst of tremendous novelty, we must discover how to take new technology and turn it into something that millions of people want to use every day
Company HQ
Financial District, San Francisco, CA
Articles
Leadership
Aravind Srinivas
(Co-Founder & CEO)Former Research Scientist at OpenAI, who has interned in Research at Google and Deep Mind. Obtained a PhD in Computer Science from the University of California, Berkeley.
Denis Yarats
(Co-Founder & CTO)PhD Student in AI at NYU. Former AI Research Scientist at Facebook AI Research, and Staff ML Engineer at Quora.
Johnny Ho
(Co-Founder & CSO)Previously a Quantitative Trader at Tower Research Capital, and Engineer at Quora.
Andy Konwinski
(Co-Founder)Co-Founder and Advisor at Databricks. Co-Founder and General Partner at CS Graduate Ventures, and Instructor at the University of California, Berkeley.
Share this job
View 25 more jobs at Perplexity AI