Member of Technical Staff, Contextual AI
AI Inference
$140-300k
+ Equity
Office located in Mountain View, CA
Contextual language models for enterprise
Open for applications
Contextual language models for enterprise
21-100 employees
Open for applications
$140-300k
+ Equity
Office located in Mountain View, CA
21-100 employees
Company mission
To change the way the world works through AI.
Role
Who you are
- M.Sc. or PhD in Computer Science, Engineering, Statistics, Mathematics, or a related field
- 5+ years of non-internship professional software development experience, including experience in leading design or architecture of new and existing systems
- Experience as a mentor, tech lead, or leading an engineering team
- Proficiency in Python, PyTorch, multi-threaded asynchronous C++/Go, and performance optimization
- Experience with GPU programming and the GPU inference stack: TensorRT-LLM, Triton, CUDA, and CUPTI
- Proficiency in the TensorFlow and/or PyTorch frameworks
- Experience with Linux kernel system calls or the POSIX API (process control, communication, and device management)
- A problem-solving mindset, owning tasks end-to-end and acquiring the necessary knowledge to get the job done
- A good intuition for when off-the-shelf solutions are sufficient and the ability to build tools to accelerate your workflow when they aren’t
- The ability to move quickly in an environment where things are sometimes loosely defined and may have competing priorities or deadlines
What the job involves
- The AI Inference team, within the Contextual AI’s platform organization, designs, builds, and operates Gen AI and LLM inference systems at scale
- The team pioneers system innovation to optimize latency, throughput, and cost for all Contextual AI’s models powered by RAG 2.0 technology
- As a Member of Technical Staff at Contextual AI, you will:
- Design, develop, test, and deploy high-performance inference solutions for—though not limited to—Gen AI state-of-the-art model architectures, RAG 2.0, knowledge retrieval models, and language encoders
- Be responsible for optimizing end-to-end inference latency, throughput, and cost, ensuring the most efficient use of our inference cluster
- Drive system architecture, spearhead best practices, and mentor junior engineers
- Improve the reliability, scalability, and observability of our distributed inference infrastructure
- Read papers and consult with scientists to gain insights into emerging techniques, integrating them into our roadmap
- Design and experiment with new algorithms, benchmarking the latency and accuracy of your implementations
Our take
Founded by former Facebook research scientists, Contextual AI is building customisable, scalable and trustworthy Large Language Models for use by enterprises. Its main product is a tool to improve model performance so that users can build production-grade AI systems.
The backbone of this product is a technology that feeds curated information into AI models so that the LLM can have more context and up-to-date information. This helps to minimise AI “hallucinations”, an increasingly common problem for models like ChatGPT.
Contextual AI is currently working with companies in the finance, technology and media sectors. Since its impressive 2024 funding, it will no doubt seek growth, perhaps into other sectors. Either way, as AI models become more and more common in enterprise use, the future looks bright for Contextual AI.
Freddie
Company Specialist at Welcome to the Jungle
Insights
Few candidates hear
back within 2 weeks
Company
Funding (2 rounds)
Aug 2024
$80m
SERIES A
Jun 2023
$20m
SEED
Total funding: $100m
Company benefits
- Nnovative Environment: Be part of a forward-thinking company that values creativity and innovation
- Career Growth: Opportunities for professional development and career advancement
- Collaborative Culture: Work with a talented and supportive team dedicated to excellence
Company HQ
SoMa, San Francisco, CA
Articles
Leadership
Douwe Kiela
(CEO)Previously Adjunct Professor at Stanford University, Head of Research at Hugging Face and Research Scientist at Facebook. Was also the CEO and Founder of Brainstorm IT.
Amanpreet Singh
(CTO)Previously Research Team Lead at Hugging Face, Research Engineer at Facebook AI, and Mobile Maintainer at jQuery Foundation. Was also a Software Engineering Intern at Amazon.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 14 more jobs at Contextual AI