Member of Technical Staff, Contextual AI

AI Inference

$140-300k

+ Equity

Python

Linux

Tensorflow

C++

CUDA

PyTorch

Senior level

San Francisco Bay Area

Office located in Mountain View, CA

Context engineering platform for production-grade AI

Job no longer available

Context engineering platform for production-grade AI

101-200 employees

B2BArtificial IntelligenceEnterpriseDeep TechSaaS

Job no longer available

$140-300k

+ Equity

Python

Linux

Tensorflow

C++

CUDA

PyTorch

Senior level

San Francisco Bay Area

Office located in Mountain View, CA

101-200 employees

B2BArtificial IntelligenceEnterpriseDeep TechSaaS

Company mission

To change the way the world works through AI.

Job

Company

Role

Who you are

M.Sc. or PhD in Computer Science, Engineering, Statistics, Mathematics, or a related field
5+ years of non-internship professional software development experience, including experience in leading design or architecture of new and existing systems
Experience as a mentor, tech lead, or leading an engineering team
Proficiency in Python, PyTorch, multi-threaded asynchronous C++/Go, and performance optimization
Experience with GPU programming and the GPU inference stack: TensorRT-LLM, Triton, CUDA, and CUPTI
Proficiency in the TensorFlow and/or PyTorch frameworks
Experience with Linux kernel system calls or the POSIX API (process control, communication, and device management)
A problem-solving mindset, owning tasks end-to-end and acquiring the necessary knowledge to get the job done
A good intuition for when off-the-shelf solutions are sufficient and the ability to build tools to accelerate your workflow when they aren’t
The ability to move quickly in an environment where things are sometimes loosely defined and may have competing priorities or deadlines

What the job involves

The AI Inference team, within the Contextual AI’s platform organization, designs, builds, and operates Gen AI and LLM inference systems at scale
The team pioneers system innovation to optimize latency, throughput, and cost for all Contextual AI’s models powered by RAG 2.0 technology
As a Member of Technical Staff at Contextual AI, you will:
Design, develop, test, and deploy high-performance inference solutions for—though not limited to—Gen AI state-of-the-art model architectures, RAG 2.0, knowledge retrieval models, and language encoders
Be responsible for optimizing end-to-end inference latency, throughput, and cost, ensuring the most efficient use of our inference cluster
Drive system architecture, spearhead best practices, and mentor junior engineers
Improve the reliability, scalability, and observability of our distributed inference infrastructure
Read papers and consult with scientists to gain insights into emerging techniques, integrating them into our roadmap
Design and experiment with new algorithms, benchmarking the latency and accuracy of your implementations

Our take

Founded by former Facebook research scientists, Contextual AI is building customizable, scalable and trustworthy Large Language Models for use by enterprises. Its main product is a tool to improve model performance so that users can build production-grade AI systems.

The backbone of this product is a technology that feeds curated information into AI models so that the LLM can have more context and up-to-date information. This helps to minimize AI “hallucinations”, an increasingly common problem for models like ChatGPT.

Contextual AI is currently working with companies in the finance, technology and media sectors. Following its 2024 funding round, the company has gained momentum, most recently announcing the launch of Agent Composer, a product aimed at moving enterprise RAG from experimentation to production ready AI agents.

Freddie

Company Specialist at Welcome to the Jungle

Company

Funding (2 rounds)

Aug 2024

$80m

SERIES A

Jun 2023

$20m

SEED

Total funding: $100m

Company benefits

Competitive salary & equity packages
Comprehensive health, dental & vision isnurance
401(k) with employer matching
Support for conference feeds & travel
Team offsites, celebrations & events
Unlimited PTO

Company HQ

Old Mountain View, Mountain View, CA

Leadership

Douwe Kiela

(Co-Founder & CEO)

Previously Adjunct Professor at Stanford University, Head of Research at Hugging Face and Research Scientist at Facebook. Was also the CEO and Founder of Brainstorm IT.

Salary benchmarks

We don't have enough data yet to provide salary benchmarks for this role.

Submit your salary to help other candidates with crowdsourced salary estimates.

Share this job