Software Engineer, Exa

Web Crawling

$150-300k

+ Offers Equity

JavaScript

C++

Rust

Junior, Mid and Senior level

Remote from US

More information about location

Search infrastructure for AI

Be an early applicant

Search infrastructure for AI

21-100 employees

B2CB2BArtificial Intelligence

Be an early applicant

$150-300k

+ Offers Equity

JavaScript

C++

Rust

Junior, Mid and Senior level

Remote from US

More information about location

21-100 employees

B2CB2BArtificial Intelligence

Company mission

To understand any query – no matter how complex – and filter the internet to exactly the knowledge required for that query.

Job

Company

Role

Who you are

You have extensive experience building and scaling web crawlers, or would be excited to ramp up very quickly
You have experience with some high performance language (C++, Rust, etc.)
You’re comfortable optimizing a system to an exceptional degree
You care about the problem of finding high quality knowledge and recognize how important this is for the world

What the job involves

As a Web Crawler engineer, you'd be responsible for crawling the entire web. Basically build Google-scale crawling!
Build a distributed crawler that can handle 100M+ pages per day
Optimize crawl politeness and rate limiting across thousands of domains
Design systems to detect and handle dynamic content, JavaScript rendering, and anti-bot measures
Create intelligent crawl scheduling and prioritization algorithms for maximum coverage efficiency

Our take

The way we currently query AIs means that the models we rely on are themselves reliant on the quality of internet search tools. To answer this, Exa is building a tool that allows AI models to perform the equivalent of a web search, making the models more effective in their responses to our questions.

Exa’s embeddings-based search engine is free of “hallucinations” (those bizarre search query answers that AI sometimes brings back to users). Also, in the same way that LLMs complete sentences, its predictive technology does the same for search queries by providing the next probable link.

It's an alluring product for companies and individuals who want to accelerate their research answers. It's also one of a kind at present, which has led to several successful funding rounds which will help accelerate its product. If it maintains its current momentum, Exa could well be the AI search engine of the future.

Kirsty

Company Specialist at Welcome to the Jungle

Company

Funding (last 2 of 5 rounds)

Sep 2025

$85m

SERIES B

Jul 2024

$17.6m

SERIES A

Total funding: $112.2m

Company HQ

Lower Haight, San Francisco, CA

Leadership

Will Bryk

(Co-Founder & CEO)

Previously a Software Engineer at Cresta, Intern at Zoox Inc and was the President of the Harvard Undergrad Robotics Club.

Jeffrey Wang

(Co-Founder)

Previously a Member of South Park Commons and was a Software Engineer at Plaid.

Share this job

View 14 more jobs at Exa