Principal Data Scientist, Elastic

Search, Workchat

$159.8-303.5k

Salary is dependent on location and is benchmarked on US rates and may vary in other locations; + Participate in Elastic's stock program

Python

Elasticsearch

Pandas

PyTorch

Senior and Expert level

Remote from Spain, UK, US

Software that searches and analyses data in real time

Job no longer available

Software that searches and analyses data in real time

1001+ employees

B2BAnalyticsSaaS

Job no longer available

$159.8-303.5k

Salary is dependent on location and is benchmarked on US rates and may vary in other locations; + Participate in Elastic's stock program

Python

Elasticsearch

Pandas

PyTorch

Senior and Expert level

Remote from Spain, UK, US

1001+ employees

B2BAnalyticsSaaS

Company mission

To build software to make data usable in real-time and at scale for search, logging, security, and analytics use cases.

Job

Company

Role

Who you are

8+ years of confirmed experience building and applying NLP to production use cases
8+ years of professional software development experience in Python
Experience in Generative AI, Retrieval Augmented Generation, and information retrieval
Experience with libraries and frameworks such as PyTorch, transformers, and Pandas
Experience using collaborative notebook-based workflows (e.g. Jupyter) for prototyping and knowledge sharing
Expertise in AI/ML quality evaluation and improvement, including balancing tuning techniques with cost/benefit tradeoffs
Self motivated, collaborative style, open communicator, experience in a distributed team
Good attention to detail and highly organized
Real passion for data, analysis and achieving excellence
Experience with Elasticsearch is useful
An academic background in the domain is also a plus

What the job involves

The Search Data Science team is responsible for developing and integrating statistical tools and machine learning models within the Search domain in support of semantic search, RAG, agentic search, and chat applications
As a Data Scientist in this area, you will work closely with our Product teams to lead the innovation, incubation, and prototyping phases of how to evolve and transform our AI/ML driven Search experiences and solutions with a focus on quickly bringing new ideas to production and into the hands of our customers
Your primary focus will be driving forward research and development in support of improving semantic search with proprietary models and customized open source models, developing techniques and models for query and document understanding, implementing RAG and LLM-driven search experiences, and developing tooling to help customers design and implement successful end-to-end RAG systems
Furthermore, you’ll be investigating aspects of modern agentic search including reasoning engines, prompt engineering techniques, query understanding, and more. Doing this requires exploring and benchmarking new open source models, and existing proprietary Elastic models, while keeping up to date with the latest major advancements in the fields of NLP and information retrieval
Explore, select and benchmark open source and Elastic proprietary models
Implementing RAG and other LLM-based search experiences
Designing evaluation protocols for semantic search, tool selection, and generation in LLM-based search experiences
Keeping up-to-date with the most significant recent developments in the field of NLP and information retrieval
Engage with the NLP and information retrieval communities (blogs, documentation, Python examples, conference talks, academic papers, etc.)
Collaborate with cross-functional teams of data scientists, engineers, and product managers
Promote knowledge sharing and collaboration in a distributed team

Our take

Elastic develops the Elastic Stack, an open-source set of tools that includes Elasticsearch, Kibana, Beats, and Logstash, designed for data search and analysis. It also offers X-Pack, which adds commercial features to the Elastic Stack, and Elastic Cloud, a suite of SaaS (Software-as-a-Service) products.

This technology is widely used by major companies like eBay, Wikipedia, Yelp, Uber, Lyft, Tinder, and Netflix, along with over 17,000 other organizations. It is applied in various use cases, including application and website search, enterprise search, logging, infrastructure monitoring, application performance management (APM), security analytics (enhancing SIEM applications), and business analytics.

Freddie

Company Specialist at Welcome to the Jungle

Insights

Top investors

8% employee growth in 12 months

Glassdoor (3.8)

Company

Funding (last 2 of 4 rounds)

Jul 2016

$58m

SERIES D

Jun 2014

$70m

SERIES C

Total funding: $162m

Company benefits

Toast to your health: Fully paid health coverage for you and your family, in many locations
Craft your calendar: Flexible location and schedule for most roles
Create space for you: Distributed by design workforce, plus generous number of vacation days each year
Embrace parenthood: Minimum of 16 weeks of parental leave, plus generous family formation benefits
Give back your time: 40 hours each year to use toward volunteering with organizations and causes you’re passionate about
Amplify your impact: Double your charitable giving — we match donations up to $1500 USD (or local currency equivalent)

Company HQ

Union Square, San Francisco, CA

Leadership

Shay Banon

(Co-Founder & CTO)

Previously held the position of Technology Director at GigaSpaces Technologies.

Simon Willnauer

(Co-Founder)

Previously spent 13 years at The Apache Software Foundation, holding various positions such as VP Apache Lucene and Lucene Core Commiter and PMC Member.

Uri Boness

(Co-Founder)

Previously worked as a Software Architect and Head of Search at Orange11 for 7 years.

Share this job

View 79 more jobs at Elastic