Senior Search Engineer, Acryl Data
Elasticsearch
+Equity
Metadata management platform
Be an early applicant
Metadata management platform
21-100 employees
Be an early applicant
+Equity
21-100 employees
Company mission
To bring clarity to data through a next generation multi-cloud metadata management platform.
Role
Who you are
- 7+ years of software engineering experience, with at least 4 years focused on search systems
- Deep expertise with Elasticsearch, including:
- Cluster administration and optimization
- Query and indexing performance tuning
- Relevance scoring and ranking
- Text analysis and processing
- Monitoring and observability
- Strong experience with relevance engineering and information retrieval concepts
- Proficiency in performance analysis and optimization techniques
- Experience with large-scale data processing and distributed systems
- Strong coding skills in Java, Python, or similar languages
- Experience with search metrics (NDCG, MRR, etc.) and A/B testing
Desirable
- Experience with other search engines (Solr, Lucene) and vector databases
- Knowledge of machine learning for search ranking
- Experience with semantic search and embedding models
- Background in natural language processing
- Experience with search infrastructure in cloud environments (AWS, GCP)
- Contributions to Elasticsearch or related open-source projects
What the job involves
- We're seeking an experienced Search Engineer to optimize and scale our search infrastructure built on Elasticsearch
- In this role, you'll be responsible for delivering lightning-fast, highly relevant search experiences across massive datasets
- You'll work on complex challenges involving search relevance, performance optimization, and scalability while maintaining sub-100ms response times
- This role combines deep technical expertise in search systems with a data-driven approach to relevance tuning
- Architect and optimize Elasticsearch clusters for high-throughput, low-latency operations
- Implement and tune caching strategies to optimize query performance
- Design and implement efficient indexing strategies for large-scale data ingestion
- Monitor and optimize cluster health, performance metrics, and resource utilization
- Implement horizontal scaling solutions while maintaining consistent performance
- Design and implement efficient replication and sharding strategies
- Develop and tune ranking algorithms to improve search relevance
- Implement advanced text analysis pipelines using analyzers, tokenizers, and filters
- Design and implement custom scoring functions and boosting strategies
- Create and maintain relevance testing frameworks
- Conduct A/B tests to measure and improve search quality
- Implement semantic search capabilities using vector search and relevant plugins
- Design and implement efficient search APIs and query DSL patterns
- Build robust monitoring and alerting for search infrastructure
- Develop tools for search quality analysis and debugging
- Implement advanced features like faceted search, autocomplete, and filtering
- Create documentation and best practices for search implementation
Our take
Due to the increasing amount of diverse data types, companies face challenges in organising and analysing their stored data. This means data teams are overwhelmed as they accommodate data requests from within the company while striving to ensure consistent data policies are maintained.
One company tackling these data challenges is Acryl Data, a California-based startup that operates the DataHub Project, an open-source data catalog. Alongside its data catalog, the company offers a solution for data governance and observability. This managed service, Acryl Cloud, builds upon the open-source capabilities of the DataHub Project, introducing features that streamline the operational management of data.
Major companies such as Stripe and Pinterest already utilise DataHub, while Notion and Zendesk rely on Acryl Cloud as their data management solution. This success has attracted the support of numerous investors, and with the capital raised, Acryl Data is now focused on developing a new platform that enhances data discovery, observability, and control, further addressing the evolving needs of organizations in the data-driven landscape.
Steph
Company Specialist at Welcome to the Jungle
Insights
Few candidates hear
back within 2 weeks
Company
Funding (1 round)
Jun 2023
$21m
SERIES A
Total funding: $21m
Company benefits
- Equity
- Medical, dental, and vision insurance
- Carrot Fertility Program
- Parental leave
- Remote friendly
- Work from home and monthly co-working space budget
Company values
- Community-first: Our vibrant DataHub community is at the core of who we are and the work we do – we are committed to providing the best experience to all members of the DataHub community
- Impact-driven: Each member of the Acryl Data team works hard and takes proud ownership in producing long-term, impactful results quickly and efficiently
- Representation matters: In order to build the best, most inclusive, accessible product for our community members, our work and team reflects the lived experiences, unique perspectives, and communities around us
Company HQ
Santa Clara, CA
Articles
Leadership
Swaroop Jagadish
(Co-Founder & CEO)Graduated from UC Santa Barbara with a M.S. in Computer Science. Previously worked as a Software Engineer at Yahoo!, LinkedIn and Airbnb.
Shirshanka Das
(Co-Founder & CTO)Graduated from UCLA with a Ph.D. in Computer Science. Previously worked as a Senior Software Engineer/Application Architect at Paypal, as a Principal Technical at Yahoo! and as a Senior then Principal Software Engineer at LinkedIn.
John Joyce
(Co-Founder)Graduated from the University of Notre Dame with a B.S. in Computer Engineering. Experienced Software Engineer having previously worked at Joyce & Bittner, SwoopIn, Visa, Cameo, and LinkedIn. Also co-founded SquadSnap and Float Tickets.
Share this job
View 6 more jobs at Acryl Data