Senior Software Engineer, Dremio
Query Engine
Agentic data lakehouse
Job no longer available
Agentic data lakehouse
201-500 employees
Job no longer available
201-500 employees
Company mission
To shorten the distance to data by removing barriers, accelerating time to insight, and putting control in the hands of the user.
Role
Who you are
- We are seeking a talented and motivated Senior Software Engineer to join our Datalake team within the Query Engine organization
- B.S., M.S. or PhD in Computer Science or in a related technical field
- 5+ years of software engineering experience, with a focus on database systems, query execution or related fields
- Strong programming skills in an object oriented language such as Java or C++
- Understanding of database internals, query planning, distributed systems, concurrency control, data replication, and storage systems
- Familiarity with cloud object stores, such as AWS S3, ADLS or GCS
- Experience with Apache Iceberg, Parquet, AVRO and/or Delta
- Interested and motivated to be part of a fast-moving startup with a fun and accomplished team
- Desire to learn: You can stand your ground as well as be mentored by your teammates
Desirable
- Experience working with and contributing to open source projects
What the job involves
- In this role, you will focus on enhancing our query engine with a particular emphasis on the Iceberg table format and efficient scans of various file formats
- This is an exciting opportunity to contribute to cutting-edge technology in the big data ecosystem
- Designing and implementing features for Dremio’s query engine with a focus on the Iceberg table format
- Optimizing file scan operations for various file formats, including Parquet, Avro and others
- Collaborating with members of the query planning and query execution teams to ensure seamless integration of features across the code stack
- Working with and contributing to open-source projects like Apache Iceberg, Parquet and Arrow
- Maintaining and enhancing compliance with the Iceberg table format specification
- Conducting performance tuning and benchmarking to enhance query execution speed
- Understanding and reasoning about concurrency and parallelization to deliver scalability and performance in a multithreaded and distributed environment
- Participating in code reviews and providing constructive feedback to peers
Our take
Data lakehouse platform Dremio bridges the gap between data warehouses and data lakes to help data engineers, analysts and scientists streamline, curate, and run queries on raw, purpose non-specific data, allowing them to quickly build analytics stacks. The self-service platform enables users to create datasets from a multitude of sources and can be deployed on Kubernetes clusters, AWS, and Azure.
The company is tackling the longstanding, time-draining problem of having to manually extract raw data and load it into data warehouses, providing customers with low-cost, sub-second SQL queries for BI on the data lakehouse. Its offering has captured the attention of some big-name clients including Samsung, Bose, HSBC, and Microsoft, and has raised substantial funding.
Dremio is well set to see continued growth as it continues to innovate its data offerings, including by creating the first agentic lakehouse that is built for and managed by agents. A partnership with PlainID, provider of a central access control platform, will allow clients to manage and control access to data via Dremio, and the company has also achieved HIPAA certification.
Kirsty
Company Specialist at Welcome to the Jungle
Insights
-18% employee growth in 12 months
Company
Funding (last 2 of 6 rounds)
Jan 2022
$160m
SERIES E
Jan 2021
$135m
SERIES D
Total funding: $410m
Company benefits
- Medical, dental and vision insurance
- 401(k) Plan
- Short term / long term disability and life insurance
- Pre-IPO stock options
- Flexible PTO
- 16 hours of volunteer time off
- 12 company paid holidays, including Juneteenth
- Hybrid workplace
- Monthly “Get Stuff Done” (GSD) Days
- Paid parental leave
- Employee Assistance Program (EAP)
- Quarterly swag surprise
Company HQ
Santa Clara, CA
Leadership
Tomer Shiran
(CPO & Founder)They started their career as an IBM Software Engineer before spending a further 4 years at Microsoft and 2 at Hewlett-Packard. They co-founded ePassportPhoto.com in 2005, where they worked until June 2015.
Share this job
View 2 more jobs at Dremio