Senior Software Engineer, Dremio
Query Planner & Reflections
Open data lakehouse
Be an early applicant
Open data lakehouse
201-500 employees
Be an early applicant
201-500 employees
Company mission
To shorten the distance to data by removing barriers, accelerating time to insight, and putting control in the hands of the user.
Role
Who you are
- B.S./M.S/Equivalent in Computer Science or a related technical field or equivalent experience
- 5+ years of experience developing production-level software
- Fluency in Java/C++
- Strong foundation in data structures, algorithms, multi-threaded and asynchronous programming models, and their use in developing distributed and scalable systems
- Strong database fundamentals including SQL, performance, and schema design is a big plus
- Experience in developing complex and scalable distributed systems and delivering, deploying, and managing microservices successfully
- Passion for learning, quality, zero downtime upgrades, availability, resiliency, uptime of the platform, and using latest technologies
- Ability to solve ambiguous, unexplored, and cross-team problems effectively
- Understanding of distributed file systems such as S3, ADLS, or HDFS
- Experience with AWS, Azure, and Google Cloud Platform and background in large scale data processing systems (e.g., Hadoop, Spark, etc.) is a plus
- Ability to scope and plan solutions for big problems and mentors others on the same
- Interested and motivated to be part of a fast-moving startup with a fun and accomplished team
Desirable
- Experience with materialized views and incremental view maintenance
- Experience with distributed query engines
- Hands on experience in query processing or optimization, distributed systems, concurrency control, data replication, code generation, networking, storage systems, heap management, Apache Arrow, SQL Operators, caching techniques, and disk spilling
- Hands on experience with multi-threaded and asynchronous programming models
What the job involves
- In this role, you will work on some of Dremio’s core features, including Reflections—a key feature of Dremio’s query engine that combines the power of materialized views with sophisticated automatic query rewrites through deep integration in Dremio’s distributed query optimizer
- You will grow as a leader through mentoring, collaborating with other developers and taking ownership of complex issues to deliver high quality distributed systems at a massive scale
- Own design, implementation, testing, and support of next-generation features related to Dremio’s Query Planner and Reflections technologies
- Work with open source projects like Apache Calcite and Apache Iceberg
- Use modular design patterns to deliver an architecture that’s elegant, simple, extensible and maintainable
- Solve complex technical problems and customer issues while improving our telemetry and instrumentation to proactively detect issues before they arise and make debugging more efficient
- Design and deliver architectures that run optimally on public clouds like GCP, AWS, and Azure
- Mentor other team members for high quality and design
- Collaborate with Product Management to innovate and deliver on customer requirements and with Support and field teams to ensure customer success
Our take
Data lakehouse platform Dremio bridges the gap between data warehouses and data lakes to help data engineers, analysts and scientists streamline, curate, and run queries on raw, purpose non-specific data, allowing them to quickly build analytics stacks. The self-service platform enables users to create datasets from a multitude of sources and can be deployed on Kubernetes clusters, AWS, and Azure.
The company is tackling the longstanding, time-draining problem of having to manually extract raw data and load it into data warehouses, providing customers with low-cost, sub-second SQL queries for BI on the data lakehouse. Its offering has captured the attention of some big-name clients including Samsung, Bose, HSBC, and Microsoft, and has raised substantial funding.
Dremio is well set to see continued growth as it continues to innovate its data offerings, with a focus on security and privacy. A partnership with PlainID, provider of a central access control platform, will allow clients to manage and control access to data via Dremio, and the company has also achieved HIPAA certification.
Kirsty
Company Specialist at Welcome to the Jungle
Insights
Company
Funding (last 2 of 6 rounds)
Jan 2022
$160m
SERIES E
Jan 2021
$135m
SERIES D
Total funding: $410m
Company benefits
- Medical, dental and vision insurance
- 401(k) Plan
- Short term / long term disability and life insurance
- Pre-IPO stock options
- Flexible PTO
- 16 hours of volunteer time off
- 12 company paid holidays, including Juneteenth
- Hybrid workplace
- Monthly “Get Stuff Done” (GSD) Days
- Paid parental leave
- Employee Assistance Program (EAP)
- Quarterly swag surprise
Company values
- People - How we communicate with each other is the #1 priority for Gnarlies. Clarity is essential for teams to be productive and accountable for their contributions. When we approach communication from the standpoint of respect, even disagreements can have healthy outcomes.
- Thinking - We think about our work by staying focused on results. To do that, we sometimes need to have hard conversations confronting uncomfortable issues. Asking questions, being curious, and staying inquisitive is the best way to learn and grow.
- Action - We’re scaling fast, so we’re past the early days of building for only one customer at a time. Now we’re thinking in terms of scalability and how everything we do needs to serve hundreds and thousands.
Company HQ
Santa Clara, CA
Articles
Leadership
Tomer Shiran
(CPO & Founder)They started their career as an IBM Software Engineer before spending a further 4 years at Microsoft and 2 at Hewlett-Packard. They co-founded ePassportPhoto.com in 2005, where they worked until June 2015.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 6 more jobs at Dremio