Data Platform Engineer, Onehouse
$150-220k
+ Equity
Office located in Sunnyvale, CA
Pre-built data lakehouse foundation
Open for applications
Pre-built data lakehouse foundation
21-100 employees
Open for applications
$150-220k
+ Equity
Office located in Sunnyvale, CA
21-100 employees
Company mission
To aid companies of all sizes in supercharging their data engineering/data science, by automating painful data infrastructure buildout.
Role
Who you are
- 3+ years of experience in building and operating data pipelines in Apache Spark or Apache Flink
- 2+ years of experience with workflow orchestration tools like Apache Airflow, Dagster
- Proficient in Java, Maven, Gradle and other build and packaging tools
- Adept at writing efficient SQL queries and trouble shooting query plans
- Experience managing large-scale data on cloud storage
- Great problem-solving skills, eye for details. Can debug failed jobs and queries in minutes
- Operational excellence in monitoring, deploying, and testing job workflows
- Open-minded, collaborative, self-starter, fast-mover
Desirable
- Hands-on experience with k8s and related toolchain in cloud environment
- Experience operating and optimizing terabyte scale data pipelines
- Deep understanding of Spark, Flink, Presto, Hive, Parquet internals
- Hands-on experience with open source projects like Hadoop, Hive, Delta Lake, Hudi, Nifi, Drill, Pulsar, Druid, Pinot, etc
- Operational experience with stream processing pipelines using Apache Flink, Kafka Streams
What the job involves
- We are a team of self-driven, inspired, and seasoned builders that have created large-scale data systems and globally distributed platforms that sit at the heart of some of the largest enterprises out there including Uber, Snowflake, AWS, Linkedin, Confluent and many more
- Be the thought leader around all things data engineering within the company - schemas, frameworks, data models
- Implement new sources and connectors to seamlessly ingest data streams
- Building scalable job management on Kubernetes to ingest, store, manage and optimize petabytes of data on cloud storage
- Optimize Spark or Flink applications to flexibly run in batch or streaming modes based on user needs, optimize latency vs throughput
- Tune clusters for resource efficiency and reliability, to keep costs low, while still meeting SLAs
Our take
Managing the ballooning volume of unstructured data is becoming a tough task for enterprise companies. The traditional solution, data lakes, doesn’t offer management or transaction capabilities. This lack of oversight could lead to data violations, which are becoming more costly as regulations tighten. Onehouse is catering to the growing number of businesses opting for an alternative, the so-called ‘data lakehouse’. It's a hybrid architecture that offers the management and transaction capabilities of a warehouse, with the cost-effectiveness of a data lake.
The Onehouse platform is a management plane that helps businesses set up a data lakehouse without having to invest the time and expertise in building one from scratch. With an open data format, it can be used to work with protected or sensitive data; it also allows companies to easily pull their data from Onehouse without egress fees if they decide to leave the service.
Onehouse has carved out an astute market niche for itself: businesses under increasingly close scrutiny, but with ballooning data pools, who don’t need to build out highly customized lakehouses. For the moment, this tends to be top-tier enterprises, which is how Onehouse has secured deep-pocketed clients like Walmart, Amazon, Zendesk, and Uber. As the first company to make fully managed data lakes possible, it is no surprise that it has received substantial funding. This will allow it to continue advancing the platform and grow its team to meet market demand.
Steph
Company Specialist at Welcome to the Jungle
Insights
Few candidates hear
back within 2 weeks
Company
Funding (last 2 of 3 rounds)
Jun 2024
$35m
SERIES B
Feb 2023
$25m
SERIES A
Total funding: $68m
Company benefits
- Equity Compensation; our success is your success with eligible participation in our company equity plan
- Health & Well-being; we'll invest in your physical and mental well-being with up to 90% health coverage (50% for spouses/dependents) including comprehensive medical, dental & vision benefits
- Financial Future; we'll invest in your financial well-being by making this role eligible to contribute to our company 401(k) or Roth 401(k) retirement plan
- Location; we are a remote-friendly company (internationally distributed across N. America + India), though some roles will be subject to in-person requirements in alignment with the needs of the business
- Generous Time Off; unlimited PTO (mandatory 1 week/year minimum), uncapped sick days and 11 paid company holidays
- Company Camaraderie; Annual company offsites and Quarterly team onsites @Sunnyvale HQ
- Food & Meal Allowance; weekly lunch stipend, in-office snacks/drinks
- Equipment; we'll provide you with the equipment you need to be successful and a one-time $500 stipend for your initial desk setup
- Child Bonding!; 8 weeks off for parents (birthing, non-birthing, adoptive, foster, child placement, new guardianship) - fully paid so you can focus your energy on your newest addition
Company HQ
Sharon Heights, Menlo Park, CA
Articles
Leadership
Vinoth Chandar
(Founder & CEO)Previously a Principal Engineer at Uber, then Confluent, and subsequently served as VP of Apache Hudl at The Apache Software Foundation.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 7 more jobs at Onehouse