Founding Big Data/ETL Engineer, Bluesky

Salary not provided

Spark

MapReduce

Snowflake

Hive

Mid and Senior level

San Francisco Bay Area

Remote from US

Snowflake workload optimization and cost governance

Job no longer available

Snowflake workload optimization and cost governance

1-20 employees

B2BEnterpriseProductivityBig dataSaaSAutomation

Job no longer available

Salary not provided

Spark

MapReduce

Snowflake

Hive

Mid and Senior level

San Francisco Bay Area

Remote from US

1-20 employees

B2BEnterpriseProductivityBig dataSaaSAutomation

Company mission

To help customers drive healthy cloud consumption, providing more visibility and optimization into the efficiency of workloads. To allow its customers to derive the most value from their Snowflake Data Cloud usage.

Job

Company

Role

Who you are

BS level technical degree or equivalent
4+ years of professional experience in data engineering or data scientists
1+ year of experience with Snowflake
1+ year of experience with dbt

Desirable

Experience with more than one big data computation framework: Spark, Tez, MapReduce, Hive, Pig, Presto
Experience with cloud deployments and containers

What the job involves

As a key early team member, you will be responsible for critical architectural decisions that will shape the technology stack for years to come
Development - Design and build highly-efficient and scalable ETL pipelines with Snowflake, Airbyte, dbt, and Prefect
Management - Configure, monitor, and manage Snowflake, Airbyte, dbt, and Prefect software in production
Modeling - Apply your expertise to help model structured data with emphasis on Snowflake’s ACCOUNT_USAGE schema
Own these models at a high level, and provide consulting help for others to model applications on top of your data models
Performance Tuning - Analyze and improve the performance and efficiency of the ETL pipelines by identifying bottlenecks, finding out root causes, applying best practices like incremental computation and parallel computation, and dogfooding Bluesky product
Stewardship - Own or support the data definitions and lineage across our entire data warehouse
Mentoring - Help teach other team members about data architecture, and also be a consultant for developers who need help with data
Learning - Stay current on technical knowledge and tooling to help the team utilize new technologies

Our take

Data-driven organizations are on the rise - as is the volume of data by which they’re driven, and many are turning to Snowflake to help manage this. The software’s sliding price scale, however, means operating costs can stack up fast. Bluesky is hoping to help organizations combat this by providing data cloud efficiency services. The idea is to make analytics and querying faster, and therefore cheaper, keeping cloud costs lean and complexity low.

It does this by trimming off practices that are costly but ineffective, then working out the inefficiency knots in the remaining high-performance but pricey ones. Ultimately, it hopes to develop a software that carries this out continuously and autonomously.

Interestingly enough, Bluesky doesn’t actually compete with Snowflake. The two are partners, with Snowflake funnelling customers over to Bluesky who provide a much-needed cost guardrail. Whilst Bluesky is just recently launched, it can expect this arrangement to drum up some substantial business: over two fifths of the Fortune 500 use Snowflake, and it’s growing fast in line with the pivot towards data-driven business. This neat symbiosis, in combination with Bluesky’s elegant product and strong first steps into the market, makes for some strong potential.

Steph

Company Specialist at Welcome to the Jungle

Company

Funding (1 round)

Sep 2022

$8.8m

SEED

Total funding: $8.8m

Company benefits

Top-tier health coverage
401(k)
Unlimited PTO

Company HQ

Menlo Park, CA

Leadership

Mingsheng Hong

(CEO)

Worked as a Field CTO at Vertica Systems, Chief Data Scientist at Hadapt, Tech Lead at Google, and then Head of Engineering for ML Runtime.

Salary benchmarks

We don't have enough data yet to provide salary benchmarks for this role.

Submit your salary to help other candidates with crowdsourced salary estimates.

Share this job