Lead Data Engineer, Mysten Labs
$160-240k
+ Equity and tokens and eligibility to participate in the annual equity and token refresh grant programs
Foundational infrastructure for Web 3.0
Job no longer available
Foundational infrastructure for Web 3.0
101-200 employees
Job no longer available
$160-240k
+ Equity and tokens and eligibility to participate in the annual equity and token refresh grant programs
101-200 employees
Company mission
To create foundational infrastructure for Web 3.0.
Role
Who you are
- 5+ years experience in data engineering
- Strong SQL and Python
- Strong and informed opinions on data orchestrators, catalogs, governance, and testing frameworks
- Experience combining in-house and external data
Desirable
- Experience with, or interest in learning, Rust
- Prior blockchain and cryptocurrency experience
- Experience designing and implementing streaming data solutions
- Experience or interest in security analytics and data for security teams
What the job involves
- The Data team is looking to hire a Staff Data Engineer to design and execute on the next iteration of our data systems. This is an exciting opportunity for someone who wants to design web3 analytics systems that run at web2 scale, reliability, and robustness. Interested candidates will have the opportunity to help define the new standards for blockchain analytics on top of the world’s premier object-centric blockchain
- This role requires a combination of high capacity hands-on individual contributor work and planning data architecture. As a Staff Data Engineer you will partner with the heads of Data and Engineering to effectively and smoothly process high-volume data in a reliable and robust way. You will get to touch all parts of the business at Mysten Labs and become the expert on data structures on the Sui blockchain
- Design and implement scalable ingestion pipelines with a reusable and modular framework
- Build robust, reusable frameworks to ingest data from internal sources (e.g., Prod DBs, cloud buckets, etc) and external APIs or files (e.g., CSVs, webhooks)
- Ensure idempotency, backfill support, and error handling in pipeline design
- Optimize and own data warehousing, with clear table definitions, schemas, cost efficiency
- Architect a centralized data lake/warehouse with clear schemas and partitioning strategies
- Support both batch and streaming workloads, and optimize for cost and performance
- Enable data discoverability, usability, and governance
- Implement or integrate data cataloging and lineage tools
- Define naming conventions, documentation standards, and ownership metadata to make data self-serve and intuitive for data scientists, analysts, and product / GTM teams
- Set up a mechanism for scalable access controls (with RBAC or ABAC), PII tagging, and data obfuscation
- Enable approaches for data quality checks, validation pipelines, and alerting for broken or stale data
- Develop a strong understanding of how to use on-chain and off-chain data together
Our take
Mysten Labs was created with the ambition to build a blockchain comparable to Ethereum or Solanan - but with even greater capabilities. That means tackling pain points currently found in blockchain technology, like scaling transactions and speed to meet growing demand.
To do this, Mysten is building foundational infrastructure for Web 3.0 which supports the accelerated development and adoption of decentralized services. The startup is determined to build a platform that finally lets Web 3.0 developers focus on UI, without compromising on security.
The company has focussed on expanding partnerships with existing networks such as Ethos and Orange Comet Partners, who have integrated Mysten technology, as well as open protocols based on Mysten-designed components. Ensuring that it assigns developer and community outreach resources in the right places will be crucial to building a sustainable business in this relatively young space.
Steph
Company Specialist at Welcome to the Jungle
Company
Funding (2 rounds)
Sep 2022
$300m
SERIES B
Dec 2021
$36m
SERIES A
Total funding: $336m
Company HQ
SoMa, San Francisco, CA
Leadership
Evan Cheng
(Co-Founder & CEO)Previously Director of R&D for Novi Financial at Meta. Also worked as Director of Engineering at Facebook and spent over a decade in senior engineering positions at Apple.
Adeniyi Abiodun
(Co-Founder & CPO)Former Product Lead at Novi for Meta. Also worked as Head of Product for VMware's Blockchain division and led the Blockchain Cloud Platform team at Oracle.
Sam Blackshear
(Co-Founder & CTO)Previously Principal Engineer for Novi Financial working on the Move language and Diem platform. Also worked as a Staff Engineer for Facebook. Ex-Microsoft and University of Colorado Research Assistant.
George Danezis
(Co-Founder & Chief Scientist)Professor of Security and Privacy Engineering in the Information Security Group at University College London. Previously a Research Scientist at Facebook, and has a Cryptography PhD from the University of Cambridge.
Share this job
View 4 more jobs at Mysten Labs