Lead Data Engineer, strongDM
$190-230k
+ Equity
Manages auditable database access
Open for applications
Manages auditable database access
101-200 employees
Open for applications
$190-230k
+ Equity
101-200 employees
Company mission
To simplify infrastructure access by helping companies manage and audit access to their databases, servers, clusters, and web applications.
Role
Who you are
- The ideal candidate will have deep expertise in tabular formats like Apache Iceberg, Apache Parquet, and other open standards
- This role requires an innovative mindset and the ability to lead data engineering projects, making key architectural decisions that shape our data ecosystem
- Big Data Technologies: Strong knowledge of big data processing frameworks and data streaming technologies
- AI/ML Data Integration: Experience collaborating with AI/ML teams, building data pipelines that feed AI models, and ensuring data readiness for machine learning workflows
- Experience in Cloud Data Lakes: Proven experience in architecting and building data lakes on cloud platforms (AWS, Azure, GCP)
- Open Standards Expertise: In-depth knowledge of Apache Iceberg, Apache Parquet, and other open standards for efficient data storage and query optimization
- Compute Engines: Expertise in using compute engines such as Apache Spark, Dremio, Presto, or similar, with hands-on experience in optimizing them for business intelligence and AI workloads
- Leadership: Proven track record of leading large-scale data engineering projects and mentoring teams
- Programming Languages: Proficiency in languages such as Python, Java, or Scala, and SQL for querying and managing large datasets
- AI/ML Workflows: Previous experience working directly with AI or machine learning teams preferred
- Distributed Systems: A deep understanding of distributed systems and the challenges of scaling data infrastructure in large, dynamic environments preferred
- Data Warehouse Experience: Familiarity with modern data warehousing solutions such as Snowflake or Redshift preferred
What the job involves
- We are seeking a highly skilled Principal Data Engineer with extensive experience in building cloud data lakes and architecting large-scale data platforms
- You will be instrumental in designing and implementing data architectures that support diverse use cases, AI/ML to business intelligence (BI)
- As a Lead Data Engineer, you will work closely with data scientists, AI teams, and business stakeholders to ensure that our data infrastructure is robust, scalable, and optimized for a variety of computational workloads
- Design and Architect Cloud Data Lakes: Lead the design and development of scalable data lake architectures on cloud platforms (e.g., AWS, Azure, GCP), optimized for both structured and unstructured data
- Tabular Data Formats: Implement and manage tabular formats like Apache Iceberg, Parquet, and other open standards to efficiently store and process large datasets
- Data Platform Development: Architect and build large-scale, highly available data platforms that support real-time analytics, reporting, and AI workloads
- Compute Engines: Leverage various compute engines (e.g., Apache Spark, Dremio, Presto, Trino) to support complex business intelligence and AI use cases, optimizing performance and cost-efficiency
- Collaboration with AI Teams: Work closely with AI and machine learning teams to design data pipelines that enable AI model training, deployment, and real-time inference
- Data Governance: Establish best practices for data governance, ensuring data quality, security, and compliance with industry regulations
- Lead and Mentor: Provide technical leadership to data engineering teams and mentor junior engineers, fostering a culture of continuous learning and innovation
Our take
With cyber threats becoming increasingly common over the last decade, securing access permissions within data infrastructures is essential to enterprise survival. However, managing this task can be expensive and complicated, leading some small businesses to combine various budget open-source data services which results in insecure and convoluted infrastructures.
strongDM provides a tool for managing permissions and access within data infrastructures, achieved by ensuring information is siloed to prevent one person from accessing all parts of the infrastructure. In addition to providing these modular security features, the company also makes it easier for technical staff to access the information that they need based on one-click identity checks.
Whilst plenty of data infrastructure tools already exist with the purpose of securing permission, strongDM have made the smart move of integrating their siloed approach to auditable permissions whilst making access easier for those with permission. The company claims that its service guarantees frictionless and auditable data infrastructure by also automating access logging and data capturing across entire IT stacks. Its 2024 funding round will be used to expand its operations into the Europe, Middle East, and Africa (EMEA) and Asia-Pacific (APAC) regions. It's also setting up an engineering center of excellence in Poland.
Freddie
Company Specialist at Welcome to the Jungle
Insights
Company
Funding (last 2 of 7 rounds)
May 2024
$34m
SERIES C
Sep 2021
$54m
SERIES B
Total funding: $110.1m
Company benefits
- 401k
- 3 months parental leave
- Equity
- HSA, FSA, short/long-term disability
- 3 weeks PTO + standard holidays
- Work from home opportunities
- Health insurance
Company values
- We are transparent
- We tell it like it is
- We are always ready to help
- We are better together
Company HQ
Downtown, Burlingame, CA
Articles
Leadership
Justin McCarthy
(CTO)They worked extensively as a Software Engineer before joining CafePress.com as Engineering Manager. They were VP of Engineering at Rafter and CTO at Preact.
Schuyler Brown
(CCO)They received an MBA from Columbia before working as Assistant to the President of Miramax. They were VP of Marketing at Nomi, and a Columnist at Inc. Magazine.
Share this job
View 3 more jobs at strongDM