Senior Data Engineer, Lighthouse

• Experience in a data engineering role, with a proven track record of building scalable data pipelines
• A product engineering mindset, with a focus on understanding business context and stakeholder needs
• Professional proficiency in Python for data processing and pipeline development
• Strong knowledge of cloud database solutions such as BigQuery, Snowflake, or Databricks
• Excellent communication and stakeholder management skills

Desirable

• As a Senior Data Engineer in our new Data Domains team, you will play a key role in shaping the quality and business value of our core data assets
• You will be hands-on in designing, building, and maintaining the data pipelines that serve teams across Lighthouse
• You will act as a bridge between our data and the business, collaborating with stakeholders and ensuring our data effectively enables its consumers
• Become the expert for key data domains, understanding the full data lifecycle, quality, and business applications
• Design, implement, and maintain the streaming and batch data pipelines that power our products and internal analytics
• Collaborate directly with data consumers to understand their needs, gather requirements, and deliver data solutions
• Deliver improvements in data quality, latency, and reliability
• Show a product engineering mindset, focusing on delivering value and solving business problems through data
• Mentor other engineers, sharing your expertise and contributing to their growth
• The Data Domains Team is the definitive source of truth for Lighthouse's data, sitting at the foundational layer of our entire data ecosystem
• Their core mission is to model and deliver high-quality, foundational data products that are essential ingredients for all downstream product features, machine learning models, and data science initiatives across the company:
• Data Modeling & Ownership: Defining and optimizing core data entities for product and analytical use
• Pipeline Engineering: Building robust ETL/ELT pipelines to transform raw integrated data into trusted domains
• Data Quality: Establishing standards and monitoring the health of all foundational data assets
• Technologies you will work with
• Mostly, but not limited to: GCP, Python, BigQuery, Kubernetes, Airflow, dbt, Terraform, Atlan (data governance tool), Soda