Lead Data Engineer, Philo

• 10+ years of professional experience in data engineering, ideally with a few years working on high-volume data platforms
• 3+ years of experience leading data engineering teams in cloud-native environments
• Deep expertise in modern data stack technologies, particularly AWS data services, Redshift, dbt, orchestration tools like Airflow and Dagster, Python, and SQL
• Strong track record of designing and implementing data platforms
• Experience mentoring junior engineers and raising team capabilities through technical documentation and knowledge sharing
• Excellent communication skills with technical and non-technical stakeholders, simplifying complex data concepts for various business audiences
• Experience managing cloud-based data platforms (AWS/GCP/Azure)
• Location: San Francisco, CA, Brooklyn, NY, Cambridge, MA, or remote

Desirable

• On the Data Engineering team, we’re looking for people who are comfortable working on complex data infrastructure challenges that support critical business functions across our streaming services
• You’ll be working closely with other engineers, data scientists, analysts, and stakeholders to build and deploy scalable data solutions that power our entire service
• In addition, you’ll work with departments across the organization to understand their data needs and deliver high-performance, reliable data systems to help the entire team thrive
• We are passionate about building robust, scalable data infrastructure and providing high-quality data infrastructure for the entire company, using both cutting-edge technologies and proven engineering practices in close collaboration with every department
• To complete our work, we build on modern tools including AWS-native services, DBT, Segment, Redshift, AWS SageMaker, AWS Glue, Avo, BigEye and more
• Some of the recent projects our Data Engineering team members have worked on include data warehouse cluster upgrades, per-query infra cost optimization, implementation of Apache Iceberg data storage, and evaluating alternative data warehouse technologies
• We're seeking an experienced Lead Data Engineer to join our team at Philo. This role will be responsible for designing and implementing our long-term Data Platform Strategy while providing technical leadership to take our data engineering practices to the next level
• The ideal candidate will be strongly opinionated about data stack architecture and how to enhance velocity across the entire Data Team at Philo
• Lead the design and implementation of Philo's data platform architecture
• Set technical standards and best practices for data engineering work
• Mentor and coach data engineers in best practices for data pipeline design, performance optimization, and AWS cloud services
• Collaborate with cross-functional teams to understand data platform needs and translate business requirements into technical solutions
• Design scalable data pipelines and infrastructure
• Manage team workload, priorities, and delivery timelines
• Implement data governance, security, and quality control processes
• Drive technical decisions with a focus on long-term sustainability