Senior Data Engineer, Lyft

• Bachelor's degree in Computer Science, Engineering, Mathematics, Statistics, or a related field
• 4+ years of relevant professional experience
• Strong experience with Spark
• Experience with Hadoop (or similar) Ecosystem, S3, DynamoDB, MapReduce, Yarn, HDFS, Hive, Spark, Presto, Pig, HBase, Parquet
• Strong skills in a scripting language (Python, Ruby, Bash)
• Good understanding of SQL Engine and able to conduct advanced performance tuning
• Proficient in at least one of the SQL languages (MySQL, PostgreSQL, SqlServer, Oracle)
• Experience with workflow management tools (Airflow, Oozie, Azkaban, UC4)
• Comfortable working directly with data analytics to bridge Lyft’s business goals with data engineering

• We are looking for a Data Engineer to build a scalable data platform
• You will proactively propose new ideas, evaluate multiple approaches and choose the best one based on fundamental qualities and supporting data
• You will communicate highly technical problems working along with our cross-functional team and you will have ownership of our core data pipeline that powers mapping’s top-line metrics
• You will also use data expertise to help evolve data models in several components of the data stack
• You will help architect, building, and launching scalable data pipelines to support Lyft’s growing data processing and analytics needs
• Your efforts will allow access to business and user behavior insights, using huge amounts of Lyft data to fuel several teams such as Analytics, Data Science, Engineering, and many others
• You will work with incredibly passionate and talented colleagues from software engineering, machine learning and data science on projects that delight millions of passengers and drivers
• Owner of the core data pipelines in mapping, responsible for scaling up data processing flow to meet the rapid data growth at Lyft
• Evolve data model and data schema based on business and engineering needs
• Implement systems tracking data quality and consistency
• Develop tools supporting self-service data pipeline management (ETL)
• SQL and MapReduce job tuning to improve data processing performance
• Write well-crafted, well-tested, readable, maintainable code
• Participate in code reviews to ensure code quality and distribute knowledge
• Participate in on-call rotations to ensure high availability and reliability of workflows and data
• Unblock, support and communicate with internal & external partners to achieve results

• Great medical, dental, and vision insurance options
• Mental health benefits
• In addition to 12 observed holidays, salaried team members have unlimited paid time off, hourly team members have 15 days paid time off
• 401(k) plan to help save for your future
• 18 weeks of paid parental leave. Biological, adoptive, and foster parents are all eligible
• Pre-tax commuter benefits
• Lyft Pink - Lyft team members get an exclusive opportunity to test new benefits of our Ridership Program
• Family building benefits
• Lyft Pink - Lyft team members get an exclusive opportunity to test new benefits of our Ridership Program

Total funding: $4.9bn

Lyft has aimed for consistent growth, making sure to pitch itself as a more reliable and friendly ride-sharing option than its main competitor, Uber. Uber has a greater market share and operates globally, but Lyft hopes to compete by its focus on ride-sharing over Uber's more diversified business approach and as a more rider-friendly and greener alternative to Uber.