Senior Data Engineer, Lyft
Mapping
More information about location
3 days a week in office
Ride sharing company
Open for applications
Ride sharing company
1001+ employees
Open for applications
More information about location
3 days a week in office
1001+ employees
Company mission
To improve people’s lives with the world’s best transportation.
Role
Who you are
- Bachelor's degree in Computer Science, Engineering, Mathematics, Statistics, or a related field
- 4+ years of relevant professional experience
- Strong experience with Spark
- Experience with Hadoop (or similar) Ecosystem, S3, DynamoDB, MapReduce, Yarn, HDFS, Hive, Spark, Presto, Pig, HBase, Parquet
- Strong skills in a scripting language (Python, Ruby, Bash)
- Good understanding of SQL Engine and able to conduct advanced performance tuning
- Proficient in at least one of the SQL languages (MySQL, PostgreSQL, SqlServer, Oracle)
- Experience with workflow management tools (Airflow, Oozie, Azkaban, UC4)
- Comfortable working directly with data analytics to bridge Lyft’s business goals with data engineering
What the job involves
- We are looking for a Data Engineer to build a scalable data platform
- You will proactively propose new ideas, evaluate multiple approaches and choose the best one based on fundamental qualities and supporting data
- You will communicate highly technical problems working along with our cross-functional team and you will have ownership of our core data pipeline that powers mapping’s top-line metrics
- You will also use data expertise to help evolve data models in several components of the data stack
- You will help architect, building, and launching scalable data pipelines to support Lyft’s growing data processing and analytics needs
- Your efforts will allow access to business and user behavior insights, using huge amounts of Lyft data to fuel several teams such as Analytics, Data Science, Engineering, and many others
- You will work with incredibly passionate and talented colleagues from software engineering, machine learning and data science on projects that delight millions of passengers and drivers
- Owner of the core data pipelines in mapping, responsible for scaling up data processing flow to meet the rapid data growth at Lyft
- Evolve data model and data schema based on business and engineering needs
- Implement systems tracking data quality and consistency
- Develop tools supporting self-service data pipeline management (ETL)
- SQL and MapReduce job tuning to improve data processing performance
- Write well-crafted, well-tested, readable, maintainable code
- Participate in code reviews to ensure code quality and distribute knowledge
- Participate in on-call rotations to ensure high availability and reliability of workflows and data
- Unblock, support and communicate with internal & external partners to achieve results
Our take
Lyft has aimed for consistent growth, making sure to pitch itself as a more reliable and friendly ride-sharing option than its main competitor, Uber. Uber has a greater market share and operates globally, but Lyft hopes to compete by its focus on ride-sharing over Uber's more diversified business approach and as a more rider-friendly and greener alternative to Uber.
Operating only in the USA and Canada, Lyft is in a position of being less affected by global events than Uber but also more vulnerable to local conditions. As an example, while it doesn't face the regulatory hurdles around employment rights that Uber does, it is unable to balance out the cost of the unusually expensive US auto insurance across its operations.
In 2022, Lyft acquired PBSC Urban Solutions, a bike-share equipment and technology supplier, allowing Lyft to compete in new verticals and reaffirming its commitment to green transportation. It has also trialed and launched Lyft Assisted, where drivers help passengers from their door into the car to get to medical appointments. These developments chime well with Lyft's unique selling point as a friendlier and more environmentally aware ride-sharing app.
Steph
Company Specialist at Welcome to the Jungle
Insights
Company
Funding (last 2 of 14 rounds)
Jun 2018
$600m
LATE VC
Mar 2018
$200m
LATE VC
Total funding: $4.9bn
Company benefits
- Great medical, dental, and vision insurance options
- Mental health benefits
- In addition to 12 observed holidays, salaried team members have unlimited paid time off, hourly team members have 15 days paid time off
- 401(k) plan to help save for your future
- 18 weeks of paid parental leave. Biological, adoptive, and foster parents are all eligible
- Pre-tax commuter benefits
- Lyft Pink - Lyft team members get an exclusive opportunity to test new benefits of our Ridership Program
- Family building benefits
- Lyft Pink - Lyft team members get an exclusive opportunity to test new benefits of our Ridership Program
Company HQ
China Basin, San Francisco, CA
Articles
Leadership
John Zimmer
(Co-Founder)Originally an Analyst at Lehman Brothers, Zimmer then founded Zimride which was a private ridesharing company that pivoted into Lyft.
Logan Green
(Co-Founder)Founded Zimride, a private ridesharing company which later pivoted into Lyft.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 99 more jobs at Lyft