Data Engineer, Lyft
CA$108-135k
More information about location
Ride sharing company
Open for applications
Ride sharing company
1001+ employees
Open for applications
CA$108-135k
More information about location
1001+ employees
Company mission
To improve people’s lives with the world’s best transportation.
Role
Who you are
- Bachelor's degree in Computer Science, Engineering, Mathematics, Statistics, or a related field
- 4+ years of relevant professional experience
- Strong experience with Spark and with a scripting language (Python, Ruby, Bash)
- Exceptional analytical skills, with an in-depth understanding of data quality issues and the ability to dive into complex datasets to resolve inconsistencies
- Excellent communication skills, with the ability to articulate technical concepts clearly to both technical and non-technical audiences while collaborating effectively across teams
- Experience with disparate database, querying and streaming technologies such as S3, DynamoDB, HDFS, Hive, Presto, Pig, HBase, Parquet, Iceberg, Flink, Spark Streaming, Kafka
- Experience with data quality tools such as Great Expectations, dbt, Monte Carlo, Soda, Collibra
- Strong understanding of SQL Engine, experience with querying geospatial data, and able to conduct advanced performance tuning
- Proficient in at least one of the SQL languages (MySQL, PostgreSQL, SqlServer, Oracle)
- Experience with workflow management tools (Airflow, Oozie, Azkaban, UC4, Prefect)
- Experience with infra tooling (Terraform, Cloud Formation, Docker, Kubernetes, Ansible, Chef, Puppet etc preferably in an AWS context)
- Experience defining API schemas and developing backend services in a microservices environment
What the job involves
- As a Data Engineer on the Mapping team, you will collaborate with our world class team of engineers, product managers, and data scientists to grow and improve the quality of recommended routes and accuracy of our travel time estimations
- You will architect, build, and maintain scalable data pipelines and services to support route simulation, experimentation, analytics, and machine learning models
- Your work will enable integration with partner teams and allow stakeholders across Engineering, Data Science, and Product to make data-informed decisions that directly impact Lyft’s growth and profitability
- Our technology stack is based on the latest technologies such as AWS, Kubernetes and Apache Airflow
- You will work with incredibly passionate and talented colleagues from software engineering, machine learning and data science on projects that directly impact millions of riders and drivers
- Owner of the core data pipelines in mapping, responsible for scaling up data processing flow to meet the rapid data growth at Lyft
- Develop strong subject matter expertise in the systems you manage, setting and managing SLAs for both data pipeline and datasets
- Continuously evolve data models and schemas to meet business and engineering requirements
- Develop tools that support self-service management of data pipelines (ETL), schema evolution, and perform SQL tuning to optimize data processing performance
- Write clean, well-tested, and maintainable code, prioritizing scalability and cost efficiency
- Conduct code reviews to uphold code quality standards and facilitate knowledge sharing
- Participate in on-call rotations to maintain high availability and reliability of data workflows
- Unblock, support and communicate with internal & external partners to achieve results
Our take
Lyft has aimed for consistent growth, making sure to pitch itself as a more reliable and friendly ride-sharing option than its main competitor, Uber. Uber has a greater market share and operates globally, but Lyft hopes to compete by its focus on ride-sharing over Uber's more diversified business approach and as a more rider-friendly and greener alternative to Uber.
Operating only in the USA and Canada, Lyft is in a position of being less affected by global events than Uber but also more vulnerable to local conditions. As an example, while it doesn't face the regulatory hurdles around employment rights that Uber does, it is unable to balance out the cost of the unusually expensive US auto insurance across its operations.
In 2022, Lyft acquired PBSC Urban Solutions, a bike-share equipment and technology supplier, allowing Lyft to compete in new verticals and reaffirming its commitment to green transportation. It has also trialled and launched Lyft Assisted, where drivers help passengers from their door into the car to get to medical appointments. These developments chime well with Lyft's unique selling point as a friendlier and more environmentally aware ride-sharing app, whilst the acquisition of European competitor Freenow could add 6 million new riders to its platform in 2026.
Steph
Company Specialist at Welcome to the Jungle
Insights
-2% employee growth in 12 months
Company
Funding (last 2 of 14 rounds)
Jun 2018
$600m
LATE VC
Mar 2018
$200m
LATE VC
Total funding: $4.9bn
Company benefits
- Great medical, dental, and vision insurance options
- Mental health benefits
- In addition to 12 observed holidays, salaried team members have unlimited paid time off, hourly team members have 15 days paid time off
- 401(k) plan to help save for your future
- 18 weeks of paid parental leave. Biological, adoptive, and foster parents are all eligible
- Pre-tax commuter benefits
- Lyft Pink - Lyft team members get an exclusive opportunity to test new benefits of our Ridership Program
- Family building benefits
- Lyft Pink - Lyft team members get an exclusive opportunity to test new benefits of our Ridership Program
Company HQ
China Basin, San Francisco, CA
Leadership
John Zimmer
(Co-Founder)Originally an Analyst at Lehman Brothers, Zimmer then founded Zimride which was a private ridesharing company that pivoted into Lyft.
Logan Green
(Co-Founder)Founded Zimride, a private ridesharing company which later pivoted into Lyft.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 76 more jobs at Lyft