Data Engineer, Lyft
3+ days a week in office
Ride sharing company
Open for applications
Ride sharing company
1001+ employees
Open for applications
3+ days a week in office
1001+ employees
Company mission
To improve people’s lives with the world’s best transportation.
Role
Who you are
- 2+ years of relevant professional experience
- Strong experience with Spark
- Experience with Hadoop (or similar) Ecosystem, S3, DynamoDB, MapReduce, Yarn, HDFS, Hive, Spark, Presto, Pig, HBase, Parquet
- Strong skills in a scripting language (Python, Ruby, Bash)
- Good understanding of SQL Engine and able to conduct advanced performance tuning
- Proficient in at least one of the SQL languages (MySQL, PostgreSQL, SqlServer, Oracle)
- Experience with workflow management tools (Airflow, Oozie, Azkaban, UC4)
- Comfortable working directly with data and business partners to bridge Lyft’s business goals with data engineering
- Preferred to have experience of building and maintaining insurance related data pipeline for large organizations
What the job involves
- Joining Lyft as a Data Engineer means becoming a pivotal part of a team dedicated to shaping the future of transportation.
- You'll be tasked with developing robust data infrastructure—encompassing data transport, collection, and storage—and providing services that enable our leadership to make informed, risk-reducing decisions.
- We're in search of a Data Engineer to construct a scalable insurance data pipeline that will inform our financial strategies.
- Collaborating closely with our claims engineering, actuarial, and science teams, as well as our insurance partners, you'll lead the charge from technical proposal to final implementation.
- This role involves clear communication of technical challenges to both our internal teams and external partners, ensuring a cohesive approach to problem-solving
- As the steward of our core data pipeline, which underpins Lyft's key metrics, you'll leverage your data expertise to refine data models and spearhead the creation and launch of scalable data pipelines.
- These efforts will support Lyft's expanding needs in insurance data processing and analytics, providing critical business and user behavior insights.
- With access to vast amounts of Lyft data, your work will empower teams across Analytics, Data Science, Engineering, and beyond, driving innovation and growth
- Design and implement insurance and claim-related data pipeline to help optimize insurance operation strategies
- Tune ETL and MapReduce job to improve data processing performance
- Partner with external insurance partners and Lyft business stakeholders to ensure seamless execution within established timelines
- Owner of the core company data pipeline, responsible for converting the business and engineering need to efficient & reliable data pipelines
- Main contributor to the team roadmap and lead the team to make the right technical decisions
Our take
Lyft has aimed for consistent growth, making sure to pitch itself as a more reliable and friendly ride-sharing option than its main competitor, Uber. Uber has a greater market share and operates globally, but Lyft hopes to compete by its focus on ride-sharing over Uber's more diversified business approach and as a more rider-friendly and greener alternative to Uber.
Operating only in the USA and Canada, Lyft is in a position of being less affected by global events than Uber but also more vulnerable to local conditions. As an example, while it doesn't face the regulatory hurdles around employment rights that Uber does, it is unable to balance out the cost of the unusually expensive US auto insurance across its operations.
In 2022, Lyft acquired PBSC Urban Solutions, a bike-share equipment and technology supplier, allowing Lyft to compete in new verticals and reaffirming its commitment to green transportation. It has also trialed and launched Lyft Assisted, where drivers help passengers from their door into the car to get to medical appointments. These developments chime well with Lyft's unique selling point as a friendlier and more environmentally aware ride-sharing app.
Steph
Company Specialist at Welcome to the Jungle
Insights
Company
Funding (last 2 of 14 rounds)
Jun 2018
$600m
LATE VC
Mar 2018
$200m
LATE VC
Total funding: $4.9bn
Company benefits
- Great medical, dental, and vision insurance options
- Mental health benefits
- In addition to 12 observed holidays, salaried team members have unlimited paid time off, hourly team members have 15 days paid time off
- 401(k) plan to help save for your future
- 18 weeks of paid parental leave. Biological, adoptive, and foster parents are all eligible
- Pre-tax commuter benefits
- Lyft Pink - Lyft team members get an exclusive opportunity to test new benefits of our Ridership Program
- Family building benefits
- Lyft Pink - Lyft team members get an exclusive opportunity to test new benefits of our Ridership Program
Company HQ
China Basin, San Francisco, CA
Articles
Leadership
John Zimmer
(Co-Founder)Originally an Analyst at Lehman Brothers, Zimmer then founded Zimride which was a private ridesharing company that pivoted into Lyft.
Logan Green
(Co-Founder)Founded Zimride, a private ridesharing company which later pivoted into Lyft.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 99 more jobs at Lyft