Lead Data Engineer, Mastercard
Office located in Mountain View
Global payments technology company
Open for applications
Global payments technology company
1001+ employees
Open for applications
Office located in Mountain View
1001+ employees
Company mission
To connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart, and accessible.
Role
Who you are
- Expertise in Spark (PySpark/Scala), Hadoop, Hive, Impala, and Airflow
- Strong coding skills in Python or Scala and a solid understanding of distributed data processing
- Hands-on experience with Databricks on cloud platforms (preferably AWS), including S3, Delta Lake, DLT, SQL Warehouses, Unity Catalog, and Databricks Asset Bundles (DAB)
- Strong experience with HDFS storage and handling large-scale structured and semi-structured datasets
- Proficiency in Git-based development workflows and CI/CD pipelines using Jenkins
- Leadership experience, with a track record of mentoring, guiding, and supporting engineering teams
- Deep understanding of distributed systems, data partitioning strategies, and performance optimization
- Strong problem-solving skills and a delivery mindset with the ability to work cross-functionally
Desirable
- Experience with data governance and security best practices in regulated environments
- Familiarity with modern DataOps practices and observability tools
What the job involves
- We’re looking for a Lead Data Engineer to join our SME Data team, which powers high-impact data solutions across both on-prem and cloud platforms
- As a Lead Data Engineer, you’ll architect, build and optimize robust data pipelines and platforms and lead a team of engineers working at the intersection of Big Data and Cloud innovation
- This role is ideal for someone passionate about solving large-scale data engineering challenges and who thrives in a hybrid environment spanning on-prem Hadoop clusters and modern cloud-native technologies
- Design, build, and maintain scalable data pipelines and architectures for both on-prem (Hadoop ecosystem) and Databricks Cloud environments
- Lead and mentor a team of data engineers—providing technical guidance, conducting code reviews, and fostering team growth
- Ensure data quality, reliability, and governance across all stages of data processing
- Work closely with data scientists, analysts, and business stakeholders to deliver impactful data solutions
- Drive best practices in CI/CD using Jenkins and Git and manage deployment pipelines for seamless production releases
- Optimize workflows using Airflow for orchestration and ensure performance across HDFS, Hive, Impala, and Spark
- Utilize Databricks features including Delta Tables, SQL Warehouses, DLT pipelines and Unity Catalog for secure, performant data management
- Champion team collaboration and continuous improvement in both engineering practices and team development
Application process
- End Date: August 31, 2025
Our take
Mastercard is in the global payments business, and operates the world's fastest payments processing network. Its products and solutions have become central to everyday commerce across the world, in activities ranging from shopping and travelling to running businesses.
As the economy has become more and more digitised, Mastercard has been a leading player in helping businesses and individuals across the globe embrace card payments and digital banking. One of the world's largest companies, its revenue has seen consistent gain in the last 20 years.
The challenge for modern payments companies is that payments are always changing, as seen in the astronomical rise of contactless payments over the last decade. Mastercard's acquisition of blockchain systems, and an overall focus on leveraging its technology towards a digital economy, has placed the company in good stead to keep up to date with current trends, like cryptocurrency, in the digitised payments world.
Steph
Company Specialist at Welcome to the Jungle
Insights
21% employee growth in 12 months
Company
Company benefits
- Gym membership
- Share purchase options
- Extra holiday purchase optional
- Work from home opportunities
- Health insurance
Company HQ
Purchase, Harrison, NY
Leadership
Michael Miebach
(CEO, not founder)Has served in a variety of roles at the company, including President and CPO. Currently Board Member at IBM, Accion, the World Resources Institute, the US-India Strategic Partnership Forum, and the Metropolitan Opera. They are also a Trustee of USCIB.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 232 more jobs at Mastercard