Senior Data Engineer, People Data Labs
Offers Stock
B2B data provider for industry leading platforms
Open for applications
B2B data provider for industry leading platforms
21-100 employees
Open for applications
Offers Stock
21-100 employees
Company mission
To do the heavy lifting of fata collection and standardization so our customers can focus on building and scaling innovative, compliant data solutions.
Role
Who you are
- We are looking for individuals who can balance extreme ownership with a “one-team, one-dream” mindset
- If you are looking to be part of a team discovering the next frontier of data-as-a-service (DaaS) with a high level of autonomy and opportunity for direct contributions, this might be the role for you
- We like our engineers to be thoughtful, quirky, and willing to fearlessly try new things. Failure is embraced at PDL as long as we continue to learn and grow from it
- 5-7+ years of industry experience with clear examples of strategic technical problem-solving and implementation
- Strong software development fundamentals
- Experience with Python
- Expertise with Apache Spark (Java, Scala, and/or Python-based)
- Experience with SQL
- Experience building scalable data processing systems (e.g., cleaning, transformation) from the ground up
- Experience using developer-oriented data pipeline and workflow orchestration (e.g., Airflow (preferred), dbt, dagster or similar)
- Knowledge of modern data design and storage patterns (e.g., incremental updating, partitioning and segmentation, rebuilds and backfills)
- Experience working in Databricks (including delta live tables, data lakehouse patterns, etc.)
- Experience with cloud computing services (AWS (preferred), GCP, Azure or similar)
- Experience with data warehousing (e.g., Databricks, Snowflake, Redshift, BigQuery, or similar)
- Understanding of modern data storage formats and tools (e.g., parquet, ORC, Avro, Delta Lake)
- People Thrive Here Who Can:
- Balance high ownership and autonomy with a strong ability to collaborate
- Work effectively remotely (able to be proactive about managing blockers, proactive on reaching out and asking questions, and participating in team activities)
- Demonstrate strong written communication skills on Slack/Chat and in documents
- Exhibt experience in writing data design docs (pipeline design, dataflow, schema design)
- Scope and breakdown projects, communicate and collaborate progress and blockers effectively with your manager, team, and stakeholders
Desirable
- Degree in a quantitative discipline such as computer science, mathematics, statistics, or engineering
- Experience working with entity data (entity resolution / record linkage)
- Experience working with data acquisition / data integration
- Expertise with Python and the Python data stack (e.g., numpy, pandas)
- Experience with streaming platforms (e.g., Kafka)
- Experience evaluating data quality and maintaining consistently high data standards across new feature releases (e.g., consistency, accuracy, validity, completeness)
What the job involves
- Our customers are trying to solve complex problems, and we only help them achieve their goals as a team. Our Data Engineering Team is the secret sauce behind all that we do and we are looking for the best of the best
- Build infrastructure for ingestion, transformation, and loading an exponentially increasing volume of data from a variety of sources using Spark, SQL, AWS, and Databricks
- Building an organic entity resolution framework capable of correctly merging hundreds of billions of individual entities into a number of clean, consumable datasets
- Developing CI/CD pipelines and anomaly detection systems capable of continuously improving the quality of data we're pushing into production
- Dreaming up solutions to largely undefined data engineering and data science problems
Our take
The increasing appetite of businesses to gain a competitive advantage over the competition from the use of data, coupled with the challenges of managing an increasingly complex and heterogeneous data landscape, has created the right conditions for the DaaS market to grow rapidly.
People Data Labs builds APIs that enable developers, engineers, and data scientists to build data-driven products using B2B data records. Their data powers internal and customer-facing digital products that can drive revenue and increase efficiency, and is used by enterprise businesses as well as tech start-ups. Their clients include Kleiner Perkins, BreezyHR, SugarCRM, 6Sense, Lunchclub, and Gem.
People Data Labs is focused on hiring engineering and product professionals as part of an ongoing push into critical verticals. This includes offerings in the fintech space, where they plan to expand their data products to support fraud detection, risk mitigation, and insurance underwriting. The company also plan to expand their offerings in firmographic data via insights and company data products for investment research, sales planning, and investor due diligence.
Freddie
Company Specialist at Welcome to the Jungle
Insights
43% employee growth in 12 months
Company
Funding (last 2 of 5 rounds)
Nov 2021
$45m
SERIES B
Oct 2018
$7m
SERIES A
Total funding: $55.3m
Company benefits
- Stock
- Unlimited paid time off
- Medical, dental, & vision insurance
- Health, fitness, and office stipends
- The permanent ability to work wherever and however you want
Company HQ
South Beach, San Francisco, CA
Leadership
Ben Eisenberg
(CEO)Ben joined PDL in 2017 as a Technical Analyst, since then he has held a number of roles and became CEO in 2024.
Share this job
View 4 more jobs at People Data Labs