Senior Data Engineer, Procore

• 5+ years of experience in a Data Engineer role with a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field
• Expertise building data pipelines (in either Real-time or batch) on large complex datasets using Spark or Flink frameworks
• Experience with AWS services including EC2, S3, Glue, EMR, RDS, Snowflake, Elastic Search, Cassandra and Data pipeline/streaming tools (Airflow, NiFi, Kafka)
• Experience building and optimizing data pipelines, architectures and data sets. A successful history of manipulating, processing and extracting value from large disconnected datasets
• Deep knowledge of stream processing using Kafka and highly scalable ‘big data’ data stores
• Expertise in Java or Python
• Team Player. Experience supporting and working with cross-functional teams in a dynamic environment
• Strong oral and written communication skills
• Experience of End-to-end data quality control and automated testing experience

Desirable

• Data platform engineers are responsible for designing and implementing Procore's overarching data strategy
• Critical projects include the design and operation of Procore's streaming and batching data processing infrastructure, architecture of Procore's datalake and the selection of new infrastructure technologies
• You will partner with world-class developers, engineers, architects, and data scientists to drive thinking, provide technical leadership, and collaborate in defining best practices around data engineering
• You will also work alongside local product management, engineering, and research teams to develop innovative solutions that will influence our product line
• Provide technical leadership to efforts around tooling and infrastructure that enable teams to efficiently complete and maintain data science projects
• Partner with teams on modeling and analysis problems – from transforming problem statements into analysis problems, to working through data modeling and engineering, to analysis and communication of results
• Lead code reviews, design, and best practices
• Coach and mentor senior engineers
• Use experience gained in the above and expertise in this space to influence our product roadmap, potentially working with prototype engineering team to add additional capabilities to our products to solve more of these problems