Data Engineer, Spiff

• 3-5 years of experience as a Data Engineer (beyond Data/BI Analysts)
• Cloud architecture experience (Google Cloud Platform preferably, AWS, Azure)
• Strong Python coding skills with a demonstrated ability to code, test and deploy independently
• Experience building production grade code to handle process/manipulate large scale data (Apache Beam/ Dataflow, workflow orchestration, cloud deployment)
• Strong notions on System Architecture, connecting various independent systems
• Knowledge of how Data moves (Stream vs Batch, methods to send data through services, Data Collection, storage, access and analytics at scale)
• Experience or strong notions on using Data at scale
• Build and maintain ETL processes for large scale data
• Familiarity with databases (Postgres, MySQL, etc)

Desirable

• We’re looking for an awesome Data Engineer to join our growing team and help us deliver intuitive and delightful experiences to our customers
• As a Data Engineer, you will design and build data pipelines that support data science product features into our core application
• These pipelines will be well tested and scalable to meet both streaming and batch processing of data, so that we can provide useful insights and predictions from complex systems
• Work alongside our Data Scientist and other Data Engineers to help make use of the data Spiff collects and creates
• Create pipelines starting with Data Warehouse, apply logic/algorithms, and deliver results to the desired destination
• Identify ways to improve data reliability, efficiency, and quality
• Deploy sophisticated analytics programs, machine learning, and statistical methods
• Work within the Agile framework to manage team progress towards key results