Senior Data Engineer, adMarketplace

• BS in Engineering, Computer Science or related discipline
• Must have 5+ years strong hands-on development experience using Python
• Must have experience with big data and streaming technologies like Apache Spark, Apache Kafka and Data Warehouse
• Experience with Cloud Analytics platforms like Databricks/Snowflake
• Experience developing, delivering and maintaining scalable data streaming, ETL processing and aggregation pipelines
• Experience Workflow Management tools like Airflow, Argo Workflows, Azkaban
• Experience with relational SQL and NoSQL databases
• Experience with public cloud AWS/ GCP/ Azure
• Experience working in a Linux environment/ Shell Scripting
• Ability to collaborate with multiple teams and understanding testing and deployment methodologies
• Experience building software in continuous integration and delivery fashion in an automated way
• Excellent documentation, communication, and troubleshooting skills

Desirable

• Develop and maintain ad-tech related data systems and system components using Python
• Data streaming, processing, and aggregation solutions
• Data-driven applications, ETL/ELT Pipelines
• 24/7 low latency large-scale distributed systems
• Cloud migration and containerization projects
• External Integrations for data exchange
• Work with the team for technical implementation of Data Engineering projects including data streaming, data transformation and aggregation pipelines
• Build data pipelines on cloud-based platforms
• Work closely with QA, DevOps, and other engineering teams to integrate, test and release different system components (all stages of SDLC)
• Work closely with business stakeholders and other engineers on understanding and translating business requirements into technical solutions