Data Infrastructure Engineer, SPAN

• Bachelor's Degree in a quantitative discipline: computer science, statistics, operations research, informatics, engineering, applied mathematics, economics, etc
• 7+ years of relevant work experience in data engineering, Infrastructure as Code
• Expert level production-grade, programming experience in at least one of these languages (Python, Kotlin, or other JVM based languages)
• Experience in writing clean, concise and well structured code in one of the above languages
• Experience working with Infrastructure-as-code tools: Pulumi, Terraform, etc
• Experience with Kubernetes or Docker
• Experience working with latency data processing solutions: Kafka, Flink, Prefect
• Experience with SQL/Relational databases: Snowflake
• Experience working in AWS: Athena
• Experience working with CI/CD systems

Desirable

• As a Data Infrastructure Engineer you would be working to design, build, test and create infrastructure necessary for real time analytics and batch analytics pipelines
• You will work with multiple teams within the org to provide analysis, insights on the data.
• You will also be involved in writing ETL processes that support data ingestion
• You will also guide and enforce best practices for data management, governance and security
• You will build infrastructure to monitor these data pipelines / ETL jobs / tasks and create tooling/infrastructure for providing visibility into these
• We are looking for a Data Engineer with passion for building data pipelines, working with product, data science and business intelligence teams and delivering great solutions.
• Acquire deep business understanding on how SPAN data flows from IoT device to cloud through the system and build scalable and optimized data solutions that impact many stakeholders
• Be an advocate for data quality and excellence of our platform
• Build tools that help streamline the management and operation of our data ecosystem
• Ensure best practices and standards in our data ecosystem are shared across teams
• Work with teams within the company to build close relationships with our partners to understand the value our platform can bring and how we can make it better
• Improve data discovery by creating data exploration processes and promoting adoption of data sources across the company
• Have a desire to write tools and applications to automate work rather than do everything by hand
• Assist internal teams in building out data logging, alerting and monitoring for their applications
• Are passionate about CI/CD process
• Design, develop and establish KPIs to monitor analysis and provide strategic insights to drive growth and performance