Senior Data Engineer, Omnidian

• This role is perfect for a data professional passionate about sustainability and eager to make a significant impact in a well-funded, growth-stage company
• You have strong data engineering skills and experience (experience with IoT data strongly preferred).You are highly analytical and detail-oriented
• You possess a strong curiosity and a growth mindset
• You excel in both independent work and team collaboration
• You are a proactive problem solver with excellent communication skills
• You show empathy and respect for coworkers, partners, and customers
• You can give and receive constructive feedback effectively
• You are adaptable and able to balance quick responses to business needs with strategic, long-term projects
• 4+ years experience building and optimizing data sets, ‘big data’ data pipelines, and architectures
• Experience successfully delivering large scale data engineering projects
• Proficiency with distributed systems like Spark, Kafka and data lakes
• Experience working with IoT data Experience with cloud platforms like AWS or Azure
• Understanding of data modeling principles
• Proficiency with object oriented programming languages such as Python or Kotlin
• Comfortable with SQL
• Proven ability to perform root cause analysis on processes and data to identify improvement opportunities
• Demonstrated experience with data transformation, workload management, and metadata

Desirable

• As a Senior Data Engineer at Omnidian, you’ll play a crucial role in shaping our data infrastructure
• You will design, build, document and maintain data pipelines to support our Data Warehouse and our Data Acquisition (IoT data) systems
• You’ll uphold and contribute to the creation of standards for quality and security
• You’ll collaborate with cross-functional teams to enhance our data capabilities, supporting our mission to build a more sustainable future through innovative technology and exceptional customer experience
• This role sits within the Data Management and Infosec team (part of our Engineering department) and will report to our Manager of Data Engineering
• Data Engineering (80%)
• Build and maintain data warehouse pipelines via Databricks bronze, silver and gold medallion structures
• Build and maintain data acquisition pipelines which acquire IoT data from aggregator portals, land and transform the data, and make the data available to consumer services
• Use your knowledge of different programming languages to code and update data systems
• Write or contribute to technical specification documents as appropriate
• Data Stewardship (15%)
• Create and maintain related data documentation as outlined in Data Governance standards
• Act as an ambassador for data governance standards when working cross functionally
• Participate in code reviews and change management processes
• Continuous Improvement (5%)
• Identify, align stakeholders on and implement improvements to our processes, code and/or architecture