Data Platform Lead, Omnidian

• Data Architecture Experience: You are comfortable with data architecture and patterns for both structured and unstructured data. You have experience owning and maintaining distributed big data platforms such as Databricks or Hadoop as well as relational databases such as MySQL
• Data Engineering Expertise: You have a strong working knowledge of Data Engineering processes and standards
• Leadership Abilities: You possess strong leadership skills, with the ability to provide mentoring cross-functionally
• Communication: You have excellent verbal and written communication skills, with the ability to effectively communicate technical concepts to both technical and non-technical stakeholders
• Value Creation: You understand business needs, users, technology, and data, and collaborate with stakeholders to design and deliver data solutions that provide business value
• Problem-Solving: You demonstrate strong analytical and problem-solving abilities, with a proactive approach to identifying issues and implementing effective solutions
• 5+ years experience as a Data Platform Engineer/DBA
• 2+ years in a technical leadership role
• Experience successfully managing large scale data platform projects
• Proficiency with distributed systems like Spark, Kafka and data lakes
• Strong experience with relational databases like SQL Server or MySQL
• Experience with cloud platforms like AWS or Azure
• Understanding of data modeling principles
• Deep understanding of data platform availability, recoverability, security and performance best practices
• Experience implementing and maintaining cost forecasting and containment processes and structures
• Experience implementing data platform monitoring and alerting
• Proficient with SQL

Desirable

• We are looking for an experienced Data Platform Lead to own the availability, reliability, recoverability, security and performance of our data platforms
• You will be responsible to architect, implement, manage and optimize robust data platforms
• You will be responsible for cost transparency, containment and forecasting
• You will own, enhance and update Data Platform processes and standards, understand company needs, and own and execute critical projects on our Data Platform roadmap
• Our IoT timeseries data is a critical component of our service
• You will be responsible to understand the business and technical requirements for this data and to own the data platform architecture solutions, working closely with our Data Acquisition team for a cohesive architecture
• This role sits within our Engineering department and will report directly to our Director of Data Management and Information Security
• At Omnidian we believe in trust and autonomy. How you create an impact is ultimately up to you. Here is an outline of some of the things you’ll be doing:
• Hands on Data Platform Administration (33%)
• Participate in change management process; implement database changes
• Ensure data structures are available, reliable, recoverable, secure and performant
• Establish appropriate monitoring and alerting mechanisms for data platforms, including runbooks
• Establish a transparent intake process for data platform administration requests; complete requests
• Proactively identify improvements in database code or structure to improve performance and/or mitigate costs; make improvements as needed and/or work with stakeholders to prioritize and track the work
• Create and maintain dashboards and alerts to track and forecast data platform costs
• Own and Lead Critical Data Platform Projects (33%)
• Own successful outcome and positive impact for critical large scale data platform projects including project management and communication
• Mitigate risks and clear blockers
• Collaborate cross functionally to drive initiatives
• Contribute hands-on to the work as needed
• Own the Data Platform Roadmap and Strategy (33%)
• Establish, communicate and maintain a rolling 5 Quarter roadmap for Data Platform
• Drive stakeholder alignment on roadmap and prioritization
• Ensure scalable and cost effective architecture
• Establish and continuously improve Data Platform architecture, processes and standards
• Provide mentoring, coaching and education on Data Platform best practices and standards to stakeholders
• Work with partner teams to establish SLAs for data platform administration requests and system availability; report against SLAs to stakeholders