Staff Software Engineer, Tatari

• 7+ years of dedicated experience building data pipelines and scaling data infrastructure
• 5+ years of experience working with cloud-based infrastructure (we use AWS and Databricks)
• Strong programming skills in Python or a similar language
• Proven experience deploying and managing open-source frameworks such as Airflow, Kafka, Spark, Kubernetes, Terraform, Docker, Helm charts, etc
• Proficiency with Spark/PySpark
• Working knowledge of OLAP and OLTP databases like Clickhouse and Postgres
• Experience with security, controls, and access management for data
• Strong problem-solving skills and the ability to lead projects from conception to completion

Desirable

• As a Staff Data Platform Engineer on our core Data Platform team, you will play a key role in leveling up Tatari’s data platform by designing, building, and scaling the infrastructure that powers all of our data engineering, data science, and analytics efforts
• You will drive architectural decisions, mentor team members, and lead initiatives to implement industry-standard data engineering practices and solutions
• This role provides an opportunity to influence the technical strategy, bring in new tools and technologies when necessary, and ensure the scalability, reliability, and performance of our data infrastructure
• Lead the design and development of scalable data infrastructure and data pipelines
• Collaborate closely with data engineering, data science, and analytics teams to understand business requirements and deliver robust solutions
• Introduce and drive the adoption of new tools and technologies to enhance the data platform
• Ensure best practices for data security, governance, and access management
• Mentor and guide engineers on the Data Platform team, fostering a culture of technical excellence