Senior Data Engineer, Clarity AI

• You have 7+ years of professional experience as a Software Developer/Data Engineer, and hold a degree in a quantitative field (CS, Engineer, Math, Physics, … )
• You have built production data pipelines in the cloud, setting up data-lake and server-less solutions; on top of that, you have hands-on experience with schema design and data modelling
• Proven knowledge of Python is required, Java/Scala will be a plus
• You have strong SQL skills and knowledge and familiarity with other distributed data stores such as Redis, ElasticSearch, Druid, Cassandra, Hbase
• You are comfortable working in containerized cloud developments, and familiar with the integration of public and private APIs
• Strong communication skills; The right candidate can thrive in an environment of asynchronous conversation, since a part of the Clarity team will be based remotely
• Open to try new technologies and programming languages
• Fluency in English

Desirable

• Clarity is looking for an Senior DE for the Tech team
• You will be part of the team delivering the different parts of our production-ready product, while co-designing and implementing an architecture that can scale up with the product and the company
• You will help to build a data platform to enable other teams to self service high quality data while performing data operations to support their day to day actions
• You will join the data engineering team which is responsible for developing models, practises and systems to support the data lifecycle
• You’ll support designing and creating all aspects of our ever-growing set of external and internal data pipelines, understand the problems, and tie them back to data engineering solutions
• You will be responsible of designing and building our ETL's
• You’ll transform raw data from different sources (batch and near-real-time) into intuitive data models, using a diverse set of tools (such as Spark, Hadoop, Redshift, Kafka, etc.) to build robust data pipelines of high quality in a scalable fashion (regarding volume and maintainability)
• In order to develop feature and product features, you will form part of cross functional squads including people of many different teams
• Work closely with Platform, Data Science and Backend teams, as well as product and tech teams
• Fix, troubleshoot and solve bugs and issues