Data Engineer, Clarity AI

• We like engineers who adapt quickly to new challenges and break them down in smaller pieces that a highly productive team will find high-quality solutions for
• As an Engineer, you will have a solid technical foundation and a strong focus on growing your development skills
• They use best practices to ship high-quality code and continue to push their knowledge
• You have more than 3 years of professional experience as a Software Developer/Data Engineer, and hold a degree in a quantitative field (CS, Engineer, Math, Physics, … )
• You have built production data pipelines in the cloud, setting up data-lake and server-less solutions; on top of that, you have hands-on experience with schema design and data modeling
• Proven knowledge of Python(Pandas) is required, Java/Scala will be a plus
• You have strong SQL skills and knowledge and familiarity with other distributed data stores such as Redis, ElasticSearch, Druid, Cassandra, Hbase
• You are comfortable working in containerized cloud developments, and familiar with the integration of public and private APIs
• Strong communication skills; The right candidate can thrive in an environment of asynchronous conversation, since a part of the Clarity team will be based remotely
• Open to try new technologies and programming languages
• Fluency in English

Desirable

• We are looking for a Data Engineer for the Tech team
• You will be part of the team delivering the different parts of our production-ready product while co-designing and implementing an architecture that can scale up with the product and the company
• You will help to build a data platform to enable other teams to self-service high-quality data while performing data operations to support their day-to-day actions
• You will join the data engineering team which is responsible for developing models, practises and systems to support the data lifecycle
• You’ll support designing and creating all aspects of our ever-growing set of external and internal data pipelines, understand the problems, and tie them back to data engineering solutions
• You will be responsible of designing and building our ETL's
• You’ll transform raw data from different sources (batch and near-real-time) into intuitive data models, using a diverse set of tools (such as Spark, Hadoop, Redshift, Kafka, etc.) to build robust data pipelines of high quality in a scalable fashion (regarding volume and maintainability)
• In order to develop feature and product features, you will form part of cross-functional squads including people of many different teams
• Work closely with Platform, Data Science and Backend teams, as well as product and tech teams
• Fix, troubleshoot and solve bugs and issues