Senior Data Engineer, Input Output

Technical Intelligence

Salary not provided

SQL

AWS

Python

Airflow

Terraform

Athena

Redshift

Spark

dbt

Senior and Expert level

Remote from UK

Blockchain infrastructure research & engineering

Be an early applicant

Blockchain infrastructure research & engineering

201-500 employees

FintechB2BCryptocurrencyBlockchain

Be an early applicant

Salary not provided

SQL

AWS

Python

Airflow

Terraform

Athena

Redshift

Spark

dbt

Senior and Expert level

Remote from UK

201-500 employees

FintechB2BCryptocurrencyBlockchain

Company mission

To perturb the graphs to a more connected, transparent and fair configuration for both the flow of ideas and value.

Job

Company

Role

Who you are

A MSc/PhD in Computer Science, AI, or a related field is a strong plus
Typically 7+ years of professional experience in data engineering or data science
Expertise in data modeling and data warehousing, including building and optimizing data schemas and data lakes
Hands-on experience specifically with AWS data services like Glue, Redshift, S3, Lambda, Athena
Advanced proficiency in Python, SQL, PySpark
Hands-on experience with big data frameworks like Apache Spark, DBT, workflow orchestration tools like Apache Airflow or AWS Step Functions, and Infrastructure-as-Code like CloudFormation or Terraform
Hands-on experience with MLOps in operationalizing machine learning models in production
Experience leading and mentoring data engineers and driving data system projects from conception to completion
Solid critical thinking, research, and problem-solving skills, with the ability to quickly grasp any data-related domain
Solid foundation of large-scale data systems, including data warehousing and data processing, including parallel processing, data partitioning, cost efficiency
Solid data programming covering algorithms, data structures, design patterns, and relational databases
Solid software development practices, version control, testing, and CI/CD
Knowledge of Machine Learning (ML), Natural Language Processing (NLP), or Deep Learning (DL)
Knowledge of the Blockchain domain and passionate about gaining further breadth and depth of the domain

What the job involves

As a Senior Data Engineer in the Technical Intelligence (TechInt) team, you will play a crucial role in shaping the company's strategic direction
The TechInt team's core function is to analyze the blockchain industry, providing leadership with data-driven insights into competitor activities, emerging trends and projects, and areas of technical innovation
You will contribute to an automated process that leverages a data warehouse alongside machine learning (ML) and artificial intelligence (AI) on AWS to generate these insights
The role works closely with senior leadership and involves direct exposure to strategic decision-making, with a focus on analyzing company strategy and new venture planning from a quantitative perspective
Own and drive the end-to-end data process for intelligence (business and technical), across all the ventures of the company. This involves acquiring, processing (ETL), modeling with AI/ML, and reporting
Serve as the competitive positioning expert in the blockchain landscape, responsible for providing data insights that fulfill stakeholder requirements
Architect and build performant and scalable data engineering pipelines using AWS. Drive the data system design, modeling, data quality, and delivery
Work with senior leadership and stakeholders to understand data value, define key metrics for competitive positioning, and gather requirements. Work closely with data engineers and analysts to deliver the agreed-upon requirements
Work with data scientists, ML, and AI engineers to operationalize models and integrate LLM-related logic into data pipelines
Use Scrum methodologies to drive prioritization, planning, and execution of tasks for the data intelligence team

Our take

Blockchain technology has the potential to change the world, but its full potential is yet to be realised. Input Output's fully decentralized platform solves this problem through rigorous research practices and evidence-based software development, building high-assurance blockchain products for both the public and private sectors.

Input Output was founded by Charles Hoskinson, one of the most important names in cryptocurrency and blockchain. This has lent the company considerable weight, credibility and insight, allowing it to scale effectively. Input Output is best known for its flagship product, Cardano, a blockchain platform targeted at innovators, but its suite of products also includes Daedalus, ATALA, and Mantis.

Input Output's main challenge will be competing with other blockchain research and engineering companies. However, the strength of its technology and the expertise of its leadership should allow the company to remain competitive.