Data Engineer, Input Output

Technical Intelligence

Salary not provided

SQL

AWS

Docker

Kubernetes

GCP

Postgres

Airflow

Terraform

Jenkins

Athena

Redshift

Spark

Pandas

BigQuery

RDS

Oracle

DynamoDB

Mid and Senior level

Remote in UK

Blockchain infrastructure research & engineering

Open for applications

Blockchain infrastructure research & engineering

201-500 employees

FintechB2BCryptocurrencyBlockchain

Open for applications

Salary not provided

SQL

AWS

Docker

Kubernetes

GCP

Postgres

Airflow

Terraform

Jenkins

Athena

Redshift

Spark

Pandas

BigQuery

RDS

Oracle

DynamoDB

Mid and Senior level

Remote in UK

201-500 employees

FintechB2BCryptocurrencyBlockchain

Company mission

To perturb the graphs to a more connected, transparent and fair configuration for both the flow of ideas and value.

Job

Company

Role

Who you are

BSc/MSc in a Computer Science field, or equivalent practical experience
4+ years of work experience in data and software engineering : data storage, data manipulation, front-end and back-end development for software applications and data systems
Preferable work experience with blockchain
Professional English
Knowledge of big data processing platforms (such as Spark, Databricks, Google BigQuery), data orchestration (such as Airflow), and data manipulation libraries (such as Pandas, Polars)
Knowledge of cloud services management: AWS services (such as Amazon S3, RDS, Redshift, Lambda, Glue, Athena, DynamoDB) or GCP
Knowledge of relational databases (such as PostgreSQL, Oracle, Mssql) and writing highly optimized SQL
Knowledge of docker container orchestration (such as Kubernetes, ECS)
Knowledge of Continuous Integration and Continuous Delivery (CI/CD) pipelines (such as GitHub Actions, Travis, Jenkins)
Knowledge of Infrastructure as code (such as Terraform, AWS CloudFormation, AWS CDK)
Knowledge of blockchain on-chain data representation
Ability to communicate well both verbally and in writing, with both technical and non-technical partners

What the job involves

You will be part of the Technical Intelligence (TechInt) team
The team’s main function is to recon the blockchain industry and feed the company with new trends and projects
The TechInt team has automatized the recon process by utilizing a data lake and machine learning
The team currently harvests data from a variety of different sources
This data gets fed into different systems that then show this data as a report
You are responsible for maintaining and setting up data solutions and services
A key part would be to aid in the maturation of the data ingestion pipeline and processes
Moreover, you would be expected to create a state-of-the-art data warehouse which would be cloud-native
In your daily job, you do a mix of data engineering, and cloud infrastructure management
Develop and maintain automated data ingestion (API or crawling) pipelines from source code repositories, social media, and on-chain analytics
Simplify existing data pipelines - re-architecting where necessary
Research existing datasets to figure out their relevance - and remove irrelevant data pipelines and sources
Design a data warehouse that can be queried by analysts and APIs, and that will serve as a data backend for a reporting web application
Collaborate with data scientists to operationalize ML models and deploy them into production environments
Work closely with leadership to understand and define requirements, ensuring alignment with the department’s strategy and roadmap
Collaborate with a Data Scientist and an Intelligence Engineer to implement technical solutions that meet project goals
Ensure systems are functional, available, and carefully monitored for continuous performance and reliability

Our take

Blockchain technology has the potential to change the world, but its full potential is yet to be realised. Input Output's fully decentralized platform solves this problem through rigorous research practices and evidence-based software development, building high-assurance blockchain products for both the public and private sectors.

Input Output was founded by Charles Hoskinson, one of the most important names in cryptocurrency and blockchain. This has lent the company considerable weight, credibility and insight, allowing it to scale effectively. Input Output is best known for its flagship product, Cardano, a blockchain platform targeted at innovators, but its suite of products also includes Daedalus, ATALA, and Mantis.

Input Output's main challenge will be competing with other blockchain research and engineering companies. However, the strength of its technology and the expertise of its leadership should allow the company to remain competitive.