Data Engineer, Netcraft

Salary not provided

+ Equity tracking scheme

MongoDB

AWS

Docker

Kubernetes

Kafka

Elasticsearch

Postgres

Terraform

MySQL

RDS

Golang

DynamoDB

Mid and Senior level

London

2-5 days a week in office (Westminster, London)

Phishing detection, cybercrime disruption and website takedown solutions

Open for applications

Phishing detection, cybercrime disruption and website takedown solutions

201-500 employees

B2BCyber SecurityAutomationFraud

Open for applications

Salary not provided

+ Equity tracking scheme

MongoDB

AWS

Docker

Kubernetes

Kafka

Elasticsearch

Postgres

Terraform

MySQL

RDS

Golang

DynamoDB

Mid and Senior level

London

2-5 days a week in office (Westminster, London)

201-500 employees

B2BCyber SecurityAutomationFraud

Company mission

To detect and disrupt cybercrime at scale through constant innovation, extensive automation, and unique insight, delivering a safer online experience for everyone.

Job

Company

Role

Who you are

Experience designing and deploying webscale SaaS solutions that make use of OpenSearch or Elasticseach based search engines
Strong background in cloud engineering and containerisation (Docker, Kubernetes), with experience deploying services at scale, particularly on AWS
AWS managed data service experience, such as S3, RDS, Aurora, DynamoDB, etc
A strong focus on automation and operational efficiency, minimising manual intervention wherever possible to enhance system reliability
Strong troubleshooting and problem-solving skills, especially in complex, cloud-based infrastructure
Experience with AWS cost management and optimisation, using tools like AWS Cost Explorer and AWS Budgets to monitor, manage, and explain AWS spend

Desirable

Experience in managing MongoDB clusters for high-availability and scalability
Comfortable working with SQL-based databases (MariaDB, MySQL, Postgres), including schema design, query optimisation, and debugging scaling issues in high-load environments
Streaming/eventing technologies like Kafka
Infrastructure-as-code experience, especially Terraform
Setting up dashboards and alerts with observability tooling
Proficiency in a major back-end language, like Golang

What the job involves

Reporting to one of Netcraft’s Engineering Directors, you will work cross-functionally to help build, improve, maintain Netcraft’s vast data estate, as well as support teams to leverage that data to solve a range of problems within their respective services
As a Data Engineer you will have a deep understanding of modern relational DB and NoSQL technologies, plus hands-on data pipeline/ETL development experience, and strong focus on automation, security, performance, and observability
Deploying, configuring, and maintaining OpenSearch/Elasticsearch clusters in high-volume environments
Tuning performance to improve indexing and search latency
Managing upgrades and security controls
Monitoring and troubleshooting distributed search infrastructure
Designing and building pipelines for ingesting structured and unstructured data
Designing and optimising index strategies including sharding, partitioning, and improving data locality to ensure scalable, high-performance querying across large datasets
Working with other teams to formulate ETL approaches for their respective data stores
Optimising index mappings for search and analytics use cases
Balancing storage efficiency vs. query speed at scale, and able to advise on alternative solutions and migration approaches
Cost-aware, and able to articulate business benefits against the often-high run cost of at-scale data services

Salary benchmarks

Our take

Netcraft is a global leader that specialises in cybercrime detection, disruption, and takedowns. The company's portfolio includes partnerships with four of the world's largest companies, twelve of the top fifty banks, and five national governments, making it a trusted authority in the cyber-security space.

Central to Netcraft's achievements is its advanced technology platform, that enables the company to combat cyber threats with remarkable efficiency through automated processes. With this approach, the company swiftly identifies and neutralises online threats, providing clients with a robust shield against cyberattacks.

In a recent development, Netcraft has successfully strenghtened its commitment to combating online

Steph

Company Specialist at Welcome to the Jungle

Insights

19% employee growth in 12 months

Glassdoor (4.7)

Company

Company benefits

Hybrid and flexible working options
33 days holiday per year, including bank holidays
Private health cover including digital GP services, dental and optical
Pension scheme with up to 4% employer contribution
Meals, snacks and drinks provided daily in our offices

Company HQ

Westminster, London, UK

Leadership

Ryan Woodley

(CEO)

Previously spent 8 years at Progressive Leasing as the COO, CFO and CEO.

Share this job

View 8 more jobs at Netcraft