Senior Data Engineer, Kpler
Data and analytics for trade
Job no longer available
Data and analytics for trade
201-500 employees
Job no longer available
201-500 employees
Company mission
To facilitate efficient and sustainable trade through the provision of state-of-the art, technology-led data, analytics and market insight.
Role
Who you are
- Have at least 8 years of experience as a Software Engineer, including significant hands-on experience with using Python in production, especially with Spark, or Kafka
- Have worked with ML, OCR and NLP models integrated as part of complex production pipelines
- Have experience with DevOps and Infrastructure as Code practices, especially on AWS
- Have experience with Data Processing Orchestration (Airflow)
- Are fluent in English and have experience working in an international environment
Desirable
- Scala, and functional Programming frameworks such as Cats, fs2…
- Big Data Management : DeltaLake, Medallion, Lineage…
- Terraform, gitops, Kubernetes…
- ElasticSearch, GraphQL…
- Front-end web development (typescript, vue.js, react…)
- SQL schema and PostgreSQL optimisations
- AWS Well-Architected Framework principles
What the job involves
- The Market Data team is responsible for the ingestion, filtering, enrichment, and distribution of externally sourced data. This data is coming from thousands of sources related to maritime trade, and is critical to the business processing entities in Kpler, so they can provide a live and accurate picture of the global trade to our customers
- Work with Product Owners and Engineering Managers to upgrade our data pipelines to the next level of quality and reliability
- Design and implement the pipelines, and read models to publish our datasets
- Maintain and optimise our datasets and their schemas
- Guarantee data integrity and availability to our consumers
- Provide state of the art environments and tools to support the development team
- Review code and mentor the development team to higher quality standards
Our take
Even as more and more industries digitise, processes in legacy industries such as trade remain relatively archaic – with commodity markets running on incomplete, dispersed and sometimes inaccurate information. Kpler, founded in 2014, brings data technology to trade, in order to make the space more efficient and sustainable.
Kpler is the leader in its field, claiming ten times the revenue and commercial footprint of its nearest competitor. The company supplies real-time, transparent data on commodity markets, as well as actionable insights for those acting in the industry. Partnerships with leading data providers and analytics firms have bolstered Kpler’s offerings to cover a range of markets across the trading space, cementing its leadership as a provider of commodity market data.
Kpler has received massive funding for its continued expansion, received atop already impressive growth and between 2022 and 2023, acquired five companies. The investment is being used to make more smart acquisitions, of note within the growing maritime analytics and logistics market, hire talent, and accelerate development to ensure it remains at the forefront of its field.
Steph
Company Specialist at Welcome to the Jungle
Insights
Company
Funding (1 round)
Apr 2022
$220m
GROWTH EQUITY VC
Total funding: $220m
Company benefits
- Flexible office policy: Work in office spaces at central locations, sponsored co-working hubs or in a full-remote set-up.
- Home office set-up & monthly allowance: We provide top of the range office equipment along with a set-up budget for whatever you need. Along with a monthly allowance for electricity and Wi-Fi.
- Health insurance coverage: We offer health insurance coverage for employees to ensure you are always safe and healthy.
- Time-off when you need it: Global maternity, parental, medical, festivals, and compassionate leave policies aligned to the contemporary needs of the family, and individual choices.
- Special discounts and offers: Get exclusive access to country-specific employee discount programs (hotel, restaurants, tech products, etc.).
- Regular outings and social events: We hold regular events (online and on-site) for staff to socialise and interact with each other in the team.
Company values
- Be Humble: Always place the interest of the collective before your own.
- Respect & Care for People: Make every person feel comfortable in their own beliefs, decisions, and perspectives.
- Take Responsibility: Always take ownership of your actions.
- Act with Integrity: Be honest and transparent in all your dealings.
- Be Bold: Push the boundaries in order to improve and grow.
Company HQ
Etterbeek, Brussels
Articles
Leadership
François Cazor
(CEO)Non Executive Director at Spark Commodities. Co-founder and former CEO of eCO2Market. Previously an Associate Director at HSBC, with experience in Trading.
Jean Maynier
(CTO)Non Executive Director at Spark Commodities. Co-founder and former CEO of eCO2Market. Previously a System Adviser at CDPQ, with experience as a Business Analyst.
Share this job
View 4 more jobs at Kpler