Senior Data Engineer, Metapack
More information about location
Provides delivery management software
Job no longer available
Provides delivery management software
201-500 employees
Job no longer available
More information about location
201-500 employees
Company mission
To build the world's most trusted eCommerce delivery platform that seamlessly connects Retailers, Carriers, and Consumers to accelerate Retailers' eCommerce sales, make Carriers' networks more efficient, and give Consumers peace of mind.
Role
Who you are
- A Software Engineering background
- Experience developing and supporting robust, automated and reliable data pipelines in Python and SQL
- Experience with data processing frameworks like Pandas, Polars, dbt or Spark
- Experience with streaming data processing
- AWS, Azure or Google Cloud experience
- Continuous integration/delivery environment experience with a passion for automation
- Knowledge of a data orchestration solution like Airflow, Oozie, Luigi or Prefect
- Knowledge of both relational and non-relational database design and internals
- Knowledge of how to design distributed systems and the trade-offs involved
- Experience working with software engineering best practices for development, including source control systems, automated deployment pipelines like Jenkins and devops tools like Terraform
Desirable
- Production experience working with very large datasets
- Knowledge and direct experience of using business intelligence and analytics tools (Tableau, Looker, Power BI, etc.)
- Practical understanding of PII related issues and other considerations regarding data security
- Experience with big data cloud technologies like EMR, Athena (Trino), Glue, Big Query, Dataproc, Dataflow
- MLOps know-how
- A desire to constantly challenge the norm
- Fast-learner with a keen interest in evaluating and adopting new technologies: Apache Iceberg, Dagster, dbt, GreatExpectations, Prefect, Snowflake, etc
- Willing to attend conferences, webinars and meet-ups and share the learning
What the job involves
- The Auctane Engineering Tech and Data team does one thing first - provide our customers with world class production software.
- This team ensures that our customers experience a fast and reliable system and provides our engineering teams with the tools to deploy, monitor, and maintain our production systems
- Contribute to the design, build and operational management of our data lake and analytics solution on top of proven AWS data technologies like S3, Athena, Lambda, Kinesis and ECS
- Use state of the art technologies like Airflow, dbt and Spark to process data and get our dataset just right
- Develop frameworks and solutions that enable us to acquire, process, monitor and extract value from our massive dataset
- Support the Data Analysts and Data Scientists with automation, tooling, data pipelines and data engineering expertise, enabling them to deliver complex analytics products and machine learning solutions
- Deliver highly reliable software and data pipelines using Software Engineering best practices like automation, version control, continuous integration/continuous delivery, testing, security, etc
- Define, implement and enforce automated data security and data governance best practices within the solutions designed
- Mentor more junior colleagues and receive mentorship by more senior colleagues
Application process
- We'll ask you about your salary expectations in the first interview to ensure we're on the same page
Salary benchmarks
Our take
eCommerce continues to eat into the high street, with more shopping done online than ever, and the trend shows no sign of slowing down. Given such continuous growth, Metapack aims to meet growing consumer expectations for fast and efficient deliveries.
The company helps online businesses meet customer needs by offering a wide range of personalised services that is facilitated by their wide network of carriers. This is essential for Metapack to maintain a defensible business model. Success has been clear for the company; leading brands like Adidas, Argos and Asos use their technology.
Recent integration with Gophr, a courier service that prioritises same-day service, will expand Metapack's customer base at a time when consumers are interested in faster shipping choices and when retailers look to leverage different shipping options to meet customer demand. This helps place the company in a steady place amongst competitors.
Kirsty
Company Specialist at Welcome to the Jungle
Insights
Company
Company benefits
- Pension: Someday you're going to retire. We want you to retire well, and help you to build a suitable retirement fund
- Unlimited Snacks and Drinks: We love our coffee and snacks. We keep a wide selection fully topped up, grab some fresh fruit, or something less healthy if you need a sugar rush!
- Enhanced Leave: We like to reward company loyalty, we give you an extra 2 - 5 days leave once you have been with the company for 2 - 5 years
- Family Friendly Policies: This is the win-win contract. The company wins. You win. This is your opportunity to take part in our success
- Charitable Donation Matching: We pay it forward not because we expect anything in return, but simply because it's the right thing to do
- Training: Your potential and growth is limitless! We want to fund it. Dream big, and let us know what you want!
- Day of Volunteering: Take a day to feed your soul by volunteering in your community or for your favorite cause/charity
- Flexible Working: Yes, we have great offices, but we take a very blended approach to give flexibility between remote and office working
- Employee Referral Program: Rad people know other rad people. Share their names and make money!
- Company Events: We take play seriously. From cooking classes to ping-pong, or a drink in a local pub, there is something for everyone. We work to LIVE
Company HQ
Holborn, London, UK
Leadership
Patrick Wall
(CEO)Founded a number of businesses before landing on MetaPack. General Manager of Schweppes brand for 7 years. Previously an Engagement Manager at McKinsey.
Share this job