Lead Spark Data Engineer, Wizard

$210-235k

MongoDB

AWS

GCP

Python

Java

Kafka

Elasticsearch

Redis

Cassandra

Hadoop

Azure

Spark

RabbitMQ

Flow

Data Flow

Kinesis

Parquet

Git

DynamoDB

Senior and Expert level

Remote from US

Conversational AI for eCommerce customer engagement

Job no longer available

Conversational AI for eCommerce customer engagement

21-100 employees

B2BArtificial IntelligenceMarketingeCommerceSales

Job no longer available

$210-235k

MongoDB

AWS

GCP

Python

Java

Kafka

Elasticsearch

Redis

Cassandra

Hadoop

Azure

Spark

RabbitMQ

Flow

Data Flow

Kinesis

Parquet

Git

DynamoDB

Senior and Expert level

Remote from US

21-100 employees

B2BArtificial IntelligenceMarketingeCommerceSales

Company mission

To build a world where finding what you need is simple, fast, and fund - and where scouring the internet is a thing of the past.

Job

Company

Role

Who you are

A Bachelor's degree in Computer Science or a related field, with a solid foundational knowledge of data engineering principles
7-10 years of software development experience, significantly focusing on data engineering
Extensive experience in building ETL pipelines using tools such as Apache Spark, Databricks, or Hadoop
Proficiency in Python or Java, with a deep understanding of software engineering best practices
Expertise in distributed computing and data modeling, capable of designing scalable data systems
Proficiency with NoSQL databases, including MongoDB, Cassandra, DynamoDB, and CosmosDB
Proficiency in real-time stream processing systems such as Kafka, AWS Kinesis, or GCP Data Flow
Skilled in utilizing caching and search technologies like Redis, Elasticsearch, or Solr
Familiarity with message queuing systems, including RabbitMQ, AWS SQS, or GCP Cloud Tasks
Experience with Delta Lake, Parquet files, and AWS, GCP, or Azure cloud services
A strong advocate for Test Driven Development (TDD) and experienced in version control using Git platforms like GitHub or Bitbucket

Desirable

Exceptional written and verbal communication skills, capable of articulating complex technical concepts clearly and concisely
A collaborative team player, eager to share knowledge and learn from peers, passionate about mentoring junior team members, and leading by example

What the job involves

We seek a Lead Data Engineer to take charge of our data engineering initiatives, focusing on enhancing data collection, storage, and analysis across all of Wizard's dynamic services
This lead position is pivotal to our data infrastructure, enabling data-driven decision-making and supporting our ambitious growth objectives
Architect and scale a state-of-the-art data infrastructure capable of handling batch and real-time data processing needs with unparalleled performance
Collaborate closely with the data science team to oversee data systems, ensuring accurate monitoring and insightful analysis of business processes
Design and implement robust ETL (Extract, Transform, Load) data pipelines, optimizing data flow and accessibility
Develop comprehensive backend data solutions to bolster microservices architecture, ensuring seamless data integration and management
Engineer and manage integrations with third-party e-commerce platforms, expanding Wizard's data ecosystem and capabilities

Our take

Direct-to-customer marketing is invaluable for eCommerce brands trying to scale, helping to boost brand engagement and encourage repeat sales. However, providing personalized engagement on a large scale is almost impossible through traditional means, showing a demand for automated marketing solutions for large-scale customer interaction.

Wizard provides a conversational AI for eCommerce customer engagement capable of sending automated follow-up messages to customers after they have purchased an item. The tool is heavily focused on boosting product reorders through these follow-up texts, storing every customer's shipping address and payment details to facilitate sales with one-word answers from customers.

Whilst AI-driven chatbots are commonly used to answer simple questions on eCommerce websites, Wizard has taken this a step further by providing a simple way for businesses to receive new orders as a direct response to follow-up marketing texts. By allowing customers to bypass the web entirely for such reorders, the company claims it can boost conversion and repeat purchase rates, whilst simultaneously building brand engagement.

Steph

Company Specialist at Welcome to the Jungle

Company

Funding (1 round)

Oct 2021

$50m

SERIES A

Total funding: $50m

Company benefits

Equity
Remote work culture
Health, dental and vision insurance
Mental healthcare support and services
401(K) plan
16 weeks parental leave
12 paid holidays
Flexible PTO
Life and AD&D insurance

Company HQ

Hudson Square, New York, NY

Leadership

Melissa Bridgeford

(Co-Founder & CEO)

Experience as Director of Guggenheim Partners from 2009 to 2014. CEO and Founder of Stylust from 2017 to 2021.

Share this job

View 3 more jobs at Wizard