Principal Data Engineer, Spotter
$200-400k
+ Stock options
3-4 days a week in office (Culver City, CA)
Finance solution for content creators
Job no longer available
Finance solution for content creators
201-500 employees
Job no longer available
$200-400k
+ Stock options
3-4 days a week in office (Culver City, CA)
201-500 employees
Company mission
To catapult creative potential with lucrative deals that make you unstoppable.
Role
Who you are
- Bachelor’s degree, preferably in Computer Science or Computer Information Systems
- 10+ years of Data Engineering experience. Ideally also have 2-4 years software engineering
- 5+ years experience with Apache Spark or Apache Flink
- 4+ years of experience running software and services in the cloud
- Proficiency in working with DataFrame APIs (Pandas and Spark) for parallel and single node processing
- Proficiency using advanced languages and techniques with Python, Scala, etc. with modern data optimized file formats such as Parquet and Avro
- Proficiency with SQL on RDBMS and data warehouse solutions like Redshift
- Hands on experience with Data Lake technologies like Delta Lake and Iceberg
- Experience with data acquisition from external APIs at large scale / in parallel processing
- Experience supporting ML/AI projects: deployed pipelines for computing features, using models for inference on large datasets
Desirable
- Experience with YouTube APIs
- Experience with AWS Glue metastore
- Experience with Data-Mesh approaches
- Experience with data cataloging, data lineage and data governance tools and approaches
- Experience with vector databases
What the job involves
- We're in search of an exceptional Principal Data Engineer who will play a pivotal role in designing, building, and optimizing scalable data infrastructure
- Develop and maintain scalable data pipelines, including:
- ETL pipelines, both single and multi-node solutions
- Build data quality assurance steps for new and existing pipelines
- Create derived datasets with augmented properties
- Work on analytics ready datasets to power internal and creator facing tools
- Troubleshoot issues when they arise, working directly with internal data consumers
- Automate pipeline runs with scheduling and orchestration tools
- Work with large scale datasets
- Work with/use various external APIs to enhance data
- Setup database tables for analytics users to consume the data collected by the Data Engineering team
- Work with big data technologies to improve data availability and data quality in the cloud (AWS)
- Lead development of projects involving other team members and act as a mentor
- Actively participate in team discussions about technology/architecture/solutions for new projects and to improve existing code and pipeline
Our take
Spotter offers digital-creatives the opportunity to transform content creation as a hobby to a full-time job by providing them with the capital to do so. The company provides cash upfront to creators in exchange for ownership of any future ad revenue their videos generate.
Not dissimilar to venture capital investments, Spotter has applied this model to the digital content world, an increasingly lucrative industry. It is well placed to continue rapid ascension given its impressive clientele, some of YouTube’s most popular creators - such as Mr.Beast and Dude Perfect - whose cumulative content has amassed a combined 50 billion minutes in watch time.
2022 investment from Japan’s SoftBank and further venture capital positions Spotter to invest $1 billion with YouTube creators through 2023, cementing it as the leading partner of content creation.
Steph
Company Specialist at Welcome to the Jungle
Insights
33% employee growth in 12 months
Company
Funding (last 2 of 5 rounds)
Sep 2024
$7.4m
LATE VC
Sep 2022
$9.4m
LATE VC
Total funding: $247.4m
Company benefits
- Medical insurance covered up to 100%
- Dental & vision insurance
- 401(k) matching
- Stock options
- Autonomy and upward mobility
Company HQ
Playa Vista, Los Angeles, CA
Leadership
Aaron DeBevoise
(CEO)Previously co-founded Cflix, North Entertainment, Machinima, StyleHaul, and served as CEO for Network of One. Spent nearly 5 years at J.P Morgan, initially as an Analyst before becoming an Associate within the Entertainment Industries Group.
Nic Paul
(COO)Previously founded N.B Paul and Revee, serving here as CEO until it was acquired by Outbrain, and acting as Head of Sales and Innovation. Spent 4 years at Penske Media Corporation as Senior Vice President.
David Carroll
(Chief of R&D)Previously founded SantaCruzGuide.com. Experience as a Software Engineer for ICTV, Interwoven, and eBay, and later held positions at Sony, Sizzle Digital Media and DIRECTV, before serving as CTO for Network of One.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 3 more jobs at Spotter