Senior Data Engineer, Vantage

• A BA/BS degree and a strong technical background with 8+ years of professional working experience
• 2+ years of experience building and operating data platforms that transform and ingest large quantities of structured and unstructured data
• Experience working in a fast-paced, dynamic environment seamlessly balancing tactical and strategic considerations
• Experience working with MPP databases such as Clickhouse, Snowflake, Hive, etc
• Experience with big data technologies like Trino, Spark, Hadoop, Airflow, Kafka
• Experience with reliability engineering specifically in areas such as data quality, data observability and incident management
• A kind person

Desirable

• Vantage is looking for a data engineer to be the foundation to our data platform efforts
• This person will be responsible for owning and developing our large scale ingestion pipeline and the query layer, the system which warehouses all of the cost data powering the core of the Vantage product
• You will be working with our Engineers to develop and scale the data ingestion, transformation and query layers to keep up with the growth of our customer base and expansion of our use cases
• Today we primarily use Clickhouse, Postgres, Temporal, Redis, and S3
• What You’ll Do:
• Design, build, and operate the data processing platform that processes billions of records per month
• Design, build, and operate the query and data infrastructure critical to the core of the Vantage product
• Work directly with our founders and collaborate on feature discovery, ideation and delivery
• Work closely with Product and our Engineers to understand data processing needs and propose the right solutions for them
• Measure performance of our data processing platform and ensure it stays ahead of our rapidly growing business