Data Engineer, Human API

• At least 5+ years working as an individual technical contributor, in a software engineering role
• 3+ years working with distributed data systems and data engineering
• Streaming processing semantics (and debugging streaming applications)
• Design and maintenance of pipelines built atop distributed data technologies (Databricks/Spark, Snowflake, BigQuery/Redshift, Kafka/Kinesis, etc.)
• All aspects of managing distributed systems (design, scalability, security, deployment, observability, resiliency)
• CI/CD principles (even better applying devops practices to data)
• Workflow orchestration (Airflow, Prefect, AWS Step Functions, etc.)
• SQL and Python, and willingness to learn other languages
• Data modeling and query optimization
• Keen eye for opportunities to better leverage time (both your own and others)
• Desire to take complex problems and making them simple for others
• A desire to help others grow
• A commitment to continuous self improvement
• An ability to operate both individually and collaboratively

Desirable

• You'll build out our data platform capabilities across a wide selection of themes (pipelines, graphs, ml models, annotations, automation, data observability, data lifecycle management, data governance, semantic layers) using a set of core services (currently AWS, Databricks, and Looker)
• Manage and scale data pipelines across the terabytes of arbitrarily complex data in our data lake, both structured and unstructured
• Performance tuning and scaling internal and external real-time data services