Data Engineer, AllTrails

• Expertise in Python for data cleansing, transformation, modeling, etc
• Professional experience in transforming machine-learning prototypes into solutions that scale with real-world constraints and deploying them into production
• Proficiency with SQL and experience working with high volume datasets in SQL-based warehouses such as BigQuery, Redshift, Snowflake, or others
• Experience with parallelized data processing frameworks such as Apache Beam, Apache Spark, Google Dataflow, AWS Glue, etc
• Deep understanding of data modeling, access, storage, caching, replication, and optimization techniques
• Ability to orchestrate data pipelines through tools such as Apache Airflow
• Experienced in container orchestration (e.g. Docker)
• Understanding of the software development lifecycle and CI/CD
• Monitoring and metrics-gathering (e.g. Datadog, NewRelic, Cloudwatch, etc)
• Proficiency with git and working on a shared codebase
• Excellent documentation skills
• Self motivation and a deep sense of pride in your work
• Passion for the outdoors
• Comfort with ambiguity, and an instinct for moving quickly
• Humility, empathy and open-mindedness - no egos

Desirable

• Deploy and build systems that enable machine learning and artificial intelligence product solutions
• Work cross-functionally to ensure data scientists have access to clean, reliable, and secure data, the backbone for new algorithmic product features
• Build, deploy, and orchestrate large-scale batch and stream data pipelines to transform and move data to/from our data warehouse and third-party systems
• Deliver scalable, testable, maintainable, and high-quality code
• Investigate, test-for, monitor, and alert on inconsistencies in our data, data systems, or processing costs
• Create tools to improve data and model discoverability and documentation
• Ensure data collection and storage adheres to GDPR and other privacy and legal compliance requirements
• Uphold best data-quality standards and practices, promoting such knowledge throughout the organization