Data Engineer, AllCloud

• Are you passionate about data and delivering solutions for clients that turn data into valuable, actionable information for their business?
• We are hiring Data Engineers with strong experience across the entire Cloud Data stack. The ideal candidate will have extensive experience in data pipelines (ELT/ETL), data replication, data warehousing and dimensional modeling, and curation of data sets for Data Scientists and Business Intelligence users
• This candidate will also have excellent problem-solving ability dealing with large volumes of data
• Bachelor’s degree, or equivalent experience, in Computer Science, Engineering, Mathematics or a related field. Commensurate work experience will be considered in lieu of degree
• 2+ years’ experience building scalable Cloud data solutions using MPP Data Warehouses (Snowflake, Redshift, or Azure Data Warehouse/Synapse), data storage (S3, Azure Blob Storage, Delta Lakes, or AWS Lake Formation) and analytics platforms (i.e. Spark, Databricks, etc.)
• 3+ years with complex SQL queries and scripting
• 3+ years’ experience building data pipelines via Python, Spark, or GUI Based tools
• 3+ years’ experience loading historical data to data warehouses
• 3+ years’ experience with AWS and/or Azure Cloud
• 3+ years developing, and deploying scalable enterprise data solutions (Enterprise Data Warehouses, Data Marts, ETL/ELT workloads, etc.)
• 3+ years of supporting business intelligence and analytic projects
• 2+ years’ DevOps experience
• 2+ years’ experience working in an environment with automated promotions to production
• Familiar with ETL/ELT patterns and methodologies
• Good understanding of code repositories such as GIT
• Excellent written and oral communication skills

Desirable

• Building scalable Cloud data solutions using MPP Data Warehouses (Snowflake, Redshift, or Azure Data Warehouse/Synapse), data storage (S3, Azure Blob Storage, Delta Lakes, or AWS Lake Formation) and analytics platforms (i.e. Spark, Databricks, etc.)
• Creation of data pipelines and transformations
• Knowledge of ETL tools such as– Matillion, FiveTran, Informatica, Talend, SSIS, etc
• Transformations – dbt
• Experience with elastic/open search
• Load historical data to a data warehouse
• Scripting in Python, Java Script or Shell
• Workflow Orchestrations using Apache Airflow, AWS Step Functions, etc
• Familiarity with automated promotions, SCM tools, and CICD best practices
• Modeling and curation of data for visualization and predictive modeling users
• Design and implementation of AWS and/or Azure services such as Lambda, SNS, etc
• Creating data integrations with scripting languages such as Python
• Writing complex SQL queries, stored procedures, etc