Senior Platform and DataLake Engineer, TetraScience

• 8+ years of experience in the software development industry, preferably in data engineering, data warehousing r data analytics companies and teams
• 3+ year of experience with the DataBricks ecosystem
• Expert level of Python, Java, and Typescript
• Expert level of understanding and hands-on experience with Lake House architecture
• Expert level of experience with Spark/Glue and Delta tables/iseberg
• Experienced in designing and implementing complex, scalable data pipelines/ETL services
• Extensive in cloud-based data storage and processing technologies, particularly AWS services such as S3, Step Functions, Lambda, and Airflow
• Ability to articulate ideas clearly, present findings persuasively, and build rapport with clients and team members

Desirable

• As a Senior Platform and Data Lake Engineer at TetraScience, you will play a critical role in building and maintaining our data infrastructure
• You will work closely with cross-functional teams to ensure the seamless ingestion, processing, and storage of significant volumes of scientific data
• The role requires extensive experience building and supporting data pipeline infrastructure and hands-on experience in the Databricks ecosystem
• Design, develop, and optimize data lake solutions to support our scientific data pipelines and analytics capabilities
• Design, develop, and optimize data pipelines and workflows within the Databricks platform
• Design and architect services to meet customer data processing needs
• Implement data quality and governance frameworks to ensure data integrity and compliance