Senior Platform Engineer, DataHub

• 4+ years building production-grade distributed systems
• Advanced Python expertise with a focus on API design
• Experience with high-scale data processing or integration frameworks
• Strong systems knowledge and distributed architecture experience
• A track record of solving complex technical challenges

Desirable

• This is where infrastructure meets impact. The metadata layer you'll build will directly power the next generation of AI systems at massive scale
• Your code will determine how safely and effectively thousands of organizations deploy AI, affecting millions of users worldwide
• We're looking for an exceptional Python engineer to lead development of DataHub's ingestion framework – the core that connects diverse data systems and powers our metadata collection capabilities
• Scalable, fault-tolerant ingestion systems for enterprise-scale metadata
• Clean, intuitive APIs for our connector ecosystem
• Event-driven architectures for real-time metadata processing
• Schema mapping between diverse systems and DataHub's unified model
• Versioning systems for AI assets (training data, model weights, embeddings)