Principal Data Engineer, Lantern

• You use LOGIC in your decision making and understand that progress is critical to making change. You focus on the execution of your content while balancing a fast-paced environment and you take the time to celebrate both the small & big wins
• INCLUSION is a core tenant of your personal beliefs. A diverse and inclusive environment is incredibly important to you. You understand and desire to be a part of a diverse team with different experiences and perspectives & you cherish the differences in each individual that you interact with
• You have the GRIT, drive and ambition to tackle big problems. Big problems require big ideas and a team that supports new ideas
• You care deeply for your customers are driven to keep HUMANITY in all decisions. Your customers aren’t just the individuals using your product. They are the driving factor in your motivation to make a change
• Integrity guides you in life. Focusing on the TRUTH vs. giving people the answers they want to hear
• You thrive in a Team Environment. Collaboration is key in innovation and creating change
• Bachelor’s or master’s degree in computer science, Engineering, or a related field
• 12+ years of experience in Data Engineering, with at least 5+ years as Principal Engineer
• 5+ years of experience with programming languages (Python, Scala etc.), with a deep understanding of Spark and Databricks, and ability to optimize and performance tune the pipelines
• 3+ years of working with EDI or HIE standards (e.g. X12, HL7, and/or FHIR)
• Proven leadership experience managing and developing data engineering teams, including team growth, skill development, and strategic project execution
• Prior experience with designing and managing large scale data infrastructure
• Expertise with cloud platforms, databases, and modern data stack with proficiency in Distributed Data Systems (e.g. Kafka, NoSQL)
• Experience in building data lakes to support high speed querying by the end users
• Knowledge of AI/ML technologies to support various business use cases
• Knowledge of OOA/D and N-tier web or mobile applications best practices
• Strong communication skills, with the ability to convey complex technical concepts to non-technical stakeholders
• Experience or knowledge with creating RESTful API’s and data visualizations

Desirable

• Lantern is looking for a Principal Data Engineer who will help shape the future of our Data Platform
• In this hands-on role, you'll develop and implement the strategic vision for our platform while championing advanced Data Engineering, ML, and AI capabilities across the organization
• You'll mentor team members while applying your deep expertise in Data Architecture and software engineering best practices to strengthen our platform's foundation
• Success in this position requires balancing technical excellence with business value creation through effective stakeholder collaboration
• Architect and build platform foundations including Observability, lineage, Quality Control Frameworks while ensuring scalability, performance and security
• Modularize platform frameworks to support diverse data needs, variety of data formats (EDI, API, JSON, etc.), and deliver batch and real-time insights
• Collaborate with Data Engineers, Architects, and Business Analysts in building pipelines, data models to improve reliability and interpretability of data for analytical and business needs
• Build technical design documents, evaluate emerging technologies, and lead proof-of-concept initiatives to validate solutions
• Champion software engineering best practices including code standards, effective review processes, CI/CD, and Data Infrastructure
• Evolve platform capabilities to integrate ML and AI Models to accelerate business use cases
• Adopt an iterative product development mindset to solve for challenges on the platform
• Partner with business stakeholders, and technology leadership to define Data Strategy, Roadmap and hiring for future needs
• Foster a positive team environment that embraces continuous learning and technical innovation
• Mentor team members and build a high-performance engineering culture through collaboration, and knowledge sharing