Data Engineer, Verisian

• We welcome candidates of diverse experience levels, and meeting every requirement is not mandatory. Research indicates that underrepresented groups tend to apply only if they meet all qualifications. If you're enthusiastic about the role, please apply and let our recruiters evaluate your application
• Extensive experience in Python and ideally at least one other programming language
• Extensive experience with SQL and data engineering principles
• Extensive experience with and love for data
• Experience with and love for complex root cause analyses to find and resolve bugs
• Experience identifying and resolving performance and scalability issues
• Strong focus on building as a team: we have a We & Mission mindset
• Strong ability to communicate complex technical problems and solutions, foresee risks, and align work across multiple teams and colleagues
• “If it’s not code and documented, it doesn’t exist”-mindset
• Iteration mindset

Desirable

• As a Data Engineer, you will join our world-class engineering team in building the Verisian Platform. You will work on an application that exposes our clinical trial insights to data managers, statistical programmers, statisticians, medical experts/writers, and regulatory authorities
• The Verisian Platform brings value to a set of highly regulated processes crucial for medical progress and innovation
• Your work will support the Planner, Builder, Explorer, Validator, Submitter, and related supporting modules
• These core modules of the platform target the planning, exploration/onboarding, building, validation, submission, and review of clinical trials and their results
• They enable data managers, statistical programmers, statisticians, medical writers, and regulators to deliver their work faster, at higher quality, lower cost, and in greater confidence
• Our pipelines analyze clinical trial documentation, code, logs, data, and results to build a knowledge graph through code traceability
• We harness the resulting dataset, column-level and logic lineage to turn clinical trials into Information Infrastructure that can be used by experts and consumed by AI to revolutionize how therapies are evaluated and enter the market
• We capture complex processes in fully- and semi-automated workflows that place experts in control and AI automation at their fingertips
• We build visualizations to provide our customers with a maximum of insight as fast as possible
• Our application stack is based on Next
• Js and deployed via Docker/Kubernetes in the cloud
• The data analysis pipelines run in Argo Workflows
• We analyze code based on Antlr4 and Java
• AI agents are developed in Python
• The data analysis engine is developed in Python
• Git is where our code lives, and Github Actions is how it gets out into the world
• In tandem, you will create data validation rules (custom DSL) and develop our data analysis engine (Python) that is used to automatically detect inconsistencies and analysis errors in data while enforcing regulatory data standard adherence
• These crucial pipelines are an integral part of our platform to expose our game-changing functionality to users and consumed by our AI agents to automate the planning, analysis, validation, and submission of clinical trials
• You will be expected to lead the analysis, design, building and testing of components of the engine and data validation rules
• As part of our core team, you will join us in designing, prioritising, building and testing new functionality, troubleshooting customer issues, finding root causes, and deploying required fixes to ensure maximal user impact and performance