Senior or Lead Data Engineer, Crux Informatics
£105-141k
More information about location
External data automation platform
Be an early applicant
External data automation platform
101-200 employees
Be an early applicant
£105-141k
More information about location
101-200 employees
Company mission
To accelerate data integrations from external sources by removing the data engineering, operations, and wrangling obstacles.
Role
Who you are
- This role requires an individual with an obsession for data quality, who is comfortable writing Python scripts and libraries, experienced in dealing with financial datasets, and proficient in SQL and database management
- Bachelor's or Master's degree in Computer Science, Data Science, or a related field
- 3-5 years of proven experience as a Data Engineer or similar role, preferably in the financial sector (or an equivalent combination of education and experience)
- 2+ years of client-facing skills with a background in managed services
- 3+ years of experience with Python for writing scripts and libraries
- Experience working with financial datasets
- Strong knowledge of data architecture, data modeling, and data management principles
- Strong SQL and database management skills
- Proficiency with Git or similar version control systems
- Proficiency in database technologies, ETL processes, and data ingestion methods (FTP, APIs, and web scraping)
- Experience with at least one cloud platform (e.g., AWS, Azure, Google Cloud)
- Knowledge and hands-on expertise in the following technologies:
- Data lake architectures
- Distributed computing
- Data modeling for relational and non-relational data stores
- Prior hands-on experience using a workflow orchestration system like Apache Airflow, Kestra, Prefect, or Mage at scale
- Experience with cloud data warehouses like Snowflake, Redshift, Azure Synapse, and Google BigQuery
- Hands-on coding proficiency in modern Python, Java, JSON, and YAML
- Expertise in managing and delivering on client expectations
- Sense of ownership and responsibility, with the ability to work independently with minimal supervision
- Demonstrable obsession with data quality and attention to detail
- Excellent communication and interpersonal skills
What the job involves
- Serve as a key point of contact for our clients, managing their expectations effectively and delivering top-notch service
- Develop and maintain ETL pipelines, ensuring data integrity, quality, and timeliness
- Write, debug, and optimize Python scripts and libraries to automate data processes
- Handle complex financial datasets, extracting meaningful insights that drive business value
- Utilize your strong SQL and database skills to design and implement robust data structures according to client demands
- Employ data ingestion patterns, including FTP, APIs, and web scraping, to fetch and process data from various sources
- Collaborate with the broader team to meet project goals, maintaining a high level of communication, documentation, and cooperation
- Leverage your knowledge of Google Cloud Platform (or similar cloud technologies) to implement scalable solutions
- Stay current with industry trends and emerging technologies in data engineering
- Strictly adhere to best practices and promote strong SDLC and DevOps culture using a modern cloud data engineering technology stack
Salary benchmarks
Our take
Data delivery operations can be ineffective and complex, making effective management and integration of external data difficult to achieve. Crux Informatics' cloud-based data integration and operations platform solves this problem, by automating external data integration, transformation, and observability.
Crux's tools accelerate the value realization between external and internal data, which has understandably proven popular among businesses of all kinds. By using the platform, businesses can get quality data when and where they need it, reduce management times for external data, and hence free up their teams to focus on higher-value tasks.
Although Crux Informatics faces strong competition in the data integration market, it has displayed steady growth and cemented itself in the space by a series of partnerships with the likes of Amazon Web Services. The significant funding raised by the company will help it to scale up operations, towards meeting a new wave of demand for its platform in the increasingly data-first business world.
Steph
Company Specialist at Welcome to the Jungle
Insights
Company
Funding (last 2 of 5 rounds)
Jan 2023
$50m
SERIES B
Dec 2020
$55m
LATE VC
Total funding: $146m
Company benefits
- Flexible time off including vacation, sick leave, and volunteer time off
- Robust & inclusive parental leave policy for birthing, non-birthing, adoptive & foster parents
- Fully remote work from anywhere in the world
- Stock options
- Pre and post-tax retirement benefits
- Comprehensive insurance options, including no-cost options for medical, dental & vision coverage
- Employee referral bonus program - $4,000 bonus for every successful referral
- Scheduled team building events & monthly virtual activities
- Monthly phone & internet reimbursement
- One-time $250 budget for office supplies
- Bi-annual giving opportunities
- Fundraising & volunteer opportunities made available throughout the year
- Welcome swag for new hires
Company values
- Integration at scale: The Crux Deliver platform is unmatched in scale, agility, and capabilities when it comes to pipeline building, customization, and maintenance
- Take ownership: We own outcomes, innovate, and deliver results
- Focused innovation & execution: We know when and how to say no
- One team: We are resilient and here to win
Company HQ
Financial District, San Francisco, CA
Articles
Leadership
Will Freiberg
(CEO)Was an M&A Associate at Simpson Thacher & Bartlett, Senior Associate at Gunderson Dettmer, and President and COO of Mesosphere.
Share this job
View 2 more jobs at Crux Informatics