Principal Data Engineer, Octus
The essential credit platform
Posted today
The essential credit platform
501-1000 employees
Posted today
501-1000 employees
Company mission
To make subscribers the smartest people in the room on all things credit.
Role
Who you are
- Strong foundation in software engineering principles, including SOLID design, modularity, and scalability
- Expert proficiency in Python for data pipeline and automation development
- Advanced SQL skills and experience optimizing complex queries and data models
- Proven experience designing and maintaining cloud-native data pipelines on AWS (e.g., MWAA/Airflow, Lambda, ECS, SQS, Glue, S3, Redshift, etc.)
- Experience with data warehousing or lakehouse technologies (Redshift, Snowflake, Databricks, etc.)
- Experience implementing and managing Terraform or similar IaC frameworks
- Strong understanding of data ingestion, transformation, and orchestration tools and patterns, including those used in AI/ML pipelines
- Familiarity with CI/CD pipelines, automated testing, and modern DevOps practices
- 8+ years of experience in data engineering or backend development, with a focus on scalable data solutions
- Extensive experience in a technical leadership capacity, including mentoring and leading complex data infrastructure projects end-to-end
- Familiarity with containerization (Docker) and workflow orchestration best practices
- Excellent communication, collaboration, and problem-solving skills
Desirable
- Exposure to streaming data technologies (Kafka, Kinesis, Flink)
- Experience integrating data quality and observability tools (Great Expectations, Monte Carlo, etc.)
- Familiarity with Scrapy, BeautifulSoup, or other data extraction frameworks for ingestion pipelines
What the job involves
- Octus is seeking a Principal Data Engineer to design, develop, and lead scalable data ingestion and transformation pipelines.
- This is a hands-on Individual Contributor (IC) role that encompasses some management duties, including mentoring, architecture guidance, and providing technical leadership.
- You’ll play a key role in designing and maintaining robust data infrastructure that powers data platforms, products and automation initiatives across the firm.
- Lead the overarching technical strategy for the data platform, ensuring alignment between data infrastructure and long-term business goals
- Lead the design and development of data ingestion and transformation pipelines, ensuring scalability, efficiency, and reliability across diverse data sources (APIs, web data, internal feeds, etc.)
- Serve as a foundational technical leader and mentor for senior engineers within the data platform team, guiding architecture, design, and implementation decisions
- Architect and manage data pipelines and orchestration workflows using AWS services such as MWAA (Airflow), Lambda, ECS, and SQS
- Implement and maintain infrastructure as code (IaC) using Terraform, ensuring reproducibility and compliance with cloud standards
- Partner with data analysts, scientists, and backend engineers to ensure data consistency, discoverability, and reliability
- Apply best practices in data modeling, schema design, and ETL/ELT processes for high-volume structured and semi-structured data
- Ensure data quality and lineage through automated testing, monitoring, and alerting
- Promote continuous improvement through code reviews, observability practices, and team-wide knowledge sharing
- Collaborate closely with technology leadership to align data platform development with business strategy and product goals
- Stay up to date with industry trends in data engineering, cloud architecture, AI/ML integration, and automation
Our take
Octus, formerly Reorg, is a global provider of credit intelligence, data and analysis of issues affecting the distressed debt, event-driven and leveraged finance markets. The company sets itself apart by taking an approach that combines reporting with financial and legal analysis, providing a holistic view and delivering that view in real-time.
Octus has fundamentally changed the way in which financial and legal professionals access complex business information. Its service reaches over 40,000 people across a variety of institutions and its subscription-based service is giving organisations the ability to replace the work of junior attorneys.
Octus garnered considerable interest from several private equity and strategic rivals due to its expensive subscription-based services that have proven to result in stable growth for clients. Octus's services are particularly valuable and its 2022 buyout by British global investment firm Permira has opened the doors to vast opportunities for Octus's further growth.
Steph
Company Specialist at Welcome to the Jungle
Company
Company benefits
- Medical, dental, vision and 401(k) benefits
- A flexible, hybrid working policy with home office reimbursements
- Reimbursements for career development and continuing education
- Generous paid time off – including vacations, sick leave and parental leave
- Employee referral bonuses
- Gym subsidies and other fun fitness benefits
- Kudos program to recognize and reward colleagues
- Manager training programs
Company HQ
Midtown South, New York, NY
Leadership
Kent Collier
(Founder & CEO)Experienced Analyst having previously worked at Catalyst Investment Management and Millennium Partners, also worked as the Vice President at Assurant Asset Management.
Share this job
View 16 more jobs at Octus