Principal Software Engineer, project44
Data Engineering
Real-time supply chain visibility platform
Job no longer available
Real-time supply chain visibility platform
501-1000 employees
Job no longer available
501-1000 employees
Company mission
To improve lives everywhere by creating a connected, predictable, and sustainable world.
Role
Who you are
- 8+ Years of experience in leading Data Engineering efforts
- 3+ Years of experience in Snowflake, Oracle and knowledge in No SQL database like MongoDB
- 3+ Years of experience in Python/Java
- 3+ Years of experience in ETL Developer role with deep knowledge of data processing tools like Airflow, Argo workflow
- 4+ yrs experience with data engineering and operations, including administering production-level, always-on, high throughput, complex OLTP RDBMS
- Experience in delivering software solutions in areas of distributed systems
- Experience with working with Neural network and Gen AI methodologies
- Strong experience in building data warehouse solutions and Data Modeling
- Strong ETL performance-tuning skills and the ability to analyze and optimize production volumes and batch schedules
- Experience with ETL, GCP, Unix/Linux, Helm Charts as well as Git or other version control systems
- Experience with PII redaction for traditional ETL pipelines, as well as in GenAI solutions
- Expertise in operational data stores and real time data integration
- Expert level skill in modeling, managing, scaling and performance tuning high-volume transactional database
- Bachelor's Degree in computer science or equivalent experience
- Strong programming/scripting knowledge in building and maintaining ETL using Java, SQL, Python, Bash, Go
- In-depth hands-on knowledge of public clouds - GCP(preferred)/AWS, PostgreSQL (version 9.6+), ElasticSearch, MongoDB, MySQL/MariaDB, Snowflake, BigQuery
- Participate in an on-call rotation to mitigate any data pipeline failures
- Strong experience with Kafka or equivalent event/streaming based systems
- Experience with Docker, Kubernetes
- Experience with RAG, Vector DB, embedbings,etc
- Develop and deploy CICD pipelines for Data Engineering
- Experience and knowledge of optimizing database performance and capacity utilization to provide high availability and redundancy
- Proficiency with high volume OLTP Databases and large data warehouse environments
- Ability to work in a fast-paced, rapidly changing environment
- Understanding of Agile and its implementation for Data Warehouse Development
- Focus on development/ improvement of framework to support repeatable and scalable solutions
- Demonstrates excellent communication and interpersonal skills; able to communicate clearly and concisely
- Takes initiative to recommend/ develop innovative approaches to getting things done
- Is a team player and encourages collaboration
What the job involves
- As a Principal Software Engineer - Data Engineering at project44, you'll have opportunities to work on the latest technologies to streamline Machine Learning & AI Operations, build scalable data infrastructure and democratize data access
- Work with software architecture and design as part of your job. Leverage and institute best practices from the areas of distributed systems, databases, data platform, infrastructure and platform software, manageability and observability
- Providing guidance on new technologies and continuous improvement in best practices. Researching, implementation and development of software development tools
- Build systems in a multi-cloud environment - we use AWS & GCP but value experience in other cloud environments such as Azure
- Build complex metrics solutions with data visualization support for actionable business insights
- Leverage expertise in latest Gen AI tools & methodologies like RAG , Vector DB, embeddings to architect and build automated data access & interpretation solutions
- Design and development ETL/ELT using Python/Java with Snowflake, Postgres and other data stores. Be able to develop & automate a project through its entire lifecycle
- Knowledge in Data Warehouse/Data Mart design and implementation. Be able to develop a project through its entire lifecycle
- Build distributed, reusable, and efficient backend ETLs. Implementation of security and Data protection
- Understand repeatable automated processes for building the application, test it, document it, and deploy it at scale
- Work collaboratively with insights and data science teams to understand end user requirements to provide technical solutions and for the implementation of new features and data pipelines
- Establish quality processes to deliver a stable and reliable solution
- Efficient in writing complex SQL, stored procedures in Snowflake, Postgres, BigQuery
- Preparing documentation (Data Mapping, Technical Specifications, Production Support, data dictionaries, test cases, etc.) for all projects
- Coach junior team members and help your team to continuously improve by contributing to tooling, documentation, and development practices
Our take
There currently exists a huge amount of pressure on supply chains across almost every industry, resulting in a demand for streamlined solutions. Businesses are attempting to future-proof their supply chains by identifying bottlenecks that lead to logistic breakdowns, but with the market being so volatile, this is difficult to manage.
Project44 provides a digital platform that aims to improve communication between logistics companies, transportation providers, and supply chain systems. The platform consists of a variety of modular API tools that can be employed to produce real-time data and predictive analytics. This helps provide insights into shipment arrival times, supply chain bottlenecks, and opportunities to increase efficiency.
Many startups have released software platforms that aim to prepare companies and their supply chains. However, Project44 has taken a unique approach by presenting a more versatile solution to the volatility of supply chain demands. The company has kept up with the growing market by launching new products and updates, expanding geographically, and building its leadership team, all of which have put it in a good place to find success into the future.
Steph
Company Specialist at Welcome to the Jungle
Insights
Company
Funding (last 2 of 7 rounds)
Oct 2022
$80m
LATE VC
Jan 2022
$420m
LATE VC
Total funding: $892.5m
Company benefits
- 401k plan
- Paid parental leave
- Vision and dental insurance
- Paid volunteer time off
- Work from home opportunities
- Health insurance
Company values
- Obsess over the customer: We strive for a frictionless experience at every step of the customer journey.
- Share the wheel: When others need help, we provide it. When we need help, we ask for it. When we work together, we win together.
- Build trust through real talk: We say and we do what's right, not what's easy.
- Roll up our sleeves: We are problem solvers. We approach problems with grit, resourcefulness, passion, and courage.
- Say:Do ratio: We strive to exceed a 1:1 ration between what we say and what we do. We set hight expectations and relentlessly strive to exceed them.
Company HQ
River North, Chicago, IL
Articles
Leadership
Jett McCandless
(CEO)They started their career with 7 years at YRC Freight before spending 5 years at GlobalTranz. They then founded CarrierDirect in 2011, before starting project44 as CEO.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 11 more jobs at project44