Data Engineer, Shift5

• 5+ years software/data engineering
• 3+ years experience with a major programming language (GoLang, Java, Python)
• 3+ years experience with of relational database experience (PostgreSQL, MySQL, Oracle, etc.)
• 3+ years experience with Big Data (Hadoop, Spark) and Data Modeling
• 2+ years experience with containerization and cloud services: Docker, Kubernetes, cloud monitoring tools
• Proven experience building complex data applications from scratch including requirements gathering, design, planning, and implementation
• Familiar with modern data stack components including data ingestion, transformation, and orchestration
• Expertise with batch and streaming data pipelines using technologies such as Apache Airflow or Benthos
• Demonstrated delivery of scalable, observable, supportable, reliable data processing applications
• Deep understanding of software engineering practices and concepts
• Experience with end-to-end feature design and ownership
• Comfortable working in a fast-paced environment
• Ability to efficiently multitask and accommodate change of priorities on demand

Desirable

• Shift5 is seeking a Data Engineer to join our growing team
• Interpret requirements and design specifications and take ownership of building features from the ground up
• Write clean, well-documented, scalable, extensible, testable code to ensure application quality and maintainability
• Work cross-functionally across Shift5 engineering teams to build applications that integrate cleanly across other Shift5 componentry
• Design, build, and maintain data processing, storage, and integration pipelines
• Build robust and scalable data products for various stakeholders including data scientists, transportation engineers, and executives that drive insights and decision making
• Create solutions that utilize AWS cloud services that are efficient, reliable, cost-effective, dynamically scalable, and observable
• Collaborate with data scientists and engineers to create semantic data models to represent complex vehicular systems
• Perform analysis on complex data sets to create data ontologies, verify data quality/integrity, and ensure accuracy of data after passing through data pipelines
• You’ll operate in a team-based environment with engineers, product managers, program managers and designers to conceive, implement and shape major features
• Engineers are key contributors in shaping this design process and you’ll be a major factor in generating high-impact products that literally save lives
• This role resides in our Product Engineering team and reports to our Director, Software Engineering
• Shift5 is a rapidly growing data and cybersecurity scale-up
• We specialize in capturing and analyzing vehicular bus data in real time, providing anomaly detection and operational intelligence required to act
• Our insights provide real-time alerting and historical trends to assure mission readiness and cyber survivability, and our innovative technology enables military systems to deter adversaries, protect warfighters, and maintain their competitive edge
• We are a collaborative, passionate and driven cadre of cyber security experts
• Our engineers are multidisciplinary, and our team is dynamic