AI Infrastructure Systems Engineer, Together AI

• 3+ years building distributed systems, infrastructure platforms, or large-scale backend software
• Strong software engineering skills in Python, Go, or Rust
• Experience building platforms, automation systems, or developer infrastructure
• Experience with Linux, Kubernetes, Terraform, Ansible, or similar infrastructure technologies
• Strong systems thinking with the ability to understand problems across hardware and software
• A passion for solving complex infrastructure challenges through software
• An automation-first mindset—if a task is repeated, your instinct is to build a system to eliminate it

Desirable

• As an AI Infrastructure Engineer at Together, you are responsible for keeping all user-facing services and production systems running smoothly
• Participate in on-call rotation (Pagerduty) to respond to production incidents
• Build and run our infrastructure with Ansible, Terraform, and Kubernetes to enable scaling to a massive number of concurrent users
• Build monitoring systems to ensure the highest quality service for our customers
• Design and implement operational processes (such as deployments and upgrades)
• Debug production issues across all services and levels of the stack
• Identify improvements for the product architecture from the reliability, performance and availability perspectives
• Plan the growth of Together AI's infrastructure