Senior GPU Infrastructure Engineer, Hyperbolic

• Deep understanding of bare-metal provisioning and lifecycle management, including IPMI/Redfish, BMC-based remote management, PXE boot, and automated OS deployment workflows
• Deep understanding of GPU scheduling and orchestration, including GPU type awareness, memory management, topology considerations, placement strategies for multi-GPU jobs, and fragmentation minimization
• Strong infrastructure and DevOps engineering skills with proficiency in Terraform or Pulumi, CI/CD for infrastructure, secrets management, configuration management, and observability stack implementation
• Experience with storage and data infrastructure for AI/ML workloads, including object storage, high-IOPS block storage, and distributed file systems for training data and checkpoints
• Proficiency with API design and cloud-init for automated provisioning and configuration
• Solid understanding of GPU architecture, CUDA, and GPU compute optimization
• Highly collaborative team player with excellent communication skills across technical and non-technical stakeholders
• Proven ability to work effectively with hardware vendors and vendor engineering teams to troubleshoot issues and optimize integrations
• Experience building and scaling cloud infrastructure or distributed systems in production environments

Desirable

• We're seeking a Senior Infrastructure Engineer to help build and scale Hyperbolic's GPU Cloud Marketplace, by building a multi-tenancy provisioning and virtualization solution
• This is a foundational role where you'll be responsible for transforming raw GPUs from diverse global suppliers into a programmable, orchestrated pool that serves thousands of AI developers and researchers
• You'll work at the cutting edge of cloud infrastructure, building the core orchestration layer that enables our platform to deliver up to 75% cost savings compared to traditional cloud providers