Senior Software Engineer, Crusoe Energy Systems

• Advanced degree in Computer Science, Engineering, or a related field
• Proven experience in distributed systems design and implementation
• Expertise in using cloud-based services, such as elastic compute, object storage, virtual private networks, managed databases, etc
• Experience with container runtimes (e.g., Kubernetes) and microservices architectures
• Experience using REST APIs and common communication protocols, such as gRPC
• Demonstrated experience in the software development cycle and familiarity with CI/CD tools
• Experience in Generative AI (Large Language Models, Multimodal)
• Proficiency in Golang or Python for large-scale, production-level services. (Preferred)
• Familiarity with AI infrastructure, including training, inference, and ETL pipelines. (Preferred)
• Contributions to open-source AI projects such as VLLM or similar frameworks. (Preferred)
• Performance optimizations on GPU systems and inference frameworks. (Preferred)
• Proven track record of delivering early-stage projects under tight deadlines
• Strong communication and collaboration skills
• Proactive and results-oriented with the ability to work independently and as part of a team
• Passion for building high-quality, scalable, and impactful products

Desirable

• The Crusoe Cloud Managed AI team seeks an ambitious and experienced Senior Software Engineer to join their team
• You'll have a pivotal role in shaping the architecture and scalability of our next-generation AI inference platform
• You will lead the design and implementation of core systems for our AI services, including resilient fault-tolerant queues, model catalogs, and scheduling mechanisms optimized for cost and performance
• This role gives you the opportunity to build and scale infrastructure capable of handling millions of API requests per second across thousands of customers
• From day one, you'll own critical subsystems for managed AI inference, helping to serve large language models (LLMs) to a global audience
• As part of a dynamic, fast-growing team, you’ll collaborate cross-functionally, influence the long-term vision of the platform, and contribute to cutting-edge AI technologies
• This is a unique opportunity to build a high-performance AI product that will be central to Crusoe's business growth
• Lead the design and implementation of resilient fault-tolerant queues, model catalogs, and scheduling mechanisms
• Build and optimize systems for high-volume AI inference, handling millions of API requests per second
• Develop and maintain core services for AI model deployment and management
• Work closely with product managers, data scientists, and other engineers to define and deliver AI services
• Integrate with other Crusoe Cloud services to provide a seamless user experience
• Collaborate with research and development teams to explore and implement new AI technologies
• Design and implement systems with high availability, low latency, and fault tolerance
• Optimize performance across all stages of the AI inference pipeline, including model loading, execution, and response handling
• Continuously monitor and improve the performance and reliability of AI services