Software Engineer, Fireworks AI

• Bachelor’s degree in Computer Science or equivalent industry experience
• 5+ years of experience writing high-performance, production-grade code
• Hands-on experience with LLM inference frameworks (e.g., vLLM, TensorRT, SGLang, Triton)
• Deep understanding of distributed systems, including storage, search, and large-scale computation
• Strong background in systems programming, performance optimization, and parallel computing

Desirable

• We’re looking for a Machine Learning Software Engineer to develop the core systems and APIs that power LLM inference and fine-tuning at scale
• You will work on high-performance, distributed systems that optimize model execution, ensuring low-latency inference and efficient fine-tuning pipelines
• As part of our engineering team, you’ll collaborate with researchers and infrastructure engineers to bring cutting-edge AI capabilities to production, delivering robust and scalable solutions for real-world applications
• Develop and optimize ML inference systems that enable fast, scalable model execution
• Build APIs for LLM inference and fine-tuning, ensuring reliability, efficiency, and performance
• Design distributed systems for serving large-scale AI workloads, ensuring fault tolerance and scalability
• Analyze and improve the efficiency, scalability, and stability of system resources
• Troubleshoot performance bottlenecks and optimize inference runtime for diverse hardware environments