Senior/Principal Performance Engineer, CIQ
+ Employee stock options
More information about location
Enterprise-grade open source software infrastructure
Open for applications
Enterprise-grade open source software infrastructure
101-200 employees
Open for applications
+ Employee stock options
More information about location
101-200 employees
Company mission
To simplify and unify software infrastructure, enabling customers to craft ground breaking technologies for generations to come.
Role
Who you are
- A deep, principled understanding of operating system internals - Linux kernel scheduler, memory subsystem, I/O stack, and networking
- Proven experience identifying and resolving performance regressions across kernel and user space in production environments
- Hands-on expertise with profiling and tracing tools: perf, eBPF/bpftrace, Flamegraphs, VTune, Nsight, strace, ftrace, and similar
- Strong background in AI/ML workload performance - including inference optimization (TensorRT, ONNX, vLLM, or similar), training efficiency, and GPU/accelerator utilization
- Experience with HPC workloads: MPI, OpenMP, parallel filesystems, RDMA/InfiniBand, and job schedulers (Slurm, PBS, etc.)
- Familiarity with modern AI-first development workflows and comfort using LLM-based tools to accelerate engineering work
- Experience building automated performance testing and regression detection pipelines in CI/CD environments
- Excellent analytical skills - able to form hypotheses, design experiments, and draw actionable conclusions from complex data
- Strong written and verbal communication skills; able to present findings to both deeply technical audiences and business stakeholders
- A collaborative, humble, and always-learning mindset - combined with the confidence to champion performance as a first-class engineering concern
- PhD in Computer Science, Computer Engineering, or a related field strongly preferred; equivalent industry experience considered
- 15+ years of industry experience in systems performance engineering, OS development, or a closely related discipline
- Demonstrated track record of measurable, published, or production-deployed performance improvements at scale
- Experience working in or with open-source ecosystems (Linux kernel contributions, upstream community engagement) is a strong plus
- Background with cloud-native, containerized, and/or HPC computing environments preferred
What the job involves
- CIQ is seeking a highly experienced Senior or Principal Performance Engineer to own and drive system-level and application-level performance across our product portfolio
- This is an AI-first role, both in methodology and focus area, and the right candidate will bring deep expertise in operating system internals, kernel and userspace performance, and the performance demands of modern AI workloads, HPC environments, general-purpose computing, and production service workloads
- In this role, you will be the standard-bearer for performance at CIQ. Our performance-focused solutions must always be the fastest in the industry, and you will be responsible for ensuring that remains true
- You will be intimately involved with Fuzzball, CIQ's cloud-native computing platform, learning its architecture end-to-end and integrating workloads - both user-facing and CI/testing pipelines - directly through it
- This role is leveled as Senior or Principal based on qualifications and demonstrated capabilities
- Design, develop, and maintain comprehensive benchmarking frameworks spanning OS, kernel, and application layers
- Profile workloads across CPU, memory, I/O, network, and accelerator (GPU/NPU) subsystems to identify bottlenecks and optimization opportunities
- Establish and own performance baselines across CIQ's product and solutions portfolio
- Leverage AI-assisted tooling and agentic workflows to accelerate profiling, analysis, and root cause identification
- Build and maintain automated performance regression-detection pipelines integrated into CI/CD workflows using Fuzzball
- Identify, triage, and resolve regressions across user space, kernel space, and application layers with urgency and rigor
- Collaborate across engineering teams to root-cause regressions introduced by upstream kernel changes, compiler updates, or library modifications
- Drive proactive performance improvements - not just reactive fixes - to keep CIQ solutions ahead of the competition across every layer of the stack
- Own core operating system performance: kernel subsystem tuning (scheduler, memory management, I/O, networking), system call overhead reduction, and user space library and runtime optimizations
- Identify and implement kernel-level enhancements, including patches, configuration changes, and upstream contributions that yield measurable performance gains for CIQ's customer workloads
- Optimize for AI inference and training workloads, including LLM serving, model parallelism, and accelerator utilization
- Tune performance for HPC workloads, including modeling, simulation, and tightly coupled parallel applications (MPI, OpenMP, etc.)
- Optimize general computing and service workloads - web services, databases, messaging systems, and other production software that runs on CIQ's OS platform
- Work at all levels of the stack: compiler flags, kernel parameters, scheduler tuning, NUMA topology, memory allocation, and application-level algorithmic improvements
- Champion an AI-first engineering philosophy - use AI tools, agents, and automation to accelerate your own productivity and the quality of performance insights
- Identify and prioritize optimization opportunities that directly impact AI training throughput and inference latency/cost
- Stay current on state-of-the-art techniques in ML system performance, including quantization, batching strategies, kernel fusion, and hardware-software co-design
- Develop deep expertise in CIQ's Fuzzball platform - its architecture, scheduling, and workload execution model
- Integrate performance benchmarks, regression tests, and user-facing workloads into Fuzzball-based pipelines
- Contribute to the performance characterization of Fuzzball itself, ensuring the platform adds minimal overhead and scales efficiently
- Develop broad familiarity with the full CIQ product portfolio — including Rocky Linux and RLC (and its variants), Fuzzball, Apptainer (formerly Singularity), and Warewulf - understanding how performance considerations span and interconnect across each
- Collaborate deeply with the engineering teams behind each product line to surface, prioritize, and deliver performance improvements that benefit customers across the entire CIQ ecosystem
- Partner with product and customer success teams to translate real-world performance pain points into engineering priorities and measurable outcomes
- Document and communicate findings clearly - from low-level profiling data to executive-level summaries
- Contribute to technical publications, conference presentations, and thought leadership that reinforces CIQ's reputation for performance excellence
Our take
Development of the Community Enterprise Linux Operating System (CentOS) was dropped by IBM’s RedHat in just 2020, leaving a gaping hole in the market. When CIQ’s founders swept in to offer a replacement, Rocky Linux, and a complementary support and servicing company CIQ, the demand reportedly skyrocketed - and, according to CIQ, it hasn’t subsided since.
That’s because the old CentOS was one of the principal OSs used by enterprise, cloud, VMs, and containers - Google, for example, was among one of its many enterprise users. Now Google has picked up Rocky Linux, and CIQ has consequently scooped up that major partnership too - and some healthy funding. It’s a fitting reward for a highly savvy play from the CIQ founders, picking up a tried-and-tested product that’s already achieved strong market penetration.
Besides Rocky Linux, CIQ has also developed cluster provisioning solution Warewulf, high performance computing (HPC) app containers tool Apptainer, and hybrid performance computing platform-as-a-Service Fuzzball. So it’s safe to say that CIQ has managed to skilfully manoeuvre its way into a pivotal position in the development of cutting edge high performance computing architecture. Now it will need to ensure it can capitalize on its lead.
Kirsty
Company Specialist at Welcome to the Jungle
Insights
56% employee growth in 12 months
Company
Funding (2 rounds)
May 2022
$26m
SERIES A
Jan 2021
$4m
SERIES A
Total funding: $30m
Company HQ
North Valleys, Reno, NV
Leadership
Gregory Kurtzer
(Co-Founder & CEO)Spent over 16 years as a System Architect, Technical Lead, and Scientific Advisor at Berkeley Lab, before moving into a Corporate Advisor role at RStor. Alongside this, also founded and served as CEO at Sylabs.
Share this job