Senior Machine Learning Engineer, Illumio
$191-220k
Office located in Sunnyvale, CA
Automated enforcement against cyberattacks
Be an early applicant
Automated enforcement against cyberattacks
501-1000 employees
Be an early applicant
$191-220k
Office located in Sunnyvale, CA
501-1000 employees
Company mission
To enable every organization to realize a future without high-profile breaches.
Role
Who you are
- 5–8 years of experience in backend engineering using Java, Python, or Go
- Expertise in distributed systems, asynchronous architectures (Kafka), and large-scale data processing (Spark/Flink)
- Hands on experience with agentic frameworks (e.g., AutoGen, CrewAI, or custom orchestration layers), RAG, MCP, fine tuning models and prompt engineering
- Agentic observability using Langfuse, Evals frameworks for Testing/Resilience
Desirable
- Advanced IaC: Expertise in building reusable Terraform modules and managing complex multi-region cloud deployments
- Vector DB Optimization: Deep experience in indexing strategies (HNSW vs IVF) and performance tuning for high-concurrency vector databases at scale
- AI Ops: Experience with LLM deployment optimization (e.g., vLLM, TensorRT-LLM) or managing proprietary model inference endpoints
What the job involves
- As a Senior Software Engineer, you will architect high-scale distributed systems that process massive data volumes to fuel our Agentic AI ecosystem.
- You will lead the development of autonomous agents that don’t just provide analytics, but take action—driving complex automation and insights for our enterprise customers
- Asynchronous Systems: Architect and optimize high-throughput, event-driven systems using Apache Kafka to handle real-time data flows
- Data Processing at Scale: Build and maintain large-scale data pipelines using Apache Spark or Flink to provide the high-volume analytics that power our AI
- Agentic Systems at Scale: Design sophisticated AI Agents capable of autonomous planning, memory management, and high-reliability tool-use across distributed environments
- Infrastructure & Orchestration: Lead the architectural design of containerized services on Kubernetes, ensuring high availability and scalability across Cloud Infrastructure (AWS/Azure/GCP)
Our take
Cybersecurity remains an ongoing battle, with evolving cyberthreats and ever-more determined cybercriminals, and major data breaches such as the SolarWinds hack have the potential to cause widespread disruption. Illumio is taking a different approach to most of the mainstream security companies, with a process called "microsegmentation". This makes it easier to guard companies from security breaches, and contain any breaches that occur.
Detection of viruses is no longer considered sufficient to keep companies and individuals safe. Illumio takes a “zero trust” approach, in which everything is viewed as suspicious, a similar approach to that which is used by the White House. The company operates at the cutting edge of microsegmentation, focusing on protecting cloud datacenters and workloads. With more and more companies moving to the cloud, this approach is crucial.
Illumio also protects endpoints, partnering with big players such as Citrix, Amazon Web Services, and Splunk. A collaboration with Appgate, a Zero Trust secure access company, delivers the industry's first integrated Zero Trust Network Access and Segmentation solution, which can reduce risk across hybrid infrastructure, and proves Illumio's dedication to innovating the space. Additionally, the company announced a Federal Risk and Authorisation Management Program (FedRAMP), which is tailored to assist federal agencies in reducing risk.
Kirsty
Company Specialist at Welcome to the Jungle
Insights
1% employee growth in 12 months
Company
Funding (last 2 of 6 rounds)
Jun 2021
$225m
SERIES F
Feb 2019
$65m
SERIES E
Total funding: $565.6m
Company benefits
- Medical, Dental, Vision Coverage
- Health and Dependent Savings Accounts
- Life and Disability Programs
- Paid Parental Leave
- Voluntary Benefit Programs
- Company Sponsored Wellness Program
- Wellness Reimbursement Program
- Retirement Savings
- Equity Opportunities
- Paid time off and Paid Holidays
- Employee Incentive Program
Company HQ
Sunnyvale, CA
Leadership
Andrew Rubin
(Co-Founder & CEO)Started in Business Development, as an Analyst at VoiceNet Communications, and as a Director at VoiceNet. Worked at Cymtec Systems for over 8 years, promoted from VP of Sales to CEO. Seed Investor in Tory Burch, and Powermat. Current Strategic Advisor to Menlo Security, and Bolt.
PJ Kirner
(Co-Founder & Strategic Advisor)Studied Computer Science at Cornell. Worked as an Engineer Manager for over 6 years at Trilogy. Software Architect at Funkware for over 3 years. Was Principal Systems Engineer at Cluster File Systems. Distinguished Engineer for over 5 years at Juniper Networks. Was CTO of Cymtec Systems.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 61 more jobs at Illumio