Staff Cloud Infrastructure Engineer, OctoML
$185-220k
Machine learning acceleration platform
Job no longer available
Machine learning acceleration platform
101-200 employees
Job no longer available
$185-220k
101-200 employees
Company mission
To empower more creators to harness the transformative power of ML to build intelligent applications.
Role
Who you are
- Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience
- 7+ years of experience in cloud infrastructure engineering, with a strong background in incident management
- Extensive experience with cloud platforms such as AWS and Google Cloud
- Deep understanding of Kubernetes cluster management, debugging and troubleshooting
- Excellent communication and collaboration skills
- Background in software engineering with a solid understanding of SDLC
- Strong Linux systems understanding including Bash / shell scripting and debugging
- Proficiency in Go, Python, and/or JavaScript/TypeScript for building tools and automation
- Expertise with CI/CD systems such as GitHub Actions, GitLab CI, or similar
- Experience with infrastructure as code tools like Terraform, CloudFormation, or Ansible
- Familiarity with observability tools such as Prometheus, Grafana, Datadog, or equivalent
- Proficient in Git and version control practices
- Strong problem-solving and debugging skills
- Proven effectiveness in leading cross-functional projects
- Track record of building patterns and solutions leveraged across an organization
What the job involves
- OctoAI is conducting a search for a Staff Infrastructure Engineer to take a leadership role in advancing the engineering efforts behind our Inference Serving platform.
- You'll be central to optimizing developer experience, overseeing incident management and reliability processes, and driving our security and compliance initiatives. Your deep expertise in cloud platforms, Kubernetes, and software engineering will be crucial in ensuring our infrastructure is robust, scalable, and secure, meeting the needs of our users. By guiding and supporting the team, you'll help shape the future as the organization grows
- Architect and implement cloud infrastructure solutions, ensuring they meet the needs of scalability, reliability, and security
- Develop and maintain automated CI/CD pipelines, enabling smooth and rapid software deployment
- Lead and manage incident response efforts, ensuring that issues are resolved quickly and that root cause analysis is performed to prevent future occurrences
- Implement and manage monitoring tools and performance tuning practices to ensure optimal infrastructure performance and cost-efficiency
- Work closely with software engineers, product, and other stakeholders to integrate infrastructure solutions seamlessly into the overall software development lifecycle
- Develop and maintain tools to automate routine tasks, improve infrastructure efficiency, and reduce manual intervention
- Ensure all infrastructure meets security and compliance requirements, implementing best practices and keeping up-to-date with industry standards
- Create and maintain comprehensive documentation for infrastructure designs, processes, and incident response actions
Our take
It’s no secret AI technology has the capability to revolutionise the world. Now used across many sectors, developers are looking into and continuing to research the possibilities of machine learning. OctoML is an acceleration platform hoping to make AI the most accessible and sustainable version of itself that it can be.
The company has developed a library of products that enables users to implement AI technology into customers' already integrated systems, making it less intimidating for the more amateur user.
The company appointed Lip-Bu Tan, the executive chairman of multinational software company Cadence Design, to its board of directors in 2022. This fresh wealth of expertise will be used toward the company's next phase of expansion. After several rounds of funding gave OctoML the ability to deploy new features among the platform, it’ll be interesting to see what the company decides to do next in its scaling.
Freddie
Company Specialist at Welcome to the Jungle
Insights
Company
Funding (last 2 of 4 rounds)
Nov 2021
$85m
SERIES C
Mar 2021
$28m
SERIES B
Total funding: $131.9m
Company benefits
- Great benefits - Whether you’re into kitesurfing, biking, or board games, we’ve got you covered with low-deductible, inclusive health plans with 100% paid premiums. Plus dental, vision, life, disability, paid parental leave, 401K, Health Savings Accounts, and more
- Time for your life - We strongly encourage use of our generous PTO policy and offer two company-wide “quiet periods” per year to rest and recharge. Enjoy a remote-first culture, family-friendly policies, flexible work schedules, and a generous stipend to outfit your home office.
- Career growth - We understand that career growth isn’t always linear. Octonauts who wish to pursue broader responsibilities at the company are equipped with resources and guidance to develop as leaders.
Company HQ
Pike Pine Retail Core, Seattle, WA
Leadership
Luis Ceze
(CEO)Co-founded Corensic, was a Venture Partner at Madrona Venture Group. Is currently also a Professor at the University of Washington.
Jason Knight
(CSO)Previously a Bioinformatics Scientist at Human Longevity and worked through several roles at Intel Corporation, most recently Head of Software Product - AI Products Group.
Jared Roesch
(CTO)Worked as a Research Assistant at Mozilla, Teaching Assistant at the University of Washington and Research Intern at Microsoft.
Thierry Moreau
(VP Technology Partnerships)Extensive background in research and engineering. Most recently worked as a Postdoctoral Researcher at the University of Washington.
Tianqi Chen
(Chief Technologist)Doctor of Philosophy - PhD in Computer Science. Began as CTO at OctoML before becoming Chief Technologist in January 2022. Also is currently a Professor at Carnegie Mellon University.
Share this job