Software Engineer, Cohere
Core Infrastructure
Natural language processing AI platform
Open for applications
Natural language processing AI platform
501-1000 employees
Open for applications
501-1000 employees
Company mission
To build machines that understand the world, and to make them safely accessible to all.
Role
Who you are
- You have proven production experience with Kubernetes
- You’re skilled in managing GPU-accelerated workloads within Kubernetes environments, with experience in scaling and debugging cloud-based infrastructure
- You have hands-on coding experience developing services and automated tests (experience with Go and Python is plus!)
- You prefer contributing to Open Source solutions rather than building solutions from the ground up
- You have experience scaling and debugging cloud-based infrastructure (such as Oracle, GCP, and Coreweave)
- You draw motivation from building systems that help others be more productive
- You see mentorship, knowledge transfer, and review as essential prerequisites for a healthy team
- If some of the above doesn’t line up perfectly with your experience, we still encourage you to apply! If you want to work really hard on a glorious mission with teammates that want the same thing, Cohere is the place for you
What the job involves
- This team is responsible for building world-class infrastructure that is critical to all of Cohere’s success
- Focus on stability, scalability, and observability are all paramount as this work acts as the foundation for all members of technical staff
- Please Note: All of our infrastructure roles require participating in a 24x7 on-call rotation, where you are compensated for your on-call schedule
- Build self-service systems that automate managing, deploying and operating services
- This includes our custom Kubernetes operators that support language model deployments
- Automate environment observability and resilience. Enable all developers to troubleshoot and resolve problems
- Take steps required to ensure we hit defined SLOs, including participation in an on-call rotation
- Build strong relationships with internal developers and influence the Infrastructure team’s roadmap based on their feedback
- Develop our team through knowledge sharing and an active review process
Salary benchmarks
Our take
The AI industry biggest stakeholders insist that the next step in enhancing web experiences will be through natural language interactions. While this may be true, only companies with considerable resources can reasonably address the gap needed to bring NLP to the forefront of web integration. Cohere was founded to address this shortfall between NLP development, widespread usage, and the resources required.
Cohere works on building top-of-the-class NLP processing models and software which it makes available to customers through APIs and custom solutions. In a strategic move, the company has partnered with Google Cloud, giving them access to resources that will undoubtedly push the field of NLP forward. This allows Cohere to serve as middlemen by offering a wide range of customers a product built on unmatched technology.
AI is currently a worldwide talking point and so it is no surprise that Cohere has seen rapid development, and raised $270M in a 2023 funding round. The company plans to introduce a dialogue model that would resemble ChatGPT, however, in this case, its technology would be mainly accessible to developers and businesses.
Steph
Company Specialist at Welcome to the Jungle
Insights
192% employee growth in 12 months
Company
Funding (last 2 of 6 rounds)
Aug 2025
$500m
LATE VC
Jul 2024
$500m
SERIES D
Total funding: $1.4bn
Company benefits
- We cover 100% of premiums across health, dental, vision & travel
- We offer RRSP, 401K, and Pension Scheme contributions
- We offer lunch and fitness studio credits and a quality time fund which can be spent on things like dog walking and laundry services
- We want everyone who contributes to our success to get a ‘piece of the pie’
- Work Remote & PTO
- We know that some people work better at home, so we are remote-first, and sure that all meetings, events, and opportunities are set up for our distributed team
- Every employee at Cohere gets 6 weeks of paid time off & US and Canadian federal holidays, and we provide unlimited sick days
- All new parents (including those who adopt or go through a surrogate journey) are eligible to receive 100% salary for 6 months in Canada, the US, and the UK
- The decision and journey to having kids is different for each person and family. Part of our commitment to diversity is being able to support the widest variety of these scenarios as we can so we offer financial support for egg freezing and IVF for those in the US, Canada and the UK
- Every employee at Cohere receives an annual $2,000 education fund to use as they please
Company HQ
Grange Park, Toronto, ON
Leadership
Aidan Gomez
(CEO)Has a PhD in Computer Science from Oxford University. Previously worked as a Researcher at Google (Brain) and FOR.ai
Ivan Zhang
(CTO)Previous experience working in research and engineering at For.ai, Cortex labs, Pressly and Ranomics.
Nick Frosst
(CTO)Previously worked as a Research Engineer at Google (Brain).
Share this job
View 40 more jobs at Cohere