Senior Software Engineer, Cohere
MLOps and Infrastructure
Remote-flexible
Natural language processing AI platform
Open for applications
Natural language processing AI platform
501-1000 employees
Open for applications
Remote-flexible
501-1000 employees
Company mission
To build machines that understand the world, and to make them safely accessible to all.
Role
Who you are
- 5+ years of engineering experience running production infrastructure at a large scale
- Experience designing large, highly available distributed systems with Kubernetes, and GPU workloads on those clusters
- Experience working with GCP, Azure, AWS and/or OCI
- Experience in designing, deploying, supporting, and troubleshooting in complex Linux-based computing environments
- Excellent collaboration and troubleshooting skills to build mission-critical systems, and ensure smooth operations and efficient teamwork
- The grit and adaptability to solve complex technical challenges that evolve day to day
- You have proven production experience with Kubernetes
- You have hands-on coding experience developing services and automated tests (we use Go)
- You prefer contributing to Open Source solutions rather than building solutions from the ground up
- You have experience scaling and debugging cloud-based infrastructure (we use Oracle, GCP, and Coreweave)
- You draw motivation from building systems that help others be more productive
- You see mentorship, knowledge transfer, and review as essential prerequisites for a healthy team
- If some of the above doesn’t line up perfectly with your experience, we still encourage you to apply! If you want to work really hard on a glorious mission with teammates that want the same thing, Cohere is the place for you
Desirable
- You worked with or supported MLEs or data scientists
- Familiarity troubleshooting RDMA networking
What the job involves
- Please Note: All of our infrastructure roles require participating in a 24x7 on-call rotation, where you are compensated for your on-call schedule
- Build self-service systems that automate managing, deploying and operating services
- This includes our custom Kubernetes operators that support language model deployments
- Automate environment observability and resilience. Enable all developers to troubleshoot and resolve problems
- Take steps required to ensure we hit defined SLOs, including participation in an on-call rotation
- Build strong relationships with internal developers and influence the Infrastructure team’s roadmap based on their feedback
- Develop our team through knowledge sharing and an active review process
Salary benchmarks
Our take
The AI industry biggest stakeholders insist that the next step in enhancing web experiences will be through natural language interactions. While this may be true, only companies with considerable resources can reasonably address the gap needed to bring NLP to the forefront of web integration. Cohere was founded to address this shortfall between NLP development, widespread usage, and the resources required.
Cohere works on building top-of-the-class NLP processing models and software which it makes available to customers through APIs and custom solutions. In a strategic move, the company has partnered with Google Cloud, giving them access to resources that will undoubtedly push the field of NLP forward. This allows Cohere to serve as middlemen by offering a wide range of customers a product built on unmatched technology.
AI is currently a worldwide talking point and so it is no surprise that Cohere has seen rapid development, and raised $270M in a 2023 funding round. The company plans to introduce a dialogue model that would resemble ChatGPT, however, in this case, its technology would be mainly accessible to developers and businesses.
Steph
Company Specialist at Welcome to the Jungle
Insights
192% employee growth in 12 months
Company
Funding (last 2 of 5 rounds)
Jul 2024
$500m
SERIES D
Mar 2023
$270m
SERIES C
Total funding: $940m
Company benefits
- We cover 100% of premiums across health, dental, vision & travel
- We offer RRSP, 401K, and Pension Scheme contributions
- We offer lunch and fitness studio credits and a quality time fund which can be spent on things like dog walking and laundry services
- We want everyone who contributes to our success to get a ‘piece of the pie’
- Work Remote & PTO
- We know that some people work better at home, so we are remote-first, and sure that all meetings, events, and opportunities are set up for our distributed team
- Every employee at Cohere gets 6 weeks of paid time off & US and Canadian federal holidays, and we provide unlimited sick days
- All new parents (including those who adopt or go through a surrogate journey) are eligible to receive 100% salary for 6 months in Canada, the US, and the UK
- The decision and journey to having kids is different for each person and family. Part of our commitment to diversity is being able to support the widest variety of these scenarios as we can so we offer financial support for egg freezing and IVF for those in the US, Canada and the UK
- Every employee at Cohere receives an annual $2,000 education fund to use as they please
Company HQ
Grange Park, Toronto, ON
Leadership
Aidan Gomez
(CEO)Has a PhD in Computer Science from Oxford University. Previously worked as a Researcher at Google (Brain) and FOR.ai
Ivan Zhang
(CTO)Previous experience working in research and engineering at For.ai, Cortex labs, Pressly and Ranomics.
Nick Frosst
(CTO)Previously worked as a Research Engineer at Google (Brain).
Share this job
View 28 more jobs at Cohere