Member of Technical Staff, Cohere
Data Analysis and Evaluation
Natural language processing AI platform
Open for applications
Natural language processing AI platform
501-1000 employees
Open for applications
501-1000 employees
Company mission
To build machines that understand the world, and to make them safely accessible to all.
Role
Who you are
- Extremely strong software engineering skills
- Strong expertise in designing and conducting data collection tasks, including working with human annotators
- Strong statistical skills and experience evaluating scientific experiments related to data collection and model performance
- Experience analysing datasets with respect to their quality, biases, and suitability for training ML models
- Hands-on experience training large language models (LLMs) on distributed training infrastructures
- Familiarity with evaluating and improving the generalisability and robustness of ML systems
- Proficiency in programming languages such as Python and ML frameworks (e.g., PyTorch, TensorFlow, JAX)
- Excellent communication skills to collaborate effectively with cross-functional teams and present findings
- One or more papers at top-tier venues (such as NeurIPS, ICML, ICLR, AIStats, MLSys, JMLR, AAAI, Nature, COLING, ACL, EMNLP)
What the job involves
- As a Member of Technical Staff in Data Analysis and Evaluation, you will play a pivotal role in ensuring the quality, reliability, and performance of our large language models (LLMs)
- Your primary focus will be on designing and conducting data collection tasks, assessing and evaluating dataset quality, and analysing the robustness and generalisability of our models
- You will work closely with cross-functional teams, including researchers, engineers, and data annotators, to conduct data-driven decision-making and improve the overall effectiveness of our AI systems
- This role combines expertise in statistics, experimental design incl
- Human annotators, and machine learning to ensure that our models are trained on high-quality data and perform reliably across diverse scenarios
- You will contribute to Cohere’s mission of advancing AI by ensuring our systems are robust, scalable, and impactful
- Design and oversee data collection tasks, including supporting human annotators and ensuring data quality
- Develop and apply statistical methods to evaluate the quality and reliability of datasets
- Analyse and assess the generalisability and robustness of ML systems across diverse use cases
- Collaborate with teams to improve dataset quality and model performance
- Train and fine-tune large language models (LLMs) on distributed training infrastructures
- Conduct experiments to evaluate model performance and identify areas for improvement
Our take
The AI industry biggest stakeholders insist that the next step in enhancing web experiences will be through natural language interactions. While this may be true, only companies with considerable resources can reasonably address the gap needed to bring NLP to the forefront of web integration. Cohere was founded to address this shortfall between NLP development, widespread usage, and the resources required.
Cohere works on building top-of-the-class NLP processing models and software which it makes available to customers through APIs and custom solutions. In a strategic move, the company has partnered with Google Cloud, giving them access to resources that will undoubtedly push the field of NLP forward. This allows Cohere to serve as middlemen by offering a wide range of customers a product built on unmatched technology.
AI is currently a worldwide talking point and so it is no surprise that Cohere has seen rapid development, and raised $270M in a 2023 funding round. The company plans to introduce a dialogue model that would resemble ChatGPT, however, in this case, its technology would be mainly accessible to developers and businesses.
Steph
Company Specialist at Welcome to the Jungle
Insights
192% employee growth in 12 months
Company
Funding (last 2 of 5 rounds)
Jul 2024
$500m
SERIES D
Mar 2023
$270m
SERIES C
Total funding: $940m
Company benefits
- We cover 100% of premiums across health, dental, vision & travel
- We offer RRSP, 401K, and Pension Scheme contributions
- We offer lunch and fitness studio credits and a quality time fund which can be spent on things like dog walking and laundry services
- We want everyone who contributes to our success to get a ‘piece of the pie’
- Work Remote & PTO
- We know that some people work better at home, so we are remote-first, and sure that all meetings, events, and opportunities are set up for our distributed team
- Every employee at Cohere gets 6 weeks of paid time off & US and Canadian federal holidays, and we provide unlimited sick days
- All new parents (including those who adopt or go through a surrogate journey) are eligible to receive 100% salary for 6 months in Canada, the US, and the UK
- The decision and journey to having kids is different for each person and family. Part of our commitment to diversity is being able to support the widest variety of these scenarios as we can so we offer financial support for egg freezing and IVF for those in the US, Canada and the UK
- Every employee at Cohere receives an annual $2,000 education fund to use as they please
Company HQ
Grange Park, Toronto, ON
Leadership
Aidan Gomez
(CEO)Has a PhD in Computer Science from Oxford University. Previously worked as a Researcher at Google (Brain) and FOR.ai
Ivan Zhang
(CTO)Previous experience working in research and engineering at For.ai, Cortex labs, Pressly and Ranomics.
Nick Frosst
(CTO)Previously worked as a Research Engineer at Google (Brain).
Share this job
View 35 more jobs at Cohere