Staff Machine Learning Engineer, Klue
CA$190-210k
+ Employee Stock Option Plan
2 days a week in office
Competitive enablement software
Open for applications
Competitive enablement software
201-500 employees
Open for applications
CA$190-210k
+ Employee Stock Option Plan
2 days a week in office
201-500 employees
Company mission
Klue's mission is to enable revenue teams with the insights they need to win, when they need it, and wherever they live.
Role
Who you are
- Masters or PhD in Machine Learning, NLP, or related field
- 5+ years of software engineering experience
- Proven experience leading large cross team initiatives
- 3+ years building and optimizing retrieval systems
- 3+ years training/fine-tuning transformer models
- Deep understanding of LLMs, retrieval metrics and their trade-offs
- Implement memory and tool-use strategies to enhance LLM-based agent capabilities
- Experience building end-to-end systems as a Platform Engineer, MLOps Engineer, or Data Engineer
- Strong understanding of software testing, benchmarking, and continuous integration
- Build scalable, production-ready ML pipelines for training, evaluation, deployment and monitoring
- Develop and implement CI/CD pipelines. Automate the deployment and monitoring of ML models
- Knowledge of query augmentation and content enrichment strategies
- Expertise in automated LLM evaluation, including LLM-as-judge methodologies
- Skilled at prompt engineering - including zero-shot, few-shot, and chain-of-though
- Proven ability to balance scientific rigor with driving business impact
- Track record of staying current with ML research and breakthrough papers
- Take ownership and run with ambiguous problems
- Jump into new areas and rapidly learn what's needed to deliver solutions
- Bring scientific rigor while maintaining a pragmatic delivery focus
- See unclear requirements as an opportunity to shape the solution
What the job involves
- We're looking for a Staff Machine Learning Engineer to join our ML Foundation and Platform team in Toronto, focusing on building and optimizing state-of-the-art LLM-powered agents that can reason, plan and automate workflows for users
- You'll be joining us at an exciting time as we reinvent our insight generation systems, making this an excellent opportunity for someone with strong ML and IR fundamentals who wants to dive deep into practical LLM applications
- As a member of our team, you'll be focusing on optimizing LLM-based agents, creating a platform for other teams to utilize ML capabilities and deploying ML services to production
- You'll measure and improve retrieval systems across the spectrum from BM25 to semantic search and develop comprehensive evaluation metrics to measure their performance
- A key challenge will be developing optimal chunking and enrichment strategies for diverse data sources including news articles, website changes, documents, CRM entries, call recordings and internal communications
- You'll explore how different data types and formats impact retrieval performance and develop strategies to maintain high relevance across all sources
- Beyond agents and retrieval, you'll work on building a platform for other teams to effectively utilize LLM tools and take advantage of prompt engineering.This includes developing APIs and scalable systems, developing scalable tools and services to handle machine learning training and inference for our clients, writing zero-shot and few-shot prompts with structured inputs/outputs, and implementing benchmarking systems for prompts
- You'll also work on training and fine-tuning smaller, more efficient models that can match the performance of LLMs at a fraction of the cost
- This includes creating labeled datasets (sometimes using prompts), conducting careful hyperparameter optimizations, and building automated training pipelines
- You'll also deploy and monitor these models in production, optimize their latency, and implement comprehensive offline/online metrics to track their performance
- Throughout all this work, you'll apply your deep understanding of the latest breakthroughs to build scalable, production-ready systems that turn cutting-edge ML experiments into reliable business value
- Q: What technologies do we use?
- LLM platforms: OpenAI, Anthropic, open-source models
- ML frameworks: PyTorch, Transformers, spaCy
- Search/Vector DBs: Elasticsearch, Pinecone, PostgreSQL
- MLOps tools: Weights & Biases, MLflow, Langfuse
- Infrastructure: Docker, Kubernetes, GCP
- Development: Python, Git, CI/CD
Our take
The integration of market data into the many functions of enterprise has been a consistent trend in SaaS markets for a number of years. Klue is taking a similar approach for teams looking to understand competitive landscapes.
The startup is uniquely attempting to create a new category of ‘competitive enablement software’. Whereas other software companies sought to fix a company’s business intelligence needs or content placement strategies, Klue brings all of these services together under the lens of competitive positioning.
Klue plans to find ways to reduce the burden of collecting intel and also automate insights. The company wants to introduce deeper integrations with enterprise tools like Slack, Salesforce, Gong, Highspot and Gainsights.
The biggest risk facing the company is that their product is currently more enterprise friendly, supported by customer specialists. For the software company to achieve true scale, they will want to democratise access to competitive enablement with a self-serve software available to small businesses.
Freddie
Company Specialist at Welcome to the Jungle
Insights
9% employee growth in 12 months
Company
Funding (last 2 of 6 rounds)
Mar 2023
$2m
GRANT
Dec 2021
$62m
SERIES B
Total funding: $88.8m
Company benefits
- We gather compensation benchmarking data across BC and Canada’s Tech Industry, and use that data to build a range for our current team and future talent based on skill, capabilities and potential
- We currently have extended health benefits
- Vacation. Unlimited Vacation. We want the team to prioritize wellness and avoid burnout. We want to also give individuals autonomy to choose how and when they take vacation. We understand and respect that everyone’s needs for time off are different, just like our team.
- Work-life integration: Hybrid work model, flexible working schedules, and a global team
Company HQ
Downtown Vancouver, Vancouver, BC
Leadership
Jason Smith
(CEO)Key roles include President at Vision Critical, a global market research software leader, and co-founder of Columbus Group, a digital agency pioneer acquired by TELUS. Advisor and consultant to early-stage companies. Stint as a VP at Electronic Arts.
Sarathay Naicker
(CTO)Prior to Klue, Sarathay rose to become the Chief Technologist at major cloud company, Sophos. Prior to that Sarathay was a senior developer at ActiveState until 2003.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 10 more jobs at Klue