Performance Engineer, WRITER
+ Stock Options
Enterprise AI platform for agentic work
Job no longer available
Enterprise AI platform for agentic work
501-1000 employees
Job no longer available
+ Stock Options
501-1000 employees
Company mission
To bring generative AI to the enterprise.
Role
Who you are
- Bachelor's degree in Computer Science, Engineering, or a related field (Master's preferred)
- 10+ years of experience in performance engineering, with a focus on large-scale distributed systems
- 2+ years of experience working with AI/ML technologies
- Proven experience in performance testing, profiling, and analysis of complex software systems
- Deep understanding of NLP architectures, training, and inference
- Experience with vector databases and search technologies
- Experience with cloud computing platforms (e.g., AWS, Azure, GCP) and containerization technologies (e.g., Docker, Kubernetes)
- Strong programming skills in python
- Experience with performance analysis tools (e.g., profilers, debuggers, monitoring tools)
- Strong analytical and problem-solving skills
- Excellent communication and collaboration skills
- Ability to work in a fast-paced and dynamic environment
- Passion for AI and a desire to push the boundaries of performance engineering
What the job involves
- Writer is seeking a highly skilled and motivated Principal Performance Engineer to lead the performance optimization of our cutting-edge Generative AI technology stack
- This role is critical in ensuring the scalability, efficiency, and reliability of our Large Language Models (LLMs) and Retrieval Augmented Generation (RAG) systems
- You will be a key driver in identifying and resolving performance bottlenecks, optimizing resource utilization, and ensuring a seamless user experience
- You will work closely with our AI research, software engineering, and infrastructure teams to deliver world-class AI solutions
- Define and implement performance engineering strategies for our Generative AI full stack, including services, application, LLMs, RAG pipelines, and related infrastructure
- Lead performance testing, profiling, and analysis efforts to identify and resolve performance bottlenecks
- Establish and maintain performance benchmarks and SLAs for critical AI services
- Provide technical leadership and mentorship to performance engineering team members
- Analyze and improve LLM inference performance, including latency, throughput, and resource utilization
- Develop and implement strategies for LLM capacity planning and scaling
- Collaborate with AI researchers to evaluate and improve LLM model architectures and training techniques for performance
- Optimize LLM inference through techniques such as quantization, distillation, and optimized kernel implementation
- Design and implement performance tests for RAG pipelines, including retrieval, ranking, and generation components
- Identify and optimize performance bottlenecks in RAG systems, such as database queries, vector search, and document processing
- Evaluate and optimize RAG system architectures for scalability and efficiency
- Tune vector databases for optimal recall and latency
- Collaborate with infrastructure teams to optimize hardware and software configurations for AI workloads
- Evaluate and recommend new technologies and tools for performance monitoring and analysis
- Develop and maintain performance dashboards and reports to track key metrics
- Optimize GPU utilization and memory management for LLM inference
- Work closely with AI researchers, software engineers, and product managers to ensure performance requirements are met
- Communicate performance findings and recommendations to stakeholders at all levels
- Stay up-to-date with the latest developments in Generative AI and performance engineering
Our take
AI-assisted writing tools have taken off over recent years. With the likes of high-exposure company Grammarly accelerating adoption of such tools, a flurry of startups have appeared to offer their own takes. WRITER’s angle is to leverage AI as a means of standardizing and scaling both content and communications for business teams. The tool offers auto filling and inline suggestions that keep content aligned with pre-determined company language and style guides.
This branded fine-tuning function distinguishes it from full copy-generation competitors, as well as from Grammarly itself, which is a more generalist copyediting tool. It subsequently caters to major enterprise clients looking to maintain standards across multiple and sprawling teams, and the company has managed to net major clients like Deloitte, Twitter, UiPath, and Accenture.
While AI-related buzz remains solidly around generative AI's like ChatGPT and Bard, WRITER's narrow target market - in which it has already found success - supplies plenty of scope to grow, as AI copyediting tools look set to rapidly become content industry standard. With continued new launches and updates to its offerings, as well as an impressive $200 million Series C awarded in 2024, the company is well-placed for further success.
Steph
Company Specialist at Welcome to the Jungle
Insights
229% employee growth in 12 months
Company
Funding (last 2 of 4 rounds)
Nov 2024
$200m
SERIES C
Sep 2023
$100m
SERIES B
Total funding: $326m
Company benefits
- Health: Selection of employer-covered medical plans, plus dental, vision, life insurance, and FSA.
- Family-friendly: Competitive parental leave policy, working parents can truly own their schedules.
- Hybrid culture: We’re built around a mix of in office collaboration and remote work when needed.
- Finance: Company stock options, plus a 401k plan with employer contributions.
- Growth: Learning and development stipend and generous PTO.
- SF/NY/London office space: Three beautiful sunny offices in three incredibly exciting cities.
Company HQ
Union Square, San Francisco, CA
Leadership
May Habib
(Co-Founder & CEO)Harvard economics graduate, who was previously VP of sovereign wealth fund Mubadala Development Company, and a global shaper at the World Economic Forum. Also co-founded Qordoba.
Waseem Alshikh
(Co-Founder & CTO)Previously co-founded CloudAppers, then served as CTO at iMENA. Subsequently co-founded AI content editor Qordoba.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 49 more jobs at WRITER