Staff Generative AI/ML Engineer, MasterClass

• At least two years of experience working with LLMs - Fine Tuning Embedding and Causal models, distilling larger models into smaller models, etc
• Built datasets and solutions to evaluate model performance
• Proven experience in prompt engineering closed source models like GPT or OSS models like Mixtral to meet specific application needs
• Experience with pre-LLM NLP models like word2vec or GloVe models
• Experience working with CUDA architectures on single and multi-GPU compute environments
• Strong programming skills in Python and experience with frameworks and tools such as PyTorch, Huggingface SDKs, vLLM, etc
• Excellent communication skills to collaborate effectively across teams and with external partners

Desirable

• We're looking for a Staff Generative AI ML Engineer to join our team, helping to revolutionize how learning is crafted and delivered
• The Staff Generative AI ML Engineer will be instrumental in developing and deploying generative AI solutions that bring interactive learning experiences to life
• This role requires a mix of technical expertise in ML model development, prompt engineering, and strategic thinking to guide teams toward innovative AI applications
• Develop LLM-powered solutions using the various techniques that exist to reach product goals. These techniques could include prompt engineering, RAG-based systems, fine-tuning models (using techniques like SFT and DPO), etc
• Decide on the right model architecture for different requirements (e.g., using embeddings vs generation, Dense vs. Sparse MoE models, using pre-LLM architectures for specific use cases, etc.)
• Build evaluation systems that bring objectivity to model output quality and product experience aspects
• Design the right architecture based on product needs, balancing trade-offs like AI safety and latency
• Collaborate with cross-functional teams to integrate AI technologies seamlessly into the MasterClass platform, ensuring a personalized and impactful learning experience
• Be a mentor for the rest of the team to share best practices for AI product development
• Stay abreast of industry trends and advancements in generative AI and prompt engineering, incorporating best practices into our development lifecycle
• Engage with the AI research community, contributing to and applying the latest findings and technologies to our AI initiatives