Member of Technical Staff, Captions
Large Generative Models
$160-250k
Offers Equity
More information about location
Office located in Union Square, NY
AI-powered creative studio
Posted today
AI-powered creative studio
21-100 employees
Posted today
$160-250k
Offers Equity
More information about location
Office located in Union Square, NY
21-100 employees
Company mission
To empower our customers, regardless of background or experience, with the ability to bring their vision to life in seconds.
Role
Who you are
- Master's or PhD in Computer Science, Machine Learning, or related field
- Track record of research contributions at top ML conferences (NeurIPS, ICML, ICLR)
- Demonstrated experience implementing and improving upon state-of-the-art architectures
- Deep expertise in generative modeling approaches (diffusion, autoregressive, VAEs, etc.)
- Strong background in optimization techniques and loss function design
- Experience with empirical scaling studies and systematic architecture research
- Strong proficiency in modern deep learning tooling (PyTorch, CUDA, Triton, FSDP, etc.)
- Experience training diffusion models with 10B+ parameters
- Experience with very large language models (200B+ parameters) is a plus
- Deep understanding of attention, transformers, and modern multimodal architectures
- Expertise in distributed training systems and model parallelism
- Proven ability to implement and improve complex model architectures
- Track record of systematic empirical research and rigorous evaluation
- Ability to write clean, modular research code that scales
- Strong software engineering practices including testing and code review
- Experience with rapid prototyping and experimental design
- Strong analytical skills for debugging model behavior and training dynamics
- Facility with profiling and optimization tools
- Track record of bringing research ideas to production
- Experience maintaining high code quality in a research environment
What the job involves
- Captions is seeking an exceptional Research Engineer (MOTS) to advance the state-of-the-art in large-scale multimodal video diffusion models
- You'll conduct novel research on generative modeling architectures, develop new training techniques, and scale models to billions of parameters
- As a key member of our ML Research team, you'll work at the cutting edge of multimodal generation while building systems that enable natural, controllable video creation
- We're already training large-scale models with demonstrated product impact, and we're excited to continue expanding the scope and capabilities of our research
- We're especially excited about pushing the boundaries of audio-video generation, with a focus on realistic and charismatic human behavior that enables natural storytelling and creative iteration
- Our models power creative tools used by millions of creators, and we're tackling fundamental challenges in how to generate compelling human motion, expression, and speech
- You will design and implement novel architectures for large-scale video and multimodal diffusion models
- Develop new approaches to multimodal fusion, temporal modeling, and video control
- Research temporal video editing techniques and controllable generation
- Research and validate scaling laws for video generation models
- Create new loss functions and training objectives for improved generation quality
- Drive rapid experimentation with model architectures and training strategies
- Validate research directly through product deployment and user feedback
- Train and optimize models at massive scale (10s-100s of billions of parameters)
- Develop sophisticated distributed training approaches using FSDP, DeepSpeed, Megatron-LM
- Design and implement model surgery techniques (pruning, distillation, quantization)
- Create new approaches to memory optimization and training efficiency
- Research techniques for improving training stability at scale
- Conduct systematic empirical studies of architecture and optimization choices
- Advance state-of-the-art in video model architecture design and optimization
- Develop new approaches to temporal modeling for video generation
- Create novel solutions for multimodal learning and cross-modal alignment
- Research and implement new optimization techniques for generative modeling and sampling
- Design and validate new evaluation metrics for generation quality
- Systematically analyze and improve model behavior across different regimes
- You'll work directly alongside our research and engineering teams in our NYC office. We've intentionally built a culture where technical innovation and research excellence are highly valued - your success will be measured by your contributions to improving our models and advancing the field, not by your ability to navigate politics
- We're a team that loves diving deep into complex technical problems and emerging with practical breakthroughs
Our take
As AI integration grows in creative fields, concerns arise about the future of professions like writing and design. However, Captions has transformed these anxieties into opportunities by harnessing AI technology to streamline the creative workflow.
By automating tasks in music, graphic design, and video production, Captions allows users to generate compelling content directly from their mobile devices. With a focus on meeting the rising demand for captivating digital content, its subscription-based model covers key processes like captioning, editing, dubbing, and soundtracking.
Captions' innovative approach has garnered attention, securing funding from tech giants like Sequoia Capital and Andreessen Horowitz. This investment will grow the company's machine learning team and invest further into in-house research efforts and technical infrastructure.
Freddie
Company Specialist at Welcome to the Jungle
Company
Funding (2 rounds)
Jul 2024
$60m
SERIES C
Jun 2023
$25m
SERIES B
Total funding: $85m
Company benefits
- Comprehensive medical, dental, and vision plans
- Anything you need to do your best work
- We’ve done team off-sites to places like Paris, London, Park City, Los Angeles, and Nashville with more planned in the future
Company HQ
Civic Center, New York, NY
Articles
Leadership
Gaurav Misra
(CEO)Previously the Head of Design Engineering at Snap Inc, Senior Software Engineer at Localytics, Software Development Engineer at Microsoft, and Software Engineer at Lattice Engines.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 14 more jobs at Captions