Research Scientist, Twelve Labs
Public Sector
More information about location
Video intelligence platform for enterprises
Be an early applicant
Video intelligence platform for enterprises
101-200 employees
Be an early applicant
More information about location
101-200 employees
Company mission
To set a new standard and unlock the full potential of video for the word.
Role
Who you are
- Strong research experience in one or more of: deep learning, computer vision, multimodal representation learning, temporal video understanding, or neural networks
- Hands-on experience with model fine-tuning, supervised fine-tuning (SFT), or domain adaptation at scale
- Experience leading or contributing to research projects for government, DoD, or Intelligence Community programs - including applied research, model development, or technical delivery in mission-driven environments
- Proficiency in Python and PyTorch
- Comfort working within constrained or regulated compute environments
- Active Top Secret clearance or ability to obtain
- PhD or Master's in Computer Science, Mathematics, or related field
Desirable
- Active TS/SCI clearance
- Experience with government deployment requirements (FedRAMP, FIPS, air-gapped networks)
- Background in video understanding or video-language models
- Publications in top conferences (CVPR, NeurIPS, etc.)
What the job involves
- As a Research Scientist on the Public Sector team, you play a major role in bringing TwelveLabs' video AI capabilities - including our multimodal foundation models - to mission-critical government applications
- This role focuses on applying our video intelligence technology to classified and government-specific use cases, including model training, finetuning and evaluation grounded in operational requirements
- You will be the dedicated research scientist for the Public Sector team, bridging TwelveLabs' cutting-edge multimodal AI research and the unique requirements of U.S. federal, defense, and intelligence community customers
- This is an opportunity to have direct operational impact and define major components of this applied science practice from the ground up
- Adapt TwelveLabs' video understanding and multimodal models for government-specific use cases (defense, intelligence analysis, federal records management)
- Run training and fine-tuning experiments on cutting edge GPU infrastructure
- Develop supervised fine-tuning pipelines tailored to government-specific datasets and annotation workflows
- Design rigorous evaluation frameworks, including domain-specific benchmarks and operational performance metrics, that are tailored to public sector requirements
- Work closely with Solutions Engineering and the engineering team to translate customer requirements into technical implementations
Our take
Developing an algorithm that can understand text or images is (relatively) straightforward. However, the challenge escalates when it comes to understanding video, where these modes merge with audio, and context becomes much harder to grasp.
Twelve Labs has developed a machine learning solution that tackles this challenge by making the inner content of videos both indexable for developers and highly searchable for users. This technology could prove immensely valuable, with use cases extending far beyond simple searchability for end users. It could be employed for more accurate monitoring of community guidelines on social media, enterprise knowledge searches, and a deeper understanding of the value of video content.
With funding under its belt, Twelve Labs is set for rapid growth. The investment will drive R&D, nearly double its workforce, and advance its video understanding technology. As it expands, Twelve Labs is well-positioned to lead the future of multimodal AI and revolutionize how organizations extract values from video content.
Steph
Company Specialist at Welcome to the Jungle
Company
Funding (last 2 of 7 rounds)
Oct 2025
$3m
EARLY VC
Dec 2024
$30m
EARLY VC
Total funding: $110.2m
Company HQ
Northern Waterfront, San Francisco, CA
Leadership
Jae Lee
(Co-Founder & CEO)After Interning as a Software Engineer at Samsung and Amazon, they joined the Republic of Korea's Cyber Operations Command as a Lead Data Scientist. Co-founded Twelve Labs after this period of military service.
Aiden Lee
(Co-Founder & CTO)Previously Interned at Korea Advanced Institute of Science and Technology (KAIST) as a Deep Learning Researcher. Completed their National Defense duty as an AI & ML Engineer in the Cyber Operations Command.
Dave Chung
(Co-Founder & GTM of Asia-Pacific)Previously a Project Team Lead at the Institute of East and West Studies (IEWS) at Yonsei University, focusing on the planning and development of the Korean Web 3.0 ecosystem (Funded by the Ministry of ICT).
Soyoung Lee
(Co-Founder & Head of Go-to-Market)Previously worked in Risk Assurance for PricewaterhouseCoopers in Seoul before co-founding Twelve Labs.
Share this job
View 15 more jobs at Twelve Labs