Research Scientist/Engineer, Luma AI

Multimodal Capabilities

$200-300k

+ Offers Equity

Python

PyTorch

Junior, Mid and Senior level

Remote from US

3D AI design platform

Be an early applicant

3D AI design platform

21-100 employees

B2BArtificial IntelligenceAugmented RealitySaaSAPI

Be an early applicant

$200-300k

+ Offers Equity

Python

PyTorch

Junior, Mid and Senior level

Remote from US

21-100 employees

B2BArtificial IntelligenceAugmented RealitySaaSAPI

Company mission

To enable everyone to capture and experience the world in lifelike 3D.

Job

Company

Role

Who you are

Strong programming skills in Python and PyTorch
Experience with multimodal data processing pipelines and large-scale dataset curation
Understanding of computer vision, audio processing, and / or natural language processing techniques
(Preferred) Expertise working with interleaved multimodal data
(Preferred) Hands-on experience with Vision Language Models, Audio Language Models, or generative video models

What the job involves

The Multimodal Capabilities team at Luma focuses on unlocking advanced capabilities in our foundation models through strategic research into multimodal understanding and generation
This team tackles fundamental research questions around how different modalities can be combined to enable new behaviors and capabilities, working on the open-ended challenges of what makes multimodal AI systems truly powerful and versatile
Collaborate with the Foundation Models team to identify capability gaps and research solutions
Design datasets, experiments, and methodologies to systematically improve model capabilities across vision, audio, and language
Develop evaluation frameworks and benchmarking approaches for multimodal AI capabilities
Create prototypes and demonstrations that showcase new multimodal capabilities

Our take

Luma AI is an AI-based API platform that harnesses the power of NeRF (neural radiance field) technology to create 3D models of any object through its mobile application. The generated 3D models can then be used for a range of digital uses, changing how people share memories, search for products, and reimagining internet and gaming spaces.

By utilizing NeRF technology, the company can bypass traditional programming requirements such as teams of 3D artists or expensive photogrammetry setups, thus democratizing 3D creation by making it accessible to anyone with the app.

While Luma AI faces a growing number of competitors in the space, it will need to focus on advancing and refining its technology to fully compete with AI giants such as OpenAI. However, the company’s focus on its specific area of the market certainly allows it to see vast growth opportunities.

Freddie

Company Specialist at Welcome to the Jungle

Company

Funding (last 2 of 4 rounds)

Dec 2024

$20m

LATE VC

Jan 2024

$43m

SERIES B

Total funding: $87.3m

Company benefits

Equity grant to reflect the incredible value you will bring to Luma, with annual refreshes
Full health, dental, and vision coverage
Latest and greatest gear
Stipends towards wellness, house cleaner, and phone/internet
Unlimited paid time off with 12 days minimum
Unlimited sick days

Company HQ

West Oakland, Oakland, CA

Leadership

Amit Jain

(Co-Founder)

Previously worked at Apple as a Computer Vision, Cameras, and Systems Engineer. Founder and former Lead Developer of Cultured Pixel.

Alex Y.

(Co-Founder)

Initially served as a Research Scientist at the company. Former Research Assistant at UC Berkeley. Also held Internships at Adobe and Google.

Share this job

View 27 more jobs at Luma AI