Senior LLM Engineer, SmartAsset

$135-210k

+ Equity packages. Salary applicable to California, Colorado, Connecticut, Maryland, Nevada, Rhode Island, Washington, and New York City only & may differ for other locations

MongoDB

AWS

Docker

Kubernetes

GCP

Python

Django

Terraform

Azure

Prometheus

FastAPI

Senior and Expert level

Remote from US

More information about location

Financial information and advice software

Job no longer available

Financial information and advice software

201-500 employees

FintechB2CMarketplacePersonal financeSaaS

Job no longer available

$135-210k

+ Equity packages. Salary applicable to California, Colorado, Connecticut, Maryland, Nevada, Rhode Island, Washington, and New York City only & may differ for other locations

MongoDB

AWS

Docker

Kubernetes

GCP

Python

Django

Terraform

Azure

Prometheus

FastAPI

Senior and Expert level

Remote from US

More information about location

201-500 employees

FintechB2CMarketplacePersonal financeSaaS

Company mission

To help people make smart financial decisions.

Job

Company

Role

Who you are

If you are passionate about building high-performance, scalable and reliable LLM service and products and have a track record of delivering solutions in AWS, we would love to hear from you
Proven experience with Cloud Platforms (AWS, GCP or Azure)
Hands-on experience working with Vector databases such as PineCone,Chroma, MongoDB and LanceDB
Solid understanding of LLM concepts, such as prompt engineering, model fine-tuning, and transfer learning
Familiarity with one popular LLM frameworks (e.g., OpenAI GPT, Hugging Face Transformers)
Minimum 5 years of experience in Python programming, with a strong focus on developing LLM applications
Proven experience with automation and scaling
Experience building and/or integrating Voice AI solutions is a big plus
Strong problem-solving skills and the ability to work independently
Excellent communication skills, with the ability to present complex concepts to both technical and non-technical audiences
Experience working in a cross-functional team and collaborating with stakeholders at various levels of the organization
Bachelor's or Master's degree in Computer Science, Data Science, or a related field
Experience with DevOps toolsets such as Terraform, Prometheus, etc. and Understanding of Docker,Kubernetes and CI/CD tools such as Gitlab CI,ArgoCD and Helm charts gets you bonus points
Experience with web frameworks such as FastAPI, Django, Streamlit for building production ready applications gets you bonus points

What the job involves

At SmartAsset you will join a team of data scientists, analysts and ML engineers that are at the forefront of AI/ML application for the company. You will have the opportunity to work cross-functionally with leaders from different teams (Marketing, Product, Sales, and Technology), and with our growing Data team
We are seeking an experienced Senior LLM Engineer to join our team and develop high-performance, scalable and reliable LLM capabilities to power SmartAsset’s future. As a key member of our team, you will be responsible for designing and implementing the LLM service and supporting the logic, integrating the services as well as ensuring the performance scalability including handling hundreds of simultaneous users per second
Design and implement a high-performance, scalable and reliable LLM service using Python, LLM Services (E.g., OpenAI, Antropic’s Claude,Meta’s LLaMA etc) and AWS technologies to power our applications and business needs including building services that can serve hundreds of concurrent users in a second
Design and development of RAG pipelines
Building or integrating Voice related AI technologies and productizing at scale
Collaborate with business leaders to understand their needs and challenges, and identify potential LLM use cases
Design, develop, and deploy custom LLM solutions tailored to the requirements of different divisions, including co-creating the prompts
Collaborate with the Data Science team to understand how to build the LLM solution including fine tuning OpenAI models as necessary
Implement software best practices to ensure seamless development, testing, and deployment of LLM solutions
Stay up-to-date with the latest advancements in LLM technologies, and continuously explore ways to integrate these advancements into our existing solutions
Develop and maintain comprehensive documentation, including technical specifications, user guides, and best practices
Ensure data privacy and security compliance while working with LLMs
Provide technical support and training to internal teams as needed
Monitor LLM performance and make improvements to ensure acceptable response times based on use cases
Collaborate with other developers and data scientists within the organization to share knowledge, ideas, and best practices
Participate in code reviews and provide guidance to junior developers

Our take

Management of personal finance is typically a practice fraught with pitfalls and risks. Tools, information, and professional advice to help manage money have subsequently become invaluable resources to many Americans.

SmartAsset serves as a resource cache and marketplace connecting consumers with financial advisors. This focus on digital resources is proving savvy, as trends in the advisory profession indicate more consumers are turning online for support and professional help. SmartAsset's approach, therefore, allows it to reach more than 100 million people each month.

SmartAsset has managed to modernise the process of locating clients for advisors - previously a slow and labour-intensive process - while also materially assisting its large number of low-income customers. This saw SmartAsset’s revenue grow by ten times over four years, and it seems likely to capitalise on a growing number of US citizens looking to manage their financial planning digitally.

Freddie

Company Specialist at Welcome to the Jungle

Insights

Top investors

-12% employee growth in 12 months

Glassdoor (4.1)

Company

Funding (last 2 of 7 rounds)

Jun 2021

$110m

SERIES D

Jun 2018

$28m

SERIES C

Total funding: $160.7m

Company benefits

All roles at SmartAsset are currently and will remain remote - flexibility to work from anywhere in the contiguous US
Medical, Dental, Vision - multiple packages available based on your individualized needs
Life/AD&D Insurance - basic coverage at 100% company paid, additional supplemental available
Short-term and Long-term Disability
FSA: Medical and Dependant Care
401K
Equity packages for each role
Time Off: PTO, 3 Month Paid Parental Leave, Secondary Caregiver Leave
EAP (Employee Assistance Program)
Employee Resource Groups supporting our underrepresented communities
Pet Insurance
Home Office Stipend

Company HQ

Murray Hill, New York, NY

Leadership

Michael Carvin

(Founder & CEO)

Michael's expertise is in financial decision-making. In the pre-SmartAsset days, Michael worked in private equity. They spent their time using financial models to help companies understand how to make better decisions.

Share this job