Senior LLM Engineer, SmartAsset
$135-210k
+ Equity packages. Salary applicable to California, Colorado, Connecticut, Maryland, Nevada, Rhode Island, Washington, and New York City only & may differ for other locations
More information about location
Financial information and advice software
Open for applications
Financial information and advice software
201-500 employees
Open for applications
$135-210k
+ Equity packages. Salary applicable to California, Colorado, Connecticut, Maryland, Nevada, Rhode Island, Washington, and New York City only & may differ for other locations
More information about location
201-500 employees
Company mission
To help people make smart financial decisions.
Role
Who you are
- If you are passionate about building high-performance, scalable and reliable LLM service and products and have a track record of delivering solutions in AWS, we would love to hear from you
- Proven experience with Cloud Platforms (AWS, GCP or Azure)
- Hands-on experience working with Vector databases such as PineCone,Chroma, MongoDB and LanceDB
- Solid understanding of LLM concepts, such as prompt engineering, model fine-tuning, and transfer learning
- Familiarity with one popular LLM frameworks (e.g., OpenAI GPT, Hugging Face Transformers)
- Minimum 5 years of experience in Python programming, with a strong focus on developing LLM applications
- Proven experience with automation and scaling
- Experience building and/or integrating Voice AI solutions is a big plus
- Strong problem-solving skills and the ability to work independently
- Excellent communication skills, with the ability to present complex concepts to both technical and non-technical audiences
- Experience working in a cross-functional team and collaborating with stakeholders at various levels of the organization
- Bachelor's or Master's degree in Computer Science, Data Science, or a related field
- Experience with DevOps toolsets such as Terraform, Prometheus, etc. and Understanding of Docker,Kubernetes and CI/CD tools such as Gitlab CI,ArgoCD and Helm charts gets you bonus points
- Experience with web frameworks such as FastAPI, Django, Streamlit for building production ready applications gets you bonus points
What the job involves
- At SmartAsset you will join a team of data scientists, analysts and ML engineers that are at the forefront of AI/ML application for the company. You will have the opportunity to work cross-functionally with leaders from different teams (Marketing, Product, Sales, and Technology), and with our growing Data team
- We are seeking an experienced Senior LLM Engineer to join our team and develop high-performance, scalable and reliable LLM capabilities to power SmartAsset’s future. As a key member of our team, you will be responsible for designing and implementing the LLM service and supporting the logic, integrating the services as well as ensuring the performance scalability including handling hundreds of simultaneous users per second
- Design and implement a high-performance, scalable and reliable LLM service using Python, LLM Services (E.g., OpenAI, Antropic’s Claude,Meta’s LLaMA etc) and AWS technologies to power our applications and business needs including building services that can serve hundreds of concurrent users in a second
- Design and development of RAG pipelines
- Building or integrating Voice related AI technologies and productizing at scale
- Collaborate with business leaders to understand their needs and challenges, and identify potential LLM use cases
- Design, develop, and deploy custom LLM solutions tailored to the requirements of different divisions, including co-creating the prompts
- Collaborate with the Data Science team to understand how to build the LLM solution including fine tuning OpenAI models as necessary
- Implement software best practices to ensure seamless development, testing, and deployment of LLM solutions
- Stay up-to-date with the latest advancements in LLM technologies, and continuously explore ways to integrate these advancements into our existing solutions
- Develop and maintain comprehensive documentation, including technical specifications, user guides, and best practices
- Ensure data privacy and security compliance while working with LLMs
- Provide technical support and training to internal teams as needed
- Monitor LLM performance and make improvements to ensure acceptable response times based on use cases
- Collaborate with other developers and data scientists within the organization to share knowledge, ideas, and best practices
- Participate in code reviews and provide guidance to junior developers
Our take
Management of personal finance is typically a practice fraught with pitfalls and risks. Tools, information, and professional advice to help manage money have subsequently become invaluable resources to many Americans.
SmartAsset serves as a resource cache and marketplace connecting consumers with financial advisors. This focus on digital resources is proving savvy, as trends in the advisory profession indicate more consumers are turning online for support and professional help. SmartAsset's approach therefore allows it to reach more than 100 million people each month.
SmartAsset has managed to modernize the process of locating clients for advisors - previously a slow and labour-intensive process - while also materially assisting its large number of low-income customers. This saw SmartAsset’s revenue grow by ten times over four years, and it seems likely to capitalize on a growing number of US citizens looking to manage their financial planning digitally.
Freddie
Company Specialist at Welcome to the Jungle
Insights
-12% employee growth in 12 months
Company
Funding (last 2 of 6 rounds)
Jun 2021
$110m
SERIES D
Jun 2018
$28m
SERIES C
Total funding: $160.5m
Company benefits
- All roles at SmartAsset are currently and will remain remote - flexibility to work from anywhere in the contiguous US
- Medical, Dental, Vision - multiple packages available based on your individualized needs
- Life/AD&D Insurance - basic coverage at 100% company paid, additional supplemental available
- Short-term and Long-term Disability
- FSA: Medical and Dependant Care
- 401K
- Equity packages for each role
- Time Off: PTO, 3 Month Paid Parental Leave, Secondary Caregiver Leave
- EAP (Employee Assistance Program)
- Employee Resource Groups supporting our underrepresented communities
- Pet Insurance
- Home Office Stipend
Company HQ
Murray Hill, New York, NY
Leadership
Michael Carvin
(Founder & CEO)Michael's expertise is in financial decision-making. In the pre-SmartAsset days, Michael worked in private equity. They spent their time using financial models to help companies understand how to make better decisions.
Share this job
View 16 more jobs at SmartAsset