Applied LLM Software Engineer, Prophet Security
ML Security, Founding Team
Office located in Palo Alto, CA
AI for security operations
Open for applications
AI for security operations
1-20 employees
Open for applications
Office located in Palo Alto, CA
1-20 employees
Company mission
To radically transform how security teams operate, automating data analysis in ways that actually work.
Role
Who you are
- Your prior experience in LLM fine-tuning, evaluation, and productionization will directly enhance our product capabilities and user experience
- Experience: Proven track record of shipping LLM-powered products or features
- Technical Expertise: Deep understanding of LLMs, fine-tuning techniques, prompt engineering, model evaluation, and safety considerations. Proficient in Python
- Research Mind: Passionate about LLM research, with a demonstrated ability to translate cutting-edge, research concepts into practical applications
- Architectural Thinking: Experience designing and scaling ML systems, with a keen eye for optimizing performance and resource utilization
- In-depth Prompting Techniques: Familiarity with Chain-of-Thought (CoT), Tree of Thoughts (ToT), ReAct, and other advanced prompting strategies
- Knowledge Synthesis: Experience with Retrieval-Augmented Generation (RAG) or similar techniques
- Problem-Solving: Outstanding analytical and problem-solving skills, able to tackle complex challenges in the LLM domain
- Communication & Collaboration: Excellent communication skills to collaborate effectively with diverse stakeholders and translate technical concepts for non-technical audiences
Desirable
- Experience building custom frameworks to streamline LLM interactions (similar to LangChain, LlamaIndex, or Guidance)
- Familiarity with agentic architecture concepts and the role of LLMs in enabling agent-based systems
- Publications or Open-Source Contributions related to LLMs
- Experience with Go
What the job involves
- We are looking for talented a AI/ML Engineer to join as a core member of our founding engineering team, where your contributions will significantly shape our architecture and key technical decisions
- As our AI/ML Engineer, you will be working on our efforts in developing artificial intelligence and machine learning capabilities that drive our product, including work on the integration and optimization of large language models (LLMs) and other AI/ML technologies into our product
- LLM Integration & Feature Development: Lead the design and development of innovative features using LLMs, pushing the boundaries of Prophet's capabilities
- Prompt Engineering & Optimization: Master the art of prompt engineering, fine-tuning, and in-context learning to maximize the potential of LLMs within our product
- Model Evaluation & Benchmarking: Develop a model evaluation framework, extending benchmarks like MT-Bench to ensure the robustness and performance of our LLM implementations
- Safety & Guardrails: Establish comprehensive guardrails for safe and responsible use of LLMs, proactively mitigating potential risks
- Architectural Design: Shape the architecture of our LLM solutions, making strategic decisions on model configurability, portability, and cost (e.g., one large model vs. multiple task-specific models)
- Research & Development: Stay at the forefront of LLM research, identifying groundbreaking techniques and tools to enhance our product offerings
Our take
Many security teams struggle to keep pace with the evolution of the cyberthreat landscape, putting data and operations at risk. Part of the problem is in the traditional way threats are reported and addressed, which leaves room for critical alerts to fall through the cracks or be investigated too late.
Prophet Security hopes to help combat this, with an AI assistant for security analysts. The basic premise is that Prophet transforms hard-to-understand alerts into clear explanations with evidence included, all delivered in plain English. It also prioritises critical alerts and provides analysts with explicit next steps. With this, security teams can increase efficiency and invest their time where it is most needed.
By automating much of the alert-response process, Prophet Security positions itself as a vital tool for security teams seeking to become more robust. It has raised substantial funds that will support it in its early business development, having emerged from stealth in 2024.
Freddie
Company Specialist at Welcome to the Jungle
Company
Funding (1 round)
Apr 2024
$11m
SEED
Total funding: $11m
Company HQ
West Atherton, Atherton, CA
Leadership
Kamal Shah
(CEO)Investor and Advisor for Clari. Former VP of Cloud Platforms at Red Hat, and President and CEO of StackRox. Has also worked in Product and Marketing, and was an Entrepreneur-in-Residence at Sequoia Capital.
Vibhav Sreekanti
(CTO)Former Senior Director of Software Engineering at Red Hat. Was VP of Engineering at StackRox, Senior Director of Software Development at Oracle, and Co-founder and CTO at Defend7.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 2 more jobs at Prophet Security