Senior Engineering Manager, Pryon

Accelerated Compute Memory Systems

Salary not provided

AWS

Kubernetes

GCP

HTML

Python

Kafka

Azure

RabbitMQ

JSON

Golang

Expert level

Boston

Chicago

New York

San Francisco Bay Area

More information about location

AI-enhanced enterprise knowledge management

Open for applications

AI-enhanced enterprise knowledge management

101-200 employees

B2BArtificial IntelligenceEnterpriseAnalyticsMachine Learning

Open for applications

Salary not provided

AWS

Kubernetes

GCP

HTML

Python

Kafka

Azure

RabbitMQ

JSON

Golang

Expert level

Boston

Chicago

New York

San Francisco Bay Area

More information about location

101-200 employees

B2BArtificial IntelligenceEnterpriseAnalyticsMachine Learning

Company mission

To help enterprises close knowledge gaps, improve employee productivity, and enhance customer experiences.

Job

Company

Role

Who you are

10+ years in software engineering, 5+ years in management roles with large-scale AI/ML systems and infrastructure
Expert-level proficiency in Python and Golang, with 5+ years building production distributed systems
Experience with orchestration frameworks (Kubernetes, Ray, Dask)
Proficiency with vector databases (Pinecone, Weaviate, Qdrant, or similar)
Experience with message queuing systems (Kafka, Pulsar, RabbitMQ)
In-depth knowledge and hands on experience building scalable distributed architectures and high-performance compute systems
Proven experience in multimodal ingestion pipelines within RAG platforms
Direct experience in designing, fine-tuning, and optimizing LLMs for ingestion and retrieval workloads
Previous success managing engineering teams delivering production-grade, HPC-scale RAG systems
Deep understanding of infra domains: compute, storage, networking, observability, security, disaster recovery, and cost management
Familiarity with HPC cluster management softwares such as Slurm
Familiarity with cloud platforms (AWS, Azure, GCP) and/or on-prem datacenter operations

What the job involves

Pryon is building one of the industry's most ambitious AI infrastructure platforms: a petabyte-scale ingestion and inference system powering mission-critical government and enterprise deployments
We need an Engineering Manager with deep HPC expertise—someone who can teach, not be taught
You’ll lead the technical team building our ingestion, retrieval, and inference layers, ensuring scalability, reliability, and compliance
Build and lead a team delivering the ingestion, retrieval, and inference layers that will power mission-critical deployments for commercial and federal entities with millions of public users
Architect and deliver horizontally scalable, fault-tolerant systems capable of handling billions of documents and burst loads of 30K+ concurrent users
Guide implementation of multimodal ingestion pipelines (eg PDF, HTML, DOCX, JSON, XML, PPTX, TIFF)
Oversee design and optimization of LLM-driven data ingestion and retrieval workflows
Own optimization and tuning of high-throughput, low-latency production environments via async orchestration frameworks
Establish performance benchmarking, compliance frameworks, and automated testing for scale
You will balance technical leadership with people leadership, guiding architecture decisions, while also scaling and mentoring a high-performing team
Collaborate cross-functionally with Product, Executive Leadership, and Customer Success

Our take

Theknowledge gap continues to drain time, money and momentum from organisations of all sizes. Pryon tackles this head-on by turning complex enterprise content into interactive knowledge experiences, delivering fast, accurate answers for internal IT teams, customer contact centres and AI-powered chatbots alike.

Founded by the original inventors of the natural language processing technology behind Amazon's Alexa, Pryon brings rae technical credibility to the enterprise AI space. This pedigree boasts a platform designed not just to sound intelligent, but to truly understand and surface the right information when it matters most.

That momentum is reflected in Pryon's recent progress too. As the company has raised some significant funding, earned recognition from the KMWorld AI50 for Knowledge Management, and was named "AI Data Management Solution of the Year" for its pioneering enterprise AI memory layer technology. Alongside this, Pryon has rolled out major platform updates that significantly reduce model training times while improving accuracy, further strengthening its position as a standout player in enterprise AI.

Kirsty

Company Specialist at Welcome to the Jungle

Company

Company HQ

East Raleigh, Raleigh, NC

Leadership

Chris Mahl

(CEO, COO & President)

Previously, Chris was an Executive VP & Chief Revenue Officer at Opentrons labworks. He is also the co-author of Botkeeper for Dummies.

Salary benchmarks

We don't have enough data yet to provide salary benchmarks for this role.

Submit your salary to help other candidates with crowdsourced salary estimates.

Share this job

View 2 more jobs at Pryon