Senior C++ Software Engineer, Voltron Data
Data Engines
$171-210k
+ Equity
Enterprise support for Apache Arrow
Open for applications
Enterprise support for Apache Arrow
101-200 employees
Open for applications
$171-210k
+ Equity
101-200 employees
Company mission
To bring the best of open-source together and build bridges across the data analytics ecosystem with Apache Arrow.
Role
Who you are
- Experience with data processing engines or frameworks
- Experience in distributed and multi-threaded systems
- Experience in HW resource management including memory and thread pools
- Working with SQL and non-SQL systems and their computational abstractions
- Developing in C++, especially using modern C++
- Developing for multiple types of hardware (i.e. CPU, GPU)
What the job involves
- We are looking for a highly motivated Senior C++ Software Engineer for Data Engines, you’ll have the opportunity to work directly on Theseus, the accelerator-native data processing engine built for composability
- You will work closely with Voltron Data development teams to build, optimize and maintain our data execution framework, adding new features, making it run faster and more scalable and even contributing to new core architectural components that will enable the engine to run at Petabyte scale
- Upon Joining:
- Spending time learning about the Apache Arrow, the compute primitives we use in Theseus, the query parser and optimizer and other foundational components
- Diving into the data processing engine architecture, how all the different components interact with each other and how data flows through the compute graph
- Understanding memory management mechanics, including spilling memory from GPU, to Host and Disk
- Learning and embracing the software development culture at Voltron Data
- Within a month:
- Profiling single node and distributed queries executions and analyzing the engine telemetry to better understand how the engine works and how to solve distributed engine issues
- Diving deep into the various distributed relational algebra algorithms to understand how they work and how they can be improved
- Working with the team on fixing bugs, implementing simple optimizations or code refactoring projects
- Within 6 months:
- Building new relational algebra components to expand SQL coverage or DataFrame functionality coverage
- Making small improvements to more sophisticated engine components such as resource management, task scheduling, and fault tolerance
- Within 12 months:
- Proposing and implementing core architecture improvements to the engine
- Working on challenging tasks such as language agnostic user defined functions, multi-query concurrency, and multi-tenancy
- Integrating the engine with other components and features developed by other teams in the company to provide enterprise grade customer experiences
Our take
Voltron Data offers enterprise support to companies using the increasingly popular open source Apache Arrow software development platform. Its flagship service is designed specifically for companies that wish to leverage the power of Apache Arrow, but are unable or unwilling to handle the intricacies of Arrow.
The strong links to Apache Arrow are easy to explain, as co-founders Wes McKinney and Joshua Patterson were heavily involved in the creation and rise in popularity of the Apache Arrow project. In a way, a major part of Voltron Data’s remit is to promote the software development platform, while making it more palatable and user-friendly for customers.
With the likes of Google and Microsoft now adopting Apache Arrow into their own projects, Voltron Data has been able to attract incredible amounts of investment, despite only launching its first commercial product in early 2022. Voltron Data has focused on growing all aspects of its team and acquired real-time AI platform startup Claypot AI in 2024, indicating that it's maintaining its momentum.
Kirsty
Company Specialist at Welcome to the Jungle
Insights
1% employee growth in 12 months
Company
Funding (2 rounds)
Feb 2022
$88m
SERIES A
Feb 2022
$22m
SEED
Total funding: $110m
Company benefits
- Work from Anywhere - Payroll and Benefits in 150+ Countries
- Unlimited PTO
- Medical, Dental, and Vision
- Retirement [USA Only]
- Home Office Budget
- Continuing Education Budget
Company values
- Continuous Improvement: Learning new skills and establishing bold goals in pursuit of personal aspirations.
- Inclusivity: Inviting and celebrating different perspectives, because we build with and for everyone.
- Independence: Supporting autonomy across all teams and encouraging confidence in all they do
Company HQ
Old Mountain View, Mountain View, CA
Articles
Leadership
Joshua Patterson
(CEO)Former Data Science Principal at Accenture Technology Labs, former Senior Director for Rapids.ai, an end to end platform for accelerating data science on NVIDIA GPU.
Wes McKinney
(Senior Advisor)Before co-founding Voltron Data, they were a part of the Project Management Committee for the creation of the Apache Arrow project. Creator of the Python pandas project, which made Python the go-to language for data science, machine learning and AI.
Share this job
View 1 more job at Voltron Data