Senior Software Engineer, Confluent
Flink Runtime
$177.9-209k
+ Equity
Data streaming platform
Be an early applicant
Data streaming platform
1001+ employees
Be an early applicant
$177.9-209k
+ Equity
1001+ employees
Company mission
Founded by the team that built Apache Kafka, their mission is to make managing Kafka easy.
Role
Who you are
- 3-5 years of software development
- Hands-on experience in designing and development of complex distributed systems especially in the Context of Apache Flink
- Implement features in the area of distribution and coordination of distributed systems like Apache Flink
- Strong problem-solving skills, capable of translating complex requirements into effective solutions
- Excellent communication skills, both written and verbal, with the ability to collaborate across teams
- Familiarity with Flink or similar systems - checkpointing, exactly-once semantics, 2-phase commit protocols is highly desirable
What the job involves
- Confluent is seeking an innovative and executing Senior Developer to help make stream processing feel like using a database with SQL
- In this role, you will be instrumental in developing the core building blocks that will allow users a true just-in time, consumption based experience, making it the most efficient and fast cloud native Apache Flink experience on the market
- You will be working in a team with other known Flink experts iterating on an already existing implementation based on actual usage data and product requirements
- With the team you will also be working on relevant components of open source Apache Flink that will benefit both the Open Source community as well as Confluent
- Work on the next iterations of Flink user defined functions that can execute untrusted code securely on Confluent cloud - in java and python on various cloud service providers. Work on building block flink components such as shim layers, SQL logical query planner, parser, optimizer, flink control plane and SQL runtime on Confluent Cloud and guarantees an efficient and unified experience for batch and streaming workloads
- Collaborate with partner teams across components like compute platform, schema registry, kafka, flink runtime and cloud control plane to get work done
- Following a holistic development approach you will be responsible for the code quality, test coverage, documentation and maintainability of the components you and your team work on
- Designing Components: You will not only implement aspects of Flink runtime but also draft designs, discuss them and curate and moderate a decision with involved stakeholders
- Open Source contribution: As part of the Flink runtime team you will contribute to relevant changes and features to Open Source Apache Flink and help the community to maintain a high quality project by participating in relevant mailing list discussions, reviewing PRs affecting deployment and coordination components
- Open Source visibility: You will also write blog posts and give talks at meetups and conferences to strengthen the position of Confluent Cloud as industry experts for stream processing and Apache Flink in particular
- Team: As part of the team you will help to follow and maintain processes, by being an active part of the team, leading meetings and taking initiatives where feasible and participating in on-call rotations
Our take
Confluent is a commercial company built on top of the open-source Apache Kafka project. Confluent and Kafka have developed a streaming data technology that processes massive amounts of information in real-time.
The streaming database technology was developed at LinkedIn as a way of moving massive amounts of messages. The company decided to open-source that tech in 2011, and Confluent launched as the commercial arm in 2014.
While the base open-source component remains available for free download, it doesn’t include the additional tooling the company has built to make it easier for enterprises to use Kafka. Confluent's value add is in those additional tools, including a cloud version of the product and a marketplace for sharing extensions to the platform.
Confluent expanded strategic partnerships with Microsoft and acquired Immerok, and in 2023 expanded its cloud platform. 2024 saw further product expansions with the launch of the Confluent Migration Accelerator, all exemplifying how the company is living up to its name by rocket-boosting the benefits of Apache Kafka integration for companies.
Steph
Company Specialist at Welcome to the Jungle
Insights
Company
Funding (last 2 of 5 rounds)
Apr 2020
$250m
SERIES E
Jan 2019
$125m
SERIES D
Total funding: $455.9m
Company HQ
Mountain View, California
Leadership
Jay Kreps
(Co-Founder & CEO)Previously a Principal Engineer at LinkedIn.
Neha Narkhede
(Co-Founder & Board Member)Previously a Lead Engineer at LinkedIn and Oracle. They are an Investor/advisor for Gem, Block Party, Material Security, Abacus AI, Cortex Data, Yugabyte, Metaphor Data, Natalist, Common Room, and more.
Jun Rao
(Co-Founder)Previously a Senior Engineer at LinkedIn. Has a PhD in Computer Science from Columbia University.
Share this job
View 51 more jobs at Confluent