Cloud Infrastructure Engineer, Confluent
$107.2-126k
+ Annual bonus and equity
Data streaming platform
Job no longer available
Data streaming platform
1001+ employees
Job no longer available
$107.2-126k
+ Annual bonus and equity
1001+ employees
Company mission
To help every organization harness data in motion so they can compete and thrive in the modern world.
Role
Who you are
- Proven experience with Google Cloud Platform (GCP) and its data services
- Strong understanding of cloud infrastructure and data architecture principles
- Proficiency in scripting languages such as Python and Bash
- Experience with infrastructure as code (IaC) tools like Terraform
- Experience working with APIs
- Experience working with IAM including SAML, OAUth, and other standards
- Familiarity with data orchestration tools like Apache Airflow or DBT
- Familiarity with containerization and orchestration tools such as Docker and Kubernetes
- Familiarity with CI/CD pipelines,DevOps practices, and software development life cycles
- Excellent troubleshooting and problem-solving skills
- Knowledge of data security best practices in the cloud
- Ability to work independently and as part of a team
- Strong communication skills and ability to collaborate with cross-functional teams
- 5+ years experience as a Cloud Infrastructure Engineer
Desirable
- Understanding of data warehousing concepts and ETL processes
- Experience with Apache Airflow and DBT
- Experience with event-streaming technologies such as Kafka
What the job involves
- As a Cloud Infrastructure Engineer, you will be responsible for designing, implementing, and managing our data infrastructure on GCP and other cloud providers
- You will ensure the performance, reliability, and security of our cloud-based data systems, utilizing GCP services and tools to build and optimize our data architecture and processes
- Design, implement, and manage data infrastructure on Google Cloud Platform (GCP)
- Ensure high performance, reliability, and security of our cloud-based data systems
- Utilize GCP services such as BigQuery, Google Cloud Storage, Dataflow, and data processing and storage
- Develop and maintain infrastructure as code (IaC) using tools like Terraform
- Automate data workflows and processes using orchestration tools like Apache Airflow and DBT
- Troubleshoot and resolve issues related to data infrastructure, including performance tuning and error handling
- Implement best practices for data security and ensure compliance with security and governance policies
- Collaborate with data engineers, data scientists, analysts, and other stakeholders to improve the data infrastructure in support of their data needs
- Monitor and optimize cloud resource usage to ensure cost-efficiency
- Work closely with other cross functional teams (like Tableau admins) for high availability of end-to-end data services
Our take
Confluent is a commercial company built on top of the open-source Apache Kafka project. Confluent and Kafka have developed a streaming data technology that processes massive amounts of information in real-time. The streaming database technology was developed at LinkedIn as a way of moving massive amounts of messages. The company decided to open-source that tech in 2011, and Confluent launched as the commercial arm in 2014.
While the base open-source component remains available for free download, it doesn’t include the additional tooling the company has built to make it easier for enterprises to use Kafka. Confluent's value add is in those additional tools, including a cloud version of the product and a marketplace for sharing extensions to the platform.
Confluent expanded strategic partnerships with Microsoft and acquired Immerok, and in 2023 expanded its cloud platform. 2024 saw further product expansions with the launch of the Confluent Migration Accelerator, all exemplifying how the company is living up to its name by rocket-boosting the benefits of Apache Kafka integration for companies.
Now, it looks like IBM is eyeing the company for acquisition and Confluent looks to be a natural fit. Long positioned as the real-time backbone behind modern application, Confluent would gain global scale and an even deeper enterprise reach under iBM, while cementing its role at the center of AI-driven architectures. For COnfluent, the deal would marka shift from fast-growing independent disruptor to foundational infrastructure player powering the next wave of enterprise AI.
Steph
Company Specialist at Welcome to the Jungle
Insights
Company
Funding (last 2 of 5 rounds)
Apr 2020
$250m
SERIES E
Jan 2019
$125m
SERIES D
Total funding: $455.9m
Company HQ
Old Mountain View, Mountain View, CA
Leadership
Jay Kreps
(Co-Founder & CEO)Prior to co-founding Confluent in 2014, Jay spent 7 years at LinkedIn, holding various roles including Principal Engineer and Principal Staff Engineer.
Share this job
View 24 more jobs at Confluent