Distributed Systems Engineer, Cloudflare
Data Platform - Logs and Audit Logs
Please submit CV in English
Web performance and security platform
Be an early applicant
Web performance and security platform
1001+ employees
Be an early applicant
Please submit CV in English
1001+ employees
Company mission
Cloudflare's mission is to help build a better Internet that is bold and ambitious.
Role
Who you are
- 3+ years of experience working in software development covering distributed systems and data pipelines
- Strong programming skills (Go is preferable), with a deep understanding of software development best practices for building resilient, high-throughput systems
- Hands-on experience with modern observability stacks, including Prometheus, Grafana, and a strong understanding of handling high-cardinality metrics at scale
- Strong knowledge of SQL, including experience with query optimisation
- A solid foundation in computer science, including algorithms, data structures, distributed systems, and concurrency
- Strong analytical and problem-solving skills, with a willingness to debug, troubleshoot, and learn about complex problems at high scale
- Ability to work collaboratively in a team environment and communicate effectively with other teams across Cloudflare
- Experience with data streaming technologies (e.g., Kafka, Flink) is a strong plus
- Experience with various logging platforms or SIEMs (e.g., Splunk, Datadog, Sumo Logic) and storage destinations (e.g., S3, R2, GCS) is a plus
- Experience with Infrastructure as Code tools like SALT or Terraform is a plus
- Experience with Linux container technologies, such as Docker and Kubernetes, is a plus
- If you're passionate about building scalable and performant data platforms using cutting-edge technologies and want to work with a world-class team of engineers, then we want to hear from you! Join us in our mission to help build a better internet for everyone!
What the job involves
- We are actively seeking experienced and highly motivated Distributed Systems Engineers to join Cloudflare’s dynamic DATA Organisation
- This is a pivotal opportunity to contribute to the future of data at Cloudflare, working on systems that are fundamental to our global operations and customer insights
- As an engineer within our organisation, you will be presented with unique challenges across various critical parts of our intricate data stack
- This role offers the chance to work on cutting-edge technologies and contribute to solutions that operate at the very edge of internet infrastructure
- This particular role is focused on the Logs and Audit Logs group
- Logs and Audit Logs: This specialised team is dedicated to building a robust and easy-to-use logging platform that powers reliable data delivery and seamless integrations with customer destinations
- The team’s mission is to make it simple for customers to access, manage, and use their log data — ensuring that critical datasets, including comprehensive audit logs, are delivered securely and efficiently to their preferred storage and analysis platforms
- The work spans developing intuitive connectors, ensuring data integrity, optimising delivery pipelines, and upholding strict standards for compliance, performance, and usability
- Design, build, and operate a robust logging platform, ensuring reliable logging, and secure data transfer to a wide array of customer destinations and third-party integrations
- Develop and maintain high-performance data connectors and integrations for our log-shipping products, focusing on usability, scalability and data integrity
- Create and manage systems for handling comprehensive audit logs, ensuring they are delivered securely and adhere to strict compliance and performance standards
- Scale and optimise the data delivery pipeline to handle massive data volumes with low latency, identifying and removing bottlenecks in data processing and routing
- Work closely with Product and other engineering teams to define requirements for a new logging platform and integrations
- Maintain the operational health of our log delivery platform through comprehensive monitoring and participation in an on-call rotation (with flexibility for out-of-hours technical issue resolution)
- Collaborate on the architectural evolution of our data egress platform, researching and implementing new technologies to improve efficiency and reliability
Our take
Cloudflare is a multi-service global network that provides web security and infrastructure, DDoS mitigation services, and a content delivery network. Founded in 2009, Cloudflare has risen to become an industry giant, with around 25 million global internet properties on its network.
Cloudflare has been responsible for a number of admirable initiatives, offering free web protection to human rights groups, journalists, artists, and US election websites. This goes some way to counteracting the flak Cloudflare has received in some circles for the controversial groups and users who use its services. This chequered history, however, has not affected its over 80% market share in the content delivery network field.
This is perhaps in part because it has proven sharp at staying abreast of the rapidly morphing tech and digital space and customer demands. For example, Cloudflare is shifting to 100% renewable energy usage to create a zero-emissions internet, and in 2020 released a feature that would help users navigate data privacy regulations by selecting where their data is stored.
The cloud infrastructure market reached $53 billion in 2022. While the Big 3 (Amazon, Microsoft, and Google) own 65% of the market, that still leaves billions of dollars left for companies such as Cloudflare. Its ambitious and successful work is likely to continue being a crucial feature of the web, but in 2023, placed it in the crosshairs of hackers looking to exploit its infrastructure. The beginning of 2024 saw Cloudflare vow to bolster its security and patch vulnerabilities.
Steph
Company Specialist at Welcome to the Jungle
Insights
16% employee growth in 12 months
Company
Company benefits
- Minimum 8 weeks of paid parental leave
- Equal opportunity employer
- Unlimited paid time off policy
- Work from home opportunities
- Medical, Dental & Vision Insurance
- Life Insurance, Disability Insurance
- 401(k) plans
- Family planning and fertility program
- Gym discounts
- Commuter Benefits Program
Company HQ
China Basin, San Francisco, CA
Leadership
Lee Holloway
(Lead Engineer)Lee started their career as an Engineer at Homewarehouse for a year before working at Unspam Technologies for 4 years. They co-created Project Honey Pot in 2004 and Cloudflare in March 2009, serving as Lead Engineer of both to present.
Michelle Zatlyn
(President & COO)Having worked for Investor Economics and I Love Rewards for a combined 4 years, Michelle worked at Toshiba for 3 years as a Product Manager. She then co-founded Cloudflare in 2009 as COO, and has served as President since 2020. She is also a Board Member at Atlassian.
Matthew Prince
(CEO)Matthew studied for an MBA at Harvard Business School before co-founding Unspam Technologies in December 2001, and Cloudflare as CEO in March 2009.
Share this job
View 154 more jobs at Cloudflare