Senior Software Engineer, Grafana Labs
Databases, SRE
$154.4-185.3k
+ RSUs
More information about location
Open & composable observability platform
Be an early applicant
Open & composable observability platform
1001+ employees
Be an early applicant
$154.4-185.3k
+ RSUs
More information about location
1001+ employees
Company mission
To unite data, no matter where it lives, and empower its users to analyze, take action, and make smart decisions.
Role
Who you are
- 6+ years engineering experience, 3+ in SRE/CRE/production engineering. Strong preference for those with formal customer reliability engineering experience
- Strong Kubernetes experience in AWS, GCP, or Azure, and familiarity with infrastructure-as-code tooling (Helm, Terraform, Jsonnet, etc.)
- Experience operating multi-tenant systems in production
- Strong experience designing and implementing SLOs
- Experience with one or more programming languages (e.g. Go, Python, Java, etc)
- Experience with Linux operating systems internals, and some knowledge of networking, cloud storage, and scaling
- Excellent problem-solving and troubleshooting skills
- Experience with calmly and actively participating in blame-free Incident Response, following up on actions, and writing high quality PIRs (Post Incident Reviews, a.k.a. post-mortem documents)
- Ability to reason about performance, scaling, and failure modes
- Comfortable working within an engineering team where individuals are encouraged to have a strong sense of autonomy and self-direction
- Ability to partner deeply with product engineering teams
- We highly value those who are intellectually curious, who default to transparency, possess a high bias towards action, and who are also kind (this is important!)
What the job involves
- We are looking for a Senior Software Engineer - SRE to help us support our highest value Grafana Cloud customers by increasing the reliability of our Cloud databases that are based on Mimir, Loki, Tempo, and Pyroscope. We provide these databases as a SaaS product from AWS, GCP, and Azure across all regions
- The SRE team is embedded within the Mimir and Loki squads and focuses on ensuring that Grafana Cloud’s database products deliver exceptional reliability for our highest-SLA customers. We seek a senior engineer operating at the intersection of customer needs, production systems, and product engineering. In this role, you will:
- Partner closely with product engineering squads (embedded model)
- Own production reliability for high-SLA and complex customer environments
- Design and implement automation to scale our reliability practices
- Ensuring our customers meet our SLO targets
- Define and evolve per-tenant SLOs and reliability models
- Proactively reduce SLO burn to prevent repeat incidents
- Serving as a primary escalation point and on-call for relevant incidents
- Lead customer-impacting incident response and post-incident reviews
- Contribute to design docs and code reviews
- Influence feature design to ensure production scalability and operability
- Build automation to eliminate toil where needed
- Improve alert quality and reduce noisy escalations
- Of course, there is an on-call component to this role and one that we take seriously. As a company, we hire globally (remote-first) to ensure our on-call remains healthy and aligned to approximately 12 daylight hours per day. You will work closely with counterparts in other regions to provide balanced coverage and shared ownership
- We invest heavily in developer productivity. You can use modern AI coding assistants as part of your daily workflow (your choice of tools, within security guidelines), backed by a company-funded usage budget so you can iterate quickly without unnecessary friction
- We encourage pragmatic AI-assisted development: faster prototyping, test generation, refactors, documentation, and incident follow-ups—always paired with strong code review and quality standards. You’ll also have access to frontier models (e.g., GPT-Codex 5/3, Claude Opus 4.6, Gemini 3 Pro)
- Regular 1:1s to with your manager and colleagues
- Reviewing and creating SLOs, proactively investigating ways in which we can further reduce budget burn for those SLOs, which can be self-directed or as the result of learnings from incidents, and may include improvements to monitoring, automation, increasing self-healing, auto-scaling, etc
- Improve observability of customers within their environments
- Designing and implementing solutions to ensure reliability and scalability of our environments can meet rapidly increasing demands
- Develop fault-tolerant design patterns ensuring that we are considering reliability at all stages of the service lifecycle
- Collaborating with our Engineering Leaders to help define and influence product strategy, roadmaps and technical designs
- Participate in PR review and collaborating with other engineers on their Design Docs
- Teach others about Site Reliability Engineering and communicate best practices to be applied early in development of new features and functionality
- Participate in Incident Response when applicable, including investigation through to resolution, PIR, and communication with customers via Bridge calls where necessary
Our take
Observability plays a crucial role in software development, where dashboards are pivotal for monitoring the health of IT infrastructure across an organization. However, for developers, the frustration of spending unnecessary time navigating between different dashboards to find the latest information detracts from valuable programming time.
Grafana creates customizable observability platforms for its clients, to enhance the efficiency of this process. Its offerings include cloud-based data structures, dashboards, API plugins, and collaboration tools. The company boasts over 25 million users globally, with a customer base exceeding 5,000 and including prominent names like Bloomberg, PJ Morgan Chase, eBay, PayPal and Sony.
While Grafana provides free plans with a simplified tool package, the Grafana Enterprise Stack offers customized solutions on a monthly subscription. The company's continues to improve to meet the evolving needs of its users, enhancing functionality with each iteration. It also fosters community engagement by enabling users to share their Grafana dashboards with the broader open-source community.
Kirsty
Company Specialist at Welcome to the Jungle
Insights
49% employee growth in 12 months
Company
Funding (last 2 of 6 rounds)
Aug 2024
$270m
SERIES D
Apr 2022
$240m
SERIES D
Total funding: $805.2m
Company benefits
- Vacation: Balance is key. Our team enjoys 30 days of paid vacation each year on top of national holidays, parental leave, and sick leave. We also take a breather on a number of Grafana Shutdown Days each year
- Healthcare: We’re proud to provide health coverage or stipends for our colleagues in the US, UK, Canada, the Netherlands, Sweden, Singapore, and India
- Retirement planning: There’s no time like the present to start saving for your future. We make employer contributions into the pension pots of our team members in the US, UK, Canada, the Netherlands, Sweden, and Germany
- Professional development: On top of a $1,500 annual learning and development stipend, Grafanistas have thousands of on-demand courses at their fingertips to help them grow professionally. Want to attend a conference or training? Go ahead. Just pass on what you learned
- Work location: Vast majority of our roles are fully remote, focused on hiring the best talent and allowing you to perform from the comfort of your home. If you fancy a change of scene, we’ll also reimburse you up to $175 a month for a personal co-working space
- Choice of tech: There’s no one-size-fits-all when it comes to the tech required to do your job. Choose the laptop and accessories you need when you join us, and we’ll refresh them every three years
- Mindfulness: When you join the team, you can sign up for a complimentary subscription to Headspace to take advantage of the benefits of mindfulness and meditation. Our wellbeing resource group also organize sessions run by fellow Grafanistas or external trainers
- Paid parental leave: Grafana offers paid parental leave to all eligible new parents. This offers Grafanistas time to bond with and care for their children in the first year after birth or adoption
- Global Employee Assistance Program: We offer all team members a 100% confidential support service with 24/7 365 access to professionally qualified counsellors and specialists
Company HQ
Financial District, New York, NY
Leadership
Raj Dutt
(CEO & Co-Founder)Currently a Board Member at NSONE. Previously founded Voxel where they served as the CEO for 12 years. They also served as the Senior Vice President of Technology at Internap Network Services.
Torkel Ödegaard
(Co-Founder)Graduated from Mälardalen University with a Master's in Computer Science. Founder of Coding Instinct. Previously worked as a Consultant at H&M, Avega, and Ebay.
Anthony Wood
(Co-Founder)Previously worked at Visa and Voxel as a Senior Systems Engineer. They also have Systems Engineering experience at PalVision and iiNet.
Share this job
View 75 more jobs at Grafana Labs