Incident Response Engineer, Fireblocks

• At least 3+ years of experience as an SRE incident response engineer
• You are curious, self-motivated, easy to work with, responsible, and production-aware—fast learner and able to take a project from POC to production, while handling decision-making and communication
• Experience with Coding languages – Python/JavaScript/Bash (Must)
• At least 3+ years of experience with Alerting & Monitoring systems such as DataDog, Coralogix / Splunk / New Relic / Prometheus
• Experience working with Linux systems from kernel to shell and beyond
• Cloud systems such as AWS / Google Cloud / Azure
• Experience with Docker, Kubernetes, and Helm
• SCM – Git/bitbucket/gitlab
• High Analytical & Troubleshooting skills – ability to solve complex problems
• Strong verbal and written communication skills and a collaborative mindset

Desirable

• The SRE Incident Response team is responsible for handling critical application\infrastructure alerts, orchestrating the war room process and enabling first class observability and alerting systems
• Team members are located in several international locations (“follow the sun” model) to provide 24/7 availability
• We are a team of unique individuals, experienced and independent, who get things done
• On-call coverage is 7 days a week, starting at noon, with the shift ending at 6:00pm
• As part of your role, you would improve and establish new monitoring, alerting, and observability of services using a wide range of tools. Additionally, you would handle critical alerts and incidents and work directly with engineering and DevOps to improve and optimize availability
• Manage and participate in incident war rooms, escalating and coordinating response for critical workflow alerts
• Perform deep-dive troubleshooting for application, transaction, and general technical issues
• Research Fireblocks blockchain workflows, identify optimization opportunities, issues, and improve monitoring
• Help identify root causes for incidents and prevent them from happening again. Solve and orchestrate outages by working with multiple teams
• Improve and establish alerting for our infrastructure, services, and business logic
• Work closely with the R&D and Support: offering education and guidance on integration, support, and monitoring across the toolset
• Communicate and escalate issues to senior management in R&D and support, write RCAs, and define next steps
• Document actions in runbooks and then into automation using Python, Lambda, shell scripts, ArgoCD, and Ansible
• Focus on the system’s observability, availability, reliability, performance/latency, and monitoring