Data Engineer, Vivacity

• We are looking for an experienced infrastructure engineer who enjoys problem solving, learning, and supporting others
• You enjoy problem solving, learning, and supporting others
• You thrive on wearing lots of different hats and working in a wide variety of areas
• You are capable of taking ownership of tasks and seeing them through to the end, and include tests and documentation in your definition of “done”
• You communicate clearly and effectively so that others understand what they can expect from you, and when they can expect it
• You continue working on problems, even when you are not familiar with the problem space, and you know when and how to ask for help
• Strong knowledge of Apache Kafka (ideally Kafka Strimzi), including broker management, upgrade and scaling and integration with data pipelines (our pipelines are written in Golang and configured via yaml config maps)
• Problem solving and troubleshooting skills
• Knowledge of Unix systems, ideally Linux (we mostly use Ubuntu)
• Experience working with cloud infrastructure (we use Kubernetes on Google Cloud Platform)
• Experience writing technical or process documentation
• You don't need to have done all of these things before, but to excel in this role, you will need to be keen to learn and comfortable working in a dynamic, fast-paced environment

Desirable

• Reporting to: Andrew Zhao, Cloud Team Lead
• You’ll be joining a group of 20 engineers who work across a wide problem space and technology stack, from high-volume cloud computing and full-stack web development to physical hardware, via cutting-edge machine learning research
• This role sits within our Cloud and Infrastructure team (currently a team of six), which is responsible for the development, monitoring, and maintenance of the company’s cloud and on-premise infrastructure, CI processes, company data, internal tooling, information security, and end-user devices
• This role has a focus on improving the resilience and observability of our cloud infrastructure, and primary responsibility for our Apache Kafka platform
• You will work closely with other engineers in the Technology department to improve the scalability and reliability of our production services, as well as provide guidance and technical support
• This role is a unique opportunity to work with a wide variety of technologies and tooling, including complex time series data, an in-house data pipeline system written in Go, and kubernetes clusters defined using Infrastructure as Code
• Improving performance and efficiency of our data, primarily focusing on our core Kafka Strimzi instances.. (30%)
• Responding to incidents when they occur, informing stakeholders appropriately. (20%)
• Improving and maintaining our monitoring and alerting systems. (15%)
• Being a documentation champion. (15%)
• Using your expertise to unblock developers and improve developer experience. (10%)
• Identifying areas of inefficiency, and proposing, planning, and implementing solutions. (10%)

• 30 minute screening interview
• 90 minute problem solving interview where you work together with a VivaCity engineer to solve a problem
• 75 minute final round interview, split into a 45 minute scenario-based soft skills interview, and a 30 minute conversation with Anna, our CTO