Senior Software Engineer, Quora

• We are looking for someone who will be excited by the prospect of optimizing, enhancing or even re-designing our company’s data architecture/pipelines to support our next generation data initiatives
• Availability for meetings and impromptu communication during Quora's “coordination hours" (Mon-Fri: 9am-3pm Pacific Time)
• Must have 4+ years of experience working in Data Infrastructure
• Flexibility for working and owning different Data Engineering systems. Open to working on the areas with highest priority for the company at a given time
• Operational mindset with ability to do Problem diagnosis, Root cause analysis, Performance tuning and Incident Management
• Proficiency in Python and SQL query design
• Proficiency with big data processing frameworks, like: Hive, Spark and Trino
• Experience building data-intensive applications (high velocity/high volume)
• Experience with SQL/NoSQL data store & data lake operations

Desirable

• This role will be working on our Quora product
• Our data infrastructure team is responsible for all things data - data lake, data pipelines, distributed query engines, experimentation framework, data dashboards and visualization tools and so on
• Our data-ecosystems is composed of open source technologies like Kafka, Hive, Trino, Spark and Airflow, along with a few in-house-built systems
• As a member of our team you would spend time designing and scaling our existing infrastructure, improving system’s reliability, working closely with other teams to improve or create new tooling for our infrastructure, and promoting the correct use of data at the company
• Design and implement scalable and efficient data architectures, meeting data needs from data scientists, engineers and business partners
• Identify and implement improvements to system’s cost efficiency, reducing data storage and processing costs
• Bring your expertise to help model structured & unstructured data. Own these data models at a high level & be a data consultant for partner teams
• Champion best practices on system usages and hold high-quality code standards
• Participate in the team’s on call rotation, helping solve timely reliability incidents