Senior Software Engineer, Astronomer
Data Ingestion
$180-210k
+ Equity
Data orchestration platform
Open for applications
Data orchestration platform
201-500 employees
Open for applications
$180-210k
+ Equity
201-500 employees
Company mission
To help companies build, run, and observe their data pipelines through its data orchestration platform powered by Apache Airflow.
Role
Who you are
- Your background may be unconventional; as long as you have the essential qualifications, we encourage you to apply
- While having "bonus" qualifications makes for a strong candidate, Astronomer values diverse experiences
- Many of us at Astronomer haven't followed traditional career paths, and we welcome it if yours hasn't either
- A strong focus on helping customers gain more visibility and actionable insights through our observability offerings
- Proven experience with Python
- Strong written and verbal communication skills, with the ability to find middle ground
- 5+ years of engineering experience
- Experience with fast-paced startup environments
- Experience with software development best practices, such as code reviews, testing, CI/CD, version control, automation and debugging
Desirable
- Experience with OpenLineage
- Experience with Apache Airflow
- Experience with data observability products
- Experience with Golang
- Experience with SQL and OLAP databases
- Experience with distributed systems and stream processing
What the job involves
- As a member of our team, you will be at the forefront of the industry as we strive to deliver the world's data
- At Astronomer, our R&D team is dedicated to providing an exceptional experience in managing Apache Airflow at scale
- As a leading player in the industry, we are seeking an experienced Software Engineer to work on our data observability product - Astro Observe
- Astro Observe is a critical component of our expansion strategy built on top of OpenLineage events
- You will play a pivotal role in driving the success of Astro Observe by leading the design and implementation of our OpenLineage data collection and ingestion efforts
- Your contributions will directly impact our ability to scale and deliver exceptional value to our customers
- Contribute to the OpenLineage and Airflow Open Source community to enhance the data collection and extraction of OpenLineage events from Airflow
- Contribute to the design, development and vision of Astro Observe’s ingestion pipelines
- Collaborate with cross-functional teams to understand user requirements, implement and iterate on the observability and governance features to help our customers gain visibility into their data pipelines and data products
- Contribute to the overall platform usability, reliability, and scalability
Our take
Developing data pipelines is essential for modern businesses to stay competitive, but building them can be a slow process. Workflow management tools for data engineering pipelines such as Apache Airflow makes the development process significantly simpler, but managing it manually is still a repetitive, convoluted, and time-consuming process.
Astronomer provides a data orchestration platform called Astro powered by Apache Airflow, aiming to automate its data pipeline management processes, unify data flows, and ultimately help businesses to access the software's full potential without DevOps. The company claims that its collaborative system helps teams to build data pipelines faster, increase data availability, ensure runtime environments are reliable within cloud infrastructures, and provide a holistic overview of business data.
Whilst it is undeniable that the company faces competition from other data orchestration platforms, Astronomer has been smart to recognize the presence of inefficiencies in Apache Airflow, despite its great potential. The company is thus providing solutions to improve it, not replace it, a unique perspective that shows great potential for Astronomer to disrupt the market.
Steph
Company Specialist at Welcome to the Jungle
Insights
Company
Funding (last 2 of 8 rounds)
Mar 2022
$213m
SERIES C
Jan 2021
$43.6m
SERIES B
Total funding: $279.8m
Company benefits
- Remote friendly, work from anywhere
- If you’re in a city with an office, it’s there (and stocked with snacks) when you need it
- Co-workers in over 40 states and 15 countries around the world
- Health, dental, and vision insurance at little to no cost for individuals, and at competitive rates for your dependents
- Disability and life insurance policies in case something happens
- Unlimited vacation - we do track vacation days and actively encourage people to take it (on average, Astronomers take 20 days of vacation per year)
- Parental leave
- Laptop of your choice, and a stipend to help with your work-from-home setup
- Monthly $170 pre-tax stipend intended to cover your cellphone and WiFi bills
- Yearly internal summit for all employees
- Regular access to conferences, workshops, and meetups in the ecosystem
Company values
- Empathy - We're humans first. We seek to understand why people do what they do and believe that innovation comes from human-centric questions, discoveries, and decisions. We act with compassion and build trust by owning our impact on the people and systems around us
- Inclusion - We welcome diverse perspectives and value our differences. We're intentional about cultivating a respectful and welcoming environment with no ceiling on opportunity. Collaboration is our superpower
- Agility - We're a multi-disciplined team that’s focused on execution but nimble enough to adapt as the needs of our company, industry, and world evolve. We see change as opportunity
- Grit - We are energetic problem-solvers. We roll up our sleeves and figure it out as we go, navigating ambiguity with resilience. We’re powered by a shared sense of purpose and commitment to delivering excellence
- Curiosity - We’re humble learners with deep curiosity about the world, technology, and each other. We're active listeners and questioners, skilled at breaking down complex problems and making sense of them. We're unafraid to challenge the past and present, and are driven in the pursuit of truth and continuous improvement
- Transparency - Openness is at the core of everything we do. We disrupt knowledge silos and seek feedback early and often. We take pride in contributing our work to the open-source community and owning our role as educators
Company HQ
Flatiron District, New York, NY
Articles
Leadership
Greg Neiheisel
(Co-founder)Software Engineer for Great American Insurance from 2011 to 2013. Experience as Founder and CTO of USERcycle.
Tim Brunk
(Co-founder)Co-founder of Cladwell since 2012 and of Ocean Accelerator since 2014. Founder of MetaRouter since 2018.
Share this job
View 10 more jobs at Astronomer