Astronomer Logo

Astronomer

Senior Airflow Reliability Engineer

Posted 7 Days Ago
Be an Early Applicant
Remote
Hiring Remotely in Ireland
Senior level
Remote
Hiring Remotely in Ireland
Senior level
As a Senior Airflow Reliability Engineer, you will provide expert guidance on Apache Airflow, work through technical challenges, collaborate with customers, and contribute to open-source projects while maintaining a high level of customer support.
The summary above was generated by AI

Astronomer empowers data teams to bring mission-critical software, analytics, and AI to life and is the company behind Astro, the industry-leading unified DataOps platform powered by Apache Airflow®. Astro accelerates building reliable data products that unlock insights, unleash AI value, and powers data-driven applications. Trusted by more than 800 of the world's leading enterprises, Astronomer lets businesses do more with their data. To learn more, visit www.astronomer.io.

About this role:

As an Airflow Reliability Engineer on the Customer Reliability Engineering (CRE) team at Astronomer, you will have the opportunity to become an Apache Airflow expert, learning directly from leaders of the Airflow project. You’ll provide Apache Airflow expertise directly to customers to help them make the best possible use of our managed Airflow service.

CRE is Astronomer’s support team. Because our customers are sophisticated organizations who need and expect high levels of expertise to help them keep mission critical uses of Apache Airflow working consistently, we look a little different from most support teams. Nearly every ticket you will work requires an intersection of strong technical knowledge and customer empathy to understand what the customer needs and how to get them there. Every day is a new challenge and a new thing to learn.

When you learn a new piece of technology, are you aiming not just to get started but to become the expert? Do you listen to the plumber when they tell you what is wrong with the pipes? Are you the kind of person who takes an MIT OpenCourseWare course and actually finishes it? Then this role could be for you.

What you get to do:
  • Learn and build expertise across several software engineering disciplines, including:

  • Airflow and data engineering

  • Kubernetes

  • Cloud Engineering

  • Gain exposure to the big picture; learn about product, engineering, customer relationship management, and more.

  • Solve challenging Airflow problems for our customers. From optimizing configuration to identifying world-first Airflow bugs, you’ll see it all here.

  • Spend up to 20% of your time on side projects that contribute to Astronomer’s overall success, such as contributing to the open-source Airflow repository or developing Astronomer’s internal monitoring and alerting systems built on Airflow.

  • Work on a modern, sophisticated, cloud-native product that customers use to connect to dozens of other systems. Gain depth and breadth of learning!

  • Work directly with our customers’ data engineers, system admins, DevOps teams, and management.

  • Provide feedback from your experience that can shape the direction of the Airflow project.

  • Own the customer experience, working directly with customers to prioritize and solve issues, meet SLAs, and provide “white glove” guidance on the path to production.

  • Participate remotely within a fully distributed team.

  • Help maintain 24x7 coverage through a specified 6-hour pager period during your work day.

  • Participate in paid on-call rotation for weekend coverage.

What you bring to the role:
  • Data Engineering background

  • 4 years of experience with Python

  • 1 year of experience with Kubernetes/Docker/Containers

  • Experience in Airflow administration and DAG creation

  • Experience working with a distributed system with any major cloud provider (AWS, GCP, Azure)

  • Problem-solving and troubleshooting abilities

  • Ability to work well with autonomy and independence

  • Strong written and verbal communication for connecting with our customers over our ticketing system and through Zoom

  • Experience mentoring junior team members

Bonus points if you have:
  • Contributions to open-source projects

  • Customer Support experience

  • Familiarity with SQL and PostgreSQL

  • Experience with Databricks, Snowflake, Redshift, dbt, or other similar data engineering tools


#LI-Fulltime

#LI-Remote

At Astronomer, we value diversity. We are an equal opportunity employer: we do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

Top Skills

Apache Airflow
AWS
Azure
Databricks
Dbt
Docker
GCP
Kubernetes
Postgres
Python
Redshift
Snowflake
SQL

Similar Jobs

7 Days Ago
Remote
Ireland, IRL
Senior level
Senior level
Artificial Intelligence • Big Data • Cloud • Software • Analytics • Infrastructure as a Service (IaaS) • Big Data Analytics
As a Senior Airflow Reliability Engineer, you will ensure reliable operations of the managed Airflow service, troubleshoot issues, and enhance customer experience.
Top Skills: Apache AirflowAWSAzureCi/CdGCPKubernetesLinuxPython
2 Hours Ago
Remote or Hybrid
Dublin, IRL
Expert/Leader
Expert/Leader
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
As the founding Country Leader for Ireland, you will design and execute territory strategy, acquire enterprise customers, and drive revenue growth while collaborating across functions and establishing market presence.
Top Skills: AICloudDevOpsEnterprise SoftwareModern Applications
10 Hours Ago
Remote or Hybrid
2 Locations
Mid level
Mid level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Develop automation tools and infrastructure, integrate new modules into the Falcon platform, and support security engineering through scalable code and data processing solutions.
Top Skills: AWSAzureDevoDockerElasticGCPGitGoHumioKubernetesLogrhythmLogscalePythonQradarSplunkSumologic

What you need to know about the Dublin Tech Scene

From Bono and Oscar Wilde to today's tech leaders, Dublin has always attracted trailblazers, with more than 70,000 people working in the city's expanding digital sector. Continuing its legacy of drawing pioneers, the city is advancing rapidly. Ireland is now ranked as one of the top tech clusters in the region and the number one destination for digital companies, with the highest hiring intention of any region across all sectors.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account