As a Lead Data Engineer, you will shape the future of online car markets, leading complex data projects, organizing teams, and designing new data solutions while working closely with engineers and management in a collaborative environment.
About the project:
Our customer is the European online car market with over 30 million monthly users, with a market presence in 18 countries. The company is now merging with a similar company in Canada and needs support on this way. As a Lead Data Engineer, you will play a pivotal role in shaping the future of online car markets and enhancing the user experience for millions of car buyers and sellers.
Requirements:
- 8+ years of experience in software engineering
- English - Upper-Intermediate+
- Proven experience leading complex data projects, organizing teams, and architecting and designing new solutions
- Extensive expertise in AWS services, especially Glue, Athena
- Proficiency in Python, PySpark, GCP
- SQL, Airflow, data streaming frameworks (Kafka or Firehose)
- Experience in building and maintaining data pipelines
- Experience in building data platforms, not just using them
- Proficiency in data modeling techniques and best practices
Responsibilities:
- Simplify existing tools, make them more modular, work with technical debt
- Propose improvements, be actively involved in team discussions and decision-making, drive initiatives
- Work closely with a team of Senior Engineers, Product Manager and Engineering Manager
We offer:
- Flexible working format - remote, office-based or flexible
- A competitive salary and good compensation package
- Personalized career growth
- Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
- Active tech communities with regular knowledge sharing
- Education reimbursement
- Memorable anniversary presents
- Corporate events and team buildings
- Other location-specific benefits
Top Skills
Pyspark
Python
SQL
Similar Jobs
The Data Engineer will architect and lead the transition from on-premises batch architecture to a cloud-based streaming data platform, focusing on data warehousing, ETL pipelines, and data governance. The role involves collaboration with cross-functional teams and fostering a culture of technical excellence.
The Data Engineer will develop databases and data pipelines, create end-to-end data solutions, and maintain scalable data solutions while collaborating with various stakeholders to ensure data security and project success.
Be an Early Applicant
As a Middle Data Engineer, you will enhance online car markets by developing and maintaining data pipelines, working with AWS services and SQL, and collaborating with a senior engineering team to improve tools and drive initiatives.
What you need to know about the Dublin Tech Scene
From Bono and Oscar Wilde to today's tech leaders, Dublin has always attracted trailblazers, with more than 70,000 people working in the city's expanding digital sector. Continuing its legacy of drawing pioneers, the city is advancing rapidly. Ireland is now ranked as one of the top tech clusters in the region and the number one destination for digital companies, with the highest hiring intention of any region across all sectors.
