Version 1 Logo

Version 1

Senior Data Engineer

Posted Yesterday
Be an Early Applicant
In-Office
Dublin, IRL
Senior level
In-Office
Dublin, IRL
Senior level
Designs, develops, and optimizes high-volume data pipelines in Databricks and Spark environments. The role integrates data from enterprise systems, collaborates with architects and data scientists, incorporates forecasting algorithms, optimizes Spark performance and cluster costs, follows Agile Scrum practices, mentors junior engineers, and maintains technical documentation.
The summary above was generated by AI
Company Description

Version 1 has celebrated 30 years in business and continues to be trusted by global brands to deliver technology and transformation solutions that drive customer success. Our deep expertise enables our customers to navigate the rapidly evolving technology landscape. We foster strong partnerships with global technology leaders including Microsoft, AWS, Oracle, Red Hat, OutSystems, Snowflake, ensuring that our customers are provided with the highest quality solutions and services. 

 We’re an award-winning employer reflecting how our employees are at the very heart of  what we do: 

  • UK & Ireland's premier AWS, Microsoft & Oracle partner 
  • 3300+ strong, €350/£300m revenue business 
  • 10+ years as a Great Place to Work in Ireland & UK 
  • Best Workplace for Women in the UK & Ireland by GPTW 
  • Best Workplace for Wellbeing in the UK by GPTW 

We’re a core values driven company, we hire people who share our values, and we reward those who display and foster them, it’s deeply embedded within our DNA. Invest in us and we’ll invest in you!. 

Job Description

Are you an experienced Data Engineer who wants to work with cutting edge technologies? Are you keen to build, develop and work at the forefront and centre of data engineering in a global enterprise? If so, this may be the role for you!

This is a hybrid role with the flexibility to work both virtually and from Dublin office.

Reporting to the Data Engineering Manager you will:

  • Work with solution architects, data architects, and application developers to gather data integration requirements and develop solutions accordingly
  • Collaborate with data scientists to develop and integrate statistical and forecasting algorithms into robust high-performing pipelines.
  • Design, develop, and optimize data pipeline solutions scaling to multi-terabyte datasets in Databricks environments
  • Assess and improve Spark performance in areas of memory management, caching strategies, and cluster resource optimization
  • Manage individual tasks and communicate updates to colleagues following an Agile Scrum methodology
  • Mentor junior colleagues, providing guidance and support to help them grow professionally
  • Maintain up to date Technical and Operational documentation

 

How this opportunity is different

This is a great opportunity for an experienced Engineer who wishes to broaden their role through working across multiple data and analytics projects and products. The Data Engineering team is working with new, innovative technologies such as Databricks, Unity Catalog, and AWS alongside established technologies like SQL Server.

Qualifications

  • Third level IT qualification or equivalent experience, with a solid foundation in mathematics and/or statistics.
  • 10+ years hands-on experience as an ETL/DWH developer with strong knowledge in designing, developing, and scaling end-to-end high-volume data integration processes
  • Strong programming experience with Python, SPARK, and SQL
  • Strong understanding of Spark execution plans and memory management
  • Experience with Databricks cluster configuration, performance, and cost optimization strategies
  • Customer focused with excellent communications skills (both oral and written)
  • A strong team player that can also work independently

Additional Information

Why Version 1? 

 At Version 1, we believe in providing our employees with a comprehensive benefits package that prioritises their wellbeing, professional growth, and financial stability. 

  • Share in our success with our Quarterly Performance-Related Profit Share Scheme, where employees collectively benefit from a share of our company's profits 
  • Strong Career Progression & mentorship coaching through our Strength in Balance & Leadership schemes with a dedicated quarterly Pathways Career Development programme 
  • Flexible/remote working, Version 1 is tremendously understanding of life events and people’s individual circumstances and offer flexibility to help achieve a healthy work life balance 
  • Financial Wellbeing initiatives including; Pension, Private Healthcare Cover, Life Assurance, Financial advice and an Employee Discount scheme 
  • Employee Wellbeing schemes including Gym Discounts, Bike to Work, Fitness classes, Mindfulness Workshops, Employee Assistance Programme and much more. Generous holiday allowance, enhanced maternity/paternity leave, marriage/civil partnership leave and special leave policies 
  • Educational assistance, incentivised certifications, and accreditations, including AWS, Microsoft, Oracle, and Red Hat 
  • Reward schemes including Version 1’s Annual Excellence Awards & ‘Call-Out’ platform. 
  • Environment, Social and Community First initiatives allow you to get involved in local fundraising and development opportunities as part of fostering our diversity, inclusion and belonging schemes. 

And many more exciting benefits… drop us a note to find out more.    

Version 1 is an equal opportunities employer. 

We are committed to building a diverse, inclusive and respectful workplace where everyone feels valued and able to thrive. We welcome applications from people of all backgrounds, identities and lived experiences, and we value the different perspectives people bring including those shaped by disability and neurodiversity. 

We want every candidate to have a positive and accessible recruitment experience. If you need reasonable adjustments at any stage of the process, please contact your recruiter at Version 1. We will consider all requests carefully, respectfully and confidentially. 

Video links: 

https://www.youtube.com/watch?v=F_d3ELTH5zo 

HQ

Version 1 Dublin, Dublin, IRL Office

Dublin, Ireland

Similar Jobs

4 Hours Ago
Hybrid
Dublin, IRL
Senior level
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Build and maintain scalable ETL pipelines, integrate data from databases, APIs, streaming platforms, and external providers, and transform large datasets for analytics and machine learning. Establish reusable engineering frameworks, data governance, monitoring, alerting, and reliability practices. Collaborate with analytics and business teams on cloud data migration, predictive model enablement, and healthcare cost reduction. Required skills include SQL, Python, Scala or Java, cloud platforms, Snowflake or Databricks, DevOps, Git, and CI/CD.
Top Skills: AirflowAWSAzureAzure Data FactoryCi/CdDatabricksDevOpsEltETLGCPGitHadoopJavaKafkaPythonScalaShell ScriptingSnowflakeSparkSQL
11 Days Ago
Hybrid
Dublin, IRL
Senior level
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Develop and maintain complex data pipelines and data sources using Snowflake, Airflow, Azure, SQL, and Python. Integrate on-premises and cloud data, build transformation routines, data models, stored procedures, masking solutions, monitoring tools, and automated data quality controls. Create CI/CD pipelines with GitHub Actions and collaborate with architects, analysts, and data stewards to deliver reliable analytics foundations. The role also supports scalable payment integrity data solutions and requires knowledge of data warehousing, integration, and security practices.
Top Skills: AirflowAzureAzure Blob StorageAzure Data FactoryAzure FunctionsAzure Key VaultCi/CdDockerEltETLGitGithub ActionsGreat ExpectationsJavaKubernetesNon-Relational DatabasesPythonRelational DatabasesScalaSnowflakeSodaSQL
6 Hours Ago
Hybrid
Dublin, IRL
Senior level
Senior level
Information Technology • Consulting
Designs, builds, and maintains scalable Azure data pipelines and platform architecture. Responsibilities include developing Synapse pipelines, creating data models, optimizing databases, deploying through Azure DevOps and Terraform, implementing data quality and monitoring controls, supporting governance and security, troubleshooting environments, and sharing platform knowledge. The role also requires collaboration with analysts, infrastructure teams, technical stakeholders, and users while keeping current with Microsoft Fabric and migration approaches.
Top Skills: SparkAzure Data FactoryAzure DevopsAzure SqlAzure SynapseGdprLogic AppsMicrosoft FabricMicrosoft Power PlatformPowershellPysparkPythonSQLTerraform

What you need to know about the Dublin Tech Scene

From Bono and Oscar Wilde to today's tech leaders, Dublin has always attracted trailblazers, with more than 70,000 people working in the city's expanding digital sector. Continuing its legacy of drawing pioneers, the city is advancing rapidly. Ireland is now ranked as one of the top tech clusters in the region and the number one destination for digital companies, with the highest hiring intention of any region across all sectors.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account