Designs, implements, and maintains scalable data solutions and ETL pipelines using SQL Server, relational databases, Databricks, and Spark. Responsibilities include data modeling, SQL optimization, data validation, troubleshooting pipeline issues, and communicating technical concepts to diverse stakeholders. The role requires managing competing priorities, supporting multiple projects, innovating, and solving data problems with minimal supervision.
- Experience as a Data Engineer or in a similar role, with a strong understanding of data engineering concepts and methodologies, including data modeling and database design to support scalable data solutions.
- Strong knowledge of writing and optimizing SQL queries to retrieve, manipulate, and analyze data efficiently.
- Experience with Microsoft SQL Server and relational databases.
- Ability to design, implement, and maintain ETL pipelines.
- Experience with Databricks and Spark
- Experience with productivity tools such as GitHub Copilot
- Ability to innovate, think critically, and break down problems.
- Ability to handle tasks on multiple projects and navigate competing priorities.
- Ability to analyze and troubleshoot data issues and provide solutions with minimal supervision.
- Basic knowledge of testing and validating data to ensure accuracy and consistency in data pipelines.
- Excellent verbal and written communication skills, with the ability to articulate complex ideas clearly and concisely to both technical and non-technical stakeholders.
- Bachelor's degree in a quantitative discipline such as Engineering, Mathematics, Finance, Business, or a related field. Equivalent practical experience may also be considered.
Test Triangle Dublin, Dublin, IRL Office
Dublin, Ireland
Similar Jobs
Blockchain • Fintech • Payments • Financial Services • Cryptocurrency • Web3 • Infrastructure as a Service (IaaS)
Build and maintain scalable batch and streaming data pipelines for payments, ledger, transaction, and blockchain data. Own ingestion from databases, files, APIs, and onchain sources; develop incremental dbt models; orchestrate workflows in Dagster; and implement data quality, freshness, reconciliation, monitoring, deduplication, and late-data handling. Partner with engineering, analytics, data science, and risk teams to support reliable reporting and machine-learning features.
Top Skills:
AirbyteAirflowApache BeamBigQueryCdcClickhouseDagsterDataflowDatastreamDbtDebeziumEvmFivetranFlinkGCPGcsKafkaMeltanoPub/SubPythonRustSftpSnowflakeSolanaSQL
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Develop and maintain large-scale data pipelines integrating databases, APIs, logs, streaming platforms, and external sources. Build transformation and processing jobs using PySpark and SQL, implement governance and de-identification controls, and support data quality and reliability. Partner with analytics, product, infrastructure, and data science teams to advance Azure and Snowflake platforms. Monitor pipelines, automate error handling, and contribute to deployment, orchestration, architecture, and CI/CD best practices.
Top Skills:
Apache AirflowSparkAzureAzure Data FactoryAzure DatabricksCi/CdGitJavaPysparkPythonScalaSnowflakeSQLSQL Server
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Designs, builds, tests, and maintains scalable batch, real-time, and near-real-time data pipelines on Databricks and Azure. Develops ETL and data transformation workloads, migrates legacy data, creates data models, and implements monitoring, governance, security, and backup strategies. Automates production releases for data, machine learning, and business intelligence workloads. Uses and governs AI-assisted development tools, validates generated code, documents solutions, and coaches engineers on responsible AI tooling. Supports operational ownership of commercial data products.
Top Skills:
Amazon RedshiftApache AirflowSparkAWSAzure SynapseData VaultDatabricksDatabricks AssistantDbtDockerGithub CopilotGCPJavaKimballKubernetesLinuxAzureOlapPythonScalaSnowflakeSQLVertica
What you need to know about the Dublin Tech Scene
From Bono and Oscar Wilde to today's tech leaders, Dublin has always attracted trailblazers, with more than 70,000 people working in the city's expanding digital sector. Continuing its legacy of drawing pioneers, the city is advancing rapidly. Ireland is now ranked as one of the top tech clusters in the region and the number one destination for digital companies, with the highest hiring intention of any region across all sectors.


