Designs and maintains scalable batch and streaming data pipelines across transactional platforms, databases, APIs, cloud, and on-premise environments. Ensures data quality, governance, lineage, metadata, and regulatory compliance while supporting analytics and reporting. Collaborates with analysts and data scientists to translate requirements into architecture solutions, monitors pipeline performance, and troubleshoots delivery issues.
Job Title: Senior Data Engineer – Cloud & Regulatory
Reporting
Location: [Dublin] | Type: Full-Time | Experience Level: 7+
Years
About the Role: We are seeking a skilled and
experienced Senior Data Engineer to design and build robust, scalable data
pipelines that power analytics and regulatory reporting from our transactional
platforms to our enterprise data lake. You will play a pivotal role in shaping
data integration strategies, ensuring high data quality, and enabling critical
insights for compliance and business intelligence across cloud and on-premise
environments.
Key Responsibilities:
- Design,
implement, and maintain ETL/ELT data pipelines to move structured and
unstructured data from RDBMS, NoSQL (MongoDB, etc.), and APIs to the
enterprise data lake
- Build
reusable components and frameworks for batch and streaming data ingestion
- Work
closely with business analysts and data scientists to understand data
requirements and translate them into data architecture solutions
- Monitor
data pipeline performance and troubleshoot issues to ensure timely and
accurate data delivery
- Ensure
compliance with data governance and regulatory data standards (e.g., BCBS
239, CCAR, GDPR)
- Document
data flows, lineage, and technical metadata
Required Qualifications:
- Bachelor's
or Master’s degree in Computer Science, Information Systems, or related
field
- Minimum
7 years of experience in data engineering roles
- Strong
experience with data pipeline tools like Apache NiFi, Airflow, Spark,
Kafka, or AWS Glue
- Proficiency
in SQL and scripting languages (e.g., Python, Scala)
- Deep
understanding of RDBMS (Oracle, PostgreSQL, MySQL), NoSQL (MongoDB,
Cassandra), and cloud-native data platforms (AWS, Azure, or GCP)
- Experience
with cloud data storage (e.g., S3, ADLS), and compute services (e.g., EMR,
Databricks, BigQuery)
- Prior
experience supporting regulatory reporting data initiatives is a strong
plus
Preferred Experience:
- Familiarity
with data quality frameworks and tools
- Exposure
to data cataloging and metadata management tools
- Financial
services domain experience, especially with transaction platforms
- Understanding
of data security and encryption best practices
What We Offer:
- Opportunity
to work on enterprise-scale data engineering challenges
- Competitive
compensation and benefits
- Flexible
working environment with modern tech stack
- A
mission-driven team focused on data integrity and regulatory excellence
Similar Jobs
.png){kind=logo}
Software
Provide advanced technical support for New Relic products: troubleshoot installations, configurations, and data issues; collaborate with engineering to resolve complex problems; advocate customer feedback to product teams; maintain and monitor servers and cloud/container environments; continually advance skills through training.
Top Skills:
AnsibleAWSAzureChefDockerGCPJavaScriptKubernetesLinuxNew RelicOpenshiftPuppetWebdriverWindows
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Lead product strategy and roadmap for an enterprise AI modernization of medical record review. Align business, clinical, and technical stakeholders to integrate LLMs, intelligent document understanding, and autonomous coding across Optum/UnitedHealthcare systems, define success metrics, ensure compliance and responsible AI, and drive adoption and operational outcomes.
Top Skills:
Agentic AiAi/MlAPIsAutonomous Claim CodingCloud-Native PlatformsDistributed SystemsEvent-Driven ArchitectureGenerative AiIntelligent Document UnderstandingLarge Language Models (Llms)
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Lead design and implementation of advanced analytics, reporting, and data tooling for chart review, targeting analytics, and risk adjustment. Build and validate data pipelines, automate integrations, ensure data quality, modernize legacy analytics, and deliver actionable insights to stakeholders across the organization.
Top Skills:
Big DataCloudData WarehouseDatabricksETLPythonSQL
What you need to know about the Dublin Tech Scene
From Bono and Oscar Wilde to today's tech leaders, Dublin has always attracted trailblazers, with more than 70,000 people working in the city's expanding digital sector. Continuing its legacy of drawing pioneers, the city is advancing rapidly. Ireland is now ranked as one of the top tech clusters in the region and the number one destination for digital companies, with the highest hiring intention of any region across all sectors.
