Lead design and delivery of Databricks-based banking data platforms on AWS. Build and optimise large-scale Spark/PySpark pipelines with Delta Lake, own data governance (Unity Catalog), manage Terraform IaC, drive CI/CD, mentor engineers, maintain documentation, and ensure scalable, secure, cost-effective architectures in a regulated financial environment.
G MASS are seeking an experienced Databricks Technical Lead to support the development and ownership of strategic data platforms and cloud-based applications within a financial services environment.
The role will focus on defining technical direction and architecture across Databricks and the wider AWS estate, ensuring scalable and secure development practices, and overseeing delivery through the full software development lifecycle. The successful candidate will work closely with Development, Business Analysis, QA, Application Support, IT Security, and Enterprise Architecture teams to deliver robust and high-performing solutions across complex banking and financial systems.
Responsibilities:
- Lead the development and enhancement of strategic banking data platforms and applications across Databricks and AWS cloud environments
- Design, build, and optimise large-scale data pipelines using Spark / PySpark, Delta Lake, and Databricks Workflows
- Own data governance and access control within the Databricks environment, including Unity Catalog design and implementation
- Manage cloud infrastructure deployments using Terraform and Infrastructure as Code best practices
- Maintain technical documentation and internal knowledge resources
- Provide technical leadership through mentoring, code reviews, and best practice guidance
- Support architectural design with a focus on scalability, performance, cost efficiency, and reliability
- Drive CI/CD improvements across cloud and on-premise environments
- Promote clean coding standards, automated testing, and effective use of AI-assisted development tools
Requirements
- Enterprise SDLC experience
- Financial services experience, including banking exposure
- Strong hands-on Databricks experience, including Spark / PySpark, Delta Lake, Databricks SQL, and Workflows, with proficiency in Python and / or Scala
- Experience of Unity Catalog and data governance within a regulated environment
- Strong AWS experience (EC2, Lambda, ECS, RDS, S3, IAM)
- Hands-on Terraform / Infrastructure as Code experience
- CI/CD experience using Jenkins
- Degree in Computer Science or related discipline (or equivalent experience)
- IBM MQ or similar messaging systems
Benefits
Length: Permanent
Location: Cork, Dublin, or Amsterdam
Similar Jobs
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Senior Software Engineer responsible for building scalable backend systems in Java/Spring Boot, designing and implementing API and UI test automation, embedding quality/security into the SDLC, enhancing CI/CD, driving performance and reliability efforts, collaborating on architecture, and troubleshooting distributed systems.
Top Skills:
BambooGitJavaJenkinsJSONJunitPlaywrightPostmanRestassuredRestful ServicesSeleniumSonarSpring BootTestngXML
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Lead end-to-end development of high-performance Java services for Mastercard’s distributed, in-memory fraud decisioning platform. Design scalable APIs and resilient distributed systems, troubleshoot multi-tier performance issues, coordinate releases, participate in on-call and incident management, improve automation and operational stability, and mentor engineers. Collaborate with product and business stakeholders on prioritization, demos, risks, and acceptance while driving engineering standards, secure development, testing, and continuous improvement.
Top Skills:
AgileApache GeodeCi/CdCoherenceHazelcastHibernateJavaJbossJdk 17JenkinsJSONJunitLinuxMavenMessage Queuing SystemsPci-DssRedisRest ApisSafeScrumShell ScriptingSpringSpring BootSQLTomcat
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Own the full lifecycle of high-performance Java services and distributed caching systems supporting Mastercard’s real-time fraud decisioning platform. Responsibilities include architecture, development, testing, deployment, troubleshooting, release coordination, on-call support, incident management, performance optimization, stakeholder engagement, code reviews, mentoring, and automation. The role emphasizes scalable, secure, resilient systems, low latency, high availability, data consistency, and cross-team collaboration.
Top Skills:
AgileApache GeodeCi/CdCoherenceHazelcastHibernateJavaJbossJdk 17JenkinsJSONJunitLinuxMavenMessage QueuesPci-DssRedisRestSafeScrumShell ScriptingSpringSpring BootSQLTomcat
What you need to know about the Dublin Tech Scene
From Bono and Oscar Wilde to today's tech leaders, Dublin has always attracted trailblazers, with more than 70,000 people working in the city's expanding digital sector. Continuing its legacy of drawing pioneers, the city is advancing rapidly. Ireland is now ranked as one of the top tech clusters in the region and the number one destination for digital companies, with the highest hiring intention of any region across all sectors.
