The role involves designing and managing data platforms on Azure with Databricks, focusing on data governance, security, and cost optimization in a cloud architecture context.
Company Description
We are a Digital Product Engineering company that is scaling in a big way! We build products, services, and experiences that inspire, excite, and delight. We work at a scale — across all devices and digital mediums, and our people exist everywhere in the world (17500+ experts across 36 countries, to be exact). Our work culture is dynamic and non-hierarchical. We are looking for great new colleagues. That is where you come in!
Job Description- Cloud Architect for Azure Databricks designs and manages data platforms on Azure, leveraging Databricks for unified data science, engineering, and analytics, focusing on the two-plane architecture (Control & Data Planes), data governance (Unity Catalog), security (Entra ID, Key Vault), cost optimization, and building reliable Lakehouse solutions using Microsoft's Well-Architected Framework principles for data pipelines (Bronze, Silver, Gold layers) and integration with other Azure services like Synapse, Power BI, and Azure Monitor.
- Architecture Design: Designing end-to-end data solutions, from ingestion to consumption, using Databricks'''' Lakehouse Platform on Azure.
- Control Plane vs. Data Plane: Understanding the separation where Databricks manages the backend (Control Plane) while the customer owns the compute and data (Data Plane) within their Azure subscription, ensuring data residency and security.
- Data Governance: Implementing Unity Catalog for centralized access control, lineage, and security across data assets.
- Security & Identity: Integrating with Microsoft Entra ID (Azure AD) for SSO, using Azure Key Vault for secrets, and Microsoft Defender for Cloud for protection.
- Performance & Cost: Optimizing cluster configurations (classic vs. serverless), storage (ADLS Gen2), and resource usage for cost efficiency.
Must have Skills: Cloud development (Strong), Cloud architecture (Strong), Databricks
Top Skills
Adls Gen2
Azure
Azure Ad
Azure Key Vault
Azure Monitor
Databricks
Microsoft Defender For Cloud
Power BI
Similar Jobs
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
The Lead SRE Engineer will oversee infrastructure assessments, incident management, observe performance metrics, and enhance reliability through automation and collaboration with development teams.
Top Skills:
AnsibleChefDynatraceElkGrafanaJSONNetscoutOpentelemetryPrometheusSolarwindsSplunkTcpdumpTerraformWiresharkYaml
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
The Director of Site Reliability Engineering will lead SRE teams, manage infrastructure quality, mentor engineers, and drive operational excellence for payment systems.
Top Skills:
AutomationCloud PlatformsComputeContainerizationDatabasesInfrastructure OperationsInfrastructure-As-CodeMonitoringNetworkingObservabilitySite Reliability EngineeringStorageVirtualization
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
The role involves creating marketing content, managing social media platforms, organizing events, and collaborating with teams to ensure effective marketing execution.
Top Skills:
Adobe Creative SuiteContent Management SystemsFigmaGraphic Design ToolsSocial Media Platforms
What you need to know about the Dublin Tech Scene
From Bono and Oscar Wilde to today's tech leaders, Dublin has always attracted trailblazers, with more than 70,000 people working in the city's expanding digital sector. Continuing its legacy of drawing pioneers, the city is advancing rapidly. Ireland is now ranked as one of the top tech clusters in the region and the number one destination for digital companies, with the highest hiring intention of any region across all sectors.
