eBay Logo

eBay

Engineering Manager, Data & AI Platform

Posted 15 Days Ago
Be an Early Applicant
In-Office
Dublin, IRL
Senior level
In-Office
Dublin, IRL
Senior level
Lead architecture, scaling, and operation of eBay's batch and real-time data infrastructure. Oversee Spark/Hadoop batch ecosystem, Kafka/Flink streaming platform, lakehouse storage (Iceberg/Delta), security and governance, cost and capacity planning, SLA/SLO enforcement, and mentor platform engineers while aligning cross-functionally.
The summary above was generated by AI

At eBay, we're more than a global ecommerce leader — we’re changing the way the world shops and sells. Our platform empowers millions of buyers and sellers in more than 190 markets around the world. We’re committed to pushing boundaries and leaving our mark as we reinvent the future of ecommerce for enthusiasts.

Our customers are our compass, authenticity thrives, bold ideas are welcome, and everyone can bring their unique selves to work — every day. We're in this together, sustaining the future of our customers, our company, and our planet.

Join a team of passionate thinkers, innovators, and dreamers — and help us connect people and build communities to create economic opportunity for all.

We are seeking an experienced Engineering Manager for our Data Platform team to lead the architecture, scaling, and operation of our core data in

Position Overview

We are seeking an experienced Engineering Manager for our Data & AI Platform team to lead the architecture, scaling, and operation of our core data/AI infrastructure. In this role, you will manage a team of platform engineers responsible for several distinct, mission-critical pillars: our high-throughput batch eco-system, our real-time, low-latency streaming platform, our model training / finetuning system and our online/offline model inference system.

You will bridge the gap between deep technical infrastructure investments and strategic people leadership, ensuring our data lake / AI ecosystem is reliable, cost-efficient, and secure.

Key Responsibilities

Technical Vision & Infrastructure Ownership

  • Batch Processing Ecosystem: Direct the scaling, optimization, and upgrades of distributed batch computing infrastructure (e.g., Apache Spark ecosystem, Hadoop/HDFS).

  • Streaming Infrastructure: Own the reliability, partitioning strategies, and architecture of our event-driven streaming backbone (e.g., Apache Kafka, Flink) to power real-time analytics and microservices.

  • Storage & Lakehouse Evolution: Oversee the data storage layer, optimizing open table formats (e.g., Iceberg) for both fast stream writes and heavy batch analytical queries.

  • Machine Learning Infrastructure: Lead the design, scaling, and reliability of end-to-end ML and LLM platforms covering training and fine-tuning pipelines, model registry, batch and real-time inference, and online/offline serving. Optimize distributed training and LLM inference performance for low latency, high throughput, scalable model serving, and cost-efficient GPU utilization.

  • Security & Governance: Drive enterprise-grade data security initiatives, including automated compliance, data cataloging, and scalable column/row-level encryption framework deployment across both streaming and batch domains.

Operational Excellence & Financial Engineering

  • Infrastructure Efficiency: Lead cost-optimization and capacity-planning initiatives to manage massive cloud compute and storage footprints effectively.

  • SLA/SLO Accountability: Define and enforce strict availability, data freshness, and processing latency SLAs for downstream data consumers.

Team Leadership & Delivery

  • People Management: Mentor, coach, and grow senior and principal engineers specializing in distributed systems and data infrastructure.

  • Cross-Functional Alignment: Collaborate closely with Data Engineering, Data Science, Core Platform, and Product teams to treat the data & AI platform as an internal product, simplifying how other teams ingest, store, and consume data; speed up the new AI technology adoption in business use cases. 

Qualifications & Skills

Management & Leadership Experience

  • People Leadership: 3+ years of experience managing high-performing engineering teams in the data & AI platform, infrastructure, or distributed systems space.

  • Proven Track Record: Experience managing large-scale infrastructure migrations (e.g., Spark major version upgrades, cloud migrations, or moving from batch to real-time event streaming architectures).

Technical Domain Expertise

  • Batch Technologies: Deep technical depth in Apache Spark, Hadoop, and optimization of large-scale distributed jobs.

  • Streaming & Messaging: Expert-level understanding of Apache Kafka, Flink, or similar event-streaming and pub/sub patterns (including consumer group management, schema registries, and stream-processing windowing techniques).

  • Storage & Query Engines: Hands-on experience with modern lakehouse formats (Iceberg, Delta) and distributed SQL query engines (Trino/Presto).

  • Model Training Platforms & Pipelines: Expertise in building scalable, reproducible training/finetuning systems—covering data/feature ingestion, distributed training orchestration, experiment tracking, model registry, and CI/CD for ML (e.g., PyTorch, Ray, Kubernetes, MLflow).

  • Inference & Serving Infrastructure: Hands-on experience in deploying and operating low-latency, high-throughput model and LLM serving stacks, including AI control plane capabilities for model deployment, routing, policy enforcement, observability, traffic management, and cost-efficient inference operations using platforms such as Triton, vLLM, and Kubernetes.

  • Languages & Infrastructure: Strong foundations in Java, Scala, Python, or Go, along with infrastructure-as-code tooling (Kubernetes,Docker).

Additional Details

eBay is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, sex, sexual orientation, gender identity, veteran status, and disability, or other legally protected status. If you have a need that requires accommodation, please contact us at [email protected]. We will make every effort to respond to your request for accommodation as soon as possible. View our accessibility statement to learn more about eBay's commitment to ensuring digital accessibility for people with disabilities.


We use cookies to enhance your experience and may use AI tools for administrative tasks in the hiring process. To learn how we handle your personal data and use AI responsibly, please visit our Talent Privacy Notice, Privacy Center, and AI Hiring Guidelines.

eBay Dublin, Dublin, IRL Office

Dublin, Ireland

Similar Jobs

An Hour Ago
Easy Apply
Hybrid
Dublin, IRL
Easy Apply
Entry level
Entry level
Big Data • Cloud • Software • Database
Identify and qualify new opportunities for strategic EMEA accounts, run outbound campaigns, engage IT and business decision-makers, update Salesforce, set qualified meetings, nurture early opportunities, and exceed monthly/quarterly quotas while collaborating with partners and sales teams.
Top Skills: AWSDatabaseGCPAzureMongoDBMongodb AtlasOpen SourceSalesforceWeb Server
An Hour Ago
Easy Apply
Hybrid
Dublin, IRL
Easy Apply
Mid level
Mid level
Big Data • Cloud • Software • Database
Provide expert technical support and advisory to large MongoDB customers on architecture, performance, recovery, and security. Advocate customer needs to product teams, contribute to internal tooling and diagnostics, and operate across the MongoDB ecosystem including Atlas and Cloud Manager.
Top Skills: AtlasAWSAzureCC#C++Cloud ManagerDatabase DriversFirewallsGoGoogle Cloud PlatformJavaJavaScriptLinuxLoad BalancersMongoDBNode.jsPerlPHPPythonRubyWindows
An Hour Ago
In-Office
Dublin, IRL
Senior level
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Lead a global exploratory ideation team within Payment Integrity to identify, validate, and convert new medical cost savings opportunities. Own pipeline prioritization, governance, financial reporting, forecasting, and delivery against savings targets. Partner with Product, Operations, and enablement teams to operationalize concepts into production and communicate progress and risks to senior leadership.

What you need to know about the Dublin Tech Scene

From Bono and Oscar Wilde to today's tech leaders, Dublin has always attracted trailblazers, with more than 70,000 people working in the city's expanding digital sector. Continuing its legacy of drawing pioneers, the city is advancing rapidly. Ireland is now ranked as one of the top tech clusters in the region and the number one destination for digital companies, with the highest hiring intention of any region across all sectors.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account