At eBay, we're more than a global ecommerce leader — we’re changing the way the world shops and sells. Our platform empowers millions of buyers and sellers in more than 190 markets around the world. We’re committed to pushing boundaries and leaving our mark as we reinvent the future of ecommerce for enthusiasts.
Our customers are our compass, authenticity thrives, bold ideas are welcome, and everyone can bring their unique selves to work — every day. We're in this together, sustaining the future of our customers, our company, and our planet.
Join a team of passionate thinkers, innovators, and dreamers — and help us connect people and build communities to create economic opportunity for all.
Data EngineerAbout the team and the role:
We are looking for a Data Engineer (location Dublin, Ireland) to join the Cloud Data Technology team based in Dublin.
We are part of the Data and Metrics team at eBay, tasked with managing data within the Data Warehouse (DWH) for the Customer Support applications. Our team utilizes various tools(third party, open source) in creating and integrating data from these systems. We manage over 800 tables in the DWH. Our approach is distinctive, as we continuously seek to improve our platform, thereby enhancing our ability to drive business opportunities. We embrace rapid experimentation, learning from our failures, and swiftly iterating based on these learnings.
What you will accomplish:
Architectural Leadership: Design and enhance our data architecture to support real-time and batch processing with a focus on scalability and fault tolerance using Kafka, Flink, and lakehouse principles.
Data Managemnet: Classify data according to its sensitivity and importance. Establishing clear classification guidelines helps in managing data access and ensuring compliance with regulatory requirements.
Pipeline Automation: Develop and maintain automated data pipelines that ensure efficient data flow and processing from multiple sources to our lakehouse architecture.
Cross-functional Collaboration: Work closely with data scientists, business analysts, and other engineering teams to define and refine requirements that drive data solutions.
Innovation and Research: Stay abreast of the latest industry developments in data engineering and propose adoption of new technologies or methodologies to keep our data infrastructure ahead of the curve.
What you will bring:
-
Design, build, and maintain scalable data pipelines using Python, Apache Spark, Hadoop, Unix Shell Scripting and SQL.
-
Extensive experience in working with Python, SQL and Unix Shell scripting
-
Proficiency in Hadoop ecosystem such as Hive, Iceberg, Spark.
-
Proven ability to Develop and optimize ETL processes to support data integration and analytics.
-
Good to have experience with Apache Kafka, Apache Flink, and other relevant streaming technologies.
-
Nice to have experience in Java and scala programming (not Mandatory)
-
Collaborate with cross-functional teams to understand data requirements and deliver solutions.
-
Ensure data quality and integrity through robust monitoring and validation processes.
-
Excellent Troubleshooting skills to resolve data-related issues in a timely manner.
#LI-AZ1
#LI-Hybrid
Please see the Talent Privacy Notice for information regarding how eBay handles your personal data collected when you use the eBay Careers website or apply for a job with eBay.
eBay is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, sex, sexual orientation, gender identity, veteran status, and disability, or other legally protected status. If you have a need that requires accommodation, please contact us at [email protected]. We will make every effort to respond to your request for accommodation as soon as possible. View our accessibility statement to learn more about eBay's commitment to ensuring digital accessibility for people with disabilities.
This website uses cookies to enhance your experience. By continuing to browse the site, you agree to our use of cookies. Visit our Privacy Center for more information.
