The Data Engineer will design and maintain data infrastructure, build scalable data pipelines, ensure data integrity, and integrate third-party data sources for analytical capabilities.
We are looking for an experienced Data Engineer to design and maintain robust data infrastructure across our systems. In this role, you will be responsible for building scalable data pipelines, ensuring data integrity, and integrating third-party data sources. Your primary focus will be to enable efficient data flow and support analytical capabilities across the organization. You will also contribute to the development of our data architecture, implement best engineering practices, and collaborate closely with cross-functional teams to turn raw data into actionable insights.
Responsibilities- Communicate with both technical and non-technical audiences to gather requirements
- Review and analyze data and logic to ensure consistency and accuracy
- Design, implement, and maintain data pipelines for efficient data flow
- Integrate and support of developed solutions
- Research and evaluate third-party components for potential use
- Follow best engineering practices: refactoring, code review, testing, continuous delivery, and Scrum
- Design, optimize, and support of data storage
Requirements
- At least 3+ years of experience in data engineering
- Experience in requirement gathering and communication with stakeholders
- Strong knowledge of DWH (data warehouse) architecture and principles
- Practical experience building ETL pipelines and designing data warehouses
- Deep experience with Python with a strong focus on PySpark
- Proficiency in SQL and databases such as PostgreSQL, ClickHouse, MySQL
- Hands-on experience with data scraping and integrating third-party sources and APIs
- Solid understanding of software design patterns, algorithms, and data structures
- Intermediate English proficiency
Will be a plus
- Experience with RabbitMQ or Kafka
- Understanding of web application architecture
- Familiarity with DataOps practices
- Background in FinTech or Trading domains
We offer
- 20 paid vacation days per year
- 10 paid sick leave days per year
- Public holidays as per the company's approved Public holiday list
- Medical insurance
- Opportunity to work remotely
- Professional education budget
- Language learning budget
- Wellness budget (gym membership, sports gear and related expenses)
Top Skills
Clickhouse
Kafka
MySQL
Postgres
Pyspark
Python
RabbitMQ
SQL
Similar Jobs
Artificial Intelligence • Productivity • Software • Automation
As a Data Engineer at Zapier, you'll build scalable data systems, enhance product functionality through data, and collaborate with teams to improve data access and usability.
Top Skills:
AWSAzureDatabricksGCPPythonSparkSQLTypescript
Cloud • Security • Software • Cybersecurity • Automation
Develop new features, review database changes, document best practices, and improve product performance in backend engineering focusing on data frameworks.
Top Skills:
KafkaNatsPostgresRubyRuby On Rails
Information Technology • Consulting
As a Data Engineer, you will design and implement big data solutions, analyze data for insights, and support data integration and API development.
Top Skills:
SparkAWSAzureAzure Data Lake StorageDatabricksDockerFast-ApiGCPPythonSQL
What you need to know about the Dublin Tech Scene
From Bono and Oscar Wilde to today's tech leaders, Dublin has always attracted trailblazers, with more than 70,000 people working in the city's expanding digital sector. Continuing its legacy of drawing pioneers, the city is advancing rapidly. Ireland is now ranked as one of the top tech clusters in the region and the number one destination for digital companies, with the highest hiring intention of any region across all sectors.
