The Principal Data Engineer will design and implement data solutions, ensuring high data quality and supporting business needs. Responsibilities include developing ETL pipelines, engineering best practices, and providing production support in a fast-paced environment. Expertise in various databases, ETL tools, and cloud services is essential.
Job Description:
The Data Engineer will design, develop, document, and implement end-to-end data solutions applying best engineering practices, testing, deployment, and providing production support. The incumbent will demonstrate technical skills in tools like Python, Snowflake, data analysis/modelling, ETL/ELT processes, and API development and maintenance to support diverse business customers. An ideal candidate is passionate about analysing data needs, aspiring to improve data quality, and contributing innovative solutions to our data platforms which includes cloud and/or on-premise infrastructure technologies.
The Expertise We’re looking for
- 8+ years of relevant experience in business intelligence, analytics or data process improvement
- Bachelor’s degree (e.g., Computer Science, Engineering, Statistics) / Master’s degree preferred
- Immediately apply Industry-leading analytics approaches and tools to transform data into insights
- Deliver high quality, timely, cost effective and maintainable software solutions in an agile environment with diverse a diverse tech stack to meet functional and non-functional business requirements
- Understand and develop highly scalable distributed systems in public Cloud
- Ability to develop and drive best engineering practices and data strategies as per the needs of the domain
- Partner with data practitioners and other stakeholders to address complex data challenges and troubleshoot data-related issues effectively.
- Build and maintain robust ETL pipelines to integrate data from multiple sources into OLAP data stores, ensuring data integrity and consistency.
- Bring an innovative spirit in search of efficiencies, process improvement opportunities, technical improvements, and other ways to add value to the organization with focus on operations improvement
- Production support in a 24x7 on-call rotation
Technical Skills key to this role:
- Relational database management expertise (Oracle, Snowflake, PostgreSQL)
- Extensive hands on experience with ETL/ELT tools (Informatica, Nifi, Snap logic)
- Expertise in Data Analysis, Data Profiling and Data Modelling skills
- Knowledge of Data Warehousing methodologies and concepts
- Extensive experience with ANSI SQL, database stored procedures, and performance tuning
- Proficiency in Snowflake DB using JavaScript, Python, and snowSQL; Snowflake features (Snow pipe, Data Sharing, etc.) and stay updated with the latest Snowflake features and best practices.
- Proficiency with python for data movement/transformation including development of classes and object oriented code
- Complex batch cycle orchestration (tools like Control-M, Autosys or Crontab)
- Implement best practices in data security, role-based access control, and data masking to maintain compliance and data governance standards
- Knowledge of Cloud platforms and Services (AWS – IAM, EC2, S3, Lambda, RDS)
- Knowledge of data streaming tools like Kafka, Kinesis
- Design experience of scalable data models, optimized for data ingestion and analytics requirements including SCD
- Developing and automating deployment with GIT, Jenkins, and CICD Processes
- Experience with REST APIs and in-memory technologies
Skills that are an advantage:
- Knowledge of non-RDBMS databases like Graph, No-SQL, Timeseries databases
- Working knowledge of analytics and BI front-end tools like Power BI, Tableau, and ThoughtSpot
- Financial Services experience
For more like this search #DE
Category:Information Technology
Top Skills
Ansi Sql
APIs
AWS
Ec2
Elt
ETL
Git
Iam
Informatica
Jenkins
Kafka
Kinesis
Lambda
Nifi
Oracle
Postgres
Python
Rds
Rest Apis
S3
Snap Logic
Snowflake
Snowsql
Fidelity Investments Dublin, Dublin, IRL Office
3007 Lake dr Citywest, Dublin, Dublin, Ireland, D24 N2HR
Similar Jobs
Cloud • Internet of Things • Software • App development • Automation
As an Inside Sales Manager, you will lead an Inside Sales Team to meet revenue targets by coaching, training, and developing sales skills. You will monitor team performance, conduct one-on-one meetings, and maintain productive relationships to ensure your team meets and exceeds quotas.
Cloud • Internet of Things • Software • App development • Automation
As an Inside Sales Manager, you will lead and coach a team of Inside Sales Representatives to meet revenue targets and develop their sales skills. Responsibilities include hiring, training, monitoring performance, and maintaining relationships within the team and with leadership.
Top Skills:
Consultative SalesSales ManagementSoftware Quality
Cloud • Internet of Things • Software • App development • Automation
The Account Executive will engage with customers to drive sales growth, manage complex sales cycles, maintain sales pipeline data, and collaborate with various teams to ensure product success, while building strong relationships with clients.
Top Skills:
BugsnagCucumberReadyapiSwaggerTestcompleteZephyr
What you need to know about the Dublin Tech Scene
From Bono and Oscar Wilde to today's tech leaders, Dublin has always attracted trailblazers, with more than 70,000 people working in the city's expanding digital sector. Continuing its legacy of drawing pioneers, the city is advancing rapidly. Ireland is now ranked as one of the top tech clusters in the region and the number one destination for digital companies, with the highest hiring intention of any region across all sectors.
