Build and optimize scalable data pipelines and cloud-based data solutions using Python, PySpark, SQL, and Snowflake. Integrate REST APIs and external data sources, develop ETL/ELT workflows, optimize Snowflake queries, and implement data quality, validation, monitoring, and automation. Collaborate with engineering and analytics teams to deliver reliable data platforms.
Job Description
Data Engineer - Python, PySpark, SQL, Snowflake & API Integration
Job Description:
We are seeking a skilled Data Engineer with strong hands-on experience in Python, PySpark, SQL, Snowflake, and API integrations to build scalable data pipelines and cloud-based data solutions.
Key Responsibilities:
- Design, develop, and optimize data pipelines using Python, PySpark, SQL, and Snowflake.
- Integrate REST APIs and external data sources into Snowflake-based data platforms.
- Build and maintain ETL/ELT workflows for data ingestion, transformation, and processing.
- Develop efficient SQL queries and optimize Snowflake performance.
- Implement data quality, validation, monitoring, and automation.
- Collaborate with engineering and analytics teams to deliver reliable data solutions.
Required Qualifications:
- 3+ years of experience in Data Engineering.
- Strong hands-on expertise in Python, PySpark, SQL, and Snowflake.
- Experience with REST APIs, JSON, and API-based data integration.
- Knowledge of ETL/ELT processes, data modeling, and data warehousing.
- Experience with cloud platforms such as AWS, Azure, or GCP is preferred.
Additional Information
All your information will be kept confidential according to EEO guidelines.
Similar Jobs
Cloud • Security • Software • Cybersecurity • Automation
Own and expand a mid-market Canadian customer portfolio for GitLab’s AI-powered DevSecOps platform. Responsibilities include prospecting, pipeline development, value-based selling, complex sales cycles, forecasting, customer adoption, churn reduction, negotiations, closing, and expansion. The role partners with sales development, solutions consulting, customer success, renewals, marketing, technical teams, and partners while communicating customer insights and supporting territory planning.
Top Skills:
AICommand Of The MessageDevsecopsGitlabMeddpiccSaaS
Big Data • Fintech • Mobile • Payments • Financial Services
Build and operate scalable AI platform infrastructure, including LLM and MCP gateways, agent runtimes, evaluation services, routing, quotas, observability, and security controls. Own projects from design through launch and on-call, establish technical standards, collaborate with security and infrastructure teams, and mentor engineers. Develop highly available distributed backend systems supporting AI workloads across Affirm’s financial products and engineering organization.
Top Skills:
Ai FrameworksAWSAws BedrockChatgptClaudeKotlinKubernetesLitellmLlmsMcpMySQLPython
Cloud • Security • Software • Cybersecurity • Automation
Leads global compensation programs, including merit, promotion, equity, and bonus cycles, from design through closeout. Defines calendars, controls, documentation, communications, and success measures; analyzes compensation data; partners with Finance on budgeting and reconciliation; advises People teams and leaders; maintains compliance and audit controls; and improves compensation workflows, systems, transparency, and team member experience.
Top Skills:
Compensation Planning ToolsHuman Resources Information Systems (Hris)macOSPaveSpreadsheet SoftwareWorkday
What you need to know about the Dublin Tech Scene
From Bono and Oscar Wilde to today's tech leaders, Dublin has always attracted trailblazers, with more than 70,000 people working in the city's expanding digital sector. Continuing its legacy of drawing pioneers, the city is advancing rapidly. Ireland is now ranked as one of the top tech clusters in the region and the number one destination for digital companies, with the highest hiring intention of any region across all sectors.
