Lead the adoption of AI technologies in QA processes, develop AI-augmented frameworks, and enhance software testing through AI methodologies.
Senior AI QA Automation Test Engineer
The Role:
We are seeking a Senior AI QA Automation Test Engineer to serve as our highest-level technical expert and hands-on innovator in the AI and testing space. This is a highly strategic, senior Individual Contributor (IC) role designed for an exceptional technologist. You will partner closely with internal QA leadership to drive the adoption of AI and Generative AI across the entire Software Development Life Cycle (SDLC).
As our core technical enabler, you will not be responsible for people management; instead, you will act as a force multiplier across the organization. You will architect complex, autonomous systems that fundamentally improve how we analyze requirements, assess risk, predict defects, and validate quality. You will build foundational frameworks, establish technical standards for evaluating AI-based solutions, and empower engineering teams to effectively leverage next-generation agentic QA workflows.
The main responsibilities of the position include:
- Acting as the primary technical enabler for the QA organization by building scalable AI/ML frameworks, libraries, and tooling that support broader engineering adoption
- Collaborating closely with QA, Data Science, and Engineering teams to ensure seamless integration of AI-driven testing capabilities within the CI/CD ecosystem
- Leading research and experimentation initiatives focused on emerging AI testing methodologies, tools, and best practices
- Mentoring and supporting engineers through hands-on collaboration, code reviews, technical workshops, and architectural guidance
- Designing and implementing advanced autonomous QA agents and workflows using modern AI orchestration frameworks and technologies
- Building sophisticated AI evaluation pipelines to assess reasoning quality, robustness, hallucination rates, fairness, and overall model reliability
- Developing resilient, AI-augmented, and self-healing automation frameworks capable of adapting to dynamic product and UI changes
- Implementing machine learning-driven analytics and intelligent quality engineering solutions, including predictive quality insights, root cause analysis, and smart test prioritization
Main requirements:
- BSc/MSc in Computer Science, Artificial Intelligence, or related discipline
- 8+ years of hands-on experience in AQA
- 1+ years of experience applying AI or ML technologies in software testing or QA process improvement
- A proven history of personally building and integrating AI/ML models into production workflows or SDLC processes
- Coding proficiency in Java/Python and/or TypeScript, with a deep, practical understanding of complex software architecture and distributed system design
- Hands-on experience designing and implementing complex AI agent architectures (LLM-as-a-judge, human-in-the-loop, RAG, multi-agent orchestration)
- Deep architectural knowledge of modern AI/ML tooling (LLMs, vector databases, MLOps pipelines)
- Strong background in integrating advanced tooling into enterprise CI/CD pipelines (GitLab, Jenkins, GitHub Actions) and containerized cloud-native environments (Docker, Kubernetes)
- Exceptional ability to communicate complex technical concepts clearly, influence engineering standards without direct authority, and collaborate effectively across disciplines
The following will be considered an advantage:
- Extensive experience with autonomous QA agents and agentic orchestration frameworks in building self-evolving test suites
- Expertise in high-fidelity AI evaluation pipelines and real-time observability (e.g., LangSmith, Arize) to measure probabilistic outcomes and adversarial robustness
- Knowledge of AI ethics, fairness, and bias detection in model validation
- Experience with gRPC, WebSockets, and HTTP/2
- Familiarity with cloud-native AI solutions (AWS Bedrock, GCP Vertex AI, Azure AI)
Benefit from:
- Attractive remuneration package
- Intellectually stimulating work environment
- Continuous personal development and international training opportunities
The Hiring Experience: What Awaits You
- Let’s Connect – Intro Chat with Talent Acquisition
- Deep Dive – First Interview with Your Future Team
- Final Connection – Final Interview
All applications will be treated with strict confidentiality!
Similar Jobs
Cloud • Security • Software • Cybersecurity • Automation
Lead end-to-end incident response for high-severity security events across cloud environments, perform DFIR investigations, build detection and automation (including AI-assisted) workflows, partner cross-functionally, produce executive communications and RCAs, maintain runbooks/playbooks, and mentor other engineers within a 24/7 global on-call model.
Top Skills:
Ai/MlAWSDetection EngineeringEdrGCPGitGitlabMitre Att&CkPythonScriptingSIEMSoarTelemetry
Aerospace • Artificial Intelligence • Machine Learning • Robotics • Software
Serve as the primary on-site customer-facing lead for Shield AI aircraft in Greece, managing integration, issue triage, cross-functional coordination, sustainment planning, logistics, and long-term customer adoption. Build trusted relationships, track customer health metrics, resolve technical and operational issues, and advocate field needs into product and sustainment priorities to ensure mission readiness and sustained use.
Top Skills:
CRMGroup 3-5 UasHivemindIssue Tracking ToolsLogistics And Sustainment ToolsV-BatX-Bat
Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Lead end-to-end recruitment for Experienced Hires across Greece and Central Europe. Partner with hiring managers to define requirements, source and assess candidates, manage candidate experience, build talent pools, and drive continuous improvement with TA leads and coordinators.
Top Skills:
ExcelMS OfficePhenomWorkday
What you need to know about the Dublin Tech Scene
From Bono and Oscar Wilde to today's tech leaders, Dublin has always attracted trailblazers, with more than 70,000 people working in the city's expanding digital sector. Continuing its legacy of drawing pioneers, the city is advancing rapidly. Ireland is now ranked as one of the top tech clusters in the region and the number one destination for digital companies, with the highest hiring intention of any region across all sectors.
