We’re opening the position of a Senior Automation QA Engineer to work with our Client – a global leader in delivering advanced SaaS solutions for the energy sector, serving thousands of clients worldwide. Their offerings combine proprietary data, analytics, and software to empower high‑impact business decisions where accuracy, reliability, and trust are paramount. The Customer spans the entire energy value chain and depends on these solutions to navigate complex markets, optimize operations, and make informed strategic choices.
The project centers on a next‑generation AI platform that integrates deterministic workflows with generative AI capabilities, conversational interfaces, and autonomous agents. This platform enables users to explore proprietary datasets, uncover actionable insights, and support mission‑critical decisions in scenarios where correctness and trust are essential. The system blends traditional rule‑based logic with probabilistic AI models, requiring rigorous validation to ensure consistent, reliable outcomes in real‑world applications.
You will play a key role in advancing both manual and automated testing strategies for complex AI‑driven workflows and agent‑based systems. This position involves validating that AI features perform as intended within diverse operational contexts, ensuring dependable results even when underlying models are probabilistic. Working within a collaborative, cross‑functional team, you will influence quality standards, design robust test frameworks, and help shape the overall quality strategy for evolving, high‑impact software solutions.
Responsibilities:
- Manually test AI‑driven features, workflows, and autonomous agents to deeply understand system behavior, explore edge cases, and identify risk areas
- Evaluate AI‑powered workflows and autonomous agents, focusing on correctness, consistency, and user trust rather than strict deterministic outputs
- Use exploratory and risk‑based testing to assess probabilistic behavior, system boundaries, and failure modes in AI‑driven features
- Design, develop, and maintain automated tests across UI, API, and service layers
- Contribute to and evolve test automation frameworks and best practices
- Define and implement test strategies for multi‑step workflows that combine deterministic logic with AI behavior
- Validate system behavior across data‑driven, configuration‑based, and AI‑assisted use cases
- Partner with Engineering and Product teams to clarify expectations, identify risk areas, and improve testability of AI‑powered features
- Participate in issue triage, root cause analysis, and defect resolution, especially for subtle or non‑deterministic failures
- Help set quality standards for testing AI‑enabled workflows and agent behavior
- Mentor other QA Engineers and contribute to technical discussions and interviews
- Integrate testing (manual and automated) into CI/CD pipelines to support reliable releases
Requirements:
- 5+ years of experience in software quality assurance, with a strong focus on automation and exploratory testing
- Demonstrated strength in hands‑on manual testing of complex workflows and systems
- Experience testing AI‑powered features, including workflows or systems with probabilistic or non‑deterministic behavior
- Strong understanding of exploratory, risk‑based, and system‑level testing approaches
- Ability to evaluate AI‑driven behavior based on correctness, consistency, and user trust, rather than strict pass/fail outcomes
- Proficiency in JavaScript for test automation
- Experience working with modern test automation frameworks
- Hands‑on experience testing web applications and APIs
- Familiarity with CI/CD pipelines and automated tests execution
- Strong analytical and problem‑solving skills, with attention to subtle failures and edge cases
- Ability to clearly communicate quality risks, ambiguity, and confidence levels to Product and Engineering teams
- Bachelor’s degree in Computer Science or equivalent practical experience
- English level – Upper-Intermediate or higher
Will be a plus:
- Experience with performance, load, or security testing
We offer:
- Remote-first work model with flexible working hours (we provide all equipment)
- Comfortable and fully equipped offices in Lviv and Rzeszów
- Competitive compensation with regular performance reviews
- 18 paid vacation days per year + all state holidays
- 12 days of paid sick leave per year without a medical certificate + extra paid leave for blood donation
- Fixed monthly health & wellness compensation, applicable to: medical insurance; fitness and sports activities
- English, German, and Polish language courses
- Corporate subscription to learning platforms, regular meetups and webinars
- Friendly team that values accountability, innovation, teamwork, and customer satisfaction
- Inclusive environment where everyone feels valued and treated equally. We proudly partner with VeteranHub to support Ukrainian veterans
- We are committed to supporting Ukraine and actively participate in charity initiatives