QA Engineer (Senior/Lead) ID35731 Porto

QA Engineer (Senior/Lead) ID35731
Porto
Porto, Porto District, Portugal

Client:

Agile
Engine

Location:

Porto, Portugal

Job Category:

Other

-

EU work permit required:

Yes

Job Reference:

c5dc3b998d5e

Job Views:

4

Posted:

24. 06. 2025

Job Description:

Job Description

Agile
Engine is one of the Inc. 5000
- growing companies in the US and a
- 3 ranked dev shop according to Clutch. We create
- winning custom software solutions that help companies across 15+ industries change the lives of millions.

If you like a challenging environment where you’re working with the best and are encouraged to learn and experiment every day, there’s no better place - guaranteed! :)

WHAT YOU WILL DO

• Architect and oversee
  -
  - end test strategies across different layers in the testing pyramid;
• Define, evaluate, and monitor model validation criteria, including accuracy threshold, confidence scoring, fallback behaviors, etc. ;
• Drive the automation of QA processes, ensuring robust, scalable processes for data ingestion, extraction, and classification;
• Lead the validation integration points between AI components and business logic, identifying risks and ensuring seamless operation;
• Own, maintain, and evolve the test infrastructure, specifically the CI/CD quality gates, data generation, and automated validation scripts;
• Establish and monitor key quality metrics aligned with the business goals, including turnaround time, confidence scores, and user corrections;
• Act as a strategic partner to Product and Engineering, and advocate for quality from design through delivery;
• Keep up with the latest AI tech and how to best apply the latest advancements to make the previously impossible possible for our customers;
• Sense of ownership, take ownership of code quality through exploratory and automated tests.

MUST HAVES

• Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field experience;
• 5+ years in AQA, Software Test Engineering, or related roles, including leadership responsibilities;
• Experience in AQA Javascript;
• Solid knowledge of software development life cycle (SDLC), Agile methodologies, and Quality Assurance or Quality Engineering methodologies;
• Proven experience building and scaling test automation frameworks (e. g. , Pytest, Cypress, Selenium, Postman, etc. ). Strong technical skills with REST APIs, data, pipelines, and backend services;
• Strong technical background with APIs, CI/CD pipelines, backend services, and cloud environments (AWS, Azure);
• Exceptional attention to detail, with a mindset for building robust systems that catch issues early and protect the customer experience;
• Demonstrated fast, proactive learning skills, especially crucial in the rapidly changing field of AI;
• Upper-Intermediate English level.

NICE TO HAVES

• Experience testing AI/ML in production environments;
• Experience with Gen
  AI model evaluation metrics;
• Experience setting up proactive monitoring and alerting systems to catch issues like model drift, performance degradation, or workflow failures.

THE BENEFITS OF JOINING US

• Professional growth: Accelerate your professional journey with mentorship, Tech
  Talks, and personalized growth roadmaps.
• Competitive compensation: We match your
  - growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities.
• A selection of exciting projects: Join projects with modern solutions development and
  - tier clients that include Fortune 500 enterprises and leading product brands.
• Flextime: Tailor your schedule for an optimal
  - life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive.

Your application doesn't end here! To unlock the next steps, check your email and complete your registration on our Applicant Site. The incomplete registration results in the termination of your process.

Requirements

• Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field experience;
• 5+ years in AQA, Software Test Engineering, or related roles, including leadership responsibilities;
• Experience in AQA Javascript;
• Solid knowledge of software development life cycle (SDLC), Agile methodologies, and Quality Assurance or Quality Engineering methodologies;
• Proven experience building and scaling test automation frameworks (e. g. , Pytest, Cypress, Selenium, Postman, etc. ). Strong technical skills with REST APIs, data, pipelines, and backend services;
• Strong technical background with APIs, CI/CD pipelines, backend services, and cloud environments (AWS, Azure);
• Exceptional attention to detail, with a mindset for building robust systems that catch issues early and protect the customer experience;
• Demonstrated fast, proactive learning skills, especially crucial in the rapidly changing field of AI;
• Upper-Intermediate English level.

Please note that if you are NOT a passport holder of the country for the vacancy you might need a work permit. Check our Blog for more information.

Bank or payment details should not be provided when applying for a job. Eurojobs.com is not responsible for any external website content. All applications should be made via the 'Apply now' button.