QA Engineer (Senior) ID35731 Porto

QA Engineer (Senior) ID35731
Porto
Porto, Porto District, Portugal

Join to apply for the QA Engineer (Senior) ID35731 role at Agile
Engine

2 days ago Be among the first 25 applicants

Join to apply for the QA Engineer (Senior) ID35731 role at Agile
Engine

Get AI-powered advice on this job and more exclusive features.

Agile
Engine is one of the Inc. 5000
- growing companies in the US and a
- 3 ranked dev shop according to Clutch. We create
- winning custom software solutions that help companies across 15+ industries change the lives of millions.

If you like a challenging environment where you’re working with the best and are encouraged to learn and experiment every day, there’s no better place - guaranteed! :)


WHAT YOU WILL DO

- Architect and oversee
-
- end test strategies across different layers in the testing pyramid;
- Define, evaluate, and monitor model validation criteria, including accuracy threshold, confidence scoring, fallback behaviors, etc. ;
- Drive the automation of QA processes, ensuring robust, scalable processes for data ingestion, extraction, and classification;
- Lead the validation integration points between AI components and business logic, identifying risks and ensuring seamless operation;
- Own, maintain, and evolve the test infrastructure, specifically the CI/CD quality gates, data generation, and automated validation scripts;
- Establish and monitor key quality metrics aligned with the business goals, including turnaround time, confidence scores, and user corrections;
- Act as a strategic partner to Product and Engineering, and advocate for quality from design through delivery;
- Keep up with the latest AI tech and how to best apply the latest advancements to make the previously impossible possible for our customers;
- Sense of ownership, take ownership of code quality through exploratory and automated tests.

MUST HAVES

-Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field experience;
- 5+ years in AQA, Software Test Engineering, or related roles, including leadership responsibilities;
- Experience in AQA Javascript;
- Solid knowledge of software development life cycle (SDLC), Agile methodologies, and Quality Assurance or Quality Engineering methodologies;
- Proven experience building and scaling test automation frameworks (e. g. Pytest, Cypress, Selenium, Postman, etc. ). Strong technical skills with REST APIs, data, pipelines, and backend services;
- Strong technical background with APIs, CI/CD pipelines, backend services, and cloud environments (AWS, Azure);
- Exceptional attention to detail, with a mindset for building robust systems that catch issues early and protect the customer experience;
- Demonstrated fast, proactive learning skills, especially crucial in the rapidly changing field of AI;
- Uppper-Intermediate English level.

NICE TO HAVES

- Experience testing AI/ML in production environments;
- Experience with Gen
AI model evaluation metrics;
- Experience setting up proactive monitoring and alerting systems to catch issues like model drift, performance degradation, or workflow failures.

THE BENEFITS OF JOINING US

- Professional growth: Accelerate your professional journey with mentorship, Tech
Talks, and personalized growth roadmaps.

- Competitive compensation: We match your
- growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities.

- A selection of exciting projects: Join projects with modern solutions development and
- tier clients that include Fortune 500 enterprises and leading product brands.

- Flextime: Tailor your schedule for an optimal
- life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive.


Your application doesn't end here! To unlock the next steps, check your email and complete your registration on our Applicant Site. The incomplete registration results in the termination of your process.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Industries

  IT Services and IT Consulting

Referrals increase your chances of interviewing at Agile
Engine by 2x

Sign in to set job alerts for “Senior Quality Assurance Engineer” roles.

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.