QA Analyst - AI Solutions (Portugal-based Remote/Hybrid) Porto

Overview

QA Analyst - AI Solutions (Portugal-based Remote/Hybrid) at Sword Health. This role focuses on quality assurance for AI Agents used in healthcare, from
- launch validation to
- deployment improvement.

What you’ll be doing

• Ensure AI agents perform consistently before and after going live
• Monitor performance across different healthcare environments and languages
• Collaborate with the clinical team to define monitoring parameters
• Establish quality standards for AI systems
• Trace when AI Agents do not follow the defined protocol and fix underlying prompt logic and reasoning
• Create new testing methods to prevent similar issues
• Test systems designed to be intelligent and adaptive; build testing frameworks for diverse healthcare scenarios
• Define what "good enough" means for AI in healthcare
• Manage compliance with MDR and AI Act requirements with the compliance team
• Document quality processes and verification/validation procedures for regulatory submissions
• Ensure algorithms perform with expected accuracy and do not exhibit bias
• Work with compliance teams to achieve and maintain certification of relevant algorithms
• Help establish industry standards for AI quality assurance

What you need to have

• Comfortable speaking and understanding English
• 2–6 years of experience in QA, testing, or analytical roles
• Strong analytical and
  - solving skills
• Comfortable learning new technologies and methodologies
• Curious about the evolving AI landscape

What we would love to see

• Familiarity with secure handling of health data (GDPR, HIPAA)
• Experience with medical device regulations (MDR, 21 CFR 820, ISO 13485, IEC62304)
• Comfortable speaking and understanding Portuguese
• Experience with AI tools or prompt engineering
• Background in healthcare, enterprise software, or regulated industries
• Familiarity with quality metrics and monitoring systems
• Basic programming or scripting experience

Benefits (Portugal - Sword)

• Health, dental and vision insurance
• Meal allowance
• Equity shares
• Remote work allowance
• Flexible working hours
• Work from home
• Discretionary vacation
• Snacks and beverages
• English class

Notes

Please note that this position does not offer relocation assistance. Candidates must possess a valid EU visa and be based in Portugal.

Sword Health complies with applicable civil rights laws and does not discriminate on the basis of age, ancestry, color, citizenship, gender, gender identity, marital status, medical condition, national origin, disability, pregnancy, race, religion, sexual orientation, or veteran status.

Employment details

• Seniority level: Not Applicable
• Employment type: Full-time
• Job function: Quality Assurance
• Industry: Software Development

Note on application

Referrals increase your chances of interviewing. Get notified about new Quality Assurance Analyst jobs in Porto, Portugal.