Program Manager - Content QA

Program Manager Content QA

This role supports a high-impact content quality and AI evaluation team focused on delivering high-quality, reliable content experiences across productivity platforms. The Quality Analyst will validate AI-generated outputs, assess content performance, and ensure consistency across templates, prompt-based content, and emerging AI-driven experiences.

This position plays a key role in improving customer experience by driving quality assurance processes for next-generation content solutions.

Required Skills & Qualifications

Education

• Bachelor's degree in Computer Science, Engineering, Information Systems, Content Automation, or a related technical field

Experience

• Proven experience in quality assurance, content testing, or usability testing
• Demonstrated ability to create test plans, test cases, and test reporting documentation
• Experience working with structured testing methodologies and quality frameworks

Core Skills

• Strong analytical and problem-solving capabilities
• Experience with scripting languages such as Python, PowerShell, or similar
• Understanding of productivity tools and digital content ecosystems
• Ability to communicate complex findings clearly to technical and non-technical stakeholders
• Strong attention to detail with a focus on content accuracy and user experience

Candidate Requirements

• Consistent employment history demonstrating stability and reliability
• Ability to work aligned to Pacific Time hours in a remote environment
• Supplier-provided equipment (standard PC required)
• Strong communication skills with the ability to articulate testing outcomes and recommendations

Assessment Process

• One to two interview rounds (30 to 45 minutes each)
• Technical and experiential evaluation focused on:
• Quality assurance methodologies
• Content testing experience
• Test planning and reporting capabilities
• Candidates should be prepared to discuss prior projects and demonstrate applied experience

Performance Measurement

Success in this role will be evaluated based on:

• Volume and quality of executed test cases
• Effectiveness and accuracy of test coverage
• Timely delivery against milestones and deadlines
• Proactive communication regarding risks and blockers
• Ability to translate data into clear, actionable insights and recommendations

Key Responsibilities

Content Testing and Quality Assurance

• Develop and execute test plans for templates, prompt templates, and AI-generated content
• Perform manual and automated testing across productivity applications and content experiences
• Validate content quality, usability, accessibility, functionality, and visual/design alignment
• Identify, document, and track defects through resolution

AI Content Evaluation

• Evaluate AI-generated outputs against predefined quality standards
• Assess accuracy, formatting, usability, and overall effectiveness
• Provide actionable recommendations to improve content and model performance

Test Development and Execution

• Create and maintain test cases, scripts, validation frameworks, and documentation
• Establish scalable and repeatable testing methodologies
• Collaborate with cross-functional teams to identify automation opportunities

Reporting and Insights

• Analyze test results and communicate findings to stakeholders
• Identify recurring issues, trends, and improvement opportunities
• Ensure findings are reflected in documentation and ongoing workflows

Unique Selling Points

• Opportunity to influence and validate next-generation content and AI-driven experiences
• Direct impact on large-scale customer-facing productivity tools and platforms
• Exposure to advanced AI content workflows and evaluation methodologies
• Cross-functional collaboration with content, engineering, and product teams
• Ability to drive improvements that enhance both content quality and user experience at scale