Contract QA Engineer
Job Description
We're looking for a highly experienced Contract QA Engineer to supplement our existing QA team on a part-time, as-needed basis as we grow. This is a flexible engagement — hours and scope will vary based on active project load — making it ideal for a seasoned QA professional who wants meaningful, high-quality contract work alongside other commitments. You'll own quality assurance across our AI-first web and SaaS products, working closely with developers and product leads across active client engagements. This role demands someone equally fluent in automated and manual testing, deeply familiar with modern CMS platforms like Sanity, and who understands the unique challenges of testing AI-driven systems.
What you will do
- Design and execute test plans, test cases, and test scripts covering functional, regression, exploratory, cross-browser, and edge-case scenarios across web and SaaS platforms
- Build, maintain, and extend automated test suites using Selenium WebDriver and related frameworks
- Develop and apply AI-specific QA strategies — validating prompt/response behavior, LLM output consistency, AI workflow integrity, and catching model-driven failure modes
- Test and validate headless CMS implementations (Sanity and others) including content schemas, structured data, editorial workflows, and preview environments
- Integrate automated tests into CI/CD pipelines and collaborate with engineers to establish quality gates
- Write clear, reproducible bug reports and drive issues to resolution in partnership with development teams
- Proactively identify gaps in test coverage and recommend improvements to tooling and process
- Maintain QA documentation including test plans, test case libraries, and release coverage reports
- Communicate QA status, risks, and sign-off clearly to project stakeholders in an async, remote environment
- Support engineers during code reviews by reasoning about testability and potential failure surfaces
What we definitely need
Technical Requirements
- 5+ years of QA experience with a strong focus on web applications and SaaS products
- Proven, hands-on experience in AI-first development environments — testing AI features, LLM integrations, or AI-powered workflows
- Expert-level proficiency with Selenium WebDriver for automated browser and end-to-end testing
- Deep manual testing skills: functional, regression, exploratory, usability, accessibility, and cross-device/browser testing
- Direct experience testing content management system implementations, particularly Sanity CMS or equivalent headless platforms
- Solid understanding of web fundamentals: HTML, CSS, JavaScript, REST APIs, and browser developer tools
- Experience integrating tests into CI/CD workflows using tools such as GitHub Actions, CircleCI, or similar
- Comfortable reading and reasoning about code — able to review implementations and assess coverage independently
- Ability to self-manage time, deliverables, and communication across async, distributed teams
Communication
- Create and maintain comprehensive test plans and QA documentation for every project engagement
- Provide timely, clear status updates and risk flags to project managers and engineering leads
- Write thorough, reproducible bug reports with clear steps, expected vs. actual behavior, and supporting evidence
- Attend and actively contribute to key project ceremonies including sprint planning, reviews, and retrospectives
- Collaborate with developers during requirements and design reviews to identify testability concerns early
- Accurately track and report time against tasks in project management tools
- Identify and raise scope changes or conflicting requirements that affect QA coverage or timelines
Tools & Technologies
Testing
Selenium WebDriver, Playwright, Cypress
AI / LLM
Prompt testing, LLM output validation, AI workflow QA
CMS
Sanity, WordPress, Contentful, Butter
Frontend
React, Next.js, Gatsby, Vue
APIs
REST, GraphQL, Postman, browser DevTools
CI / CD
GitHub Actions, CircleCI, Vercel, Netlify
Bug Tracking
Jira, Linear, GitHub Issues
Cloud
AWS, Azure
Other
Git, Figma (design review), accessibility tools (axe, Lighthouse)
We're excited to get to know you!
Our simple form makes it easy to connect.
We proactively seek passionate individuals to craft amazing digital products.
Join our talent network.
PDF, DOCX, TXT accepted.
What roles are you interested in? (Required)