Skip navigation and go to the main content
Careers @ Alloy Digital

Contract QA Engineer

Level
Senior
Location
Contract / Part-Time

Job Description

We're looking for a highly experienced Contract QA Engineer to supplement our existing QA team on a part-time, as-needed basis as we grow. This is a flexible engagement — hours and scope will vary based on active project load — making it ideal for a seasoned QA professional who wants meaningful, high-quality contract work alongside other commitments. You'll own quality assurance across our AI-first web and SaaS products, working closely with developers and product leads across active client engagements. This role demands someone equally fluent in automated and manual testing, deeply familiar with modern CMS platforms like Sanity, and who understands the unique challenges of testing AI-driven systems.

What you will do

  • Design and execute test plans, test cases, and test scripts covering functional, regression, exploratory, cross-browser, and edge-case scenarios across web and SaaS platforms
  • Build, maintain, and extend automated test suites using Selenium WebDriver and related frameworks
  • Develop and apply AI-specific QA strategies — validating prompt/response behavior, LLM output consistency, AI workflow integrity, and catching model-driven failure modes
  • Test and validate headless CMS implementations (Sanity and others) including content schemas, structured data, editorial workflows, and preview environments
  • Integrate automated tests into CI/CD pipelines and collaborate with engineers to establish quality gates
  • Write clear, reproducible bug reports and drive issues to resolution in partnership with development teams
  • Proactively identify gaps in test coverage and recommend improvements to tooling and process
  • Maintain QA documentation including test plans, test case libraries, and release coverage reports
  • Communicate QA status, risks, and sign-off clearly to project stakeholders in an async, remote environment
  • Support engineers during code reviews by reasoning about testability and potential failure surfaces

What we definitely need

Technical Requirements

  • 5+ years of QA experience with a strong focus on web applications and SaaS products
  • Proven, hands-on experience in AI-first development environments — testing AI features, LLM integrations, or AI-powered workflows
  • Expert-level proficiency with Selenium WebDriver for automated browser and end-to-end testing
  • Deep manual testing skills: functional, regression, exploratory, usability, accessibility, and cross-device/browser testing
  • Direct experience testing content management system implementations, particularly Sanity CMS or equivalent headless platforms
  • Solid understanding of web fundamentals: HTML, CSS, JavaScript, REST APIs, and browser developer tools
  • Experience integrating tests into CI/CD workflows using tools such as GitHub Actions, CircleCI, or similar
  • Comfortable reading and reasoning about code — able to review implementations and assess coverage independently
  • Ability to self-manage time, deliverables, and communication across async, distributed teams

Communication

  • Create and maintain comprehensive test plans and QA documentation for every project engagement
  • Provide timely, clear status updates and risk flags to project managers and engineering leads
  • Write thorough, reproducible bug reports with clear steps, expected vs. actual behavior, and supporting evidence
  • Attend and actively contribute to key project ceremonies including sprint planning, reviews, and retrospectives
  • Collaborate with developers during requirements and design reviews to identify testability concerns early
  • Accurately track and report time against tasks in project management tools
  • Identify and raise scope changes or conflicting requirements that affect QA coverage or timelines

Tools & Technologies

Testing

Selenium WebDriver, Playwright, Cypress

AI / LLM

Prompt testing, LLM output validation, AI workflow QA

CMS

Sanity, WordPress, Contentful, Butter

Frontend

React, Next.js, Gatsby, Vue

APIs

REST, GraphQL, Postman, browser DevTools

CI / CD

GitHub Actions, CircleCI, Vercel, Netlify

Bug Tracking

Jira, Linear, GitHub Issues

Cloud

AWS, Azure

Other

Git, Figma (design review), accessibility tools (axe, Lighthouse)

We're excited to get to know you!

Our simple form makes it easy to connect.

We proactively seek passionate individuals to craft amazing digital products.

Join our talent network.

Name (Required)
Email (Required)
Phone
Website, portfolio, or LinkedIn URL

PDF, DOCX, TXT accepted.

Message (Required)

What roles are you interested in? (Required)