Skip to content
View entire changelog

[BETA] Test Quality Agent that fixes flaky tests

New feature

Test Quality Agent now in Beta

A new agentic capability is now available in private beta that automatically identifies and fixes flaky tests in your CircleCI projects. This agent helps reduce debugging time by analyzing inconsistent test behavior and creating pull requests with validated solutions.

Read the full announcement and setup guide on Discuss

How it Works:

  • Identifies flaky tests with inconsistent pass/fail behavior
  • Generates and validates multiple solution attempts per test
  • Creates PRs only when solutions pass reliability validation
  • Provides detailed logs and code diffs for review

Beta Details:

  • No extra cost during beta (uses existing compute credits and AI provider tokens)
  • Join the waitlist for access
  • Feedback welcome at ai-feedback@circleci.com

Previous changes

Runner Release 3.1.5