Integration: CircleCI
AI testing in CircleCI
Available
A CircleCI job runs npx aitp run and reads AITP_TOKEN from a project environment variable or context.
Add one job step to your CircleCI pipeline that runs npx aitp run with the tags you want, and pass AITP_TOKEN and your test credentials from CircleCI's secret store.
Exit codes follow the CLI: 0 pass, 1 fail, 2 healed steps pending review. The pipeline step fails on 1 and, with ci.failOnHealedPending: true, on 2.
Add --cloud to run in hosted browsers in the EU or US region, or leave it out to run in Chromium on the CI machine.
# AITP_TOKEN and test credentials come from CircleCI secretsnpx aitp run --tag smoke --cloudWhat CircleCI documents
- When you save test data using the store_test_results step, CircleCI collects data from XML files and uses it to provide insights into your job, including the Tests tab in the CircleCI web app. [CircleCI]
Questions
How do I run the tests in CircleCI?
Run npx aitp run --tag smoke --cloud in a job step, with AITP_TOKEN and test credentials as environment variables.
Where do I see the result?
In the job status, in the run report opened with npx aitp report --last, and as a triage card for each failed test.
Request early access
Early access: prices are the planned list prices. Billing starts when the platform enters beta; early-access use is not charged. We reply within 24 hours on business days.