SuperAPI AI Directory

tests

Testing & quality

View repository

Updated 10-16 08:45

About this skill

Testany test execution

Execute a Testany test Pipeline and monitor the results.

User input: $ARGUMENTS

Scope of responsibilities

  • Trigger Pipeline execution
  • Monitor execution status
  • Report execution results
  • Get execution log link

Note: Testany only supports executing Pipelines, not executing a single Case directly. To execute a single Case, first create a Pipeline that contains that Case.: Testany only supports executing Pipelines, not executing a single Case directly. To execute a single Case, first create a Pipeline that contains that Case.

Core knowledge

Execution status

Status Value Meaning Is terminal state
NOT_STARTED -1 Not started/queued No
RUNNING 0 Executing No
SUCCESS 1 All passed Yes
FAILURE 2 Has failures Yes
SKIPPED 3 Skipped (Case only) Yes
FAIL_AS_EXPECTED 4 Expected failure (Case only) Yes
CANCELLED 5 Canceled Yes
ERROR 99 System error Yes

Execution flow

1. testany_execute_pipeline → 触发执行,获取 execution_id
2. testany_get_execution → 轮询状态(每 5-10 秒)
3. 状态变为终态后 → 汇报结果
4. 如有失败 → testany_get_execution_case 获取详情

Workflow

  1. Confirm the target: Which Pipeline does the user want to execute?
  2. Find the resource:testany_list_pipelines Find the target Pipeline
  3. Trigger execution:testany_execute_pipeline
  4. Monitor status: poll testany_get_execution until terminal state
  5. Report results: number of successes/failures, list of failed cases

Polling strategy

  • Initial interval: 5 seconds
  • Maximum interval: 30 seconds
  • Timeout limit: depending on Pipeline complexity, usually 10-30 minutes

Return format

After the task is complete, report to the user:

  • Execution ID (e.g. Y2K-0001A-0000B)
  • Execution status (success/failure/timeout)
  • Number of passed cases
  • List of failed cases (if any)
  • Execution duration
  • Next-step suggestions (e.g. if failed, suggest "use /debug to troubleshoot the failure reason")

Reference documentation

For detailed concepts, please refer to: