SuperAPI AI Directory

quality-assurance-auditor

Testing & quality

View repository

Updated 10-16 02:32

About this skill

Preconditions
  • rigor_profile is submission.
  • All Qx reached G5.
  • Final consistency and completeness audits exist.
Audit Dimensions
  1. Workflow integrity

    • G1–G5 passed per Qx.
    • Human judgments trace to the decision ledger.
    • Main/baseline/fallback execution respected approved scope.
  2. Evidence integrity

    • No fabricated data, references, experiments, metrics, or figures.
    • Main claims trace to frozen numbers and robustness evidence.
    • Limitations and uncertainty are visible.
  1. Method quality

    • Baseline is usable.
    • Assumptions, units, objectives, constraints, and solution steps are coherent.
    • Output concentration/degeneracy and failure triggers were addressed.
  2. Paper quality

    • Problem, method, results, and conclusions align.
    • Claims are proportional to tested comparisons.
    • Human-owned physical meaning and contribution are present.
  3. Presentation

    • Required figures/tables exist and passed render checks.
    • Figure types are used correctly.
    • References are real, complete, and consistently cited.
    • AI-use disclosure follows the current contest profile and verified rules.
Workflow
  1. Read the two earlier audits and unresolved blockers.
  2. Sample canonical sources directly; do not trust summaries alone.
  3. Record blocking and nonblocking findings with artifact paths and repair owners.
  4. Save paper/qa_report.md.
  5. Set verdict:
    • PASSED
    • FAILED
    • NOT_RUN
Rules
  • Do not approve on partial audits.
  • Do not use artifact count or bullet count as a proxy for quality.
  • Do not repair issues inside QA.
  • Do not hide uncertainty or downgrade a blocker silently.
  • Do not claim compliance with time-varying contest rules without verification.
Verification
  • All five audit dimensions were evaluated.
  • Blocking findings are explicit and actionable.
  • QA verdict agrees with consistency/completeness verdicts and sampled evidence.
  • Final assembly is recommended only when all three audits pass.