SuperAPI AI Directory

update-cli-models

Coding & development

View repository

Updated 10-16 08:00

About this skill

update-cli-models: Model Catalog Update Protocol

When triggered, execute all steps below in order. This is an active update run — not a reference. Fetch live data, diff against current JSON files, write changes, and sync at the end.


Reference Files (master copies — only these are ever edited directly)

File CLI Key field
plugins/cli-agents/references/copilot-models.json copilot cli_id uses dot notation e.g. claude-sonnet-4.6
plugins/cli-agents/references/agy-models.json agy Gemini models with thinking levels
plugins/cli-agents/references/claude-models.json claude cli_id uses dash notation e.g. claude-sonnet-5 — more models than Copilot
plugins/cli-agents/references/codex-models.json codex OpenAI models via codex CLI
plugins/cli-agents/references/cheapest_models.json all Master cheapest pick per backend
plugins/cli-agents/references/cheapest_models.md all Master human-readable cheapest + Copilot tier table

Copies under individual skills are never edited directly — the sync script handles them.


Step 1 — Fetch current data from official sources

Fetch each source using read_url_content. Use the markdown API endpoints where available — do NOT scrape raw HTML.

CLI Fetch URL
copilot pricing https://docs.github.com/api/article/body?pathname=/en/copilot/reference/copilot-billing/models-and-pricing
copilot model IDs https://docs.github.com/api/article/body?pathname=/en/copilot/reference/ai-models/supported-models
agy (Gemini) https://ai.google.dev/pricing
claude https://platform.claude.com/docs/en/about-claude/models/overview
codex (OpenAI) Try https://openai.com/api/pricing/ — if 403, use search_web for "OpenAI API pricing [current year] per million tokens"

For each source extract:

  • Exact CLI identifier (not display name)
  • Input / output price per 1M tokens
  • Cached input price
  • Cache write cost (Anthropic only)
  • Context window (if available)
  • Long context pricing tiers and thresholds
  • Status: GA / preview / withdrawn / deprecated

Step 2 — Diff against current JSON and update

For each CLI backend, compare fetched data to the current JSON:

New model? → Add full entry to models[] array, add to appropriate cost_tiers bucket.

Price changed? → Update pricing_usd_per_1m and credits_per_1m fields.

Model withdrawn/deprecated? → Set "status": "withdrawn" or "status": "deprecated", "available": false. Do NOT delete the entry.

Long context tier missing? → Add long_context_pricing_usd_per_1m field with threshold_note.

After any changes, update _meta.updated to today's date on that JSON file.

CLI-specific rules

  • copilot: Claude IDs use dots (claude-sonnet-4.6). Prices in AI Credits (credits_per_1m). See _meta.credits_formula.
  • claude: Claude IDs use dashes (claude-sonnet-5). Has more models than Copilot — the files intentionally differ.
  • agy: Each thinking level (Low/Med/High) is a separate cli_id entry. Do not collapse them.
  • codex: OpenAI models only. Matches OpenAI API pricing (not Copilot AI Credits).

Step 3 — Check if cheapest pick has changed

Compare current cheapest_models.json entries against what Step 1 found:

CLI Current cheapest Verification question
copilot gpt-5.4-nano (20 cr/1M input) Is there anything cheaper in the catalog?
agy gemini-3.5-flash (Low) Is Flash (Low) still the cheapest Gemini?
claude claude-haiku-4-5 ($1/1M input) Is Haiku still cheapest current Claude?
codex gpt-5-mini ($0.25/1M input) Is there anything cheaper?
llama gemma-4-12b (free, self-hosted) Always free — no change expected

If cheapest changed for any CLI:

  1. Edit plugins/cli-agents/references/cheapest_models.json — update model and description
  2. Edit plugins/cli-agents/references/cheapest_models.md — update main table row; if Copilot changed, update the Copilot tiers table too

Step 4 — Run sync script

After ALL JSON updates are done, run:

python3 plugins/cli-agents/scripts/sync_cheapest_models.py

Verify output shows updated: N files with no errors. This propagates the master cheapest_models.json and .md to all copies across the repo.


Step 5 — Report

Summarise what changed:

✅ update-cli-models complete — [DATE]

Updated JSON files:
  - copilot-models.json: [N new models, M price changes]
  - agy-models.json: [changes or "no changes"]
  - claude-models.json: [changes or "no changes"]
  - codex-models.json: [changes or "no changes"]

Cheapest model changes:
  - [cli]: [old model] → [new model]  (or "no changes")

Sync: [N] copies of cheapest_models updated across repo.

Common Failures

  • Display name vs CLI ID: Copilot shows "GPT-5.4 nano" — CLI arg is gpt-5.4-nano. Always use CLI identifier.
  • Dot vs dash notation: claude-sonnet-4.6 (Copilot) ≠ claude-sonnet-4-6 (direct API). Wrong notation silently fails at runtime.
  • agy thinking levels: gemini-3.5-flash (medium) ≠ gemini-3.5-flash-low. Separate cli_id entries.
  • Long context pricing: Always capture both tiers when a model has them.
  • OpenAI 403: openai.com/api/pricing/ blocks fetchers. Use search_web fallback.
  • Symlinks: Some copies of cheapest_models.json are symlinks — sync_cheapest_models.py skips them automatically.
  • Do not delete entries: Mark withdrawn models with "available": false, "status": "withdrawn". Deletion breaks history.