SuperAPI AI Directory

local-llm-setup

Agents & models

View repository

Updated 10-16 08:00

About this skill

Primary Use Case: Mode B Task Delegation

Mode B is the fast path. run_agent.py sends a lean prompt directly to llama-server — no proxy overhead, no 29K system prompt. Measured: ~2s wall clock for a typical bounded task.

# Start llama-server (required for cli=llama)
python3 scripts/run_server.py
curl http://localhost:8089/health   # must return {"status":"ok"}

# Mode B task delegation — fast path (~2s)
time python3 scripts/run_agent.py agents/refactor-expert.md target.py output.md \
  "List the top 3 issues." --cli llama

# Mode B with custom max tokens
python3 scripts/run_agent.py /dev/null /dev/null /tmp/out.md \
  "Summarize this architecture decision." --cli llama --max-tokens 300

Available agent personas (pass as PERSONA_FILE):

Persona Role
agents/refactor-expert.md Code quality — SOLID/DRY smell taxonomy
agents/security-auditor.md OWASP vulnerability audit
agents/architect-review.md C4/SOLID structural review
agents/red-team-reviewer.md Adversarial exploit analysis
agents/compliance-reviewer.md Coding standards drift detection
agents/pr-reviewer.md Diff review — ship/hold decision
agents/test-writer.md Unit test generation
agents/debate-synthesizer.md Multi-perspective synthesis
agents/output-validator.md Output guardrail / hallucination check
agents/self-critic.md Reflection loop — task-fit check
agents/performance-analyst.md Bottleneck and scale analysis

Mode A (Optional — Interactive Proxy)

Mode A routes Claude Code itself through Gemma via a proxy. It carries ~29K tokens of system prompt overhead per session, making the first turn 30–60s. Not recommended for task delegation — use Mode B instead.

python3 scripts/enable_global_routing.py   # install launchd/systemd/NSSM daemon
python3 scripts/disable_global_routing.py  # remove daemon

Co-located Scripts (scripts/)

Script Purpose
run_server.py Start llama-server (authoritative params)
run_agent.py Task router — Mode B, 6 backends
enable_global_routing.py Install Mode A proxy daemon
disable_global_routing.py Remove Mode A proxy daemon
routing_proxy.py Mode A API compatibility proxy (port 4000)