SuperAPI AI Directory

Geek-skills-xuefeng-method

Agents & models

View repository

Updated 10-16 04:57

About this skill

Xuefeng Methodology: A Practical System for AI-Native Product Development

Core philosophy: strong model dependence × multi-specialist Agents × rapid calibration × behavior auditing

Source: Xuefeng — a serial AI-Native entrepreneur deeply engaged in AI-driven products such as AI calendar management. Core insight: exhaustive enumeration is an infinite loop; only speed wins is the way for AI-native to survive.

Mutually dual with the Keqian methodology (keqian-method): Keqian solves "how to make AI execute reliably within clear boundaries," Xuefeng solves "what to do when the boundaries themselves are uncertain."


Step Zero: Product Type Determination (must be done first)

Before choosing any development strategy, first determine your product type. Choosing the wrong methodology is more dangerous than having no methodology.

Type Characteristics Key judgment criteria Recommended method
+AI (scenario-dependent) User behavior is exhaustible; AI assists in executing deterministic processes Can list all valid input-output combinations → keqian-method
AI-native (strong model dependence) AI drives core decisions; user behavior is open-ended You cannot predict the user's next action → this skill
Hybrid Core processes are deterministic; some parts are AI-native Can break down which modules are deterministic and which are open → combine both, choose per module

Quick judgment checklist

Answer the following questions. If you answer "yes" to 3 or more, you are most likely AI-native:

  1. Is the user's input free text/voice rather than a selection menu?
  2. For the same input, do you want AI to give outputs in different styles?
  3. Will users change their subsequent behavior because of how AI responds?
  4. Are you unable to write a complete set of functional test cases for the product?
  5. Does the product's core value lie in AI's "judgment" rather than "execution"?

First Principle: Exhaustive Enumeration Is an Infinite Loop

"Exhaustive enumeration means: as much manual effort as there is, that much intelligence there is. This is an infinite loop."

Why exhaustive enumeration is infeasible in AI-native scenarios

In +AI scenarios, Keqian says "within boundaries it can be exhaustively enumerated; single-dimension options are limited"—this is correct. But the mathematics of AI-native scenarios is different:

用户行为空间(开放) × 模型输出空间(概率性) × 上下文状态(动态)
= 组合爆炸,不可穷举

How complex can calendar management be? The answer is: after taking the AI-native route,very complex. Because once users get used to AI-native interaction, they can never go back to the traditional mode— you must continuously adapt to users' ever-evolving expectations.

Three strategies to replace exhaustive enumeration

Strategy 1: Behavioral Clusters

Instead of enumerating every case, cluster user behavior patterns:

原始行为空间(不可穷举)
    ↓ 聚类
行为模式簇(5-15个典型模式)
    ↓ 每个模式簇
设计对应的AI响应策略
    ↓ 边界case
优雅降级到确定性逻辑

Strategy 2: Graceful Degradation

When AI is uncertain, fall back to deterministic logic:

AI置信度 > 阈值 → AI决策(快路径)
AI置信度 < 阈值 → 确定性回退(安全路径)
AI置信度极低 → 请求人工介入(慢路径)

Strategy 3: Probabilistic Acceptance

Do not use assert output == expected, while using check output ∈ acceptable_set:

# 传统断言式(克谦适用)
assert response == "会议安排在下午3点"

# 行为属性式(雪峰适用)
assert "下午" in response
assert contains_time(response)
assert tone_is_professional(response)
assert no_hallucinated_contacts(response)

Second principle: raise more specialized shrimp

"Raise two more shrimp, each fairly specialized, each doing only one kind of work. When a problem arises, it's easy to find the bug. A shrimp that can do everything comprehensively is very troublesome to troubleshoot when a problem arises."

Specialized Agent architecture

               ┌─ 理解Agent(NLU:解析用户意图)
               │
用户输入 → 路由器 ─┼─ 执行Agent(Action:调用API/修改数据)
               │
               ├─ 校验Agent(Verify:检查执行结果)
               │
               └─ 表达Agent(NLG:生成用户可见回复)

Each shrimpdoes only one kind of workbenefits:

  • When a bug occurs, you can precisely locate which shrimp is the problem
  • Upgrade/replace a single shrimp independently without affecting the others
  • Each shrimp can use the model that suits it best (routing strategy)

Split decision matrix

Condition Split? Reason
Functions are orthogonal, outputs do not depend on each other ✅ Execute in parallel without interfering with each other
Each has independent validation criteria ✅ Evaluate separately, locate precisely
Failure affects only the local part ✅ Retry locally, no need to scrap the whole thing
There is a context dependency chain ❌ Merging easily produces inconsistencies
You cannot precisely control context injection ❌ What to inject and how much must be precisely controlled
Merging results requires complex alignment ❌ Merging cost may exceed the benefit

Differences from Keqian's method

Dimension Keqian (single-agent extreme) Xuefeng (multiple specialized agents)
Default choice Sequential execution Parallel division of labor
Applicable scenarios Long-horizon tasks with dependency chains Independent modules with orthogonal functions
Error localization Trace back in a long chain Directly locate the shrimp that went wrong
Risk The longer the chain, the lower the multiplied probability May be inconsistent when merging

It's not about right or wrong, it's a different product type. They can also be mixed within the same product.


Third principle: speed is the only thing that cannot be broken

"You cannot predict user feedback and preferences after launch, so speed is the only thing that cannot be broken."

AI-Native rapid iteration loop

Phase 1: 行为属性测试(上线前)
├── 不是断言式测试,是属性检查
├── "输出合理吗?" 而非 "输出等于X吗?"
└── 通过 = 可以上线,不通过 = 还不够稳

Phase 2: 快速上线(MVP心态)
├── 不追求完美,追求"可接受"
├── 95%校准极难,先追求80%
└── 剩下的靠用户反馈补

Phase 3: 用户反馈 + 漂移检测
├── 收集:用户满意度、异常行为、投诉
├── 检测:模型输出分布是否偏移
└── 预警:漂移超过阈值 → 触发校准

Phase 4: 快速校准
├── 提示词迭代(最快)
├── 模型切换/升级(中等)
├── 微调/RLHF(最慢但最持久)
└── 下一轮上线 → 回到Phase 3

Iteration speed > single-pass quality

Strategy Single-pass quality Iteration speed AI-native applicability
Get it to 95% in one go Extremely high Extremely slow ❌ Unrealistic
Launch at 80% first, then iterate Medium Fast ✅ Recommended
Launch at 60% Low Extremely fast ⚠️ High risk, use with caution

Fourth principle: model selection in practice

"If it's not pure coding, try not to use the xxx-codex model; just switch to a general model." "Slower is fine, but it's reliable and not verbose."

Model routing decision tree

任务类型?
├── 纯代码编写 → codex系列
├── 代码+推理混合 → 通用旗舰模型(GPT-5.x / Claude Opus)
├── 自然语言理解/生成 → 通用模型
├── 多模态 → 专用多模态模型(如GLM-5V-Turbo)
└── 简单执行 → 轻量模型(省成本)

Dumb Zone protection

Models "get dumber" in long contexts, and the threshold differs by model:

Model category Threshold for entering the dumb zone Response strategy
International Top 2 (GPT/Gemini) Context window * 0.7~0.8 compact at 0.7
Domestic models (GLM-5.1, etc.) context window * 0.4~0.5 compact at 0.5

Iron rule: compact once the threshold is reached/compact, don't wait until intelligence degrades before remedying it.

Intelligent routing architecture (multi-model collaboration)

用户请求 → 复杂度评估器
              ↓
    ┌─ 简单请求 → 轻量模型(低成本)
    ├─ 中等请求 → 通用模型(平衡)
    └─ 复杂请求 → 旗舰模型(高质量)

Benefit: most requests use lightweight models, a few complex requests use flagship models, total cost is controllable.


Fifth principle: behavior auditing replaces quality gates

Keqian uses strict gates → cache hit flywheel. This is effective in deterministic output scenarios. AI-native output is probabilistic and requires a different quality strategy.

Quality strategy comparison

Dimension Keqian gates (deterministic) Xuefeng auditing (probabilistic)
Testing method assert output == expected check output ∈ acceptable_set
Failure handling Automatic repair → escalate to human Analyze drift causes → adjust strategy
Quality metrics Cache hit rate User satisfaction + model consistency
Iteration trigger Gate not passed User feedback + drift detection
Cost model High cache hit = low cost Route to suitable model = controllable cost

Behavior auditing implementation

定期(每日/每周)
├── 采样模型输出(N=100+)
├── 自动检查行为属性(格式、安全、一致性)
├── 人工抽检(关键决策质量)
├── 漂移检测(输出分布与基线对比)
└── 生成审计报告 → 决定是否触发校准

Drift detection signals

When the following signals appear, it indicates the model may be drifting:

  1. Output distribution shift: the output style/length/structure of similar inputs changes
  2. Increased user complaints: satisfaction metrics decline
  3. Increased abnormal behavior: timeouts, refusals, hallucinations increase
  4. Upstream/downstream inconsistency: output format or semantics between Agents are not aligned

Sixth principle: everything is user-centric

"The cost of AI-native is very high, which is everything being user-centric." "Once users get used to AI-native, they can never go back to the traditional mode."

User adaptability flywheel

用户使用AI-native产品
  → 用户期望提高(不接受传统交互)
  → 产品必须持续进化
  → 需要更强的模型 / 更好的校准
  → 用户体验提升
  → 用户期望进一步提高
  → …(正向循环,但也是成本螺旋)

Managing user expectations

  • Don't overpromise: AI-native is not omnipotent, clarify capability boundaries
  • Design graceful degradation: when AI is uncertain, give users the right to choose, rather than forcing an answer
  • Transparency: let users know what AI is doing, build trust
  • Feedback loop: let user feedback truly influence product iteration

Practical workflow templates

Starting a new AI-Native project

Phase 1: 产品定义(30%时间)
├── 判断产品类型(+AI / AI-native / 混合)
├── 定义行为模式簇(5-15个典型用户模式)
├── 设计优雅降级策略
└── 选择初始模型组合

Phase 2: 多专精Agent搭建(30%时间)
├── 拆分Agent职责(每只虾一种活)
├── 设计Agent间通信协议
├── 每只Agent独立eval
└── 集成测试(行为属性式)

Phase 3: 快速上线(10%时间)
├── MVP上线,不追求完美
├── 先覆盖80%的行为模式簇
└── 剩余20%用优雅降级兜底

Phase 4: 持续校准(30%时间,持续进行)
├── 用户反馈收集
├── 漂移检测 + 行为审计
├── 模型切换/提示词迭代
└── 下一轮上线

Daily operations rhythm

每日:
  - 查看漂移检测报告
  - 处理用户反馈中的高优问题
  
每周:
  - 行为审计(采样+属性检查+人工抽检)
  - 评估是否需要模型切换或提示词迭代
  
每月:
  - 回顾行为模式簇是否需要更新
  - 评估新模型是否值得切换
  - 成本分析(路由策略优化)

Complementary relationship with Keqian.skill

The two skills do not conflict,they can be used separately in different modules of the same product:

Product module Characteristics Recommended skill
Backend API Deterministic input and output keqian-method
Data processing pipeline Enumerable transformation rules keqian-method
AI conversation engine Open-ended user input xuefeng-method
AI recommendation system Probabilistic output xuefeng-method
CI/CD Pipeline Deterministic Process keqian-method
Model Routing/Orchestration Dynamic Decision-Making xuefeng-method

Summary of Key Principles

"多养两只虾,每只只干一种活" — 专精分工,出bug好找
"穷举是死循环" — 用行为模式簇替代穷举
"唯快不破" — 先上线再校准,不追求一次完美
"慢点就慢点,但牢靠" — 模型选择,稳定优先
"AI-native的代价很大" — 一切以用户为中心,没有退路
"做过就知道了" — 理论和实操差距巨大,动手验证

References

For more details, please refer to:

  • references/behavioral-clusters.md — Behavioral Pattern Cluster Design Method
  • references/drift-detection.md — Model Drift Detection and Calibration Protocol