Probe structure, not just outputs.
Intake
Clarify:
- which layer/embedding/state is being probed;
- what property should be represented;
- available labels or proxy labels;
- suspected failure mode;
- whether the probe is for diagnosis, paper evidence, or debugging.
Workflow
- Define the representation and target property.
- Choose minimal probes: linear probe, nearest-neighbor, clustering, retrieval, or collapse diagnostic.
- Add controls for trivial cues.
- Choose negative controls and random/label-shuffled baselines.
- Define what would count as meaningful structure.
- Recommend the smallest informative probe set.
Rules
- A probe is evidence, not full explanation.
- Control for capacity and leakage.
- Prefer probes that distinguish two hypotheses over probes that merely look interesting.
- Do not overinterpret a high-capacity probe as proof the base representation contains a simple feature.
Output
Return:
- target representation and property;
- probe plan;
- controls;
- interpretation rules;
- failure modes and limits;
- smallest next diagnostic.