Counterfactual-Variant Prover MCP Connector for Claude
A+AI models recite memorized answers to classic puzzles, failing when variables or rules are changed. This tool forces cognitive decontamination: isolate variables, compare prompt rules against standard puzzle templates, execute first-principles logic step-by-step, and prove decontaminated output.
AI models exhibit high error rates when facing variations of classic logic puzzles, math problems, or public benchmarks. Because these puzzles (like Cheryl's Birthday, Monty Hall, or River Crossing) are heavily represented in training datasets, models fall back on pattern completion rather than active reasoning. They recite the standard solution even when the prompt contains modified parameters or contradictory rules. This tool interrupts memory-based retrieval by introducing structured cognitive constraints.
The Problem Axis: Recitation Bias
LLM reasoning fails on modified classic puzzles due to three main factors:
- Retrieval Anchoring — The model recognizes the names or context of a famous puzzle and anchors to the standard solution, ignoring changes in variables.
- Variable Contamination — Even when attempting to solve, the model blends constants from the classic puzzle (e.g. standard dates or weights) into its calculations.
- Derivation Bypass — The model skips step-by-step logic and directly jumps to the memorized conclusion.
How It Works
Counterfactual-Variant Prover uses 5 Decision Pivots that force the agent to validate its thinking process:
- recitationSignatureDetected — Has the model identified if the problem resembles a classic template or public benchmark?
- variablesIsolated — Are all numeric constants, rules, and parameters extracted in isolation to prevent retrieval leakage?
- ruleDiscrepancyMapped — Have the differences between this prompt's rules and the standard classic rules been explicitly mapped?
- firstPrinciplesCalculated — Was the solution derived step-by-step using only the isolated variables and modified rules?
- outputDecontaminated — Is the final output completely free of the classic memorized answer?
Related Connectors
Munger Latticework Prover MCP
Charlie Munger spent 60 years proving that a man with one model is a man with a hammer — every problem looks like a nail. An AI proposed a strategy without inverting it, without tracing second-order effects, without mapping incentive conflicts, without admitting what it does not know, and without a margin of safety for being wrong. That is not analysis — that is a first draft dressed as a final answer. This tool forces five Munger-level mental models: inversion, second-order effects, incentive architecture, circle of competence, and margin of safety.
LLM Response Structural Validator MCP
Detect and prevent silent structural failures in LLM outputs using deterministic pattern matching.
Prompt Template Variable Resolver MCP
Validates and resolves variable placeholders in LLM templates.
Output Format Stability Checker MCP
Detect non-deterministic shifts in LLM response structures.