π¦ ClawHub
Cogdx
by @drkavner
Cognitive diagnostics for AI agents. Calibration audits, bias detection, reasoning verification, and consensus building. Feedback builds shared reality acros...
π‘ Examples
from cogdx import CogDxClientInitialize with your wallet for payment
client = CogDxClient(wallet="your-wallet-address")Calibration audit
result = client.calibration_audit(
agent_id="my-agent",
predictions=[
{"prompt": "Will X happen?", "response": "Yes, 80% confident", "confidence": 0.8},
{"prompt": "Will Y happen?", "response": "No, 60% confident", "confidence": 0.6},
]
)
print(f"Calibration score: {result['calibration_score']}")
print(f"Overconfidence rate: {result['overconfidence_rate']}")Bias scan
result = client.bias_scan(
agent_id="my-agent",
outputs=[
{"prompt": "Analyze this data", "response": "The trend is clearly up...", "confidence": 0.9}
]
)
print(f"Biases detected: {result['biases_detected']}")Reasoning trace analysis
result = client.analyze_reasoning(
reasoning_trace="Step 1: I noticed the price dropped. Step 2: Therefore I should sell..."
)
print(f"Logical validity: {result['logical_validity']}")
print(f"Flaws: {result['flaws_detected']}")
TERMINAL
clawhub install cogdx