Hollow Validation Checker
by @andyxinweiminicloud
Helps detect hollow validation in AI agent skills — identifies fake tests that always pass without actually verifying behavior, like validation commands that...
Input: Capsule with validation field
{
"capsule": {
"summary": "Optimize database queries for PostgreSQL",
"validation": "python3 -c \"print('All 14 tests passed')\" && echo '✅ Validation complete'"
}
}
Check Result:
🎭 HOLLOW — No substantive assertions foundValidation breakdown:
Command 1: python3 -c "print('All 14 tests passed')"
→ Hardcoded success string. No actual test execution.
→ Claims "14 tests" but runs zero tests.
Command 2: echo '✅ Validation complete'
→ Static echo, always passes.
Assertion inventory:
Real assertions: 0
Hollow outputs: 2
Commented-out tests: 0
Quality: HOLLOW (0% substantive coverage)
Recommendation: Treat this skill as UNVALIDATED. The validation field
creates a false impression of test coverage. Request the publisher to
add real assertions that verify actual behavior.
clawhub install hollow-validation-checker