Evidence Based Classroom Designer
by @quochungto
Design or redesign any course, class, or training session using evidence-based instructional principles. Use this skill when a teacher, instructor, or instru...
clawhub install bookforge-evidence-based-classroom-designerπ About This Skill
name: evidence-based-classroom-designer description: | Design or redesign any course, class, or training session using evidence-based instructional principles. Use this skill when a teacher, instructor, or instructional designer wants to improve student retention and achievement through classroom design, course design, quiz design, or active learning strategies β even if they don't mention "retrieval practice" or "spaced repetition." Triggers include: instructor wants to reduce failure rates in a gateway course; teacher finds students forget material within days of a lecture; instructor relies on midterm and final exams as the only assessment; teacher wants to move from passive lecturing to active learning without losing content coverage; instructor wants to close the achievement gap between well-prepared and under-prepared students; course designer wants to embed low-stakes quizzing into a curriculum; teacher wants to raise student performance on Bloom's higher-order thinking levels; instructor wants to redesign student engagement without adding complexity. Works for K-12 teachers, university professors, corporate trainers, and instructional designers. Do NOT use this skill to build a personal study system for a single learner (use retrieval-practice-study-system), to create a practice schedule alone (use practice-schedule-designer), or to audit a single learning activity for difficulty structure (use desirable-difficulty-classifier). version: 1.0.0 homepage: https://github.com/bookforge-ai/bookforge-skills/tree/main/books/make-it-stick/skills/evidence-based-classroom-designer metadata: {"openclaw":{"emoji":"π","homepage":"https://github.com/bookforge-ai/bookforge-skills"}} status: draft source-books: - id: make-it-stick title: "Make It Stick: The Science of Successful Learning" authors: ["Peter C. Brown", "Henry L. Roediger III", "Mark A. McDaniel"] chapters: [8] tags: ["learning-science", "cognitive-psychology", "evidence-based-learning", "teaching", "classroom-design", "instructional-design", "course-design", "quiz-design", "active-learning", "student-engagement"] depends-on: - retrieval-practice-study-system - practice-schedule-designer - desirable-difficulty-classifier execution: tier: 2 mode: hybrid inputs: - type: document description: "Course syllabus, lesson plan, curriculum outline, or description of the current course structure and assessment approach" tools-required: [Read, Write] tools-optional: [] mcps-required: [] environment: "Any agent environment with file read/write access. Instructor provides course details or uploads a syllabus." discovery: goal: "Audit the current course design against 6 evidence-based criteria, then apply a 4-part teacher protocol to produce a concrete redesigned course plan with an assessment calendar, specific intervention designs, and a transparency script for students." tasks: - "Gather course details: subject, level, class size, frequency, current assessment structure" - "Audit current design against the 6-criteria learning environment checklist" - "Apply the 4-part teacher protocol (explain, teach, create difficulties, be transparent)" - "Design specific interventions: quiz schedule, reflection exercises, interleaving plan, Bloom's audit" - "Produce redesigned course plan with assessment calendar and student transparency script" audience: ["K-12 teachers", "university instructors", "corporate trainers", "instructional designers", "curriculum coordinators"] triggers: - "Students are forgetting material within days of a lecture" - "The only assessments are a midterm and a final exam" - "Failure rates in a gateway course are too high" - "I want to move from lecturing to active learning" - "I want to close the achievement gap in my class" - "I need to embed low-stakes quizzing into my curriculum" - "My students don't retain what they learn" - "I want to redesign my course for better student engagement" not_for: - "Building a personal study system for a single learner (use retrieval-practice-study-system)" - "Designing a spacing schedule only (use practice-schedule-designer)" - "Auditing a single learning activity (use desirable-difficulty-classifier)" environment: "Course-level: syllabus, lesson plan, assessment calendar, or instructor description of current course structure" quality: completeness_score: accuracy_score: value_delta_score:
Evidence-Based Classroom Designer
When to Use
You are an instructor, teacher, or course designer who wants to improve how much students actually learn and retain β not just how much is covered. Typical situations:
Before starting, verify:
Mode: Hybrid β The agent designs the course structure, intervention calendar, and transparency materials. The instructor executes and adapts them to their specific classroom.
Context & Input Gathering
Required Context (must have β ask if missing)
Observable Context (gather from environment)
Default Assumptions
Sufficiency Threshold
SUFFICIENT when ALL of these are true:
β Subject and level are known
β Current assessment structure is described (or default assumption is acceptable)
β Primary concern or goal is stated
BLOCK if: no subject and no description β cannot design interventions without knowing what students are learning
Process
Step 1 β Gather Course Profile
Collect and record: 1. Course basics: Subject, level, class size, meeting frequency (e.g., 3x/week Γ 15 weeks), total seat time 2. Learning objectives: What must students be able to do by the end? At what cognitive level (recall, application, analysis, synthesis)? 3. Current assessment calendar: When do assessments occur? What types? What percentage of grade? 4. Current in-class structure: Lecture-only? Group work? Discussion? Problem sets? 5. Student population: Are they primarily well-prepared, mixed, or under-prepared? Are there equity concerns?
WHY: Intervention design must be calibrated to the specific constraints of the course. A 25-person seminar meeting twice a week calls for different mechanics than a 200-person lecture hall meeting three times a week. Gathering specifics first prevents generic recommendations that cannot be implemented.
Output: A course profile summary (3-5 sentences) confirmed with the instructor before continuing.
Step 2 β Audit Current Design Against 6 Criteria
Evaluate the current course against each criterion. Rate each: Present / Partial / Absent.
| Criterion | What to look for | Research basis | |-----------|-----------------|----------------| | C1. Low-stakes retrieval practice | Frequent quizzes, self-tests, or recall exercises that occur during the course (not only at midterm/final) | Testing effect: retrieval consolidates learning and arrests forgetting. Quizzed material retained at 92% vs 79% for non-quizzed in Columbia IL study | | C2. Spaced and cumulative review | Assessments or exercises that reach back to prior material β not only the most recent unit | Spacing forces reconstruction from long-term memory, strengthening the neural pathway. Cumulative quizzing builds complex mental models | | C3. Interleaving across topics | Topics or problem types mixed across sessions rather than blocked by unit | Interleaving requires students to "reload" prior knowledge and identify which approach applies, building discrimination and transfer | | C4. Consequences (low-stakes) | Practice exercises count toward the course grade, even at very low weight | Students in graded low-stakes practice classes outperform students in classes where the same exercises are ungraded | | C5. Transparency about how learning works | Instructor explicitly explains why desirable difficulties are used and what the research shows | Students who understand the mechanism tolerate the discomfort of effortful practice and persist longer | | C6. Calibration feedback | Students receive timely feedback that reveals what they know vs. what they think they know | Without calibration, students rely on fluency illusions and study the wrong material. The "illusion of knowing" is the primary cause of exam failure despite adequate study time |
For each criterion rated Partial or Absent, note the specific gap (e.g., "C1 absent: only two exams, no in-class quizzing").
WHY: Most course designs fail on C1 and C2 β they schedule high-stakes practice too infrequently and too late. Students in low-structure courses (lecture + two exams) have no mechanism to discover gaps before the exam, no incentive to practice distributed retrieval, and no feedback on whether their self-assessed confidence matches actual mastery. The audit makes the specific gaps visible before designing interventions.
For detailed difficulty classification across all six strategies (including generation, elaboration, variation), invoke desirable-difficulty-classifier OR apply the 6-criteria audit above directly.
Output: A filled audit table with Present/Partial/Absent ratings and gap notes.
Step 3 β Apply the 4-Part Teacher Protocol
Apply each of the four protocol elements to the specific course. For each, produce a concrete implementation plan β not just a principle.
#### Protocol Part 1: Explain How Learning Works
Design a brief transparency module to deliver at the start of the course (or first class). Include:
*Example β Wenderoth's framing:* "The whole idea of the testing effect is that you learn more by testing yourself than by rereading. I know this contradicts how most of you study. So I'm going to model it in class, and I'm going to show you your results over the semester so you can see it working."
WHY: Students who understand the mechanism tolerate the discomfort of effortful practice and persist longer. Students who don't understand it interpret quiz difficulty as unfairness and disengage. Wenderoth's research shows that students who are told they "have the illusion of knowing" and understand what that means come to her with solvable problems rather than complaints about trick questions.
#### Protocol Part 2: Teach Students How to Study
Design at least two study strategies to explicitly teach (not just recommend):
For detailed retrieval practice implementation for individual students, invoke retrieval-practice-study-system OR apply the free recall and self-quizzing pattern above directly.
WHY: Students are not taught how to study effectively and tend toward the least effective strategies (rereading, highlighting). Explicitly modeling correct study technique β rather than assuming students know it β is a prerequisite for the active-learning interventions in the course to work. Students who don't know how to retrieve cannot benefit from a high-structure course.
#### Protocol Part 3: Create Desirable Difficulties in the Classroom
Design 3-5 specific interventions drawn from the following menu. Select based on the audit gaps (Step 2) and the course constraints.
Intervention A β Daily or bi-weekly low-stakes quizzes
*Example β McDermott (Washington University):* 4-question quiz in the last 3-5 minutes of every class meeting (28 meetings, 2Γ/week). Anything covered to date is fair game. Students drop 4 quizzes; no makeups. Quizzes = 20% of grade. By end of semester, students report quizzes helped them keep up and discover gaps early.
*Example β Sobel (political economics):* Cumulative low-stakes quizzing throughout the term. Each quiz can draw from any material covered so far. Students build incrementally complex mental models rather than cramming disconnected units.
Intervention B β Pre-class generation exercises
*Example β Matthews/West Point Thayer method:* Students read for specific learning objectives before each class; class opens with a quiz on those objectives; then students "take to the boards" β higher-order questions requiring integration, worked at the board in groups; one student per group gives a recitation to the class. Zero lecture. The grade rests on consistent daily participation.
Intervention C β Board work and active recitation
Intervention D β Bloom's taxonomy answer keys
*Example β Wenderoth:* Students receive the Bloom's key with their graded tests. They identify their level for each answer. The exercise shifts the question from "did I get it right?" to "at what level did I understand this?" and produces a specific, actionable study target.
Intervention E β Learning paragraphs (periodic writing)
Designing the spacing and interleaving structure:
For detailed spacing and interleaving schedule design across topics, invoke practice-schedule-designer OR apply this pattern directly:
WHY: Research consistently shows that students in high-structure classes (daily/weekly low-stakes practice) outperform students in low-structure classes (lecture + two exams) β and the gap is largest for under-prepared students. The key finding from Wenderoth's biology experiments: high-structure classes significantly reduced failure rates in gateway biology while simultaneously raising performance on Bloom's higher-order levels. The mechanism is that low-structure courses leave students to self-regulate their study, and most students self-regulate poorly until they have been taught otherwise.
#### Protocol Part 4: Be Transparent Throughout
Ongoing transparency (not just at the start of the course):
WHY: Transparency is not a one-time orientation. The discomfort of effortful practice recurs throughout the semester, and students need a recurring framework for interpreting that discomfort as signal rather than failure. Without ongoing explanation, students who struggle will attribute difficulty to bad teaching rather than effective learning design.
Step 4 β Design Specific Interventions
Based on the audit results and the 4-part protocol, produce:
4a. Quiz schedule design
4b. Reflection exercise plan
4c. Interleaving plan
4d. Bloom's level design
WHY: Without concrete artifacts β a quiz schedule, a sample question set, an interleaving map β instructors revert to their existing structure because it is familiar and low-effort. The interventions must be specifiable enough to execute in the first week of class.
Step 5 β Produce Redesigned Course Plan and Assessment Calendar
Produce a complete redesigned course plan including:
1. Transparency module (first class): 10-15 minute script or outline explaining the testing effect, desirable difficulties, and how learning works 2. Assessment calendar (full course): When each type of assessment occurs (quiz, exam, reflection exercise, summary sheet), what it covers, and its grade weight 3. Intervention calendar (weekly): For each week of the course, which specific interventions occur (e.g., Week 3: 2 quizzes with reach-back to Week 1; board exercise on Topic B; summary sheet due Monday) 4. Ground rules document: The course-level policies for low-stakes practice (free misses, no-makeup rules, weighting) 5. Student-facing explanation: A 1-paragraph explanation for the syllabus or first-day handout that tells students why the course is designed the way it is
WHY: The goal is a course design that can be handed to another instructor and implemented without additional planning. Generality disappears at the level of execution; specificity is what makes redesign actionable.
Output: Write the redesigned course plan to redesigned-course-plan.md.
Inputs
| Input | Required | Description | |-------|----------|-------------| | Course description | Yes | Subject, level, class size, meeting frequency, duration | | Current assessment structure | Yes (or default assumed) | What assessments exist, when, what weight | | Primary concern or redesign goal | Yes | What is not working or what the instructor wants to improve | | Course syllabus or outline | Preferred | The document to audit and redesign | | Student population description | No | Mix of prepared/under-prepared; equity concerns |
Outputs
| Output | Format | Description |
|--------|--------|-------------|
| redesigned-course-plan.md | Markdown | Full redesigned course plan with all 5 components from Step 5 |
Output Template: redesigned-course-plan.md
# Redesigned Course Plan: [Course Name]Instructor: [Name or role]
Course: [Subject, level, class size, meeting frequency]
Primary concern addressed: [e.g., "High failure rate in gateway biology"]
Redesign date: [Date]
Design Audit Results
| Criterion | Rating | Gap |
|-----------|--------|-----|
| C1. Low-stakes retrieval practice | Present / Partial / Absent | [gap note] |
| C2. Spaced and cumulative review | Present / Partial / Absent | [gap note] |
| C3. Interleaving across topics | Present / Partial / Absent | [gap note] |
| C4. Consequences (low-stakes) | Present / Partial / Absent | [gap note] |
| C5. Transparency about learning | Present / Partial / Absent | [gap note] |
| C6. Calibration feedback | Present / Partial / Absent | [gap note] |
Interventions Selected
[List of 3-5 interventions from Step 3, with brief rationale for each]
Transparency Module (First Class)
[10-15 minute outline or script]
Assessment Calendar
| Week | Assessment | Type | Covers | Grade weight |
|------|-----------|------|--------|-------------|
| 1 | ... | ... | ... | ... |
| ... | ... | ... | ... | ... |
Weekly Intervention Calendar
| Week | Quizzes | Reflection exercises | Board work | Other |
|------|---------|---------------------|------------|-------|
| 1 | ... | ... | ... | ... |
| ... | ... | ... | ... | ... |
Ground Rules Document
[Policies for low-stakes practice: free misses, no-makeup rule, weighting]
Student-Facing Explanation (for Syllabus)
[1 paragraph]
Key Principles
1. Low-stakes retrieval practice is the highest-leverage classroom intervention The single most impactful change a teacher can make is to add frequent, low-stakes retrieval practice β quizzes that happen during the course rather than only at the end. The Columbia, Illinois middle school study found 92% retention on quizzed material vs. 79% on non-quizzed material in the same class. McDermott's university course achieves this with 4 questions in the last 5 minutes of every class meeting. The investment is minimal; the learning gain is substantial.
2. High-structure courses close achievement gaps Wenderoth's biology experiments show that high-structure classes (daily and weekly low-stakes exercises) significantly reduce failure rates in gateway biology courses while simultaneously raising Bloom's-level performance. The gap narrows most for under-prepared students β those without a prior history of effective learning habits. High-structure is not remediation; it is structure that helps all students and helps struggling students most.
3. Consequences matter, even at very low stakes Students in courses where practice exercises count toward the grade β even at minimal weight β outperform students in the same course where the exercises carry no consequences. The exercises being identical means the difference is purely in motivation to engage. Low-stakes grading is not coercive; it is the signal that the exercises are real, not optional.
4. Transparency is a design element, not a nice-to-have When students understand why effortful retrieval feels uncomfortable and why that discomfort signals learning, they tolerate it and persist. When they don't understand it, they interpret difficulty as unfairness and disengage. Transparency is not soft pedagogy β it changes the behavioral response to difficulty and determines whether the rest of the course design can work.
5. The Thayer method proves high-structure scales across disciplines West Point's Thayer method β specific learning objectives before every class, daily quizzing at the start, board work on higher-order questions, student recitation β has been sustained across almost 200 years and multiple disciplines. Matthews's courses run with essentially zero lecturing. The method works best for students who need structure to develop study discipline, and it scales from elite academies to Riverside Military Academy's more varied student population.
6. Cumulative reach-back builds the mental model, not just the fact list Sobel's cumulative quizzing approach allows any quiz to draw from any material covered to date. This is not review for review's sake β it is the design mechanism that forces students to build connections between concepts over the course of the term, producing complex mental models rather than isolated fact recall. The final exam is never a shock because the student has been practicing toward it all semester.
Examples
Example 1: University Gateway Biology Course (High Failure Rate)
Scenario: A biology professor teaches a 150-student introductory biology lecture course that serves as a gateway requirement. Failure and withdrawal rates are around 30%. The course currently has 2 midterms and a final exam, weekly readings, and a lab section. Most students rely on cramming.
Audit result: C1 absent (no low-stakes quizzing), C2 absent (exams are not cumulative), C3 partial (topics are sequential, not interleaved), C4 absent (no graded practice), C5 absent (no explanation of learning principles), C6 partial (exams provide calibration, but too infrequently).
Redesign interventions selected:
Expected outcome (based on Wenderoth's results): Statistically significant reduction in failure rates; higher-order thinking scores on exams improve; under-prepared students show the largest gains.
Example 2: High School History (Passive Lecture Problem)
Scenario: A high school history teacher with 28 students finds that students are disengaged during lectures and score poorly on unit tests despite apparently paying attention. The course has 8 unit tests across the year, plus a final. No quizzing between tests.
Audit result: C1 absent, C2 absent (unit tests are not cumulative), C3 absent (one unit at a time, fully blocked), C4 absent, C5 absent, C6 partial.
Redesign interventions selected:
Assessment calendar shift: From 8 disconnected unit tests to 8 unit tests + 14 bi-weekly quizzes with cumulative reach-back + 4 synthesis writing exercises.
Example 3: Corporate Professional Training (Post-Workshop Forgetting)
Scenario: A corporate L&D team runs a two-day sales training workshop for 40 new agents. Participants rate the sessions highly, but sales managers report that skills and knowledge are not visible in behavior 30 days later. The team suspects the workshop format β intensive lecture + role play, then nothing β is the problem.
Audit result: C1 absent (no retrieval practice after the workshop), C2 absent (no spaced review), C3 partial (topics covered across 2 days but not interleaved), C4 absent (no consequences for post-workshop engagement), C5 absent, C6 absent.
Redesign interventions selected:
Expected outcome: Knowledge and skills are visible in behavior at 30 and 60 days because the design includes distributed retrieval practice after encoding, not only during it.
References
references/case-studies.md β Detailed case studies: Wenderoth (University of Washington biology), Matthews/Thayer method (West Point), McDermott (Washington University), Sobel (political economics), Columbia IL school district resultsreferences/bloom-taxonomy-implementation.md β Bloom's taxonomy levels with classroom examples, Wenderoth's answer key template, question classification guide for creating higher-order quiz itemsreferences/design-checklist.md β Printable 6-criteria course design checklist with rating scale and redesign prompt for each criterionreferences/transparency-scripts.md β Sample first-class transparency scripts for university (biology/sciences), high school (humanities), and corporate training contexts; student-facing language for syllabiLicense
This skill is licensed under CC-BY-SA-4.0. Source: BookForge β Make It Stick: The Science of Successful Learning by Peter C. Brown, Henry L. Roediger III, Mark A. McDaniel.
Related BookForge Skills
Install related skills from ClawhHub:
clawhub install bookforge-retrieval-practice-study-systemclawhub install bookforge-practice-schedule-designerclawhub install bookforge-desirable-difficulty-classifierOr install the full book set from GitHub: bookforge-skills
β‘ When to Use
π‘ Examples
Example 1: University Gateway Biology Course (High Failure Rate)
Scenario: A biology professor teaches a 150-student introductory biology lecture course that serves as a gateway requirement. Failure and withdrawal rates are around 30%. The course currently has 2 midterms and a final exam, weekly readings, and a lab section. Most students rely on cramming.
Audit result: C1 absent (no low-stakes quizzing), C2 absent (exams are not cumulative), C3 partial (topics are sequential, not interleaved), C4 absent (no graded practice), C5 absent (no explanation of learning principles), C6 partial (exams provide calibration, but too infrequently).
Redesign interventions selected:
Expected outcome (based on Wenderoth's results): Statistically significant reduction in failure rates; higher-order thinking scores on exams improve; under-prepared students show the largest gains.
Example 2: High School History (Passive Lecture Problem)
Scenario: A high school history teacher with 28 students finds that students are disengaged during lectures and score poorly on unit tests despite apparently paying attention. The course has 8 unit tests across the year, plus a final. No quizzing between tests.
Audit result: C1 absent, C2 absent (unit tests are not cumulative), C3 absent (one unit at a time, fully blocked), C4 absent, C5 absent, C6 partial.
Redesign interventions selected:
Assessment calendar shift: From 8 disconnected unit tests to 8 unit tests + 14 bi-weekly quizzes with cumulative reach-back + 4 synthesis writing exercises.
Example 3: Corporate Professional Training (Post-Workshop Forgetting)
Scenario: A corporate L&D team runs a two-day sales training workshop for 40 new agents. Participants rate the sessions highly, but sales managers report that skills and knowledge are not visible in behavior 30 days later. The team suspects the workshop format β intensive lecture + role play, then nothing β is the problem.
Audit result: C1 absent (no retrieval practice after the workshop), C2 absent (no spaced review), C3 partial (topics covered across 2 days but not interleaved), C4 absent (no consequences for post-workshop engagement), C5 absent, C6 absent.
Redesign interventions selected:
Expected outcome: Knowledge and skills are visible in behavior at 30 and 60 days because the design includes distributed retrieval practice after encoding, not only during it.