large-document-reader
by @mrchenkuan
Intelligently splits long academic or technical documents into chapters, generates structured JSON summaries for each, and creates a file system with a globa...
clawhub install large-document-reader📖 About This Skill
name: large-document-reader description: | Intelligently splits long academic or technical documents into chapters, generates structured JSON summaries for each, and creates a file system with a global index. This enables efficient AI retrieval and analysis, perfectly solving context window limitations by enabling “overview via summaries, deep-dive on demand” workflows. version: 1.0.0 author: Document Assistant category: research tags: [document-processing, knowledge-management, summarization, ai-optimization] metadata: {}
Literature Structuring Expert
Automatically decompose long documents (papers, reports, books) into a structured, AI-friendly knowledge base. Splits by chapter, generates machine-readable summaries, and builds a navigable index to overcome context limits.
When to Use This Skill
Use this skill when the user:
Quick Reference
| Situation | Action |
|-----------|--------|
| User provides a long document | 1. Analyze and split it into chapters.
2. Generate a JSON summary for each chapter.
3. Create a master index file. |
| User asks a high-level, cross-chapter question | Provide the content of the MASTER_INDEX.md file to the AI. |
| User asks a detailed, chapter-specific question | Provide the corresponding single file from the ./chapters/ directory to the AI. |
| Task completed | Present the generated file tree and MASTER_INDEX.md preview to the user. |
Core Workflow
Phase 1: Intelligent Splitting
1. Analyze Input: Receive the long document text or file path. 2. Identify Structure: Automatically analyze the document to identify heading hierarchies (e.g.,#, ##, 1., 1.1) to determine chapter boundaries. Prioritize user-specified splitting preferences.
3. Execute Split: Split the document into independent plain-text files by chapter.
* Naming Convention: {sequence_number}_{chapter_title}.md (e.g., 01_Introduction.md).
* Storage Location: All chapter files are saved in the ./chapters/ directory.Phase 2: Summary Generation & Structuring
1. Generate Summary per Chapter: For each file in./chapters/, generate a corresponding JSON summary file.
* Structured Fields (JSON format):
{
"chapter_id": "Unique identifier matching the filename, e.g., 02_1",
"chapter_title": "Chapter Title",
"abstract": "Core summary of the chapter, 200-300 words.",
"keywords": ["Keyword1", "Keyword2", "Keyword3"],
"key_points": ["Key point one", "Key point two"],
"related_sections": ["IDs of other chapters strongly related to this one"]
}
* Storage Location: JSON summary files are saved in the ./summaries/ directory (e.g., 01_Introduction.summary.json).Phase 3: Create Global Index
1. Aggregate Information: Collect data from all JSON files in./summaries/.
2. Generate Index: Create a global index file, MASTER_INDEX.md.
* Content: Lists all chapters' IDs, titles, a short abstract preview, and keywords in a Markdown list or table.
* Purpose: Provides a "bird's-eye view" for quick navigation and high-level Q&A.Final Deliverables & File Structure
Upon completion, the following file tree is generated:
Project_Root/
├── chapters/ # 【Source Repository】Contains all split chapter texts (.md files)
│ ├── 01_Introduction.md
│ ├── 02_1_Experimental_Methods.md
│ └── ...
├── summaries/ # 【Summary Repository】Contains all structured JSON summaries
│ ├── 01_Introduction.summary.json
│ ├── 02_1_Experimental_Methods.summary.json
│ └── ...
└── MASTER_INDEX.md # 【Global Navigation】Core document summary index
Usage Instructions for the User
For Global, Cross-Chapter Queries (e.g., “What is the paper's main thesis?”):
* Provide the content of the MASTER_INDEX.md file to the AI. This is token-efficient.
For Specific, In-Depth Queries Within a Chapter (e.g., “What were the parameters in the 'Methods' section?”):
* Provide the corresponding single chapter file from the chapters/ directory to the AI for full context.