Arxiv Paper Processor
by @xukp20
Tool for manual per-paper ArXiv paper processing: batch/source/pdf download then model-driven full-text reading and summary.md writing in chosen language.
clawhub install arxiv-paper-processorπ About This Skill
name: arxiv-paper-processor description: "Tool-only paper processing skill with a manual language parameter: supports batch artifact download for many papers or single-paper download, then the model manually reads source/PDF and writes summary.md in the selected language. Use when per-paper comprehension should be model-driven instead of script-generated."
ArXiv Paper Processor
Use this skill for per-paper manual summarization, with optional batch artifact download.
// ).Language Parameter
English or Chinese) and apply it manually.summary.md must be written in the selected language.--language for traceability.Core Principle
Scripts only fetch artifacts. The model performs reading and writing.
Non-negotiable Constraint
summary.md by script-based snippet extraction, regex harvesting, or template autofill.source/pdf) and trace logs.summary.md must come from model-side reading and synthesis of the paper content.Optional Batch Artifact Download (Many Papers)
Use this first when Stage B has many papers:
python3 scripts/download_papers_batch.py \
--run-dir /path/to/run \
--artifact source_then_pdf \
--max-workers 3 \
--min-interval-sec 5 \
--language English
Key behavior:
--artifact source, --artifact pdf, or --artifact source_then_pdf (default).--max-workers) and safe throttling/retry (--min-interval-sec, retry args)./.runtime/arxiv_download_state.json ) to reduce 429 risk.source/source_extract/*.tex or existing source/paper.pdf (unless --force).summary.md, you can skip that paper's summary-writing step./download_batch_log.json by default.Step 1: Download Source (Preferred)
python3 scripts/download_arxiv_source.py \
--paper-dir /path/to/run/2602.00528 \
--language English
This writes:
source/source_bundle.binsource/source_extract/source/download_source_log.jsonIf usable source already exists and --force is not set, the script reuses local artifacts.
Step 2: If Needed, Download PDF
python3 scripts/download_arxiv_pdf.py \
--paper-dir /path/to/run/2602.00528 \
--language English
This writes:
source/paper.pdfsource/download_pdf_log.jsonIf PDF already exists and --force is not set, the script reuses local artifacts.
Step 3: Model Reads and Summarizes
1. If summary.md already exists and follows the required format, skip this paper and mark it complete.
2. Read metadata.md first.
3. If source/source_extract/ already exists with readable .tex files, use it directly.
4. Otherwise, if source/paper.pdf already exists, use PDF directly.
5. If neither exists, run download scripts (single-paper scripts or batch script) first.
6. Manually write summary.md in the same paper directory, in the selected language.
Do not rely on rule-based auto summarization. Do not rely on auto-extracted snippets as the primary writing basis.
Quality Requirement
references/summary-example-en.md and references/summary-example-zh.md.Required Output
/summary.md in fixed section format.## 10. Brief Conclusion: write a 3-4 sentence mini-conclusion that covers contribution, method, evaluation setup, and results with paper-specific details.## 1. Paper Snapshot, use exact keys: ArXiv ID, Title, Authors, Publish date, Primary category, Reading basis.Reading source, Author list, Published on, or lowercase key names.See references/summary-format.md for exact section requirements.
Related Skills
This skill is a sub-skill of arxiv-summarizer-orchestrator.
Pipeline position:
1. Step 1 (upstream): arxiv-search-collector produces the selected paper directories and metadata.
2. Step 2 (this skill): arxiv-paper-processor downloads artifacts and writes one summary.md per paper.
3. Step 3 (downstream): arxiv-batch-reporter uses these per-paper summaries to generate the final collection report.
Use this skill together with Step 1 and Step 3 for full end-to-end execution.