xinwencaiji
by @nighmat1220
Run a self-contained Chinese and international AI news workflow inside the current workspace. Use when the user wants either high-frequency RSS capture only...
clawhub install ai-news-collectionπ About This Skill
name: ai-news-pipeline description: Run a self-contained Chinese and international AI news workflow inside the current workspace. Use when the user wants either high-frequency RSS capture only or scheduled report delivery only, with cumulative Excel outputs and a merged Word brief, without relying on an external local repository path.
AI News Pipeline
Overview
This skill is executable by itself. The actual workflow scripts are bundled in scripts/.
Run them against the current workspace or pass --workspace /path/to/workspace explicitly.
Workspace Requirements
The target workspace should contain or accept these files and folders:
config/sources.jsonconfig/international_sources.jsoncompanies.txtdata/reports/state/If the folders do not exist, the scripts create them.
Install Dependencies
Install Python dependencies before first use:
python -m pip install -r /path/to/skill/scripts/requirements.txt
Available Entrypoints
Use the bundled Python entrypoints depending on the job type.
Capture Only
Use this for high-frequency collection jobs. It only captures feeds, updates deduplication state, and writes raw and incremental data.
python /path/to/skill/scripts/run_capture_only.py --workspace /path/to/workspace
Report Only
Use this for scheduled delivery jobs. It reads already-collected data, calls the model for summaries and titles, updates the cumulative Excel files, and rebuilds the Word brief.
By default it uses the reporting window from yesterday 00:00 to today 08:00.
python /path/to/skill/scripts/run_report_only.py --workspace /path/to/workspace
Optional time window:
python /path/to/skill/scripts/run_report_only.py --workspace /path/to/workspace --time-window "2026-03-15 00:00 to 2026-03-16 08:00"
Optional skip-AI mode:
python /path/to/skill/scripts/run_report_only.py --workspace /path/to/workspace --disable-ai
Full Workflow
python /path/to/skill/scripts/run_full_workflow.py --workspace /path/to/workspace
Optional time window:
python /path/to/skill/scripts/run_full_workflow.py --workspace /path/to/workspace --time-window "2026-03-15 00:00 to 2026-03-15 18:00"
Optional skip-AI mode:
python /path/to/skill/scripts/run_full_workflow.py --workspace /path/to/workspace --disable-ai
What Each Entrypoint Does
run_capture_only.py
1. Collect domestic RSS items into data/YYYY-MM-DD.jsonl.
2. Collect domestic raw items into data/domestic_raw_YYYY-MM-DD.jsonl.
3. Collect international raw items into data/international_raw_YYYY-MM-DD.jsonl.
4. Filter international items into data/international_YYYY-MM-DD.jsonl.
5. Save per-source snapshots in snapshots/.
6. Update RSS deduplication and source metrics in state/feed_state.json.
run_report_only.py
1. Read the selected time window from collected data.
2. Build the cumulative domestic Excel output in reports/company_mentions.xlsx.
3. Build the cumulative international Excel output in reports/international_company_mentions.xlsx.
4. Call the model to generate domestic AI titles and AI summaries.
5. Call the model to generate international AI titles, AI summaries, and impact scores.
6. Build a merged daily Word brief in reports/.
run_full_workflow.py
1. Run capture.
2. Run domestic reporting.
3. Run international reporting.
Inputs
config/sources.jsonconfig/international_sources.jsoncompanies.txtARK_API_KEYARK_MODELImportant Behavior
state/feed_state.json controls RSS deduplication.Troubleshooting
1. If the workflow does not rerun old RSS items, check state/feed_state.json.
2. If AI columns are empty, check whether ARK_API_KEY is set in the execution environment.
3. If the user wants a full rebuild, delete the relevant daily data files and state/feed_state.json, then rerun.
4. If the user needs exact commands or cloud prompts, read references/commands.md.
References
references/commands.mdπ Tips & Best Practices
1. If the workflow does not rerun old RSS items, check state/feed_state.json.
2. If AI columns are empty, check whether ARK_API_KEY is set in the execution environment.
3. If the user wants a full rebuild, delete the relevant daily data files and state/feed_state.json, then rerun.
4. If the user needs exact commands or cloud prompts, read references/commands.md.