Alicloud Platform Multicloud Docs Api Benchmark
by @cinience
Benchmark similar product documentation and API documentation across Alibaba Cloud, AWS, Azure, GCP, Tencent Cloud, Volcano Engine, and Huawei Cloud. Given o...
clawhub install alicloud-platform-multicloud-docs-api-benchmarkπ About This Skill
name: alicloud-platform-multicloud-docs-api-benchmark description: Benchmark similar product documentation and API documentation across Alibaba Cloud, AWS, Azure, GCP, Tencent Cloud, Volcano Engine, and Huawei Cloud. Given one product keyword, auto-discover latest official docs/API links, score quality consistently, and output detailed prioritized improvement recommendations. version: 1.0.0
Multi-Cloud Product Docs/API Benchmark
Use this skill when the user wants cross-cloud documentation/API comparison for similar products.
Supported clouds
Data source policy
L0 (highest): user-pinned official links via ---links L1: machine-readable official metadata/sourceL2: official-domain constrained web discovery fallbackL3: insufficient discovery (low confidence)Workflow
Run the benchmark script:
python skills/platform/docs/alicloud-platform-multicloud-docs-api-benchmark/scripts/benchmark_multicloud_docs_api.py --product ""
Example:
python skills/platform/docs/alicloud-platform-multicloud-docs-api-benchmark/scripts/benchmark_multicloud_docs_api.py --product "serverless"
LLM platform benchmark example (Bailian/Bedrock/Azure OpenAI/Vertex AI/Hunyuan/Ark/Pangu):
python skills/platform/docs/alicloud-platform-multicloud-docs-api-benchmark/scripts/benchmark_multicloud_docs_api.py --product "Bailian" --preset "llm-platform"
If --preset is omitted, script attempts to auto-match preset based on keyword.
Scoring weights can be switched by profile (see references/scoring.json):
python skills/platform/docs/alicloud-platform-multicloud-docs-api-benchmark/scripts/benchmark_multicloud_docs_api.py --product "Bailian" --preset "llm-platform" --scoring-profile "llm-platform"
Optional: pin authoritative links
Auto-discovery may miss pages. For stricter comparison, pass official links manually:
python skills/platform/docs/alicloud-platform-multicloud-docs-api-benchmark/scripts/benchmark_multicloud_docs_api.py \
--product "object storage" \
--aws-links "https://docs.aws.amazon.com/AmazonS3/latest/userguide/Welcome.html" \
--azure-links "https://learn.microsoft.com/azure/storage/blobs/"
Available manual flags:
--alicloud-links--aws-links--azure-links--gcp-links--tencent-links--volcengine-links--huawei-linksEach flag accepts comma-separated URLs.
Output policy
All artifacts must be written under:
output/alicloud-platform-multicloud-docs-api-benchmark/
Per run:
benchmark_evidence.jsonbenchmark_report.mdReporting guidance
When answering the user:
1) Show score ranking across all providers. 2) Highlight top gaps (P0/P1/P2) and concrete fix actions. 3) If discovery confidence is low, ask user to provide pinned links and rerun.
Validation
mkdir -p output/alicloud-platform-multicloud-docs-api-benchmark
for f in skills/platform/docs/alicloud-platform-multicloud-docs-api-benchmark/scripts/*.py; do
python3 -m py_compile "$f"
done
echo "py_compile_ok" > output/alicloud-platform-multicloud-docs-api-benchmark/validate.txt
Pass criteria: command exits 0 and output/alicloud-platform-multicloud-docs-api-benchmark/validate.txt is generated.
Output And Evidence
output/alicloud-platform-multicloud-docs-api-benchmark/.Prerequisites
ALICLOUD_ACCESS_KEY_ID, ALICLOUD_ACCESS_KEY_SECRET, optional ALICLOUD_REGION_ID.References
references/review-rubric.mdβοΈ Configuration
ALICLOUD_ACCESS_KEY_ID, ALICLOUD_ACCESS_KEY_SECRET, optional ALICLOUD_REGION_ID.π Constraints
mkdir -p output/alicloud-platform-multicloud-docs-api-benchmark
for f in skills/platform/docs/alicloud-platform-multicloud-docs-api-benchmark/scripts/*.py; do
python3 -m py_compile "$f"
done
echo "py_compile_ok" > output/alicloud-platform-multicloud-docs-api-benchmark/validate.txt
Pass criteria: command exits 0 and output/alicloud-platform-multicloud-docs-api-benchmark/validate.txt is generated.