dataworks-diagnoser
by @ljw-git-dw
Fetch and analyze Alibaba Cloud DataWorks task instance logs to diagnose failures and get actionable recommendations using your instance ID and credentials.
Example 1: Quick Diagnosis
python3 scripts/dataworks_diagnose.py 123456789
Example 2: Save Report
python3 scripts/dataworks_diagnose.py 123456789 --save-report diagnosis.txt
Example 3: Different Region
python3 scripts/dataworks_diagnose.py 123456789 --region cn-shanghai
Example 4: Analyze Saved Log
python3 scripts/diagnose_log.py saved_log.txt --instance-id 123456789
Example 5: Batch Analysis
for id in 123 456 789; do
python3 scripts/diagnose_log.py --instance-id $id < log_$id.txt
done
1. Alibaba Cloud Credentials
One of the following is required:
Option A: Environment Variables (Recommended)
export ALIBABA_CLOUD_ACCESS_KEY_ID=your_access_key
export ALIBABA_CLOUD_ACCESS_KEY_SECRET=your_access_secret
Option B: Config File
Create ~/.alibabacloud/credentials:
{
"access_key_id": "your_access_key",
"access_key_secret": "your_access_secret"
}
Option C: Aliyun CLI Config If you have Aliyun CLI configured, credentials will be loaded automatically.
2. Required Permissions
The AccessKey needs these permissions:
dataworks:GetInstanceLog - Fetch task instance logsdataworks:QueryTask - Query task information3. Network Access
💡 Pro tips:
1. Save logs for failed tasks - Use --save-log to keep records
2. Generate reports - Use --save-report for documentation
3. Batch processing - Script supports multiple instance IDs
4. JSON output - Use --json for programmatic processing
5. Region matters - Always use the correct region for your workspace
clawhub install dataworks-diagnoser