yarn任务筛选spark任务,判断内存/CPU使用超过限制任务
yarn任务筛选spark任务,判断内存/CPU使用超过限制任务
curl -s “http://it-cdh-node01:8088/ws/v1/cluster/apps?states=RUNNING” | jq ‘select(.apps.app[].applicationType = “SPARK”) | .apps.app[].id’ | xargs -I {} curl -s “http://it-cdh-node01:8088/ws/v1/cluster/apps/{}” | jq ‘select(.app.allocatedMB >= 102400 or .app.allocatedVCores >= 50) | .app.id, .app.name, .app.allocatedMB, .app.allocatedVCores’