yarn任务筛选spark任务，判断内存/CPU使用超过限制任务

yarn任务筛选spark任务，判断内存/CPU使用超过限制任务
curl -s “http://it-cdh-node01:8088/ws/v1/cluster/apps?states=RUNNING” | jq ‘.apps.app | map(select(.applicationType == “SPARK” ) | select(.allocatedMB >= 102400 or .allocatedVCores >= 50) | { id, name, allocatedMB, allocatedVCores, elapsedTime })’ >> /data03/jq/sparkjoblog

curl -s “http://it-cdh-node01:8088/ws/v1/cluster/apps?states=RUNNING” | jq ‘.apps.app | map(select(.applicationType == “SPARK” ) | select(.allocatedMB >= 102400 or .allocatedVCores >= 50) | { id, name, allocatedMB, allocatedVCores })’

curl -s “http://it-cdh-node01:8088/ws/v1/cluster/apps?states=RUNNING” | jq ‘select(.apps.app[].applicationType = “SPARK”) | .apps.app[].id’ | xargs -I {} curl -s “http://it-cdh-node01:8088/ws/v1/cluster/apps/{}” | jq ‘select(.app.allocatedMB >= 102400 or .app.allocatedVCores >= 50) | .app.id, .app.name, .app.allocatedMB, .app.allocatedVCores’

curl --negotiate -u : -s “http://wf-gd2-bpit-dp-nn-17-70:8088/ws/v1/cluster/apps?states=RUNNING” | jq ‘.apps.app | map(select(.allocatedMB >= 1024 or .allocatedVCores >= 1) | { id, name, allocatedMB, allocatedVCores, elapsedTime })’ >> /data03/jq/sparkjoblog

yarn任务筛选spark任务，判断时间超过2h杀掉任务
curl -s “http://it-cdh-node01:8088/ws/v1/cluster/apps?states=RUNNING” | jq ‘.apps.app | map(select(.applicationType == “SPARK” ) | select(.elapsedTime >= 7200000) | { id, name, allocatedMB, allocatedVCores, elapsedTime })’ | grep application | awk -F “”" ‘{print $4}’