python处理数据

jhh2013

于 2023-01-06 10:43:24 发布

阅读量134

点赞数

CC 4.0 BY-SA版权

文章标签： python 开发语言 linux

本文链接：https://blog.youkuaiyun.com/jhh2013/article/details/128575009

该Python脚本利用subprocess模块调用squeue和sacct命令，通过管道处理和grep、awk工具，获取并分析SLURM作业管理系统中的作业ID及其执行状态，用于监控集群资源使用情况。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

# !/usr/bin/env python
# coding=utf-8

import subprocess

obj1 = subprocess.Popen("squeue | grep -E '^ +[0-9]'| awk '{print $1,$4}'", shell=True, stdout=subprocess.PIPE,stderr=subprocess.PIPE)
res1 = obj1.stdout.read().decode("UTF-8")


l = res1.split()
l1 = l[::2]
l2 = l[1::2]


obj2 = subprocess.Popen("sacct -X -j " + ",".join(l1) + "| grep -E '^[0-9]'| awk '{print $1}'",shell=True, stdout=subprocess.PIPE, stderr=subprocess.PIPE)
res2 = obj2.stdout.read().decode("UTF-8")
t1 = set(res1.split())
t2 = set(res2.split())

t3 = t1 - t2

for i in t3:
   for index, j in enumerate(l1):
     if i == j:
      print(j, l2[index])