python之从多个stat.txt筛选出想要的数据

最新推荐文章于 2023-11-13 21:46:09 发布

原创最新推荐文章于 2023-11-13 21:46:09 发布 · 309 阅读

0 ·

CC 4.0 BY-SA版权

本文介绍了一种从多个文件中读取特定数据并进行汇总的方法。通过Python脚本，从指定目录下的文本文件中筛选出包括sim_seconds、cpu ipc、l2缓存命中与未命中等关键性能指标，最后将这些数据统一写入到结果文件中。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

file_path = []

with open('C:\\Users\\lili\\Desktop\\filename.txt', 'r') as file:
    for line in file:
        line1=line.split()
        file_path.append(line1[0])
    file.close()

with open('C:\\Users\\lili\\Desktop\\result.txt','w') as file1:

    for path in file_path:
        file1.write(path)
        with open(path, 'r') as f:
            for data1 in f:
                data2=data1.split()
                if data2[0:1] == ['sim_seconds'] or data2[0:1] == ['system.cpu0.ipc'] \
                   or data2[0:1] == ['system.cpu1.ipc'] or data2[0:1]==['system.cpu2.ipc']\
                   or data2[0:1] == ['system.cpu3.ipc'] or data2[0:1] ==['system.l2.overall_hits::total']\
                   or data2[0:1] ==['system.l2.overall_misses::total']or data2[0:1] ==['system.switch_cpus.ipc']:
                    #file1.write(data2[1])
                    file1.write(data2[1])
                    file1.write('\n')

结果：:\\Users\\lili\\Desktop\\stat\\8bank\\fft.txt0.394197
28457545
1989437
1.662845
0.158834
0.158761
0.159098
C:\\Users\\lili\\Desktop\\stat\\8bank\\lu.txt0.075905
6152916
13707
1.734172
0.148619
0.161893
0.161368
C:\\Users\\lili\\Desktop\\stat\\8bank\\no-lu.txt0.070493
6344829
13663
1.681833
0.160879
0.174416
0.175062
C:\\Users\\lili\\Desktop\\stat\\8bank\\radix.txt0.108180
12242651
44925
1.255587
0.070901
0.071113
0.071223
C:\\Users\\lili\\Desktop\\stat\\8bank\\mcf.txt1.065738
0.234579
13666596
25099264
C:\\Users\\lili\\Desktop\\stat\\8bank\\gcc.txt0.207957
1.202170
5400038
2436211
C:\\Users\\lili\\Desktop\\stat\\8bank\\gromacs.txt0.146651
1.704733
8034160
315229
C:\\Users\\lili\\Desktop\\stat\\8bank\\lib.txt0.651423
1.535100
239948
19318861