具有相同frequent_token 的size+1

最新推荐文章于 2025-02-05 18:56:26 发布

scan724

最新推荐文章于 2025-02-05 18:56:26 发布

阅读量357

点赞数 5

分类专栏：人工智能文章标签：人工智能

本文链接：https://blog.youkuaiyun.com/zhaoyangjian724/article/details/144885483

版权

for k, v in contents.items():
frequent_token = tuple(sorted(vocab.topk_tokens(v[0].split(), 3)))
log_format = v[1]
if frequent_token not in hierichical_clusters:
hierichical_clusters[frequent_token] = {"size": 1, "cluster": {log_format: [k]}}
else:
hierichical_clusters[frequent_token]["size"] = hierichical_clusters[frequent_token]["size"] + 1

------------------------------------------------------------------------------
111111111111111111111---hierichical_clusters--1111111111111111111111111
0 ('LDAP Built with OpenLDAP LDAP / SDK', '/:=@')
('LDAP', 'SDK', 'with')
/:=@
{('LDAP', 'SDK', 'with'): {'size': 1, 'cluster': {'/:=@': [0]}}}
111