介绍 seqeval
- seqeval是一个序列标注算法评估的python框架;
- seqeval 可以对命名实体识别、词性标注、语义角色标注等分块任务的性能进行评估;
- 使用以下语句安装:
pip install seqeval
seqeval评估支持以下指标
metrics | description |
---|---|
accuracy_score(y_true, y_pred) | Compute the accuracy. |
precision_score(y_true, y_pred) | Compute the precision. |
recall_score(y_true, y_pred) | Compute the recall. |
f1_score(y_true, y_pred) | Compute the F1 score, also known as balanced F-score or F-measure. |
classification_report(y_true, y_pred, digits=2) | Build a text report showing the main classification metrics. digits is number of digits for formatting output floating point values. Default value is 2 . |
seqeval 用法
from seqeval.metrics import accuracy_score
from seqeval.metrics import classification_report
from seqeval.metrics import f1_score
y_true = [['O', 'O', 'O', 'B-MISC', 'I-MISC', 'I-MISC', 'O'], ['B-PER', 'I-PER', 'O']]
y_pred = [['O', 'O', 'B-MISC', 'I-MISC', 'I-MISC', 'I-MISC', 'O'], ['B-PER', 'I-PER', 'O']]
f1_score(y_true, y_pred) # 0.5
accuracy_score(y_true, y_pred) # 0.8
classification_report(y_true, y_pred)
# precision recall f1-score support
# MISC 0.00 0.00 0.00 1
# PER 1.00 1.00 1.00 1
# micro avg 0.50 0.50 0.50 2
# macro avg 0.50 0.50 0.50 2