compute_metrics

📚 compute_metrics in Trainer

By Pengpeng Wu

⚙️ 介绍传入Trainer的compute_metrics函数中EvalPrediction.predictions和EvalPrediction.label_ids分别是什么?

  • 先来看一下用法:
import evaluate

clf_metrics = evaluate.load("accuracy")
def compute_metrics(eval_pred):
    preds = eval_pred.predictions.argmax(-1)
    labels = eval_pred.label_ids
    return clf_metrics.compute(predictions=preds, references=labels)

# compute_metrics: Callable[[EvalPrediction], Dict]

compute_metrics

Tags: huggingface
Share: