Task
Summarization
SummEvalSummarization.v2 An MTEB dataset Massive Text Embedding Benchmark News Article Summary Semantic Similarity Estimation. This version fixes a bug in the evaluation script that caused the main score to be computed incorrectly. Task category t2t Domains News, Written Reference https://github.com/Yale-LILY/SummEval How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task =… See the full description on the dataset page: https://huggingface.co/datasets/mteb/summeval.
SummEvalSummarization.v2 An MTEB dataset Massive Text Embedding Benchmark