uzw/PlainFact
PlainFact is a high-quality human-annotated dataset with fine-grained explanation (i.e., added information) annotations designed for Plain Language Summarization tasks, along with PlainQAFact factuality evaluation framework. It is collected from the Cochrane database sampled from CELLS dataset (Guo et al., 2024). PlainFact is a sentence-level benchmark that splits the summaries into sentences wit
mlforge datasets pull uzw/PlainFact
Dataset details
About uzw/PlainFact
PlainFact is a high-quality human-annotated dataset with fine-grained explanation (i.e., added information) annotations designed for Plain Language Summarization tasks, along with PlainQAFact factuality evaluation framework. It is collected from the Cochrane database sampled from CELLS dataset (Guo et al., 2024). PlainFact is a sentence-level benchmark that splits the summaries into sentences with fine-grained explanation annotations. In total, we have 200 plain language summary-abstract pairs (2,740 sentences). In addition to all factual plain language sentences, we also generate contrasting non-factual examples for each plain language sentence. These contrasting examples are perturbed using GPT-4o, following the perturbation criteria for faithfulness introduced in APPLS (Guo et al., 2024).