WikiSplit

Submitted by on Jan 08 2020 } Suggest Revision
By: Jan A. Botha, Manaal Faruqui, John Paul Alex, Jason Baldridge, Dipanjan Das
Resource Type:
Data
License:
CC BY-SA 4.0
Language:
not code
Data Format:
tsv

Description

One million English sentences, each split into two sentences that together preserve the original meaning, extracted from Wikipedia edits. The WikiSplit dataset was constructed automatically from the publicly available Wikipedia revision history. Although the dataset contains some inherent noise, it can serve as valuable training data form models that split or merge sentences.
Post comment
Cancel