blimp

Submitted by on Feb 21 2021 } Suggest Revision
From:
Paper:
Resource Type:
Data
License:
Language:
not code
Data Format:

Description

BLiMP is a challenge set for evaluating what language models (LMs) know about major grammatical phenomena in English. BLiMP consists of 67 sub-datasets, each containing 1000 minimal pairs isolating specific contrasts in syntax, morphology, or semantics. The data is automatically generated according to expert-crafted grammars.
Post comment
Cancel