Assessing BERT's Syntactic Abilities

01/16/2019
by   Yoav Goldberg, et al.
0

I assess the extent to which the recently introduced BERT model captures English syntactic phenomena, using (1) naturally-occurring subject-verb agreement stimuli; (2) "coloreless green ideas" subject-verb agreement stimuli, in which content words in natural sentences are randomly replaced with words sharing the same part-of-speech and inflection; and (3) manually crafted stimuli for subject-verb agreement and reflexive anaphora phenomena. The BERT model performs remarkably well on all cases.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset