Syntax Role for Neural Semantic Role Labeling

by   Zuchao Li, et al.

Semantic role labeling (SRL) is dedicated to recognizing the semantic predicate-argument structure of a sentence. Previous studies in terms of traditional models have shown syntactic information can make remarkable contributions to SRL performance; however, the necessity of syntactic information was challenged by a few recent neural SRL studies that demonstrate impressive performance without syntactic backbones and suggest that syntax information becomes much less important for neural semantic role labeling, especially when paired with recent deep neural network and large-scale pre-trained language models. Despite this notion, the neural SRL field still lacks a systematic and full investigation on the relevance of syntactic information in SRL, for both dependency and both monolingual and multilingual settings. This paper intends to quantify the importance of syntactic information for neural SRL in the deep learning framework. We introduce three typical SRL frameworks (baselines), sequence-based, tree-based, and graph-based, which are accompanied by two categories of exploiting syntactic information: syntax pruning-based and syntax feature-based. Experiments are conducted on the CoNLL-2005, 2009, and 2012 benchmarks for all languages available, and results show that neural SRL models can still benefit from syntactic information under certain conditions. Furthermore, we show the quantitative significance of syntax to neural SRL models together with a thorough empirical survey using existing models.


page 1

page 2

page 3

page 4


Syntax-aware Neural Semantic Role Labeling with Supertags

We introduce a new syntax-aware model for dependency-based semantic role...

Transition-based Semantic Role Labeling with Pointer Networks

Semantic role labeling (SRL) focuses on recognizing the predicate-argume...

Syntax-Aware Graph-to-Graph Transformer for Semantic Role Labelling

The goal of semantic role labelling (SRL) is to recognise the predicate-...

Wave to Syntax: Probing spoken language models for syntax

Understanding which information is encoded in deep models of spoken and ...

Semantic Role Labeling with Associated Memory Network

Semantic role labeling (SRL) is a task to recognize all the predicate-ar...

Syntax-aware Multilingual Semantic Role Labeling

Recently, semantic role labeling (SRL) has earned a series of success wi...

Multilingual Irony Detection with Dependency Syntax and Neural Models

This paper presents an in-depth investigation of the effectiveness of de...

Please sign up or login with your details

Forgot password? Click here to reset