Effective Inference for Generative Neural Parsing

07/27/2017
by   Mitchell Stern, et al.
0

Generative neural models have recently achieved state-of-the-art results for constituency parsing. However, without a feasible search procedure, their use has so far been limited to reranking the output of external parsers in which decoding is more tractable. We describe an alternative to the conventional action-level beam search used for discriminative neural models that enables us to decode directly in these generative models. We then show that by improving our basic candidate selection strategy and using a coarse pruning function, we can improve accuracy while exploring significantly less of the search space. Applied to the model of Choe and Charniak (2016), our inference procedure obtains 92.56 F1 on section 23 of the Penn Treebank, surpassing prior state-of-the-art results for single-model systems.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/10/2017

Improving Neural Parsing by Disentangling Model Combination and Reranking Effects

Recent work has proposed several generative neural models for constituen...
research
09/24/2019

Neural Generative Rhetorical Structure Parsing

Rhetorical structure trees have been shown to be useful for several docu...
research
07/05/2016

Global Neural CCG Parsing with Optimality Guarantees

We introduce the first global recursive neural parsing model with optima...
research
08/01/2017

A Generative Parser with a Discriminative Recognition Algorithm

Generative models defining joint distributions over parse trees and sent...
research
09/27/2019

Improving Semantic Parsing with Neural Generator-Reranker Architecture

Semantic parsing is the problem of deriving machine interpretable meanin...
research
12/16/2022

Fast Rule-Based Decoding: Revisiting Syntactic Rules in Neural Constituency Parsing

Most recent studies on neural constituency parsing focus on encoder stru...
research
05/27/2021

Search Spaces for Neural Model Training

While larger neural models are pushing the boundaries of what deep learn...

Please sign up or login with your details

Forgot password? Click here to reset