A Survey on Recent Advances in Sequence Labeling from Deep Learning Models

11/13/2020
by   Zhiyong He, et al.
0

Sequence labeling (SL) is a fundamental research problem encompassing a variety of tasks, e.g., part-of-speech (POS) tagging, named entity recognition (NER), text chunking, etc. Though prevalent and effective in many downstream applications (e.g., information retrieval, question answering, and knowledge graph embedding), conventional sequence labeling approaches heavily rely on hand-crafted or language-specific features. Recently, deep learning has been employed for sequence labeling tasks due to its powerful capability in automatically learning complex features of instances and effectively yielding the stat-of-the-art performances. In this paper, we aim to present a comprehensive review of existing deep learning-based sequence labeling models, which consists of three related tasks, e.g., part-of-speech tagging, named entity recognition, and text chunking. Then, we systematically present the existing approaches base on a scientific taxonomy, as well as the widely-used experimental datasets and popularly-adopted evaluation metrics in the SL domain. Furthermore, we also present an in-depth analysis of different SL models on the factors that may affect the performance and future directions in the SL domain.

READ FULL TEXT
research
12/22/2018

A Survey on Deep Learning for Named Entity Recognition

Named entity recognition (NER) is the task to identify text spans that m...
research
04/24/2017

Semi-supervised Multitask Learning for Sequence Labeling

We propose a sequence labeling framework with a secondary training objec...
research
08/30/2017

An Empirical Study of Discriminative Sequence Labeling Models for Vietnamese Text Processing

This paper presents an empirical study of two widely-used sequence predi...
research
08/24/2019

Enhancing Neural Sequence Labeling with Position-Aware Self-Attention

Sequence labeling is a fundamental task in natural language processing a...
research
05/29/2019

Learning Task-specific Representation for Novel Words in Sequence Labeling

Word representation is a key component in neural-network-based sequence ...
research
10/25/2022

Influence Functions for Sequence Tagging Models

Many language tasks (e.g., Named Entity Recognition, Part-of-Speech tagg...
research
12/05/2022

GNN-SL: Sequence Labeling Based on Nearest Examples via GNN

To better handle long-tail cases in the sequence labeling (SL) task, in ...

Please sign up or login with your details

Forgot password? Click here to reset