Creating Training Sets via Weak Indirect Supervision

by   Jieyu Zhang, et al.

Creating labeled training sets has become one of the major roadblocks in machine learning. To address this, recent Weak Supervision (WS) frameworks synthesize training labels from multiple potentially noisy supervision sources. However, existing frameworks are restricted to supervision sources that share the same output space as the target task. To extend the scope of usable sources, we formulate Weak Indirect Supervision (WIS), a new research problem for automatically synthesizing training labels based on indirect supervision sources that have different output label spaces. To overcome the challenge of mismatched output spaces, we develop a probabilistic modeling approach, PLRM, which uses user-provided label relations to model and leverage indirect supervision sources. Moreover, we provide a theoretically-principled test of the distinguishability of PLRM for unseen labels, along with an generalization bound. On both image and text classification tasks as well as an industrial advertising application, we demonstrate the advantages of PLRM by outperforming baselines by a margin of 2


Learning from Indirect Observations

Weakly-supervised learning is a paradigm for alleviating the scarcity of...

Integrated Weak Learning

We introduce Integrated Weak Learning, a principled framework that integ...

Learning from Multiple Noisy Partial Labelers

Programmatic weak supervision creates models without hand-labeled traini...

A Survey on Programmatic Weak Supervision

Labeling training data has become one of the major roadblocks to using m...

Universalizing Weak Supervision

Weak supervision (WS) frameworks are a popular way to bypass hand-labeli...

Deep Probabilistic Logic: A Unifying Framework for Indirect Supervision

Deep learning has emerged as a versatile tool for a wide range of NLP ta...

Physics-constrained indirect supervised learning

This study proposes a supervised learning method that does not rely on l...

Please sign up or login with your details

Forgot password? Click here to reset