Scalable Structure Learning for Probabilistic Soft Logic

07/03/2018
by   Varun Embar, et al.
4

Statistical relational frameworks such as Markov logic networks and probabilistic soft logic (PSL) encode model structure with weighted first-order logical clauses. Learning these clauses from data is referred to as structure learning. Structure learning alleviates the manual cost of specifying models. However, this benefit comes with high computational costs; structure learning typically requires an expensive search over the space of clauses which involves repeated optimization of clause weights. In this paper, we propose the first two approaches to structure learning for PSL. We introduce a greedy search-based algorithm and a novel optimization method that trade-off scalability and approximations to the structure learning problem in varying ways. The highly scalable optimization method combines data-driven generation of clauses with a piecewise pseudolikelihood (PPLL) objective that learns model structure by optimizing clause weights only once. We compare both methods across five real-world tasks, showing that PPLL achieves an order of magnitude runtime speedup and AUC gains up to 15

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/09/2013

Structure Learning of Probabilistic Logic Programs by Searching the Clause Space

Learning probabilistic logic programming languages is receiving an incre...
research
05/19/2017

Induction of Interpretable Possibilistic Logic Theories from Relational Data

The field of Statistical Relational Learning (SRL) is concerned with lea...
research
06/28/2016

On the Semantic Relationship between Probabilistic Soft Logic and Markov Logic

Markov Logic Networks (MLN) and Probabilistic Soft Logic (PSL) are widel...
research
05/17/2015

Hinge-Loss Markov Random Fields and Probabilistic Soft Logic

A fundamental challenge in developing high-impact machine learning techn...
research
02/25/2014

Inductive Logic Boosting

Recent years have seen a surge of interest in Probabilistic Logic Progra...
research
02/09/2023

Principled and Efficient Motif Finding for Structure Learning in Lifted Graphical Models

Structure learning is a core problem in AI central to the fields of neur...
research
05/24/2023

SVDinsTN: An Integrated Method for Tensor Network Representation with Efficient Structure Search

Tensor network (TN) representation is a powerful technique for data anal...

Please sign up or login with your details

Forgot password? Click here to reset