Abstract Diagrammatic Reasoning with Multiplex Graph Networks

by   Duo Wang, et al.
University of Cambridge

Abstract reasoning, particularly in the visual domain, is a complex human ability, but it remains a challenging problem for artificial neural learning systems. In this work we propose MXGNet, a multilayer graph neural network for multi-panel diagrammatic reasoning tasks. MXGNet combines three powerful concepts, namely, object-level representation, graph neural networks and multiplex graphs, for solving visual reasoning tasks. MXGNet first extracts object-level representations for each element in all panels of the diagrams, and then forms a multi-layer multiplex graph capturing multiple relations between objects across different diagram panels. MXGNet summarises the multiple graphs extracted from the diagrams of the task, and uses this summarisation to pick the most probable answer from the given candidates. We have tested MXGNet on two types of diagrammatic reasoning tasks, namely Diagram Syllogisms and Raven Progressive Matrices (RPM). For an Euler Diagram Syllogism task MXGNet achieves state-of-the-art accuracy of 99.8 comprehensive datasets for RPM reasoning, MXGNet outperforms the state-of-the-art models by a considerable margin.


DAReN: A Collaborative Approach Towards Reasoning And Disentangling

Computational learning approaches to solving visual reasoning tests, suc...

Learning Syllogism with Euler Neural-Networks

Traditional neural networks represent everything as a vector, and are ab...

Structured Set Matching Networks for One-Shot Part Labeling

Diagrams often depict complex phenomena and serve as a good test bed for...

Dynamic Graph Generation Network: Generating Relational Knowledge from Diagrams

In this work, we introduce a new algorithm for analyzing a diagram, whic...

Solving Raven's Progressive Matrices with Multi-Layer Relation Networks

Raven's Progressive Matrices are a benchmark originally designed to test...

Neural Consciousness Flow

The ability of reasoning beyond data fitting is substantial to deep lear...

Please sign up or login with your details

Forgot password? Click here to reset