Visual Affordance and Function Understanding: A Survey

07/18/2018
by   Mohammed Hassanin, et al.
0

Nowadays, robots are dominating the manufacturing, entertainment and healthcare industries. Robot vision aims to equip robots with the ability to discover information, understand it and interact with the environment. These capabilities require an agent to effectively understand object affordances and functionalities in complex visual domains. In this literature survey, we first focus on Visual affordances and summarize the state of the art as well as open problems and research gaps. Specifically, we discuss sub-problems such as affordance detection, categorization, segmentation and high-level reasoning. Furthermore, we cover functional scene understanding and the prevalent functional descriptors used in the literature. The survey also provides necessary background to the problem, sheds light on its significance and highlights the existing challenges for affordance and functionality learning.

READ FULL TEXT

page 4

page 5

page 8

page 10

page 13

page 14

page 15

page 17

research
03/09/2018

Indoor Scene Understanding in 2.5/3D: A Survey

With the availability of low-cost and compact 2.5/3D visual sensing devi...
research
01/29/2016

What Can I Do Around Here? Deep Functional Scene Understanding for Cognitive Robots

For robots that have the capability to interact with the physical enviro...
research
03/11/2019

Building an Affordances Map with Interactive Perception

Robots need to understand their environment to perform their task. If it...
research
05/31/2019

Visual Understanding and Narration: A Deeper Understanding and Explanation of Visual Scenes

We describe the task of Visual Understanding and Narration, in which a r...
research
03/30/2021

3D AffordanceNet: A Benchmark for Visual Object Affordance Understanding

The ability to understand the ways to interact with objects from visual ...
research
04/01/2019

The RGB-D Triathlon: Towards Agile Visual Toolboxes for Robots

Deep networks have brought significant advances in robot perception, ena...
research
06/24/2019

Integrating Knowledge and Reasoning in Image Understanding

Deep learning based data-driven approaches have been successfully applie...

Please sign up or login with your details

Forgot password? Click here to reset