Deep Layer Aggregation

07/20/2017
by   Fisher Yu, et al.
0

Convolutional networks have had great success in image classification and other areas of computer vision. Recent efforts have designed deeper or wider networks to improve performance; as convolutional blocks are usually stacked together, blocks at different depths represent information at different scales. Recent models have explored `skip' connections to aggregate information across layers, but heretofore such skip connections have themselves been `shallow', projecting to a single fusion node. In this paper, we investigate new deep-across-layer architectures to aggregate the information from multiple layers. We propose novel iterative and hierarchical structures for deep layer aggregation. The former can produce deep high resolution representations from a network whose final layers have low resolution, while the latter can effectively combine scale information from all blocks. Results show that the our proposed architectures can make use of network parameters and features more efficiently without dictating convolution module structure. We also show transfer of the learned networks to semantic segmentation tasks and achieve better results than alternative networks with baseline training settings.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/23/2017

Investigating the feature collection for semantic segmentation via single skip connection

Since the study of deep convolutional neural network became prevalent, o...
research
04/30/2018

Towards Deeper Generative Architectures for GANs using Dense connections

In this paper, we present the result of adopting skip connections and de...
research
04/27/2018

Stacked U-Nets: A No-Frills Approach to Natural Image Segmentation

Many imaging tasks require global information about all pixels in an ima...
research
05/05/2021

Learning Feature Aggregation for Deep 3D Morphable Models

3D morphable models are widely used for the shape representation of an o...
research
07/18/2017

Beyond Forward Shortcuts: Fully Convolutional Master-Slave Networks (MSNets) with Backward Skip Connections for Semantic Segmentation

Recent deep CNNs contain forward shortcut connections; i.e. skip connect...
research
10/15/2020

Why Layer-Wise Learning is Hard to Scale-up and a Possible Solution via Accelerated Downsampling

Layer-wise learning, as an alternative to global back-propagation, is ea...
research
11/20/2018

Recurrent Iterative Gating Networks for Semantic Segmentation

In this paper, we present an approach for Recurrent Iterative Gating cal...

Please sign up or login with your details

Forgot password? Click here to reset