DeepAI AI Chat
Log In Sign Up

Multiresolution Convolutional Autoencoders

by   Yuying Liu, et al.
University of Washington

We propose a multi-resolution convolutional autoencoder (MrCAE) architecture that integrates and leverages three highly successful mathematical architectures: (i) multigrid methods, (ii) convolutional autoencoders and (iii) transfer learning. The method provides an adaptive, hierarchical architecture that capitalizes on a progressive training approach for multiscale spatio-temporal data. This framework allows for inputs across multiple scales: starting from a compact (small number of weights) network architecture and low-resolution data, our network progressively deepens and widens itself in a principled manner to encode new information in the higher resolution data based on its current performance of reconstruction. Basic transfer learning techniques are applied to ensure information learned from previous training steps can be rapidly transferred to the larger network. As a result, the network can dynamically capture different scaled features at different depths of the network. The performance gains of this adaptive multiscale architecture are illustrated through a sequence of numerical experiments on synthetic examples and real-world spatial-temporal data.


page 3

page 4

page 9

page 11

page 12

page 13

page 14


Multiscale Spatio-Temporal Graph Neural Networks for 3D Skeleton-Based Motion Prediction

We propose a multiscale spatio-temporal graph neural network (MST-GNN) t...

Improving Generalization of Transfer Learning Across Domains Using Spatio-Temporal Features in Autonomous Driving

Training vision-based autonomous driving in the real world can be ineffi...

Transfer Learning from Synthetic to Real-Noise Denoising with Adaptive Instance Normalization

Real-noise denoising is a challenging task because the statistics of rea...

MeshfreeFlowNet: A Physics-Constrained Deep Continuous Space-Time Super-Resolution Framework

We propose MeshfreeFlowNet, a novel deep learning-based super-resolution...

Towards the One Learning Algorithm Hypothesis: A System-theoretic Approach

The existence of a universal learning architecture in human cognition is...