Deep Transform and Metric Learning Networks

04/21/2021
by   Wen Tang, et al.
0

Based on its great successes in inference and denosing tasks, Dictionary Learning (DL) and its related sparse optimization formulations have garnered a lot of research interest. While most solutions have focused on single layer dictionaries, the recently improved Deep DL methods have also fallen short on a number of issues. We hence propose a novel Deep DL approach where each DL layer can be formulated and solved as a combination of one linear layer and a Recurrent Neural Network, where the RNN is flexibly regraded as a layer-associated learned metric. Our proposed work unveils new insights between the Neural Networks and Deep DL, and provides a novel, efficient and competitive approach to jointly learn the deep transforms and metrics. Extensive experiments are carried out to demonstrate that the proposed method can not only outperform existing Deep DL, but also state-of-the-art generic Convolutional Neural Networks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/18/2020

Deep Transform and Metric Learning Network: Wedding Deep Dictionary Learning and Neural Networks

On account of its many successes in inference tasks and denoising applic...
research
10/08/2018

Deep Learning with the Random Neural Network and its Applications

The random neural network (RNN) is a mathematical model for an "integrat...
research
09/10/2018

Energy Disaggregation via Deep Temporal Dictionary Learning

This paper addresses the energy disaggregation problem, i.e. decomposing...
research
05/30/2012

A Brief Summary of Dictionary Learning Based Approach for Classification (revised)

This note presents some representative methods which are based on dictio...
research
07/05/2021

A Deep Learning-Based Particle-in-Cell Method for Plasma Simulations

We design and develop a new Particle-in-Cell (PIC) method for plasma sim...
research
05/05/2017

SLDR-DL: A Framework for SLD-Resolution with Deep Learning

This paper introduces an SLD-resolution technique based on deep learning...
research
08/15/2023

Inverse Lithography Physics-informed Deep Neural Level Set for Mask Optimization

As the feature size of integrated circuits continues to decrease, optica...

Please sign up or login with your details

Forgot password? Click here to reset