research
∙
05/26/2022
Cost-efficient Gaussian Tensor Network Embeddings for Tensor-structured Inputs
This work discusses tensor network embeddings, which are random matrices...
share
research
∙
05/30/2021
MLPruning: A Multilevel Structured Pruning Framework for Transformer-based Models
Pruning is an effective method to reduce the memory footprint and comput...
research
∙
04/23/2021
Low Rank Approximation in Simulations of Quantum Algorithms
Simulating quantum algorithms on classical computers is challenging when...
research
∙
04/02/2021
Fast and Accurate Randomized Algorithms for Low-rank Tensor Decompositions
Low-rank Tucker and CP tensor decompositions are powerful tools in data ...
research
∙
10/22/2020
Efficient parallel CP decomposition with pairwise perturbation and multi-sweep dimension tree
CP tensor decomposition with alternating least squares (ALS) is dominate...
research
∙
05/10/2020
AutoHOOT: Automatic High-Order Optimization for Tensors
High-order optimization methods, including Newton's method and its varia...
research
∙
10/27/2019
Comparison of Accuracy and Scalability of Gauss-Newton and Alternating Least Squares for CP Decomposition
Alternating least squares is the most widely used algorithm for CP tenso...
research
∙
09/12/2019
Q-BERT: Hessian Based Ultra Low Precision Quantization of BERT
Transformer based architectures have become de-facto models used for a r...
research
∙
03/14/2019
Inefficiency of K-FAC for Large Batch Size Training
In stochastic optimization, large batch training can leverage parallel r...
research
∙
11/26/2018