research
∙
07/13/2022
N-Grammer: Augmenting Transformers with latent n-grams
Transformer models have recently emerged as one of the foundational mode...
share
research
∙
09/27/2021
BigSSL: Exploring the Frontier of Large-Scale Semi-Supervised Learning for Automatic Speech Recognition
We summarize the results of a host of efforts using giant automatic spee...
research
∙
05/10/2021
GSPMD: General and Scalable Parallelization for ML Computation Graphs
We present GSPMD, an automatic, compiler-based parallelization system fo...
research
∙
11/07/2020
Exploring the limits of Concurrency in ML Training on Google TPUs
Recent results in language understanding using neural networks have requ...
research
∙
05/16/2020
Conformer: Convolution-augmented Transformer for Speech Recognition
Recently Transformer and Convolution neural network (CNN) based models h...
research
∙
04/28/2020
Automatic Cross-Replica Sharding of Weight Update in Data-Parallel Training
In data-parallel synchronous training of deep neural networks, different...
research
∙
01/04/2020
SurveilEdge: Real-time Video Query based on Collaborative Cloud-Edge Deep Learning
The real-time query of massive surveillance video data plays a fundament...
research
∙
09/21/2019