research
∙
11/17/2022
VeLO: Training Versatile Learned Optimizers by Scaling Up
While deep learning models have replaced hand-designed features across m...
share
research
∙
11/09/2022
Efficiently Scaling Transformer Inference
We study the problem of efficient generative inference for Transformer m...
research
∙
09/14/2022
PaLI: A Jointly-Scaled Multilingual Language-Image Model
Effective scaling and a flexible task interface enable large language mo...
research
∙
04/05/2022
PaLM: Scaling Language Modeling with Pathways
Large language models have been shown to achieve remarkable performance ...
research
∙
03/31/2022
Scaling Up Models and Data with and
Recent neural network-based language models have benefited greatly from ...
research
∙
11/07/2020
Exploring the limits of Concurrency in ML Training on Google TPUs
Recent results in language understanding using neural networks have requ...
research
∙
06/24/2020
A High-Quality Multilingual Dataset for Structured Documentation Translation
This paper presents a high-quality multilingual dataset for the document...
research
∙
12/03/2019
PyTorch: An Imperative Style, High-Performance Deep Learning Library
Deep learning frameworks have often focused on either usability or speed...
research
∙
08/26/2019
OpenSpiel: A Framework for Reinforcement Learning in Games
OpenSpiel is a collection of environments and algorithms for research in...
research
∙
12/20/2017
A Flexible Approach to Automated RNN Architecture Generation
The process of designing neural architectures requires expert knowledge ...
research
∙
12/20/2017
Block-diagonal Hessian-free Optimization for Training Neural Networks
Second-order methods for neural network optimization have several advant...
research
∙
11/07/2017
Non-Autoregressive Neural Machine Translation
Existing approaches to neural machine translation condition each output ...
research
∙
09/06/2017
Towards Neural Machine Translation with Latent Tree Attention
Building models that take advantage of the hierarchical structure of lan...
research
∙
08/01/2017
Learned in Translation: Contextualized Word Vectors
Computer vision has benefited from initializing multiple deep layers wit...
research
∙
11/05/2016
Quasi-Recurrent Neural Networks
Recurrent neural networks are a powerful tool for modeling sequential da...
research
∙
09/26/2016
Pointer Sentinel Mixture Models
Recent neural network sequence models with softmax classifiers have achi...
research
∙
06/24/2015