research
∙
08/31/2023
SARATHI: Efficient LLM Inference by Piggybacking Decodes with Chunked Prefills
Large Language Model (LLM) inference consists of two distinct phases - p...
share
research
∙
06/20/2023
DynaQuant: Compressing Deep Learning Training Checkpoints via Dynamic Quantization
With the increase in the scale of Deep Learning (DL) training workloads ...
research
∙
08/30/2019
Learning Digital Circuits: A Journey Through Weight Invariant Self-Pruning Neural Networks
Recently, in the paper "Weight Agnostic Neural Networks" Gaier & Ha util...
research
∙
02/13/2019
