research
∙
09/16/2023
Earth Virtualization Engines – A Technical Perspective
Participants of the Berlin Summit on Earth Virtualization Engines (EVEs)...
share
research
∙
09/07/2023
OSMOSIS: Enabling Multi-Tenancy in Datacenter SmartNICs
Multi-tenancy is essential for unleashing SmartNIC's potential in datace...
research
∙
08/23/2023
Cached Operator Reordering: A Unified View for Fast GNN Training
Graph Neural Networks (GNNs) are a powerful tool for handling structured...
research
∙
08/18/2023
Graph of Thoughts: Solving Elaborate Problems with Large Language Models
We introduce Graph of Thoughts (GoT): a framework that advances promptin...
research
∙
07/17/2023
Differentiable Transportation Pruning
Deep learning algorithms are increasingly employed at the edge. However,...
research
∙
07/17/2023
Maximum Flows in Parametric Graph Templates
Execution graphs of parallel loop programs exhibit a nested, repeating s...
research
∙
07/02/2023
Disentangling Hype from Practicality: On Realistically Achieving Quantum Advantage
Quantum computers offer a new paradigm of computing with the potential t...
research
∙
06/28/2023
FuzzyFlow: Leveraging Dataflow To Find and Squash Program Optimization Bugs
The current hardware landscape and application scale is driving performa...
research
∙
06/19/2023
Co-design Hardware and Algorithm for Vector Search
Vector search has emerged as the foundation for large-scale information ...
research
∙
06/05/2023
SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression
Recent advances in large language model (LLM) pretraining have led to hi...
research
∙
06/05/2023
Streaming Task Graph Scheduling for Dataflow Architectures
Dataflow devices represent an avenue towards saving the control and data...
research
∙
06/01/2023
Bridging Control-Centric and Data-Centric Optimization
With the rise of specialized hardware and new programming languages, cod...
research
∙
05/18/2023
The Graph Database Interface: Scaling Online Transactional and Analytical Graph Workloads to Hundreds of Thousands of Cores
Graph databases (GDBs) are crucial in academic and industry applications...
research
∙
05/15/2023
FMI: Fast and Cheap Message Passing for Serverless Functions
Serverless functions provide elastic scaling and a fine-grained billing ...
research
∙
05/09/2023
Sparse Stream Semantic Registers: A Lightweight ISA Extension Accelerating General Sparse Linear Algebra
Sparse linear algebra is crucial in many application domains, but challe...
research
∙
05/09/2023
A High-performance, Energy-efficient Modular DMA Engine Architecture
Data transfers are essential in today's computing systems as latency and...
research
∙
05/08/2023
ASDL: A Unified Interface for Gradient Preconditioning in PyTorch
Gradient preconditioning is a key technique to integrate the second-orde...
research
∙
04/15/2023
STen: Productive and Efficient Sparsity in PyTorch
As deep learning models grow, sparsity is becoming an increasingly criti...
research
∙
03/14/2023
Performance Embeddings: A Similarity-based Approach to Automatic Performance Optimization
Performance optimization is an increasingly challenging but often repeti...
research
∙
02/14/2023
PolarStar: Expanding the Scalability Horizon of Diameter-3 Networks
In this paper, we present PolarStar, a novel family of diameter-3 networ...
research
∙
01/17/2023
AutoDDL: Automatic Distributed Deep Learning with Asymptotically Optimal Communication
Recent advances in deep learning base on growing model sizes and the nec...
research
∙
01/06/2023
Myths and Legends in High-Performance Computing
In this humorous and thought provoking article, we discuss certain myths...
research
∙
01/03/2023
A Theory of I/O-Efficient Sparse Neural Network Inference
As the accuracy of machine learning models increases at a fast rate, so ...
research
∙
12/18/2022
Efficient RDMA Communication Protocols
Developers of networked systems often work with low-level RDMA libraries...
research
∙
11/25/2022
PipeFisher: Efficient Training of Large Language Models Using Pipelining and Fisher Information Matrices
Pipeline parallelism enables efficient training of Large Language Models...
research
∙
11/25/2022
HexaMesh: Scaling to Hundreds of Chiplets with an Optimized Chiplet Arrangement
2.5D integration is an important technique to tackle the growing cost of...
research
∙
11/25/2022
Sparse Hamming Graph: A Customizable Network-on-Chip Topology
Chips with hundreds to thousands of cores require scalable networks-on-c...
research
∙
11/24/2022
Spatial Mixture-of-Experts
Many data have an underlying dependence on spatial location; it may be w...
research
∙
11/14/2022
Assessing requirements to scale to practical quantum advantage
While quantum computers promise to solve some scientifically and commerc...
research
∙
10/31/2022
GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
Generative Pre-trained Transformer (GPT) models set themselves apart thr...
research
∙
10/27/2022
Noise in the Clouds: Influence of Network Performance Variability on Application Scalability
Cloud computing represents an appealing opportunity for cost-effective d...
research
∙
10/22/2022
Compressing multidimensional weather and climate data into neural networks
Weather and climate simulations produce petabytes of high-resolution dat...
research
∙
09/20/2022
Neural Graph Databases
Graph databases (GDBs) enable processing and analysis of unstructured, c...
research
∙
09/19/2022
Temporal Vectorization: A Compiler Approach to Automatic Multi-Pumping
The multi-pumping resource sharing technique can overcome the limitation...
research
∙
09/14/2022
Efficient Quantized Sparse Matrix Operations on Tensor Cores
The exponentially growing model size drives the continued success of dee...
research
∙
09/07/2022
SAGE: Software-based Attestation for GPU Execution
With the application of machine learning to security-critical and sensit...
research
∙
09/03/2022
HammingMesh: A Network Topology for Large-Scale Deep Learning
Numerous microarchitectural optimizations unlocked tremendous processing...
research
∙
08/24/2022
ProbGraph: High-Performance and High-Accuracy Graph Mining with Probabilistic Set Representations
Important graph mining problems such as Clustering are computationally d...
research
∙
08/02/2022
PolarFly: A Cost-Effective and Flexible Low-Diameter Topology
In this paper we present PolarFly, a diameter-2 network topology based o...
research
∙
06/29/2022
ENS-10: A Dataset For Post-Processing Ensemble Weather Forecast
Post-processing ensemble prediction systems can improve weather forecast...
research
∙
06/21/2022
Boosting Performance Optimization with Interactive Data Movement Visualization
Optimizing application performance in today's hardware architecture land...
research
∙
06/20/2022
Building Blocks for Network-Accelerated Distributed File Systems
High-performance clusters and datacenters pose increasingly demanding re...
research
∙
06/16/2022
Deinsum: Practically I/O Optimal Multilinear Algebra
Multilinear algebra kernel performance on modern massively-parallel syst...
research
∙
05/19/2022
Parallel and Distributed Graph Neural Networks: An In-Depth Concurrency Analysis
Graph neural networks (GNNs) are among the most powerful tools in deep l...
research
∙
05/10/2022
The spatial computer: A model for energy-efficient parallel computation
We present a new parallel model of computation suitable for spatial arch...
research
∙
05/09/2022
Productive Performance Engineering for Weather and Climate Modeling with Python
Earth system models are developed with a tight coupling to target hardwa...
research
∙
04/13/2022
Fast Arbitrary Precision Floating Point on FPGA
Numerical codes that require arbitrary precision floating point (APFP) n...
research
∙
03/28/2022
FaasKeeper: a Blueprint for Serverless Services
FaaS (Function-as-a-Service) brought a fundamental shift into cloud comp...
research
∙
02/28/2022
Asynchronous Distributed-Memory Triangle Counting and LCC with RMA Caching
Triangle count and local clustering coefficient are two core metrics for...
research
∙
02/16/2022