DUNE: Improving Accuracy for Sketch-INT Network Measurement Systems

12/09/2022
by   Zhongxiang Wei, et al.
0

In-band Network Telemetry (INT) and sketching algorithms are two promising directions for measuring network traffics in real time. To combine sketch with INT and preserve their advantages, a representative approach is to use INT to send a switch sketch in small pieces (called sketchlets) to end-host for reconstructing an identical sketch. However, in this paper, we reveal that when naively selecting buckets to sketchlets, the end-host reconstructed sketch is inaccurate. To overcome this problem, we present DUNE, an innovative sketch-INT network measurement system. DUNE incorporates two key innovations: First, we design a novel scatter sketchlet that is more efficient in transferring measurement data by allowing a switch to select individual buckets to add to sketchlets; Second, we propose lightweight data structures for tracing "freshness" of the sketch buckets, and present algorithms for smartly selecting buckets that contain valuable measurement data to send to end-host. We theoretically prove the effectiveness of our proposed methods, and implement a prototype on commodity programmable switch. The results of extensive experiments driven by real-world traffics on DUNE suggest that our proposed system can substantially improve the measurement accuracy at a trivial cost.

READ FULL TEXT

page 1

page 10

research
10/23/2019

A Fast and Compact Invertible Sketch for Network-Wide Heavy Flow Detection

Fast detection of heavy flows (e.g., heavy hitters and heavy changers) i...
research
12/16/2019

Trapezoidal Sketch: A Sketch Structure for Frequency Estimation of Data Streams

The sketch is one of the typical and widely used data structures for est...
research
12/14/2020

Sketch for traffic measurement: design, optimization, application and implementation

Network measurement probes the underlying network to support upper-level...
research
11/15/2010

Prize insights in probability, and one goat of a recycled error: Jason Rosenhouse's The Monty Hall Problem

The Monty Hall problem is the TV game scenario where you, the contestant...
research
02/22/2019

Scaling Distributed Machine Learning with In-Network Aggregation

Training complex machine learning models in parallel is an increasingly ...
research
05/09/2022

I Know What You Draw: Learning Grasp Detection Conditioned on a Few Freehand Sketches

In this paper, we are interested in the problem of generating target gra...
research
05/17/2022

ROP inception: signal estimation with quadratic random sketching

Rank-one projections (ROP) of matrices and quadratic random sketching of...

Please sign up or login with your details

Forgot password? Click here to reset