To Share, or not to Share Online Event Trend Aggregation Over Bursty Event Streams

01/02/2021
by   Olga Poppe, et al.
0

Complex event processing (CEP) systems continuously evaluate large workloads of pattern queries under tight time constraints. Event trend aggregation queries with Kleene patterns are commonly used to retrieve summarized insights about the recent trends in event streams. State-of-art methods are limited either due to repetitive computations or unnecessary trend construction. Existing shared approaches are guided by statically selected and hence rigid sharing plans that are often sub-optimal under stream fluctuations. In this work, we propose a novel framework Hamlet that is the first to overcome these limitations. Hamlet introduces two key innovations. First, Hamlet adaptively decides whether to share or not to share computations depending on the current stream properties at run time to harvest the maximum sharing benefit. Second, Hamlet is equipped with a highly efficient shared trend aggregation strategy that avoids trend construction. Our experimental study on both real and synthetic data sets demonstrates that Hamlet consistently reduces query latency by up to five orders of magnitude compared to the state-of-the-art approaches.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/06/2020

Sharon: Shared Online Event Sequence Aggregation

Streaming systems evaluate massive workloads of event sequence aggregati...
research
10/06/2020

GRETA: Graph-based Real-time Event Trend Aggregation

Streaming applications from algorithmic trading to traffic management de...
research
10/06/2020

Event Trend Aggregation Under Rich Event Matching Semantics

Streaming applications from health care analytics to algorithmic trading...
research
07/13/2020

Knowledge Graph Driven Approach to Represent Video Streams for Spatiotemporal Event Pattern Matching in Complex Event Processing

Complex Event Processing (CEP) is an event processing paradigm to perfor...
research
07/15/2020

VidCEP: Complex Event Processing Framework to Detect Spatiotemporal Patterns in Video Streams

Video data is highly expressive and has traditionally been very difficul...
research
11/08/2021

CORE: a COmplex event Recognition Engine

Complex Event Recognition (CER) systems are a prominent technology for f...

Please sign up or login with your details

Forgot password? Click here to reset