Improved Space Bounds for Learning with Experts

03/02/2023
by   Anders Aamand, et al.
0

We give improved tradeoffs between space and regret for the online learning with expert advice problem over T days with n experts. Given a space budget of n^δ for δ∈ (0,1), we provide an algorithm achieving regret Õ(n^2 T^1/(1+δ)), improving upon the regret bound Õ(n^2 T^2/(2+δ)) in the recent work of [PZ23]. The improvement is particularly salient in the regime δ→ 1 where the regret of our algorithm approaches Õ_n(√(T)), matching the T dependence in the standard online setting without space restrictions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/03/2023

Streaming Algorithms for Learning with Experts: Deterministic Versus Robust

In the online learning with experts problem, an algorithm must make a pr...
research
03/09/2023

On the Value of Stochastic Side Information in Online Learning

We study the effectiveness of stochastic side information in determinist...
research
03/03/2023

Near Optimal Memory-Regret Tradeoff for Online Learning

In the experts problem, on each of T days, an agent needs to follow the ...
research
02/05/2020

Locally-Adaptive Nonparametric Online Learning

One of the main strengths of online algorithms is their ability to adapt...
research
03/15/2022

Efficient and Optimal Fixed-Time Regret with Two Experts

Prediction with expert advice is a foundational problem in online learni...
research
11/11/2019

Learning The Best Expert Efficiently

We consider online learning problems where the aim is to achieve regret ...
research
03/04/2011

Adapting to Non-stationarity with Growing Expert Ensembles

When dealing with time series with complex non-stationarities, low retro...

Please sign up or login with your details

Forgot password? Click here to reset