Distributed Parameter Estimation in Randomized One-hidden-layer Neural Networks

09/20/2019
by   Yinsong Wang, et al.
0

This paper addresses distributed parameter estimation in randomized one-hidden-layer neural networks. A group of agents sequentially receive measurements of an unknown parameter that is only partially observable to them. In this paper, we present a fully distributed estimation algorithm where agents exchange local estimates with their neighbors to collectively identify the true value of the parameter. We prove that this distributed update provides an asymptotically unbiased estimator of the unknown parameter, i.e., the first moment of the expected global error converges to zero asymptotically. We further analyze the efficiency of the proposed estimation scheme by establishing an asymptotic upper bound on the variance of the global error. Applying our method to a real-world dataset related to appliances energy prediction, we observe that our empirical findings verify the theoretical results.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/22/2019

On Parameter Estimation of Hidden Ergodic Ornstein-Uhlenbeck Process

We consider the problem of parameter estimation for the partially observ...
research
08/11/2015

Are Slepian-Wolf Rates Necessary for Distributed Parameter Estimation?

We consider a distributed parameter estimation problem, in which multipl...
research
09/10/2013

Exponentially Fast Parameter Estimation in Networks Using Distributed Dual Averaging

In this paper we present an optimization-based view of distributed param...
research
03/30/2020

Supplementary Material for CDC Submission No. 1461

In this paper, we focus on the influences of the condition number of the...
research
08/07/2023

Quantifying MEV On Layer 2 Networks

This paper addresses the lack of research on quantifying Maximal Extract...
research
09/23/2018

On the Information in Extreme Measurements for Parameter Estimation

This paper deals with parameter estimation from extreme measurements. Wh...
research
03/22/2018

Maximum Consensus Parameter Estimation by Reweighted ℓ_1 Methods

Robust parameter estimation in computer vision is frequently accomplishe...

Please sign up or login with your details

Forgot password? Click here to reset