Echo state networks are universal
This paper shows that echo state networks are universal uniform approximants in the context of discrete-time fading memory filters with uniformly bounded inputs defined on negative infinite times. The proof uses newly introduced internal approximation results for filters associated to reservoir computing systems, as well as the external approximation properties of state affine systems proved in a previous work.
READ FULL TEXT