Sarah Marzen
  • Main
  • People
  • Contact
  • Google Scholar
  • Random ruminations
  • Research Program
  • SFI Workshop: Sensory Prediction, Engineered and Evolved
  • Main
  • People
  • Contact
  • Google Scholar
  • Random ruminations
  • Research Program
  • SFI Workshop: Sensory Prediction, Engineered and Evolved

Random musings

Fixing the textbook on random dynamical systems for reservoir computing

11/1/2021

0 Comments

 
Back when I was at MIT and starting to think about the predictive capabilities of reservoirs, I wanted to pull out the dynamical systems textbook and answer all my questions about prediction.

The first dynamical systems textbook I pulled out was Strogatz.  I realized that I could hit the problem of prediction with that textbook in the limit of weak input, when the basin-attractor portrait failed to change, and that resulted in this paper.

The second book I looked up was one on "Random Dynamical Systems".  I got one chapter in when I realized something-- this book wasn't answering any of my questions on prediction.  I realized that a conceptual shift was needed.  These dynamical systems were not "random".  They were filters of input, and the input was the signal, and it was incorrect for all the problems I was working on to treat the input as noise.  I barely care about what the state of the system is; I only care about how the state of the system relates to the past of the input, something that may be harder to keep track of.

The fix to this, I think, is to look at the joint state space of predictive features of the input and the state of the system and find dynamics on that joint state space.  I did this in this paper.  You have to know something about the input.  The math gets a bit complicated, but I'm hoping that slight fixes to the Strogatz textbook can be imported in the more general case!

Altogether, I think a new textbook on dynamical systems with input is in order, one that includes more recent work on reservoir computing.  These input-dependent dynamical systems actually do a computation, and so many fields-- from biophysics to theoretical neuroscience-- care about quantifying exactly how well that computation is done.  Considering the input as noise is the opposite of solving the problems in these fields.

I think this is a classic example of how bio-inspired math could spark an entirely new textbook.
0 Comments



Leave a Reply.

    Author

    Write something about yourself. No need to be fancy, just an overview.

    Archives

    November 2022
    July 2022
    December 2021
    November 2021
    March 2021
    February 2021
    May 2020
    July 2019
    May 2017

    Categories

    All

    RSS Feed

Proudly powered by Weebly