corner
corner

Phys. Rev. E 63, 036217 (2001) [12 pages]

Learning to control a complex multistable system

Download: PDF (348 kB) Buy this article Export: BibTeX or EndNote (RIS)

Sabino Gadaleta* and Gerhard Dangelmayr
Department of Mathematics, Colorado State University, Weber Building, Fort Collins, Colorado 80523

Received 25 June 2000; revised 19 September 2000; published 27 February 2001

In this paper the control of a periodically kicked mechanical rotor without gravity in the presence of noise is investigated. In recent work it was demonstrated that this system possesses many competing attracting states and thus shows the characteristics of a complex multistable system. We demonstrate that it is possible to stabilize the system at a desired attracting state even in the presence of high noise level. The control method is based on a recently developed algorithm [S. Gadaleta and G. Dangelmayr, Chaos 9, 775 (1999)] for the control of chaotic systems and applies reinforcement learning to find a global optimal control policy directing the system from any initial state towards the desired state in a minimum number of iterations. Being data-based, the method does not require any information about governing dynamical equations.

© 2001 The American Physical Society

URL:
http://link.aps.org/doi/10.1103/PhysRevE.63.036217
DOI:
10.1103/PhysRevE.63.036217
PACS:
05.45.-a, 05.40.Ca, 02.30.Xx

*Email address: sabino@math.colostate.edu

Email address: gerhard@math.colostate.edu