SUNY Downstate Health Sciences University
Department of Physiology and Pharmacology
John K. Chapin, PhD
Physiology and Pharmacology
Tel: (718) 270-2767
Robot Arm Controlled Using Command Signals Recorded Directly from Brain Neurons
Our laboratory employs multi-electrode based brain interface technologies to investigate the control of movement by the sensory and motor systems in the brain. We have recently demonstrated that experimental animals can learn to control a robot arm using brain-derived signals alone, as recorded from neuronal populations in the motor cortex. This approach could be used to restore motor function in paralysis patients.
Information processing in the brain involves the coordinated activity of large networks of neurons. Over the past 15 years we have developed and utilized technologies for extracting this information from neuronal populations in behaving animals. This involves chronically implanting multi-electrode arrays in functionally connected areas of the motor and somatosensory systems of the brain. Multi-processor computer systems are used to simultaneously discriminate and record the spiking activity of large numbers of single neurons within those systems. Mathematical techniques are used to decode the information processed by these neuronal populations while the animals perform specific behavioral tasks involving somatosensory perception and/or trained limb movement.
We have recently shown that electronic decoding of neuronal population activity could be used to extract and utilize "comm" for forelimb movement from the motor cortex of rats. The rats were initially trained to use their forelimbs to press down a lever to a certain position. The lever movement controlled movement of a robot arm to obtain a drop of water from a dropper (fig. 1). When the rat released the lever the robot arm delivered the water to the rat's mouth. Next we suddenly switched the control of the robot arm away from this lever-press, and replaced it with the electronic signal carrying decoded movement commands from the motor cortex. Four of the six rats were able to use this motor command signal to control the robot arm with sufficient accuracy to reliably and repeatedly retrieve water drops. After a few days of this training, the animals were increasingly able to move the robot arm and retrieve water without the concomitant lever pressing. This suggests that motor cortical control of limb movement is modifiable. Thus, paraplegic patients might be able to use their motor cortex activity to directly control a robot arm, or their own arm using functional stimulation of the paralyzed muscles. In collaborative studies with Dr. Miguel Nicolelis at Duke University the overall feasibility of this approach has been demonstrated in monkeys. We are now further developing technology to allow up to 1000 neurons to be recorded simultaneously.
- Nicolelis, M. A. L., Baccala, L. A., Lin, R. C. S., and Chapin, J. K. (1995). Synchronous neuronal ensemble activity at multiple levels of the rat somatosensory system anticipates onset and frequency of tactile exploratory movements. Science 268, 1353-1358.
- Nicolelis, A. L., Ghazanfar, A. A., Stambaugh, C. R., Oliveira, L. M., Laubach, M. Chapin, J. K., Nelson, R. J., and Kaas, J. H. (1998). Simultaneous representation of tactile information by three primate cortical areas. Nature Neuroscience 1, 621-630.
- Chapin, J. K., Markowitz, R. A., Moxon, K. A., and Nicolelis, M. A. L. (1999). Direct real-time control of a robot arm using signals derived from neuronal population recordings in motor cortex. Nature Neuroscience 2, 664-670.
- Chapin, J. K., and Nicolelis, M. A. L. (2000). Brain control of sensorimotor prostheses. In Neural Prostheses for Restoration of Sensory and Motor Function (Chapin, J. K., and Moxon, K. A. eds.), CRC Press, Baco Raton, pp. 235-262.
- Wessberg, J., Stambaugh, C. R., Kralik, J. D., Beck, P. D., Laubach, M., Chapin, J. K., Kim, J., Biggs, S. J., Srinivasan, M. A., and Nicolelis, M. A. L. (2000). Real-time prediction of hand trajectory by ensembles of cortical neurons in primates. Nature 408, 361 - 365.