Support

Support Options

Submit a Support Ticket

 

[Illinois]: Avoidance Learn Simulation

By AbderRahman N Sobh

University of Illinois at Urbana-Champaign

This script simulates avoidance conditioning as reinforcement learning with two upper motoneurons (SUMO and FUMO).

Launch Tool

You must login before you can run this tool.

Version 1.0c - published on 19 Aug 2013

doi:10.4231/D3V698C2K cite this

This tool is closed source.

View All Supporting Documents

See also

No results found.

Default Inputs

Category

Tools

Published on

Abstract

From Tutorial on Neural Systems Modeling, Chapter 7, pg. 238:

We will refer to the upper motoneurons that elicit “spin” and “freeze” responses as the spin upper-motoneuron (SUMO) and the freeze upper-motoneuron (FUMO), respectively.

We will assume that both SUMO and FUMO receive auditory input and respond to tone. We will further assume that the behavioral response of the rabbit will be determined by whichever upper-motoneuron schema has the larger response to the tone. For example, if the response of SUMO is greater than that of FUMO, then SUMO will win the competition for control of the behavioral response, and the rabbit will spin the wheel rather than freeze. However, since there is an element of randomness in behavior, we will assume that the rabbit will sometimes innovate (i.e., explore). This means that the rabbit will sometimes produce the behavior represented by the upper-motoneuron schema that loses the competition for behavioral control. Finally, we assume that the rabbit can learn to change its behavioral response to the tone by adjusting the sizes of the responses of SUMO and FUMO to the tone. We assume that this learning is driven by reinforcement signals, and that the overall rabbit model expresses reinforcement learning by acquiring a simu­lated version of the avoidance response. The ability of the model to simulate this form of reinforcement learning depends entirely on its structure.

The model will incorporate a HEAR schema that represents the auditory system. We will design the model so that the weights of the excitatory connec­tions from the HEAR schema to either upper-motoneuron schema are modifi­able. On each trial, the weight that is modified will be the one associated with the connection from HEAR to whichever upper motoneuron represented the behavioral response produced by the simulated rabbit. For example, if the rab­bit spins the wheel, then the weight of the connection to SUMO from HEAR will be modified. The amount of this modification will be proportional to the difference between a reinforcement signal and the current weight value. Thus the weights from HEAR, and so the responses of SUMO and FUMO to the tone, will track the reinforcement associated with a spin or a freeze response, respectively.

Sponsored by

NanoBio Node, University of Illinois Champaign-Urbana

Cite this work

Researchers should cite this work as follows:

  • Tutorial on Neural Systems Modeling, Copyright 2010 Sinauer Associates Inc. Author: Thomas J. Anastasio
  • AbderRahman N Sobh (2013), "[Illinois]: Avoidance Learn Simulation," http://nanohub.org/resources/avoidlearn. (DOI: 10.4231/D3V698C2K).

    BibTex | EndNote

Tags

nanoHUB.org, a resource for nanoscience and nanotechnology, is supported by the National Science Foundation and other funding agencies. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation.