Algorithms:

Reinforcement Learning

The panel so titled shows the performance of the reinforcement learning algorithm doing dynamic channel allocation in cellular telephones. To learn more about reinforcement learning, please read Reinforcement Learning for Dynamic Channel Allocation in Cellular Telephone Systems.

Fixed Assignment

The panel so titled shows the performance of the fixed assignment algorithm doing dynamic channel allocation in cellular telephones. To learn more about fixed assignment please read Reinforcement Learning for Dynamic Channel Allocation in Cellular Telephone Systems.

Graphical Effects:

Number in the Cells
Indicate the number of ongoing calls in that cell.
Grayscale in the Cells
Indicates the number of ongoing calls: the darker the color the more the calls.
Flashing Color
Indicates a call arrival in the cell.

Display Counters:

time in secs
This is the time in seconds that has been simulated.
Calls
This is the total number of calls in the entire cellular array that have arrived until that point in time.
(RL) Calls Blocked
This is the percentage of calls that have not been accepted since the beginning of time by the reinforcement learning (RL) algorithm.
(FA) Calls Blocked
This is the percentage of calls that have not been accepted since the beginning of time by the fixed assignment (FA) algorithm.

Controls:

Flash Duration
This merely effects the graphical display.
calls/hr
This textfield shows the MEAN number of calls per hour being generated using a Poisson distribution in each cell of the cellular telephone array depicted. You can change this rate by editing the text field directly, or by using the up or down buttons.
Stop/Continue
This toggle button freezes/unfreezes time.
Restart
This resets the clock.
Width
Width is the number of cells in the horizontal direction. You can change this by directly editing the textfield. Changing width also restarts the time clock. Width has to be larger than one and less than 12.
Height
Height is the number of cells in the vertical direction. You can change this by directly editing the textfield (you have to hit return after editing the textfield). Changing height also restarts the time clock. Height has to be larger than one and less than 12.
Channels
Channels is the number of channels available to the cellular system. For a 2-d array, this has to be a multiple of 7. For a 1-d world this has to be a multiple of 3. These numbers are used by the FA algorithm but are not required by the RL algorithm.

Go back to Demo.