[Illinois]: Temporal Difference, Iterative Dynamic Programming, and Least Mean Squares

By Bara Saadah¹; Nahil Sobh¹; AbderRahman N Sobh¹; Jessica S Johnson¹

1. University of Illinois at Urbana-Champaign

This tool updates state values using the Temporal Difference Algorithm.

Launch Tool

You must login before you can run this tool.

Version 1.1b - published on 06 Aug 2014

doi:10.4231/D3K649T6C cite this

This tool is closed source.

View All Supporting Documents

• About
• Usage
• Citations
• Questions
• Reviews
• Wishlist
• Versions

Usage

World usage

Location of all "[Illinois]: Temporal Difference, Iterative Dynamic Programming, and Least Mean Squares" Users Since Its Posting

• Monthly
• Yearly
• Cumulative

Cumulative Simulation Users

9

6 4 4 4 4 5 5 5 5 5 5 5 5 5 5 5 5 5 5 5 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6 6 7 7 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8 9 9

Simulation Runs

18 Mar 2024

24 7 9 9 9 11 11 11 11 11 11 11 11 11 11 11 11 11 11 11 13 13 13 13 13 13 13 13 13 13 13 13 13 13 13 13 13 13 13 13 13 13 13 13 13 13 13 13 13 13 13 13 13 13 13 13 14 14 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 16 18 18

Overview

	Average	Total
Wall Clock Time	1.92 hours	17.27 hours
CPU time	4.02 seconds	36.22 seconds
Interaction Time	3.42 minutes	30.79 minutes