- Title
- A new model of decision processing in instrumental learning tasks
- Creator
- Miletic, Steven; Boag, Russell J.; Trutti, Anne C.; Stevenson, Niek; Forstmann, Birte U.; Heathcote, Andrew
- Relation
- ARC.DP150100272 http://purl.org/au-research/grants/arc/DP150100272 | ARC|DP160101891 http://purl.org/au-research/grants/arc/DP160101891
- Relation
- eLife Vol. 10, no. e63055
- Publisher Link
- http://dx.doi.org/10.7554/eLife.63055
- Publisher
- eLife Sciences Publications
- Resource Type
- journal article
- Date
- 2021
- Description
- Learning and decision-making are interactive processes, yet cognitive modeling of error-driven learning and decision-making have largely evolved separately. Recently, evidence accumulation models (EAMs) of decision-making and reinforcement learning (RL) models of error-driven learning have been combined into joint RL-EAMs that can in principle address these interactions. However, we show that the most commonly used combination, based on the diffusion decision model (DDM) for binary choice, consistently fails to capture crucial aspects of response times observed during reinforcement learning. We propose a new RL-EAM based on an advantage racing diffusion (ARD) framework for choices among two or more options that not only addresses this problem but captures stimulus difficulty, speed-accuracy trade-off, and stimulus-response-mapping reversal effects. The RL-ARD avoids fundamental limitations imposed by the DDM on addressing effects of absolute values of choices, as well as extensions beyond binary choice, and provides a computationally tractable basis for wider applications.
- Subject
- learning and decision-making; reinforcement learning models; response times; learning tasks
- Identifier
- http://hdl.handle.net/1959.13/1453305
- Identifier
- uon:44646
- Identifier
- ISSN:2050-084X
- Rights
- © 2021, Miletić et al. This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited. http://creativecommons.org/licenses/by/4.0/
- Language
- eng
- Full Text
- Reviewed
- Hits: 2052
- Visitors: 2136
- Downloads: 103
| Thumbnail | File | Description | Size | Format | |||
|---|---|---|---|---|---|---|---|
| View Details Download | ATTACHMENT02 | Publisher version (open access) | 1 MB | Adobe Acrobat PDF | View Details Download |