25 252

Cited 14 times in

Model-based reinforcement learning under concurrent schedules of reinforcement in rodents.

Authors
Huh, N; Jo, S; Kim, H; Sul, JH; Jung, MW
Citation
Learning & memory (Cold Spring Harbor, N.Y.), 16(5):315-323, 2009
Journal Title
Learning & memory (Cold Spring Harbor, N.Y.)
ISSN
1072-05021549-5485
Abstract
Reinforcement learning theories postulate that actions are chosen to maximize a long-term sum of positive outcomes based on value functions, which are subjective estimates of future rewards. In simple reinforcement learning algorithms, value functions are updated only by trial-and-error, whereas they are updated according to the decision-maker's knowledge or model of the environment in model-based reinforcement learning algorithms. To investigate how animals update value functions, we trained rats under two different free-choice tasks. The reward probability of the unchosen target remained unchanged in one task, whereas it increased over time since the target was last chosen in the other task. The results show that goal choice probability increased as a function of the number of consecutive alternative choices in the latter, but not the former task, indicating that the animals were aware of time-dependent increases in arming probability and used this information in choosing goals. In addition, the choice behavior in the latter task was better accounted for by a model-based reinforcement learning algorithm. Our results show that rats adopt a decision-making process that cannot be accounted for by simple reinforcement learning models even in a relatively simple binary choice task, suggesting that rats can readily improve their decision-making strategy through the knowledge of their environments.
MeSH terms
AlgorithmsAnimalsDecision Making/physiology*Models, Neurological*Models, Theoretical*RatsReinforcement (Psychology)*Reward
DOI
10.1101/lm.1295509
PMID
19403794
Appears in Collections:
Journal Papers > Research Organization > Institute for Medical Sciences
Journal Papers > Research Organization > BK21
AJOU Authors
허남정정민환
Full Text Link
Export
RIS (EndNote)
XLS (Excel)
XML

qrcode

해당 아이템을 이메일로 공유하기 원하시면 인증을 거치시기 바랍니다.

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.

Browse