Model-based reinforcement learning under concurrent schedules of reinforcement in rodents.
Huh, N; Jo, S; Kim, H; Sul, JH; Jung, MW
Learning & memory (Cold Spring Harbor, N.Y.), 16(5):315-323, 2009
Learning & memory (Cold Spring Harbor, N.Y.)
Reinforcement learning theories postulate that actions are chosen to maximize a long-term sum of positive outcomes based on value functions, which are subjective estimates of future rewards. In simple reinforcement learning algorithms, value functions are updated only by trial-and-error, whereas they are updated according to the decision-maker's knowledge or model of the environment in model-based reinforcement learning algorithms. To investigate how animals update value functions, we trained rats under two different free-choice tasks. The reward probability of the unchosen target remained unchanged in one task, whereas it increased over time since the target was last chosen in the other task. The results show that goal choice probability increased as a function of the number of consecutive alternative choices in the latter, but not the former task, indicating that the animals were aware of time-dependent increases in arming probability and used this information in choosing goals. In addition, the choice behavior in the latter task was better accounted for by a model-based reinforcement learning algorithm. Our results show that rats adopt a decision-making process that cannot be accounted for by simple reinforcement learning models even in a relatively simple binary choice task, suggesting that rats can readily improve their decision-making strategy through the knowledge of their environments.
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.
Total Visit :2,390,672
Total Download :1,019,054
Today View :41
Ajou University Medical Information & Media Center 164 Worldcup-ro Yeongtong-gu Suwon 16499 Korea / TEL : 031-219-5312 / FAX : 031-219-5314 Copyright (c) Ajou University Medical Information & Media Center All Rights Reserved. AJOU Open Repository는 국립중앙도서관 OAK 보급사업으로 구축되었습니다.