Kenji Doya - Publications

Affiliations: 
Okinawa Institute of Science and Technology, Onna-son, Okinawa-ken, Japan 
Area:
reinforcement learning
Website:
http://www.oist.jp

170 high-probability publications. We are testing a new system for linking publications to authors. You can help! If you notice any inaccuracies, please sign in and mark papers as correct or incorrect matches. If you identify any major omissions or other inaccuracies in the publication list, please let us know.

Year Citation  Score
2018 Tokuda T, Yoshimoto J, Shimizu Y, Okada G, Takamura M, Okamoto Y, Yamawaki S, Doya K. Identification of depression subtypes and relevant brain regions using a data-driven approach. Scientific Reports. 8: 14082. PMID 30237567 DOI: 10.1038/s41598-018-32521-z  0.56
2018 Magrans de Abril I, Yoshimoto J, Doya K. Connectivity inference from neural recording data: Challenges, mathematical bases and research directions. Neural Networks : the Official Journal of the International Neural Network Society. 102: 120-137. PMID 29571122 DOI: 10.1016/j.neunet.2018.02.016  0.48
2018 Yoshizawa T, Ito M, Doya K. Reward-Predictive Neural Activities in Striatal Striosome Compartments. Eneuro. 5. PMID 29430520 DOI: 10.1523/ENEURO.0367-17.2018  0.44
2017 Tokuda T, Yoshimoto J, Shimizu Y, Okada G, Takamura M, Okamoto Y, Yamawaki S, Doya K. Multiple co-clustering based on nonparametric mixture models with heterogeneous marginal distributions. Plos One. 12: e0186566. PMID 29049392 DOI: 10.1371/journal.pone.0186566  0.56
2017 Yoshida K, Shimizu Y, Yoshimoto J, Takamura M, Okada G, Okamoto Y, Yamawaki S, Doya K. Prediction of clinical depression scores and detection of changes in whole-brain using resting-state functional MRI data with partial least squares regression. Plos One. 12: e0179638. PMID 28700672 DOI: 10.1371/journal.pone.0179638  0.56
2017 Yoshida K, Yoshimoto J, Doya K. Sparse kernel canonical correlation analysis for discovery of nonlinear interactions in high-dimensional data. Bmc Bioinformatics. 18: 108. PMID 28196464 DOI: 10.1186/s12859-017-1543-x  0.48
2016 Fermin AS, Yoshida T, Yoshimoto J, Ito M, Tanaka SC, Doya K. Model-based action planning involves cortico-cerebellar and basal ganglia networks. Scientific Reports. 6: 31378. PMID 27539554 DOI: 10.1038/srep31378  1
2016 Caligiore D, Pezzulo G, Baldassarre G, Bostan AC, Strick PL, Doya K, Helmich RC, Dirkx M, Houk J, Jörntell H, Lago-Rodriguez A, Galea JM, Miall RC, Popa T, Kishore A, et al. Consensus Paper: Towards a Systems-Level View of Cerebellar Function: the Interplay Between Cerebellum, Basal Ganglia, and Cortex. Cerebellum (London, England). PMID 26873754 DOI: 10.1007/s12311-016-0763-3  1
2016 Gutierrez CE, Doya K, Yoshimoto J. Self-consistent neuronal population under spike inputs and unbalanced conditions Iciibms 2015 - International Conference On Intelligent Informatics and Biomedical Sciences. 309-312. DOI: 10.1109/ICIIBMS.2015.7439532  1
2016 Reinke C, Uchibe E, Doya K. Maximizing the average reward in episodic reinforcement learning tasks Iciibms 2015 - International Conference On Intelligent Informatics and Biomedical Sciences. 420-421. DOI: 10.1109/ICIIBMS.2015.7439495  1
2016 Doya K, Wang DL. State of Neural Networks Is Strong Neural Networks. 73: xiii. DOI: 10.1016/S0893-6080(15)00248-8  1
2016 Wang J, Uchibe E, Doya K. EM-based policy hyper parameter exploration: application to standing and balancing of a two-wheeled smartphone robot Artificial Life and Robotics. 1-7. DOI: 10.1007/s10015-015-0260-7  1
2016 Tanaka SC, Doya K, Okada G, Ueda K, Okamoto Y, Yamawaki S. Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops Behavioral Economics of Preferences, Choices, and Happiness. 593-616. DOI: 10.1007/978-4-431-55402-8_22  1
2015 Ito M, Doya K. Parallel Representation of Value-Based and Finite State-Based Strategies in the Ventral and Dorsal Striatum. Plos Computational Biology. 11: e1004540. PMID 26529522 DOI: 10.1371/journal.pcbi.1004540  1
2015 Shimizu Y, Yoshimoto J, Toki S, Takamura M, Yoshimura S, Okamoto Y, Yamawaki S, Doya K. Toward Probabilistic Diagnosis and Understanding of Depression Based on Functional MRI Data Analysis with Logistic Group LASSO. Plos One. 10: e0123524. PMID 25932629 DOI: 10.1371/journal.pone.0123524  0.36
2015 Funamizu A, Ito M, Doya K, Kanzaki R, Takahashi H. Condition interference in rats performing a choice task with switched variable- and fixed-reward conditions. Frontiers in Neuroscience. 9: 27. PMID 25741231 DOI: 10.3389/fnins.2015.00027  1
2015 Nakano T, Otsuka M, Yoshimoto J, Doya K. A spiking neural network model of model-free reinforcement learning with high-dimensional sensory input and perceptual ambiguity. Plos One. 10: e0115620. PMID 25734662 DOI: 10.1371/journal.pone.0115620  1
2015 Ito M, Doya K. Distinct neural representation in the dorsolateral, dorsomedial, and ventral parts of the striatum during fixed- and free-choice tasks. The Journal of Neuroscience : the Official Journal of the Society For Neuroscience. 35: 3499-514. PMID 25716849 DOI: 10.1523/JNEUROSCI.1962-14.2015  1
2015 Elfwing S, Uchibe E, Doya K. Expected energy-based restricted Boltzmann machine for classification. Neural Networks : the Official Journal of the International Neural Network Society. 64: 29-38. PMID 25318375 DOI: 10.1016/j.neunet.2014.09.006  1
2015 Yoshida K, Shimizu Y, Yoshimoto J, Toki S, Okada G, Takamura M, Okamoto Y, Yamawaki S, Doya K. Resting state functional connectivity explains individual scores of multiple clinical measures for major depression Proceedings - 2015 Ieee International Conference On Bioinformatics and Biomedicine, Bibm 2015. 1078-1083. DOI: 10.1109/BIBM.2015.7359831  0.36
2015 Doya K, Wang D. Exciting Time for Neural Networks Neural Networks. 61: xv-xvi. DOI: 10.1016/S0893-6080(14)00260-3  1
2015 Balleine BW, Dezfouli A, Ito M, Doya K. Hierarchical control of goal-directed action in the cortical-basal ganglia network Current Opinion in Behavioral Sciences. 5: 1-7. DOI: 10.1016/j.cobeha.2015.06.001  1
2015 Baek J, Oba S, Yoshimoto J, Doya K, Ishii S. Computational complexity reduction for functional connectivity estimation in large scale neural network Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 9491: 583-591. DOI: 10.1007/978-3-319-26555-1_66  1
2015 Baek J, Oba S, Yoshimoto J, Doya K, Ishii S. Computational complexity reduction for functional connectivity estimation in large scale neural network Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 9491: 583-591. DOI: 10.1007/978-3-319-26555-1-66  1
2014 Okada G, Okamoto Y, Shishida K, Ueda K, Onoda K, Kunisato Y, Tanaka SC, Doya K, Yamawaki S. [Brain mechanisms of depression--preliminary evidence from fMRI studies]. Seishin Shinkeigaku Zasshi = Psychiatria Et Neurologia Japonica. 116: 825-31. PMID 25672209  0.36
2014 Miyazaki KW, Miyazaki K, Tanaka KF, Yamanaka A, Takahashi A, Tabuchi S, Doya K. Optogenetic activation of dorsal raphe serotonin neurons enhances patience for future rewards. Current Biology : Cb. 24: 2033-40. PMID 25155504 DOI: 10.1016/j.cub.2014.07.041  1
2014 Elfwing S, Doya K. Emergence of polymorphic mating strategies in robot colonies. Plos One. 9: e93622. PMID 24717898 DOI: 10.1371/journal.pone.0093622  1
2014 Uchibe E, Doya K. Combining learned controllers to achieve new goals based on linearly solvable MDPs Proceedings - Ieee International Conference On Robotics and Automation. 5252-5259. DOI: 10.1109/ICRA.2014.6907631  1
2014 Uchibe E, Doya K. Inverse reinforcement learning using Dynamic Policy Programming Ieee Icdl-Epirob 2014 - 4th Joint Ieee International Conference On Development and Learning and On Epigenetic Robotics. 222-228. DOI: 10.1109/DEVLRN.2014.6982985  1
2014 Miyapuram KP, Pamnani U, Doya K, Bapi RS. Inter Subject Correlation of Brain Activity during Visuo-Motor Sequence learning Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 8834: 35-41.  1
2013 Nakano T, Yoshimoto J, Doya K. A model-based prediction of the calcium responses in the striatal synaptic spines depending on the timing of cortical and dopaminergic inputs and post-synaptic spikes. Frontiers in Computational Neuroscience. 7: 119. PMID 24062681 DOI: 10.3389/fncom.2013.00119  1
2013 Kinjo K, Uchibe E, Doya K. Evaluation of linearly solvable Markov decision process with dynamic model learning in a mobile robot navigation task. Frontiers in Neurorobotics. 7: 7. PMID 23576983 DOI: 10.3389/fnbot.2013.00007  1
2013 Elfwing S, Uchibe E, Doya K. Scaled free-energy based reinforcement learning for robust and efficient learning in high-dimensional state spaces. Frontiers in Neurorobotics. 7: 3. PMID 23450126 DOI: 10.3389/fnbot.2013.00003  1
2013 Morén J, Shibata T, Doya K. The mechanism of saccade motor pattern generation investigated by a large-scale spiking neuron model of the superior colliculus. Plos One. 8: e57134. PMID 23431402 DOI: 10.1371/journal.pone.0057134  1
2013 Pammi VS, Srinivasan N. Preface. Progress in Brain Research. 202: xi. PMID 23317846 DOI: 10.1016/B978-0-444-62604-2.10000-0  0.16
2013 Miyapuram KP, Pammi VS. Understanding decision neuroscience: a multidisciplinary perspective and neural substrates. Progress in Brain Research. 202: 239-66. PMID 23317836 DOI: 10.1016/B978-0-444-62604-2.00014-9  1
2013 Bandyopadhyay D, Pammi VS, Srinivasan N. Role of affect in decision making. Progress in Brain Research. 202: 37-53. PMID 23317825 DOI: 10.1016/B978-0-444-62604-2.00003-4  0.92
2013 Sakuma T, Shimizu T, Miki Y, Doya K, Uchibe E. Computation of driving pleasure based on driver's learning process simulation by reinforcement learning Sae Technical Papers. 1. DOI: 10.4271/2013-01-0056  1
2013 Yoshida N, Uchibe E, Doya K. Reinforcement learning with state-dependent discount factor 2013 Ieee 3rd Joint International Conference On Development and Learning and Epigenetic Robotics, Icdl 2013 - Electronic Conference Proceedings. DOI: 10.1109/DevLrn.2013.6652533  1
2013 Doya K, Kimura M. The Basal Ganglia, Reinforcement Learning, and the Encoding of Value Neuroeconomics: Decision Making and the Brain: Second Edition. 321-333. DOI: 10.1016/B978-0-12-416008-8.00017-6  1
2012 Doya K, Shadlen MN. Decision making. Current Opinion in Neurobiology. 22: 911-3. PMID 23177659 DOI: 10.1016/j.conb.2012.10.003  1
2012 Miyazaki KW, Miyazaki K, Doya K. Activation of dorsal raphe serotonin neurons is necessary for waiting for delayed rewards. The Journal of Neuroscience : the Official Journal of the Society For Neuroscience. 32: 10451-7. PMID 22855794 DOI: 10.1523/JNEUROSCI.0915-12.2012  1
2012 Okamoto Y, Okada G, Shishida K, Fukumoto T, Machino A, Yamashita H, Tanaka SC, Doya K, Yamawaki S. [Effects of serotonin on delay discounting for rewards--an application for understanding of pathophysiology in psychiatric disorders]. Seishin Shinkeigaku Zasshi = Psychiatria Et Neurologia Japonica. 114: 108-14. PMID 22568113  1
2012 Funamizu A, Ito M, Doya K, Kanzaki R, Takahashi H. Uncertainty in action-value estimation affects both action choice and learning rate of the choice behaviors of rats. The European Journal of Neuroscience. 35: 1180-9. PMID 22487046 DOI: 10.1111/j.1460-9568.2012.08025.x  1
2012 Miyazaki K, Miyazaki KW, Doya K. The role of serotonin in the regulation of patience and impulsivity. Molecular Neurobiology. 45: 213-24. PMID 22262065 DOI: 10.1007/s12035-012-8232-6  1
2012 Demoto Y, Okada G, Okamoto Y, Kunisato Y, Aoyama S, Onoda K, Munakata A, Nomura M, Tanaka SC, Schweighofer N, Doya K, Yamawaki S. Neural and personality correlates of individual differences related to the effects of acute tryptophan depletion on future reward evaluation. Neuropsychobiology. 65: 55-64. PMID 22222380 DOI: 10.1159/000328990  1
2012 Sugimoto N, Haruno M, Doya K, Kawato M. MOSAIC for multiple-reward environments. Neural Computation. 24: 577-606. PMID 22168558 DOI: 10.1162/NECO_a_00246  1
2012 Pammi VS, Miyapuram KP, Ahmed, Samejima K, Bapi RS, Doya K. Changing the structure of complex visuo-motor sequences selectively activates the fronto-parietal network. Neuroimage. 59: 1180-9. PMID 21867758 DOI: 10.1016/j.neuroimage.2011.08.006  1
2012 Doya K, Wang D. Loss of a Co-Editor-in-Chief and friend Neural Networks. 29: v. DOI: 10.1016/j.neunet.2012.03.007  1
2012 Doya K, Taylor JG, Wang D. Expedited review process Neural Networks. 25: 1. DOI: 10.1016/j.neunet.2011.11.002  1
2011 Ishii S, Diesmann M, Doya K. Multi-scale, multi-modal neural modeling and simulation. Neural Networks : the Official Journal of the International Neural Network Society. 24: 917. PMID 21840687 DOI: 10.1016/j.neunet.2011.07.004  1
2011 Onoda K, Okamoto Y, Kunisato Y, Aoyama S, Shishida K, Okada G, Tanaka SC, Schweighofer N, Yamaguchi S, Doya K, Yamawaki S. Inter-individual discount factor differences in reward prediction are topographically associated with caudate activation. Experimental Brain Research. 212: 593-601. PMID 21695536 DOI: 10.1007/s00221-011-2771-3  1
2011 Ito M, Doya K. Multiple representations and algorithms for reinforcement learning in the cortico-basal ganglia circuit. Current Opinion in Neurobiology. 21: 368-73. PMID 21531544 DOI: 10.1016/j.conb.2011.04.001  1
2011 Miyazaki K, Miyazaki KW, Doya K. Activation of dorsal raphe serotonin neurons underlies waiting for delayed rewards. The Journal of Neuroscience : the Official Journal of the Society For Neuroscience. 31: 469-79. PMID 21228157 DOI: 10.1523/JNEUROSCI.3714-10.2011  1
2011 Doya K, Grossberg S, Taylor JG, Wang D. An excellent year and a transition. Neural Networks : the Official Journal of the International Neural Network Society. 24: 1. PMID 21118747 DOI: 10.1016/j.neunet.2010.11.004  1
2011 Miyazaki KW, Miyazaki K, Doya K. Activation of the central serotonergic system in response to delayed but not omitted rewards. The European Journal of Neuroscience. 33: 153-60. PMID 21070390 DOI: 10.1111/j.1460-9568.2010.07480.x  1
2011 Elfwing S, Uchibe E, Doya K, Christensen HI. Darwinian embodied evolution of the learning ability for survival Adaptive Behavior. 19: 101-120. DOI: 10.1177/1059712310397633  1
2011 Doya K, Ito M, Samejima K. Model-based analysis of decision variables Decision Making, Affect, and Learning: Attention and Performance Xxiii. DOI: 10.1093/acprof:oso/9780199600434.003.0009  1
2011 Uchibe E, Doya K. Evolution of rewards and learning mechanisms in Cyber Rodents Neuromorphic and Brain-Based Robots. 109-128. DOI: 10.1017/CBO9780511994838.007  1
2011 Cutsuridis V, Heida T, Duch W, Doya K. Neurocomputational models of brain disorders Neural Networks. 24: 513-514. DOI: 10.1016/j.neunet.2011.03.016  1
2010 Fermin A, Yoshida T, Ito M, Yoshimoto J, Doya K. Evidence for model-based action planning in a sequential finger movement task. Journal of Motor Behavior. 42: 371-9. PMID 21184355 DOI: 10.1080/00222895.2010.526467  1
2010 Brooks AM, Pammi VS, Noussair C, Capra CM, Engelmann JB, Berns GS. From bad to worse: striatal coding of the relative value of painful decisions. Frontiers in Neuroscience. 4: 176. PMID 21103006 DOI: 10.3389/fnins.2010.00176  0.92
2010 Nakano T, Doi T, Yoshimoto J, Doya K. A kinetic model of dopamine- and calcium-dependent striatal synaptic plasticity. Plos Computational Biology. 6: e1000670. PMID 20169176 DOI: 10.1371/journal.pcbi.1000670  1
2010 Klein M, Kamp H, Palm G, Doya K. A computational neural model of goal-directed utterance selection. Neural Networks : the Official Journal of the International Neural Network Society. 23: 592-606. PMID 20116973 DOI: 10.1016/j.neunet.2010.01.003  1
2010 Doya K, Grossberg S, Taylor JG. Editorial for 2010. Neural Networks : the Official Journal of the International Neural Network Society. 23: 1. PMID 19942405 DOI: 10.1016/j.neunet.2009.11.006  1
2010 Morimura T, Uchibe E, Yoshimoto J, Peters J, Doya K. Derivatives of logarithmic stationary distributions for policy gradient reinforcement learning. Neural Computation. 22: 342-76. PMID 19842990 DOI: 10.1162/neco.2009.12-08-922  1
2010 Elfwing S, Otsuka M, Uchibe E, Doya K. Free-energy based reinforcement learning for vision-based navigation with high-dimensional sensory inputs Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 6443: 215-222. DOI: 10.1007/978-3-642-17537-4_27  1
2010 Morén J, Shibata T, Doya K. Toward a spiking-neuron model of the oculomotor system Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 6226: 104-113. DOI: 10.1007/978-3-642-15193-4_10  1
2010 Otsuka M, Yoshimoto J, Doya K. Free-energy-based reinforcement learning in a partially observable environment Proceedings of the 18th European Symposium On Artificial Neural Networks - Computational Intelligence and Machine Learning, Esann 2010. 541-546.  1
2009 Tanaka SC, Shishida K, Schweighofer N, Okamoto Y, Yamawaki S, Doya K. Serotonin affects association of aversive outcomes to past actions. The Journal of Neuroscience : the Official Journal of the Society For Neuroscience. 29: 15669-74. PMID 20016081 DOI: 10.1523/JNEUROSCI.2799-09.2009  1
2009 Ito M, Doya K. Validation of decision-making models and analysis of decision variables in the rat basal ganglia. The Journal of Neuroscience : the Official Journal of the Society For Neuroscience. 29: 9861-74. PMID 19657038 DOI: 10.1523/JNEUROSCI.6157-08.2009  1
2009 Doya K. How can we learn efficiently to act optimally and flexibly? Proceedings of the National Academy of Sciences of the United States of America. 106: 11429-30. PMID 19584249 DOI: 10.1073/pnas.0905423106  1
2009 Ito M, Shirao T, Doya K, Sekino Y. Three-dimensional distribution of Fos-positive neurons in the supramammillary nucleus of the rat exposed to novel environment. Neuroscience Research. 64: 397-402. PMID 19409426 DOI: 10.1016/j.neures.2009.04.013  1
2009 Fujiwara Y, Yamashita O, Kawawaki D, Doya K, Kawato M, Toyama K, Sato MA. A hierarchical Bayesian method to resolve an inverse problem of MEG contaminated with eye movement artifacts. Neuroimage. 45: 393-409. PMID 19150653 DOI: 10.1016/j.neuroimage.2008.12.012  1
2009 Doya K, Grossberg S, Taylor JG. New action editors join the journal! Five exciting special issues in the works! Neural Networks. 22: 1. DOI: 10.1016/j.neunet.2008.12.002  1
2009 Doya K, Kimura M. The basal ganglia and the encoding of value Neuroeconomics. 407-416. DOI: 10.1016/B978-0-12-374176-9.00026-9  1
2009 Elfwing S, Uchibe E, Doya K. Emergence of different mating strategies in artificial embodied evolution Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 5864: 638-647. DOI: 10.1007/978-3-642-10684-2_71  1
2009 Nakano T, Yoshimoto J, Wickens J, Doya K. Calcium responses model in striatum dependent on timed input sources Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 5768: 249-258. DOI: 10.1007/978-3-642-04274-4_26  1
2009 Kamioka T, Uchibe E, Doya K. Neuroevolution based on reusable and hierarchical modular representation Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 5506: 22-31. DOI: 10.1007/978-3-642-02490-0_3  1
2009 Elfwing S, Uchibe E, Doya K. Co-evolution of Rewards and Meta-parameters in Embodied Evolution Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 5436: 278-302. DOI: 10.1007/978-3-642-00616-6_13  1
2009 Sendhoff B, Körner E, Sporns O, Ritter H, Doya K. Creating brain-like intelligence Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 5436: V-VI. DOI: 10.1007/978-3-642-00616-6_1  1
2009 Otsuka M, Yoshimoto J, Doya K. Reward-dependent sensory coding in free-energy-based reinforcement learning Neural Network World. 19: 597-610.  1
2009 Morimurat T, Uchibe E, Yoshimoto J, Doya K. A generalized natural actor-critic algorithm Advances in Neural Information Processing Systems 22 - Proceedings of the 2009 Conference. 1312-1320.  1
2008 Uchibe E, Doya K. Finding intrinsic rewards by embodied evolution and constrained reinforcement learning. Neural Networks : the Official Journal of the International Neural Network Society. 21: 1447-55. PMID 19013054 DOI: 10.1016/j.neunet.2008.09.013  1
2008 Ito M, Doya K. [Mathematical models of decision making and learning]. Brain and Nerve = Shinkei KenkyÅ« No Shinpo. 60: 791-8. PMID 18646619  1
2008 Schweighofer N, Bertin M, Shishida K, Okamoto Y, Tanaka SC, Yamawaki S, Doya K. Low-serotonin levels increase delayed reward discounting in humans. The Journal of Neuroscience : the Official Journal of the Society For Neuroscience. 28: 4528-32. PMID 18434531 DOI: 10.1523/JNEUROSCI.4982-07.2008  1
2008 Bissmarck F, Nakahara H, Doya K, Hikosaka O. Combining modalities with different latencies for optimal motor control. Journal of Cognitive Neuroscience. 20: 1966-79. PMID 18416676 DOI: 10.1162/jocn.2008.20133  1
2008 Doya K. Modulators of decision making. Nature Neuroscience. 11: 410-6. PMID 18368048 DOI: 10.1038/nn2077  1
2008 Elfwing S, Uchibe E, Doya K, Christensen HI. Co-evolution of shaping rewards and meta-parameters in reinforcement learning Adaptive Behavior. 16: 400-412. DOI: 10.1177/1059712308092835  1
2008 Ishikawa M, Doya K. Mini-special issue: ICONIP 2007 Neural Networks. 21: 1419. DOI: 10.1016/j.neunet.2008.10.005  1
2008 Doya K, Grossberg S, Taylor JG. Neural Networks goes electronic at twenty! Neural Networks. 21: 1-2. DOI: 10.1016/j.neunet.2007.12.003  1
2008 Morimura T, Uchibe E, Doya K. Natural actor-critic with baseline adjustment for variance reduction Artificial Life and Robotics. 13: 275-279. DOI: 10.1007/s10015-008-0514-8  1
2008 Sato T, Uchibe E, Doya K. Learning how, what, and whether to communicate: Emergence of protocommunication in reinforcement learning agents Artificial Life and Robotics. 12: 70-74. DOI: 10.1007/s10015-007-0444-x  1
2008 Otsuka M, Yoshimoto J, Doya K. Robust population coding in free-energy-based reinforcement learning Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 5163: 377-386. DOI: 10.1007/978-3-540-87536-9_39  1
2008 Morimura T, Uchibe E, Yoshimoto J, Doya K. A new natural policy gradient by stationary distribution metric Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 5212: 82-97. DOI: 10.1007/978-3-540-87481-2_6  1
2008 Uchibe E, Doya K. Finding exploratory rewards by embodied evolution and constrained reinforcement learning in the cyber rodents Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 4985: 167-176. DOI: 10.1007/978-3-540-69162-4_18  1
2008 Yoshimoto J, Doya K. Bayesian system identification of molecular cascades Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 4984: 614-624. DOI: 10.1007/978-3-540-69158-7_64  1
2008 Samejima K, Doya K. Estimating internal variables of a decision maker's brain: A model-based approach for neuroscience Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 4984: 596-603. DOI: 10.1007/978-3-540-69158-7_62  1
2008 Ishikawa M, Doya K, Miyamoto H, Yamakawa T. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial intelligence and Lecture Notes in Bioinformatics): Preface Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 4984: V-VI.  1
2008 Schweighofer N, Bertin M, Shishida K, Okamoto Y, Tanaka SC, Yamawaki S, Doya K. Low-serotonin levels increase delayed reward discounting in humans (Journal of Neuroscience (2008) (4528-4532)) Journal of Neuroscience. 28: 5619.  1
2007 Tanaka SC, Schweighofer N, Asahi S, Shishida K, Okamoto Y, Yamawaki S, Doya K. Serotonin differentially regulates short- and long-term prediction of rewards in the ventral and dorsal striatum. Plos One. 2: e1333. PMID 18091999 DOI: 10.1371/journal.pone.0001333  1
2007 Corrado G, Doya K. Understanding neural coding through the model-based analysis of decision making. The Journal of Neuroscience : the Official Journal of the Society For Neuroscience. 27: 8178-80. PMID 17670963 DOI: 10.1523/JNEUROSCI.1590-07.2007  1
2007 Bertin M, Schweighofer N, Doya K. Multiple model-based reinforcement learning explains dopamine neuronal activity. Neural Networks : the Official Journal of the International Neural Network Society. 20: 668-75. PMID 17611074 DOI: 10.1016/j.neunet.2007.04.028  1
2007 Balleine BW, Doya K, O'Doherty J, Sakagami M. Current trends in decision making. Annals of the New York Academy of Sciences. 1104: xi-xv. PMID 17595291 DOI: 10.1196/annals.1390.2226  1
2007 Samejima K, Doya K. Multiple representations of belief states and action values in corticobasal ganglia loops. Annals of the New York Academy of Sciences. 1104: 213-28. PMID 17435124 DOI: 10.1196/annals.1390.024  1
2007 Schweighofer N, Tanaka SC, Doya K. Serotonin and the evaluation of future rewards: theory, experiments, and possible neural mechanisms. Annals of the New York Academy of Sciences. 1104: 289-300. PMID 17360806 DOI: 10.1196/annals.1390.011  1
2007 Morimoto J, Doya K. Reinforcement learning state estimator. Neural Computation. 19: 730-56. PMID 17298231 DOI: 10.1162/neco.2007.19.3.730  1
2007 Ogasawara H, Doi T, Doya K, Kawato M. Nitric oxide regulates input specificity of long-term depression and context dependence of cerebellar learning. Plos Computational Biology. 3: e179. PMID 17222054 DOI: 10.1371/journal.pcbi.0020179  1
2007 Elfwing S, Uchibe E, Doya K, Christensen HI. Evolutionary development of hierarchical learning structures Ieee Transactions On Evolutionary Computation. 11: 249-264. DOI: 10.1109/TEVC.2006.890270  1
2007 Doya K. Designing the reward system: Computational and biological principles Proceedings of the 2007 Ieee Symposium On Foundations of Computational Intelligence, Foci 2007. 645. DOI: 10.1109/FOCI.2007.371540  1
2007 Uchibe E, Doya K. Constrained reinforcement learning from intrinsic and extrinsic rewards 2007 Ieee 6th International Conference On Development and Learning, Icdl. 163-168. DOI: 10.1109/DEVLRN.2007.4354030  1
2007 Matsubara T, Morimoto J, Nakanishi J, Sato MA, Doya K. Learning a dynamic policy by using policy gradient: Application to biped walking Systems and Computers in Japan. 38: 25-38. DOI: 10.1002/scj.20441  1
2006 Schweighofer N, Shishida K, Han CE, Okamoto Y, Tanaka SC, Yamawaki S, Doya K. Humans can adopt optimal discounting strategy under real-time constraints. Plos Computational Biology. 2: e152. PMID 17096592 DOI: 10.1371/journal.pcbi.0020152  1
2006 Tanaka SC, Samejima K, Okada G, Ueda K, Okamoto Y, Yamawaki S, Doya K. Brain mechanism of reward prediction under predictable and unpredictable environmental dynamics. Neural Networks : the Official Journal of the International Neural Network Society. 19: 1233-41. PMID 16979871 DOI: 10.1016/j.neunet.2006.05.039  1
2006 Bapi RS, Miyapuram KP, Graydon FX, Doya K. fMRI investigation of cortical and subcortical networks in the learning of abstract and effector-specific representations of motor sequences. Neuroimage. 32: 714-27. PMID 16798015 DOI: 10.1016/j.neuroimage.2006.04.205  1
2006 Daw ND, Doya K. The computational neurobiology of learning and reward. Current Opinion in Neurobiology. 16: 199-204. PMID 16563737 DOI: 10.1016/j.conb.2006.03.006  1
2006 Kawawaki D, Shibata T, Goda N, Doya K, Kawato M. Anterior and superior lateral occipito-temporal cortex responsible for target motion prediction during overt and covert visual pursuit. Neuroscience Research. 54: 112-23. PMID 16337706 DOI: 10.1016/j.neures.2005.10.015  1
2006 Capi G, Doya K. Application of evolutionary computation for efficient reinforcement learning Applied Artificial Intelligence. 20: 35-55. DOI: 10.1080/08839510500191299  1
2006 Matsubara T, Morimoto J, Nakanishi J, Sato Ma, Doya K. Learning CPG-based biped locomotion with a policy gradient method Robotics and Autonomous Systems. 54: 911-920. DOI: 10.1016/j.robot.2006.05.012  1
2006 Bando T, Shibata T, Doya K, Ishii S. Switching particle filters for efficient visual tracking Robotics and Autonomous Systems. 54: 873-884. DOI: 10.1016/j.robot.2006.03.004  1
2006 Samejima K, Katagiri K, Doya K, Kawato M. Symbolization and imitation learning of motion sequence using competitive modules Electronics and Communications in Japan, Part Iii: Fundamental Electronic Science (English Translation of Denshi Tsushin Gakkai Ronbunshi). 89: 42-53. DOI: 10.1002/ecjc.20267  1
2006 Samejima K, Katagiri K, Doya K, Kawato M. Multiple model-based reinforcement learning for nonlinear control Electronics and Communications in Japan, Part Iii: Fundamental Electronic Science (English Translation of Denshi Tsushin Gakkai Ronbunshi). 89: 54-69. DOI: 10.1002/ecjc.20266  1
2006 Miyapuram KP, Bapi RS, Pammi CVS, Ahmed, Doya K. Hierarchical chunking during learning of visuomotor sequences Ieee International Conference On Neural Networks - Conference Proceedings. 249-253.  1
2005 Samejima K, Ueda Y, Doya K, Kimura M. Representation of action-specific reward values in the striatum. Science (New York, N.Y.). 310: 1337-40. PMID 16311337 DOI: 10.1126/science.1115270  1
2005 Morimoto J, Doya K. Robust reinforcement learning. Neural Computation. 17: 335-59. PMID 15720771 DOI: 10.1162/0899766053011528  1
2005 Doya K, Uchibe E. The cyber rodent project: Exploration of adaptive mechanisms for self-preservation and self-reproduction Adaptive Behavior. 13: 149-160. DOI: 10.1177/105971230501300206  1
2005 Capi G, Doya K. Evolution of neural architecture fitting environmental dynamics Adaptive Behavior. 13: 53-66. DOI: 10.1177/105971230501300103  1
2005 Matsubara T, Morimoto J, Nakanishi J, Sato MA, Doya K. Learning sensory feedback to CPG with policy gradient for biped locomotion Proceedings - Ieee International Conference On Robotics and Automation. 2005: 4164-4169. DOI: 10.1109/ROBOT.2005.1570759  1
2005 Uchibe E, Doya K. Reinforcement learning with multiple heterogeneous modules: A framework for developmental robot learning Proceedings of 2005 4th Ieee International Conference On Development and Learning. 2005: 87-92. DOI: 10.1109/DEVLRN.2005.1490949  1
2005 Capi G, Doya K. Evolution of recurrent neural controllers using an extended parallel genetic algorithm Robotics and Autonomous Systems. 52: 148-159. DOI: 10.1016/j.robot.2005.04.003  1
2005 Elfwing S, Uchibe E, Doya K, Christensen HI. Biologically inspired embodied evolution of survival 2005 Ieee Congress On Evolutionary Computation, Ieee Cec 2005. Proceedings. 3: 2210-2216.  1
2005 Capi G, Hironaka D, Yokota M, Doya K. A new hybrid method for real time adaptation of intelligent agents in dynamic environments Wseas Transactions On Systems. 4: 137-142.  1
2005 Bissmarck F, Nakahara H, Doya K, Hikosaka O. Responding to modalities with different latencies Advances in Neural Information Processing Systems 1
2004 Sato MA, Yoshioka T, Kajihara S, Toyama K, Goda N, Doya K, Kawato M. Hierarchical Bayesian estimation for MEG inverse problem. Neuroimage. 23: 806-26. PMID 15528082 DOI: 10.1016/j.neuroimage.2004.06.037  1
2004 Tanaka SC, Doya K, Okada G, Ueda K, Okamoto Y, Yamawaki S. Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops. Nature Neuroscience. 7: 887-93. PMID 15235607 DOI: 10.1038/nn1279  1
2004 Schweighofer N, Doya K, Fukai H, Chiron JV, Furukawa T, Kawato M. Chaos may enhance information transmission in the inferior olive. Proceedings of the National Academy of Sciences of the United States of America. 101: 4655-60. PMID 15070773 DOI: 10.1073/pnas.0305966101  1
2004 Miyamoto H, Morimoto J, Doya K, Kawato M. Reinforcement learning with via-point representation. Neural Networks : the Official Journal of the International Neural Network Society. 17: 299-305. PMID 15037348 DOI: 10.1016/j.neunet.2003.11.004  1
2004 Schweighofer N, Doya K, Kuroda S. Cerebellar aminergic neuromodulation: towards a functional understanding. Brain Research. Brain Research Reviews. 44: 103-16. PMID 15003388 DOI: 10.1016/j.brainresrev.2003.10.004  1
2004 Haruno M, Kuroda T, Doya K, Toyama K, Kimura M, Samejima K, Imamizu H, Kawato M. A neural correlate of reward-based behavioral learning in caudate nucleus: a functional magnetic resonance imaging study of a stochastic decision task. The Journal of Neuroscience : the Official Journal of the Society For Neuroscience. 24: 1660-5. PMID 14973239 DOI: 10.1523/JNEUROSCI.3417-03.2004  1
2004 Bando T, Shibata T, Doya K, Ishii S. Switching particle filters for efficient real-time visual tracking Proceedings - International Conference On Pattern Recognition. 2: 720-723. DOI: 10.1109/ICPR.2004.1334360  1
2004 Capi G, Hironaka D, Yokota M, Doya K. Adaptation in dynamic environments by learning and evolution Proceedings of the Iasted International Conference On Intelligent Systems and Control. 232-237.  1
2004 Chandrasekhar Pammi VS, Miyapuram KP, Bapi RS, Doya K. Chunking phenomenon in complex sequential skill learning in humans Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 3316: 294-299.  1
2004 Elfwing S, Uchibe E, Doya K, Christensen HI. Multi-agent reinforcement learning: Using macro actions to learn a mating task 2004 Ieee/Rsj International Conference On Intelligent Robots and Systems (Iros). 4: 3164-3169.  1
2004 Tanaka S, Doya K, Okada G, Ueda K, Okamoto Y, Yamawaki S. Different cortico-basal ganglia loops specialize in reward prediction on different time scales Advances in Neural Information Processing Systems 1
2004 Samejima K, Doya K, Ueda Y, Kimura M. Estimating internal variables and parameters of a learning agent by a particle filter Advances in Neural Information Processing Systems 1
2003 Samejima K, Doya K, Kawato M. Inter-module credit assignment in modular reinforcement learning. Neural Networks : the Official Journal of the International Neural Network Society. 16: 985-94. PMID 14692633 DOI: 10.1016/S0893-6080(02)00235-6  1
2003 Wolpert DM, Doya K, Kawato M. A unifying computational framework for motor control and social interaction. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences. 358: 593-602. PMID 12689384 DOI: 10.1098/rstb.2002.1238  1
2003 Schweighofer N, Doya K. Meta-learning in reinforcement learning. Neural Networks : the Official Journal of the International Neural Network Society. 16: 5-9. PMID 12576101 DOI: 10.1016/S0893-6080(02)00228-9  1
2003 Capi G, Doya K. Evolving recurrent neural controllers for sequential tasks: A parallel implementation 2003 Congress On Evolutionary Computation, Cec 2003 - Proceedings. 1: 514-519. DOI: 10.1109/CEC.2003.1299619  1
2003 Koike Y, Doya K. Driver model based on reinforced learning with multiple-step state estimation Electronics and Communications in Japan, Part Iii: Fundamental Electronic Science (English Translation of Denshi Tsushin Gakkai Ronbunshi). 86: 85-95. DOI: 10.1002/ecjc.10123  1
2003 Eriksson A, Capi G, Doya K. Evolution of Meta-parameters in Reinforcement Learning Algorithm Ieee International Conference On Intelligent Robots and Systems. 1: 412-417.  1
2003 Elfwing S, Uchibe E, Doya K. An evolutionary approach to automatic construction of the structure in hierarchical reinforcement learning Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 2723: 507-509.  1
2002 Doya K. Metalearning and neuromodulation. Neural Networks : the Official Journal of the International Neural Network Society. 15: 495-506. PMID 12371507 DOI: 10.1016/S0893-6080(02)00044-8  1
2002 Doya K, Samejima K, Katagiri K, Kawato M. Multiple model-based reinforcement learning. Neural Computation. 14: 1347-69. PMID 12020450 DOI: 10.1162/089976602753712972  1
2002 Doya K, Dayan P, Hasselmo ME. Introduction for 2002 Special Issue: Computational models of neuromodulation Neural Networks. 15: 475-477. DOI: 10.1016/S0893-6080(02)00042-4  1
2001 Nakahara H, Doya K, Hikosaka O. Parallel cortico-basal ganglia mechanisms for acquisition and execution of visuomotor sequences - a computational approach. Journal of Cognitive Neuroscience. 13: 626-47. PMID 11506661 DOI: 10.1162/089892901750363208  1
2001 Schweighofer N, Doya K, Lay F. Unsupervised learning of granule cell sparse codes enhances cerebellar adaptive control. Neuroscience. 103: 35-50. PMID 11311786 DOI: 10.1016/S0306-4522(00)00548-0  1
2001 Kuroda S, Yamamoto K, Miyamoto H, Doya K, Kawat M. Statistical characteristics of climbing fiber spikes necessary for efficient cerebellar learning. Biological Cybernetics. 84: 183-92. PMID 11252636 DOI: 10.1007/s004220000206  1
2001 Doya K, Kimura H, Kawato M. Neural mechanisms of learning and control Ieee Control Systems Magazine. 21: 42-51. DOI: 10.1109/37.939943  1
2001 Morimoto J, Doya K. Acquisition of stand-up behavior by a real robot using hierarchical reinforcement learning Robotics and Autonomous Systems. 36: 37-51. DOI: 10.1016/S0921-8890(01)00113-0  1
2000 Doya K. Complementary roles of basal ganglia and cerebellum in learning and motor control. Current Opinion in Neurobiology. 10: 732-9. PMID 11240282 DOI: 10.1016/S0959-4388(00)00153-7  1
2000 Bapi RS, Doya K, Harner AM. Evidence for effector independent and dependent representations and their differential time course of acquisition during motor sequence learning. Experimental Brain Research. 132: 149-62. PMID 10853941 DOI: 10.1007/s002219900332  1
2000 Doya K. Reinforcement learning in continuous time and space. Neural Computation. 12: 219-45. PMID 10636940  1
1999 Doya K. What are the computations of the cerebellum, the basal ganglia and the cerebral cortex? Neural Networks : the Official Journal of the International Neural Network Society. 12: 961-974. PMID 12662639 DOI: 10.1016/S0893-6080(99)00046-5  1
1999 Hikosaka O, Nakahara H, Rand MK, Sakai K, Lu X, Nakamura K, Miyachi S, Doya K. Parallel neural networks for learning sequential procedures. Trends in Neurosciences. 22: 464-71. PMID 10481194 DOI: 10.1016/S0166-2236(99)01439-3  1
1999 Schweighofer N, Doya K, Kawato M. Electrophysiological properties of inferior olive neurons: A compartmental model. Journal of Neurophysiology. 82: 804-17. PMID 10444678  1
1999 Morimoto J, Doya K. Hierarchical reinforcement learning for motion learning: Learning `stand-up' trajectories Advanced Robotics. 13: 267-268.  1
1998 Nakahara H, Doya K. Near-saddle-node bifurcation behavior as dynamics in working memory for goal-directed behavior. Neural Computation. 10: 113-32. PMID 9501506  1
1997 Doya K. Efficient nonlinear control with actor-tutor architecture Advances in Neural Information Processing Systems. 1012-1018.  1
1989 Doya K, Yoshizawa S. Adaptive neural oscillator using continuous-time back-propagation learning Neural Networks. 2: 375-385. DOI: 10.1016/0893-6080(89)90022-1  1
Show low-probability matches.