Richard S. Sutton

Cited by

	All	Since 2018
Citations	138393	68913
h-index	104	69
i10-index	350	226

17000

8500

4250

12750

1990199119921993199419951996199719981999200020012002200320042005200620072008200920102011201220132014201520162017201820192020202120222023399 589 616 647 943 884 901 1054 1183 1258 1381 1553 1782 1977 2183 2723 2877 3326 3311 3479 3573 3814 3938 4131 4249 4056 4548 5668 8029 10252 12655 14421 16396 7057

Public access

View all

59 articles

4 articles

available

not available

Based on funding mandates

Co-authors

Andrew BartoUniversity of Massachusetts AmherstVerified email at cs.umass.edu
Satinder SinghDeepMind / U. of MichiganVerified email at umich.edu
Doina PrecupDeepMind and McGill UniversityVerified email at cs.mcgill.ca
Patrick M. PilarskiAmii and University of AlbertaVerified email at ualberta.ca
Charles Andersonprofessor of computer science, Colorado State University. Founder Pattern Exploration, LLC.Verified email at colostate.edu
Csaba SzepesvariDeepMind & University of AlbertaVerified email at cs.ualberta.ca
Adam WhiteUniversity of Alberta, DeepmindVerified email at ualberta.ca
Shalabh BhatnagarProfessor in the Department of Computer Science and Automation, Indian Institute of ScienceVerified email at iisc.ac.in
Hamid MaeiNetflixVerified email at netflix.com
Thomas DegrisDeepMindVerified email at google.com
A. Rupam MahmoodUniversity of Alberta, AmiiVerified email at ualberta.ca
David SilverDeepMind, UCLVerified email at google.com
Martha WhiteUniversity of AlbertaVerified email at ualberta.ca
David McAllesterProfessor, Toyota Technological Institute at ChicagoVerified email at ttic.edu
Joseph ModayilDeepMindVerified email at cs.ualberta.ca
Elliot A. LudvigProfessor, Psychology, University of WarwickVerified email at warwick.ac.uk
Yishay MansourTel Aviv UniversityVerified email at tauex.tau.ac.il
E James KehoeProfessor of Psychology, University of New South WalesVerified email at unsw.edu.au
Peter StoneProfessor of Computer Science, The University of Texas at AustinVerified email at cs.utexas.edu
Mohammad GhavamzadehGoogle ResearchVerified email at google.com

Richard S. Sutton

DeepMind, Amii, and University of Alberta

Verified email at richsutton.com - Homepage

artificial intelligence reinforcement learning machine learning cognitive science computer science


Title Sort by citations Sort by year Sort by title	Cited by Cited by	Year
Reinforcement learning: An Introduction, 2nd edition RS Sutton, AG Barto MIT press, 2018	60789	2018
Learning to predict by the methods of temporal differences RS Sutton Machine learning 3, 9-44, 1988	7352	1988
Policy gradient methods for reinforcement learning with function approximation RS Sutton, D McAllester, S Singh, Y Mansour Advances in neural information processing systems 12, 1999	6798	1999
Reinforcement learning: An Introduction, 1st edition RS Sutton, AG Barto MIT press, 1998	5168*	1998
Neuronlike adaptive elements that can solve difficult learning control problems AG Barto, RS Sutton, CW Anderson IEEE transactions on systems, man, and cybernetics 13 (5), 834-846, 1983	4763	1983
Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning RS Sutton, D Precup, S Singh Artificial intelligence 112 (1-2), 181-211, 1999	3841	1999
Integrated architectures for learning, planning, and reacting based on approximating dynamic programming RS Sutton Proceedings of the International Conference on Machine Learning, 216-224, 1990	2052	1990
Guidelines for the diagnosis and management of syncope (version 2009): the Task Force for the Diagnosis and Management of Syncope of the European Society of Cardiology (ESC) A Moya, R Sutton European heart journal 30 (21), 2631-2671, 2009	2026	2009
Generalization in reinforcement learning: Successful examples using sparse coarse coding RS Sutton Advances in neural information processing systems 8, 1995	1781	1995
Toward a modern theory of adaptive networks: Expectation and prediction. RS Sutton, AG Barto Psychological review 88 (2), 135, 1981	1718	1981
Neural networks for control WT Miller, PJ Werbos, RS Sutton MIT press, 1990	1615	1990
Guidelines on management (diagnosis and treatment) of syncope–update 2004: the Task Force on Syncope, European Society of Cardiology M Brignole, P Alboni, DG Benditt, L Bergfeldt, JJ Blanc, PEB Thomsen, ... European heart journal 25 (22), 2054-2072, 2004	1326	2004
Temporal credit assignment in reinforcement learning RS Sutton University of Massachusetts, Amherst, http://www.incompleteideas.net/papers …, 1984	1120	1984
Reinforcement learning with replacing eligibility traces SP Singh, RS Sutton Machine learning 22 (1-3), 123-158, 1996	983	1996
Introduction to reinforcement learning. Vol. 135 RS Sutton, AG Barto MIT press Cambridge 5, 21-22, 1998	950	1998
Dyna, an integrated architecture for learning, planning, and reacting RS Sutton ACM Sigart Bulletin 2 (4), 160-163, 1991	939	1991
2021 ESC Guidelines on cardiac pacing and cardiac resynchronization therapy: Developed by the Task Force on cardiac pacing and cardiac resynchronization therapy of the European … M Glikson, JC Nielsen, MB Kronborg, Y Michowitz, A Auricchio, ... EP Europace 24 (1), 71-164, 2022	937	2022
Between MDPs and Semi-MDPs: Learning, planning, and representing knowledge at multiple temporal scales RS Sutton	811	1998
Time-derivative models of Pavlovian reinforcement. RS Sutton, AG Barto Learning and Computational Neuroscience: Foundations of Adaptive Networks …, 1990	797	1990
Eligibility traces for off-policy policy evaluation D Precup, RS Sutton, S Singh International Conference on Machine Learning 16, 759-766, 2000	793	2000

The system can't perform the operation now. Try again later.

Articles 1–20

Citations per year

Duplicate citations

Merged citations

Add co-authorsCo-authors

Follow

Cited by

Co-authors