Tom Schaul

Cited by

	All	Since 2018
Citations	31056	28039
h-index	42	40
i10-index	75	63

7000

3500

1750

5250

2011201220132014201520162017201820192020202120222023108 149 165 228 365 535 1148 2367 3505 4835 5692 6030 5579

Public access

View all

20 articles

0 articles

available

not available

Based on funding mandates

Co-authors

David SilverDeepMind, UCLVerified email at google.com
Juergen SchmidhuberKing Abdullah University of Science and Technology / The Swiss AI Lab, IDSIA / University of LuganoVerified email at kaust.edu.sa
Daan WierstraPrincipal Scientist, DeepMindVerified email at google.com
Nando de FreitasCIFAR & DeepMindVerified email at google.com
Tobias GlasmachersVerified email at idsia.ch
Oriol VinyalsResearch Scientist at Google DeepMindVerified email at google.com
Will DabneyDeepMindVerified email at google.com
Julian TogeliusAssociate Professor of Computer Science and Engineering, New York University; co-founder, modl.aiVerified email at nyu.edu
Joseph ModayilDeepMindVerified email at cs.ualberta.ca
Andre BarretoResearch Scientist, Google DeepMindVerified email at google.com
Rémi MunosDeepMindVerified email at inria.fr
koray kavukcuogluDeepMindVerified email at kavukcuoglu.org
Diana BorsaDeepMindVerified email at google.com
Simon LucasProfessor of Artificial Intelligence, Queen Mary University of LondonVerified email at qmul.ac.uk
Simon OsinderoPrincipal Scientist (Director) @ DeepMindVerified email at google.com
Max JaderbergChief AI Officer, Isomorphic LabsVerified email at robots.ox.ac.uk
Jan PetersProfessor for Intelligent Autonomous Systems at Technische Universität DarmstadtVerified email at ias.tu-darmstadt.de
Marc G. BellemareGoogle BrainVerified email at google.com
Yann LeCunChief AI Scientist at Facebook & Silver Professor at the Courant Institute, New York UniversityVerified email at cs.nyu.edu
Karen SimonyanCo-Founder and Chief Scientist at Inflection AIVerified email at inflection.ai

Tom Schaul

Senior Staff Scientist, DeepMind

Verified email at nyu.edu - Homepage

Reinforcement Learning Deep Learning Deep Reinforcement Learning Game AI Exploration


Title Sort by citations Sort by year Sort by title	Cited by Cited by	Year
Prioritized Experience Replay T Schaul, J Quan, I Antonoglou, D Silver International Conference on Learning Representations (ICLR), 2016	4320	2016
Dueling Network Architectures for Deep Reinforcement Learning Z Wang, T Schaul, M Hessel, H van Hasselt, M Lanctot, N de Freitas International Conference on Machine Learning (ICML), 2016	4295	2016
Grandmaster level in StarCraft II using multi-agent reinforcement learning O Vinyals, I Babuschkin, WM Czarnecki, M Mathieu, A Dudzik, J Chung, ... Nature 575 (7782), 350–354, 2019	3696	2019
Rainbow: Combining Improvements in Deep Reinforcement Learning M Hessel, J Modayil, H Van Hasselt, T Schaul, G Ostrovski, W Dabney, ... AAAI Conference on Artificial Intelligence, 2018	2335	2018
Learning to learn by gradient descent by gradient descent M Andrychowicz, M Denil, S Gomez, MW Hoffman, D Pfau, T Schaul, ... Neural Information Processing Systems (NeurIPS), 2016	2114	2016
Unifying Count-Based Exploration and Intrinsic Motivation MG Bellemare, S Srinivasan, G Ostrovski, T Schaul, D Saxton, R Munos Neural Information Processing Systems (NeurIPS), 2016	1518	2016
Reinforcement learning with unsupervised auxiliary tasks M Jaderberg, V Mnih, WM Czarnecki, T Schaul, JZ Leibo, D Silver, ... International Conference on Learning Representations (ICLR), 2017	1309	2017
Deep Q-learning from Demonstrations T Hester, M Vecerik, O Pietquin, M Lanctot, T Schaul, B Piot, D Horgan, ... AAAI Conference on Artificial Intelligence, 2018	1104	2018
Universal value function approximators T Schaul, D Horgan, K Gregor, D Silver International Conference on Machine Learning (ICML-15), 1312-1320, 2015	1090	2015
StarCraft II: A New Challenge for Reinforcement Learning O Vinyals, T Ewalds, S Bartunov, P Georgiev, AS Vezhnevets, M Yeo, ... arXiv preprint arXiv:1708.04782, 2017	1006	2017
Feudal networks for hierarchical reinforcement learning AS Vezhnevets, S Osindero, T Schaul, N Heess, M Jaderberg, D Silver, ... International Conference on Machine Learning (ICML), 2017	949	2017
Natural evolution strategies D Wierstra, T Schaul, T Glasmachers, Y Sun, J Peters, J Schmidhuber The Journal of Machine Learning Research 15 (1), 949-980, 2014	944	2014
No more pesky learning rates T Schaul, S Zhang, Y LeCun International Conference on Machine Learning (ICML'13), 2013	545	2013
Successor features for transfer in reinforcement learning A Barreto, W Dabney, R Munos, JJ Hunt, T Schaul, D Silver, ... Neural Information Processing Systems (NeurIPS), 2017	538	2017
AlphaStar: Mastering the Real-Time Strategy Game StarCraft II O Vinyals, I Babuschkin, J Chung, M Mathieu, M Jaderberg, W Czarnecki, ... (DeepMind blog), 2019	535	2019
PyBrain T Schaul, J Bayer, D Wierstra, Y Sun, M Felder, F Sehnke, T Rückstieß, ... Journal of Machine Learning Research 11 (Feb), 743-746, 2010	475	2010
The predictron: End-to-end learning and planning D Silver, H van Hasselt, M Hessel, T Schaul, A Guez*, T Harley, ... International Conference on Machine Learning (ICML), 2017	318*	2017
The 2014 General Video Game Playing Competition D Perez, S Samothrakis, J Togelius, T Schaul, S Lucas, A Couëtoux, ... Computational Intelligence and AI in Games, 2015	279*	2015
A video game description language for model-based or interactive learning T Schaul Conference on Computational Intelligence in Games (IEEE-CIG), 1-8, 2013	263	2013
General Video Game AI: Competition, Challenges and Opportunities D Perez-Liebana, S Samothrakis, J Togelius, T Schaul, SM Lucas AAAI What's Hot, 2016	217	2016

The system can't perform the operation now. Try again later.

Articles 1–20

Citations per year

Duplicate citations

Merged citations

Add co-authorsCo-authors

Follow

Cited by

Co-authors