Tom Schaul

Cited by

	All	Since 2018
Citations	27831	24830
h-index	41	40
i10-index	71	58

7000

3500

1750

5250

2011201220132014201520162017201820192020202120222023108 151 170 221 367 539 1162 2315 3481 4804 5669 6022 2515

Public access

View all

20 articles

0 articles

available

not available

Based on funding mandates

Co-authors

David SilverDeepMind, UCLVerified email at google.com
Juergen SchmidhuberKing Abdullah University of Science and Technology / The Swiss AI Lab, IDSIA / University of LuganoVerified email at kaust.edu.sa
Daan WierstraPrincipal Scientist, DeepMindVerified email at google.com
Nando de FreitasCIFAR & DeepMindVerified email at google.com
Tobias GlasmachersVerified email at idsia.ch
Oriol VinyalsResearch Scientist at Google DeepMindVerified email at google.com
Will DabneyDeepMindVerified email at google.com
Julian TogeliusAssociate Professor of Computer Science and Engineering, New York University; co-founder, modl.aiVerified email at nyu.edu
Joseph ModayilDeepMindVerified email at cs.ualberta.ca
Andre BarretoResearch Scientist, Google DeepMindVerified email at google.com
Rémi MunosDeepMindVerified email at inria.fr
koray kavukcuogluDeepMindVerified email at kavukcuoglu.org
Simon LucasProfessor of Artificial Intelligence, Queen Mary University of LondonVerified email at qmul.ac.uk
Diana BorsaDeepMindVerified email at google.com
Max JaderbergIsomorphic LabsVerified email at robots.ox.ac.uk
Simon OsinderoSenior Staff Scientist @ DeepMindVerified email at google.com
Jan PetersProfessor for Intelligent Autonomous Systems at Technische Universität DarmstadtVerified email at ias.tu-darmstadt.de
Marc G. BellemareGoogle BrainVerified email at google.com
Yann LeCunChief AI Scientist at Facebook & Silver Professor at the Courant Institute, New York UniversityVerified email at cs.nyu.edu
Karen SimonyanCo-Founder and Chief Scientist at Inflection AIVerified email at inflection.ai

Tom Schaul

Senior Staff Scientist, DeepMind

Verified email at nyu.edu - Homepage

Reinforcement Learning Deep Learning Deep Reinforcement Learning Game AI Exploration


Title Sort by citations Sort by year Sort by title	Cited by Cited by	Year
Prioritized Experience Replay T Schaul, J Quan, I Antonoglou, D Silver International Conference on Learning Representations (ICLR), 2016	3856	2016
Dueling Network Architectures for Deep Reinforcement Learning Z Wang, T Schaul, M Hessel, H van Hasselt, M Lanctot, N de Freitas International Conference on Machine Learning (ICML), 2016	3763	2016
Grandmaster level in StarCraft II using multi-agent reinforcement learning O Vinyals, I Babuschkin, WM Czarnecki, M Mathieu, A Dudzik, J Chung, ... Nature 575 (7782), 350–354, 2019	3107	2019
Rainbow: Combining Improvements in Deep Reinforcement Learning M Hessel, J Modayil, H Van Hasselt, T Schaul, G Ostrovski, W Dabney, ... AAAI Conference on Artificial Intelligence, 2018	2074	2018
Learning to learn by gradient descent by gradient descent M Andrychowicz, M Denil, S Gomez, MW Hoffman, D Pfau, T Schaul, ... Neural Information Processing Systems (NeurIPS), 2016	1925	2016
Unifying Count-Based Exploration and Intrinsic Motivation MG Bellemare, S Srinivasan, G Ostrovski, T Schaul, D Saxton, R Munos Neural Information Processing Systems (NeurIPS), 2016	1357	2016
Reinforcement learning with unsupervised auxiliary tasks M Jaderberg, V Mnih, WM Czarnecki, T Schaul, JZ Leibo, D Silver, ... International Conference on Learning Representations (ICLR), 2017	1210	2017
Universal value function approximators T Schaul, D Horgan, K Gregor, D Silver International Conference on Machine Learning (ICML-15), 1312-1320, 2015	985	2015
Deep Q-learning from Demonstrations T Hester, M Vecerik, O Pietquin, M Lanctot, T Schaul, B Piot, D Horgan, ... AAAI Conference on Artificial Intelligence, 2018	970	2018
StarCraft II: A New Challenge for Reinforcement Learning O Vinyals, T Ewalds, S Bartunov, P Georgiev, AS Vezhnevets, M Yeo, ... arXiv preprint arXiv:1708.04782, 2017	914	2017
Natural evolution strategies D Wierstra, T Schaul, T Glasmachers, Y Sun, J Peters, J Schmidhuber The Journal of Machine Learning Research 15 (1), 949-980, 2014	866	2014
Feudal networks for hierarchical reinforcement learning AS Vezhnevets, S Osindero, T Schaul, N Heess, M Jaderberg, D Silver, ... International Conference on Machine Learning (ICML), 2017	846	2017
No more pesky learning rates T Schaul, S Zhang, Y LeCun International Conference on Machine Learning (ICML'13), 2013	524	2013
AlphaStar: Mastering the Real-Time Strategy Game StarCraft II O Vinyals, I Babuschkin, J Chung, M Mathieu, M Jaderberg, W Czarnecki, ... (DeepMind blog), 2019	497	2019
Successor features for transfer in reinforcement learning A Barreto, W Dabney, R Munos, J Hunt, T Schaul, D Silver, H van Hasselt Neural Information Processing Systems (NeurIPS), 2017	474	2017
PyBrain T Schaul, J Bayer, D Wierstra, Y Sun, M Felder, F Sehnke, T Rückstieß, ... Journal of Machine Learning Research 11 (Feb), 743-746, 2010	470	2010
The predictron: End-to-end learning and planning D Silver, H van Hasselt, M Hessel, T Schaul, A Guez*, T Harley, ... International Conference on Machine Learning (ICML), 2017	300*	2017
The 2014 General Video Game Playing Competition D Perez, S Samothrakis, J Togelius, T Schaul, S Lucas, A Couëtoux, ... Computational Intelligence and AI in Games, 2015	269*	2015
A video game description language for model-based or interactive learning T Schaul Conference on Computational Intelligence in Games (IEEE-CIG), 1-8, 2013	249	2013
General Video Game AI: Competition, Challenges and Opportunities D Perez-Liebana, S Samothrakis, J Togelius, T Schaul, SM Lucas AAAI What's Hot, 2016	208	2016

The system can't perform the operation now. Try again later.

Articles 1–20

Citations per year

Duplicate citations

Merged citations

Add co-authorsCo-authors

Follow

Cited by

Co-authors