SURREAL is an open-source scalable framework that supports state of-the-art distributed reinforcement learning algorithms. It is a principled
distributed learning formulation that accommodates both on-policy and off-policy learning.
Also related is the SURREAL Robotics Suite, an accessible set of benchmarking tasks in physical simulation for reproducible robot manipulation research.