Abstract

In offline reinforcement learning, a policy needs to be learned from a singlepre-collected dataset. Typically, policies are thus regularized during trainingto behave similarly to the data generating policy, by adding a penalty based ona divergence between action distributions of generating and trained policy. Wepropose a new algorithm, which constrains the policy directly in its weightspace instead, and demonstrate its effectiveness in experiments.

 

Quick Read (beta)