Variational actor-critic algorithms, Yuhua Zhu and Lexing Ying ESAIM: COCV, 29 (2023) 20 Published online: 07 March 2023 DOI: 10.1051/cocv/2023007