Unbiased Gradient Estimation in Unrolled Computation Graphs
with Persistent Evolution Strategies
Paul Vicol 1 2 Luke Metz 2 Jascha Sohl-Dickstein 2
Abstract Zipser, 1989; Tallec & Ollivier, 2017a; Mujika et al., 2018;
Unrolled computation graphs arise in many sce- Benzing et al., 2019; Marschall et al., 2019; Menick et al.,
narios, including training RNNs, tuning hyperpa- 2020) gradient accumulation. These method ...


雷达卡




京公网安备 11010802022788号







