Reference: A. Agarwal, N. Jiang, S. Kakade, & W. Sun. Reinforcement Learning: Theory and Algorithms. https://rltheorybook.github.io/ (Version January 31, 2022)