D-DL4CV-Lec21b-Value_Function

Value Function

The value function at state $s$ computes the expected reward by following policy $\pi$

$$V^{\pi }(s)=\mathbb{E}\left[\sum _{t\ge 0}{\gamma }^t{r}_t|s_0=s,\pi \right]$$