Hi, Q-function is the expected reward from state s and after choosing action a. A Value function is the expected reward from state s before choosing an action. Same thing about the r. Hope this clears things.