伪代码如下:
Initialize Q(s,a) arbitrarily
Repeat (for each episode):
Initialize s
Repeat (for each step of episode):
Choose a from s using policy derived from Q (e.g.,-greedy)
Take action a , abserve r , s'
Q (s , a)Q (s , a)+
[r+
Q( s' , a')-Q(s , a)]
ss';
until s is term