Supplementary reading: AIMA sections 4.1 on local search. For extra supplementary reading, this paper surveys the results on convergence of simulated annealing.