I do at the beginning of the game. Then around the third badge or so, I put it in the PC. I try to teach Pokemon on my team one HM per Pokemon.
(I try not to give any HM's to the Starter, unless it's the Water Starter)