Put a thin strip of card in alongside the battery as you insert it ,so that it's a good tight fit. I've been using mine like that for ages without problem.
open