After trying fruitlessly with a variety of plastic tools, I remembered I owned an iSesamo. Got in in 20 seconds.

This step appears to be optional for a battery replacement - or, at least, I could not persuade the connector off the logic board without applying more force than I was prepared to given all these warnings. So I just carried on, and replaced the battery without ever removing the headphone jack connector.