I used a higher power 2.4 amp connector I had laying around between the USB and the outlet. Poof. Now the battery charges and the speaker stays on. I guess it just needed more juice.
open