....or desolder connection and leave the speaker & wire in the case, if you like to "play with powertools?" ;-)

If the speaker and wire (twisted red&white) are removed from the case (step 2 above), then you won't need to desolder the connection to the motherboard (step 3 above). Just leave it soldered and remove with motherboard (step 10 above).