It's always a problem! And bad for the neighbours - bang, bang, bang... I guess those stand alone bags are a good idea - if you have the space.
I've got a punch ball, but it's way too springy, so I've reinforced the spring with an ash stick. Regarding the punch bag - we don't have to worry about neighbours, but the house is rented so I don't want to start drilling big holes.