KeysRx300

Ive got a 2001 RX300 with the premium Pioneer system. And I have a problem with the speakers in the front doors. Under certian bass frequencies the whole door rattles. This is with the volume about half way up. Ive disconnected the subwoofer and can select just the rear speakers. So its only the front doors. Any suggestions? Replace the speakers. Tighten the door or speaker?