If you stop the spawner from spawning using torches, it's usually more beneficial to leave it. After you grab the loot, you can set up a mob grinder using cacti and flowing water that will harvest the monster drops for you.
edit: for creepers and zombies, a 3-block deep pit is also a sufficient mob trap; let them collect in the pit, then you can safely attack them with a sword