Tape is probably good enough if you're throwing them away, but in the junk box it often comes off and (1) exposes the battery terminals and (2) makes everything sticky.
What I prefer is to get a bunch of 9v-battery snap connectors, cut the wires off, and use them to cap batteries in storage.
They are super cheap, as this link shows.