The key is to ensure that you store any “bag” lithium batteries away from everything else, and preferably in an airtight container drained to 20% power.

Dry cell batteries (like the ones in your picture) should be stored in glass or plastic, so if the corrosive electrolytes leak out, they don’t damage anything else; you just have to recycle all the batteries the electrolytes touched.