In some cases, the RAM actually is in use by the site. That’s especially the case on sites with heavy client-side logic. In that case, it’s not Chrome’s (or Firefox’s) fault, it’s the website’s fault.

Chrome has a “Memory Saver” feature where it’ll unload tabs that are offscreen/hidden which helps quite a bit. Not sure if Firefox has something similar.