It sounds like you just need to exfoliate when you bathe. You're wiping soap on your skin (presumably), but you need a coarser texture to remove the dead skin cells which build up.