Everyone’s definition of attractive is different, but typically everyone wants their partner to be both loving and attractive. It’s the “full package.”

So they care because they want you to have both, they want the best for you. So long as you find him attractive, that should be good enough.