I had the opposite experience. Left a shitty blue-collar job (it was even a union job, but the union was toothless and mostly just existed to get work from places that would only place orders with union shops) for an office job.

The hours are better, the pay is better, the co-workers are less bigoted, and I no longer smell like grease and sweat whenever I come home.

There will always be trade-offs in any job. Whether it’s blue-collar, white-collar, or whatever ever other collar you can think of. There is no perfect job type for everyone.