As a 6'2 man the clothes I find which are right for my height are often very loose on me. And if I worry about the waist I look like a kid who grew a lot in the past 2 months and everything is too short for me.
Its not entirely universal, some stores are better than others. And I wear a lot of loose casual t-shirts so thats fine too. But finding dress shirts means some places work, some don't.
It's hard for men. Big stores that just squeeze in a small section in the back for men. Trying 3 different items: one's too big, one's too tight, but they're all the same size.