When most of your waking hours go to earning enough simply to stay alive, the things that make a life feel full get squeezed out. Survival work doesn't just tire people; it takes the room where the rest of life would happen.
People at the top and at the bottom of the social order both try to arrange their lives to suit themselves, and both are blocked by forces they don't control. Class, family authority and custom limit the rich heir as well as the factory girl, in different ways.
For people worn down by hard work, beauty and feeling still turn up, but only at the edge of attention, caught while too tired or busy to stop for them. There is no spare time to dwell on them, so they pass almost unnoticed.