Ignoring extinction and singleton risks, the bare minimum you should be horrified of is a commodification of intelligence, and what that means in a world with an uneven distribution of power and resources.

Commodified Intelligence.

That’s the phrase I’ve been trying to put a finger on for a while now.

The reason why dead-end so-called unskilled labor sucks is that you are fundamentally replaceable. The market enforces a pretty brutal equilibrium. White-collar jobs suck less because you are less replaceable, and maybe even get to convince yourself that your work matters, either for yourself or for society. You have some narrative arc attached to it that just isn’t there if you’re completely replaceable.

Whether you have a white-collar job or not, commodified intelligence fundamentally makes workers more replaceable, and this is bad for them.

It doesn’t matter that we’re all subjected to horrible AI-generated slop food posters as long as the margins are positive. It doesn’t matter that some diffuse component of quality, or a human touch are missing. Not as long as the margins are positive.