Discussion about this post

User's avatar
Valentina's avatar

Oh, I always think about earlier technological breakthroughs, and it seems as though their ethics came not from their creators, but from the people who resisted them. Strikes by assembly-line workers made factories safer and forced manufacturers to introduce standards. They would never have done it on their own initiative.

So it is always a conflict. And with AI, I suspect it will also become a conflict once adoption grows, because right now the entire discourse is still being shaped mainly by model developers and early adopters...

Quy Ma's avatar

A checklist is such a horrible substitute for judgment. Once something is on the checklist, checking the box is all it is...no thought beyond that.

Your essay actually reminds me of a study in which Israeli daycare centers introduced a small fine for late pickup, only to see lateness increase. The fine converted a moral obligation into a priced transaction, so parents stopped feeling they owed the staff anything and started feeling they'd bought the right to be late. Runs parallel to what you're talking about with checklists, except there's an actual price attached to it. (Source if you wanna read it: rady.ucsd.edu/_files/faculty-research/uri-gneezy/fine.pdf)

Great points, Lisa!

4 more comments...

No posts

Ready for more?