Why Human-Level Intelligence Is the Wrong AI Yardstick
Norvig rejects a single score comparing AI with people because the purpose of AI should not be to replace a human. Useful tools combine narrow superhuman abilities with human judgment, while current general language models can alternate between excellent and extremely poor answers.
- AI should fill missing pieces rather than duplicate a whole person
- Tools can be superhuman at narrow tasks and subhuman elsewhere
- Performance and generality are separate dimensions
- Current general-purpose models are not consistently reliable
“we don't want a tool that replaces a human we want a tool that kind of fills in the the missing pieces”
“they'll give you an amazingly good answer one time and then the next time they'll give you an amazingly bad answer”