Know the limitation of the tool - general reasonong ability is back. Expertise is niched.
“The world is so much richer than even their training data,” Lewis said.
Is hallucination a case of wait wait dont tell me tongue slips. (toddlers generalize)
Measure Model belief - as one researcher said, humans have an idea of how wrong/right they are.
rock paper scissors with AI and simultaneity -- compare the behavioral aspect of neural networks with Behave book by Sapolsky
"people in various professions have a much better understanding of the limits of AI in their domains than AI researchers do."
"it’s very hard to articulate all your knowledge. Much of it is tacit or unconscious—things you don’t even realize you know. And that knowledge is often crucial to doing the job well."
midstream evaluation.
midstream evaluation.
No comments:
Post a Comment