David Gerard@awful.systemsM to TechTakes@awful.systemsEnglish · 7 months agoRemember how ChatGPT totally aced the bar exam? Wow! yeah, turns out that was just a liewww.nytimes.comexternal-linkmessage-square82fedilinkarrow-up12arrow-down10file-textcross-posted to: [email protected]
arrow-up12arrow-down1external-linkRemember how ChatGPT totally aced the bar exam? Wow! yeah, turns out that was just a liewww.nytimes.comDavid Gerard@awful.systemsM to TechTakes@awful.systemsEnglish · 7 months agomessage-square82fedilinkfile-textcross-posted to: [email protected]
minus-squareexanime@lemmy.todaylinkfedilinkEnglisharrow-up0·7 months agoBecause a machine that “forgets” stuff it reads seems rather useless… considering it was a multiple choice style exam and, as a machine, Chat GPT had the book entirely memorized, it should have scored perfect almost all the time.
minus-squareEatATaco@lemm.eelinkfedilinkEnglisharrow-up0·7 months ago Chat GPT had the book entirely memorized I feel like this exposes a fundamental misunderstanding of how LLMs are trained.
Because a machine that “forgets” stuff it reads seems rather useless… considering it was a multiple choice style exam and, as a machine, Chat GPT had the book entirely memorized, it should have scored perfect almost all the time.
I feel like this exposes a fundamental misunderstanding of how LLMs are trained.