Is chatgpt proof that standard tests are bad measures of intelligence - eviltoast

LLMs are solving MCAT, the bar test, SAT etc like they’re nothing. At this point their performance is super human. However they’ll often trip on super simple common sense questions, they’ll struggle with creative thinking.

Is this literally proof that standard tests are not a good measure of intelligence?

  • Z3k3@lemmy.world
    link
    fedilink
    English
    arrow-up
    6
    ·
    edit-2
    8 months ago

    I’m not in the us collages are generally vocational here with both colleges being less (while not totaly) concerned by the money side.

    For example where I live university courses are free for those in country outside they pay fees

    Dunno how it’s done elsewhere but our course are usually measured in 3 parts 1 exam 2 practical 3 essey/investigation. Everyone hates exams