• Communist@beehaw.org
      link
      fedilink
      arrow-up
      3
      arrow-down
      1
      ·
      1 year ago

      It’s not, this method of analysis is terrible, they’re just asking gpt4 to grade the responses, not actually testing anything beyond that.

      • aponigricon@beehaw.org
        link
        fedilink
        English
        arrow-up
        2
        ·
        1 year ago

        That doesn’t necessarily invalidate the point they’re making. Other forms of analysis, strikingly, provide pretty much completely equivalent results.

    • fruitywelsh
      link
      fedilink
      arrow-up
      1
      ·
      1 year ago

      I know I personally like open assistant more just because you get less blocks