• Abracadaniel [he/him]@hexbear.netOP
    link
    fedilink
    English
    arrow-up
    5
    ·
    7 months ago

    It’s interesting how words with similar semantic content are close together in the abstract vector space. Those groupings seem like they could reveal the idological content of the training data.

    • Prometheus [they/them, undecided]@hexbear.net
      link
      fedilink
      English
      arrow-up
      4
      ·
      7 months ago

      Lol I don’t have it on hand, but someone did a centroid analysis of another smaller but open GPT model, and found the “word” at the “center” of the model space was “a man’s penis”