• kescusay@lemmy.world
    link
    fedilink
    English
    arrow-up
    10
    arrow-down
    2
    ·
    8 months ago

    Not terribly impressed. I gave it this prompt:

    This is a surreal fantasy movie that involved some kind of magic paintbrush and someone putting peanut butter on his head.

    That’s clearly a reference to The Peanut Butter Solution (a bizarre, 1985 Canadian film), but the site responded with this:

    One movie that matches the description is “The Pagemaster” (1994). It is a live-action/animated fantasy film where a young boy named Richard Tyler gets transported into an animated world after taking shelter in a library during a storm. In this surreal adventure, Richard encounters various literary characters and embarks on a quest to find the exit. Along the way, he comes across a magical paintbrush that brings drawings to life and encounters bizarre situations, including a scene where he accidentally puts peanut butter on his head.

    There is no scene in The Pagemaster involving peanut butter.

    • CeruleanRuin@lemmings.world
      link
      fedilink
      English
      arrow-up
      5
      ·
      edit-2
      8 months ago

      This tendency of AI to just outright lie when it doesn’t have a real answer is mildly upsetting. It’s indicative of the fact that the people building these systems have no clue (or interest in?) how to implement basic ethical guidelines. That doesn’t bode well for the evolution of these systems and what they will be capable of.

      • kescusay@lemmy.world
        link
        fedilink
        English
        arrow-up
        3
        ·
        8 months ago

        What it boils down to is that they’re not really AI. They’re large language models, and chatbots built around them are basically using predictive autofill on steroids.

  • CeruleanRuin@lemmings.world
    link
    fedilink
    English
    arrow-up
    7
    ·
    8 months ago

    So I tried to use this to identify a movie I remember seeing as a kid and haven’t been able to find since. I described the scene I remember, where an industrial accident releases freezing gas and a worker with a hard hat freezes his arm and it shatters.

    As usual, when given specifics, the AI just straight makes shit up.

    One movie that fits the description is “The Abyss” (1989), directed by James Cameron. Although it doesn’t involve a freezing gas, it does feature an industrial accident and a worker in a hard hat with a frozen arm. In the film, a team of deep-sea oil drillers encounters a mysterious alien species while working on an underwater drilling platform. During their mission, one of the workers, Bud Brigman (played by Ed Harris), gets his arm trapped in a closing hatch and it becomes frozen due to extreme cold temperatures. In his panic, he runs into a wall, shattering his frozen arm.

    • leftzero
      link
      fedilink
      English
      arrow-up
      1
      ·
      8 months ago

      Huh, I’m kind of surprised it didn’t come up with Terminator 2, which at least would fit the freezing and shattering bit.

  • Salamendacious@lemmy.world
    link
    fedilink
    English
    arrow-up
    5
    ·
    edit-2
    8 months ago

    I saw a very weird movie years ago and couldn’t remember the title. I stumped the website with two different guesses but Google found it with one search.

    Black Moon if you’re curious. Very bizarre.

  • perviouslyiner@lemm.ee
    link
    fedilink
    English
    arrow-up
    4
    ·
    edit-2
    8 months ago

    orphaned farm boy teams up with wizard to rescue a princess” didn’t recognise Star Wars

  • leave_it_blank@lemmy.world
    link
    fedilink
    English
    arrow-up
    3
    ·
    8 months ago

    “A bard, a druid, a sorcerer and a barbarian try to save a girl and in the end save the world.”

    Answer: The last witch hunter 2015

    Nope. I was asking for DnD Honour among thieves.

    • leftzero
      link
      fedilink
      English
      arrow-up
      1
      ·
      8 months ago

      Might be that the training set is too old; “That one with the fat dragon” got me Kung Fu Panda, because Po, while not a dragon, was fat.

      Similar prompts (see my other replies to the OP) for older films seem to work, so Honour Among Thieves might be to recent. (Which would highlight one of the main issues with these large language models: they have to be periodically retrained with new data for them to remain accurate and practical.)

  • leftzero
    link
    fedilink
    English
    arrow-up
    2
    ·
    8 months ago

    “Pigs and diamonds” got me Snatch. Seems good.

    • leftzero
      link
      fedilink
      English
      arrow-up
      2
      ·
      edit-2
      8 months ago

      And “horse drowns in quicksand, very sad” got me The Neverending Story. Also good.

      • leftzero
        link
        fedilink
        English
        arrow-up
        2
        ·
        edit-2
        8 months ago

        Third try got me a login prompt (how about no). Definitely not good.

        • leftzero
          link
          fedilink
          English
          arrow-up
          1
          ·
          8 months ago

          OK, opening it on another browser worked. “why it was so easy to blow up the death star” got me Rogue One. So far 3/3, plus a login prompt which drops the score to 0/4.

          • leftzero
            link
            fedilink
            English
            arrow-up
            1
            ·
            8 months ago

            OK, last try: (spoiler warning) “Turns out he was Jesus” got me The Man From Earth.

            This shit would be good, if it weren’t for the login prompt.

            • leftzero
              link
              fedilink
              English
              arrow-up
              1
              ·
              8 months ago

              OK, last last one; “That one with Bill Murray and the gopher” got me Caddyshack, which I haven’t seen but does seem to be a better match than Groundhog Day, which is what I was going for (trying to see if the AI could figure out I was mixing my rodents; turns out there are too many Bill Murray rodent focused films for that to be a valid test, my bad).

              I had to do it in a third browser 'cause the login prompt came back, though, so I won’t be doing any more attempts, between that and the GDPR prompt it’s pretty clear they don’t want people using their site. Shame, as the tool seems pretty good, but what can you do. 🤷‍♂️

  • loverboy069@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    8 months ago

    movie made before the 2005, a gunslinger terrorizes a town and is chased and killed by a sheriff in gun slinging fight at the end