• gastationsushi@lemmy.world
    link
    fedilink
    arrow-up
    84
    arrow-down
    2
    ·
    8 months ago

    Are we sure it’s AI?

    I’ve heard of this scam happening maybe a decade ago with my extended family. The voice was a real person overseas with a lot of exp tricking grandparents. Scammers only had basic information.

    They act as a freaked out kid and the victim gets roped in. They scam for thousands of dollars each time, even succeeding a few times a day would net a big profit. Also cell connections are low fidelity, I bet that aids their ability to trick the victim.

    • TORFdot0@lemmy.world
      link
      fedilink
      English
      arrow-up
      20
      ·
      8 months ago

      Yeah this happened to my grandparents, they just say “I sound like shit because I’ve been crying”

    • Chetzemoka@startrek.website
      link
      fedilink
      arrow-up
      15
      arrow-down
      1
      ·
      8 months ago

      Same. Years ago my grandfather received a call from a guy claiming to be my younger, male cousin saying he was in jail for something and needed bail. Luckily (?), my grandfather was an asshole and told him to call his mother.

    • OceanSoap
      link
      fedilink
      arrow-up
      7
      ·
      8 months ago

      Yeah, my dad called me one day asking if my brother was out if the country because our grandma got a call saying he was kidnapped in Mexico and she needed to put up money for his release.

      It’s wild.

    • AFaithfulNihilist@lemmy.world
      link
      fedilink
      arrow-up
      18
      ·
      8 months ago

      I don’t know, the “Spanish prisoner” is a scam that seems to be reinvented every few years every time we see a little bit of a change in technology. It wouldn’t take much to fake a person’s voice with a trained model, especially if that person has an online profile open to the public where they post content in their own voice.

    • flying_sheep
      link
      fedilink
      arrow-up
      16
      arrow-down
      4
      ·
      8 months ago

      Yeah, it has some sus vibes. I’m usually far too trusting, but here even my bullshit detectors rang

      • Mr_Blott@lemmy.world
        link
        fedilink
        arrow-up
        17
        arrow-down
        4
        ·
        8 months ago

        You know that old adage “Never attribute to malice that which can be easily explained by stupidity”?

        We need a new one along the lines of “Never attribute to truth that which can be easily explained by attention-starved teenagers”

    • I could easily conceive some tricks to get clips of a person’s voice without them realizing. I’d write them out but… that would be stupid of me. Humans have more vulnerabilities than computers.

    • PLAVAT🧿S@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      4
      arrow-down
      3
      ·
      8 months ago

      Yeah, unless this person runs a YouTube or podcast it seems implausible. What would you train a random AI on for the normal person?

      I could see a situation where you hack a phone, get the contacts and call history, pick the 1st or 2nd most dialed number, have a bot call that person to get samples, then go back to the original phone and try this… I mean, eventually you’d get a hit?

    • Szymon@lemmy.ca
      link
      fedilink
      English
      arrow-up
      0
      ·
      8 months ago

      You can train AI with just a single voice clip. You can do this on your desktop. Microsoft doesn’t need to sell shit, you put that clip on tiktok yourself.

      • unexposedhazard@discuss.tchncs.de
        link
        fedilink
        arrow-up
        1
        ·
        8 months ago

        Well they said they dont share their voice anywhere, if thats true it would be concerning. I for one just dont use any centralized unencrypted services that could scrape my voice but i would assume most people think that if they dont publish anything, they are safe…

  • cum@lemmy.cafe
    link
    fedilink
    English
    arrow-up
    43
    arrow-down
    9
    ·
    8 months ago

    Uh there’s zero chance these big techs are selling voices like this. Also, this sounds very targeted and planned, so there must be more context to this. Also, why the hell are they on bluesky?

    • maynarkh@feddit.nl
      link
      fedilink
      arrow-up
      3
      arrow-down
      1
      ·
      8 months ago

      Oh they totally are. Maybe not this directly, but there is an awful depth to the data market. One company may be selling to the next and the next and you end up with companies just buying all the data they can to sell police surveillance software running off of fucking Candy Crush telemetry.

  • ɔiƚoxɘup@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    34
    arrow-down
    1
    ·
    8 months ago

    All those TV shows that taught us how to spot which twin was the evil one by asking about life history were just training us to beat AI

  • rbesfe@lemmy.ca
    link
    fedilink
    arrow-up
    38
    arrow-down
    6
    ·
    edit-2
    8 months ago

    The only way to train an AI voice model is to have lots of samples. As scummy as they are, neither Microsoft nor Apple is selling your voice recordings with enough info to link them to you specifically. This person probably just forgot about an old social post where they talk for enough time for a model to be trained. Still super scary stuff.

    • altasshet@lemmy.ca
      link
      fedilink
      arrow-up
      35
      arrow-down
      1
      ·
      edit-2
      8 months ago

      Not true anymore. You can create a reasonable voice clone with like 30 seconds of audio now (11labs for example doesn’t do any kind of authentication). The results are good enough for this kind of thing, especially in a lower bandwidth situation like a phone call.

    • nifty@lemmy.world
      link
      fedilink
      arrow-up
      14
      arrow-down
      2
      ·
      edit-2
      8 months ago

      This person probably just forgot about an old social post…

      Or recordings made during customer service calls, maybe a disgruntled employee decides to repurpose the data.

    • Wirlocke@lemmy.blahaj.zone
      link
      fedilink
      arrow-up
      6
      ·
      edit-2
      8 months ago

      True for creating voices at all, but that work has already been done.

      Now we’re just taking these large AI’s trained to mimic voices and giving them a 30 second audio clip to tell them what to mimic. It can be done quickly and give convincing results especially when hidden by the phonecall quality.

  • voxel@sopuli.xyz
    link
    fedilink
    arrow-up
    28
    ·
    8 months ago

    you don’t even need to fake a voice for these scams tho, it’s very difficult to differentiate q voice while you’re crying

  • Zeshade@lemmy.world
    link
    fedilink
    arrow-up
    24
    ·
    8 months ago

    Do a lot of people put their voice on the internet “as much as they’re able to”? It sounds like that person may post their voice online more than the average person…

    • Powerpoint@lemmy.ca
      link
      fedilink
      arrow-up
      5
      ·
      8 months ago

      Discord just automatically started putting you opt in for having your voice recorded for clips

    • maynarkh@feddit.nl
      link
      fedilink
      arrow-up
      3
      ·
      8 months ago

      I imagine even discounting social media self-posts, there are VoIP calls, etc.

      Don’t assume a call with your mom through Facebook Messenger or Zoom or FaceTime or whatever is not somehow packaged and sold.

  • LaunchesKayaks@lemmy.world
    link
    fedilink
    arrow-up
    21
    ·
    8 months ago

    My grandmother got a call from scammers pretending to be me. They didn’t use my name, but I was the only adult granddaughter at the time lol. Anyway, the scammers said that they needed money for hospital bills and a bus ticket home. They said they got into a fight at a friend’s funeral in New Jersey and had to go to the hospital. And then after that their car got stolen. My grandmother knew that I was not in New Jersey, and told the scammers that she’d call them back once she got to the bank. She then informed my parents, who told me. It was hilarious.

  • DirkMcCallahan@lemmy.world
    link
    fedilink
    arrow-up
    20
    arrow-down
    1
    ·
    8 months ago

    Waiting for the comment that’s going to say something like, “Joke’s on you, my parents don’t even talk to me.”

  • M500
    link
    fedilink
    English
    arrow-up
    17
    arrow-down
    2
    ·
    8 months ago

    I advise everyone to contact their loved ones and inform them of this possibility. I also advise having some codeword that would be used if there was an emergency and money needs to be sent.

    For example is more than $100 is being asked for we have to share the code word or we should not transfer money.

      • get_off_the_phone@sh.itjust.works
        link
        fedilink
        arrow-up
        4
        ·
        8 months ago

        Hey is me, your cousin. I’m kinda in a jam and need your help. The contractor cut me a huge check after the fire that took everything but the bank won’t cash it without proof. I just need $101 for proof and I can pay back immediately.

        This is for real.

        Thanks.

        Donkeyballs

        • Restaldt@lemmy.world
          link
          fedilink
          arrow-up
          2
          ·
          edit-2
          8 months ago

          Hey its me your 2nd uncle

          I need about $3.50 to pay for shipping on a package from a nigerian price who needed my help

          I know we said over 100 for this but

          Donkeyballs

          • DrRatso
            link
            fedilink
            arrow-up
            3
            ·
            8 months ago

            Well thats about the time I noticed my uncle was eight stories tall and a crustacean from the paleozoic era.

  • paulcdb@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    10
    ·
    8 months ago

    Tbh it’s not that hard to stop scams. Treat EVERY call you get as a scammer!

    Either phone back on a known number, not some shit they give you or if they claim you need bail, ask for a reference number and the place being held and phone them after looking up the number, and If they get pissed, it’s a scam!

    No real police force is going to care/shouldn’t care if you call back. It’s not like cops get a percentage of bail money but scammers always seem too desperate to get you to pay and lose it pretty quick.