WhatsApp’s AI shows gun-wielding children when prompted with ‘Palestine’ - Feddit
feddit.de
The search results varied when tested by different users, but the Guardian verified through screenshots and its own tests that various stickers portraying guns surfaced for these three search results. Prompts for “Israeli boy” generated cartoons of children playing soccer and reading. In response to a prompt for “Israel army” the AI created drawings of soldiers smiling and praying, no guns involved. Meta’s own employees have reported and escalated the issue internally, a person with knowledge of the discussions said.
  • magnetosphere @beehaw.orgEnglish
    3·
    1 year ago

    Something as simple and obvious as this makes me wonder what other hidden biases are just waiting to be discovered.

    • hh93@lemm.ee
      9·
      1 year ago

      I think the best example about how AI will only further a bias that’s already there is the one when Amazon used AI to weed out applications by training an ai with which applications resulted in hired people and which failed - eventually they found that they almost only had interviews with men and upon closer inspection identified that they already were subconsciously discriminating against women earlier but at least HR sent them an equal amount of men and women to the interviews which now wasn’t the case anymore since the AI didn’t see the value in sending the women to interviews if most of them wouldn’t be hired anyway.