• restingboredface@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    9
    ·
    7 days ago

    This doesn’t appear as bad as some of the other ai legal stuff. Formatting references isn’t really about generating content as much as structuring it and AI (usually) doesn’t have the kind of problems with hallucinations when just tasked with reorganizing data. I’ve used GPT for reformatting references to APA style and it worked really well. I’m surprised Claude couldn’t handle this task.

    Also bummed that there doesn’t appear to be a book called a statisticians guide to making inferences with noisy data, because that sounds like a book worth checking out.

    • tyler@programming.dev
      link
      fedilink
      English
      arrow-up
      3
      ·
      7 days ago

      They gave it a link to the paper, not the text of the paper. So it probably couldn’t actually access the URL and just pulled from its training.

  • BrianTheeBiscuiteer@lemmy.world
    link
    fedilink
    English
    arrow-up
    48
    ·
    7 days ago

    This should be cause for contempt. This isn’t much worse, IMO, than a legal briefing mentioning, “as affirmed in the case of Pee-pee v.s Poo-poo.” They’re basically taking a shit on the process by not verifying their arguments.

  • dohpaz42@lemmy.world
    link
    fedilink
    English
    arrow-up
    50
    arrow-down
    8
    ·
    7 days ago

    Can we normalize not calling them hallucinations? They’re not hallucinations. They are fabrications; lies. We should not be romanticizing a robot lying to us.

    • Imgonnatrythis@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      37
      ·
      7 days ago

      Pretty engrained vocabulary at this point. Lies implies intent. I would have preferred “errors”

      Also, for the record, this is the most dystopian headline I’ve come across to date.

      • dohpaz42@lemmy.world
        link
        fedilink
        English
        arrow-up
        7
        arrow-down
        13
        ·
        7 days ago

        If a human does not know an answer to a question, yet they make some shit up instead of saying “I don’t know”, what would you call that?

        • JuxtaposedJaguar@lemmy.ml
          link
          fedilink
          English
          arrow-up
          6
          ·
          7 days ago

          If you train a parrot to say “I can do calculus!” and then you ask it if it can do calculus, it’ll say “I can do calculus!”. It can’t actually do calculus, so would you say the parrot is lying?

        • ramirezmike@programming.dev
          link
          fedilink
          English
          arrow-up
          29
          ·
          7 days ago

          that’s a lie. They knowingly made something up. The AI doesn’t know what it’s saying so it’s not lying. “Hallucinating” isn’t a perfect word but it’s much more accurate than “lying.”

          • 5too@lemmy.world
            link
            fedilink
            English
            arrow-up
            4
            ·
            edit-2
            7 days ago

            This is what I’ve been calling it. Not as a pejorative term, just descriptive. It has no concept of truth or not-truth, it just tells good-sounding stories. It’s just bullshitting. It’s a bullshit engine.

    • BossDj@lemm.ee
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      1
      ·
      7 days ago

      I like fabrication going forward. Clearly made up, doesn’t imply intent

    • mosiacmango@lemm.ee
      link
      fedilink
      English
      arrow-up
      24
      ·
      edit-2
      7 days ago

      AI’s second innovation, besides letting you mass fire labor, is removing all blame for any decision as long as you can thinly point to AI being involved.

      It outsources responsibility, and our legal/political/moral systems are not built to handle it.

      • count_dongulus@lemmy.world
        link
        fedilink
        English
        arrow-up
        8
        ·
        7 days ago

        But it legally doesn’t. That is why AI has not taken over in high liability fields. Morons are testing the waters and learning that AI mistakes make no difference in a court room, and if anything are grounds for further evidence of negligence.

        The big bet now, I think, is whether those popup insurance policies regarding coverage for losses relates to AI usage end up profitable. If so, that is what will lead to truly dystopian stories like “AI piloted passenger jet crashes, United Airlines fined x million dollars but happily continues using AI pilots because insurance covered the fine and it’s just a cost of doing business”