Using Reddit’s popular ChangeMyView community as a source of baseline data, OpenAI had previously found that 2022’s ChatGPT-3.5 was significantly less persuasive than random humans, ranking in just the 38th percentile on this measure. But that performance jumped to the 77th percentile with September’s release of the o1-mini reasoning model and up to percentiles in the high 80s for the full-fledged o1 model.

So are you smarter than a Redditor?

  • Dayroom7485@lemmy.world
    link
    fedilink
    English
    arrow-up
    25
    ·
    2 months ago
    1. Make up a challenge.
    2. Have your AI win that challenge.
    3. Report „My AI is the best AI at this challenge!
    4. Watch your stocks go up.

    Genius.

  • TheFogan@programming.dev
    link
    fedilink
    English
    arrow-up
    15
    ·
    2 months ago

    I mean… one one hand it’s hardly supprising. Off the bat we know AI is more knowledgable than any single individual that doesn’t bother to research… and well 80% of online forum type posts aren’t exactly researched. second, AI can confidently bullshit in a way that can only be debunked easily by someone knowledgeable.

  • Fizz@lemmy.nz
    link
    fedilink
    English
    arrow-up
    14
    arrow-down
    1
    ·
    2 months ago

    So open ai is admitting to botting comments on reddit. To be honest with how shit reddit is I actually rather read ai comments than the same stupid reddit meme being repeated for the last decade.

  • Treczoks@lemmy.world
    link
    fedilink
    English
    arrow-up
    6
    ·
    2 months ago

    Lets put it the other way round: there are a lot of people in social networks who are dumb enough that them being overtaken by an AI is no real surprise.

  • satans_methpipe@lemmy.world
    link
    fedilink
    English
    arrow-up
    6
    ·
    2 months ago

    Their models are more persuasive than a person and/or older model with internet access. Very impressive. I wager your stock is worth all of the gold in fort knox ($0).

    • T156@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      ·
      2 months ago

      Their own older model, no less.

      It would be weirder/more of note if their new model was worse.

  • rottingleaf@lemmy.world
    link
    fedilink
    English
    arrow-up
    3
    ·
    2 months ago

    You mean those aggressive morons more Redditish than you expect from even Reddit are bots? Not a surprise.