Absolutely needed: to get high efficiency for this beast … as it gets better, we’ll become too dependent.

“all of this growth is for a new technology that’s still finding its footing, and in many applications—education, medical advice, legal analysis—might be the wrong tool for the job,”

    • Bogasse@lemmy.ml
      link
      fedilink
      English
      arrow-up
      13
      ·
      1 month ago

      Yeah, I think there was some efforts, until we found out that adding billions of parameters to a model would allow both to write the useless part in emails that nobody reads and to strip out the useless part in emails that nobody reads.

  • Dr. Moose@lemmy.world
    link
    fedilink
    English
    arrow-up
    30
    arrow-down
    6
    ·
    1 month ago

    The energy issue almost feels like a red herring for distracting all idiots from actual AI problems and lemmy is just gobbling it up every day. It’s so tiring.

    • Phoenixz@lemmy.ca
      link
      fedilink
      English
      arrow-up
      43
      arrow-down
      2
      ·
      1 month ago

      That’s because it IS an issue, together with many other issues like disinformation, over reliance, wrong tools for wrong (most) jobs, etc.

      • REDACTED@infosec.pub
        link
        fedilink
        English
        arrow-up
        4
        arrow-down
        11
        ·
        1 month ago

        Ypu know what I don’t hear on lemmy? People complaining that crypto world consumes more energy than AI world and one of those is far more useless in grand scheme of things.

        So how comes it is A issue for AI, but everyone seemingly has forgotten about crypto?

        Last I heard, securing one transaction on chain is equalivent to powering US household for many days (feel free to fact check). In comparison, generating LLM text for entire hour on your PC is pretty much the same as gaming for two hours (very approx., your gpu is unlikely at 100% load), which means gaming world is far more destructive energy wise. Are you getting triggered yet?

        • I Cast Fist@programming.dev
          link
          fedilink
          English
          arrow-up
          8
          ·
          1 month ago

          Ypu know what I don’t hear on lemmy? People complaining that crypto world consumes more energy than AI world and one of those is far more useless in grand scheme of things.

          That’s because one has all the big tech companies madly rushing to implement it everywhere, while the other even Ubisoft has abandoned and is more or less stuck to their own cult

        • Decq@lemmy.world
          link
          fedilink
          English
          arrow-up
          6
          arrow-down
          1
          ·
          1 month ago

          What stone did you live under? The huge power consumption of crypto was often debated. You just don’t hear too much about it because people don’t really talk about crypto much anymore. Now it’s mostly just people pro crypto who discuss it. And obviously they tend to talk leas about the downsides.

          • Phoenixz@lemmy.ca
            link
            fedilink
            English
            arrow-up
            1
            ·
            1 month ago

            Eh, that enormous energy consumption hasn’t change, y’know. For Bitcoin, for example, the basic concept is still that ALL wallets have to process ALL transactions, which scales as well as studfing a walrus in a mini Cooper. Bitcoin is extremely energy inefficient and is simply not a good replacement for transactions for the entire world.

            Same goes for all other block chain technologies, they’re fundamentally flawed and won’t ever be good. If you want a good alternative to visa and MasterCard, you’ll need something fundamentally different from blockchain tech.

          • REDACTED@infosec.pub
            link
            fedilink
            English
            arrow-up
            1
            arrow-down
            5
            ·
            1 month ago

            … Oh, so so the terawatts of power wasted is no longer a problem because people don’t really speak of it anymore and cryptobros tried to debate it.

            If I’m living under a stone, you’re straight up stoned.

        • JackbyDev@programming.dev
          link
          fedilink
          English
          arrow-up
          4
          ·
          1 month ago

          Ypu know what I don’t hear on lemmy? People complaining that crypto world consumes more energy than AI world and one of those is far more useless in grand scheme of things.

          I have both heard and said that crypto uses a lot of energy on Lemmy.

          • REDACTED@infosec.pub
            link
            fedilink
            English
            arrow-up
            1
            arrow-down
            3
            ·
            edit-2
            1 month ago

            This? Hipster 4chan from everything I’ve seen. Altought nowadays 4chan tends to be less hateful/extreme, especially when it comes to calls for genocide/killings of Jews

        • Phoenixz@lemmy.ca
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 month ago

          You don’t hear so much about it because it has faded a bit into the background and crypto bros work hard spreading misinformation about how awesome Bitcoin is.

          Technically, blockchain tech is interesting, bit nothing more than that. Blockchain technology is fundamentally flawed. Requiring everyone to confirm the same transactions by having everyone make the same CPU / GPU / memory intensive calculations is just dumb and it won’t scale to anything that could sustain the daily transactions of even a single small country, let alone the world.

          At least AI has a whole lot of pieces that are fundamentally “useful”. As it currently stands, AI will need completely new concepts and technologies to be able to grow in capabilities and shrink in power requirements, but at least the prices that are there are reasonably useful.

          Blockchain technology is fundamentally flawed for just about any application at all.

          Having said all that, fuck AI companies. AI could be a great new tool for humanity but instead we hacet all sorts of shitty assistants being shoved down our throats. Oh, and AI revenge porn, that too

        • adr1an@programming.dev
          link
          fedilink
          English
          arrow-up
          2
          arrow-down
          3
          ·
          1 month ago

          That’s not true if you were to use off-chain transactions (i.e. lightning network)

          • REDACTED@infosec.pub
            link
            fedilink
            English
            arrow-up
            4
            arrow-down
            2
            ·
            edit-2
            1 month ago

            “That’s not true”

            “But not true only if you use non-mainstream transaction method that was not part of the original design and is only supported by selected cryptos, meaning not universal”

            K

            I mean, don’t get me wrong, it’s nice that things are improving, but it’s safe to say that things will improve for AI too (energy-wise), hella lot of people now working on optimization and it looks very promising, even by just splitting large models into many smaller ones by topic

            • adr1an@programming.dev
              link
              fedilink
              English
              arrow-up
              4
              ·
              1 month ago

              I just wanted to clarify the confusion that was in my head for a moment after going after the truth and fact checking. If I buy a pizza with Bitcoin and Lightning Network (which is the only one in use at most legal places), it’s not like I’m using 1600 kWh… The original message is misleading in that regard… Practical and concrete reality are different. But theoretical, if that pizza wanted a normal transaction it would use such amount of energy and take days (that’s why they wouldn’t use that)… So… There’s that.

              Anyway, the dichotomy ‘AI or Crypto’ is false. I am not taking sides. But you do you, enjoy.

    • CapriciousDay@lemmy.ml
      link
      fedilink
      English
      arrow-up
      5
      ·
      1 month ago

      The international energy agency estimates that the total electricity consumption for AI worldwide was around 415 TWh per year as of 2024. That’s more than the UK uses.

    • kalkulat@lemmy.worldOP
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 month ago

      Partly, yep. Seems like every time I try to pin down an AI on a detail of a question worth asking - a math question, or a date in history, it’ll confidently reply with the first answer it finds … right or wrong.

      • Dr. Moose@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 month ago

        I don’t think accuracy is an issue either. I’ve been on the web since inception and we always had a terribly inaccurate information landscape. It’s really about individual ability to put together found information to an accurate world model and LLMs is a tool just like any other.

        The real issues imo are effects on society be it information manipulation, breaking our education and workforce systems. But all of that is overshadowed by meme issues like energy use or inaccuracy as these are easy to understand for any person while sociology, politics and macro economics are really hard.

    • crystalmerchant@lemmy.world
      link
      fedilink
      English
      arrow-up
      8
      ·
      1 month ago

      Depends on the prompt, the model, the parameters, which DCs, time of day, location in the world, and other factors. They answer the question but there’s so many variables that can affect footprint (and big hyperscalers do not release this data so you have to under a lot)

  • notfromhere@lemmy.ml
    link
    fedilink
    English
    arrow-up
    18
    arrow-down
    37
    ·
    1 month ago

    At some point, someone said the same thing about:

    • electricity
    • books
    • cars
    • computers
    • medicine
    • houses

    Is this /c/technology or /c/anti_technology because it’s hard to tell most of the time.

    • yeahiknow3@lemmings.world
      link
      fedilink
      English
      arrow-up
      24
      arrow-down
      3
      ·
      1 month ago

      A better analogy for AI is the discovery of asbestos or the invention of single-use plastics. Terrible fucking idea.

      • notfromhere@lemmy.ml
        link
        fedilink
        English
        arrow-up
        5
        arrow-down
        3
        ·
        1 month ago

        I think it’s probably a bit early to tell for certain on that assessment. There is definitely pros and cons to all technology. Electricity production causes environmental damage, building wooden houses require logging. Plastics are a byproduct of a withering industry. Asbestos might have saved more lives than it took, but there were probably much better ways to solve fire resistant buildings.

        Why all these destructive things? Capitalism requires maximizing profits above all else. So, really the question is how will capitalism fuck us over with AI? So, so many ways. That’s why it’s important that we build community understanding of this technology in order to combat it. It’s not going away. It’s here to stay. So we either put our heads in the sand and pretend it’s not here or we can embrace it and learn how it works and how to defeat it and come up with open source tooling to combat it.

        I’m in the latter camp. I love technology breakthroughs and want to learn first hand the capabilities to understand how it will be used against me and how I can use it.

    • eleitl@lemm.ee
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      1
      ·
      1 month ago

      You might have heard of these fossil fuels we’re busily running out of. And fossil is still 80% of primary energy use so there is no renewable energy transition, and renewable infrastructure is being built almost exclusively using fossil fuels.

      So this means future energy rationing. What’s the business case for AI?

        • Melvin_Ferd@lemmy.world
          link
          fedilink
          English
          arrow-up
          3
          ·
          edit-2
          1 month ago

          Also telling me how to install arch Linux but sing it to me as a Kenny Loggins

          Verse 1 Reboot your rig and hit the USB, Boot it up live from the Arch IS-OOOHH-B! You’re in the zone now, terminal’s lit, You gotta ping that net and make sure it’s legit!

          (CHORUS) Highway to the Arch install, (Gonna fly into the…) Highway to the Arch install!


          Verse 2 Partition time with cfdisk — no fear, Format your root with mkfs.ext4 my dear. Mount it up with a little mount /dev/sdX, Now you’re rolling smooth, yeah you’re onto the next!

          (CHORUS) Highway to the Arch install, (Gonna fly into the…) Highway to the Arch install!


          Bridge Mirror, mirror, set 'em fast, reflector knows how to make that last. Then pacstrap /mnt base linux — so fly, Installin’ Arch, baby, you’re touching the sky!

          (Slow breakdown) genfstab, then chroot in, Now you’re living life like a power sysadmin…


          Final Chorus – belt it! Highway to the Arch install, You’re flying, configuring it aaaaall! Bootloader, locale, make that call — You’re livin’ the dream with no safety net at all!

          Highway… to the Arch install…

      • notfromhere@lemmy.ml
        link
        fedilink
        English
        arrow-up
        1
        arrow-down
        2
        ·
        1 month ago

        Restricting our energy use is not a very good end game. We need to learn how to unlock more energy production without destruction of the environment. This will happen through technological development. Temporarily rationing or conservation may be needed, but permanent is not the answer.

          • notfromhere@lemmy.ml
            link
            fedilink
            English
            arrow-up
            2
            arrow-down
            1
            ·
            1 month ago

            I’m not interested in books championing our reduction of human expansion. I want to see us reach out into the stars one day. Technological development and progress is needed. We need to also change our mindset on current systems. E.g., if it doesn’t maximize return on investment, forget about it. If there is a way to do it slightly cheaper even if it’s detrimental, do it cheaper. That mindset sucks.

            • eleitl@lemm.ee
              link
              fedilink
              English
              arrow-up
              1
              ·
              1 month ago

              Just develop fully autopoietic artificial photosynthetic systems. Piece of cake.

    • Melvin_Ferd@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      3
      ·
      1 month ago

      When AI was getting popular, the media released an absolute war against it. A lot of us are swayed by what the media tell us

    • Engywook@lemm.ee
      link
      fedilink
      English
      arrow-up
      8
      arrow-down
      10
      ·
      edit-2
      1 month ago

      Is this /c/technology or /c/anti_technology because it’s hard to tell most of the time.

      People here are generally anti-anything. That’s what echo chambers are for.

      • notfromhere@lemmy.ml
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        1
        ·
        1 month ago

        I am biased, I am having a ton of fun with LLMs and they are helping me achieve some personal goals. Do they use energy? Sure. Will new, more powerful technologies come along later that require even greater amounts of energy? I hope so one day. We need to find cleaner more abundant energy sources.

      • zerofk@lemm.ee
        link
        fedilink
        English
        arrow-up
        6
        arrow-down
        7
        ·
        1 month ago

        Sounds like most of Lemmy. Honestly sometimes I feel it’s worse than Reddit with the constant bashing on anything except Linux, Firefox, or - for some reason - Steam. Still glad I left Reddit though.

        • taladar@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          1
          arrow-down
          2
          ·
          1 month ago

          Nuclear power seems to be one of those things that are anything but bashed here but instead gets treated with an almost worship-like reverence.

        • Engywook@lemm.ee
          link
          fedilink
          English
          arrow-up
          3
          arrow-down
          4
          ·
          edit-2
          1 month ago

          I didn’t leave reddit, because I consider useful the subs I use (mostly technical stuff). And yes, you’re right about the constant bashing on anything out of the herd mentality.