Jellie Frontier
  • Communities
  • Create Post
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
just_another_person@lemmy.world
cake
to Linux@lemmy.worldEnglish · 4 months ago

AMD Announces "Instella" Fully Open-Source 3B Language Models

www.phoronix.com

external-link
message-square
17
fedilink
  • cross-posted to:
  • linux@lemmy.ml
70
external-link

AMD Announces "Instella" Fully Open-Source 3B Language Models

www.phoronix.com

just_another_person@lemmy.world
cake
to Linux@lemmy.worldEnglish · 4 months ago
message-square
17
fedilink
  • cross-posted to:
  • linux@lemmy.ml
Attention Required! | Cloudflare
www.phoronix.com
external-link
alert-triangle
You must log in or register to comment.
  • TheGrandNagus@lemmy.world
    link
    fedilink
    English
    arrow-up
    36
    ·
    4 months ago

    Fully open and accessible: Fully open-source release of model weights, training hyperparameters, datasets, and code, fostering innovation and collaboration within the AI community.

    That’s actually pretty good. Seems to be open source as the OSI defines it, rather than the much more common “this model is open source, but the dataset is a secret”.

  • HappyFrog@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    6
    ·
    4 months ago

    I see all these graphs about how much better this LLM is than another, but do those graphs actually translate to real world usefulness?

    • just_another_person@lemmy.world
      cake
      OP
      link
      fedilink
      English
      arrow-up
      8
      arrow-down
      2
      ·
      4 months ago

      I think more of the issue is what constitutes actual open source. This is actually open source, and it performs well. If you’re familiar with the space, then it’s a big deal.

      • HappyFrog@lemmy.blahaj.zone
        link
        fedilink
        English
        arrow-up
        3
        ·
        edit-2
        4 months ago

        I see, thank you.

        Damn, they even chose a dataset with a open license.

      • Possibly linux@lemmy.zip
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        1
        ·
        edit-2
        4 months ago

        Is it really or is it just a binary release like everything else?

        Edit: It is actually Foss

        • just_another_person@lemmy.world
          cake
          OP
          link
          fedilink
          English
          arrow-up
          4
          ·
          4 months ago

          Everything is explained and linked in the project, so…

          • Possibly linux@lemmy.zip
            link
            fedilink
            English
            arrow-up
            2
            ·
            4 months ago

            Yeah I noticed that after writing this. Really cool stuff

    • oldfart@lemm.ee
      link
      fedilink
      English
      arrow-up
      1
      ·
      4 months ago

      I have yet to see a 3B model that’s not dumb.

  • penquin@lemm.ee
    link
    fedilink
    English
    arrow-up
    3
    ·
    4 months ago

    Thank god for this. Setting up deepseek to utilize my AMD GPU through llama was near impossible

  • GaMEChld@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    edit-2
    4 months ago

    Smart people, I beg of thee, explain! What can it do?

    Edit: looks to be another text based one, not image generation right?

    • just_another_person@lemmy.world
      cake
      OP
      link
      fedilink
      English
      arrow-up
      5
      arrow-down
      1
      ·
      4 months ago

      It’s language only, hence, LM

      • GaMEChld@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        4 months ago

        To be fair, I didn’t know if that language included programming language, and thus maybe still consider image based AI to be included in LLM. Is there a different designation for the type of AI that does image generation?

        • just_another_person@lemmy.world
          cake
          OP
          link
          fedilink
          English
          arrow-up
          3
          ·
          4 months ago

          Yes: https://www.hachi-x.com/en/single-post/differences-between-llm-vlm-lvm-lmm-mllm-generative-ai-and-foundation-models

          • GaMEChld@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            4 months ago

            Nice, thanks!

  • Rando@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    1
    ·
    4 months ago

    Got it up and running on a Debian distrobox… now I need to figure out how to train it. Will be my first steps into this type of thing – so prob will take me a bit to figure out how it all works

  • werefreeatlast@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    arrow-down
    5
    ·
    4 months ago

    It knows everything about everything you ever received by mail from your local grocery store.

    Can it learn my local database of PDF books I illegally downloaded years ago? No!

    That’s right! Isn’t it great?

    • just_another_person@lemmy.world
      cake
      OP
      link
      fedilink
      English
      arrow-up
      4
      arrow-down
      1
      ·
      4 months ago

      Huh?

Linux@lemmy.world

linux@lemmy.world

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !linux@lemmy.world

Welcome to c/linux!

Welcome to our thriving Linux community! Whether you’re a seasoned Linux enthusiast or just starting your journey, we’re excited to have you here. Explore, learn, and collaborate with like-minded individuals who share a passion for open-source software and the endless possibilities it offers. Together, let’s dive into the world of Linux and embrace the power of freedom, customization, and innovation. Enjoy your stay and feel free to join the vibrant discussions that await you!

Rules:

  1. Stay on topic: Posts and discussions should be related to Linux, open source software, and related technologies.

  2. Be respectful: Treat fellow community members with respect and courtesy.

  3. Quality over quantity: Share informative and thought-provoking content.

  4. No spam or self-promotion: Avoid excessive self-promotion or spamming.

  5. No NSFW adult content

  6. Follow general lemmy guidelines.

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 1 user / day
  • 303 users / week
  • 947 users / month
  • 2.92K users / 6 months
  • 1 local subscriber
  • 11.8K subscribers
  • 399 Posts
  • 1.61K Comments
  • Modlog
  • mods:
  • MigratingtoLemmy@lemmy.world
  • BE: 0.19.8
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org