• brucethemoose@lemmy.world
    link
    fedilink
    English
    arrow-up
    5
    ·
    20 hours ago

    True, though there’s a big output difference between the 7B distil (or even 32B/70B) and the full model.

    And Microsoft does host R1 already, heh. Again, this headline is a big nothingburger.

    Also (random aside here), you should consider switching from ollama. They’re making some FOSS unfriendly moves, and depending on your hardware, better backends could host 14B models at longer context, and similar or better speeds.