• 0 Posts
  • 49 Comments
Joined 2 years ago
cake
Cake day: November 7th, 2023

help-circle

















  • for AI inference (generally hardware agnostic, which is different than AI training, which is heavily CUDA based) favors vram. Digits has to compete against both apples m series chips at max ram capacity, as well as the recently announced AMD Strix Halo devices, which come with up to 128 GB shared ram.

    A fully kitted out Strix Halo device with 128gb ram is 2000$, a fully kitted out Mac Studio with 128GB ram is just under 5000$. Nvidia claims it starts at 3000$, so finding out the 128gb cost is still in the air.