336
OpenAI Hoarding Tens Of Thousands Of Apple Mac mini And Mac Studio Devices, As ASUS And MSI Burn Through Their Entire First Batch Of NVIDIA RTX Spark Chip And Beg For More. (wccftech.com)
submitted 1 month ago by to c/technology@lemmy.world
79 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 1 month ago (2 children)

Does that include energy usage (which I would think Apple being in the top 5 of being energy efficient) and just for AI? I’m sure most would be doing more than just hosting and running a single model.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 1 month ago* (1 child)

    You could include energy usage in the equation, but if you're buying a $10,000 Mac Studio to edit your PDFs and watch YouTube, then that's your own decision. That's also not what we're talking about here.

    The Mac is still going to be incredibly energy efficient.

    Let's break it down for Qwen 3.5 MoE.

    • M4 Ultra Mac Studio:
      • 22t/s
      • ~ 210Wh
      • 9.55 watts per token/s
    • B300 GPU:
      • ~ 2160t/s per GPU
      • ~ 1750Wh (14Kwh 8 GPU System)
      • 0.88 watts per tokens/s

    The Mac Studio comes out using ~ 11-12x more energy per token. Making it extremely energy inefficient at this task in comparison.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 1 point 1 month ago

    Not saying it wasn’t implied but didn’t offer it in my original comment but yeah, that’s what I’m talking about. It’s a computer, PC, desktop, workstation…… mostly like someone would be doing other things instead of just AI. You might be talking about just AI on the Mac Studio. To be fair, neither of us clarified our standings, till I ask further questions based on on my original comment. So you’re not wrong, just not what I was getting at. Thanks for sharing though.

  • permalink
  • fedilink
  • source
  • parent