GamingChairModel comments on OpenAI Hoarding Tens Of Thousands Of Apple Mac mini And Mac Studio Devices, As ASUS And MSI Burn Through Their Entire First Batch Of NVIDIA RTX Spark Chip And Beg For More.

[–] GamingChairModel@lemmy.world 11 points 1 month ago (6 children)

I don't understand why Rosetta has to be involved in any way at all.

Apple provides APIs for programming low level GPU instructions, including AI workloads, on their chips, using the Metal API. Anyone interested in using Apple hardware to its full potential can just write Mac-native software, same as any other MacOS native software directly compiled as binaries to run on Mac M series chips. No Rosetta required for translating x86 instructions to ARM, when the whole thing compiles for Apple's native instructions in the first place.

permalink

fedilink

source

parent

hideshow 6 child comments

[+] eurodyne@piefed.world -6 points 1 month ago* (5 children)

Uhh, you’re skipping a few steps

Steps that either would not work between architectures or that Rosetta would handle (thereby answering your own question)

And I’m not here to teach a computer science class

permalink

fedilink

source

parent

hideshow 5 child comments

[–] GamingChairModel@lemmy.world 8 points 1 month ago (1 child)

Steps that either would not work between architectures or that Rosetta would handle (thereby answering your own question)

What? They would compile the code that they control for the M-series architectures. The target architecture is M-series ARM chips running on MacOS.

Rosetta is for translating x86 to ARM. Which wouldn't be necessary because there are no x86 binaries involved at all.

permalink

fedilink

source

parent

hideshow 1 child comment

[–] eurodyne@piefed.world 1 point 1 month ago*

Oh, I guess you’re right about that

My mistake

permalink

fedilink

source

parent

[–] brucethemoose@lemmy.world 3 points 1 month ago* (last edited 1 month ago) (2 children)

No, @GamingChairModel@lemmy.world is right.

What does Rosetta have anything to do with what OpenAI needs? Machine learning on Macs is done in MLX or something else with Metal, running OSX. Most agenic frameworks or other ML-related infrastructure are just Python, or open code that can compile on OSX/Macs just fine. In fact, OSX is often the first target platform.

This even includes inter-node frameworks for clustering Macs together.

No one doing "AI" on Macs is using Rosetta. There's no point, and its a bad idea. They're doing everything in OSX, which works fine, and I can't imagine what OpenAI would be doing with them that wouldn't work in OSX.

But maybe I'm missing what you're implying here. And I'm sorry to come off as thorny, but condescending comments like "I’m not here to teach a computer science class" rub me the wrong way.

permalink

fedilink

source

parent

hideshow 2 child comments