Sam Altman:

A lot of people want local inference, and somehow they assume that the problem is solved now because we have open-source models, we're going to be able to run them on our computers, and so we're not going to need all the stuff in the data center.

But from a global allocation perspective, actually it's quite terrible to have everybody, like, have a bunch of the world's limited supply of DRAM sitting in their own computer and being used five percent of the time.

Like you want maximum utilisation in the cloud if you're trying to deal with this very supply-constrained environment,

And somehow many people's intuition is the opposite of that

TL;DR Guy selling product: "Here's why owning your own product instead of renting it from me is a terrible idea"

top 50 comments

sorted by: hot top controversial new old
[–] 10 points 10 hours ago

This fucking guy needs to suck a tailpipe

  • source
  • [–] 7 points 10 hours ago*

    Sam Altman is an example of a terrible allocation of resources. Think of how much oxygen and dihydrogen monoxide he consumes? And for what? He just needlessly produces carbon dioxide in record amounts. The elementary particles that make up the sack of biotic matter that calls itself Samuel would be better suited for other applications. Agriculture comes to mind.

  • source
  • [–] 7 points 10 hours ago

    Altman existing is a terrible waste of resources

  • source
  • [–] 5 points 10 hours ago

    Why does this 41 year old man speak the valley girl accent?

  • source
  • [–] 5 points 11 hours ago* (last edited 6 hours ago)

    Don't fucking talk to me about scarce resources, billionaire.

  • source
  • [–] 2 points 10 hours ago (1 child)
  • [–] 20 points 17 hours ago

    letting sam altman (or billionaires for that matter) have all the money from our work is a poor allocation of resources.

  • source
  • [–] 6 points 17 hours ago (5 children)

    It's true what he says and not just about RAM but about anything you own.

    My car isn't driving most of the time. My drill isn't drilling most of the time and my oven is off most of the time.

    That's a huge waste of resources in a macro economic kind of way.

    You can't argue with the correctness of his statement. You need other arguments. These arguments exist.

  • source
  • hideshow 5 child comments
  • [–] 3 points 10 hours ago (1 child)

    Defending that an argument CAN be true in an extremely narrow subset is an example of a really stupid argument, and only highlights the stupidity of the original argument.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 3 points 11 hours ago

    You can’t argue with the correctness of his statement. You need other arguments. These arguments exist.

    Here's a counterargument: The resources wouldn't be scarce if his company didn't buy all of it for exetremely questionable gain. (Three years into the bubble, and AI compute is still being sold at a subsidized rate. You'd think if enough genuine demand existed to justify the buildout, you'd have to pay dearly for any AI use.

  • source
  • parent
  • [–] 5 points 17 hours ago

    Finally coming out of the bloody closet. Frontier labs and Nvidia are in death dance.

    The latter sells mostly to the former, but their growth story needs local inference to keep up with valuation. Nvidia could reduce prices on a whim and boost local inference, but that would make its investment in frontier labs lose too much.

    Frontier labs meanwhile need public markets money, and their story really needs local inference to be more expensive/extremely worst than what they offer.

    One narrative takes money away from.one side and puts it in the pockets of the other.

  • source
  • [–] 28 points 1 day ago (2 children)

    And who made those resources scarce, Sam? WHO MADE THEM SCARCE???

    also screw you for trying to make the answer to 'How should those resources be allocated?' be 'In the way that best enriches me personally'.

  • source
  • hideshow 2 child comments
  • [–] 15 points 1 day ago (1 child)

    Please don't run AI for free on your own workstation 😭 it's a very bad use of your computer 😥

  • source
  • hideshow 1 child comment
  • [–] 5 points 20 hours ago

    But buying up the world's silicon wafers that you don't even have the ability to turn into chips is a much better use of resources, right Sammy?

  • source
  • Fuck you, Sam.

  • source
  • [–] 12 points 1 day ago (1 child)

    you are not getting it, if I have all the ram and I'm just going to charge you the amount I decided for you to be able to perform the most mundane tasks, I can't believe you are not grasping the benefits of this business model

  • source
  • hideshow 1 child comment
  • [–] 5 points 22 hours ago (1 child)
  • [–] 13 points 1 day ago

    Never felt so proud to have a Local LLM in my router, yes my router of all things... my router which is an old and downgraded Mac Mini I had lying around.

  • source
  • [–] 16 points 1 day ago* (1 child)

    "Raping your own siblings at home is terribly inefficient when we have private islands where we can keep and rape other people's siblings."

  • source
  • hideshow 1 child comment
  • [–] 10 points 1 day ago

    "OpenRape automates your raping needs in efficient and industrialized format. Our rapecenters will be built around the country to support the growing number of rape requests. We train our rape agents on real life input (wars etc.). You can be sure they never go rogue (unless we prompt them to)."

  • source
  • parent
  • [–] 19 points 1 day ago (1 child)

    Fucking idiot is too stupid to realize that local DRAM can be used for useful shit, as opposed to whatever he wants to use it for.

  • source
  • hideshow 1 child comment
  • load more comments (1 reply)
    [–] 23 points 1 day ago (2 children)

    Fuck this loser piece of shit

  • source
  • hideshow 2 child comments
  • load more comments (2 replies)
    [–] 15 points 1 day ago

    Yeah no. I will hoard all the computing resources I can. Fuck you Altman.

  • source
  • [–] 10 points 1 day ago

    There is a national park in Kentucky called Blue Heron that has an outdoor museum of a company owned coal town. Residents were paid in scripts that could only be spent at the company store. Once the lands resources were taken, the company moved on and the town died. This is the America the wealthy always wants. https://www.nps.gov/biso/learn/historyculture/blueheron.htm

  • source
  • [–] 17 points 1 day ago

    we lost Captain Picard yesterday, yet this lazy-eyed cardboard human gets to keep using oxygen. there is no justice in this world.

  • source
  • [–] 22 points 1 day ago

    CEO of Pizza Hut says making pizzas at home is a terrible allocation of resources.

  • source
  • [–] 45 points 1 day ago (2 children)

    Sam Altman is a terrible utilization of scarce resources.

    I want to use ram for things unrelated to AI you fucking prick.

  • source
  • hideshow 2 child comments
  • load more comments (2 replies)
    [–] 21 points 1 day ago

    Guy selling product: “Here’s why owning your own product instead of renting it from me is a terrible idea”

    Guy with the spying infrastructure in place to steal your product when renting his product, says you escaping his ability to spy is waste of resources.

  • source
  • [–] 22 points 1 day ago

    actually it's quite terrible to have everybody, like, have a bunch of the world's limited supply of DRAM sitting in their own computer and being used five percent of the time.

    Why is it terrible for us plebeians to have our own RAM, huh?

    Like you want maximum utilisation in the cloud if you're trying to deal with this very supply-constrained environment

    WHY IS IT SUPPLY-CONSTRAINED, ALTMAN? WHY IS THERE CURRENTLY A RAM SHORTAGE IN THE FIRST PLACE?!?

    Nobody wants the fucking cloud and that's why major tech companies are forcing it on them without asking, and burying the opt-out if it's offered at all.

    And somehow many people's intuition is the opposite of that

    Gee I wonder why our intuitions don't align with your "Give me everything and have nothing" philosophy...

  • source
  • [–] 13 points 1 day ago

    Oh BROTHER this does this guy suck!

  • source
  • [–] 36 points 1 day ago* (3 children)

    A lot of people want local inference, and somehow they assume that the problem is solved now because we have open-source models, we’re going to be able to run them on our computers, and so we’re not going to need all the stuff in the data center.

    We don't need them even without local inference. There was already more than enough total global compute for the most valuable use cases of LLMs (research, development, admin). The datacenter build-up is almost entirely fueled by utterly unrealistic expectations of future capabilities. Before and now the case for local inference is a matter of access, not capacity.

    But from a global allocation perspective, actually it’s quite terrible to have everybody, like, have a bunch of the world’s limited supply of DRAM sitting in their own computer and being used five percent of the time.

    Utilitarianism like this is a disease. By the same logic, it's inefficient that we allow other species of animals to exist and consume usable energy. Hell, why stop at other species? It's inefficient to allow humans to exist - let's kill all humans!

    Now, I know that's not what he said, the point was to show that when someone uses utilitarianism as a serious argument, they are no longer worth listening to.

    Like you want maximum utilisation in the cloud if you’re trying to deal with this very supply-constrained environment,

    The supply is only constrained because you keep hoarding more than you need. Maybe it's time for some communization? So communities where data centers are built get most if not all of the profits from it?

  • source
  • hideshow 3 child comments
  • load more comments (3 replies)
    [–] 20 points 1 day ago

    Shovel seller vehemently against you building your own shovel

  • source
  • [–] 35 points 1 day ago*

    new title:

    "Man whose company lost $20b in previous year explains how to allocate resources."

  • source
  • [–] 93 points 1 day ago* (last edited 1 day ago) (5 children)

    A lot of people want to be billionaires, and somehow they assume the problem is solved because we have unfettered predatory late stage capitalism and oligarchy in America, we're going to be able to amass as much money as we want in our bank accounts, and so we're all going to be rich without oversight, accountability or government interference.

    But from a global allocation perspective, actually it's quite terrible to have everybody, like, have a bunch of the world's wealth sitting in a few private bank accounts and being used .05% of the time.

    Like you want maximum circulation of currency if you're trying to reduce inequality in this artificial scarcity environment,

    And somehow, Americans' intuitions are the opposite of that.

    FTFY Sam.

  • source
  • hideshow 5 child comments
  • load more comments (5 replies)
    [–] 40 points 1 day ago

    That's insanely ironic coming from him. Meanwhile the crazy amount of waste that these companies are producing buying all the GPUs to create artificial scarcity. They are terrified of people being able to run their own local LLMs because it completely destroyed their entire business model, they will never be profitable.

  • source
  • [–] 11 points 1 day ago (2 children)

    This IS the same argument use for why trains are better then cars.

    Maybe your infra needs to become public domain then Sam :)

  • source
  • hideshow 2 child comments
  • [–] 11 points 1 day ago (1 child)

    It's basically just the argument for socialism, but perverted so that HE owns and controls everything instead of the people/state.

    Monolithic control over an industry in the name of efficiency is only possible with checks and balances to keep it running in the public interest. Otherwise it's just a monopoly.

    I'm all for building up high speed rail in the US, but if we were going to give Sam Altman a blank check to do it, no fucking thanks

  • source
  • parent
  • hideshow 1 child comment
  • load more comments (1 reply)
  • load more comments
    view more: next ›