image saying "at least the important software isn't being vibe cod-" (cut off) and showing a graph of em dashes in the linux kernel over time with a sharp rise the past few years
you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 3 days ago (8 children)

It would have to use trillions of fewer cpu cycles to do that. Currently scientists estimate it at 8 cups of water consumed for every 100 word prompt. What developer do you know that consumes 8 cups of water a day much less every thirty seconds. A developer can sit there and think with their own mind, computer doing nothing, while an LLM consumes thousands of gallons of water and kilowatts of electricity to do the same thing.

  • source
  • parent
  • hideshow 8 child comments
  • [–] 1 point 3 days ago (7 children)

    It only needs to save a few hundreds of seconds on one computer, or one second on a few hundreds of computers, or a tiny fraction of a second on the number of computers that actually run Linux to save trillions of cycles. A trillion cycles isn't very many at all. A hundred-word prompt on a frontier model running on GPUs in a datacentre burns much more power than a trillion cycles on a CPU, so for a large Linux kernel patch, trillions is the wrong number by many orders of magnitude. There are also a lot of computers spending a lot of time running Linux, so it kind of balances out. There's only one Linus Torvalds, and he's very busy, so it's likely that if he'd not used an LLM to get this work done, it simply wouldn't have happened, even if someone had been willing to fund a different human to do it.

    Either way, the original point of the post was that LLM-generated code is always shitty (even when it's not immediately obvious to whoever's responsible for it that it's shitty) and so having any amount of it already makes things worse, even ignoring the huge environmental cost. With that context, it is the case that there's a huge difference between Timmy and Torvalds as Torvalds is famous for having very high standards, so if he's using it, he might be able to make something that isn't shitty.

  • source
  • parent
  • hideshow 7 child comments
  • [–] 1 point 3 days ago (6 children)

    I didn’t realize you were talking about performance in the kernel, which I think will be incredibly hard to measure. That that’s usually the main focus of enterprise investment into Linux, so I very much doubt that an LLM is coming in and making improvements there, but maybe it’s happening. As far as I can tell all the latest things are security scans, which usually will result in worse performance since the goal isn’t speed but safety.

  • source
  • parent
  • hideshow 6 child comments
  • [–] 0 points 3 days ago (5 children)

    This comment chain is specifically referencing a single LLM-assisted patch that Linus Torvalds posted to the mailing list for review a few days ago that solves a longstanding performance problem that interacts with enough things parts of the kernel that there are only a handful of people in the world qualified to deal with it, and that none of them have had the time to investigate and fix properly until just now. https://www.tomshardware.com/software/linux/linus-torvalds-posts-his-first-llm-assisted-patch-to-the-linux-kernel-after-issuing-clear-pro-ai-directives-the-bossman-makes-use-of-ai-tooling-himself

  • source
  • parent
  • hideshow 5 child comments
  • [–] 1 point 2 days ago (4 children)

    Huh.. no it isn’t. This is literally the first time that’s being mentioned in this comment chain. All the way to the top it is only discussing the em-dashes.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 0 points 2 days ago (3 children)

    It's been headline news (at least by Lemmy standards), so it's a safe bet that Earthwormjim91 was alluding to it when he initially brought up Torvalds, and I was referring to it when I initially brought up optimisation. It wouldn't have been clear to you if you hadn't known about it already, as no one linked an article or said explicitly that that's what they were referring to, but for someone who did, it would have been obvious. You wouldn't expect someone to explicitly say they were referencing Shrek if they said that something had layers or something was sacrifice someone was willing to make when it clearly would only affect other people, and you wouldn't expect someone to explicitly say they were referring to Trump's infamous COVID-era press conference if they mentioned injecting bleach.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 1 day ago (2 children)

    safe bet that Earthwormjim91 was alluding to it when he initially brought up Torvalds

    The image literally is talking about the Linux kernel. Why you would jump to a specific talking point when the post is about the full kernel?

    So no, I think you’re probably the only one thinking this thread was about a specific commit to the kernel.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 0 points 1 day ago (1 child)

    Most of this particular comment chain (and it's the post-Earthormjim comment chain I said was referring to that one patch, not the whole thread) has been you replying to me after I started talking about it, so it's been the topic whether or not it's a non-sequitur from the thread as a whole. When one of the participants in a two-person dialogue thinks something's the current topic, that's enough to make it the topic.

  • source
  • parent
  • hideshow 1 child comment