523
Other AI Companies Should Be Very Afraid of What Just Happened to Character.AI, According to Its Own Bankruptcy Documents: Be afraid. (futurism.com)
submitted 6 days ago by to c/technology@lemmy.world
162 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 4 points 6 days ago (4 children)

If LLMs can’t be made more power efficient, then the technology isn’t ready yet for general use.

Hm, I don't see the harm in powering local models with solar.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 5 points 6 days ago (2 children)

    Depends. Is it solar energy that started production to power these models? Great! If not, then you're still consuming power and the difference will have to be made somewhere, likely by burning more fossil fuels.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 5 points 6 days ago (1 child)

    Oh yeah, I mean my own personal solar modules in my backyard. I agree it's not that easy to say "solar exists, checkmate doubters", that would be silly.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 2 points 6 days ago

    Well that is an alternative. But I bet each query to a local 27b model takes less energy anyway than the same query to Claude Opus or Fable in some data centre. So it is also a case of improving energy efficiency by running smaller models.

  • permalink
  • fedilink
  • source
  • parent