308
Sam Altman says OpenAI will not go public this year as AI fears grow (www.sfchronicle.com)
submitted 2 weeks ago by to c/technology@lemmy.world
82 comments fedilink hide all child comments
 

Archive link: https://archive.ph/U1zEK

you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 1 week ago (4 children)

Maybe not a mobile device, but running decent local models is definitely within reach for the average consumer today by simply adding a GPU with lots of VRAM to their existing PC.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 3 points 1 week ago (3 children)

    I mean yes but those gpus are not necessarily within reach of the average consumer anymore. Even if you got one for a grand which is a lot of money you would have cooling and enclosure costs, possibly additional hardware.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 1 point 1 week ago (2 children)

    Nah I got an RX 6800 XT for $300 with 16 GB VRAM, perfectly cromulent for a 27B model.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •