you are viewing a single comment's thread
view the rest of the comments
[–] 16 points 1 day ago (2 children)

The ones in Russia definitely are. They don't have to be local models - you run them in the cloud like anyone else.

The idea that the frontier labs have LLMs with special capabilities that make them dramatically better than the top open-weight models is largely marketing.

The reality is that most systems are poorly secured, and LLMs make exploiting vulnerabilities fast, cheap, and easy. What would have taken a trained security researcher weeks before can be done by a much less skilled attacker with an LLM in a few hours.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 19 points 1 day ago (1 child)

    This is correct. We can thrash all we want about slop and hallucinations, but from a defensive posture position, the models only need to be right some of the time and they still constitute a threat.

    Knowing it sucks and pretending it doesn’t exist are two different things.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 5 points 1 day ago

    the models only need to be right some of the time and they still constitute a threat.

    Right!?!

    And with how cheap and fast they are to run, they don't have to be right that often as long as a separate run can verify/validate claims. In a lot of ways what the LLMs do should probably be thought of as just a very sophisticated sort of brute force approach. You're effectively just searching the space of combinations of known vulnerabilities. It doesn't require particular cleverness, just an encyclopedic knowledge, a reasonable way to prune the search space, and the ability to put in the compute time.

  • source
  • parent