you are viewing a single comment's thread
view the rest of the comments
[–] 22 points 1 day ago (11 children)

Cool; walk me through attention layers plz.

  • source
  • hideshow 11 child comments
  • [–] 26 points 1 day ago (7 children)

    Yeah. It's some if statements and some loops but with CUDA and matrix multiplication

  • source
  • parent
  • hideshow 7 child comments
  • [–] 13 points 1 day ago (6 children)

    Great; that describes all functions, so we've nothing to worry about.

  • source
  • parent
  • hideshow 6 child comments
  • [–] 24 points 1 day ago (5 children)

    No no we still gotta worry about people in power allowing the worst possible use of technology at everyone's expense for personal gain..

    So same old

  • source
  • parent
  • hideshow 5 child comments
  • [+] -14 points 1 day ago (4 children)

    What specifically do you want the people in power to do?

  • source
  • parent
  • hideshow 4 child comments
  • [–] 17 points 1 day ago (2 children)

    A very good start would be people not having that much power to begin with. Especially not if they’re not democratically elected representatives.

    But for the people in power we’re seemingly talking about (AI company leaders):

    • Not presenting AI as something mystical/mythical
    • Not turning AI into a product tailored to be addictive
    • Not framing AI as a tech only they can be trusted to keep and distribute (see also point 1)
    • Maybe developing the technology towards what gives most utility, not what earns them the most money (fat chance)
  • source
  • parent
  • hideshow 2 child comments
  • [–] 7 points 1 day ago (1 child)

    I just want these AI companies to be held accountable for openly trying to hack everyone. It's ridiculous they're allowed to hide behind "AI did it, not us" as if what their product does isn't their responsibility.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 1 day ago*

    Think of it as a game, the players are corpo, and gov.

    Corpo hacks planet, gov says, "Hm, that's pretty bad corpo, we could hold you accountable.. but.. that's pretty neat, maybe share a lil with us how you achieved this terrible incident (that we totally don't want to leverage against international peers) and we can forget this happened.."

    A game of incentives.

    If the gov comes down too hard, they could slow the development, the same development that they short-sightedly want to exploit in parallel with the accused.

  • source
  • parent
  • [–] 11 points 1 day ago* (1 child)
  • [–] 1 point 1 day ago

    GPT is basically a machine that builds machines.

    We understand how the machine builder works. We don't understand how the output of the machine works. Like mechanically we understand each individual sub-component works e.g. a single matrix multiplication, but we don't understand why specific weights are the value they are, or the broader macrostructure.

    I don't think you realize that acting like "No we actually do understand how it works" just reveals that you don't understand the question, it does not show that the question has an answer.

  • source
  • parent