"AI is so complex even the developers dont understand it" "looks inside" "if-statement and for-loops" cat stares down at the camera
you are viewing a single comment's thread
view the rest of the comments
[–] 184 points 5 days ago (12 children)

More accurately:
>looks inside
>matrix multiplication

  • source
  • hideshow 12 child comments
  • [–] 28 points 5 days ago (2 children)

    Max(input*weights, 0) is an if in a sense, I guess.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 4 points 5 days ago (1 child)

    Good old ReLU. I've heard that CNN's perform better when using ReLU as the activation func, and that's probably why; ReLU acts as a filter on the image's features.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 9 points 5 days ago

    Nah. Without a nonlinearity you just get a linear combination of inputs instead of the output of a deep neural network. ReLU or Ramp is just the simplest possible non linearity. Using a simple function can enable using deeper networks yielding even better performance.

    It's actually somewhat of a headache, numerically. Works well enough tho.

  • source
  • parent
  • [–] 13 points 5 days ago

    Had one guy asking if AI is conscious. I said the whole thing is actually one very big excel sheet, so does he think that excel can be conscious? Anyway, I think the guy is now in a relationship with office.

  • source
  • parent
  • [–] [S] 14 points 5 days ago (4 children)

    Yes, it is inherently incorrect, I just think that increases the fun factor. It reminds me of that guy who wrote a prime-checker for his thesis and it was just a massive list of if-statement

  • source
  • parent
  • hideshow 4 child comments
  • [–] 5 points 5 days ago (2 children)

    A transistor is on or off. It's all if-then.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 10 points 5 days ago (2 children)

    Matrix multiplication, activation functions and softmax. Also some matrix addition sometimes. That's literally it

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 4 days ago* (last edited 4 days ago)

    I mean yeah, the mechanism itself is straightforward, but isn't a big thing that we don't really know what it chooses for its... basis vectors? Something like that, I don't do programming and I'm out of practice with matrices

  • source
  • parent