[–] 8 points 15 hours ago (1 child)

Doubt many organizations have failed as badly at their goals as LW/EA has recently.

They are/were too weird for people to never notice.


The "safeguards" espoused by this crowd, always seemed to me to be more philosophical/spiritual than practical anyway, the most "orthodox" view is that no training is safe since the AI could discover magic and the cheat codes to the universe, so even air-gapping would be insufficient, in that view any participation in development must come with a hefty dose of cognitive dissonance.

On a more pragmatic note, I would note that even short of Intelligence, those incidents highlight those tools are still dangerous, and since they are unconstrained and ill-defined, can produce surprising outcomes especially if you throw lot's of inference time (money) at them.

There isn't really a universe where bots have both access to the internet (user input, both in training and live) and a collection of build/cli tools (which can run said untrusted user input), while being guaranteed to be harmless. It's like a grand automation of some of the worst engineering practices.

I find the "reasoning about the test environment" parts often included in write up of the hugging-face incident to be highly credulous, And I would be extremely surprised if not all the information was included in the task prompt (which also explains chosen usernames as "Open AI researcher #1" and so on.) It's the ELIZA/parrot thing, acting surprised "How did it guess?!?", when all of the info was provided.


I'm not entirely encouraged by the latest batch of sex-cult smearing (well mostly accurate) they are receiving at the WH, since it's probably just an expedient way of dismissing their voice, without addressing the larger issues of AI, hence probably in service of pushing forwards with AI.

  • source
  • parent
  • context
  • [–] 3 points 1 week ago

    I wonder if there's a market for RevivingYahoo^TM^, which in some ways was more link curation than search engine.

    When searching for examples of commands, I've sometimes been resorting to telling google to restrict itself to pdf files of specific websites (example redhat, with sometimes useful commands for server maintenance broadly)

    It's a bit sad that it's not just search that has gone downhill, but new documentation too (I swear Microsoft Azure documentation is getting worse).

  • source
  • parent
  • context
  • [–] 11 points 1 month ago (1 child)

    The quirkiness of the Tranquility Calendar is mildly beautiful, between the second man on the moon getting snubbed with the every four year leap day (which for no good reason still happens around Feb 29!), [I guess Collins gets even more snubbed by not appearing at all] to the more diverse than expected list of honored "scientists/scholars", until you realize the main reason is just to keep the ABCD naming pattern for the months.

  • source
  • parent
  • context
  • [–] 14 points 1 month ago (1 child)

    I was thinking "Hey I want that markdown!" (although maybe not for time magazine), but the actual example is dystopian.

    If you want to stare at the abyss it's achievable with curl -H 'user-agent: ClaudeBot' https://url_to_article, and it's like 70% SEO crap tailored to brainwash LLMs (more realistically "agents" in limited context).

  • source
  • [–] 3 points 1 month ago

    I think he falls under the category of "does too much all the time" and "vaguely techo optimist" which definitely put him at risk. I'm not too sure how harshly I should judge him yet, I guess it depends on what he does next.

  • source
  • parent
  • context
  • [–] 18 points 4 months ago* (last edited 4 months ago) (15 children)

    Encyclical from the pope about the dangers of AI, mostly sane actually: (provided link skips quite a bit about social justice and referencing previous literature)

    https://www.vatican.va/content/leo-xiv/en/encyclicals/documents/20260515-magnifica-humanitas.html#Artificial_intelligence

    EDIT, snippets:

    1. We cannot be satisfied with [...] the so-called “alignment” of AI [..] without [..] openly discussing the ethical frameworks involved and subjecting them to shared standards of social justice. Otherwise, those who control AI will impose their own moral vision, which will become the invisible infrastructure of these systems. A more moral AI is not enough if that morality is determined by a few. [...]
    1. [ about post and transhumanism ] From the perspective of the Church’s Social Doctrine, the key issue is not the use of technology as such, but the vision that underlies it. If the human being is treated as something to be perfected or surpassed, it becomes easier to accept that some lives are less useful, less desirable or less worthy. In the name of progress, “necessary sacrifices” may begin to be justified, placing the burden on the most vulnerable in pursuit of a supposed optimization of the species. [...]
  • source
  • [–] 8 points 5 months ago* (last edited 5 months ago)

    Agreed, agreed.

    EDIT: Though as far as ambiguous anarchist utopias go, I think I'd rather live on Anarres in "The Dispossessed", even though the material welfare and personal freedoms are much much lower.

  • source
  • parent
  • context
  • view more: next ›