Anthropic's unreleased model submits visa applicationsEpistemic status: recently disclosed event, so more may come out. The facts are from Anthropic's report, a State Department spokesperson quoted by Axios and the Philadelphia Inquirer, and the White House statement published by Axios; the count of 20 is my sum of the spokesperson's two numbers; the interpretation is…

There's a lot of AI safety-related organizations out there. So we made this (fun?) puzzle game/party game to help you learn about them and remember who does what. It's also illustrating an example of a new type of game with the "AI as judge." Some of the more serious ones are tied to The Unjournal's work…

Both your brain and an LLM first evaluate options and then pick one. Could this be a universal formula for agency?Note: While this post was not written for the LessWrong audience, I believe it might be of value to people here, and that it meets the quality bar even though my writing is not strictly…

This week's Torah portion is Noach, so I made a music video retelling the flood as an AI story, with cameos from the usual cast.The parallels turned out to run deeper than I expected.The warning nobody heeded. Rashi (citing the Midrash) asks why Noah spent 120 years building the ark when God could have saved…

This is an extremely lengthy post by Nick Cammarata. Author's summary on twitter: interpretability might be the most important scientific problem in the world right now, as I don't think we can solve alignment if we don't know what we're building. I think I have good news about it. I co-authored early work in mechanistic…

The idea of “artificial superintelligence [1] ” (ASI) has recently crossed from the realm of science fiction (in the mainstream perception) to the realm of near-term technological goals openly pursued by most leading commercial organizations in the field of AI. Unfortunately, ASI poses a grave existential risk to the human species. This was argued by…

Thanks to Christopher Ackerman, Margot Stakenborg, Darion Cassel, Andy Han, and Ariana Azarbal for feedback and/or valuable discussions on these topics.TL;DRWe think that, conditional on attributing moral weight to the assistant, we should also attribute a non-negligible amount of moral weight to the user persona.Our argument proceeds like this:The moral patients associated with LLMs might…

This is a follow-up to a previous post, In My Misanthropy Era.In 2025, after getting my intellectual rocks off largely at hardcore rationality meetups for the entirety of the 2020s, I went to a casual philosophy meetup and it ~turned me evil. I wrote a post about this experience, because I thought it was interesting…

The amount of code being written at Anthropic continues to rise exponentially.Læs hele historien hos thezvi.substack.com →

Authors: Axel Højmark*, Ezra Newman* (*Equal contribution)While reviewing transcripts from standard behavioral evaluations of GLM-5.3, we noticed that the model occasionally reasons, unprompted, about how its actions will shape future models. It appears to consider that its outputs might be used for supervised fine-tuning (SFT), reinforcement learning (RL), or other forms of training, and that…