Slightly Off the Mark

Have you heard about the “feed this document to an LLM, it’ll generate a podcast episode discussing it” gimmick?

Somebody fed it a document that’s just the phrase “poopoo peepee” over and over. And then took the discussion of that document, and fed it back into the LLM to discuss that. And then did it again. That link is to a 10-episode playlist. (…They’re only between 6 and 15 minutes long, so it’s not as much content as you’d think.)

It’s as stupid as it sounds — which makes it the perfect demonstration of “how LLMs will take anything, even the dumbest nonsense, and generate a response that has the vibe of something meaningful.” The recursion reveals even more levels of this. I swear every single video has included some version of “it reminds me of the absurdity of Dadaism”…and none of them acknowledge “the video we’re analyzing said it reminded them of Dadaism”…and they’re always repeating the same 2 basic facts about Dadaism.

(Bonus: the software always pronounces it “Day-day-ism” or “Daddy-ism”.) (Bonus 2: At least one of the videos inserts a fake ad break.)

There’s some hallucination, too. The TTS voices start referring to things like “funny sound effects” and “dramatic zooms”, which do not exist at all in the video they’re “analyzing.” One video says “Do we even really know what the original document said anymore?” (Yes. Yes, we do.) There are at least three variations of “it makes me think of apophenia, have you ever heard of that?” / “No, what does it mean?” when they’re supposedly “discussing” a video where apophenia was brought up and defined.

This is almost as good as the Chatbot Chess Championships 2026. (Which had a lot fewer random nonsense moves than the last one…but in one of the videos GothamChess mentions that he’s been “reminding the bots where their pieces are.” Boo.)

–

The rest of this is just a roundup of bots faceplanting in non-chess fields:

“I decided to do an experiment/torture myself with the default image model you get when you open Gemini. The prompt: “create a grid showing the flags of european countries in alphabetical order. there should be labels below them stating their name. the one for Liechtenstein should have a note below it saying “doubly-landlocked”.”“

“What really happened was that someone who is fully equipped to know better was surprised when her AI agent — a class of software that does not work reliably and cannot work reliably — messed up. […] This is not a misfortune befalling some random person — this is the director of AI alignment at Meta.”

“Amazon is absolutely clear who’s to blame for all this — this 13-hour outage caused by their own bot turning something off and on again is officially user error!“

“Press Start Gaming is almost certainly a tool for making money off of ads and sponsored posts, and posts like the Phantasy Star Fukkokuban misinformation exist mostly to give the site more juice of looking like a real website. If someone goes out and buys a copy of Fukkokuban expecting a new and improved Phantasy Star with better graphics and new sidequests, what do they care? The article wasn’t really meant to provide information.”

“It finally became clear to me and the COYOTE team that we’d been bamboozled. Someone had fabricated an identity and put our call for pitches into a large language model like ChatGPT, just to make a fake story that we’d feasibly pay for. When I started asking too many questions, that someone evaporated.“

“Even entire passwords repeat: In the above 50 attempts, there are actually only 30 unique passwords. The most common password was G7$kL9#mQ2&xP4!w, which repeated 18 times, giving this specific password a 36% probability in our test set.”

The Onion: “HmmAI is at the bleeding edge of artificial intelligence, responding to prompts about recipe ideas, ancient history, or even advanced nuclear physics with the word ‘huh’ in just a fraction of a second.”

Final post of reactions to The Rose Field. Spoilers throughout. Previous HDM-related posts on DW; see also The Reaction Posts of Dust on AO3.

Illustrated with TV-series screencaps again. Also, I decided to be self-indulgent and throw some of my own fanart in there.

I have a large but poorly-organized heap of “ideas about How To Fix These Books.” Might round those up and make a post about them at some point? TBD. For the main liveblog of the trilogy itself — this wraps it up.