The backend got infected
Severo's backend keeps 'getting infected': it stores the wrong words. When the model tags which parts of a bilingual reply are in the target language, it sometimes tags a word in the wrong language, and that bad word poisons the vocabulary store, which poisons review, which poisons every minigame stacked on top, everything downstream breaks. The diagnosis is load: asking one LLM call to also decide, live, which of ten thousand tokens is French and which is English is a huge cognitive load, and LLMs hallucinate under it. Juan's move is to take that job off the model entirely and hand it to a deterministic language-identification framework (Lingua), so Severo only has to teach and a separate, rule-based program decides the language. Make the model's life simpler, and the errors that compound stop starting.
// trace: where this idea came from
- ↳ video diary @ 6:45 (el backend se está infectando, guarda palabras en el idioma que no es)
- ↳ video diary @ 7:48 (un load cognitivo altísimo, como pedirle 10.000 cosas a la vez)
- ↳ video diary @ 7:58 (offload a un framework de identificación de idioma, Lingua)
- ↳ Entry 229-1: The lemma is the unit (el almacén de vocabulario que aquí se envenena)
Severo’s backend, Juan says, keeps “getting infected”. The job is to read a reply that mixes the user’s language and the target language and record which words were in the target language, so they can be counted and reviewed. But sometimes it files a word under the wrong language, or stores a stray word from the wrong language entirely, and once that happens the rot spreads ▸ 6:45. A poisoned entry in the vocabulary store poisons the review deck built on it, which poisons every minigame stacked above that, so everything from that point down breaks ▸ 7:16.
una palabra en el idioma equivocado envenena todo lo que viene después →
The diagnosis is load. Right now Severo has to teach the lesson and, in the same breath, decide which fragments of what it just wrote are French. That is a very high cognitive load, like asking someone to hold ten thousand things in mind at once, and LLMs hallucinate under exactly that kind of pressure ▸ 7:48. So the move is to take the job away from the model. A deterministic language-identification framework, Lingua, would look at what Severo wrote and rule “this part is English, this part is French”, and Severo would no longer carry that task at all ▸ 7:58. The general shape is the same one the whole app keeps rediscovering: the model is good at the fuzzy, human part and bad at the crisp, mechanical one, so you hand the crisp part to a program that cannot hallucinate. Make Severo’s life simpler ▸ 8:10, and the errors that compound stop starting…
// continued in
no entry has continued this idea yet: the arc is still open