statementSaid on 2026-10-19
Every LLM is essentially a huge memory store with an extremely sophisticated retrieval mechanism.
A statement by post author, said on 2026-10-19. Statements are as reported by the cited publishers — not verified by DecisionGateway.
כל LLM הוא בעצם מחסן זיכרון ענק עם מנגנון שליפה מתוחכם בטירוף
Discussion
Related claims
In a linear layer, each new memory is simply added to the weights; retrieval returns the correct value plus a bit of every other memory depending on key overlap.post author · statementIn attention the memories do not sit in the weights; every token in the context is a memory, and the store grows as the context lengthens.post author · statementOn neuromorphic chips like Intel's Loihi 2, which physically co-locate memory and compute, LLMs of 370 million parameters run without any matrix multiplications at all, and provide throughput 3.5 times higher relative to energy consumption compared to Edge GPUs.author · statementIn event-driven neuromorphic architectures, memory is adjacent to the processor.מייק · statementIn transformer-based language models and architectures like Mamba, every token prediction requires activating billions of parameters in parallel through the attention mechanism.author · statementAI makes the recovered text easier to read.rtnews · statement