---
title: "In a regular network, if the model errs, the backprop algorithm stops everything, goes back from… — author — DecisionGateway"
description: "statement by author, recorded 2026-10-31 — verbatim quote and source citation."
canonical_url: "https://dgw.tmarket.io/claims/01a1e1f1-9366-7832-923e-d2896e97aec1"
meta:
  "og:description": "statement by author, recorded 2026-10-31 — verbatim quote and source citation."
  "og:image": "https://dgw.tmarket.io/og.jpg"
  "og:image:alt": "White network of connected nodes crossed by a timeline on black"
  "og:image:height": "1024"
  "og:image:width": "1024"
  "og:title": "In a regular network, if the model errs, the backprop algorithm stops everything, goes back from… — author — DecisionGateway"
  "twitter:image": "https://dgw.tmarket.io/og.jpg"
---

> Index of every page on this site: [llms.txt](https://dgw.tmarket.io/llms.txt)

statementSaid on 2026-10-31

# **In a regular network, if the model errs, the backprop algorithm stops everything, goes back from end to start and updates all the weights; in the brain there is no such central manager, and instead each synapse learns on its own from its local environment using STDP.**

A statement by author, said on 2026-10-31. Statements are as reported by the cited publishers — not verified by DecisionGateway.

> *ברשת רגילה, אם המודל טעה, אלגוריתם הבקפרופ עוצר הכל, חוזר אחורה מהסוף להתחלה ומעדכן את כל המשקולות. במוח אין "מנהל מרכזי" כזה. במקומו, כל חיבור בין שני נוירונים (סינפסה) לומד לבד מהסביבה הקרובה שלו בעזרת מנגנון תלוי-זמן הנקרא STDP*

mathyaiwithmikePublished 2026-10-31 [ Read source](https://t.me/mathyaiwithmike/1298)

## **Discussion**

## **Related claims**

[**Each implanted layer is multiplied by a learned gate initialized to zero; at the moment of implantation the network does not change at all, and the gradient descent decides whether to open the gate.**post author · statement](https://dgw.tmarket.io/claims/01a1e1f6-8f6a-7096-8c31-22b8c40596c3) [**Large AI labs train models with MTP, but 80% of the gradient they backpropagate to the model is static noise that interferes with learning.**post author · allegation](https://dgw.tmarket.io/claims/01a1e1ee-c8cc-76f8-a0cf-fdc0d5c6fade) [**During the backward pass, the MTP residual noise and the NTP residual noise meet with opposite signs and cancel each other out, leaving only the clean self-distillation signal; the result is 0 added memory, 0 impact on token throughput, and full compatibility with Fused kernels.**post author · statement](https://dgw.tmarket.io/claims/01a1e1ee-ca92-7c91-9863-1727b4a888ac) [**The residual component is 4 times noisier than the first term, and is responsible for 80% of the update strength flowing back to the shared trunk; as the model grows it only intensifies and pulls the weights in a direction that interferes with next-token prediction.**post author · statement](https://dgw.tmarket.io/claims/01a1e1ee-c9e3-7b12-b55d-3721312de156) [**The book proves that unifying weights inside the attention mechanism to save memory erases the model's built-in ability to understand direction, order and causality.**the post author · statement](https://dgw.tmarket.io/claims/01a1e1eb-c7e3-7928-919d-d78b93be7f2e) [**Researchers discovered long ago that about 75% of attention heads in a trained model can be deleted and it will keep working almost the same, and the book shows the structural reason: at the end of each layer the model merges all units' insights into one blend, so the next layer receives a 'fruit shake' and cannot know which unit discovered what.**the post author · statement](https://dgw.tmarket.io/claims/01a1e1eb-c746-7456-8138-bfb85325f512)

[All claims](https://dgw.tmarket.io/claims)

```json
{"@context":"https://schema.org","@graph":[{"@id":"https://dgw.tmarket.io/#website","@type":"WebSite","description":"Decisions, events and falsifiable forecasts from 4,500+ Telegram channels — every claim cited. Read free.","name":"DecisionGateway","url":"https://dgw.tmarket.io/","publisher":{"@id":"https://dgw.tmarket.io/#identity"}},{"@id":"https://dgw.tmarket.io/claims/01a1e1f1-9366-7832-923e-d2896e97aec1#webpage","@type":"WebPage","description":"statement by author, recorded 2026-10-31 — verbatim quote and source citation.","name":"In a regular network, if the model errs, the backprop algorithm stops everything, goes back from… — author — DecisionGateway","url":"https://dgw.tmarket.io/claims/01a1e1f1-9366-7832-923e-d2896e97aec1","breadcrumb":{"@id":"https://dgw.tmarket.io/claims/01a1e1f1-9366-7832-923e-d2896e97aec1#breadcrumb"},"isPartOf":{"@id":"https://dgw.tmarket.io/#website"},"potentialAction":[{"@type":"ReadAction","target":["https://dgw.tmarket.io/claims/01a1e1f1-9366-7832-923e-d2896e97aec1"]}]},{"@id":"https://dgw.tmarket.io/#identity","@type":"Organization","name":"DecisionGateway","url":"https://dgw.tmarket.io"},{"@id":"https://dgw.tmarket.io/claims/01a1e1f1-9366-7832-923e-d2896e97aec1#breadcrumb","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","name":"Home","item":"https://dgw.tmarket.io","position":1},{"@type":"ListItem","name":"Claims","item":"https://dgw.tmarket.io/claims","position":2},{"@type":"ListItem","name":"In a regular network, if the model errs, the backprop…","position":3}]},{"@id":"https://dgw.tmarket.io/claims/01a1e1f1-9366-7832-923e-d2896e97aec1#/schema/quotation/1","@type":"Quotation","dateCreated":"2026-10-31","isBasedOn":"https://t.me/mathyaiwithmike/1298","text":"ברשת רגילה, אם המודל טעה, אלגוריתם הבקפרופ עוצר הכל, חוזר אחורה מהסוף להתחלה ומעדכן את כל המשקולות. במוח אין \"מנהל מרכזי\" כזה. במקומו, כל חיבור בין שני נוירונים (סינפסה) לומד לבד מהסביבה הקרובה שלו בעזרת מנגנון תלוי-זמן הנקרא STDP","url":"/claims/01a1e1f1-9366-7832-923e-d2896e97aec1"}]}
```

## Sitemap

See the full [sitemap](https://dgw.tmarket.io/sitemap.md) for all pages.
