---
title: "When the same gradient keeps appearing across several checkpoints, the writers interpret it as… — the writers — DecisionGateway"
description: "statement by the writers, recorded recently — verbatim quote and source citation."
canonical_url: "https://dgw.tmarket.io/claims/01a1e1f6-8f5d-7c1b-85c7-28a8997d5012"
meta:
  "og:description": "statement by the writers, recorded recently — verbatim quote and source citation."
  "og:image": "https://dgw.tmarket.io/og.jpg"
  "og:image:alt": "White network of connected nodes crossed by a timeline on black"
  "og:image:height": "1024"
  "og:image:width": "1024"
  "og:title": "When the same gradient keeps appearing across several checkpoints, the writers interpret it as… — the writers — DecisionGateway"
  "twitter:image": "https://dgw.tmarket.io/og.jpg"
---

> Index of every page on this site: [llms.txt](https://dgw.tmarket.io/llms.txt)

statement

# **When the same gradient keeps appearing across several checkpoints, the writers interpret it as "demand" that SGD fails to supply.**

A statement by the writers. Statements are as reported by the cited publishers — not verified by DecisionGateway.

> *כשאותו גרדיאנט ממשיך להופיע לאורך כמה צ'קפויונטס, הכותבים מפרשים אותו כ"ביקוש" ש-SGD לא מצליח לספק.*

mathyaiwithmikePublished 2026-11-08 [ Read source](https://t.me/mathyaiwithmike/1306)

## **Discussion**

## **Related claims**

[**To know where to implant, the agent computes the loss gradient for each token according to its representation in each layer.**post author · statement](https://dgw.tmarket.io/claims/01a1e1f6-8f4f-7234-a827-16c47834e007) [**When decomposing the standard MTP gradient (trained with standard Cross-Entropy), two opposing forces are hidden inside: a useful self-distillation signal and a residual noise component.**post author · statement](https://dgw.tmarket.io/claims/01a1e1ee-c9b5-7ec8-958e-20cbda9fe423) [**Large AI labs train models with MTP, but 80% of the gradient they backpropagate to the model is static noise that interferes with learning.**post author · allegation](https://dgw.tmarket.io/claims/01a1e1ee-c8cc-76f8-a0cf-fdc0d5c6fade) [**Each implanted layer is multiplied by a learned gate initialized to zero; at the moment of implantation the network does not change at all, and the gradient descent decides whether to open the gate.**post author · statement](https://dgw.tmarket.io/claims/01a1e1f6-8f6a-7096-8c31-22b8c40596c3) [**Soft-MTP obtains the same gradient for free by a simple subtraction between gradients already computed, instead of computing KL from scratch (which requires a lot of memory).**post author · statement](https://dgw.tmarket.io/claims/01a1e1ee-ca55-7120-bcef-603814df663d) [**Diffusion training is relatively simple regression — 'here is a noisy image (letter), guess the noise' — with no need for negative examples and no normalization constant to compute, which is why it is stable and scalable.**post author · statement](https://dgw.tmarket.io/claims/01a1e1f3-ce5b-7449-a89d-6dd21b639986)

[All claims](https://dgw.tmarket.io/claims)

```json
{"@context":"https://schema.org","@graph":[{"@id":"https://dgw.tmarket.io/#website","@type":"WebSite","description":"Decisions, events and falsifiable forecasts from 4,500+ Telegram channels — every claim cited. Read free.","name":"DecisionGateway","url":"https://dgw.tmarket.io/","publisher":{"@id":"https://dgw.tmarket.io/#identity"}},{"@id":"https://dgw.tmarket.io/claims/01a1e1f6-8f5d-7c1b-85c7-28a8997d5012#webpage","@type":"WebPage","description":"statement by the writers, recorded recently — verbatim quote and source citation.","name":"When the same gradient keeps appearing across several checkpoints, the writers interpret it as… — the writers — DecisionGateway","url":"https://dgw.tmarket.io/claims/01a1e1f6-8f5d-7c1b-85c7-28a8997d5012","breadcrumb":{"@id":"https://dgw.tmarket.io/claims/01a1e1f6-8f5d-7c1b-85c7-28a8997d5012#breadcrumb"},"isPartOf":{"@id":"https://dgw.tmarket.io/#website"},"potentialAction":[{"@type":"ReadAction","target":["https://dgw.tmarket.io/claims/01a1e1f6-8f5d-7c1b-85c7-28a8997d5012"]}]},{"@id":"https://dgw.tmarket.io/#identity","@type":"Organization","name":"DecisionGateway","url":"https://dgw.tmarket.io"},{"@id":"https://dgw.tmarket.io/claims/01a1e1f6-8f5d-7c1b-85c7-28a8997d5012#breadcrumb","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","name":"Home","item":"https://dgw.tmarket.io","position":1},{"@type":"ListItem","name":"Claims","item":"https://dgw.tmarket.io/claims","position":2},{"@type":"ListItem","name":"When the same gradient keeps appearing across several…","position":3}]},{"@id":"https://dgw.tmarket.io/claims/01a1e1f6-8f5d-7c1b-85c7-28a8997d5012#/schema/quotation/1","@type":"Quotation","dateCreated":"2026-11-08","isBasedOn":"https://t.me/mathyaiwithmike/1306","text":"כשאותו גרדיאנט ממשיך להופיע לאורך כמה צ'קפויונטס, הכותבים מפרשים אותו כ\"ביקוש\" ש-SGD לא מצליח לספק.","url":"/claims/01a1e1f6-8f5d-7c1b-85c7-28a8997d5012"}]}
```

## Sitemap

See the full [sitemap](https://dgw.tmarket.io/sitemap.md) for all pages.
