---
title: "Diffusion is almost an EBM: the direction diffusion learns is exactly the gradient-descent… — post author — DecisionGateway"
description: "statement by post author, recorded 2026-10-25 — verbatim quote and source citation."
canonical_url: "https://dgw.tmarket.io/claims/01a1e1f3-ce6a-7994-8b63-3d2f141cabfb"
meta:
  "og:description": "statement by post author, recorded 2026-10-25 — verbatim quote and source citation."
  "og:image": "https://dgw.tmarket.io/og.jpg"
  "og:image:alt": "White network of connected nodes crossed by a timeline on black"
  "og:image:height": "1024"
  "og:image:width": "1024"
  "og:title": "Diffusion is almost an EBM: the direction diffusion learns is exactly the gradient-descent… — post author — DecisionGateway"
  "twitter:image": "https://dgw.tmarket.io/og.jpg"
---

> Index of every page on this site: [llms.txt](https://dgw.tmarket.io/llms.txt)

statementSaid on 2026-10-25

# **Diffusion is almost an EBM: the direction diffusion learns is exactly the gradient-descent direction of some energy (in the transition from noisy data to clean), meaning diffusion directly learns the slope of the energy surface and skips the energy itself — the very trick that bypassed the difficulty of training EBMs.**

A statement by post author, said on 2026-10-25. Statements are as reported by the cited publishers — not verified by DecisionGateway.

> *הכיוון שדיפוזיה לומדת הוא בדיוק כיוון הירידה במדרון של אנרגיה (במעבר מדאטה מורעש לנקי) כלשהי. כלומר, דיפוזיה לומדת ישירות את השיפוע של משטח האנרגיה ומדלגת על האנרגיה עצמה. זה בדיוק הטריק שעקף את הקושי באימון EBMs.*

mathyaiwithmikePublished 2026-10-25 [ Read source](https://t.me/mathyaiwithmike/1295)

## **Discussion**

## **Related claims**

[**In EBM one can combine several models simply by adding their energies, giving 'both and', whereas in diffusion this works only approximately.**post author · statement](https://dgw.tmarket.io/claims/01a1e1f3-ce8b-7db7-a2c3-ea2620dcc0f4) [**The problem with EBMs is training: it is not enough to teach the model that real examples have low energy; it must also be taught that everything else has high energy, and that 'everything else' is enormous, which is why EBMs were stuck for years with unstable training and expensive sampling.**post author · statement](https://dgw.tmarket.io/claims/01a1e1f3-ce4b-7960-83c7-fe561635767d) [**Diffusion training is relatively simple regression — 'here is a noisy image (letter), guess the noise' — with no need for negative examples and no normalization constant to compute, which is why it is stable and scalable.**post author · statement](https://dgw.tmarket.io/claims/01a1e1f3-ce5b-7449-a89d-6dd21b639986) [**Alexi Gladstone's tweet is a good opportunity to clarify what an Energy-Based Model is, what a diffusion model is, and why the difference between them is smaller and more interesting than the hype suggests.**post author · statement](https://dgw.tmarket.io/claims/01a1e1f3-ce33-7357-88a1-e035201915b2) [**'The end of diffusion' is hype; the better question is whether it is worth paying for more expensive training to get built-in verification and flexible compute at inference time — a real and interesting trade-off.**מייק · statement](https://dgw.tmarket.io/claims/01a1e1f3-ce9d-791c-a033-f2dc599d501e) [**In Energy-Based Transformers, several optimization steps are run on the energy during training and the model is trained through that process itself, which is more expensive.**post author · statement](https://dgw.tmarket.io/claims/01a1e1f3-ce79-7bf5-95ba-b94da6ad7af2)

[All claims](https://dgw.tmarket.io/claims)

```json
{"@context":"https://schema.org","@graph":[{"@id":"https://dgw.tmarket.io/#website","@type":"WebSite","description":"Decisions, events and falsifiable forecasts from 4,500+ Telegram channels — every claim cited. Read free.","name":"DecisionGateway","url":"https://dgw.tmarket.io/","publisher":{"@id":"https://dgw.tmarket.io/#identity"}},{"@id":"https://dgw.tmarket.io/claims/01a1e1f3-ce6a-7994-8b63-3d2f141cabfb#webpage","@type":"WebPage","description":"statement by post author, recorded 2026-10-25 — verbatim quote and source citation.","name":"Diffusion is almost an EBM: the direction diffusion learns is exactly the gradient-descent… — post author — DecisionGateway","url":"https://dgw.tmarket.io/claims/01a1e1f3-ce6a-7994-8b63-3d2f141cabfb","breadcrumb":{"@id":"https://dgw.tmarket.io/claims/01a1e1f3-ce6a-7994-8b63-3d2f141cabfb#breadcrumb"},"isPartOf":{"@id":"https://dgw.tmarket.io/#website"},"potentialAction":[{"@type":"ReadAction","target":["https://dgw.tmarket.io/claims/01a1e1f3-ce6a-7994-8b63-3d2f141cabfb"]}]},{"@id":"https://dgw.tmarket.io/#identity","@type":"Organization","name":"DecisionGateway","url":"https://dgw.tmarket.io"},{"@id":"https://dgw.tmarket.io/claims/01a1e1f3-ce6a-7994-8b63-3d2f141cabfb#breadcrumb","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","name":"Home","item":"https://dgw.tmarket.io","position":1},{"@type":"ListItem","name":"Claims","item":"https://dgw.tmarket.io/claims","position":2},{"@type":"ListItem","name":"Diffusion is almost an EBM: the direction diffusion learns…","position":3}]},{"@id":"https://dgw.tmarket.io/claims/01a1e1f3-ce6a-7994-8b63-3d2f141cabfb#/schema/quotation/1","@type":"Quotation","dateCreated":"2026-10-25","isBasedOn":"https://t.me/mathyaiwithmike/1295","text":"הכיוון שדיפוזיה לומדת הוא בדיוק כיוון הירידה במדרון של אנרגיה (במעבר מדאטה מורעש לנקי) כלשהי. כלומר, דיפוזיה לומדת ישירות את השיפוע של משטח האנרגיה ומדלגת על האנרגיה עצמה. זה בדיוק הטריק שעקף את הקושי באימון EBMs.","url":"/claims/01a1e1f3-ce6a-7994-8b63-3d2f141cabfb"}]}
```

## Sitemap

See the full [sitemap](https://dgw.tmarket.io/sitemap.md) for all pages.
