---
title: "The researcher claims superiority at large scale, but the largest model he trained here is 1.2… — החוקר — DecisionGateway"
description: "statement by החוקר, recorded recently — verbatim quote and source citation."
canonical_url: "https://dgw.tmarket.io/claims/01a1e1ee-4774-7db0-a858-8bb5743cde1c"
meta:
  "og:description": "statement by החוקר, recorded recently — verbatim quote and source citation."
  "og:image": "https://dgw.tmarket.io/og.jpg"
  "og:image:alt": "White network of connected nodes crossed by a timeline on black"
  "og:image:height": "1024"
  "og:image:width": "1024"
  "og:title": "The researcher claims superiority at large scale, but the largest model he trained here is 1.2… — החוקר — DecisionGateway"
  "twitter:image": "https://dgw.tmarket.io/og.jpg"
---

> Index of every page on this site: [llms.txt](https://dgw.tmarket.io/llms.txt)

statement

# **The researcher claims superiority at large scale, but the largest model he trained here is 1.2 billion parameters on 31.5 billion tokens.**

A statement by החוקר. Statements are as reported by the cited publishers — not verified by DecisionGateway.

> *החוקר מצהיר על עליונות בסקייל גדול, אולם המודל הכי גדול שהוא אימן פה הוא 1.2 מיליארד פרמטרים (1.2B) על 31.5 מיליארד טוקנים.*

mathyaiwithmikePublished 2026-11-05 [ Read source](https://t.me/mathyaiwithmike/1303)

## **Discussion**

## **Related claims**

[**On algorithmic tasks (CLRS-Text), ten such layers raised an 86M-parameter model from 55% to 84%, after regular training got stuck at 55% and even training twice as long did not move it.**post author · statement](https://dgw.tmarket.io/claims/01a1e1f6-8f8e-7a10-a02f-2baf8c6d789e) [**In transformer-based language models and architectures like Mamba, every token prediction requires activating billions of parameters in parallel through the attention mechanism.**author · statement](https://dgw.tmarket.io/claims/01a1e1f1-92c2-775b-b01e-62ef447243fc) [**Large AI labs train models with MTP, but 80% of the gradient they backpropagate to the model is static noise that interferes with learning.**post author · allegation](https://dgw.tmarket.io/claims/01a1e1ee-c8cc-76f8-a0cf-fdc0d5c6fade) [**In every attention head in a model like BERT there are over 8,000 parameters that mathematically cancel each other out behind the scenes, a phenomenon called 'calibration freedom'.**the post author · statement](https://dgw.tmarket.io/claims/01a1e1eb-c6f2-7f5d-b2e2-ba78777e88c4) [**The researchers confirm their claims in experiments: they post-train models such as Qwen and Llama on a task of solving systems of equations, where the final answer is 0 or 1 so about half the cases can be solved by guessing.**החוקרים · investigation](https://dgw.tmarket.io/claims/01a1e1f1-8dd6-7df2-b722-e24fbbb3627d) [**The models trained on the easier examples are tested on problems harder than those they saw in post-training and still succeed much more than models trained directly on the test difficulty level, without receiving full solutions or feedback on intermediate steps.**המחברים · investigation](https://dgw.tmarket.io/claims/01a1e1f1-8f42-7f29-82b0-7ecb46307f22)

[All claims](https://dgw.tmarket.io/claims)

```json
{"@context":"https://schema.org","@graph":[{"@id":"https://dgw.tmarket.io/#website","@type":"WebSite","description":"Decisions, events and falsifiable forecasts from 4,500+ Telegram channels — every claim cited. Read free.","name":"DecisionGateway","url":"https://dgw.tmarket.io/","publisher":{"@id":"https://dgw.tmarket.io/#identity"}},{"@id":"https://dgw.tmarket.io/claims/01a1e1ee-4774-7db0-a858-8bb5743cde1c#webpage","@type":"WebPage","description":"statement by החוקר, recorded recently — verbatim quote and source citation.","name":"The researcher claims superiority at large scale, but the largest model he trained here is 1.2… — החוקר — DecisionGateway","url":"https://dgw.tmarket.io/claims/01a1e1ee-4774-7db0-a858-8bb5743cde1c","breadcrumb":{"@id":"https://dgw.tmarket.io/claims/01a1e1ee-4774-7db0-a858-8bb5743cde1c#breadcrumb"},"isPartOf":{"@id":"https://dgw.tmarket.io/#website"},"potentialAction":[{"@type":"ReadAction","target":["https://dgw.tmarket.io/claims/01a1e1ee-4774-7db0-a858-8bb5743cde1c"]}]},{"@id":"https://dgw.tmarket.io/#identity","@type":"Organization","name":"DecisionGateway","url":"https://dgw.tmarket.io"},{"@id":"https://dgw.tmarket.io/claims/01a1e1ee-4774-7db0-a858-8bb5743cde1c#breadcrumb","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","name":"Home","item":"https://dgw.tmarket.io","position":1},{"@type":"ListItem","name":"Claims","item":"https://dgw.tmarket.io/claims","position":2},{"@type":"ListItem","name":"The researcher claims superiority at large scale, but the…","position":3}]},{"@id":"https://dgw.tmarket.io/claims/01a1e1ee-4774-7db0-a858-8bb5743cde1c#/schema/quotation/1","@type":"Quotation","dateCreated":"2026-11-05","isBasedOn":"https://t.me/mathyaiwithmike/1303","text":"החוקר מצהיר על עליונות בסקייל גדול, אולם המודל הכי גדול שהוא אימן פה הוא 1.2 מיליארד פרמטרים (1.2B) על 31.5 מיליארד טוקנים.","url":"/claims/01a1e1ee-4774-7db0-a858-8bb5743cde1c"}]}
```

## Sitemap

See the full [sitemap](https://dgw.tmarket.io/sitemap.md) for all pages.
