statementSaid on 2026-10-19

In early versions of Attention Is All You Need the authors explicitly wrote that the FFN is "a kind of attention"; in later versions the paragraph simply disappeared.

A statement by post author, said on 2026-10-19. Statements are as reported by the cited publishers — not verified by DecisionGateway.

בגרסאות מוקדמות של Attention Is All You Need הכותבים כתבו במפורש שה-FFN הוא "סוג של attention". בגרסאות המאוחרות הפסקה פשוט נעלמה.
mathyaiwithmikePublished 2026-10-19 Read source

Discussion

0/2000

Related claims