Technical Terms

Feed-Forward Network (FFN)

Definition

The per-token neural-network stage inside a transformer block that transforms each token representation after attention has mixed information across tokens.

In Plain English

The part of each layer that reshapes what the model has learned after it looks across the sequence.