Parameters & Settings
Top-p (Nucleus Sampling)
Definition
A parameter that controls output diversity by limiting token selection to the smallest set of tokens whose cumulative probability exceeds p. Lower values (e.g., 0.1) make output more focused; higher values (e.g., 0.95) allow more variety.
In Plain English
Another way to control how creative or predictable the AI is, alongside temperature. At low top-p, the AI only picks from the most likely next words. At high top-p, it considers more unusual word choices too.