A ok got it, the next token is sampled from a deterministic probability distribu... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		michaeljx 8 months ago \| parent \| context \| favorite \| on: Ask HN: Why is Generative AI non-deterministic A ok got it, the next token is sampled from a deterministic probability distribution, hence the random output. But why not get the token with the highest probability/weight? Is this to avoid some local minima?

minimaxir 8 months ago [–]

It depends on your use case. Deterministic output is less "creative."

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact