Non-determinism in language models can be frustrating because you can't always expect the same output each time you input the same prompt. This unpredictability often stems from the way language itself works.
You can reduce some of this unpredictability by using techniques like seeding and selecting better models. These methods help control how outputs are generated and make them more consistent.
Understanding that language is inherently complex can help you see the random outputs as part of the model's nature, not just flaws. Embracing this chaos can lead to surprising and interesting results.