Cobus Greyling on LLMs, NLU, NLP, chatbots & voicebots β’ 0 implied HN points β’ 20 Dec 23
- OpenAI's JSON mode doesn't ensure a specific output format, but it guarantees that the JSON will be valid. This means it will always parse without errors.
- Using the 'seed' parameter can help create consistent JSON structures, allowing similar inputs to produce the same output format.
- It's important to explicitly instruct the model to generate JSON to avoid issues; relying solely on the response format flag might lead to problems like infinite outputs.