Stop using JSON for LLM structured output | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		Stop using JSON for LLM structured output (nehmeailabs.com)
		2 points by 44za12 7 months ago \| hide \| past \| favorite \| 1 comment

44za12 7 months ago [–]

For simple extraction tasks, a delimiter-separated string uses 11 tokens vs 35 for JSON. Output tokens are the latency bottleneck.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact