The hottest Substack posts of
Kasra’s Substack
And their main takeaways
- Existing tools focus on instrumenting only the API call to large language models.
- Building a production app with LLMs requires pre-processing and post-processing steps.
- A tool for end-to-end pipeline instrumentation and replay can facilitate experimenting with changes in the pipeline.