It's not just about the performance numbers of large language models (LLMs). The real value lies in the experiences built on top of these models for customers.
The ChatGPT interface demonstrates the importance of the overall experience over just the underlying model technology in LLMs.
When considering open source LLMs, it's crucial to focus on the holistic experience that model providers offer, not just the performance metrics in comparison to closed source models.
WebAssembly allows developers to write code in faster languages like C++ and Rust that can run in the browser, solving performance limitations of JavaScript.
Code running in the browser can only be written in JavaScript, leading to the development of WebAssembly to execute non-JavaScript code in the browser.
WebAssembly can be used to offload specific parts of applications into modules that run faster, like using C++ or Rust code compiled into WebAssembly for more efficient operations.
Observability helps teams monitor when things go wrong and profile how things change over time in different software systems
Observability can be divided into 4 major types: infrastructure, application, data, and business observability, each requiring different tools and teams for monitoring
Business observability focuses on monitoring how metrics are trending, important events, and providing proactive alerts to make better decisions