Fprox’s Substack • 1 HN point • 11 Mar 24
- The interest in small floating-point formats, like 8-bit, has increased due to the computational needs of neural networks, leading to the development of various formats.
- Standardization efforts are underway for 8-bit floating-point formats, with organizations like Open Compute Project and IEEE working on defining formats like OFP8 and binary8p1 to address challenges and enhance industry adoption.
- Different companies have proposed unique 8-bit floating-point formats, such as Microsoft's msfp8-11 and Tesla's CFloat8, each with specific characteristics like configurable bias values and special value encodings.