DigiNews

Tech Watch by Johan Denoyer

← Back to articles

4-bit floating point FP4

Quality: 8/10 Relevance: 9/10

Summary

The post explains 4-bit floating point formats (FP4) and how different exponent/mantissa allocations affect range and spacing. It covers E3M0, E2M1, E1M2, and E0M3, provides a concrete table for E2M1, and introduces the PyChop library to generate FP4 values; it also notes that FP4 is not unique and previews NF4 in a follow-up.

🚀 Service construit par Johan Denoyer