Microsoft Develops Record-Breaking 1-Bit AI Model
Microsoft researchers have created the largest-scale 1-bit AI model to date, called BitNet b1.58 2B4T. This “bitnet” is designed to run on lightweight hardware and can be used on CPUs, including Apple’s M2. By quantizing weights into just three values (-1, 0, and 1), bitnets are significantly more memory- and computing-efficient than traditional models. The … Read more