Microsoft Researchers Develop Lightweight 1-Bit AI Model
Microsoft researchers have created a lightweight 1-bit large language model (LLM) called BitNet b1.58 2B4T, which is small enough to run efficiently on some CPUs, including the Apple M2 chip. This innovative model uses 1-bit weights with only three possible values: -1, 0, and +1, reducing memory consumption by a significant amount compared to mainstream … Read more