ON THE WIRE

The latest.

A developing picture of China’s AI, one story at a time.

312 storiesPage 37 of 52
Models

Unsloth quantizes Alibaba's Qwen-Image-2.1 for consumer GPUs, but research-only license limits adoption

Third-party developer Unsloth has published GGUF and FP8 quantizations of Alibaba's open-weight Qwen-Image-2.1 model, enabling local inference on consumer hardware with as little as 6GB VRAM via offloading. However, Unsloth's own documentation cautions that memory figures are estimates and recommends FP8 over GGUF for GPU users, while the underlying Qwen Research License Agreement restricts all use to non-commercial research and evaluation.