CONNECT THE DOTS

Find your next insight.

Search stories, companies and the ideas behind China’s AI.

312 storiesPage 37 of 52
Models

Unsloth quantizes Alibaba's Qwen-Image-2.1 for consumer GPUs, but research-only license limits adoption

Third-party developer Unsloth has published GGUF and FP8 quantizations of Alibaba's open-weight Qwen-Image-2.1 model, enabling local inference on consumer hardware with as little as 6GB VRAM via offloading. However, Unsloth's own documentation cautions that memory figures are estimates and recommends FP8 over GGUF for GPU users, while the underlying Qwen Research License Agreement restricts all use to non-commercial research and evaluation.