趋势解读：Google's new open model DiffusionGemma generates text from，提升开发者接入体验

Google has released DiffusionGemma, an experimental language model that generates text using a diffusion-based method, producing blocks of 256 tokens at once rather than generating text word by word. By processing tokens in parallel, the model makes better use of graphics processors, achieving speeds up to four times faster than traditional models when running in single-user mode on dedicated GPUs. While the generated text quality is lower compared to conventional models, the approach is particularly well suited for non-linear tasks such as inserting text after the fact or filling in gaps in program code. Google released an experimental model with open weights that generates text through diffusion instead of word by word. On a single GPU, it runs up to four times faster in single-user mode than classic language models. Nvidia handled the optimization. Most language models generate one token after another, basing each new token on the previous one. DiffusionGemma takes a different approach. It starts with a block of 256 random placeholder tokens and refines them across several passes until readable text emerges. The idea comes from image AI, where diffusion models turn noise into clear images. The model has 26 billion parameters total but only activates 3.8 billion per step. That's thanks to a mixture-of-experts architecture, where several specialized sub-networks sit side by side and only the right ones fire depending on the input. When quantized to lower precision, the model fits into 18 GB of VRAM on high-end consumer GPUs, according to Google. It builds on the Gemma 4 family and borrows its diffusion process from Google's earlier research on Gemini Diffusion. Ad Nvidia says the speed advantage comes down to hardware usage. With autoregressive models, single-user inference is often bottlenecked by memory bandwidth. The GPU's compute units sit idle most of the time, just waiting for data from memory. Engineers call this memory-bound. DiffusionGemma sidesteps the problem by processing up to 256 tokens in parallel, pushing the bottleneck toward raw compute instead. The result is that GPUs actually stay busy. Ad DEC_D_Incontent-1 Nvidia reports about 1,000 tokens per second on an H100 when processing a single request, 150 tokens per second on the DGX Spark deskside system, and up to 800 tokens per second on the DGX Station. On the GeForce RTX 5090, Google claims more than 700 tokens per second. In local single-user mode, the model runs about four times faster on dedicated GPUs than a comparable autoregressive model. Google ties this effect to dedicated accelerators. On shared-memory setups like Apple Silicon, which are often memory-bandwidth-limited during inference themselves, the gap over autoregressive models is likely smaller. Ad In cloud serving with many parallel requests, the advantage flips. Autoregressive models already keep the hardware busy in that scenario, so DiffusionGemma can actually drive costs up, according to Google. DiffusionGemma trades output quality for speed. Google still recommends the regular Gemma 4 models when quality matters most and positions DiffusionGemma as a tool for researchers and developers experimenting with local, fast workflows. Ad DEC_D_Incontent-2 Where Google sees real strengths is in tasks that don't work left to right. Because the model considers the entire block at once, each token can reference every other token during generation, including ones that come later. Traditional language models can only look backward. Ad