← Writing & notes

FROM THE NOTEBOOK

Diffusion LLM Mercury 2

For the past decade, major artificial intelligence models like ChatGPT and Claude have shared the same fundamental speed limit. They generate text strictly one word at a time from left to right. This sequential process forces the AI to constantly wait for the previous word to be completed before it can think about the next one. As a result, tech companies have spent billions of dollars trying to squeeze extra speed out of an inherently slow system. Every time we ask an AI to think harder or handle complex reasoning, the wait times grow significantly and the costs spiral out of control.

A new model called Mercury 2 introduces a completely different way to generate language. Created by Inception Labs, Mercury 2 applies the same underlying technology used by AI image generators to write text. This method is known as diffusion. A diffusion model creates a rough draft of the entire response all at once. It then polishes and refines every single word simultaneously over multiple quick passes. The system easily catches its own errors and revises multiple parts of a paragraph at the exact same time.

This parallel drafting process makes Mercury 2 incredibly fast and remarkably intelligent. Traditional AI systems require multiple slow steps to reason through complex problems. With diffusion, the constant revising and polishing process inherently acts as a built in form of reasoning. The model constantly reconsiders its entire output during each refinement step, catching mistakes and improving coherence on the fly. This unique structure allows Mercury 2 to generate over one thousand words per second while maintaining the high quality of top tier reasoning models.

This massive leap in speed opens up entirely new possibilities for everyday software applications. Automated AI assistants often need to search the web, summarize documents, and plan actions in a single workflow. These complex automated tasks usually feel sluggish because every individual step adds a new delay to the final output. With lightning fast parallel generation, these complex operations can happen almost instantly. The system can afford to take more steps and create tighter feedback loops without making the user wait.

Voice assistants also benefit tremendously from this new technology. Natural human conversations require immediate responses to maintain a comfortable flow. Any slight delay completely breaks the natural rhythm of a casual interaction. The incredible speed of diffusion allows AI voices to reply instantly without any awkward robotic pauses. Software developers will also see massive improvements in their daily tools, as coding assistants can now provide instant suggestions and complete structural code revisions in a fraction of a second.

This breakthrough proves that fundamentally changing how an artificial intelligence is built can be incredibly impactful. The broader tech industry has spent years trying to make traditional models larger and more complex. Inception Labs chose to build their system from an entirely new foundation. Recent academic research heavily supports this architectural shift, showing that diffusion models can easily outperform traditional models in overall efficiency. Just as diffusion technology completely revolutionized the world of AI image generation a few years ago, this parallel approach to language promises to completely reshape our expectations for how quickly and intelligently machines can communicate.

All writing