NewsStocksJack Dorsey's Block Unveils Dessa, an AI Voice Model Trained Entirely on Human Conversations

Jack Dorsey's Block Unveils Dessa, an AI Voice Model Trained Entirely on Human Conversations

Author: CryptoBriefing·

Key Takeaways

  • •Block introduced Dessa, an AI voice model trained from scratch exclusively on human speech recordings, without text data or pretrained models.
  • •The model uses a full duplex, speech-to-speech architecture that lets it listen and speak at the same time while responding to emotional cues, pauses and interruptions.
  • •Dessa can run locally on a MacBook Pro equipped with Apple's M4 Max chip or better, without relying on cloud servers for inference.
  • •Block says the model acquired language with hundreds of times fewer words than conventional text-based models and was trained on a single NVIDIA GB200 NVL72 system.
  • •Block has released company-selected demonstrations showing both capabilities and limitations, and plans early access for AI safety researchers without disclosing a broader release date, model weights or performance benchmarks.
Jack Dorsey's Block Unveils Dessa, an AI Voice Model Trained Entirely on Human Conversations

Block, the payments company formerly known as Square, has introduced Dessa, a new AI voice model trained entirely on human conversations rather than written text. The company said the model is designed to communicate in real time while recognizing emotional cues, interruptions and natural speech patterns.

According to Block, Dessa was trained from scratch using only recordings of human speech, without text data or pretrained models. Unlike conventional voice assistants, which convert speech into text before generating a response, Dessa processes and generates audio directly through a speech-to-speech architecture.

The model supports simultaneous listening and speaking, allowing it to interrupt, respond to pauses and adjust its tone during conversations. Block said Dessa can run locally on a MacBook Pro equipped with Apple's M4 Max chip or better, without requiring cloud infrastructure for inference — a departure from most widely used voice assistants, which depend on remote servers to process spoken requests. The company has published several demonstrations of the model and plans to provide early access to a small group of AI safety researchers.

Dessa learns to communicate without text

Block said Dessa was developed to explore whether AI models can acquire language and conversational abilities through speech alone, in a similar way to how humans learn to communicate before learning to read.

“Babies learn to talk without ever seeing a word written down. We wanted to see if a model could too. It can.'s just very hard,” the company said.

The model uses what Block describes as a full duplex architecture, meaning it can listen and speak at the same time rather than waiting for a person to finish before responding. Block said this design allows Dessa to recognize laughter, sarcasm, changes in tone and emotional expressions that can be lost when speech is converted into text.

The company added that Dessa learned language using hundreds of times fewer words than conventional text-based language models, although it did not provide a detailed comparison. Block also said the model was trained on a single NVIDIA GB200 NVL72 system, suggesting that speech-focused AI development may require a different approach to computing infrastructure.

Demonstrations show promise and limits

In demonstrations shared by Dessa lead Ragavan Thurairatnam on X — 1, 2 — the model engages in conversations about movies, responds to personal stories and interacts with OpenAI's GPT Live 1 voice model, one of a growing set of realtime voice assistants being developed by major technology companies. Other examples show Dessa participating in guessing games and adjusting its responses during conversations.

Some demonstrations also reveal limitations, including instances in which the model misidentifies a speaker or unexpectedly changes topics. The examples were selected and published by Block, and the model's performance has not been independently evaluated.

Emotional awareness and AI safety

Beyond conversational capabilities, Block said Dessa was developed to investigate how AI systems could better understand human emotions and respond appropriately in sensitive situations. The company argues that traditional voice assistants lose important information when they convert speech into text, including signs of frustration, distress and emotional changes.

“AI keeps gaining power and independence, and it's still nearly deaf to the emotion in our voices,” the Dessa team said.

Block pointed to situations in which a person experiencing serious pain might interact with an AI system that fails to recognize their distress. The company said its approach could help address those limitations by allowing AI models to interpret emotional signals directly from speech — a question gaining prominence as conversational voice becomes a more common interface for AI products across the technology industry.

The project is being developed by a small research team at Block led by Ragavan Thurairatnam, with members who previously worked at Dessa, a Toronto-based AI startup of the same name. The researchers report directly to Jack Dorsey, Block's co-founder and chief executive, and have spent several years developing generative speech technologies.

Block plans to grant early access to selected AI safety researchers to identify potential risks and study how models trained exclusively on speech behave. The company has not disclosed a broader release date, model weights or detailed performance benchmarks, leaving the early-access program as the main window through which outside observers are likely to learn how Dessa performs beyond the company's own examples.