Google DeepMind and University of Pennsylvania Build AI Text Detectors That Show Their Work
Key Takeaways
- •Researchers from Google DeepMind and the University of Pennsylvania built an interpretable AI text detection pipeline, described in a paper accepted at EMNLP 2026.
- •The method applies sparse autoencoders to a Gemma-2-2B detector's residual stream, producing automatically labeled features whose weights in a logistic regression classifier reveal how each concept influenced the final decision.
- •On in-domain data, the interpretable classifier achieved an F1 score of 96.8, only 1.2 points below the original-box detector's 98.0.
- •On out-of-distribution text, the transparent model scored an F1 of 92.2 compared with 75.2 for the black-box baseline, a 17-point advantage.
- •The code and trained models are publicly available on GitHub under the google-deepmind/detectorscope repository, with limitations including dependence on automatic feature label quality and unproven scaling beyond Gemma-2-2B.

AI text detectors already influence consequential decisions: who gets into a school, whether a paper survives peer review, and which posts stay online. Yet most these systems cannot explain a single decision they make.
A research team from Google DeepMind and the University of Pennsylvania has unveiled a method that turns an opaque detector into one that reasons in concepts a human can read — and the accuracy cost is surprisingly small.
The paper, titled “Building Auditable AI Text Detectors with Sparse Autoencoders,” was submitted on October 21, 2026. It has been accepted at EMNLP 2026, one of the major venues for natural language processing research.
Opening the Black Box
The researchers describe a familiar trade-off. The best-performing detectors are fine-tuned neural classifiers whose internal logic is essentially sealed. The alternatives are transparent tools built on stylometric and linguistic features, such as patterns in word choice and sentence structure. Those can be inspected — but according to the paper, they trail the neural models by wide margins.
The team’s answer is a pipeline that keeps the neural model’s knowledge while translating it into an interpretable form. The process starts with a fine-tuned detector built on Gemma-2-2B, a compact, openly available model from Google’s Gemma family. The researchers then apply sparse autoencoders, or SAEs, to the model’s residual stream activations.
As a model processes text, information passes along an internal channel called the residual stream. Those signals are dense and tangled, with many ideas blended into each number. A sparse autoencoder untangles them, learning to represent the same information as a large set of individual features, in which only a few switch on for any given input.
The pipeline then labels these features automatically, assigning each a human-readable description. Only features that clear a set global fidelity threshold are retained, meaning the label has to actually match what the feature does. The surviving features feed into a lightweight logistic regression classifier, where each input receives a weight — making it possible to see exactly how much each one pushed the final verdict.
What the Numbers Show
On in-domain data, meaning text similar to what the models were trained on, the interpretable classifier scored an F1 of 96.8 — a standard machine-learning score that blends precision and recall into a single number, with 100 as a perfect score. The original black-box detector scored 98.0, leaving a gap of just 1.2 points between the two.
The more striking result came on out-of-distribution data, which covers text that looks different from the training set — the scenario that most closely mirrors real-world deployment, where submitted text will not always resemble the training data. There, the new model posted an F1 of 92.2, while the black-box baseline dropped to 75.2, a 17-point advantage for the transparent version.
The code and trained models are publicly available on GitHub under the google-deepmind/detectorscope repository.
Why Auditability Is the Real Story
The paper frames its motivation around the settings where these tools are already in use: peer review, education, admissions, journalism, and content moderation. In each case, a detector’s output can directly affect a person.
An auditable detector changes the conversation. Instead of “the system says this was AI-written,” a reviewer could point to the specific concepts that drove the call and judge whether they hold up. That also gives the person on the receiving end something to contest.
Limitations remain. The method depends on automatic feature labeling, so the quality of those labels sets a ceiling on how meaningful the explanations really are. The fidelity threshold is designed to filter weak labels, but independent testing on the public code will show how well that holds across domains. It also remains to be seen whether the approach scales beyond the Gemma-2-2B detector used in the study.