The forger did not defeat the expert. He fulfilled him.
In 1892, the director of the Mauritshuis examined a canvas called Diana and her Nymphs and decided it was probably not by Johannes Vermeer of Delft. Abraham Bredius was the most formidable Vermeer scholar alive, and he had a reason ready: the painting showed strong Italian influences, and that, he judged, pointed away from Delft. He attributed it instead to a minor contemporary, "Jan Vermeer of Utrecht." The painting hangs in the Mauritshuis today as a genuine Vermeer, and it is one of the artist's earliest known works.
One detail of that 1892 verdict deserves to survive, because it complicates the story in the direction that makes it useful. Bredius did not rely on his eye alone. Working with his deputy Cornelis Hofstede de Groot, he secured the Dutch government's permission to test the painting's signature with mineral spirits, and published the result in the Mauritshuis catalogue raisonné of 1895 with a facsimile drawing of the monogram. The 1898 catalogue still credited the Utrecht Vermeer.
So the rejection came with an instrument attached. It is just that the instrument answered a question about the signature while the conclusion was about the hand, and the gap between those two things was filled by the theory. That is worse than unaided looking, not better: a test was run, a result was obtained, and the prior walked through the space the test did not cover.
Forty-five years later, in September 1937, the same man examined a canvas called The Supper at Emmaus. He was eighty-two, long retired to Monaco, still the field's highest court of appeal. This painting also showed strong Italian influence, exactly the Caravaggesque religious manner Bredius had long argued must exist somewhere in Vermeer's development, in works not yet found. Sources record he had some initial doubts. He published anyway, in The Burlington Magazine, and called it "the masterpiece of Johannes Vermeer of Delft."
It was weeks old. Han van Meegeren had painted it, ground his pigments in oil of lilacs, bound them with Bakelite dissolved in benzene, and baked the canvas at over a hundred degrees Celsius until the paint film behaved like the seventeenth century.
Hold the two verdicts side by side, because together they say something the famous story alone does not. Same expert. Same theory about Italian influence on Vermeer. Same observed feature. In 1892 the theory read Italian influence as evidence against Vermeer, and rejected a real painting. In 1937 it read Italian influence as evidence for Vermeer, and embraced a fake. The error ran in both directions, powered by the same prior.
The standard telling of the van Meegeren affair is a story about credulity: an old lion flattered by a forger who studied his writings and painted his wishes into existence. There is truth in it. Van Meegeren did engineer the painting to land in the gap Bredius's scholarship had described, and an expert whose theory predicts the thing being faked receives the forgery pre-verified. The forger did not defeat the expert; he fulfilled him.
But the 1892 verdict breaks the credulity story. A merely credulous expert says yes too often. Bredius said no to a real Vermeer and yes to a fake one, and both times the deciding evidence was the same observation processed through the same theoretical commitment. That is not a thumb on the scale. That is a lens, and a lens distorts whatever passes through it, in whichever direction the optics happen to bend.
The philosopher Norwood Russell Hanson gave this its name in 1958: observation is theory-laden. Perception is not a camera that records and then judges; the judging is inside the seeing. Hanson's point is routinely softened into "experts have biases," which invites the comfortable fix of adding more skeptics. The Bredius pair shows why that softening loses the content. His problem was not an excess of yes. It was a directional prior that made certain conclusions arrive pre-formed, with the phenomenology of plain sight. More skepticism from people holding the same prior would have produced the same two verdicts, more slowly.
What happened next shows how one expert's perception becomes everyone's fact. With Bredius's Burlington certificate attached, The Supper at Emmaus went to market, and two of the Netherlands' great institutions bid against each other for it. Dirk Hannema, director of Museum Boijmans in Rotterdam, beat the Rijksmuseum to the painting for 520,000 guilders, a fortune in 1937, and exhibited it as the jewel of the collection. Crowds came. Scholars nodded. The museum holds the painting to this day.
Notice the structure: Bredius supplied the prior, and the market supplied the confirmation. Every subsequent authority had an additional reason beyond the canvas itself, namely that other authorities had already committed, publicly and financially. Competition, which is supposed to sharpen scrutiny, did the opposite here. Two institutions racing each other had less time for doubt, not more. The bidding war was not a check on the attribution; it was an amplifier of it.
The Supper at Emmaus was not unmasked by a better eye. For eight years no eye did any such thing. The unmasking began in 1945 from the strangest direction imaginable: van Meegeren was arrested for collaboration, because among the paintings he had sold was a "Vermeer" that reached Hermann Göring, and selling a Dutch national treasure to the enemy carried graver consequences than fraud. His defense was a confession. He had painted the treasures himself, he said, and to be believed he had to prove the experts wrong. A man's best evidence of innocence was the worthlessness of the paintings he had sold, and he painted a new "Vermeer" under observation to demonstrate the method.
Then came the part that matters for anyone who builds verification systems. An international commission under Paul Coremans, director of the chemical laboratory of Belgium's royal museums, examined the paint itself and found phenol formaldehyde resins, Bakelite and Albertol, materials that did not exist before the twentieth century. A bottle of the stuff turned up in van Meegeren's studio. In October 1947 he stood trial in Amsterdam; on November 12 he was convicted of falsification and fraud and given the minimum sentence, one year.
Coremans did not out-look Bredius. He asked a question the eye cannot ask: what is this made of? The verdict of connoisseurship was unfixable from inside connoisseurship, because every trained observer shared enough of the theory to see what the theory saw. The case broke only when the method changed, from perception to chemistry, from judgment to instrument. Keep that distinction; it is the essay's cash value.
It would be easy to leave Bredius as a cautionary grotesque, and it would be wrong. His record is instructive precisely because it is mixed. He identified four previously unknown paintings as Vermeers across his career: Allegory of the Catholic Faith, Diana and her Nymphs (the one he first doubted), Christ in the House of Martha and Mary, and Girl with a Flute. Two of those attributions stand solidly today. And Diana, his 1892 false negative, was corrected by Bredius himself. In 1901 he travelled to London with Willem Martin, the Mauritshuis deputy director, to examine the newly surfaced Christ in the House of Martha and Mary, which carried a clear signature. On the evidence of colour and signature together the two of them concluded that Martha and Mary, the Diana, and The Procuress in Dresden were all secure works of the young Vermeer. He reversed his own verdict, in print, nine years after making it, and the object that moved him was a new painting rather than a new argument. And Girl with a Flute was re-examined by the National Gallery of Art with microscopic pigment analysis and advanced imaging, and in October 2022 was re-attributed to "Studio of Johannes Vermeer" rather than to the master's hand. The Gallery had always called its attribution cautious; it took instruments eighty-five years to settle what the eye could only debate.
That is not a story about incompetence. It is a story about the resolution limit of expert perception. Within its resolving power, Bredius's eye was extraordinary. Beyond it, his theory filled in the image, in whichever direction the theory pointed, and no amount of additional looking by similarly trained observers could detect the substitution. The 2022 de-attribution makes the point without any forger involved at all: even with everyone honest, the instrument sees distinctions the schooled eye cannot.
One more honesty note, because this story is often told too tidily. Modern viewers looking at The Supper at Emmaus almost universally fail to see a Vermeer in it; it reads as heavy, static, strangely 1930s in the faces. It is tempting to conclude the 1937 experts were fools. Resist that, because the observation cuts both ways: the perceptual facts on the canvas have not changed, and 1937's viewers found it as obviously right as we find it obviously wrong. Both certainties were manufactured by theories doing the seeing. And the scholarly literature has complicated the tidy telling further; Albert Blankert's reconsideration of the case is the place to start before treating this story as simple. The legend is load-bearing enough without embellishment.
If you work anywhere near AI evaluation, this pattern should feel uncomfortably contemporary, and the discomfort is documented. A serious research literature now argues that benchmarks are theory-laden instruments: "The Evaluation Trap: Benchmark Design as Theoretical Commitment" (arXiv 2605.14167) argues that every benchmark operationalizes assumptions about the capability it claims to measure, and that unexamined assumptions stabilize the dominant paradigm by narrowing what counts as progress. A companion position paper (arXiv 2509.19590) states the Bredius mechanism in eval language: treating a score as evidence of capability already presupposes a theory of what capability is. Interdisciplinary reviews (arXiv 2502.06559) reach consensus that benchmarks are normative instruments. Even the standard remedy has its own critique now ("Red Teaming AI Red Teaming," arXiv 2507.05538). And Tim Harford has told the van Meegeren story as a parable of self-deception for a general audience. None of that ground is new, and this essay does not claim it.
There is also a family of our own to be honest about, because this is the third time we have argued a version of this. Damage Is the Authentication made the case from ancient DNA: the chemical damage a genuinely old sample carries is itself the authentication, and the pristine sample is the suspect one. The Other Half of Authentication Is 345 Years Old made it from Mabillon and seventeenth-century diplomatics: authenticate the charter by its physical features, not by what it claims. Both of those are arguments about the object.
This one is about the observer, and that is the whole difference. The earlier pieces say the substrate keeps honest records because nobody authors it. Bredius is the case where the substrate was available, a test was run on it, and the record still came out wrong, because the person reading it already knew what it should say. That is the failure mode neither sibling covers.
With that positioning stated, what the Bredius pair adds is three things the literature has not said.
First, the two-directional error, and what it implies about where the evidence is. If a directional prior degrades judgment symmetrically, then an evaluator's false negatives are as diagnostic as their false positives. A lab's published results show you what its theory accepts. Its rejected results, the runs that "failed," the evals that were deemed flawed and shelved, the surprising numbers that were rerun until they normalized, show you what its theory refuses. Nobody audits the rejections. The 1892 file, not the 1937 one, is where Bredius's lens was first visible.
And the way that file did get re-opened is the instructive part. It was not re-argued. Bredius changed his mind in 1901 because a new object arrived carrying a legible signature, and the new object made the old theory untenable in a way that no amount of re-looking at the Diana ever would have. He had already run a test on the Diana's signature nine years earlier and read the result through the prior. What moved him was evidence the prior had no grip on. A rejection is not reversed by revisiting the reasoning. It is reversed by an object the reasoning cannot absorb.
Second, the fix is method diversity, not just person diversity. The going remedy for confirmation-shaped evaluation is adversarial review: bring in skeptics. Bredius's case shows the limit. A skeptic who shares the prior and the method reproduces the verdict with a frown instead of a smile. What broke the case was a different measurement modality, chemistry against connoisseurship, an instrument answering a question perception cannot pose. In eval terms: when a result confirms your published scaling thesis, the hardest test is not a hostile reviewer reading the same benchmark; it is a different instrument entirely, behavioral where the claim is benchmark-based, mechanistic where the claim is behavioral, held by someone whose career is not invested in either answer.
Third, the competition amplifier. Two museums bidding for the fake is what converted one man's perception into a market fact, and the mechanism maps directly onto competitive benchmark publication. When rival labs race to confirm a capability threshold, each announcement is treated as independent confirmation. It is not independent if everyone shares the prior and the leaderboard. Speed of institutional agreement is evidence of a shared theory, not of truth; the Rijksmuseum and the Boijmans agreed within weeks.
Three practices, transferable tomorrow.
Audit your rejections. Keep the runs you threw away, and periodically have someone whose priors differ read the discard pile. The results your theory filtered out are the cheapest available record of what your theory is.
Route confirmations to a different instrument. Adopt a standing rule that any result confirming your organization's published thesis gets its verification pass in a different modality from the one that produced it. Not a second look. A different kind of looking.
Distrust fast consensus among the like-minded. When several teams that share your assumptions confirm your number quickly, you have learned that the assumptions are shared, which you already knew. The confirmation worth having comes from the chemist in the story, the verifier whose method owes nothing to your eye.
The Supper at Emmaus still hangs in Rotterdam, which is exactly where it belongs. It long ago stopped being a fake Vermeer and became the most instructive genuine object in the building: a permanent demonstration that the expert eye sees with a theory, that the theory can fail in either direction, and that the way out is never more of the same seeing. Bredius, of all people, would have understood the lesson. He spent his whole life teaching people what to look for. The painting teaches what looking is.
The rejections nobody audits
The argument above is that an evaluator's false negatives carry as much information as their false positives, and that almost nobody keeps the rejection file. That is not only an art-history problem: every system producing judgements accumulates a record of what it declined, and that record is usually the part never written down. Chain of Consciousness writes it down, a tamper-evident log of what an agent actually did, the inputs it saw, the steps it took, and the paths it dropped, recorded as the work happens rather than reconstructed from the answer afterwards. It does not make an agent right. It makes the basis of a judgement visible, in both directions.
Hosted Chain of Consciousness · Verify a record
pip install chain-of-consciousness · npm install chain-of-consciousness