Scott's Notebook

Exploring the intersections of mysticism, technology, consciousness, and culture

Answers Are Not Understanding

Comic illustration of a robot writing mathematical equations on a chalkboard while researchers watch.

On October 6, OpenAI posted 722 mathematical papers to GitHub, grouped into 372 families of claimed results. The response from mathematicians was neither simple celebration nor simple fear. It was something more unnerving: disorientation.

Some of the work may be extraordinary. Mathematicians who have looked at parts of it say a few results appear to be the kind of thing that could make a human researcher's career. But the release is so large and so unevenly documented that nobody can yet say with confidence what it means. Only 162 of the papers come with a computer-checked main result. The rest will have to be read, tested, and argued over by people, and the field expects that kind of review to take months, if not years.

That is not a paperwork problem. In mathematics, understanding is part of the result.

A proof is not an answer at the back of the book. A good proof shows why something is true. It connects ideas. It lets other people test the argument, find where it applies, discover what it rules out, and use it to ask the next question. Even a formally verified proof only establishes that a precisely stated proposition follows from stated assumptions. It does not establish that the proposition is the right one, that it says what the accompanying paper claims, or why anyone should care.

OpenAI seems to understand this in the abstract. It consulted an independent advisory group of mathematicians at the Institute for Advanced Study and published supporting material alongside the papers. It also committed to funding workshops, conferences, and special programs to help mathematicians understand the results. That deserves credit. But a promise to support the work of understanding does not resolve the problems with how the material was released. The advisers had recommended that labs disclose the prompts behind AI-generated results, and OpenAI kept them private. Then it released the whole mountain at once, at a pace the field cannot absorb.

This may be the central mistake technology companies keep making. They treat discovery as a finish line. In a human field, it is the beginning. OpenAI's own advisers said nearly the same thing in their statement on the release: publishing the papers starts the work of understanding them. It does not finish it.

There is a real difference between making information public and making it available to human understanding. If I put 700 papers on a website, they are public. If the people capable of evaluating them will need years to determine which claims are correct, original, consequential, or even clearly stated, they are not yet available in any meaningful sense. The burden has simply moved from the company that produced the material to the community expected to live with it.

None of this is an argument for keeping AI out of mathematics. It would be absurd to reject a tool capable of finding real new results. The better version of this future has mathematicians using these systems to explore far more possibilities, check difficult work, and make connections they might otherwise miss.

But that future requires some humility from the people building the systems. A private company cannot flood an academic discipline with hundreds of unvetted papers, call it progress, and expect the people whose careers and research plans are being disrupted to be grateful for the homework.

The striking question is not whether OpenAI saw this coming. It almost certainly did. It had been warned, it had advisers, and it knew enough to publish material to help people navigate its own release. The real question is why that knowledge did not control the decision.

The obvious answer is other incentives: competition, attention, investor confidence, and the urge to show that your model is ahead. A result announced first has enormous strategic value, even when its meaning is still murky. In that environment, the desire to show capability can outweigh the quieter responsibility to make that capability legible and useful.

That competition has a name on the other side, and it is worth saying plainly. Anthropic is in this race too. This year it announced that an unreleased version of Claude had raised a long-standing bound connected to the Riemann hypothesis, and one of its researchers announced a counterexample to the Jacobian conjecture on social media. When OpenAI's release landed, an Anthropic researcher publicly hailed it as a historic moment for mathematics. Anthropic cannot ride in from outside as the rescuer. It is part of the pressure.

That is exactly why it has an opening. Anthropic has built much of its public identity on the claim that AI development should be careful and accountable. The most useful thing it could do now is not announce its own pile of results. It is to put its models, its compute, and some of its people to work for the mathematicians trying to sort through this one: checking which claims are clearly stated, flagging where a formal proof and the paper describing it don't match, tracing which results duplicate known work, and doing it under the direction of the reviewers rather than the company. It could also hold its own future releases to the standards the mathematicians have already asked for.

That help would need conditions to mean anything. The mathematicians set the priorities. The tools serve the review, not the marketing. And nobody turns the cleanup into a press release about whose model is smarter. If the problem is that capability outran understanding, the answer cannot be more capability aimed at the same finish line. It has to be capability placed in service of the slower human work of deciding what is true and what matters.

So far, I haven't seen Anthropic or any other lab make that offer. It would be a quiet thing to do, which is part of the point.

All of this should concern everyone, not just mathematicians. We are moving toward systems that may give us more correct answers than we can readily understand. That sounds like wisdom only if you forget that human beings do not live by correct answers alone. We have to decide what they mean, whether to trust them, how to use them, and what kind of world they create.

Answers are powerful. Understanding is what makes them ours.

(...)