Eigen RadarAI
Analysis

ProofTrace maps proof dependencies to study AI involvement in mathematics

ProofTrace examines how mathematical proofs are organized rather than relying only on the language used to present them. The preprint compares five groups containing 8,281 papers, including human work reworded by a model and proofs reconstructed by models. Dependency graphs distinguish these interventions, although differences between groups do not establish mathematical correctness or provide a conclusive origin judgment for an individual paper.

Artificial Intelligence··Night
Close-up of page edges and staple bindings of face-down papers beside closed folders and a pencil on a mathematics research desk.

Proof links become a graph

ProofTrace is a framework for studying the organization of mathematical proofs through the results they depend on. Its directed graphs connect theorems, lemmas, intermediate steps and external results. The extraction process uses a language model and retains supporting passages. From these graphs the researchers calculate 342 features, keeping measures of writing style in a separate analysis. The preprint compares 8,281 papers divided into five cohorts.[1]

Rewording and rebuilding are tested separately

The cohorts distinguish historical human work, disclosed artificial intelligence contributions, model-originated manuscripts, reconstructed proofs and reworded human papers. For controlled comparisons, seven hundred human papers supply problems and targets for proof reconstruction, while six hundred twenty-five texts receive wording changes alone. The authors find that reworded papers broadly keep the original proof organization, whereas model-reconstructed proofs have different structural patterns.[1]

The comparison measures presentation structure

Analyses include controls for subject area, manuscript length and graph size. Even so, cohort selection and different production procedures affect interpretation: the disclosure group is self-selected and historical papers come from another period. The measured property is proof presentation, with errors also possible in graph extraction. Group differences provide no conclusive judgment about an individual author’s use of a model or the correctness of a proof.[1]

References

  1. News sourcearXivProofTrace examines proof dependencies rather than writing style in mathematics↩1↩2↩3