Preprint

Cross-layer AI retrieval system leads long-story tests

An arXiv preprint reports the highest displayed scores for PonsRAG, but the evaluation covered only long narrative reasoning benchmarks.

A cross-layer retrieval system designed to connect character and plot evidence led the displayed single-step multiple-choice comparison in a study of long narrative reasoning. PonsRAG posted a multiple-choice average accuracy of 74.98, and the report says that was an 11.56% relative improvement over the second-best baseline. The figure is relative, not an 11.56 percentage-point gain, and no confidence interval or significance test was reported.

The same pattern appeared in the reported multi-step test, where PonsRAG used IRCoT and reached 75.85 average accuracy. That was reported as a 12.51% relative improvement, again without a confidence interval or significance test.

A bridge between character and plot

The design separates evidence into Character and Plot layers and adds a Pons layer. Pons is implemented as a bipartite graph, meaning its links connect nodes across the other two layers. The aim, as described in the paper, is to create a bridge between pieces of evidence that might otherwise remain disconnected during a long narrative question.

At question time, the online pipeline has four stages: query anchoring, cross-layer awakening, cognition-pair matching and chronological filtering before generation. In ordinary terms, it first anchors the question, activates relevant links between layers, pairs the resulting evidence and filters it in story order before producing an answer.

What the comparison measured

The evaluation covered four reported question sets: 500 NarrativeQA questions, 351 EN.QA questions, 229 EN.MC questions and 126 NoCha questions. The reported sets supported both question-answering and multiple-choice comparisons.

For its fair-comparison setup, the study used GPT-4o-mini with temperature set to 0.8 and a 6,000-token context limit. Structured and multi-step retrieval systems used BGE-M3 with 512-token chunks, and hyperparameters were optimized only on a validation set.

The full design versus stripped-down versions

In the component comparison, removing the Pons layer produced an EN.MC accuracy of 61.13, compared with 77.73 for the full system. Character-only and Plot-only versions also scored lower. These ablation results are descriptive comparisons of the reported configurations.

Removing individual reasoning stages showed the same ordering in the reported EN.MC test. Accuracy was 65.50 without Pons Awaken retrieval, 64.19 without Pons Match and 70.74 without Flow Filter, against 77.73 for full PonsRAG. The paper presents these as ablation values, not as inferential tests.

The matching rule also changed both scores and context load. Strict 1-to-1 matching recorded 77.73 EN.MC accuracy and 35.13 EN.QA F1 while using 1,187 context tokens. Dense matching recorded 68.12 accuracy and 28.65 F1 while using 5,203 tokens. In these reported comparisons, the stricter rule was paired with higher scores and a smaller retrieved context.

Where the pattern was strongest

The paper's more detailed analysis found that average semantic distance between the Character and Plot layers rose from 0.231 to 0.377 as documents became longer. PonsRAG's advantage was most pronounced on queries labeled Mix. ComoRAG led PonsRAG by 4% on Plot QA, but trailed it by nearly 8% on Mix QA.

On an EN.QA subset, PonsRAG also outscored HiRAG on F1, 34.38 to 21.37. Its reported token use was 1.08 million versus 95.81 million for HiRAG, while retrieval time was 6 seconds versus 49 seconds. In that subset, the higher reported score was accompanied by the lower reported token and time load.

Questions the tests leave open

The evidence has a defined boundary. The authors state that the evaluation was limited to long narrative reasoning benchmarks and did not examine multi-hop question answering or more general long-context tasks. The findings therefore do not establish performance on those untested tasks.

The document is an arXiv preprint, version 1, dated 26 August 2026. Its acknowledgment reports support from Chinese national and Guangdong provincial research foundations and programs, including grants 62306112, 2026A1515010253, 2026B0101100004, 62276279 and 2024B1515020032.

Paper data and sources

Original title: PonsRAG: A Pons-Inspired RAG Bridging Cognitive Islands for Coordinated Long Narrative Reasoning
Authors: Rongchen Zhao, Yu Chen, Juyuan Wang et al.
Journal/Repository: arXiv
Status: Preprint, not yet peer-reviewed
First online: 2026-08-26
DOI: Not available
Original paper · Full text

Versions and corrections

  1. Published automatically after legal-source, freshness, evidence, and independent-verification gates passed.