Preprint

Model predicts parallel search times before files are opened

Preprint: A framework compares five tree-search strategies, but its accuracy changes with capacity and worker limits.

A quick forecast before the search begins

Researchers have built a mathematical framework that estimates how long a hierarchical signature search should take before any file is read. Here, a signature search means looking for a specified marker within a hierarchy of nodes. The framework compares five strategies, ranging from sequential work to full-tree parallelism, and accounts for both what is known about the number of signatures and the capacity of each file. Its central use is to estimate completion time before work begins.

The five strategies are not simply five versions of the same schedule. At one end is sequential searching; at the other is a full-tree parallel scheme. The paper treats the most aggressive option, S5, as an idealized lower bound on latency, a best-case floor set by the search dependencies. That floor comes with a resource price, so it is a reference point for planning rather than an unconditional forecast for a machine with a limited number of workers.

How the estimate is built

For each searched node, the model mixes two possibilities. If the node holds a signature, its scan time follows a discovery-time pattern; if it does not, the scan follows the full-scan, no-signature pattern. This lets the overall estimate reflect both early discoveries and fruitless scans, with the probability of a signature controlling the mix.

When the number of signatures is known, placement is handled with a multivariate hypergeometric law, a probability rule that keeps the fixed total while distributing signatures among layers. That choice matters because a simpler uniform-composition count can assign the wrong weight to how signatures are spread. The authors also separate three capacity classes and label the exactness of each expression, giving readers a way to see where a result is exact and where it is an approximation.

Close in the main test

The formulas were checked against a discrete-event Monte Carlo simulator built under the same model. In the basic node-scan calculation, the mixture mean stayed within 0.1% of simulation across assumed signature probabilities from 0.1 to 1. That is a strong check on the local building block, although it does not by itself show that every end-to-end strategy estimate will be equally accurate.

In the reported design example, analytical and simulated times were close for every strategy: S1 was 1170.0 versus 1173.8, S2 was 4.0 versus 4.0, S3 was 156.0 versus 156.5, S4 was 35.2 versus 35.1, and S5 was 1.0 versus 1.0. The example's calculation took under 1 millisecond and came within 0.5% of simulation. Those figures show what the framework can do in a setting where its assumptions line up, not a guarantee for every tree or workload.

Accuracy depends on the regime

The results changed sharply when the parameter regime changed. The reported plug-in errors were 0.07% when the associated parameter product was 5, 1.1% when it was 3, and 74% when it was 0.6. In other words, the shortcut can be nearly exact in one case and badly off in another. The paper's own examples therefore make the operating regime part of the result, not a footnote.

For S4, the authors offer a numerical convolution route for cases where the asymptotic shortcut is less dependable. In the tested configurations, that numerical route stayed within 0.06% of simulation. The asymptotic formula's reported error was 0.5% with subtrees of size 100 and 50 parallel subtrees, but 3.3% with subtrees of size 4 and five parallel subtrees. The contrast points to a practical choice: use the more involved calculation when the configuration is small or otherwise outside the approximation's reliable range.

The occupancy test offered another warning. The multivariate hypergeometric law matched simulation point by point, while the uniform-composition alternative overstated the probability of a zero minimum by about five times and inflated the estimated layer time by 4%. A seemingly minor change in how fixed signature counts are distributed can therefore move the final timing estimate.

Hardware narrows the gap

A multicore prototype gave a more practical, and less dramatic, picture. Across eight prototype trees, the median speedup over S1 at eight workers was 3.69 for S2, 3.03 for S3, 3.02 for S4, and 4.30 for S5. At four workers, the corresponding medians were 3.07, 2.59, 2.58, and 3.45. S5 and S2 were fastest in these measurements, while S3 and S4 were effectively tied.

That prototype result also marks the boundary of the model. The formulas assume homogeneous subtrees, uniform signature positions, signature inheritance, no global cancellation and unbounded processors. The paper reports a 20% separation between some formula predictions, yet says that finite worker pools and dispatch or synchronization overhead can make close strategy differences disappear. The known-count S4 case also remains unresolved when the known number of signatures in a layer is at least the realized width multiplied by per-file capacity.

A planning calculator, not a promise

Taken together, the work is best read as a planning calculator with a calibration step. It can put five search strategies on a common timing scale before execution, and in the reported design example it did so quickly and closely. But the right formula depends on what is known, how capacity is represented, and how much parallel hardware is actually available. The preprint's evidence supports careful comparison under stated assumptions, while broader workloads and bounded-worker systems remain open tests.

Paper data and sources

Original title: Probabilistic Performance Analysis of Parallel Signature Search Strategies in Multi-Level Tree Networks
Authors: Jingwei Li, Thomas G. Robertazzi
Journal/Repository: arXiv
Status: Preprint, not yet peer-reviewed
First online: 2026-08-25
DOI: Not available
Original paper · Full text

Versions and corrections

  1. Published automatically after legal-source, freshness, evidence, and independent-verification gates passed.