07 · Proof
How we test whether our method sees topics early
A retrospective blind test: at six past dates, our method recommended topics using only sources published before that date; twelve months later, public measures decided which ones materialized.
of predictions materialized
in the control group
median head start over the mainstream
Retrospective blind test 2024–2025 · six validated industries pooled · strict measurement
This quarter only. All six quarters for Energy & Utilities: 37 % vs 20 % in the control group.
Study design in four steps
Study design in four steps
Travel back
Six cutoffs between January 2024 and April 2025. The method sees only what was public at that date – no later news, no prices, no announcements.
Recommend
From those sources, the method recommends topics, each with a reasoning and a list of sources. The control group is drawn from the same sources, just without the method’s selection, so any hindsight the model has helps both groups equally.
Score with fixed criteria
Twelve months later, a second routine measures the topic across a wide range of broad public sources, grouped into three channels: search interest, news coverage and expert communities. Materialization must show in at least two of the three channels.
Let reality decide
Hit rate and lead are published without after-editing. Topics without a measurable signal count as “not measurable” and are excluded from the rate.
The blind test, hands-on
Six industries, six cutoffs. Switch the industry and the quarter to see the method work on a concrete example.
Four more industries are in exploratory testing.
Choose a topic to see its card.
Control topics come from the same model and the same sources, so any hindsight the model might carry helps both sides equally – the gap comes from the selection method.
Results by industry
| Industry | plinio® TL | Control | Lead | Median head start | |
|---|---|---|---|---|---|
| Technology & Software | 45 % | 23 % | +22 pts | 10 months | View industry → |
| Insurance & Risk | 51 % | 32 % | +19 pts | 8 months | View industry → |
| Manufacturing & Industry | 45 % | 26 % | +19 pts | 9 months | View industry → |
| Banking & Fintech | 44 % | 26 % | +18 pts | 9+ months | View industry → |
| Energy & Utilities | 37 % | 20 % | +17 pts | 9 months | View industry → |
| Healthcare & Life Sciences | 46 % | 39 % | +7 pts | 8 months | View industry → |
| Six industries pooled | 44 % | 28 % | +16 pts | ~9 months |
Validated in six industries. Four more are in exploratory testing because our historical sources underrepresent them.
Why 44 % is strong
A hit rate is only informative if you know the base rate. In the control group, drawn from the same sources and the same model, only 28 % of topics materialize. That is better than chance, but clearly less than 44 %. The gap comes from the method’s selection.
Base rate, not a coin flip
Without a comparison, a hit rate tells you nothing. The control group is what makes the 44 % readable: 16 points more than the same model delivers without the method’s selection. The difference comes from the method, not the model.
Much to gain, little to lose
A topic that materializes early opens markets and analyst conversations and gives you category leadership. A topic that does not materialize is still no loss: it remains a sourced expert piece with communication value, published in a field with little competition. The payoff sits with the hits. That is why a rate well above the base rate is worth more over time than a high rate bought with arbitrary recommendations.
More than an analyst can cover
No analyst has the time to evaluate, follow and interpret this many sources every day. plinio TL does exactly that for your markets, and only shows you the topics that pass all four tests.
The 44 % hit rate is only the lower bound of our measurement.
- Strict success definition: a topic only counts as materialized if it rises in two of three channels at the same time – search interest, news coverage and expert communities. A topic that breaks through in only one channel counts as a miss. That makes 44 % a lower bound.
- Measurement uses broad public channels. Many B2B topics take hold first in trade media, analyst reports and conference programmes – where your customers read. The test does not capture those wins.
- In the test, the method works from a typical persona per industry. In use, plinio TL knows your company, your competitors and your sources, and selects more precisely.
- Fair control: comparison topics come from the same model and the same sources. Any hindsight the model carries helps both sides equally; the gap comes from the selection.
- Newer cutoffs score better, in both groups. What counts is therefore the gap to the control group, not the absolute rate.
- Six industries are validated; four more are in exploratory testing.
Our public predictions are timestamped in the Bitcoin blockchain. They can be neither changed nor backdated later – and anyone can verify that.