AI for Researchers · Visual Deck
Citation-grounded tools, deep-research agents, and how to check either one
{{Presenter Name}}
Landscape as of August 2026
2-Minute Recap
flowchart LR a1(["Capability/Failure Map
Safe · Unreliable · Dangerous"]):::art --> T(["Today — Session 2
we live inside Tier 2 and Tier 3,
and learn to verify what each hands us"]):::today a2(["2026 Tool Taxonomy
Tier 1 chatbots · Tier 2 research-specific
· Tier 3 deep-research agents"]):::art --> T a3(["CRIT
Context · Role & register ·
Instructions · Task — then iterate"]):::art --> T classDef art fill:#23204c,stroke:#8f8cb8,color:#eceaf8,font-size:18px classDef today fill:#ab7d22,stroke:#d9b36c,color:#14132b,font-size:19px
Hallucination is structural, not an occasional glitch —
and "ask an AI for references from memory" sits in Dangerous [26]
Learning Objectives
Objectives 4–6 next · full verbatim wording in the reference deck and curriculum
Learning Objectives
Full verbatim wording in the reference deck and curriculum
Section 01
Two different matching methods, two different blind spots. Knowing which one you are using tells you what you have not seen.
Literacy Foundation
Keyword (lexical)
flowchart LR W["the words
you typed"]:::io --> B["BM25
exact matching"]:::blue --> R["same query,
same results, next year"]:::norm classDef io fill:#23204c,stroke:#8f8cb8,color:#eceaf8,font-size:19px classDef blue fill:#1c1a3f,stroke:#5f82c8,color:#9db4e8,font-size:19px classDef norm fill:#23204c,stroke:#8f8cb8,color:#b9b7d6,font-size:19px
classic method: BM25 [1] · Boolean AND / OR / NOT, field limits, exact phrases · deterministic
Semantic (embedding)
flowchart LR M["the meaning
of your question"]:::io --> V["vectors — nearest
papers win"]:::hot --> R2["a ranked list —
changes with the model"]:::norm classDef io fill:#23204c,stroke:#8f8cb8,color:#eceaf8,font-size:19px classDef hot fill:#1c1a3f,stroke:#d9b36c,color:#d9b36c,font-size:19px classDef norm fill:#23204c,stroke:#8f8cb8,color:#b9b7d6,font-size:19px
query and papers become vectors [1] · finds synonyms and paraphrases you never thought of · ranked, opaque
Literacy Foundation
flowchart TB H["hybrid search — embeddings + BM25
Consensus' 2025 pipeline"]:::wide --> T1["top 1,500 re-ranked
recency · citation count · journal impact"]:::mid --> T2["top 20 re-scored"]:::narrow --> S(["synthesis"]):::hot classDef wide fill:#23204c,stroke:#5f82c8,color:#eceaf8,font-size:19px classDef mid fill:#23204c,stroke:#8f8cb8,color:#b9b7d6,font-size:19px classDef narrow fill:#1c1a3f,stroke:#8f8cb8,color:#b9b7d6,font-size:19px classDef hot fill:#1c1a3f,stroke:#d9b36c,color:#d9b36c,font-size:19px
"Is it semantic or keyword?" is the wrong question. Ask: what did the re-ranker throw away before I ever saw it?
Literacy Foundation
Keyword misses…
Semantic misses…
The Evidence
Four completed evidence syntheses, re-run through Elicit Pro in Review mode, measured Feb–Mar 2025 [3]
The Evidence
The honest framing: both methods are biased. Use them against each other.
Section 02
Six citation-grounded tools, described from their own documentation — what each indexes, how each grounds an answer, and what it costs.
Tier 2 — Research-Specific Tools
flowchart LR S["SEARCH the scholarly
corpus first"]:::safe --> P["the papers exist
before the prose does"]:::norm --> G["generate second"]:::hot classDef safe fill:#1c1a3f,stroke:#2fae74,color:#7fd6a4,font-size:20px classDef norm fill:#23204c,stroke:#8f8cb8,color:#eceaf8,font-size:20px classDef hot fill:#23204c,stroke:#d9b36c,color:#d9b36c,font-size:20px
Consensus puts it plainly: "We only use AI after we search the scientific literature." [1]
Series Artefact
Corpus figures are vendor-stated, not independently audited · row order is not a ranking — no endorsement implied · full cells in the reference deck
Series Artefact
Pricing and features change monthly — re-check before relying on a cell · undocumented capabilities are stated as such, not guessed
Critical Literacy
Nobody is lying: "works", "papers", "documents" and "sources" count different things. A bigger index is not a better search — the independent head-to-head measured 39.5% sensitivity (Feb–Mar 2025) [3]; vendors' own newer benchmarks are self-graded [33]. All figures vendor self-reported; none independently audited.
Section 03
They plan, browse, read and return a long report with citations. Three audits tell us exactly how far to trust that report.
Tier 3 — Deep-Research Agents
flowchart LR P["plan"]:::n --> S["search"]:::n --> R["read"]:::n --> I["iterate…"]:::n I --> S I --> REP["cited report
minutes, not seconds"]:::hot classDef n fill:#23204c,stroke:#8f8cb8,color:#eceaf8,font-size:19px classDef hot fill:#1c1a3f,stroke:#d9b36c,color:#d9b36c,font-size:19px
The Tier 2 / Tier 3 line is blurring: agents search the open web — and via MCP can call Scite, Elicit and Consensus directly [13] [33] [36]
Tier 3 — Deep-Research Agents
The Evidence
Critical Literacy
The 39.5% headline is the mean of four syntheses — it describes none of them [3]. What counts as a "hit" depends on the review's criteria and the query, not the tool alone [3]. Rule: before believing a headline number, ask what counted as a hit — and how many topics it was averaged over. Every performance figure in this deck is from independent evaluation [3] [24] [25] [31].
Section 04
Systematic reviews, coverage bias, and paywalled literature — where these tools need more scrutiny than the interface suggests.
Caution Zone 1
Caution Zone 2
Africa is underrepresented in all three; high-income economies over-represented in Scopus and WoS [29]. Open is not simply worse — OpenAlex's reference coverage is comparable on shared publications [30]. Every AI tool inherits its index's shape. Ask which index, then ask who it leaves out.
Caution Zone 3
Practical move: route the shortlist through your institutional access before you summarise it.
Caution Zone 3
"Neither GS nor one of the other databases investigated, is on its own, an acceptable database to support systematic review searching." [2] — holding a paper and surfacing it are different problems, for every tool in the matrix.
Series Artefact
flowchart LR A["1 · Resolve it
necessary —
no longer sufficient"]:::warn --> B["2 · Match it
authors · year ·
journal · title — all four"]:::n --> C["3 · Open it
find the sentence
that carries the claim"]:::n --> D["4 · Compare it
weaker, narrower
or opposite?"]:::n --> E["5 · Check the direction
later contradicted?"]:::n classDef n fill:#23204c,stroke:#d9b36c,color:#eceaf8,font-size:18px classDef warn fill:#1c1a3f,stroke:#c14b58,color:#ef9a9a,font-size:18px
Step 1: frontier systems now keep link validity above 94% [31] — in 2025 audits 5–18% still failed here [25]. Steps 1–2 catch fabrication; steps 3–5 catch misreading — now the dominant failure: with links valid, factual support runs 39–77% [31], and grounded tools do not remove it [1] [26]. Direction check: [13] [24]
Systematic Prompting
One answerable question, with the population, comparison and outcome named. Then constrain with the interface, not the prose.
C — the question, in one sentence · I — year, design and open-access filters · T — one claim at a time, then re-ask
Your field, what counts as evidence, a source per claim, and an explicit list of what it could not reach.
C+R — disciplines, audience, register · I — demand disconfirming evidence: audited systems did not volunteer it [24] · T — edit the plan before it runs [21]
— Context · — Role & register · — Instructions & constraints · — Task
Live Demo & Takeaways
References
References