G-Retriever GraphQA: Scalable Graph Retrieval

• G-Retriever GraphQA is a retrieval-augmented generation framework that integrates graph-centric retrieval with LLM prompting for explainable, multi-hop question answering.
• It employs embedding-based top-k retrieval, PCST-based subgraph extraction, and GAT-MLP projection to generate succinct, grounded textual summaries.
• Empirical results demonstrate improved accuracy, reduced hallucination, and scalable performance on benchmarks like ExplaGraphs, SceneGraphs, and WebQSP.

A G-Retriever GraphQA system is a retrieval-augmented generation (RAG) framework that enables LLMs to answer questions over large, real-world graphs with textual node and edge attributes by interleaving graph-centric information retrieval with parameter-efficient LLM prompting. Unlike prior approaches that focus on small or synthetic graphs, or that perform reasoning on flat representations prone to context truncation and hallucination, G-Retriever decomposes the pipeline into embedding-based top-k retrieval, subgraph construction via combinatorial optimization, and prompt-based answer generation. This architecture efficiently scales to graphs with thousands of nodes/edges, supports explainability via answer-supporting subgraphs, and empirically mitigates hallucination and information loss in multi-hop and long-context reasoning tasks (He et al., 2024).

1. Problem Formulation and Benchmark

G-Retriever addresses the problem of free-form question answering over “textual graphs,” formally defined as $G = (V, E, \{x_n\}_{n\in V}, \{x_e\}_{e\in E})$, where each node $n$ and edge $e$ has a text attribute ($x_n \in \mathbb{D}^{L_n}$, $x_e \in \mathbb{D}^{L_e}$). Given a natural language question $q$ about $G$, the system is tasked to output both an answer $Y$ and a highlighted subgraph $(V^*, E^*) \subseteq G$ that supports $Y$.

A key innovation is the GraphQA benchmark suite, comprising:

• ExplaGraphs: Commonsense stance (accuracy metric), avg. 5.17 nodes/4.25 edges.
• SceneGraphs: Open-ended scene QA, avg. 19.13 nodes/68.44 edges.
• WebQSP: Multi-hop knowledge QA subset from Freebase, avg. 1,370 nodes/4,252 edges (Hit@1 metric).

Benchmark evaluation focuses on accuracy (ExplaGraphs, SceneGraphs) and Hit@1 (WebQSP). Questions target multi-hop, scene, knowledge, and commonsense reasoning.

2. G-Retriever System Architecture

The G-Retriever pipeline interleaves retrieval and generation in a four-stage architecture:

1. Indexing: Compute LLM (LM) embeddings for all nodes and edges, storing outputs in an approximate nearest neighbor (ANN) index (e.g., Faiss).
2. Retrieval: Given a query $n$0, encode it as $n$1. Retrieve top-$n$2 nodes $n$3 and edges $n$4 by cosine similarity in the embedding space.
3. Subgraph Construction (PCST): Formulate minimal subgraph extraction as the Prize-Collecting Steiner Tree (PCST) problem:

$n$5

where $n$6, $n$7 are retrieval-rank-based prizes and $n$8 is an edge cost. A near-linear PCST solver produces a relevant, small, connected subgraph.

1. Generation:
   • Encode $n$9 with a graph attention network (GAT) to compute a graph embedding $e$0.
   • Project $e$1 into the LLM embedding space via an MLP.
   • Linearize $e$2 into a succinct textual summary.
   • Soft prompting: Concatenate projected $e$3 and $e$4 as input to a frozen LLM (e.g., LLaMA-2-7B).
   • Backpropagate only through the GNN and projection layers (“graph prompt-tuning”).

All reasoning steps are thus grounded in a minimal, query-relevant, and context-constrained subgraph (He et al., 2024).

3. Formal Subgraph Optimization and RAG Mechanics

Subgraph selection is cast as PCST with the following properties:

• Each top-$e$5 node/edge receives a nonnegative prize: $e$6 (rest are zero).
• Edges have fixed cost $e$7.
• Edge prizes can be mapped to nodes via “virtual nodes.”
• The optimal subgraph $e$8 must be connected, guaranteeing that multi-hop paths relevant to the question are preserved.

RAG mechanics proceed as:

• Use a text encoder (e.g., Sentence-BERT) for embedding.
• ANN search retrieves top-$e$9 nodes/edges.
• PCST produces $x_n \in \mathbb{D}^{L_n}$0 for grounded context.
• GAT pooling and MLP projection produce the prompt embedding.
• Only GNN/MLP parameters are trained; the LLM is fixed.

4. Empirical Performance and Ablation Analysis

Quantitative results on the GraphQA benchmark demonstrate the system’s robustness and empirical superiority over baselines.

Dataset	Baseline (PT w/o retrieval)	G-Retriever	LoRA Baseline	G-Retriever+LoRA
ExplaGraphs	0.5876	0.8696	0.8741	0.8768
SceneGraphs	0.6851	0.8614	0.8594	0.9077
WebQSP (Hit@1)	0.4975	0.6732	0.6174	0.7011

Efficiency gains are pronounced, e.g., for WebQSP the token count after retrieval drops $x_n \in \mathbb{D}^{L_n}$1 ($x_n \in \mathbb{D}^{L_n}$2), and node count drops $x_n \in \mathbb{D}^{L_n}$3 ($x_n \in \mathbb{D}^{L_n}$4).

Ablations reveal the importance of each module: removing the graph encoder ($x_n \in \mathbb{D}^{L_n}$511.42\% Hit@1 on WebQSP), the projection layer ($x_n \in \mathbb{D}^{L_n}$62.32\%), the textual subgraph ($x_n \in \mathbb{D}^{L_n}$719.58\%), node retrieval ($x_n \in \mathbb{D}^{L_n}$81.10\%), or edge retrieval ($x_n \in \mathbb{D}^{L_n}$913.29\%) all degrade performance (He et al., 2024).

5. Hallucination Mitigation and Scalability

G-Retriever demonstrates strong hallucination resistance. On scene graphs, citation-validity (i.e., proportion of answers with fully valid grounding) climbs from 8\% (frozen LLM w/ prompt tuning) to 62\% (+54\%) with G-Retriever; node and edge citation validity also increase dramatically ($x_e \in \mathbb{D}^{L_e}$0, $x_e \in \mathbb{D}^{L_e}$1).

Scalability is ensured by (i) subgraph selection that fits within model context, (ii) connectivity constraints for multi-hop preservation, and (iii) parameter-efficient finetuning: only the GNN and projection require updates.

6. Algorithmic Design and Implementation

Pseudocode for G-Retriever GraphQA Core Loop:

$x_e \in \mathbb{D}^{L_e}$2 Gradients flow through the GAT and MLP, not the LLM.

7. Significance, Impact, and Future Directions

G-Retriever bridges the gap between graph-structured retrieval and scalable, faithful generative answer synthesis. Its design enables:

• Scalability: Efficient subgraph selection on graphs with thousands of nodes/edges.
• Faithfulness: All reasoning steps are grounded in retrieved graph elements, sharply reducing hallucinations.
• Parameter efficiency: Pure prompt tuning by freezing the LLM and updating only a small GNN head.

The approach forms the basis for subsequent research on combinatorial subgraph selection, prompt-based grounding of LLMs, and retrieval-augmented explainability in GraphQA. Empirical advances set new performance levels on multi-domain benchmarks and mark a shift towards explainable, scalable graph reasoning under tight context constraints (He et al., 2024).