Efficient Semantic Feature Concentrator (ESFC)

• The paper introduces ESFC, an innovative module that integrates dynamic expert convolutions, residual ghost blocks, and dual-domain guidance to boost semantic extraction.
• ESFC efficiently processes fused deep feature maps within the EFSI-DETR framework, preserving both semantic richness and spatial precision in UAV imagery.
• Empirical results show ESFC reduces model parameters by 1.5M and improves average precision by 0.4 with negligible increase in FLOPs.

The Efficient Semantic Feature Concentrator (ESFC) is a modular architectural component introduced to enable deep semantic extraction with minimal computational overhead in real-time small object detection frameworks, particularly within the EFSI-DETR detector for UAV imagery. ESFC is designed to operate atop a fused deep feature map output by the preceding Dynamic Frequency-Spatial Unified Synergy Network (DyFusNet). It comprises three sequential submodules: Dynamic Expert Convolution (DEConv), Residual Ghost Blocks (EGBlock), and a Dual-domain Guidance Aggregation (DGA), collectively yielding adaptively reweighted semantic features while maintaining efficiency in parameters and FLOPs (Xia et al., 26 Jan 2026).

1. Architectural Composition of ESFC

ESFC processes an input feature map $X \in \mathbb{R}^{C \times H \times W}$ and is structured as follows:

• Dynamic Expert Convolution (DEConv): Implements $K$ parallel 3×3 convolutional "experts" $\{W_k\}_{k=1}^K$. A lightweight gating network, constructed from global average pooling (GAP) and a two-layer MLP with ReLU and softmax, predicts non-negative scalars $\{\delta_k\}$ for expert weighting:

$$s = \mathrm{GAP}(X), \quad [\delta_1,\ldots,\delta_K] = \mathrm{softmax}\left(W_2\,\sigma(W_1\,s)\right)$$

The weighted expert outputs are summed:

$$F_{\mathrm{DEConv}}(X) = \sum_{k=1}^{K} \delta_k (W_k * X)$$

• Residual Ghost Blocks (EGBlock): Each EGBlock takes $U \in \mathbb{R}^{C \times H \times W}$, applies a primary pointwise conv ($W_{\mathrm{pri}}$, producing $F_{\mathrm{pri}}$), a cheap depthwise conv ($W_{\mathrm{cheap}}$, producing "ghost" features $F_{\mathrm{ghost}}$), concatenates outputs, and optionally projects to $C$ channels. $N$ EGBlocks are stacked with residual connections:

$$U_0 = F_{\mathrm{DEConv}}(X),\quad U_{i+1} = U_i + \mathrm{EGBlock}(U_i),\quad i=0\ldots N-1$$

• Dual-domain Guidance Aggregation (DGA): Aggregates both channel and spatial guidance:
  • Channel guidance:

  $$k_{\mathrm{chan}} = \left|\frac{\log_2 C + b}{\gamma}\right|_{\mathrm{odd}},\quad g_c = W_{k_{\mathrm{chan}}} * \mathrm{AvgPool}(U_N)$$ - Spatial guidance:

  $$S = [\mathrm{AvgPool}(U_N);\mathrm{MaxPool}(U_N)],\quad g_s = \sigma(W_s * S)$$ - Final modulation:

  $$F_{\mathrm{ESFC}}(X) = U_N \odot g_c^{(\text{broadcast})} \odot g_s^{(\text{broadcast})}$$

2. Integration Strategy Within EFSI-DETR

ESFC is integrated at the deepest stage (post-fusion feature $F_3$) of the three-stage DyFusNet multi-scale feature outputs in EFSI-DETR. The ESFC-modulated feature $\mathrm{ESFC}(F_3)$ forms one input to the HybridEncoder. Fine-grained Feature Retention (FFR) supplies non-ESFC-processed shallow features ($S_1, S_2$) via skip connections. This arrangement preserves both semantic richness and spatial precision before DETR-style decoding for bounding box prediction (Xia et al., 26 Jan 2026).

3. Computational and Parametric Analysis

ESFC is explicitly designed for minimal overhead relative to overall detector size:

Subcomponent	Parameters (millions)	FLOPs @ 160x160 input
DEConv ($K=3$)	~1.8
2×EGBlock	~0.36
DGA	~0.07 (channel) + minor spatial
Total ESFC	≃2.3	≲0.5 GFLOPs
% of full model	~8% (params), ~0.2% (FLOPs)

In the context of the full EFSI-DETR (27 M parameters, 291 GFLOPs), ESFC demonstrably incurs negligible computational burden yet provides significant representational benefits.

4. Empirical Ablation and Performance Outcomes

Ablation analysis elucidates ESFC’s contribution and parameterization:

• Number of Experts (K):

  • $K=2$: 27.2 M params, AP=32.6, AP₅₀=52.1
  • $K=3$: 27.3 M params, AP=33.1, AP₅₀=52.7 (optimal)
  • $K=4$: 27.5 M params, AP=32.3
• Insertion stage (deep, D):
  • Shallow: AP=31.3
  • Middle: AP=32.5
  • Deep: AP=33.1
• Comparative gain:
  • Baseline + FFR + DyFusNet: 28.8 M params, AP=32.7
  • +ESFC: 27.3 M params, AP=33.1 (+0.4 AP, –1.5M params)

This demonstrates that ESFC not only improves detection metrics (AP, AP₅₀, APₛ), but also reduces overall parameterization, primarily via redundancy reduction in ghost blocks.

5. Module Implementation and Integration Workflow

The ESFC operational workflow can be stated as follows:

def ESFC(X): # X: (C, H, W) # Dynamic Expert Convolution s = GAP(X) δ = softmax(W2 @ ReLU(W1 @ s)) Y = sum(δ[k] * Conv3x3_k(X) for k in range(K)) # Residual Ghost Blocks U = Y for _ in range(N): U = U + EGBlock(U) # Dual-domain Guidance Aggregation kc = make_odd(round((log2(C) + b) / γ)) gc = Conv_kcxkc(AvgPool(U)) S = concat(AvgPool(U), MaxPool(U)) gs = sigmoid(Conv1x1(S)) # Modulation return U * broadcast(gc) * broadcast(gs)

Within EFSI-DETR, the ESFC-processed feature joins multi-scale features and shallow skips in the HybridEncoder, which then feeds into a DETR-style decoder.

6. Significance, Applicability, and Limitations

The ESFC demonstrates a generalizable methodology for efficient semantic feature enhancement, particularly valuable in domains with constraints on computational budget and detection granularity (e.g., UAV-based small object detection). Its architectural philosophy—expert gating, redundancy-minimized residual blocks, channel/spatial reweighting—could plausibly be adapted to various detection pipelines, including both DETR-style and traditional one-/two-stage detectors.

A plausible implication is that such lightweight concentration modules, when applied judiciously at deep stages post-frequency/spatial fusion, can yield nontrivial gains in both accuracy and parameter efficiency. The necessity of multi-domain aggregation (frequency-spatial and semantic) is substantiated by the superior performance realized by integrating ESFC as evidenced in controlled ablations (Xia et al., 26 Jan 2026).

7. Relation to Research Trends and Future Directions

ESFC aligns with research trajectories emphasizing efficient semantic enrichment for detection under resource constraints. Its adoption of dynamic expert convolution reflects the broader movement toward mixture-of-experts and adaptive computation in vision systems. The use of ghost blocks for redundancy reduction and dual-domain aggregation for robust reweighting address limitations in static convolutional backbones and generic attention pooling.

Future exploration may include extending ESFC’s principles to fully transformer-based architectures, investigating synergistic expert specialization, and adapting dual-domain guidance strategies for fine-tuning spatial/semantic trade-offs in even more stringent real-time or embedded scenarios.