RSS Evaluation Framework

• RSS Evaluation Framework is a comprehensive methodology that benchmarks localization accuracy by integrating parametric path-loss models with particle filtering techniques.
• It delineates experimental protocols that assess performance with metrics such as RMSE, convergence speed, and error variance across both good and bad sensor geometries.
• Empirical analysis demonstrates that particle filtering significantly improves robustness over traditional trilateration, especially in high-noise and poor geometric configurations.

A Received Signal Strength (RSS) evaluation framework provides the methodological and quantitative infrastructure for experimentally assessing RSS-based localization algorithms and systems. Such a framework delineates the measurement models, algorithmic approaches, noise models, experimental protocols, performance metrics, and design guidelines necessary for rigorously benchmarking localization accuracy and robustness, particularly under the practical realities of sensor geometry and signal variability. In the canonical formulation, RSS evaluation is essential for validating algorithms that estimate the position of a stationary target from distributed signal measurements, especially in applications such as wireless sensor networks, surveillance, and search and rescue.

1. Measurement Model and Signal Assumptions

The framework is grounded by a parametric path-loss model describing the physical relationship between the unknown target position $x\in\mathbb{R}^2$ and observed RSS values at $M$ sensors with known locations $s_m$:

$$\hat{P}_m = P_0 - 10\beta \log_{10} \left( \frac{\| x - s_m \|}{d_0} \right) + v_m,\qquad v_m \sim \mathcal{N}(0,\sigma^2)$$

Key parameters:

• Reference RSS $P_0 = -30\,$dB at distance $d_0 = 1\,$m,
• Path-loss exponent $\beta = 2.5$,
• Additive measurement noise $v_m$ is i.i.d. Gaussian with standard deviation $\sigma$ ($\sigma$ varied between $1\,$dB and $10\,$dB to model different multipath/interference conditions).

The framework evaluates performance over both low- and high-noise regimes and systematically varies $\sigma$ to assess algorithmic robustness.

2. Particle Filtering Algorithmic Core

The primary algorithm under evaluation is a particle filtering approach explicitly tailored for stationary target localization. The state-space model is degenerate with process model $x_t = x_{t-1}$ and thus no process noise. The measurement update for particle $i$ at position $p^{(i)}$ uses

$$P_m^{(i)} = P_0 - 10\beta \log_{10} ( \| p^{(i)} - s_m \| + \epsilon )$$

where $\epsilon = 10^{-3}$ regularizes the log to avoid singularities at zero distance. Particles are initialized uniformly in the search area $[-50,50]^2$.

Importance weights for each particle at time $t$:

$$w_t^{(i)} \propto \exp\left( -\frac{1}{2\sigma^2} \sum_{m=1}^M [\hat{P}_m - P_m^{(i)}]^2 \right)$$

Weights are normalized, and the expected target estimate is taken as the mean of the (possibly resampled) particle set.

Resampling is controlled by a ratio $\rho$ (default $\rho=0.9$): the top $\rho N$ weighted particles are retained, and the remaining $(1-\rho)N$ replaced by new random samples.

Typical operational parameters are $N\in[1000,5000]$ particles, $\rho \in [0.8,0.95]$, $\epsilon=10^{-3}$, matching the above path-loss and noise settings.

3. Experimental Protocols and Sensor Geometries

Evaluation is performed over two fundamental sensor placement scenarios:

• Good geometry: Sensors arranged at the corners around the target, maximizing angular spread.
• Bad geometry: All sensors are co-located or clustered on one side of the target, embodying poor geometric diversity.

In all cases $M=4$ sensors are used, and the search area is a $100\times100$ m square.

Each simulation run comprises $T=100$ independent epochs, with each epoch bringing a new independent RSS measurement. Error metrics are averaged over these to capture steady-state as well as transient convergence behavior, and Monte Carlo trials are repeated to estimate error variance.

4. Evaluation Metrics and Quantitative Criteria

Three main classes of metrics provide a comprehensive performance profile:

• Root-mean-square error (RMSE):

$$\mathrm{RMSE}(T) = \sqrt{ \frac{1}{T} \sum_{t=1}^{T} \| \hat{x}_t - x^* \|^2 }$$

where $x^*$ is the true target position.

• Convergence speed: Number of epochs until RMSE falls below a fixed threshold (e.g., $5$ m).
• Error variance: Standard deviation of localization errors across stochastic trial repetitions.

These metrics support comparative analysis against traditional RSS-trilateration, whose solution is the least-squares fit to observed distances.

5. Key Findings and Analysis

Empirical results demonstrate critical dependencies on sensor geometry and noise:

• Good geometry: Both the particle filter (PF) and trilateration converge to RMSE $4$–$6$ m within $20$–$30$ epochs, with negligible performance difference.
• Bad geometry: The PF exhibits superior robustness: at $\sigma=5$ dB after $T=100$ epochs, PF achieves RMSE $\approx 6$ m vs. $12$ m for trilateration. Error variance is nearly halved for PF ($\pm 2$ m vs. $\pm 4$ m).
• Noise sweep: At $\sigma \leq 2$ dB, methods are similar. For $\sigma \geq 3$ dB, the PF’s non-Gaussian, nonlinear inference yields consistent performance advantages. At $\sigma=10$ dB, PF yields $12$ m error, trilateration $20$ m.
• Variance: PF exhibits $30$–$50$\% lower error variance under adverse conditions.

It is observed that PF’s sampling-based, nonlinear character provides strong resilience in ill-posed (clustered) sensor geometries and at high noise levels, regimes where analytic least-squares methods become highly unstable.

6. Design and Deployment Guidelines

The framework prescribes operational and deployment recommendations based on these results:

• Sensor placement: Favor maximum angular diversity; avoid clustering. PF is essential when clustering is unavoidable.
• Noise handling: PF is tolerable for $\sigma \leq 5$ dB and RMSE $<10$ m; for higher noise, increase $N$ and $T$.
• Particle filter tuning: Use $N \geq 1000$ for moderate fidelity, $N = 5000$–$10,000$ for $\sigma > 7$ dB. Set $\rho \in [0.8,0.95]$, monitor effective sample size (ESS), and resample when $\mathrm{ESS}<N/2$.

The framework provides a clear, replicable recipe for practitioners evaluating RSS-based localization in realistic or adversarial deployment scenarios. Its prescriptions are robust over a wide noise range and geometric spectrum and can be leveraged to guide both experimental studies and fielded system design, ensuring that solutions are optimized not merely for ideal cases but for the practical complexities of wireless sensor network operation (Lee et al., 19 Aug 2025).