Papers
Topics
Authors
Recent
Search
2000 character limit reached

Jackknife-Based Test Statistics

Updated 4 July 2026
  • Jackknife-based test statistics are inferential procedures that use leave-one-out replicates and pseudovalues to estimate bias, variance, and construct test statistics.
  • The classical approach computes delete-one replicates to form pseudovalues and yields Wald-type and chi-square calibrated tests for smooth, iid data.
  • Modern methods, including jackknife empirical likelihood and infinitesimal jackknife, extend these ideas to handle nonlinear U-statistics, model comparison, and complex data structures.

Jackknife-based test statistics are inferential procedures constructed from leave-one-out replicates, jackknife pseudo-values, or infinitesimal perturbations of data weights. In the classical formulation, the jackknife is used for bias estimation, standard error estimation, confidence limits, and test-statistic construction via pseudo-values; in later developments, jackknife empirical likelihood (JEL) converts nonlinear or UU-statistic estimating problems into likelihood-ratio statistics with Wilks-type chi-square limits, while infinitesimal-jackknife methods extend the same perturbation logic to covariance estimation, model comparison, and local approximations to cross-validation and bootstrap re-fitting (McIntosh, 2016, N et al., 2017, Ghosal et al., 2022, Giordano et al., 2019).

1. Classical jackknife construction and the pseudovalue test

The delete-1 jackknife starts from data X1,…,XnX_1,\dots,X_n and forms the jackknife samples

X[i]={X1,X2,…,Xi−1,Xi+1,…,Xn}.\bold{X}_{[i]}=\{X_1,X_2,\dots,X_{i-1},X_{i+1},\dots,X_n\}.

For an estimator s(â‹…)s(\cdot), the ii-th jackknife replicate is

θ^(i):=s(X[i]),θ^(⋅)=1n∑i=1nθ^(i).\hat{\theta}_{(i)}:=s(\bold{X}_{[i]}), \qquad \hat{\theta}_{(\cdot)}=\frac{1}{n}\sum_{i=1}^{n}\hat{\theta}_{(i)}.

The standard jackknife variance estimator is

Var^jack(θ^)=n−1n∑i=1n(θ^(i)−θ^(⋅))2,\widehat{\mathrm{Var}}_{jack}(\hat{\theta}) = \frac{n-1}{n}\sum_{i=1}^{n}(\hat{\theta}_{(i)}-\hat{\theta}_{(\cdot)})^2,

with

SE(θ^)jack={n−1n∑i=1n(θ^(i)−θ^(⋅))2}1/2.SE(\hat{\theta})_{jack}=\Big\{\frac{n-1}{n}\sum_{i=1}^{n}(\hat{\theta}_{(i)}-\hat{\theta}_{(\cdot)})^2\Big\}^{1/2}.

The same construction yields the jackknife bias estimate

bias^jack=(n−1)(θ^(⋅)−θ^),\widehat{\text{bias}}_{jack}=(n-1)(\hat{\theta}_{(\cdot)}-\hat{\theta}),

and the bias-corrected estimator

θ^jack=nθ^−(n−1)θ^(⋅).\hat{\theta}_{jack}=n\hat{\theta}-(n-1)\hat{\theta}_{(\cdot)}.

The central inferential object is the pseudovalue

X1,…,XnX_1,\dots,X_n0

The average pseudovalue equals the jackknife estimator, and the pseudovalues can be treated as if they were independent random variables. This leads to the classical asymptotic normal test statistic

X1,…,XnX_1,\dots,X_n1

where X1,…,XnX_1,\dots,X_n2 is the usual unbiased sample standard deviation computed from pseudovalues. In this form, jackknife-based testing is a Wald-type procedure centered on the average pseudovalue rather than on a direct plug-in asymptotic variance formula (McIntosh, 2016).

For two-sample statistics, the same logic is formalized through asymptotic linearity. If

X1,…,XnX_1,\dots,X_n3

with

X1,…,XnX_1,\dots,X_n4

then the jackknife variance estimator is consistent and asymptotically unbiased for the asymptotic variance

X1,…,XnX_1,\dots,X_n5

This framework is used for common mean estimators under ordered variances, where the estimators are piecewise-defined through random weights and the variance analysis is difficult because the estimator changes form depending on whether X1,…,XnX_1,\dots,X_n6 or X1,…,XnX_1,\dots,X_n7. Under the stated assumptions, these common-mean estimators satisfy a CLT and admit large-sample Wald intervals based on jackknife variance estimation (Steland et al., 2017).

A persistent limitation of the classical jackknife is already explicit in the early resampling literature: it is intended for iid data and smooth or sufficiently linear functionals, is not suitable for correlated data or time series, and may fail for non-smooth estimators such as the median. This limitation became one of the main motivations for pseudo-value likelihood methods and infinitesimal perturbation methods (McIntosh, 2016).

2. Jackknife empirical likelihood and Wilks-type ratio statistics

The modern theory of jackknife-based test statistics is dominated by JEL. Across S-Gini indices, probability weighted moments, and Gini correlations, the construction follows the same pattern: start from a X1,…,XnX_1,\dots,X_n8-statistic or a ratio of X1,…,XnX_1,\dots,X_n9-statistics, rewrite the parameter as the solution of a mean-zero estimating equation, construct jackknife pseudo-values

X[i]={X1,X2,…,Xi−1,Xi+1,…,Xn}.\bold{X}_{[i]}=\{X_1,X_2,\dots,X_{i-1},X_{i+1},\dots,X_n\}.0

and apply ordinary empirical likelihood to the linear constraint induced by the pseudo-values. For the relative S-Gini index X[i]={X1,X2,…,Xi−1,Xi+1,…,Xn}.\bold{X}_{[i]}=\{X_1,X_2,\dots,X_{i-1},X_{i+1},\dots,X_n\}.1, for example, the estimating equation is

X[i]={X1,X2,…,Xi−1,Xi+1,…,Xn}.\bold{X}_{[i]}=\{X_1,X_2,\dots,X_{i-1},X_{i+1},\dots,X_n\}.2

the pseudo-values satisfy

X[i]={X1,X2,…,Xi−1,Xi+1,…,Xn}.\bold{X}_{[i]}=\{X_1,X_2,\dots,X_{i-1},X_{i+1},\dots,X_n\}.3

and the jackknife empirical likelihood is

X[i]={X1,X2,…,Xi−1,Xi+1,…,Xn}.\bold{X}_{[i]}=\{X_1,X_2,\dots,X_{i-1},X_{i+1},\dots,X_n\}.4

The maximizer has the usual EL form, and the jackknife empirical log-likelihood ratio

X[i]={X1,X2,…,Xi−1,Xi+1,…,Xn}.\bold{X}_{[i]}=\{X_1,X_2,\dots,X_{i-1},X_{i+1},\dots,X_n\}.5

satisfies

X[i]={X1,X2,…,Xi−1,Xi+1,…,Xn}.\bold{X}_{[i]}=\{X_1,X_2,\dots,X_{i-1},X_{i+1},\dots,X_n\}.6

This yields the test of

X[i]={X1,X2,…,Xi−1,Xi+1,…,Xn}.\bold{X}_{[i]}=\{X_1,X_2,\dots,X_{i-1},X_{i+1},\dots,X_n\}.7

with rejection rule

X[i]={X1,X2,…,Xi−1,Xi+1,…,Xn}.\bold{X}_{[i]}=\{X_1,X_2,\dots,X_{i-1},X_{i+1},\dots,X_n\}.8

and the inverted confidence set

X[i]={X1,X2,…,Xi−1,Xi+1,…,Xn}.\bold{X}_{[i]}=\{X_1,X_2,\dots,X_{i-1},X_{i+1},\dots,X_n\}.9

The same paper emphasizes the computational rationale: the jackknife converts a nonlinear s(â‹…)s(\cdot)0-statistic inference problem into a linear empirical likelihood problem (N et al., 2017).

For probability weighted moments

s(â‹…)s(\cdot)1

the unbiased estimator is a s(â‹…)s(\cdot)2-statistic based on

s(â‹…)s(\cdot)3

and the JEL ratio

s(â‹…)s(\cdot)4

satisfies

s(â‹…)s(\cdot)5

The adjusted version AJEL appends the pseudo-value

s(â‹…)s(\cdot)6

to avoid convex-hull problems; under s(â‹…)s(\cdot)7,

s(â‹…)s(\cdot)8

Both JEL and AJEL are then used for confidence intervals and for testing

s(â‹…)s(\cdot)9

by chi-square calibration (Bhati et al., 2018).

For Gini correlations, the parameter is a ratio of two ii0-statistics,

ii1

and the estimating kernel is

ii2

The resulting single-parameter JEL ratio satisfies

ii3

The same framework also covers testing the equality of the two Gini correlations,

ii4

and two-sample comparisons of the difference vector

ii5

A recurring theme in these papers is that JEL avoids explicit asymptotic variance estimation while preserving a standard Wilks-type limit under finite-second-moment and non-degeneracy conditions (Sang et al., 2018).

Setting Representative statistic Null limit
Classical pseudovalue test ii6 ii7
Scalar JEL problems ii8, ii9, θ^(i):=s(X[i]),θ^(⋅)=1n∑i=1nθ^(i).\hat{\theta}_{(i)}:=s(\bold{X}_{[i]}), \qquad \hat{\theta}_{(\cdot)}=\frac{1}{n}\sum_{i=1}^{n}\hat{\theta}_{(i)}.0 θ^(i):=s(X[i]),θ^(⋅)=1n∑i=1nθ^(i).\hat{\theta}_{(i)}:=s(\bold{X}_{[i]}), \qquad \hat{\theta}_{(\cdot)}=\frac{1}{n}\sum_{i=1}^{n}\hat{\theta}_{(i)}.1
Two-sample Gini-correlation difference vector θ^(i):=s(X[i]),θ^(⋅)=1n∑i=1nθ^(i).\hat{\theta}_{(i)}:=s(\bold{X}_{[i]}), \qquad \hat{\theta}_{(\cdot)}=\frac{1}{n}\sum_{i=1}^{n}\hat{\theta}_{(i)}.2 θ^(i):=s(X[i]),θ^(⋅)=1n∑i=1nθ^(i).\hat{\theta}_{(i)}:=s(\bold{X}_{[i]}), \qquad \hat{\theta}_{(\cdot)}=\frac{1}{n}\sum_{i=1}^{n}\hat{\theta}_{(i)}.3
θ^(i):=s(X[i]),θ^(⋅)=1n∑i=1nθ^(i).\hat{\theta}_{(i)}:=s(\bold{X}_{[i]}), \qquad \hat{\theta}_{(\cdot)}=\frac{1}{n}\sum_{i=1}^{n}\hat{\theta}_{(i)}.4-sample categorical Gini test θ^(i):=s(X[i]),θ^(⋅)=1n∑i=1nθ^(i).\hat{\theta}_{(i)}:=s(\bold{X}_{[i]}), \qquad \hat{\theta}_{(\cdot)}=\frac{1}{n}\sum_{i=1}^{n}\hat{\theta}_{(i)}.5 θ^(i):=s(X[i]),θ^(⋅)=1n∑i=1nθ^(i).\hat{\theta}_{(i)}:=s(\bold{X}_{[i]}), \qquad \hat{\theta}_{(\cdot)}=\frac{1}{n}\sum_{i=1}^{n}\hat{\theta}_{(i)}.6
Many-instrument IV trinity θ^(i):=s(X[i]),θ^(⋅)=1n∑i=1nθ^(i).\hat{\theta}_{(i)}:=s(\bold{X}_{[i]}), \qquad \hat{\theta}_{(\cdot)}=\frac{1}{n}\sum_{i=1}^{n}\hat{\theta}_{(i)}.7 or θ^(i):=s(X[i]),θ^(⋅)=1n∑i=1nθ^(i).\hat{\theta}_{(i)}:=s(\bold{X}_{[i]}), \qquad \hat{\theta}_{(\cdot)}=\frac{1}{n}\sum_{i=1}^{n}\hat{\theta}_{(i)}.8 θ^(i):=s(X[i]),θ^(⋅)=1n∑i=1nθ^(i).\hat{\theta}_{(i)}:=s(\bold{X}_{[i]}), \qquad \hat{\theta}_{(\cdot)}=\frac{1}{n}\sum_{i=1}^{n}\hat{\theta}_{(i)}.9 or Var^jack(θ^)=n−1n∑i=1n(θ^(i)−θ^(⋅))2,\widehat{\mathrm{Var}}_{jack}(\hat{\theta}) = \frac{n-1}{n}\sum_{i=1}^{n}(\hat{\theta}_{(i)}-\hat{\theta}_{(\cdot)})^2,0

3. Symmetry, goodness-of-fit, and independence tests built from jackknifed Var^jack(θ^)=n−1n∑i=1n(θ^(i)−θ^(⋅))2,\widehat{\mathrm{Var}}_{jack}(\hat{\theta}) = \frac{n-1}{n}\sum_{i=1}^{n}(\hat{\theta}_{(i)}-\hat{\theta}_{(\cdot)})^2,1-statistics

Several one-sample goodness-of-fit and symmetry problems are now handled by first constructing a scalar departure measure and then applying JEL to the associated pseudo-values. For diagonal symmetry in multivariate data, the null

Var^jack(θ^)=n−1n∑i=1n(θ^(i)−θ^(⋅))2,\widehat{\mathrm{Var}}_{jack}(\hat{\theta}) = \frac{n-1}{n}\sum_{i=1}^{n}(\hat{\theta}_{(i)}-\hat{\theta}_{(\cdot)})^2,2

is equivalent to

Var^jack(θ^)=n−1n∑i=1n(θ^(i)−θ^(⋅))2,\widehat{\mathrm{Var}}_{jack}(\hat{\theta}) = \frac{n-1}{n}\sum_{i=1}^{n}(\hat{\theta}_{(i)}-\hat{\theta}_{(\cdot)})^2,3

The natural sample statistic is a difference of two Var^jack(θ^)=n−1n∑i=1n(θ^(i)−θ^(⋅))2,\widehat{\mathrm{Var}}_{jack}(\hat{\theta}) = \frac{n-1}{n}\sum_{i=1}^{n}(\hat{\theta}_{(i)}-\hat{\theta}_{(\cdot)})^2,4-statistics, but under Var^jack(θ^)=n−1n∑i=1n(θ^(i)−θ^(⋅))2,\widehat{\mathrm{Var}}_{jack}(\hat{\theta}) = \frac{n-1}{n}\sum_{i=1}^{n}(\hat{\theta}_{(i)}-\hat{\theta}_{(\cdot)})^2,5 it is degenerate, which prevents direct application of standard JEL theory. The paper resolves this by splitting the sample, constructing two pseudo-value arrays Var^jack(θ^)=n−1n∑i=1n(θ^(i)−θ^(⋅))2,\widehat{\mathrm{Var}}_{jack}(\hat{\theta}) = \frac{n-1}{n}\sum_{i=1}^{n}(\hat{\theta}_{(i)}-\hat{\theta}_{(\cdot)})^2,6 and Var^jack(θ^)=n−1n∑i=1n(θ^(i)−θ^(⋅))2,\widehat{\mathrm{Var}}_{jack}(\hat{\theta}) = \frac{n-1}{n}\sum_{i=1}^{n}(\hat{\theta}_{(i)}-\hat{\theta}_{(\cdot)})^2,7, enforcing a common-mean constraint, and proving the Wilks-type limit

Var^jack(θ^)=n−1n∑i=1n(θ^(i)−θ^(⋅))2,\widehat{\mathrm{Var}}_{jack}(\hat{\theta}) = \frac{n-1}{n}\sum_{i=1}^{n}(\hat{\theta}_{(i)}-\hat{\theta}_{(\cdot)})^2,8

The resulting test is consistent against any fixed alternative and avoids permutation calibration (Sang et al., 2019).

In competing-risks data with two causes of failure, the target null is independence between failure time and cause,

Var^jack(θ^)=n−1n∑i=1n(θ^(i)−θ^(⋅))2,\widehat{\mathrm{Var}}_{jack}(\hat{\theta}) = \frac{n-1}{n}\sum_{i=1}^{n}(\hat{\theta}_{(i)}-\hat{\theta}_{(\cdot)})^2,9

The paper defines the scalar departure measure

SE(θ^)jack={n−1n∑i=1n(θ^(i)−θ^(⋅))2}1/2.SE(\hat{\theta})_{jack}=\Big\{\frac{n-1}{n}\sum_{i=1}^{n}(\hat{\theta}_{(i)}-\hat{\theta}_{(\cdot)})^2\Big\}^{1/2}.0

and rewrites it as

SE(θ^)jack={n−1n∑i=1n(θ^(i)−θ^(⋅))2}1/2.SE(\hat{\theta})_{jack}=\Big\{\frac{n-1}{n}\sum_{i=1}^{n}(\hat{\theta}_{(i)}-\hat{\theta}_{(\cdot)})^2\Big\}^{1/2}.1

An order-2 SE(θ^)jack={n−1n∑i=1n(θ^(i)−θ^(⋅))2}1/2.SE(\hat{\theta})_{jack}=\Big\{\frac{n-1}{n}\sum_{i=1}^{n}(\hat{\theta}_{(i)}-\hat{\theta}_{(\cdot)})^2\Big\}^{1/2}.2-statistic estimates SE(θ^)jack={n−1n∑i=1n(θ^(i)−θ^(⋅))2}1/2.SE(\hat{\theta})_{jack}=\Big\{\frac{n-1}{n}\sum_{i=1}^{n}(\hat{\theta}_{(i)}-\hat{\theta}_{(\cdot)})^2\Big\}^{1/2}.3, jackknife pseudo-values

SE(θ^)jack={n−1n∑i=1n(θ^(i)−θ^(⋅))2}1/2.SE(\hat{\theta})_{jack}=\Big\{\frac{n-1}{n}\sum_{i=1}^{n}(\hat{\theta}_{(i)}-\hat{\theta}_{(\cdot)})^2\Big\}^{1/2}.4

are formed, and the JEL ratio statistic

SE(θ^)jack={n−1n∑i=1n(θ^(i)−θ^(⋅))2}1/2.SE(\hat{\theta})_{jack}=\Big\{\frac{n-1}{n}\sum_{i=1}^{n}(\hat{\theta}_{(i)}-\hat{\theta}_{(\cdot)})^2\Big\}^{1/2}.5

satisfies

SE(θ^)jack={n−1n∑i=1n(θ^(i)−θ^(⋅))2}1/2.SE(\hat{\theta})_{jack}=\Big\{\frac{n-1}{n}\sum_{i=1}^{n}(\hat{\theta}_{(i)}-\hat{\theta}_{(\cdot)})^2\Big\}^{1/2}.6

In practice the null is SE(θ^)jack={n−1n∑i=1n(θ^(i)−θ^(⋅))2}1/2.SE(\hat{\theta})_{jack}=\Big\{\frac{n-1}{n}\sum_{i=1}^{n}(\hat{\theta}_{(i)}-\hat{\theta}_{(\cdot)})^2\Big\}^{1/2}.7, so independence is tested by SE(θ^)jack={n−1n∑i=1n(θ^(i)−θ^(⋅))2}1/2.SE(\hat{\theta})_{jack}=\Big\{\frac{n-1}{n}\sum_{i=1}^{n}(\hat{\theta}_{(i)}-\hat{\theta}_{(\cdot)})^2\Big\}^{1/2}.8 against a SE(θ^)jack={n−1n∑i=1n(θ^(i)−θ^(⋅))2}1/2.SE(\hat{\theta})_{jack}=\Big\{\frac{n-1}{n}\sum_{i=1}^{n}(\hat{\theta}_{(i)}-\hat{\theta}_{(\cdot)})^2\Big\}^{1/2}.9 critical value (N. et al., 2021).

For log symmetry on the positive real line, the construction begins from the characterization

bias^jack=(n−1)(θ^(⋅)−θ^),\widehat{\text{bias}}_{jack}=(n-1)(\hat{\theta}_{(\cdot)}-\hat{\theta}),0

for a positive, real-valued, strictly monotone continuous function bias^jack=(n−1)(θ^(⋅)−θ^),\widehat{\text{bias}}_{jack}=(n-1)(\hat{\theta}_{(\cdot)}-\hat{\theta}),1. Choosing

bias^jack=(n−1)(θ^(⋅)−θ^),\widehat{\text{bias}}_{jack}=(n-1)(\hat{\theta}_{(\cdot)}-\hat{\theta}),2

produces the PWM-based departure measure

bias^jack=(n−1)(θ^(⋅)−θ^),\widehat{\text{bias}}_{jack}=(n-1)(\hat{\theta}_{(\cdot)}-\hat{\theta}),3

which under algebraic rewriting becomes

bias^jack=(n−1)(θ^(⋅)−θ^),\widehat{\text{bias}}_{jack}=(n-1)(\hat{\theta}_{(\cdot)}-\hat{\theta}),4

The associated bias^jack=(n−1)(θ^(⋅)−θ^),\widehat{\text{bias}}_{jack}=(n-1)(\hat{\theta}_{(\cdot)}-\hat{\theta}),5-statistic leads to pseudo-values bias^jack=(n−1)(θ^(⋅)−θ^),\widehat{\text{bias}}_{jack}=(n-1)(\hat{\theta}_{(\cdot)}-\hat{\theta}),6, a JEL ratio

bias^jack=(n−1)(θ^(⋅)−θ^),\widehat{\text{bias}}_{jack}=(n-1)(\hat{\theta}_{(\cdot)}-\hat{\theta}),7

and the limit

bias^jack=(n−1)(θ^(⋅)−θ^),\widehat{\text{bias}}_{jack}=(n-1)(\hat{\theta}_{(\cdot)}-\hat{\theta}),8

The explicit motivation is that the normal-based test is difficult to implement because the asymptotic variance is difficult to estimate (S et al., 2024).

The same strategy appears in goodness-of-fit testing for the standard Cauchy law. Using the characterization of Arnold (1979), the paper defines the discrepancy

bias^jack=(n−1)(θ^(⋅)−θ^),\widehat{\text{bias}}_{jack}=(n-1)(\hat{\theta}_{(\cdot)}-\hat{\theta}),9

estimates it by an unbiased order-3 θ^jack=nθ^−(n−1)θ^(⋅).\hat{\theta}_{jack}=n\hat{\theta}-(n-1)\hat{\theta}_{(\cdot)}.0-statistic, forms jackknife pseudo-values

θ^jack=nθ^−(n−1)θ^(⋅).\hat{\theta}_{jack}=n\hat{\theta}-(n-1)\hat{\theta}_{(\cdot)}.1

and proves

θ^jack=nθ^−(n−1)θ^(⋅).\hat{\theta}_{jack}=n\hat{\theta}-(n-1)\hat{\theta}_{(\cdot)}.2

The AJEL variant appends

θ^jack=nθ^−(n−1)θ^(⋅).\hat{\theta}_{jack}=n\hat{\theta}-(n-1)\hat{\theta}_{(\cdot)}.3

to enforce feasibility when the convex hull of the jackknife pseudo-values fails to contain zero (Vishnu et al., 2024).

4. Two-sample, θ^jack=nθ^−(n−1)θ^(⋅).\hat{\theta}_{jack}=n\hat{\theta}-(n-1)\hat{\theta}_{(\cdot)}.4-sample, and multivariate jackknife likelihood tests

A major branch of the literature uses jackknife-based test statistics for equality of distributions or equality of functionals across several samples. In the upper-semivariance problem, two independent nonnegative populations with cdfs θ^jack=nθ^−(n−1)θ^(⋅).\hat{\theta}_{jack}=n\hat{\theta}-(n-1)\hat{\theta}_{(\cdot)}.5 and θ^jack=nθ^−(n−1)θ^(⋅).\hat{\theta}_{jack}=n\hat{\theta}-(n-1)\hat{\theta}_{(\cdot)}.6 are compared under

θ^jack=nθ^−(n−1)θ^(⋅).\hat{\theta}_{jack}=n\hat{\theta}-(n-1)\hat{\theta}_{(\cdot)}.7

where

θ^jack=nθ^−(n−1)θ^(⋅).\hat{\theta}_{jack}=n\hat{\theta}-(n-1)\hat{\theta}_{(\cdot)}.8

The paper constructs the scalar departure measure

θ^jack=nθ^−(n−1)θ^(⋅).\hat{\theta}_{jack}=n\hat{\theta}-(n-1)\hat{\theta}_{(\cdot)}.9

rewrites it as expectations involving pairwise comparisons, and estimates it by a symmetric-kernel X1,…,XnX_1,\dots,X_n00-statistic X1,…,XnX_1,\dots,X_n01. After pooling the sample and forming pseudo-values

X1,…,XnX_1,\dots,X_n02

the JEL ratio

X1,…,XnX_1,\dots,X_n03

yields the test statistic X1,…,XnX_1,\dots,X_n04, with null limit X1,…,XnX_1,\dots,X_n05. The practical appeal is explicit: JEL avoids the practical difficulty of variance estimation in the normal-based method (Suresh et al., 2024).

For the X1,…,XnX_1,\dots,X_n06-sample homogeneity problem, the paper reformulates

X1,…,XnX_1,\dots,X_n07

as testing independence between a continuous random vector X1,…,XnX_1,\dots,X_n08 and a categorical variable X1,…,XnX_1,\dots,X_n09. The categorical Gini correlation

X1,…,XnX_1,\dots,X_n10

characterizes equality of the X1,…,XnX_1,\dots,X_n11 distributions through X1,…,XnX_1,\dots,X_n12. The test is built from the Gini contrast

X1,…,XnX_1,\dots,X_n13

with pooled and groupwise pseudo-values X1,…,XnX_1,\dots,X_n14 and X1,…,XnX_1,\dots,X_n15. The resulting JEL log-likelihood ratio

X1,…,XnX_1,\dots,X_n16

satisfies

X1,…,XnX_1,\dots,X_n17

A distinctive computational claim is that no permutation procedure is required, unlike many energy-distance or distance-correlation tests (Sang et al., 2019).

The multivariate X1,…,XnX_1,\dots,X_n18-sample extension treats X1,…,XnX_1,\dots,X_n19-statistics based on three or more independent samples. For three samples,

X1,…,XnX_1,\dots,X_n20

the construction pools all observations into X1,…,XnX_1,\dots,X_n21, defines leave-one-out statistics X1,…,XnX_1,\dots,X_n22, and forms

X1,…,XnX_1,\dots,X_n23

Because the pseudo-values are not identically distributed across the sample blocks, the JEL constraint is written as

X1,…,XnX_1,\dots,X_n24

Under finite-second-moment, non-degeneracy, and sample-balance conditions,

X1,…,XnX_1,\dots,X_n25

The paper develops this for confidence intervals for differences in VUS measurements and for HUM-type functionals, and repeatedly contrasts JEL with normal approximation and kernel-smoothed bootstrap intervals (Garg et al., 2024).

These multi-sample results show a characteristic feature of jackknife-based testing: the underlying estimand can be a high-order, multi-sample, or multivariate X1,…,XnX_1,\dots,X_n26-statistic, but the final inferential object is still a low-dimensional empirical-likelihood ratio calibrated by a standard chi-square law.

5. Infinitesimal jackknife, higher-order expansions, and covariance-based tests

The infinitesimal jackknife (IJ) replaces delete-1 recomputation by local differentiation with respect to data weights. For weighted estimating equations

X1,…,XnX_1,\dots,X_n27

the higher-order infinitesimal jackknife (HOIJ) is the Taylor expansion of X1,…,XnX_1,\dots,X_n28 in the weights X1,…,XnX_1,\dots,X_n29 around the all-ones vector X1,…,XnX_1,\dots,X_n30. The first derivative recovers the ordinary IJ,

X1,…,XnX_1,\dots,X_n31

and higher-order derivatives are computed recursively from lower-order derivatives and higher-order derivatives of X1,…,XnX_1,\dots,X_n32. The core recursion uses only one matrix inverse X1,…,XnX_1,\dots,X_n33 for all orders, and the paper proves finite-sample error bounds of the form

X1,…,XnX_1,\dots,X_n34

This work does not develop an explicit hypothesis test statistic or confidence interval, but it makes an important inferential point: for bootstrap weights, the first-order approximation reproduces the usual sandwich covariance estimator, so covariance estimates based on the linear approximation do not improve on asymptotic normal theory; higher-order terms are needed for higher-order bootstrap accuracy (Giordano et al., 2019).

A direct testing application of the IJ appears in model comparison. Extending the IJ from variance estimation to covariance estimation between two models fitted on the same data, the paper defines directional derivatives X1,…,XnX_1,\dots,X_n35 and estimates the covariance block by

X1,…,XnX_1,\dots,X_n36

For two predictors evaluated at X1,…,XnX_1,\dots,X_n37,

X1,…,XnX_1,\dots,X_n38

the covariance of the difference is estimated by

X1,…,XnX_1,\dots,X_n39

and the comparison test statistic is

X1,…,XnX_1,\dots,X_n40

The same machinery is used for testing whether a boosting stage made a statistically significant change, and for uncertainty quantification of sums, differences, and more general linear combinations of models (Ghosal et al., 2022).

Predictive inference provides a different jackknife-based branch. The jackknife+ replaces the classical jackknife interval centered at X1,…,XnX_1,\dots,X_n41 by an interval based on the leave-one-out fitted values at the test point,

X1,…,XnX_1,\dots,X_n42

Under exchangeability and permutation invariance of the learning algorithm,

X1,…,XnX_1,\dots,X_n43

The same paper is explicit that the original jackknife has no universal guarantee and can have coverage equal to zero. This is not a likelihood-ratio test, but it is an important corrective to the misconception that all leave-one-out jackknife inference is automatically valid in unstable learning problems (Barber et al., 2019).

6. High-dimensional IV inference, Bayesian survey pseudo-likelihoods, and scope conditions

In linear IV regression with endogeneity, heteroskedastic disturbances, and many potentially weak instrumental variables, jackknife ideas have been used to construct a full testing trinity. The model is

X1,…,XnX_1,\dots,X_n44

and the paper introduces jackknife objective functions based on quadratic forms and ratio-of-quadratic-forms. For the simple null

X1,…,XnX_1,\dots,X_n45

the proposed statistics are

X1,…,XnX_1,\dots,X_n46

For general linear restrictions

X1,…,XnX_1,\dots,X_n47

the paper defines restricted estimators and corresponding statistics X1,…,XnX_1,\dots,X_n48, X1,…,XnX_1,\dots,X_n49, X1,…,XnX_1,\dots,X_n50, and X1,…,XnX_1,\dots,X_n51. Under the null, the natural asymptotic limit is a weighted sum of chi-squares,

X1,…,XnX_1,\dots,X_n52

where X1,…,XnX_1,\dots,X_n53. A central contribution is that modified objective functions produce ordinary chi-square limits,

X1,…,XnX_1,\dots,X_n54

This is an explicitly jackknife-based testing framework rather than a variance-estimation device, and it is designed for settings where many potentially weak instruments make standard IV inference fragile (Crudu et al., 16 Apr 2026).

In complex survey sampling, jackknife pseudo-values also support a Bayesian pseudo-likelihood route. For a X1,…,XnX_1,\dots,X_n55-statistic parameter X1,…,XnX_1,\dots,X_n56, the pseudo-values are

X1,…,XnX_1,\dots,X_n57

and the survey-weighted jackknife empirical likelihood imposes

X1,…,XnX_1,\dots,X_n58

optionally together with the auxiliary-information constraint

X1,…,XnX_1,\dots,X_n59

Under a non-informative prior X1,…,XnX_1,\dots,X_n60, the Bayesian jackknife pseudo-empirical likelihood pseudo-posterior is asymptotically normal, with local expansion around the JEL estimator or its weighted analogue. Inference is then obtained through posterior quantiles, and testing proceeds by inversion of credible sets rather than by a frequentist likelihood-ratio cutoff (Shang et al., 2023).

Taken together, these developments delineate the scope conditions of jackknife-based testing. Recurrent assumptions are finite second moments of the kernel, non-degenerate first-order projections, and asymptotic balance of sample fractions. Where those conditions fail, several papers introduce explicit repairs: AJEL adds an artificial pseudo-value to fix convex-hull failures, HOIJ uses higher-order derivatives because first-order bootstrap linearization is equivalent to asymptotic normal theory, and jackknife+ modifies the classical jackknife because leave-one-out residual calibration alone does not control instability (Bhati et al., 2018, Giordano et al., 2019, Barber et al., 2019).

The resulting picture is broad but coherent. Jackknife-based test statistics include classical pseudovalue X1,…,XnX_1,\dots,X_n61-statistics, JEL likelihood ratios for scalar and vector X1,…,XnX_1,\dots,X_n62-statistic functionals, chi-square and chi-bar-square tests in many-instrument IV models, covariance-aware chi-square tests for model comparison, and Bayesian pseudo-likelihood procedures for complex surveys. What unifies them is not a single formula but a common reduction: a difficult estimator is recast into leave-one-out or infinitesimal perturbation objects that behave like approximately independent estimating values, after which standard normal, empirical-likelihood, or quadratic-form calibration becomes possible.

Topic to Video (Beta)

No one has generated a video about this topic yet.

Whiteboard

No one has generated a whiteboard explanation for this topic yet.

Follow Topic

Get notified by email when new papers are published related to Jackknife-Based Test Statistics.