Fisher information approximation of random orthogonal matrices by Gaussian matrices

Abstract: Let ${\Gamma}n$ be an $n\times n$ Haar-invariant orthogonal matrix. Let ${ Z}_n$ be the $p\times q$ upper-left submatrix of ${\Gamma}_n$ and ${G}_n$ be a $p\times q$ matrix whose $pq$ entries are independent standard normals, where $p$ and $q$ are two positive integers. Let $\mathcal{L}(\sqrt{n} {Z}_n)$ and $\mathcal{L}({G}_n)$ be their joint distribution, respectively. Consider the Fisher information $I(\mathcal{L}(\sqrt{n} { Z}_n)|\mathcal{L}(G_n))$ between the distributions of $\sqrt{n} {Z}_n$ and ${ G}_n.$ In this paper, we conclude that $$I(\mathcal{L}(\sqrt{n} {Z}_n)|\mathcal{L}(G_n))\longrightarrow 0 $$ as $n\to\infty$ if $pq=o(n)$ and it does not tend to zero if $c=\lim\limits{n\to\infty}\frac{pq}{n}\in(0, +\infty).$ Precisely, we obtain that $$I(\mathcal{L}(\sqrt{n} {Z}_n)|\mathcal{L}(G_n))=\frac{p^2q(q+1)}{4n^2}(1+o(1))$$ when $p=o(n).$