2. Limit distribution and higher moments

We consider the set $\mathcal {P}_T$ of affine lattice points $y\in \mathcal {L}_{\boldsymbol {\xi }}$ inside the ball of radius $\mathcal {B}_T^d$ or, more generally, $\mathcal {P}_{c,T}$ the lattice points in the spherical shell

$$ \begin{align*}\mathcal{B}_{c,T}^d:=\{\mathbf{x}\in\mathbb{R}^d: cT\leq \|\mathbf{x}\|\leq T\},\quad 0\leq c<1.\end{align*} $$

The well-known asymptotics for the number of lattice points in a large ball yields for $T\to \infty $ ,

$$ \begin{align*} \#\mathcal{P}_{c,T} \sim \operatorname{vol}_{\mathbb{R}^d}(\mathcal{B}_{c,1}^d) T^d = \frac{1-c^d}{d} V_{\mathbb{S}^{d-1}} T^d. \end{align*} $$

For $\sigma>0$ and $\boldsymbol {\upsilon }\in \mathbb {S}^{d-1}$ , we define $\mathfrak {D}_{c,T}(\sigma ,\boldsymbol {\upsilon })\subseteq \mathbb {S}^{d-1}$ to be the open disc with centre $\boldsymbol {\upsilon }$ and volume

$$ \begin{align*}\operatorname{vol}_{\mathbb{S}^{d-1}}(\mathfrak{D}_{c,T}(\sigma,\boldsymbol{\upsilon}))=\frac{\sigma d}{1-c^d}T^{-d}.\end{align*} $$

Then the radius of $\mathfrak {D}_{c,T}(\sigma ,\boldsymbol {\upsilon })$ is $\asymp T^{-{d}/({d-1})}$ , and for $T\to \infty $ ,

$$ \begin{align*} \frac{\operatorname{vol}_{\mathbb{S}^{d-1}}(\mathfrak{D}_{c,T}(\sigma,\boldsymbol{\upsilon}))}{V_{\mathbb{S}^{d-1}}} \sim \frac{\sigma}{\#\mathcal{P}_{c,T}}. \end{align*} $$

Thus, $\sigma $ measures the disc’s volume in terms of the average density of points on the sphere; this scale is compatible with the one introduced above for the pair correlation function.

We define the counting function

$$ \begin{align*}\mathcal{N}_{c,T}(\sigma, \boldsymbol{\upsilon}):=\#\{\mathbf{y}\in\mathcal{P}_{c,T}: \|\mathbf{y}\|^{-1} \mathbf{y}\in\mathfrak{D}_{c,T}(\sigma,\boldsymbol{\upsilon})\}\end{align*} $$

for the number of affine lattice points whose direction is contained in $\mathfrak {D}_{c,T}(\sigma ,\boldsymbol {\upsilon })$ . Note that on average over $\boldsymbol {\upsilon }$ , uniform distribution implies (cf. [Reference Marklof and StrömbergssonMS10, §2.3]) that for any Borel probability measure $\unicode{x3bb} $ on $\mathbb {S}^{d-1}$ with continuous density, we have

(2.1) $$ \begin{align} { \lim_{T\to\infty} \int_{\mathbb{S}^{d-1}} \mathcal{N}_{c,T}(\sigma, \boldsymbol{\upsilon}) \unicode{x3bb}(d\boldsymbol{\upsilon}) =\sigma .} \end{align} $$

This says that the expected number of affine lattice points, with direction contained in $\mathfrak {D}_{c,T}(\sigma ,\boldsymbol {\upsilon })$ for random $\boldsymbol {\upsilon }$ , is $\sigma $ .

We recall the following result from [Reference Marklof and StrömbergssonMS10], which provides the full limit distribution of $\mathcal {N}_{c,T}(\sigma , \boldsymbol {\upsilon })$ with random $\boldsymbol {\upsilon }$ distributed according to a general Borel probability measure  $\unicode{x3bb} $ .

Theorem 2.1. [Reference Marklof and StrömbergssonMS10]

For $\underline {\sigma }=(\sigma _1,\ldots ,\sigma _m)\in \mathbb {R}_{>0}^m$ , there is a probability distribution $E_{c,\boldsymbol {\xi }}(\cdot , \underline {\sigma })$ on $\mathbb {Z}^m_{\geq 0}$ such that, for any $\underline {r}=(r_1,\ldots ,r_m)\in \mathbb {Z}^m_{\geq 0}$ and any Borel probability measure $\unicode{x3bb} $ on $\mathbb {S}^{d-1}$ , absolutely continuous with respect to Lebesgue,

$$ \begin{align*}\lim_{T\to\infty} \unicode{x3bb}({\boldsymbol{\upsilon}\in\mathbb{S}^{d-1}: \mathcal{N}_{c,T}(\sigma_1,\boldsymbol{\upsilon}) = r_1,\ldots,\mathcal{N}_{c,T}(\sigma_m,\boldsymbol{\upsilon}) = r_m}) = E_{c,\boldsymbol{\xi}}(\underline{r},\underline{\sigma}).\end{align*} $$

The limit distribution satisfies the following properties, cf. §4:

1. (a) $E_{c,\boldsymbol {\xi }}(\underline {r},\underline {\sigma })$ is independent of $\unicode{x3bb} $ and $\mathcal {L}$ ;

2. (b) $\sum _{\underline {r}\in \mathbb {Z}_{\ge 0}^m}r_jE_{c,\boldsymbol {\xi }}(\underline {r},\underline {\sigma })=\sum _{r=0}^{\infty }rE_{c,\boldsymbol {\xi }}(r,\sigma _j)=\sigma _j$ for any $j\leq m$ ;

3. (c) for $\boldsymbol {\xi }\in \mathbb {Q}^d$ , $\sum _{\underline {r}\in \mathbb {Z}_{\ge 0}^m} \|\underline {r}\|^s E_{c,\boldsymbol {\xi }}(\underline {r},\underline {\sigma }) < \infty $ for $0\le s<d$ and $=\infty $ for $s\ge d$ .

4. (d) for $\boldsymbol {\xi }\notin \mathbb {Q}^d$ , $E_{c,\boldsymbol {\xi }}(\underline {r},\underline {\sigma })=:E_{c}(\underline {r},\underline {\sigma })$ is independent of $\boldsymbol {\xi }$ ;

5. (e) for $\boldsymbol {\xi }\notin \mathbb {Q}^d$ , $\sum _{\underline {r}\in \mathbb {Z}_{\ge 0}^m} \|\underline {r}\|^s E_{c}(\underline {r},\underline {\sigma }) < \infty $ for $0\le s<d+1$ and $=\infty $ for $s\ge d+1$ .

A key ingredient of the proof of Theorem 2.1 is Ratner’s measure classification theorem, which allows one to prove equidistribution of horospheres embedded in the space of affine lattices. An effective version of this statement was established only recently [Reference KimK21].

Let us now turn to the main outcome of the present investigation, which extends the results of [Reference El-Baz, Marklof and VinogradovEMV15] to arbitrary dimension. For $\sigma _1,\ldots ,\sigma _m>0$ , $\unicode{x3bb} $ a Borel probability measure on $\mathbb {S}^{d-1}$ and $\underline {z}=(z_1,\ldots ,z_m)\in \mathbb {C}^m$ , let

(2.2) $$ \begin{align} {\mathbb{M}_\unicode{x3bb}(T,\underline{z}):=\int_{\mathbb{S}^{d-1}}(\mathcal{N}_{c,T}(\sigma_1,\boldsymbol{\upsilon})+1)^{z_1}\cdots(\mathcal{N}_{c,T}(\sigma_m,\boldsymbol{\upsilon})+1)^{z_m}\unicode{x3bb}(d\boldsymbol{\upsilon}).} \end{align} $$

We denote the positive real part of $z\in \mathbb {C}$ by $\operatorname {Re}_+(z):=\max \{\operatorname {Re}(z),0\}$ .

The following is the principal theorem of this paper.

Theorem 2.2. Let $\sigma _1,\ldots ,\sigma _m>0$ and $\unicode{x3bb} $ a Borel probability measure on $\mathbb {S}^{d-1}$ with continuous density. Choose $\boldsymbol {\xi }\in \mathbb {R}^d$ and $\underline {z}=(z_1,\ldots ,z_m)\in \mathbb {C}^m$ , such that one of the following hypotheses holds:

1. (A1) $\operatorname {Re}_+(z_1)+\cdots +\operatorname {Re}_+(z_m)<d;$

2. (A2) $\eta :=\operatorname {Re}_+(z_1)+\cdots +\operatorname {Re}_+(z_m)<d+1$ and $\boldsymbol {\xi }$ is $(0,\eta -2,2)$ -vaguely Diophantine if $d=2$ and $(d-1,\eta -d,1)$ -vaguely Diophantine if $d\geq 3$ .

Then

(2.3) $$ \begin{align} {\lim_{T\to\infty}\mathbb{M}_\unicode{x3bb}(T,\underline{z})=\sum_{\underline{r}\in\mathbb{Z}_{\ge0}^m}(r_1+1)^{z_1}\cdots(r_m+1)^{z_m}E_{c,\boldsymbol{\xi}}(\underline{r},\underline{\sigma}).} \end{align} $$

We note that if $\boldsymbol {\xi }$ is Diophantine of type $\kappa $ then under hypothesis (A2), we have ${\eta <2+(2/\kappa )}$ if $d=2$ and $\eta <d+(1/\kappa )$ if $d\geq 3$ . Thus, in particular for badly approximable $\boldsymbol {\xi }$ (where $\kappa =d$ ), we have $\eta <3$ if $d=2$ and $\eta <d+({1}/{d})$ if $d\geq 3$ .

We define the restricted moments to explain the key step of the proof of Theorem 2.2:

(2.4) $$ \begin{align} {\mathbb{M}_\unicode{x3bb}^{(K)}(T,\underline{z}):=\int_{\max_j \mathcal{N}_{c,T}(\sigma_j,\boldsymbol{\upsilon})\leq K}(\mathcal{N}_{c,T}(\sigma_1,\boldsymbol{\upsilon})+1)^{z_1}\cdots(\mathcal{N}_{c,T}(\sigma_m,\boldsymbol{\upsilon})+1)^{z_m}\unicode{x3bb}(d\boldsymbol{\upsilon}).} \end{align} $$

Then Theorem 2.1 implies that for any $K>0$ ,

(2.5) $$ \begin{align} {\lim_{T\to\infty}\mathbb{M}_\unicode{x3bb}^{(K)}(T,\underline{z})=\sum_{\underline{r}\in\mathbb{Z}_{\ge0}^m, |\underline{r}|\leq K}(r_1+1)^{z_1}\cdots(r_m+1)^{z_m}E_{c,\boldsymbol{\xi}}(\underline{r},\underline{\sigma}),} \end{align} $$

where $|\underline {r}|:=\max _{1\leq j\leq m}r_m$ . Thus, for the proof of Theorem 2.2 it remains to show that under hypotheses (A1)–(A2),

(2.6) $$ \begin{align} {\lim_{K\to\infty}\limsup_{T\to\infty}|\mathbb{M}_\unicode{x3bb}(T,\underline{z})-\mathbb{M}_\unicode{x3bb}^{(K)}(T,\underline{z})|=0.} \end{align} $$

We will prove this in §6.

The following corollaries of Theorem 2.2 state that, in particular, the second moment and pair correlation converge and are Poisonnian.

Corollary 2.3. Let $\unicode{x3bb} $ be as in Theorem 2.2. Let $d\geq 2$ and $\boldsymbol {\xi }\in \mathbb {R}^d\setminus \mathbb {Q}^d$ ; furthermore, if $d=2$ , assume that $\boldsymbol {\xi }$ is $(0,0,2)$ -vaguely Diophantine. Then, for any $\sigma _1,\sigma _2>0$ ,

(2.7) $$ \begin{align} {\lim_{T\to\infty}\int_{\mathbb{S}^{d-1}}\mathcal{N}_{c,T}(\sigma_1,\boldsymbol{\upsilon})\mathcal{N}_{c,T}(\sigma_2,\boldsymbol{\upsilon})\unicode{x3bb}(d\boldsymbol{\upsilon})=\sigma_1\sigma_2+\min\{\sigma_1,\sigma_2\}.} \end{align} $$

Let $N=N_c(T)$ be the number of points in $\mathcal {P}_{c,T}$ and let $\boldsymbol {\upsilon }_{j}=\|\mathbf {y}_j\|^{-1}\mathbf {y}_j\in \mathbb {S}^{d-1}$ be the directions of the vectors $\mathbf {y}_j\in \mathcal {P}_{c,T}$ , with $j=1,\ldots ,N_c(T)$ . For ${f\in \operatorname {C}_0(\mathbb {S}^{d-1}\times \mathbb {S}^{d-1}\times \mathbb {R})}$ (continuous, real-valued and with compact support), we define the two-point correlation function

(2.8) $$ \begin{align} {R_N^2(f)=\frac{1}{N}\sum_{\substack{j_1,j_2=1\\ j_1\neq j_2}}^N f(\boldsymbol{\upsilon}_{j_1},\boldsymbol{\upsilon}_{j_2}, c_d N^{{1}/({d-1})}\mathbf{d}_{\mathbb{S}^{d-1}}(\boldsymbol{\upsilon}_{j_1},\boldsymbol{\upsilon}_{j_2})).} \end{align} $$

Corollary 2.4. Let $d\geq 2$ , $0\leq c<1$ and $\boldsymbol {\xi }\in \mathbb {R}^d\setminus \mathbb {Q}^d$ ; furthermore, if $d=2$ , assume that $\boldsymbol {\xi }$ is $(0,0,2)$ -vaguely Diophantine. Then for any $f\in \operatorname {C}_0(\mathbb {S}^{d-1}\times \mathbb {S}^{d-1}\times \mathbb {R})$ ,

(2.9) $$ \begin{align} {\lim_{T\to\infty}R_{N_c(T)}^2(f)= \frac{V_{\mathbb{S}^{d-2}}}{V_{\mathbb{S}^{d-1}}} \int_{\mathbb{S}^{d-1}\times\mathbb{R}_{\geq 0}}f(\boldsymbol{\upsilon},\boldsymbol{\upsilon},s)\, d\boldsymbol{\upsilon} \, s^{d-2}\,ds .} \end{align} $$

Corollary 2.4 implies Theorem 1.1 by approximating the characteristic function from above/below by $\operatorname {C}_0$ functions. The additional dependence of $f(\boldsymbol {\upsilon }_1,\boldsymbol {\upsilon }_2,s)$ on ${\boldsymbol {\upsilon }_1,\boldsymbol {\upsilon }_2\in \mathbb {S}^{d-1}}$ can be used to generalize Theorem 1.1 to pair counting where $\boldsymbol {\upsilon }_{j_1}$ and $\boldsymbol {\upsilon }_{j_2}$ are restricted to different subsets of $\mathcal {D}_1,\mathcal {D}_2\subseteq \mathbb {S}^{d-1}$ . Set

$$ \begin{align*} R^2_N(\mathcal{D}_1,\mathcal{D}_2,s) = \frac{1}{N} \#\{ &(j_1,j_2) : j_1,j_2\leq N, \, j_1\neq j_2, \\ &\boldsymbol{\upsilon}_{j_1}\in\mathcal{D}_1,\boldsymbol{\upsilon}_{j_2}\in\mathcal{D}_2,\,\, c_d N^{{1}/({d-1})}\mathbf{d}_{\mathbb{S}^{d-1}}(\boldsymbol{\upsilon}_{j_1},\boldsymbol{\upsilon}_{j_2}) \leq s \}. \end{align*} $$

We then have the following corollary.

Corollary 2.5. Let $d\geq 2$ , $0\leq c<1$ and $\boldsymbol {\xi }\in \mathbb {R}^d\setminus \mathbb {Q}^d$ ; furthermore, if $d=2$ , assume that $\boldsymbol {\xi }$ is $(0,0,2)$ -vaguely Diophantine. Then for any $\mathcal {D}_1,\mathcal {D}_2\subseteq \mathbb {S}^{d-1}$ with $\operatorname {vol}_{\mathbb {S}^{d-1}}(\partial \mathcal {D}_1)=\operatorname {vol}_{\mathbb {S}^{d-1}}(\partial \mathcal {D}_2)=0$ and $s>0$ , we have that

(2.10) $$ \begin{align} {\lim_{T\to\infty}R_{N_c(T)}^2(\mathcal{D}_1,\mathcal{D}_2,s)= \frac{\pi^{({d-1})/{2}} s^{d-1}}{\Gamma(({d+1})/{2})} \;\frac{\operatorname{vol}_{\mathbb{S}^{d-1}}(\mathcal{D}_1\cap\mathcal{D}_2)}{V_{\mathbb{S}^{d-1}}}.} \end{align} $$

3. The space of affine lattices

Let $G=\operatorname {SL}(d,\mathbb {R})$ and $\Gamma =\operatorname {SL}(d,\mathbb {Z})$ . Define $G'=G\ltimes \mathbb {R}^d$ by

$$ \begin{align*}(M,\mathbf{b})(M',\mathbf{b}')=(MM', \mathbf{b} M'+\mathbf{b}'),\end{align*} $$

and let $\Gamma '=\Gamma \ltimes \mathbb {Z}^d$ denote the corresponding arithmetic subgroup. The right action of $g=(M,\mathbf {b})\in G'$ on $\mathbb {R}^d$ is defined by $\mathbf {x} g:=\mathbf {x} M +\mathbf {b}$ . We embed G in $G'$ via the homomorphism $M\mapsto (M,0)$ . In the following, we will identify G with the corresponding subgroup in $G'$ and use the shorthand M for $(M,0)$ .

Given $\sigma>0$ and $0\leq c<1$ , define the cone

(3.1) $$ \begin{align} {\mathfrak{C}_c(\sigma):=\{(x_1,x')\in\mathbb{R}\times\mathbb{R}^{d-1}: c<x<1,\|(1-c^d)x'\|<\sigma\}.} \end{align} $$

For $g\in G'$ and any bounded set $\mathfrak {C}\subset \mathbb {R}^d,$

(3.2) $$ \begin{align} {\mathcal{N}(g,\mathfrak{C}):=\#(\mathfrak{C}\cap\mathbb{Z}^dg).} \end{align} $$

By construction, we can view $\mathcal {N}(\cdot ,\mathfrak {C})$ as a function on the space of affine lattices, $\Gamma '\backslash G'$ . For $\mathbf {y}=(y_2,\ldots ,y_{d})\in \mathbb {R}^{d-1}$ and $t\ge 0$ , let

(3.3) $$ \begin{align} {\widetilde{n}(\mathbf{y}):=\left(\begin{matrix} 1 & y_2 & \cdots & y_{d}\\ & 1 & & \\ & & \ddots & \\ & & & 1 \end{matrix}\right)\!,\quad \Phi_t:=\left(\begin{matrix} e^{-(({d-1})/{d})t} & & & \\ & e^{{t}/{d}} & & \\ & & \ddots & \\ & & & e^{{t}/{d}} \end{matrix}\right)\!.} \end{align} $$

Set $\mathbf {e}_1=(1,0,\ldots ,0)$ . As in [Reference Marklof and StrömbergssonMS10, p. 1968], we define a smooth map $k:\mathbb {S}^{d-1}\setminus \{-\mathbf {e}_1\}\to \operatorname {SO}(d)$ by

(3.4)

with $\mathbf {y}(\mathbf {e}_1)=0$ and, for $\boldsymbol {\upsilon }=(\upsilon _1,\ldots ,\upsilon _d)\in \mathbb {S}^{d-1}\setminus \{\mathbf {e}_1,-\mathbf {e}_1\}$ ,

$$ \begin{align*}\mathbf{y}(\boldsymbol{\upsilon})=\frac{\operatorname{arc\cos} v_1}{\sqrt{1-\upsilon_1^2}}(\upsilon_2,\ldots,\upsilon_d)\in\mathbb{R}^{d-1}.\end{align*} $$

Note that $\|\mathbf {y}(\boldsymbol {\upsilon })\|<\pi $ . By construction, $\boldsymbol {\upsilon }=(\cos \|\mathbf {y}(\boldsymbol {\upsilon })\|,\sin \|\mathbf {y}(\boldsymbol {\upsilon })\|({\mathbf {y}(\boldsymbol {\upsilon })}/{\|\mathbf {y}(\boldsymbol {\upsilon })\|}))$ , and hence $\mathbf {e}_1 =\boldsymbol {\upsilon } k(\boldsymbol {\upsilon })$ for all $\boldsymbol {\upsilon }\in \mathbb {S}^{d-1}\setminus \{-\mathbf {e}_1\}$ .

By an elementary geometric argument, given $\sigma>0$ and $\epsilon>0$ , there exists $T_0>0$ such that for all $\boldsymbol {\upsilon }\in \mathbb {S}^{d-1}\setminus \{-\mathbf {e}_1\}$ , $\boldsymbol {\xi }\in \mathbb {R}^d$ , $M_0\in G$ and $T=e^{{t}/{d}}\ge T_0$ ,

(3.5) $$ \begin{align} {\mathcal{N}_{c,T}(\sigma,\boldsymbol{\upsilon})\leq\mathcal{N}((1,\boldsymbol{\xi})M_0k(\boldsymbol{\upsilon})\Phi_t,\mathfrak{C}_0(\sigma+\epsilon)).} \end{align} $$

The argument is the same as in the two-dimensional case discussed in [Reference El-Baz, Marklof and VinogradovEMV15]; see in particular Fig. 3 (the yellow and red domains should now be viewed as higher-dimensional cones with symmetry axis along $\mathbf {e}_1$ ).

For

$$ \begin{align*}\mathbf{u}=(u_{12},\ldots,u_{1d},u_{23},\ldots,u_{(d-1)d})\in\mathbb{R}^{{d(d-1)}/{2}}\end{align*} $$

and

$$ \begin{align*}\mathbf{v}=(v_1,v_2,\ldots,v_d) \in \mathcal{T}:=\{(v_1,\ldots,v_d)\in\mathbb{R}_{>0}^d, v_1\cdots v_d=1\},\end{align*} $$

let

(3.6) $$ \begin{align} {n(\mathbf{u}):=\left(\begin{matrix} 1 & u_{12} & \cdots & u_{1d}\\ & \ddots & & \vdots \\ & & 1 & u_{(d-1)d} \\ & & & 1 \end{matrix}\right)\!,\quad a(\mathbf{v}):=\left(\begin{matrix} v_1 & & & \\ & v_2 & & \\ & & \ddots & \\ & & & v_d \end{matrix}\right)\!.} \end{align} $$

The Iwasawa decomposition of $M\in G$ is given by

(3.7) $$ \begin{align} {M=n(\mathbf{u})a(\mathbf{v})k,} \end{align} $$

where $\mathbf {u}\in \mathbb {R}^{{d(d-1)}/{2}}$ , $\mathbf {v}\in \mathcal {T}$ and $k\in \operatorname {SO}(d)$ .

Consider the Siegel set

(3.8) $$ \begin{align} {\mathcal{S}:=\bigg\{n(\mathbf{u})a(\mathbf{v})k: k\in \operatorname{SO}(d), 0<v_{j+1}\leq\frac{2}{\sqrt{3}}v_{j} ,\, \mathbf{u}\in\bigg[-\frac{1}{2},\frac{1}{2}\bigg]^{{d(d-1)}/{2}}\bigg\}.} \end{align} $$

This set has the property that it contains a fundamental domain of G and can be covered with a finite number of fundamental domains. Throughout this paper, we fix a fundamental domain of G contained in $\mathcal {S}$ and denote it by $\mathcal {F}$ . For $x\in \Gamma \backslash G$ , there exists a unique $M\in \mathcal {F}$ such that $x=\Gamma M$ . Define $\iota :\Gamma \backslash G\to \mathcal {F}$ so that $\iota (\Gamma M)=M$ .

We extend the above to define a fundamental domain $\mathcal {F}'$ and Siegel set $\mathcal {S}'$ of the $\Gamma '$ action on $G'$ by

$$ \begin{align*} \mathcal{F}'= \{ (1,\mathbf{b})(M,0) : \mathbf{b}\in [-\tfrac12,\tfrac12)^d,\, M\in\mathcal{F}\} , \end{align*} $$

$$ \begin{align*} \mathcal{S}'= \{ (1,\mathbf{b})(M,0) : \mathbf{b}\in [-\tfrac12,\tfrac12]^d,\, M\in\mathcal{S}\}. \end{align*} $$

As before, we define the map $\iota :\Gamma '\backslash G'\to \mathcal {F}'$ by $\iota (\Gamma ' g)=g$ .

Given $M\in G$ , we define $\mathbf {v}(M)$ as the $\mathbf {v}$ coordinate of the Iwasawa decomposition

(3.9) $$ \begin{align} {\iota(\Gamma M)=n(\mathbf{u})a(\mathbf{v})k.} \end{align} $$

Similarly, for $g\in G'$ , we define $\mathbf {v}(g)$ and $\mathbf {b}(g)$ as the $\mathbf {v}$ and $\mathbf {b}$ coordinates in

(3.10) $$ \begin{align} {\iota(\Gamma' g)=(1,\mathbf{b})(n(\mathbf{u})a(\mathbf{v})k,0).} \end{align} $$

We also define

(3.11) $$ \begin{align} {r(\mathfrak{C}):=\max\{\delta_d,\sup\{\|\mathbf{x}\|:\mathbf{x}\in\mathfrak{C}\}\}, \quad \delta_d=d4^d} \end{align} $$

and

(3.12) $$ \begin{align} {s_r(g):=\max\{1\leq i\leq d-1: v_i(g)>2c_dr\},} \end{align} $$

where $c_d=d({2}/{\sqrt {3}})^d$ .

Lemma 3.1. For any bounded $\mathfrak {C}\subset \mathbb {R}^d$ , $g\in G'$ , $\eta>0$ ,

(3.13) $$ \begin{align} {\mathcal{N}(g,\mathfrak{C})^\eta\leq (C_dr^d)^\eta\prod_{i=1}^{s}(v_i^\eta\#([-c_drv_i^{-1},c_drv_i^{-1}]\cap(\mathbb{Z}+b_i))),} \end{align} $$

where $\mathbf {v}=\mathbf {v}(g)=(v_1,\ldots ,v_d)$ , $\mathbf {b}=\mathbf {b}(g)=(b_1,\ldots ,b_d)$ , $r=r(\mathfrak {C})$ , $s=s_r(g)$ and $C_d=4c_d$ .

Proof. Let $\mathfrak {D}_r$ be the smallest closed ball of radius r centred at $0$ which contains $\mathfrak {C}$ . Then

(3.14) $$ \begin{align} \mathcal{N}(g,\mathfrak{C})&\leq\mathcal{N}(g,\mathfrak{D}_r)=\mathcal{N}(\iota(\Gamma g),\mathfrak{D}_r)\nonumber\\ &=\#(\mathfrak{D}_r\cap (\mathbb{Z}^d+\mathbf{b})n(\mathbf{u})a(\mathbf{v}))\nonumber\\ &\leq \#([-r,r]^d\cap(\mathbb{Z}^d+\mathbf{b})n(\mathbf{u})a(\mathbf{v}))\nonumber\\ &= \#\bigg(\prod_{i=1}^{d}[-rv_i^{-1},rv_i^{-1}]\cap(\mathbb{Z}^d+\mathbf{b})n(\mathbf{u})\bigg). \end{align} $$

Since $0<v_{i+1}\leq ({2}/{\sqrt {3}})v_i$ for $1\leq i\leq d-1$ , we have $v_j^{-1}\leq ({2}/{\sqrt {3}})^{j-i}v_i^{-1}$ for any ${1\leq i< j\leq d}$ . It follows that

(3.15) $$ \begin{align} \mathcal{N}(g,\mathfrak{C})&\leq \#\bigg(\prod_{i=1}^{d}[-c_drv_i^{-1},c_drv_i^{-1}]\cap(\mathbb{Z}^d+\mathbf{b})\bigg)\nonumber\\ &\leq\prod_{i=1}^{d}\#([-c_drv_i^{-1},c_drv_i^{-1}]\cap(\mathbb{Z}+b_i))\nonumber\\ &\leq\prod_{i=s+1}^{d}(2c_drv_i^{-1}+1)\times\prod_{i=1}^{s}\#([-c_drv_i^{-1},c_drv_i^{-1}]\cap(\mathbb{Z}+b_i)). \end{align} $$

For $i\ge s+1$ , we have $v_i^{-1}\ge {1}/{2c_dr}$ by definition of s. It follows that

$$ \begin{align*}\prod_{i=s+1}^{d}(2c_drv_i^{-1}+1)\leq (4c_dr)^{d-s}\prod_{i=s+1}^{d}v_i^{-1}=(4c_dr)^{d-s}\prod_{i=1}^{s}v_i,\end{align*} $$

and hence

$$ \begin{align*}\mathcal{N}(g,\mathfrak{C})\leq C_dr^d\prod_{i=1}^{s}(v_i\#([-c_drv_i^{-1},c_drv_i^{-1}]\cap(\mathbb{Z}+b_i))).\end{align*} $$

From the fact that

(3.16) $$ \begin{align} {\#([-c_drv_i^{-1},c_drv_i^{-1}]\cap(\mathbb{Z}+b_i))\in\{0,1\}} \end{align} $$

for any $1\leq i\leq s$ , equation (3.13) follows.

The case of mixed moment will be dealt with by the inequality

(3.17) $$ \begin{align} {| \mathcal{N}(g,\mathfrak{C}_1)^{z_1}\cdots\mathcal{N}(g,\mathfrak{C}_m)^{z_m}| \leq | \mathcal{N}(g,\mathfrak{C}_1\cup\cdots\cup\mathfrak{C}_m)^{z_1+\cdots+z_m}|.} \end{align} $$

4. Properties of the limiting distribution

In this section, we prove the properties (a)–(e) of the limiting distribution in Theorem 2.1. We denote by $m_{X'}$ , $m_{X_1}$ and $m_{X_q}$ the Haar probability measures on the homogeneous spaces

$$ \begin{align*} {X'=\Gamma'\backslash G',\quad X_1=\Gamma\backslash G,\quad X_q=\Gamma_q\backslash G,} \end{align*} $$

respectively. Here, $\Gamma _q$ denotes the congruence subgroup

$$ \begin{align*} {\Gamma_q:=\{\gamma\in\Gamma_q: \gamma\equiv \operatorname{id} \,( \operatorname{mod} q)\}} \end{align*} $$

for $q\ge 2$ . According to [Reference Marklof and StrömbergssonMS10, Theorems 6.3, 6.5 and subsequent remarks, and Lemma 9.5], the limiting distribution $E_{c,\boldsymbol {\xi }}(\cdot ,\underline {\sigma })$ in Theorem 2.1 is given as follows:

(4.1) $$ \begin{align} E_{c,\boldsymbol{\xi}}(\underline{r},\underline{\sigma}) = \begin{cases} & \kern-10pt m_{X_1}(\{\Gamma M\in X_1: \text{for all } j, \; \#(\mathbb{Z}^dM\cap \mathfrak{C}_c(\sigma_j))=r_j\})\\& \qquad\qquad\qquad\qquad\qquad\qquad \text{if}\ \boldsymbol{\xi}\in\mathbb{Z}^d,\\& \kern-10pt m_{X_q}\bigg(\bigg\{\Gamma_q M\in X_q: \text{for all } j, \; \#\bigg(\bigg(\mathbb{Z}^d+\dfrac{\mathbf{p}}{q}\bigg)M\cap \mathfrak{C}_c(\sigma_j)\bigg)=r_j \bigg\}\bigg)\\& \qquad\qquad\qquad\qquad\qquad\qquad \text{if}\ \boldsymbol{\xi}=\dfrac{\mathbf{p}}{q}\in\mathbb{Q}^d\setminus \mathbb{Z}^d,\\& \kern-10pt m_{X_q}(\{\Gamma'g\in X': \text{for all } j, \; \#(\mathbb{Z}^d g\cap \mathfrak{C}_c(\sigma_j))=r_j \})\\& \qquad\qquad\qquad\qquad\qquad\qquad \text{if}\ \boldsymbol{\xi}\in\mathbb{R}^d\setminus \mathbb{Q}^d, \end{cases} \end{align} $$

where $\mathfrak {C}_c(\sigma )$ is as in equation (3.1).

Property (a) follows from the observation that the distribution described in equation (4.1) is independent of $\unicode{x3bb} $ and $\mathcal {L}$ .

For $\boldsymbol {\xi }\in \mathbb {R}^d\setminus \mathbb {Q}^d$ , the distribution is also independent of $\boldsymbol {\xi }$ , so property (d) follows.

Property (b) follows from equation (2.1).

Properties (c) and (e) follow from calculations of [Reference MarklofM00]. We write ${g\kern1.3pt{=}\kern1.3pt(1,\mathbf {b})(M,0)\kern1.3pt{\in}\kern1.3pt G'}$ with $M=n(\mathbf {u})a(\mathbf {v})k\in \mathcal {S}$ as in equations (3.7) and (3.8). For $s\in \{1,\ldots ,d-1\}$ , put

$$ \begin{align*} {\mathcal{S}_s:=\bigg\{M=n(\mathbf{u})a(\mathbf{v})k\in\mathcal{S}: v_{s+1}\leq 1 \leq\frac{2}{\sqrt{3}}v_s\bigg\},} \end{align*} $$

and for $s=0,d,$

$$ \begin{align*} {\mathcal{S}_0:=\{M=n(\mathbf{u})a(\mathbf{v})k\in\mathcal{S}: v_1 \leq 1\},} \end{align*} $$

$$ \begin{align*} {\mathcal{S}_d:=\bigg\{M=n(\mathbf{u})a(\mathbf{v})k\in\mathcal{S}: v_d\geq \frac{\sqrt{3}}{2}\bigg\},} \end{align*} $$

then the sets $\mathcal {S}_0$ and $\mathcal {S}_d$ are clearly compact, and we also have $\mathcal {S}=\bigcup _{s=0}^{d}\mathcal {S}_s$ (see [Reference MarklofM00, Lemma 3.12]). For $k\in \operatorname {SO}(d)$ , we denote by $\chi _k$ the characteristic function of the set $\mathfrak {C}_c(\sigma )k^{-1}$ and define

$$ \begin{align*} {\phi_s(k,w_1,\ldots,w_s):=\int_{ \mathbb{R}^{d-s}}\chi_k(w_1,\ldots,w_s,t_{s+1},\ldots,t_d)\,dt_{s+1}\cdots dt_{d},} \end{align*} $$

$$ \begin{align*} {\phi_{s,\operatorname\max}(w_1, \ldots,w_s):=\max_{k\in\operatorname{SO}(d)}\phi_s(k,w_1,\ldots,w_s).} \end{align*} $$

We have

$$ \begin{align*} {\mathcal{N}(g,\mathfrak{C}_c(\sigma))=\sum_{\mathbf{m}\in\mathbb{Z}^d}\chi_k(v_1w_1(\mathbf{m}),\ldots,v_dw_d(\mathbf{m})),} \end{align*} $$

where $w_i(\mathbf {m})=(m_i+b_i)+\sum _{j=1}^{i-1}u_{ji}(m_j+b_j)$ . Without loss of generality, we may assume $b_1,\ldots ,b_d\in [-\tfrac 12,\tfrac 12]$ . For $M\in \mathcal {S}_s$ with sufficiently large $v_1\cdots v_s$ ,

$$ \begin{align*} {\begin{aligned}\mathcal{N}(g,\mathfrak{C}_c(\sigma))&=\sum_{\mathbf{m}\in \{\mathbf{0}\}\times\mathbb{Z}^{d-s}}\chi_k(v_1w_1(\mathbf{m}),\ldots,v_dw_d(\mathbf{m}))\\ &=v_{s+1}^{-1}\cdots v_{d}^{-1}\phi_s(k,v_1x_1,\ldots,v_sx_s)+O(1),\end{aligned}} \end{align*} $$

where $x_i=b_i+\sum _{j=1}^{i-1}u_{ji}b_j$ for $i=1,\ldots ,s$ .

We first consider the case of $E_{c,\boldsymbol {\xi }}$ for $\boldsymbol {\xi }\in \mathbb {Z}^d$ . For $r_0\to \infty $ and $m_G$ denoting the Haar measure of G (with arbitrary normalization),

$$ \begin{align*} {\begin{aligned} \sum_{r=r_0}^{\infty}E_{c,\boldsymbol{\xi}}(r,\sigma)&=m_{X_1}(\{M\in X_1: \mathcal{N}(g,\mathfrak{C}_c(\sigma))\ge r_0\}) \\&\asymp\sum_{s=0}^{d}m_G(\{M\in\mathcal{S}_s: v_1\cdots v_s\phi_s(k,0,\ldots,0)\ge r_0+O(1)\}) \\&\asymp\sum_{s=0}^{d}m_G\bigg(\bigg\{M\in\mathcal{S}_s: v_1\cdots v_s\ge \frac{r_0+O(1)}{\phi_{s,\operatorname\max}(0,\ldots,0)}\bigg\}\bigg). \end{aligned}} \end{align*} $$

In the last line, we are using the continuity of $\phi _{s,\operatorname \max }$ with respect to $k\in \operatorname {SO}(d)$ . According to the calculation of [Reference MarklofM00, Proof of Theorem 3.11] with $n=2$ , the sum in the last line is $\asymp r_0^{-d}$ . This proves property (c) for $\boldsymbol {\xi }\in \mathbb {Z}^d$ . The case of other $\boldsymbol {\xi }\in \mathbb {Q}^d$ is analogous.

In the case of $\boldsymbol {\xi }\in \mathbb {R}^d\setminus \mathbb {Q}^d$ , we get

$$ \begin{align*} {\begin{aligned} \sum_{r=r_0}^{\infty}E_{c,\boldsymbol{\xi}}(r,\sigma)&=m_{X'}(\{g\in X': \mathcal{N}(g,\mathfrak{C}_c(\sigma))\ge r_0\}) \\&\asymp\sum_{s=0}^{d}m_G(\{M\in\mathcal{S}_s: v_1\cdots v_s\phi_s(k,v_1x_1,\ldots,v_sx_s)\ge r_0+O(1)\}) \\&\asymp\sum_{s=0}^{d}m_G\bigg(\bigg\{M\in\mathcal{S}_s: v_1\cdots v_s\ge \frac{r_0+O(1)}{\phi_{s,\operatorname\max}(v_1x_1,\ldots,v_sx_s)}\bigg\}\bigg). \end{aligned}} \end{align*} $$

In this case, we use the calculation of [Reference MarklofM00, Proof of Theorem 4.3] which implies that the sum in the last line is $\asymp r_0^{-d-1}$ . This proves property (e).

5. Escape of mass

Denote by $\chi _{I}$ the characteristic function of a subset $I\subseteq \mathbb {R}$ . For $R\ge 1$ and $\eta ,r>0$ , define the $\Gamma '$ -invariant function $F_{R,\eta ,r}:G'\to \mathbb {R}$ by

(5.1) $$ \begin{align} {\begin{aligned} F_{R,\eta,r}(g):=\chi_{[R,\infty)}\bigg(\prod_{i=1}^{s_r(g)}v_i(g)\bigg)\; \prod_{i=1}^{s_r(g)} v_i(g)^\eta \chi_{[-c_dr,c_dr]}(v_i(g) b_i(g)). \end{aligned}} \end{align} $$

In view of Lemma 3.1, and equations (3.16) and (3.17), we note that for

(5.2) $$ \begin{align} {\eta=\operatorname{Re}(z_1)+\cdots+\operatorname{Re}(z_m),\quad r=r(\mathfrak{C}_1\cup\cdots\cup\mathfrak{C}_m),} \end{align} $$

and all $g\in G$ such that $\prod _{i=1}^{s_r(g)}v_i(g)\ge R$ with R sufficiently large, we have that

(5.3) $$ \begin{align} {| \mathcal{N}(g,\mathfrak{C}_1)^{z_1}\cdots\mathcal{N}(g,\mathfrak{C}_m)^{z_m}|\leq (C_dr^d)^\eta F_{R,\eta,r}(g).} \end{align} $$

The following proposition establishes under which conditions there is no escape of mass in the equidistribution of horospheres with respect to the function $F_{R,\eta ,r}$ and thus also for $\mathcal {N}(g,\mathfrak {C}_1)^{z_1}\cdots \mathcal {N}(g,\mathfrak {C}_m)^{z_m}$ .

Proposition 5.1. Let $\boldsymbol {\xi }\in \mathbb {R}^d$ , $M_0\in G$ , $\eta ,r>0$ and $\psi \in \operatorname {C}_0(\mathbb {R}^{d-1})$ . Assume that one of the following hypotheses hold:

1. (B1) $\eta <d$ ;

2. (B2) $\eta <d+1$ and $\boldsymbol {\xi }$ is $(0,\eta -2,2)$ -vaguely Diophantine if $d=2$ and $(d-1, \eta -d,1)$ -vaguely Diophantine if $d\geq 3$ .

Then

(5.4) $$ \begin{align} {\lim_{R\to\infty}\limsup_{t\to \infty}\bigg|\!\int_{\mathbf{y}\in\mathbb{R}^{d-1}}F_{R,\eta,r}(\Gamma'(1,\boldsymbol{\xi})M_0\widetilde{n}(\mathbf{y})\Phi_t)\psi(\mathbf{y})\,d\mathbf{y}\bigg|=0.} \end{align} $$

To prepare for the proof of this statement, put $\mathcal {K}:=\mathrm {supp\,} \psi $ . Without loss of generality, we may assume $\mathcal {K}\subset [-1,1]^{d-1}$ . Indeed, there exists $s_0\ge 0$ such that ${e^{-s_0}\mathcal {K}\subset [-1,1]^{d-1}}$ , so we may replace $M_0,\mathbf {y}$ and $\Phi _t$ in equation (5.4) by $M_0\Phi _{-s_0}, e^{s_0}\mathbf {y}$ and $\Phi _{t+s_0}$ , respectively, and reduce it to the case $\mathcal {K}\subset [-1,1]^{d-1}$ .

Next we define two maps $\gamma =\gamma _t:\mathbb {R}^{d-1}\to \Gamma $ and $h=h_t:\mathbb {R}^{d-1}\to \mathcal {F}$ as follows. For $\mathbf {y}\in \mathbb {R}^{d-1}$ , $t\in \mathbb {R}$ , there exist unique $\gamma (\mathbf {y})=\gamma _t(\mathbf {y})\in \Gamma $ and $h(\mathbf {y})=h_t(\mathbf {y})\in \mathcal {F}$ such that

$$ \begin{align*}M_0\widetilde{n}(\mathbf{y})\Phi_t=\gamma(\mathbf{y})h(\mathbf{y}).\end{align*} $$

Note that $\Gamma '(1,\boldsymbol {\xi })M_0\widetilde {n}(\mathbf {y})\Phi _t$ in equation (5.4) can now be expressed as

$$ \begin{align*}\Gamma'(1,\boldsymbol{\xi})M_0\widetilde{n}(\mathbf{y})\Phi_t=\Gamma'(1,\boldsymbol{\xi}\gamma(\mathbf{y}))(h(\mathbf{y}),0).\end{align*} $$

For $1\leq s\leq d-1$ and $\underline {l}=(l_1,\ldots ,l_s)\in \mathbb {Z}^s_{\ge 0}$ , we let

(5.5) $$ \begin{align} {\Xi^s_{\underline{l}}:=\{g\in\mathcal{F}:s_r(g)=s, \delta_d 2^{l_i}< v_i(g)\leq\delta_d 2^{l_i+1} (i=1,\ldots,s)\}} \end{align} $$

with $\delta _d=d4^d$ . Then for $g=(1,\boldsymbol {\xi } \gamma (\mathbf {y}))h(\mathbf {y})$ with $h(\mathbf {y})\in \Xi _{\underline {l}}^s$ , we have

$$ \begin{align*} F_{R,\eta,r}(\Gamma'(1,\boldsymbol{\xi})M_0\widetilde{n}(\mathbf{y})\Phi_t)=F_{R,\eta,r}(\Gamma'(1,\boldsymbol{\xi} \gamma(\mathbf{y}))h(\mathbf{y})) \leq \delta_d^\eta2^{\eta l}\chi_{[R,\infty)}(\delta_d^\eta2^{\eta l}),\end{align*} $$

where $l=l_1+\cdots +l_s$ . It follows that the integral in equation (5.4) is bounded by

(5.6) $$ \begin{align} &\bigg|\!\int_{\mathbf{y}\in\mathcal{K}}F_{R,\eta,r}(\Gamma'(1,\boldsymbol{\xi})M_0\widetilde{n}(\mathbf{y})\Phi_t)\,d\mathbf{y}\bigg|\nonumber\\ &\quad\ll\sum_{s=1}^{d-1}\sum_{l=\lfloor\log_2 R\rfloor}^{\infty} 2^{\eta l} \sum_{\substack{\underline{l}=(l_1,\ldots,l_s)\in\mathbb{Z}^s_{\ge0}, \\ l_1+\cdots+l_s=l}}\operatorname{vol}_{\mathbb{R}^{d-1}}(\{\mathbf{y}\in\mathcal{K}: h(\mathbf{y})\in\Xi_{\underline{l}}^s\} ). \end{align} $$

This will be sufficient for proving case (B1). For hypothesis (B2), we need a refinement that also considers the size of $\boldsymbol {\xi }\gamma (\mathbf {y})$ ; see equation (5.23) below.

Let us write for $1\leq i\leq d$ and $\mathbf {y}\in \mathbb {R}^{d-1}$ , and consider the Iwasawa decomposition of $h(\mathbf {y})$ ,

$$ \begin{align*}h(\mathbf{y})=n(\mathbf{u}(\mathbf{y}))a(\mathbf{v}(\mathbf{y}))k(\mathbf{y}).\end{align*} $$

Proof. For the sake of simplicity, we write $v_{i}=v_{i}(h(\mathbf {y}))$ for $1\hspace{-0.5pt}\leq\hspace{-0.5pt} i\hspace{-0.5pt}\leq\hspace{-0.5pt} d$ and ${u_{ij}\hspace{-0.5pt}=\hspace{-0.5pt}u_{ij}(h(\mathbf {y}))}$ for $1\leq i<j\leq d$ . We also define $\widetilde {\mathbf {u}}(\mathbf {y})\hspace{-0.5pt}=\hspace{-0.5pt}(\widetilde {u}_{ij})_{1\leq i<j\leq d}$ by ${n(\widetilde {\mathbf {u}}(\mathbf {y}))=n(\mathbf {u}(\mathbf {y}))^{-1}}$ . Note that each $\widetilde {u}_{ij}$ can be expressed in terms of at most $2^d$ monomials of $u_{12},\ldots ,u_{(d-1)d}$ with coefficients $\pm 1$ , and hence $|\widetilde {u}_{ij}|\leq 2^d$ for any $1\leq i<j\leq d$ .

If $h(\mathbf {y})\in \Xi ^s_{l}$ , then we have

for $1\leq i\leq d$ . Since $v_{j}^{-1}\leq ({2}/{\sqrt {3}})^{i-j}v_{i}^{-1}\leq 2^dv_i^{-1}$ for any $1\leq j<i\leq d$ ,

$$ \begin{align*} {|\boldsymbol{\beta}_i(\mathbf{y})|=\bigg|v_i^{-1}\mathbf{e}_i-\sum_{j=1}^{i-1}v_{j}^{-1}\widetilde{u}_{ji}\mathbf{e}_j\bigg|\leq d4^d v_i^{-1}=\delta_d v_i^{-1}< 2^{-l_i}} \end{align*} $$

for all $1\leq i\leq s$ .

Denote by $\pi _1:\mathbb {R}^d\to \mathbb {R}$ and the orthogonal projection to the first coordinate and $\pi ':\mathbb {R}^d\to \mathbb {R}^{d-1}$ the orthogonal projection to the remaining $(d-1)$ coordinates. Let and, for $k\in \mathbb {Z}$ , let

(5.7) $$ \begin{align} {\mathcal{R}_k:=\{\mathbf{x}\in\mathbb{R}^d: |\pi_1\mathbf{x}|<2^{k+2}, 2^{k}\leq |\pi'\mathbf{x}|<2^{k+1}\},\quad \Lambda_k:=\mathcal{R}_k\cap \Lambda.} \end{align} $$

Then for sufficiently large k,

(5.8) $$ \begin{align} {\#\Lambda_k\asymp 2^{kd},} \end{align} $$

where the implied constants are independent of k but depend on the fixed $M_0\in G$ . Throughout this section, let $K_0\in \mathbb {Z}$ be the largest integer such that

$$ \begin{align*}\{\mathbf{x}\in\Lambda: |\pi_1\mathbf{x}|<2^{k+1}, |\pi'\mathbf{x}|<2^{k}\}=\varnothing\end{align*} $$

for all $k\leq K_0$ . Note that $K_0$ only depends on the choice of $\Lambda $ .

We define the norm $\| \;\cdot \; \|$ for the wedge product by

For $\underline {k}=(k_1,\ldots ,k_s)\in \mathbb {Z}_{\ge K_0}^s$ and $\underline {p}=(p_1,\ldots ,p_s)\in \mathbb {Z}_{\ge 0}^s$ , we denote by $\Lambda _{\underline {k}}(\underline {p})$ the set of $(\mathbf {x}_1,\ldots ,\mathbf {x}_s)\in \Lambda _{k_1}\times \cdots \times \Lambda _{k_s}$ such that

(5.9) $$ \begin{align} {0<2^{-p_j-1}\|\mathbf{x}_j\| \bigg\|\bigwedge_{i=1}^{j-1}\mathbf{x}_i\bigg\|<\bigg\|\bigwedge_{i=1}^{j}\mathbf{x}_i\bigg\|\leq 2^{-p_j}\|\mathbf{x}_j\| \bigg\|\bigwedge_{i=1}^{j-1}\mathbf{x}_i\bigg\|} \end{align} $$

for $j=1,\ldots ,s$ . Then any $(\mathbf {x}_1,\ldots ,\mathbf {x}_s)\in \Lambda _{k_1}\times \cdots \times \Lambda _{k_s}$ such that $\mathbf {x}_1,\ldots ,\mathbf {x}_s$ are $\mathbb {R}$ -linearly independent is contained in $\bigcup _{\underline {p}\in \mathbb {Z}^s_{\ge 0}}\Lambda _{\underline {k}}(\underline {p})$ .

Lemma 5.3. For any $\underline {k}\in \mathbb {Z}^s_{\ge K_0}$ and $\underline {p}\in \mathbb {Z}^s_{\ge 0}$ ,

$$ \begin{align*}\#\Lambda_{\underline{k}}(\underline{p})\ll \prod_{j=1}^s 2^{\omega_s(k_j,p_j)},\end{align*} $$

where

$$ \begin{align*}\omega_s(k,p)= \begin{cases} dk-(d+1-s)p & \text{if}\ p\leq k,\\ sk-p & \text{if}\ p>k. \end{cases} \end{align*} $$

Moreover, if there exists $1\leq j\leq s$ such that $p_j\ge jk_j+K$ , then $\#\Lambda _{\underline {k}}(\underline {p})=0$ , where K is a sufficiently large constant depending only on the choice of lattice $\Lambda $ .

Proof. Given $\mathbf {x}_1,\ldots ,\mathbf {x}_{j-1}$ , let V be the subspace spanned by $\mathbf {x}_1,\ldots ,\mathbf {x}_{j-1}$ and denote by $\Upsilon $ the region of $\mathbf {x}_j$ satisfying

$$ \begin{align*}\bigg\|\!\bigwedge_{i=1}^{j}\mathbf{x}_i\bigg\|\leq 2^{-p_j}\|\mathbf{x}_j\| \bigg\|\bigwedge_{i=1}^{j-1}\mathbf{x}_i\bigg\|.\end{align*} $$

Note that $\Upsilon \cap \mathcal {R}_k$ has width $\asymp 2^{k_j}$ along the directions in V, and width $\asymp 2^{k_j-p_j}$ along the directions perpendicular to V.

If $p_j\leq k_j$ , then the number of possible $\mathbf {x}_j\in \Lambda _{k_j}$ satisfying equation (5.9) is therefore at most $\ll (2^{k_j})^{j-1}(2^{k_j-p_j})^{d-(j-1)}=2^{dk_j-(d+1-j)p_j}$ .

In the case $p_j> k_j$ , let $j'$ be the maximal number of $\mathbb {R}$ -linearly independent vectors in $\Upsilon \cap \Lambda _{k_j}$ . We may assume $j\leq j'\leq d$ since there is no $\mathbf {x}_j$ satisfying equation (5.9) in $\Upsilon $ otherwise. Then we can take a $j'$ -dimensional parallelepiped $\mathcal {Q}$ generated by $\bar {\mathbf {x}}_1,\ldots ,\bar {\mathbf {x}}_{j'}\in \Upsilon \cap \Lambda _{k_j}$ such that there is no element of $\Upsilon \cap \Lambda _{k_j}$ inside $\mathcal {Q}$ . Since $\bar {\mathbf {x}}_1,\ldots ,\bar {\mathbf {x}}_{j'}$ are $\mathbb {R}$ -linearly independent and contained in , the $j'$ -dimensional volume of is $\ge 1$ . Hence, the $j'$ -dimensional volume of $\mathcal {Q}$ is $\gg 1$ independently of $p_j$ and $\mathbf {x}_1,\ldots ,\mathbf {x}_{j-1}$ . Also, the interior of the sets $\mathbf {x}_j+\mathcal {Q}$ with $\mathbf {x}_j\in \Lambda _{k_j}$ are pairwise disjoint. Note that $\mathcal {Q}$ is contained in $j'(\Upsilon \cap \mathcal {R}_{k_j})$ since the generators are in $\Upsilon \cap \mathcal {R}_{k_j}$ . Thus, for any $\mathbf {x}_j\in \Upsilon \cap \Lambda _{k_j}$ , the set $\mathbf {x}_j+\mathcal {Q}$ is contained in $(j'+1)(\Upsilon \cap \mathcal {R}_{k_j})$ and the $j'$ -dimensional volume of this region is

$$ \begin{align*}\ll (j'+1)^{j'}(2^{k_j})^{j-1}(2^{k_j-p_j})^{j'-(j-1)}\ll 2^{jk_j-p_j}.\end{align*} $$

Because of this and the uniform lower bound on the volume of $\mathcal {Q}$ , it follows that the number of possible $\mathbf {x}_j\in \Lambda _{k_j}$ satisfying equation (5.9) is at most $\ll 2^{jk_j-p_j}$ . In particular, there is no such $\mathbf {x}_j\in \Lambda _{k_j}$ if $p_j\ge jk_j+K$ .

We have shown that for fixed $\mathbf {x}_1,\ldots ,\mathbf {x}_{j-1}$ , the number of possible $\mathbf {x}_j\in \Lambda _{k_j}$ satisfying equation (5.9) is $\ll 2^{\omega _j(k_j,p_j)}\leq 2^{\omega _s(k_j,p_j)}$ . Hence, the desired estimate follows.

For $\underline {l}=(l_1,\ldots ,l_s)\in \mathbb {Z}_{\ge 0}^s$ and $(\mathbf {x}_1,\ldots ,\mathbf {x}_s)\in \Lambda ^s$ , let $\Omega _{\underline {l}}(\mathbf {x}_1,\ldots ,\mathbf {x}_s)$ be the set of ${\mathbf {y}\in \mathcal {K}=\mathrm {supp\,}\psi \subset [-1,1]^{d-1}}$ satisfying the following two conditions:

• • for $i=1,\ldots ,s$ ;

• • $|\boldsymbol {\beta }_i(\mathbf {y})|< 2^{-l_i}$ for $i=1,\ldots ,s$ .

Lemma 5.4. There exists $T_0\ge 0$ such that the following holds for any $t>T_0$ . For $\underline {l}\in \mathbb {Z}_{\ge 0}^s$ and $(\mathbf {x}_1,\ldots ,\mathbf {x}_s)\in \Lambda ^s$ , the set $\Omega _{\underline {l}}(\mathbf {x}_1,\ldots ,\mathbf {x}_s)$ is the empty set if there exists $1\leq i\leq s$ such that

$$ \begin{align*}\mathbf{x}_i\notin \bigcup_{k=K_0}^{\lfloor({t}/{d\log 2})-l_i\rfloor}\Lambda_k.\end{align*} $$

If ${K_0\leq }k_i\leq \lfloor ({t}/{d\log 2})-l_i\rfloor $ for all $1\leq i\leq s$ and $(\mathbf {x}_1,\ldots ,\mathbf {x}_s)\in \Lambda _{\underline {k}}( \underline {p})$ , then

(5.10) $$ \begin{align} {\operatorname{vol}_{\mathbb{R}^{d-1}}(\Omega_{\underline{l}}(\mathbf{x}_1,\ldots,\mathbf{x}_s))\ll e^{-({(d-1)s}/{d})t} \prod_{i=1}^s 2^{p_i-l_i-k_i}.} \end{align} $$

Proof. For $\mathbf {y}\in \Omega _{\underline {l}}(\mathbf {x}_1,\ldots ,\mathbf {x}_s)$ , by definition of $\boldsymbol {\beta }_i(\mathbf {y})$ , we have

for $i=1,\ldots ,s$ . By a straightforward computation with $\mathbf {x}_i=(\pi _1\mathbf {x}_i,\pi '\mathbf {x}_i)\in \mathbb {R}\times \mathbb {R}^{d-1}$ , it implies that

(5.11) $$ \begin{align} {|\pi_1\mathbf{x}_i-\pi'\mathbf{x}_i\cdot\mathbf{y}|<2^{-l_i}e^{-(({d-1})/{d})t},} \end{align} $$

(5.12) $$ \begin{align} {|\pi'\mathbf{x}_i|<2^{-l_i}e^{{t}/{d}}} \end{align} $$

for $i=1,\ldots ,s$ .

If there exists i such that $\mathbf {x}_i\in \Lambda _{k_i}$ with $k_i>({t}/{d\log 2})-l_i$ , then it contradicts equation (5.12). If there exists i such that $\mathbf {x}_i\notin \bigcup _{k=K_0}^{\infty }\Lambda _k$ , then we have $|\pi _1\mathbf {x}_i|>2|\pi '\mathbf {x}_i|$ , which also contradicts equations (5.11) and (5.12) since they imply

$$ \begin{align*}|\pi_1\mathbf{x}_i|\leq |\pi'\mathbf{x}_i||\mathbf{y}|+2^{-l_i}e^{-(({d-1})/{d})t}< |\pi'\mathbf{x}_i|+2^{K_0-1}.\end{align*} $$

This proves the first claim of the lemma.

Suppose now that $k_i\leq ({t}/{d\log 2})-l_i$ for all $i=1,\ldots ,s$ and $(\mathbf {x}_1,\ldots ,\mathbf {x}_s)\in \Lambda _{\underline {k}}(\underline {p})$ . To prove the estimate in equation (5.10), we may assume $\Omega _{\underline {l}}(\mathbf {x}_1,\ldots ,\mathbf {x}_s)\neq \emptyset $ and pick any $\mathbf {y}\in \Omega _{\underline {l}}(\mathbf {x}_1,\ldots ,\mathbf {x}_s)$ . Let $p_1',\ldots ,p_s'\in \mathbb {Z}_{\ge 0}$ be the integers such that

$$ \begin{align*}2^{-p_j'-1}\bigg\|\bigwedge_{i=1}^{j-1} \frac{\pi'\mathbf{x}_i}{\|\pi'\mathbf{x}_i\|}\bigg\|< \bigg\|\bigwedge_{i=1}^j \frac{\pi'\mathbf{x}_i}{\|\pi'\mathbf{x}_i\|}\bigg\|\leq2^{-p_j'}\bigg\|\bigwedge_{i=1}^{j-1} \frac{\pi'\mathbf{x}_i}{\|\pi'\mathbf{x}_i\|}\bigg\|\end{align*} $$

for $j=1,\ldots ,s$ .

We will prove that $p_j'\leq p_j+O(1)$ for all $1\leq j\leq s$ . Since ${\pi '\mathbf {x}_i}/{\|\pi '\mathbf {x}_i\|}$ terms are unit vectors, for each j, we can find $c_1,\ldots ,c_{j-1}\ll 1$ such that

(5.13) $$ \begin{align} {\bigg\|\frac{\pi'\mathbf{x}_j}{\|\pi'\mathbf{x}_j\|}-\sum_{i=1}^{j-1}c_i\frac{\pi'\mathbf{x}_i}{\|\pi'\mathbf{x}_i\|}\bigg\|\ll 2^{-p_j'}.} \end{align} $$

This in turn implies that for any choice of $\mathbf {y}$ ,

(5.14) $$ \begin{align} {\bigg|\frac{\pi'\mathbf{x}_j\cdot \mathbf{y}}{\|\pi'\mathbf{x}_j\|}-\sum_{i=1}^{j-1}c_i\frac{\pi'\mathbf{x}_i\cdot\mathbf{y}}{\|\pi'\mathbf{x}_i\|}\bigg|\ll 2^{-p_j'} \|\mathbf{y}\| .} \end{align} $$

Now, if $\mathbf {y}\in \Omega _{\underline {l}}(\mathbf {x}_1,\ldots ,\mathbf {x}_s)$ , then we have equation (5.11), and using the triangle inequality and $\|\pi '\mathbf {x}_i\|\gg 2^{k_i}$ , it follows that

(5.15) $$ \begin{align} {\bigg|\frac{\pi_1\mathbf{x}_j}{\|\pi'\mathbf{x}_j\|}-\sum_{i=1}^{j-1}c_i\frac{\pi_1\mathbf{x}_i}{\|\pi'\mathbf{x}_i\|}\bigg|\ll 2^{-p_j'}+\sum_{i=1}^{j}2^{-l_i-k_i}e^{-(({d-1})/{d})t}.} \end{align} $$

Combining equations (5.13) and (5.15), we get

(5.16) $$ \begin{align} {\bigg\|\frac{\mathbf{x}_j}{\|\pi'\mathbf{x}_j\|}-\sum_{i=1}^{j-1}c_i\frac{\mathbf{x}_i}{\|\pi'\mathbf{x}_i\|}\bigg\|\ll 2^{-p_j'}+\sum_{i=1}^{j}2^{-l_i-k_i}e^{-(({d-1})/{d})t},} \end{align} $$

and hence

(5.17) $$ \begin{align} {\bigg\|\bigwedge_{i=1}^j \frac{\mathbf{x}_i}{\|\pi'\mathbf{x}_i\|}\bigg\|\ll\bigg(2^{-p_j'}+\sum_{i=1}^{j}2^{-l_i-k_i}e^{-(({d-1})/{d})t}\bigg)\bigg\|\bigwedge_{i=1}^{j-1} \frac{\mathbf{x}_i}{\|\pi'\mathbf{x}_i\|}\bigg\|} \end{align} $$

for $j=1,\ldots ,s$ . Since $\|\pi '\mathbf {x}_i\|\asymp \|\mathbf {x}_i\|$ for all $i=1,\ldots ,s$ by definition of $\Lambda _{k_i}$ terms, we can replace the $\|\pi '\mathbf {x}_i\|$ terms in equation (5.17) with $\|\mathbf {x}_i\|$ terms for $i=1,\ldots ,j$ . By equation (5.9), it implies that

(5.18) $$ \begin{align} {2^{-p_j}\leq C\bigg(2^{-p_j'}+\sum_{i=1}^{j}2^{-l_i-k_i}e^{-(({d-1})/{d})t}\bigg)} \end{align} $$

for some constant $C>0$ .

However, we have

$$ \begin{align*}\prod_{i=1}^{j}2^{k_i-p_i}\gg\prod_{i=1}^{j}2^{-p_i}\prod_{i=1}^{j}\|\mathbf{x}_j\|\asymp \bigg\|\bigwedge_{i=1}^{j}\mathbf{x}_i\bigg\|\ge 1,\end{align*} $$

and hence $p_j\leq \sum _{i=1}^{j}p_i\leq \sum _{i=1}^{j}k_i+O(1)$ for any $1\leq j\leq s$ . It follows that ${2^{-p_j}\gg 2^{-k_i}e^{-(({j-1})/{d})t}\geq 2^{-k_i}e^{-(({d-2})/{d})t}}$ for all $1\leq i\leq j$ , so for C as above,

(5.19) $$ \begin{align} {2^{-p_j} \ge 2C\sum_{i=1}^{j}2^{-l_i-k_i}e^{-(({d-1})/{d})t}} \end{align} $$

holds for sufficiently large t. Combining with equation (5.18), we have $p_j'\leq p_j+O(1)$ for all $1\leq j\leq s$ .

For each i, the set of $\mathbf {y}\in \mathcal {K}$ satisfying equation (5.11) is a $2^{-l_i}e^{-(({d-1})/{d})t}\|\pi '\mathbf {x}_i\|^{-1}$ -thickened hyperplane in $\mathbb {R}^{d-1}$ which is perpendicular to $\pi '\mathbf {x}_i$ . Therefore, $\operatorname {vol}_{\mathbb {R}^{d-1}}(\Omega _{\underline {l}}(\mathbf {x}_1,\ldots ,\mathbf {x}_s))$ is the volume of the intersection of such s-number of hyperplanes and the compact set $\mathcal {K}$ . The intersection has width $\ll 2^{-l_i}e^{-(({d-1})/{d})t}\|\pi '\mathbf {x}_i\|^{-1}$ along the direction of $\pi '\mathbf {x}_i$ for $1\leq i\leq s$ . It follows that the volume of the intersection is bounded above by

$$ \begin{align*} &\!\!\!\!\!\!\!\!\!\!\ll \bigg\|\!\bigwedge_{i=1}^s \frac{\pi'\mathbf{x}_i}{\|\pi'\mathbf{x}_i\|}\bigg\|^{-1}\prod_{i=1}^s (2^{-l_i}e^{-(({d-1})/{d})t}\|\pi'\mathbf{x}_i\|^{-1})\\ &\!\!\!\!\!\!\!\!\!\!\ll \bigg(\prod_{i=1}^{s}2^{-p_i'}\bigg)^{-1}\prod_{i=1}^s (2^{-l_i}e^{-(({d-1})/{d})t}\|\mathbf{x}_i\|^{-1})\ll e^{-({(d-1)s}/{d})t}\prod_{i=1}^{s}2^{p_i-l_i-k_i}.\\[-51pt] \end{align*} $$

Proof of Proposition 5.1 under hypothesis (B1)

By Lemma 5.2,

(5.20) $$ \begin{align}\operatorname{vol}_{\mathbb{R}^{d-1}}(\{\mathbf{y}\in\mathcal{K}:h(\mathbf{y})\in\Xi_{\underline{l}}^s\})\leq \operatorname{vol}_{\mathbb{R}^{d-1}}(\{\mathbf{y}\in\mathcal{K}:|\boldsymbol{\beta}_i(\mathbf{y})|<2^{-l_i}(i=1,\ldots,s)\}). \end{align} $$

For $\underline {l}=(l_1,\ldots ,l_s)\in \mathbb {Z}_{\ge 0}^s$ , by Lemma 5.4, we have

$$ \begin{align*} {\begin{aligned} &\operatorname{vol}_{\mathbb{R}^{d-1}}(\{\mathbf{y}\in\mathcal{K}: |\boldsymbol{\beta}_i(\mathbf{y})|<2^{-l_i}(i=1,\ldots,s)\})\\ &\quad=\sum_{(\mathbf{x}_1,\ldots,\mathbf{x}_s)\in\Lambda^s}\operatorname{vol}_{\mathbb{R}^{d-1}}(\Omega_{\underline{l}}(\mathbf{x}_1,\ldots,\mathbf{x}_s))\\ &\quad=\sum_{k_1=K_0}^{\lfloor({t}/{d\log 2})-l_1\rfloor}\cdots\sum_{k_s=K_0}^{\lfloor({t}/{d\log 2})-l_s\rfloor}\sum_{\underline{p}\in\mathbb{Z}_{\ge0}^s}\sum_{(\mathbf{x}_1,\ldots,\mathbf{x}_s)\in\Lambda_{\underline{k}}(\underline{p})}\operatorname{vol}_{\mathbb{R}^{d-1}}(\Omega_{\underline{l}}(\mathbf{x}_1,\ldots,\mathbf{x}_s))\\ &\quad\ll\sum_{k_1=K_0}^{\lfloor({t}/{d\log 2})-l_1\rfloor}\cdots\sum_{k_s=K_0}^{\lfloor({t}/{d\log 2})-l_s\rfloor}\sum_{\underline{p}\in\mathbb{Z}_{\ge0}^s}\#\Lambda_{\underline{k}}(\underline{p})e^{-({(d-1)s}/{d})t}\prod_{i=1}^{s}2^{p_i-l_i-k_i}.\end{aligned}} \end{align*} $$

Using the estimate of $\#\Lambda _{\underline {k}}(\underline {p})$ in Lemma 5.3, we get

$$ \begin{align*} &\!\ll e^{-({(d-1)s}/{d})t}\kern-2pt\prod_{i=1}^s\kern-2.5pt\bigg(\!\sum_{k_i={K_0}}^{\lfloor({t}/{d\log 2})-l_i\rfloor}\kern-3.5pt\bigg(\kern-1.8pt\sum_{p_i=0}^{k_i}2^{dk_i-(d-s+1)p_i}2^{p_i-l_i-k_i}+\sum_{p_i=k_i+1}^{sk_i+K}\kern-1.2pt 2^{sk_i-p_i}2^{p_i-l_i-k_i}\kern-1.5pt\bigg)\!\kern-0.2pt\bigg)\\ &\!\ll e^{-({(d-1)s}/{d})t}\prod_{i=1}^s\bigg(\sum_{k_i=K_0}^{\lfloor({t}/{d\log 2})-l_i\rfloor} (2^{(d-1)k_i-l_i}+(sk_i+K)2^{(s-1)k_i-l_i})\bigg)\\ &\!\ll e^{-({(d-1)s}/{d})t}\prod_{i=1}^s\bigg(\sum_{k_i=K_0}^{\lfloor({t}/{d\log 2})-l_i\rfloor}2^{(d-1)k_i-l_i}\bigg)\ll 2^{-d\sum l_i}. \end{align*} $$

Hence, combining with equation (5.6), for any $t,R>0$ and $\eta <d$ , we obtain

(5.21) $$ \begin{align} {\begin{aligned} &\bigg|\!\int_{\mathbf{y}\in\mathcal{K}}F_{R,\eta,r}(\Gamma'(1,\boldsymbol{\xi})M_0\widetilde{n}(\mathbf{y})\Phi_t)\,d\mathbf{y}\bigg|\\ &\quad\ll \sum_{s=1}^{d-1}\sum_{l=\lfloor\log_2 R\rfloor}^{\infty} l^{s-1}2^{-(d-\eta) l}\ll R^{-(d-\eta+o(1))}, \end{aligned}} \end{align} $$

which completes the proof.

Proof of Proposition 5.1 under hypothesis (B2)

Recall that $\Gamma '(1,\boldsymbol {\xi })M_0\widetilde {n}(\mathbf {y})\Phi _t$ in equation (5.4) is expressed as

$$ \begin{align*}\Gamma'(1,\boldsymbol{\xi})M_0\widetilde{n}(\mathbf{y})\Phi_t=\Gamma'(1,\boldsymbol{\xi}\gamma(\mathbf{y}))\, h(\mathbf{y}).\end{align*} $$

For $1\leq s\leq d-1$ and $\underline {l}=(l_1,\ldots ,l_s)\in \mathbb {Z}_{\ge 0}^s$ with $l_1+\cdots +l_s=l$ , we define ${\Xi ^s_{\underline {l}}\subseteq \mathcal {F}}$ as in equation (5.5) and $\Gamma _{\underline {l}}^{s,r}\subseteq \Gamma $ by

(5.22) $$ \begin{align} {\begin{aligned} \Gamma_{\underline{l}}^{s,r}&:=\{\gamma\in\Gamma: |(\boldsymbol{\xi}\gamma)\cdot \mathbf{e}_i|_{\mathbb{Z}}\leq \delta_{d,r}2^{-l_i}(i=1,\ldots,s)\}, \end{aligned}} \end{align} $$

where $\delta _{d,r}={c_d r}/{\delta _d}$ . For $g=(1,\boldsymbol {\xi } \gamma (\mathbf {y}))h(\mathbf {y})$ with $h(\mathbf {y})\in \Xi _{\underline {l}}^s$ , we have

$$ \begin{align*} F_{R,\eta,r}(\Gamma'(1,\boldsymbol{\xi})M_0\widetilde{n}(\mathbf{y})\Phi_t)&=F_{R,\eta,r}(\Gamma'(1,\boldsymbol{\xi} \gamma(\mathbf{y}))h(\mathbf{y}))\\ &\leq \delta_d^\eta2^{\eta l}\chi_{[R,\infty)}(\delta_d^\eta2^{\eta l})\prod_{i=1}^{s}\chi_{[-\delta_{d,r} 2^{-l_i},\delta_{d,r} 2^{-l_i}]}(b_i(g))\end{align*} $$

since, by construction, we have $v_i(g) \geq \delta _d 2^{l_i}$ and thus ${c_d r}/{v_i(g)} \leq \delta _{d,r} 2^{-l_i}$ . Since $|b_i(g)|=|(\boldsymbol {\xi }\gamma )\cdot \mathbf {e}_i|_{\mathbb {Z}}$ , the integral in equation (5.4) is bounded by

(5.23) $$ \begin{align} &\bigg|\!\int_{\mathbf{y}\in\mathcal{K}}F_{R,\eta,r}(\Gamma'(1,\boldsymbol{\xi})M_0\widetilde{n}(\mathbf{y})\Phi_t)\,d\mathbf{y}\bigg|\nonumber\\ &\ll\sum_{s=1}^{d-1}\sum_{l=\lfloor\log_2 R\rfloor}^{\infty} 2^{\eta l}\sum_{\substack{\underline{l}=(l_1,\ldots,l_s)\in\mathbb{Z}^s_{\ge0} \\ l_1+\cdots+l_s=l}} \operatorname{vol}_{\mathbb{R}^{d-1}}(\{\mathbf{y}\in\mathcal{K}: h(\mathbf{y})\in\Xi_{\underline{l}}^s, \gamma(\mathbf{y})\in \Gamma_{\underline{l}}^{s,r}\} ).\end{align} $$

This is the required improvement on equation (5.6).

The remaining task is thus to estimate the measure of the set of $\mathbf {y}\in \mathcal {K}$ such that ${h(\mathbf {y})\in \Xi _{\underline {l}}^s}$ and $\gamma (\mathbf {y})\in \Gamma _{\underline {l}}^{s,r}$ . Recall that . From now on, we fix $r>0$ as in equation (5.2) and no longer record the implicit dependence of constants on this parameter. For ${\underline {k}\in \mathbb {Z}_{\ge K_0}^s}$ , $\underline {l}\in \mathbb {Z}_{\ge 0}^s$ and $\underline {p}\in \mathbb {Z}_{\ge 0}^s$ , we denote by $\Lambda _{\underline {k}}^{\underline {l}}(\underline {p})$ the set of elements in $(\mathbf {x}_1,\ldots ,\mathbf {x}_s)\in \Lambda _{\underline {k}}(\underline {p})$ satisfying

(5.24)

for all $1\leq i\leq s$ . As we counted the number of lattice points of $\Lambda _{\underline {k}}(\underline {p})$ in Lemma 5.3, here we count the number of lattice points of $\Lambda _{\underline {k}}^{\underline {l}}(\underline {p})$ as follows.

Lemma 5.5. For $\boldsymbol {\xi }\in \mathbb {R}^d$ , let

$$ \begin{align*}&\omega_{s,\boldsymbol{\xi}}(k,p,l)\\&\quad= \begin{cases} dk-(d+1-s)p-d\log_2\dfrac{\zeta(\boldsymbol{\xi},2^{l-1})}{4\|M_0\|} & \text{if }p\leq k-\log_2\dfrac{\zeta(\boldsymbol{\xi},2^{l-1})}{4\|M_0\|},\\[6pt] (s-1)k-(s-1)\log_2\dfrac{\zeta(\boldsymbol{\xi},2^{l-1})}{4\|M_0\|} & \text{if }0\leq k-\log_2\dfrac{\zeta(\boldsymbol{\xi},2^{l-1})}{4\|M_0\|}<p\leq k,\\ sk-p & \text{if}\ p>k. \end{cases} \end{align*} $$

For any $\underline {k}\in \mathbb {Z}_{\ge K_0}^s$ , $\underline {l}\in \mathbb {Z}_{\ge 0}^s$ and $\underline {p}\in \mathbb {Z}^s_{\ge 0}$ ,

$$ \begin{align*}\#\Lambda_{\underline{k}}^{\underline{l}}(\underline{p})\ll \prod_{j=1}^{s}2^{\omega_{s,\boldsymbol{\xi}}(k_j,p_j,l_j)}.\end{align*} $$

Moreover, if there exists $1\leq j\leq s$ such that $p_j\ge jk_j+K$ or $k_j<\log _2({\zeta (\boldsymbol {\xi },2^{l-1})}/ {4\|M_0\|})$ , then $\#\Lambda _{\underline {k}}(\underline {p})=0$ . Here, K is a sufficiently large constant depending on the choice of lattice  $\Lambda $ .

Proof. For $(\mathbf {x}_1,\ldots ,\mathbf {x}_s)\in \Lambda _{\underline {k}}^{\underline {l}}(p)\subseteq \Lambda _{\underline {k}}(p)$ , recall that

(5.25) $$ \begin{align} {\bigg\|\bigwedge_{i=1}^{j}\mathbf{x}_i\bigg\|\leq 2^{-p_j}\|\mathbf{x}_j\|\bigg\|\bigwedge_{i=1}^{j-1}\mathbf{x}_i\bigg\|} \end{align} $$

for $j=1,\ldots ,s$ . Given $\mathbf {x}_1,\ldots ,\mathbf {x}_{j-1}$ , in the proof of Lemma 5.3, we already showed that the possible number of $\mathbf {x}_j\in \Lambda _{k_j}$ is $\ll 2^{\omega _s(k_j,p_j)}=2^{sk_j-p_j}$ if $p_j>k_j$ . Hence, it is enough to show that this bound can be improved under the assumption $p_j\leq k_j$ .

We first consider the case $p_j\leq k_j-\log _2({\zeta (\boldsymbol {\xi },2^{l-1})}/{4\|M_0\|})$ . In this case, if $\mathbf {x}_j\in \Lambda _{k_j}$ satisfies equation (5.25), then $\mathbf {x}_j$ must be $\ll 2^{k_j-p_j}$ -close to the subspace V spanned by $\mathbf {x}_1,\ldots ,\mathbf {x}_{j-1}$ . Hence, the region of $\mathbf {x}_j$ satisfying equation (5.25) has width $2^{k_j-p_j}$ along the directions perpendicular to V and width $2^{k_j}$ along the directions of V. This region can be covered with at most

$$ \begin{align*}\ll2^{dk_j-(d+1-j)p_j}\zeta(\boldsymbol{\xi},\delta_{d,r}^{-1}2^{l_j-1})^{-d}\ll 2^{dk_j-(d+1-j)p_j}\zeta(\boldsymbol{\xi},2^{l_j-1})^{-d}\end{align*} $$

cubes with sidelength $\|M_0\|^{-1}\zeta (\boldsymbol {\xi },\delta _{d,r}^{-1}2^{l_j-1})$ .

We claim that there is at most one point of $\Lambda _{k_j}$ satisfying equation (5.24) in each cube with sidelength $\|M_0\|^{-1}\zeta (\boldsymbol {\xi },\delta _{d,r}^{-1}2^{l_j-1})$ . To see this, suppose that there are two distinct points $\mathbf {x},\mathbf {x}'\in \Lambda _{k_j}$ with distance $< \|M_0\|^{-1}\zeta (\boldsymbol {\xi },\delta _{d,r}^{-1}2^{l_j-1})$ satisfying equation (5.24). Then we have and

However, by the definition in equation (1.2), there is no $\mathbf {m}\in \mathbb {Z}^d\setminus \{0\}$ with $|\mathbf {m}|<\zeta (\boldsymbol {\xi },\delta _{d,r}^{-1}2^{l_j-1})$ and $|\boldsymbol {\xi }\cdot \mathbf {m}|_{\mathbb {Z}}\leq \delta _{d,r}2^{-l_j+1}$ . Hence, the claim is proved. It follows from the claim that the number of possible $\mathbf {x}_j\in \Lambda _{k_j}$ satisfying equations (5.24) and (5.25) is at most $\ll 2^{dk_j-(d+1-j)p_j}({\zeta (\boldsymbol {\xi },2^{l_j-1})}/{4\|M_0\|})^{-d}= 2^{\omega _{s,\boldsymbol {\xi }}(k_j,p_j,l_j)}$ .

We now consider the case $k_j-\log _2({\zeta (\boldsymbol {\xi },2^{l-1})}/{4\|M_0\|})<p_j\leq k_j$ . In this case, the region of $\mathbf {x}_j$ satisfying equation (5.25) can be covered with at most

$$ \begin{align*}\ll 2^{(j-1)k_j}\zeta(\boldsymbol{\xi},\delta_{d,r}^{-1}2^{l_j-1})^{-(j-1)}\ll2^{(j-1)k_j}\zeta(\boldsymbol{\xi},2^{l_j-1})^{-(j-1)}\end{align*} $$

cubes with sidelength $\|M_0\|^{-1}\zeta (\boldsymbol {\xi },\delta _{d,r}^{-1}2^{l_j-1})$ since this region has width $2^{k_j-p_j}< {\zeta (\boldsymbol {\xi },\delta _{d,r}^{-1}2^{l_j-1})}/{4\|M_0\|}$ along the directions perpendicular to V and width $2^{k_j}$ along the directions of V. Similar to the previous case, the number of possible $\mathbf {x}_j\in \Lambda _{k_j}$ satisfying equations (5.24) and (5.25) is at most

$$ \begin{align*}\ll\bigg(2^{k_j}\bigg(\frac{\zeta(\boldsymbol{\xi},2^{l_j-1})}{4\|M_0\|}\bigg)^{-1}\bigg)^{j-1}\leq \bigg(2^{k_j}\bigg(\frac{\zeta(\boldsymbol{\xi},2^{l_j-1})}{4\|M_0\|}\bigg)^{-1}\bigg)^{s-1}= 2^{\omega_{s,\boldsymbol{\xi}}(k_j,p_j,l_j)}.\end{align*} $$

We have shown that for fixed $\mathbf {x}_1,\ldots ,\mathbf {x}_{j-1}$ , the number of possible $\mathbf {x}_j\in \Lambda _{k_j}$ satisfying equations (5.24) and (5.25) is $\ll 2^{\omega _{s,\boldsymbol {\xi }}(k_j,p_j,l_j)}$ . Hence, we obtain the desired estimate.

As we have shown in Lemma 5.3, $\#\Lambda _{\underline {k}}(\underline {p})=0$ if there exists $1\leq j\leq s$ such that ${p_j\geq jk_j+K}$ . However, if there exists $1\leq j\leq s$ such that $k_j<\log _2({\zeta (\boldsymbol {\xi },2^{l-1})}/{4\|M_0\|})$ , then we have since $\mathbf {x}_j\in \Lambda _{k_j}$ . It follows that by definition of $\zeta (\boldsymbol {\xi },T)$ . In other words, there is no $\mathbf {x}_j\in \Lambda _{k_j}$ satisfying equation (5.24), and hence $\#\Lambda _{\underline {k}}(\underline {p})=0$ .

The rest of the argument is similar to the case (B1). By Lemmas 5.2 and 5.4, we have

for $\underline {l}=(l_1,\ldots ,l_s)\in \mathbb {Z}_{\ge 0}^s$ . Using the estimate of $\#\Lambda _{\underline {k}}^{\underline {l}}(\underline {p})$ in Lemma 5.5, we obtain

(5.26) $$ \begin{align} &\operatorname{vol}_{\mathbb{R}^{d-1}}(\{\mathbf{y}\in\mathcal{K}: h(\mathbf{y})\in\Xi_{\underline{l}}^s, \gamma(\mathbf{y})\in\Gamma_{\underline{l}}^{s,r}\})\nonumber\\ &\quad\ll e^{-({(d-1)s}/{d})t}\prod_{i=1}^{s}\bigg(\sum_{k_i=K_0}^{\lfloor({t}/{d\log 2})-l_i\rfloor}\sum_{p_i=0}^{sk_i+K}2^{\omega_{s,\boldsymbol{\xi}}(k_i,p_i,l_i)}2^{p_i-l_i-k_i}\bigg)\nonumber\\ &\quad=e^{-({(d-1)s}/{d})t}\prod_{i=1}^{s}\bigg(\sum_{k_i=\lceil \log_2({\zeta(\boldsymbol{\xi},2^{l_i-1})}/{4\|M_0\|})\rceil}^{\lfloor({t}/{d\log 2})-l_i\rfloor}\sum_{p_i=0}^{sk_i+K}2^{\omega_{s,\boldsymbol{\xi}}(k_i,p_i,l_i)}2^{p_i-l_i-k_i}\bigg). \end{align} $$

We may assume

(5.27) $$ \begin{align} {\frac{t}{d\log 2}-l_i>\log_2\frac{\zeta(\boldsymbol{\xi},2^{l_i-1})}{4\|M_0\|}} \end{align} $$

for all i since otherwise, the product over i is zero.

We split the double sum in the last line of equation (5.26) as follows:

$$ \begin{align*} &\!\sum_{k_i=\lceil \log_2({\zeta(\boldsymbol{\xi},2^{l_i-1})}/{4\|M_0\|})\rceil}^{\lfloor({t}/{d\log 2})-l_i\rfloor}\sum_{p_i=0}^{sk_i+K}2^{\omega_{s,\boldsymbol{\xi}}(k_i,p_i,l_i)}2^{p_i-l_i-k_i}=\sum_{k_i=\lceil \log_2({\zeta(\boldsymbol{\xi},2^{l_i-1})}/{4\|M_0\|})\rceil}^{\lfloor({t}/{d\log 2})-l_i\rfloor}\\&\!\times\bigg(\sum_{p_i=0}^{k_i-\lfloor \log_2({\zeta(\boldsymbol{\xi},2^{l_i-1})}/{4\|M_0\|})\rfloor-1}2^{(d-1)k_i-(d-s)p_i-l_i-d\log_2({\zeta(\boldsymbol{\xi},2^{l_i-1})}/{4\|M_0\|})} \\&\!+\kern-1.2pt\sum_{p_i=k_i-\lfloor \log_2({\zeta(\boldsymbol{\xi},\!2^{l_i-1})}/{4\|M_0\|})\rfloor}^{k_i}\kern-2pt2^{(s-2)k_i+p_i-l_i-(s-1)\log_2({\zeta(\boldsymbol{\xi},2^{l_i-1})}/{4\|M_0\|})}\kern-1pt+\!\sum_{p_i=k_i+1}^{sk_i+K}\kern-2pt2^{(s-1)k_i-l_i}\!\bigg)\kern-0.6pt. \end{align*} $$

This is bounded above by

$$ \begin{align*} &\ll \sum_{k_i=\lceil \log_2({\zeta(\boldsymbol{\xi},2^{l_i-1})}/{4\|M_0\|})\rceil}^{\lfloor({t}/{d\log 2})-l_i\rfloor}(2^{(d-1)k_i-l_i}\zeta(\boldsymbol{\xi},2^{l_i-1})^{-d}\\&\quad+2^{(s-1)k_i-l_i}\zeta(\boldsymbol{\xi},2^{l_i-1})^{-(s-1)}+(sk_i+K)2^{(s-1)k_i-l_i})\\ &\ll \sum_{k_i=\lceil \log_2({\zeta(\boldsymbol{\xi},2^{l_i-1})}/{4\|M_0\|})\rceil}^{\lfloor({t}/{d\log 2})-l_i\rfloor}(2^{(d-1)k_i-l_i}\zeta(\boldsymbol{\xi},2^{l_i-1})^{-d}\\&\quad+2^{(s-1)k_i-l_i}\zeta(\boldsymbol{\xi},2^{l_i-1})^{-(s-1)}+k_i2^{(d-2)k_i-l_i})\\&\ll e^{(({d-1})/{d})t}2^{-dl_i}\zeta(\boldsymbol{\xi},2^{l_i-1})^{-d}+e^{(({s-1})/{d})t}2^{-sl_i}\zeta(\boldsymbol{\xi},2^{l_i-1})^{-(s-1)}+te^{(({d-2})/{d})t}2^{-(d-1)l_i}. \end{align*} $$

In summary, we have established that

(5.28) $$ \begin{align} &e^{-(({d-1})/{d})t}\sum_{k_i=\lceil \log_2({\zeta(\boldsymbol{\xi},2^{l_i-1})}/{4\|M_0\|})\rceil}^{\lfloor({t}/{d\log 2})-l_i\rfloor}\sum_{p_i=0}^{sk_i+K}2^{\omega_{s,\boldsymbol{\xi}}(k_i,p_i,l_i)}2^{p_i-l_i-k_i}\nonumber\\ &\ll 2^{-dl_i}\zeta(\boldsymbol{\xi},2^{l_i-1})^{-d}+e^{-(({d-s})/{d})t}2^{-sl_i}\zeta(\boldsymbol{\xi},2^{l_i-1})^{-(s-1)}+te^{-{t}/{d}}2^{-(d-1)l_i}\nonumber\\ &\ll 2^{-dl_i}\zeta(\boldsymbol{\xi},2^{l_i-1}\kern-0.2pt)^{\kern-1pt-d}\kern1.2pt{+}\kern1.2pt 2^{-dl_i}\zeta(\boldsymbol{\xi},2^{l_i-1})^{\kern-1pt-(d-1)}\kern1.2pt{+}\kern1.2pt(l_i\kern1.2pt{+}\kern1.2pt\log_2\zeta(\boldsymbol{\xi},2^{l_i-1}\kern-0.2pt))2^{-dl_i}\zeta(\boldsymbol{\xi},2^{l_i-1}\kern-0.2pt)^{\kern-1pt-1}\nonumber\\ &\ll (l_i+\log_2\zeta(\boldsymbol{\xi},2^{l_i-1}))2^{-dl_i}\zeta(\boldsymbol{\xi},2^{l_i-1})^{-1} \ll l_i2^{-dl_i}\zeta(\boldsymbol{\xi},2^{l_i-1})^{-1}. \end{align} $$

Here we have used that $e^{-{t}/{d}}< 2^{-l_i} 4\|M_0\| \zeta (\boldsymbol {\xi },2^{l_i-1})^{-1}$ and

$$ \begin{align*}\frac{t}{d}\,e^{-{t}/{d}}< \bigg(l_i+\log_2\frac{\zeta(\boldsymbol{\xi},2^{l_i-1})}{4\|M_0\|}\bigg)2^{-l_i} 4\|M_0\| \zeta(\boldsymbol{\xi},2^{l_i-1})^{-1}\end{align*} $$

for $t>d$ , both of which follow from equation (5.27). (Note that $x\mapsto x 2^{-x}$ is strictly decreasing for $x>{1}/{\log 2}$ .)

Combining equations (5.26) and (5.28), we have

(5.29) $$ \begin{align} {\operatorname{vol}_{\mathbb{R}^{d-1}}\bigg(\bigg\{\mathbf{y}\in\mathcal{K}: h(\mathbf{y})\in\Xi_{\underline{l}}^s, \gamma(\mathbf{y})\in\Gamma_{\underline{l}}^{s,r}\bigg\}\bigg)\ll l^s2^{-dl}\prod_{i=1}^{s}\zeta(\boldsymbol{\xi},2^{l_i-1})^{-1}} \end{align} $$

for any $\underline {l}=(l_1,\ldots ,l_s)\in \mathbb {Z}_{\ge 0}^{s}$ with $l_1+\cdots +l_s=l$ .

For any $t,R>0$ , it follows from equations (5.23) and (5.29) that

(5.30) $$ \begin{align} & \bigg|\!\int_{\mathbf{y}\in[-1,1]^{d-1}} F_{R,\eta,r}(\Gamma'(1,\boldsymbol{\xi})M_0\widetilde{n}(\mathbf{y})\Phi_t)\,d\mathbf{y}\bigg| \nonumber\\ &\quad \ll \sum_{s=1}^{d-1} \sum_{l=\lfloor\log_2 R\rfloor}^{s\lfloor({t}/{d\log 2})\rfloor} \sum_{\substack{\underline{l}=(l_1,\ldots,l_s)\in\mathbb{Z}^s_{\ge0} \\ l_1+\cdots+l_s=l}} l^s 2^{(\eta-d)l}\prod_{i=1}^{s}\zeta(\boldsymbol{\xi},2^{l_i-1})^{-1} \nonumber\\ &\quad \ll \sum_{s=1}^{d-1} \sum_{\substack{\underline{l}=(l_1,\ldots,l_s)\in\mathbb{Z}^s_{\ge0} \\ l_1+\cdots+l_s \geq \lfloor\log_2 R\rfloor }} \prod_{i=1}^{s} (l_i+1)^s 2^{(\eta-d)l_i} \zeta(\boldsymbol{\xi},2^{l_i-1})^{-1}. \end{align} $$

Since the final bound of equation (5.30) is independent of t and

$$ \begin{align*} \sum_{(l_1,\ldots,l_s)\in\mathbb{Z}^s_{\ge0}} \prod_{i=0}^{s} (l_i+1)^s 2^{(\eta-d)l_i} \zeta(\boldsymbol{\xi},2^{l_i-1})^{-1} = \bigg( \sum_{l=0}^\infty (l+1)^s 2^{(\eta-d)l} \zeta(\boldsymbol{\xi},2^{l-1})^{-1} \bigg)^{\kern-0.7pts} \kern1.3pt{<}\kern1.3pt\infty \end{align*} $$

converges by assumption (B2) (note $s\leq d-1$ ), we can conclude that

$$ \begin{align*} {\begin{aligned} \lim_{R\to\infty}\limsup_{t\to \infty}&\bigg|\!\int_{\mathbf{y}\in[-1,1]^{d-1}} F_{R,\eta,r}\bigg(\Gamma'(1,\boldsymbol{\xi})M_0\widetilde{n}(\mathbf{y})\Phi_t\bigg) \,d\mathbf{y}\bigg| =0, \end{aligned}} \end{align*} $$

as required.

We now discuss the case where $d=2$ and $\boldsymbol {\xi }$ is $(0,\eta -2,2)$ -vaguely Diophantine. If $d=2$ , then $s=1$ , and in view of the definition in equation (5.9), the set $\Lambda _{k}(p)$ is the empty set unless $p=0$ . Hence, the double sum in the last line of equation (5.26) is written as

$$ \begin{align*}\sum_{k=\lceil \log_2({\zeta(\boldsymbol{\xi},2^{l})}/{4\|M_0\|})\rceil}^{\lfloor({t}/{2\log 2})-l\rfloor}2^{\omega_{s,\boldsymbol{\xi}}(k,0,l)}2^{-l-k}=\sum_{k=\lceil \log_2({\zeta(\boldsymbol{\xi},2^{l})}/{4\|M_0\|})\rceil}^{\lfloor({t}/{2\log 2})-l\rfloor}2^{k-l}\zeta(\boldsymbol{\xi},2^{l-1})^{-2}\end{align*} $$

and bounded above by $\ll e^{{t}/{2}}2^{-2l}\zeta (\boldsymbol {\xi },2^{l-1})^{-2}$ . Plugging this in equation (5.26), we get

$$ \begin{align*}\operatorname{vol}_{\mathbb{R}}(\{\mathbf{y}\in\mathcal{K}: h(\mathbf{y})\in\Xi_{l}^1, \gamma(\mathbf{y})\in\Gamma_{l}^{1,r}\})\ll 2^{-2l}\zeta(\boldsymbol{\xi},2^{l-1})^{-2}.\end{align*} $$

Note that here we gained additional decay of $\zeta (\boldsymbol {\xi },2^{l-1})^{-1}$ in comparison to equation (5.29). It follows that

$$ \begin{align*}\!\!\!\!\!\!\!\!\bigg|\!\int_{\mathbf{y}\in[-1,1]} F_{R,\eta,r}(\Gamma'(1,\boldsymbol{\xi})M_0\widetilde{n}(\mathbf{y})\Phi_t)\,d\mathbf{y}\bigg|\ll \sum_{l=\lfloor\log_2 R\rfloor}^{\lfloor{t}/{2\log 2}\rfloor} 2^{(\eta-2)l}\zeta(\boldsymbol{\xi},2^{l-1})^{-2}<\infty.\\[-46pt]\end{align*} $$

Proof. Let $g=(1,\mathbf {b})(M,0)$ with $M\in G$ and $\mathbf {b}\in \mathbb {R}^d$ . For each $1\leq i\leq d$ , we have $v_i(g)=\|\mathbf {e}_i\mathbf {v}(M)\|=\|\mathbf {e}_iM\|$ and $v_i(g(h,0))=\|\mathbf {e}_i\mathbf {v}(Mh)\|=\|\mathbf {e}_iMh\|$ , and hence there exists $C=C(\mathcal {C})>1$ such that $C^{-1}v_i(g(h,0))\leq v_i(g)\leq Cv_i(g(h,0))$ for any $h\in \mathcal {C}$ . We also have $b_i(g)=b_i(g(h,0))$ for all i since $b_i$ is invariant under $\operatorname {SL}(d,\mathbb {R})$ -action. Let $g'=g(h,0)$ . It follows that

$$ \begin{align*} &F_{R,\eta,r}(g')=\chi_{[R,\infty)}\bigg(\prod_{i=1}^{s_r(g')}v_i(g')\bigg)\; \prod_{i=1}^{s_r(g')} v_i(g')^\eta \chi_{[-c_dr,c_dr]}(v_i(g') b_i(g'))\\ &\quad\leq C^{(d-1)\eta}\chi_{[C^{-(d-1)}R,\infty)}\bigg(\prod_{i=1}^{s_r(g)}v_i(g)\bigg)\; \prod_{i=1}^{s_r(g)} v_i(g)^\eta \chi_{[-c_dCr,c_dCr]}(v_i(g) b_i(g))\\ &\quad=C^{(d-1)\eta}F_{C^{-(d-1)}R,\eta,Cr}(g).\\[-3.2pc] \end{align*} $$

Let us denote by $\mathbb {S}^{d-1}_+$ and $\mathbb {S}^{d-1}_-$ the upper hemisphere and the lower hemisphere, respectively, that is,

$$ \begin{align*}\mathbb{S}^{d-1}_+=\{(\boldsymbol{\upsilon}_1,\ldots,\boldsymbol{\upsilon}_d)\in \mathbb{S}^{d-1}: \boldsymbol{\upsilon}_1\ge 0\},\end{align*} $$

$$ \begin{align*}\mathbb{S}^{d-1}_-=\{(\boldsymbol{\upsilon}_1,\ldots,\boldsymbol{\upsilon}_d)\in \mathbb{S}^{d-1}: \boldsymbol{\upsilon}_1\leq 0\}.\end{align*} $$

By the construction of the map in equation (3.4), k is smooth, and its differential is non-singular and bounded on $\mathbb {S}^{d-1}_+$ . For $\boldsymbol {\upsilon }\in \mathbb {S}^{d-1}_+$ , we may write

(5.31)

for $c(\boldsymbol {\upsilon })>0$ , $\mathbf {w}(\boldsymbol {\upsilon })\in \mathbb {R}^{d-1}$ and $A(\boldsymbol {\upsilon })\in \operatorname {Mat}_{d-1,d-1}(\mathbb {R})$ . Note that $\mathbf {y},c,\mathbf {w}$ and A are smooth and bounded on $\mathbb {S}^{d-1}_+$ .

Proposition 5.7. Let $\unicode{x3bb} $ be a Borel probability measure on $\mathbb {S}^{d-1}$ with continuous density, $\boldsymbol {\xi }\in \mathbb {R}^d$ and $\eta>0$ so that hypothesis (B1) or (B2) holds. Then

(5.32) $$ \begin{align} {\lim_{R\to\infty}\limsup_{t\to \infty}\bigg|\!\int_{\boldsymbol{\upsilon}\in\mathbb{S}^{d-1}_+}F_{R,\eta,r}(\Gamma'(1,\boldsymbol{\xi})M_0k(\boldsymbol{\upsilon})\Phi_t)\,d\unicode{x3bb}(\boldsymbol{\upsilon})\bigg|=0.} \end{align} $$

Proof. This follows from Proposition 5.1 by the same argument as in the proof of [Reference Marklof and StrömbergssonMS10, Corollary 5.4]. We first observe that

Since $c,\mathbf {w}$ and A are bounded on $\mathbb {S}^{d-1}_+$ , we may choose a compact set $\mathcal {C}\subset G$ so that for any $\boldsymbol {\upsilon }\in \mathbb {S}^{d-1}_+$ . It follows from Lemma 5.6 that there exists $C>1$ such that

$$ \begin{align*}F_{R,\eta,r}(\Gamma'(1,\boldsymbol{\xi})M_0k(\boldsymbol{\upsilon})\Phi_t)\leq C^{(d-1)\eta} F_{C^{-(d-1)}R,\eta,Cr}(\Gamma'(1,\boldsymbol{\xi})M_0\widetilde{n}(\mathbf{y}(\boldsymbol{\upsilon}))\Phi_t)\end{align*} $$

for any $\boldsymbol {\upsilon }\in \mathbb {S}^{d-1}_+$ . As $\mathbf {y}$ is smooth, equation (5.32) follows from Proposition 5.1.

6. The main lemma

Lemma 6.1. Under the assumptions of Theorem 2.2,

(6.1) $$ \begin{align} {\lim_{K\to\infty}\limsup_{T\to\infty}|\mathbb{M}_\unicode{x3bb}(T,\underline{z})-\mathbb{M}_\unicode{x3bb}^{(K)}(T,\underline{z})|=0.} \end{align} $$

Proof. We have

$$ \begin{align*}|\mathbb{M}_\unicode{x3bb}(T,\underline{z})-\mathbb{M}_\unicode{x3bb}^{(K)}(T,\underline{z})|\leq\int_{\mathcal{N}_{c,T}(\sigma^*,\boldsymbol{\upsilon})\ge K}(\mathcal{N}_{c,T}(\sigma^*,\boldsymbol{\upsilon})+1)^{\operatorname{Re}(z_1)+\cdots+\operatorname{Re}(z_m)}\unicode{x3bb}(d\boldsymbol{\upsilon}),\end{align*} $$

where $\sigma ^*=\max _{1\leq j\leq m}\sigma _j$ . We now split the integral over the upper and lower hemispheres. The integral over the upper hemisphere $\mathbb {S}^{d-1}_+$ vanishes in the limit in view of Proposition 5.7, and the upper bounds in equations (3.5) and (5.3). The analogous statement for $\mathbb {S}^{d-1}_-$ follows by symmetry, since the quantity $\mathcal {N}_{c,T}(\sigma ^*,\boldsymbol {\upsilon })$ for a given $\boldsymbol {\xi }$ has the same value as $\mathcal {N}_{c,T}(\sigma ^*,-\boldsymbol {\upsilon })$ for $-\boldsymbol {\xi }$ , with everything else (including $M_0$ ) being fixed.

This completes the proof of Theorem 2.2.

7. Proof of Corollaries 2.3 and 2.4

7.1. Proof of Corollary 2.3

We will need the following variant of Siegel’s formula.

Proposition 7.1. [Reference El-Baz, Marklof and VinogradovEMV15, Proposition 14]

If $F\in L^1(\mathbb {R}^d\times \mathbb {R}^d)$ , then

$$ \begin{align*} {\int_{\Gamma'\backslash G'}\sum_{\mathbf{m}_1\neq\mathbf{m}_2\in\mathbb{Z}^d}F(\mathbf{m}_1 g,\mathbf{m}_2 g)\, dm_{\Gamma'\backslash G'}(g)=\int_{\mathbb{R}^d\times\mathbb{R}^d}F(\mathbf{x},\mathbf{y})\,d\mathbf{x}\,d\mathbf{y}.} \end{align*} $$

Here (and below), we view $g=\iota (\Gamma ' g)\in G'$ as the representative of the coset $\Gamma ' g$ in the fundamental domain $\mathcal {F}'$ .

For the proof of Corollary 2.3, we first prove

(7.1) $$ \begin{align} {\sum_{\underline{r}=(r_1,r_2)\in\mathbb{Z}^2_{\ge0}}r_1r_2E_{c}(\underline{r},\underline{\sigma})=\sigma_1\sigma_2+\min\{\sigma_1,\sigma_2\}} \end{align} $$

for $\underline {\sigma }=(\sigma _1,\sigma _2)$ . To deduce equation (7.1), note that

$$ \begin{align*}\sum_{(r_1,r_2)\in\mathbb{Z}^2_{\ge0}}r_1r_2E_{c}(\underline{r},\underline{\sigma})=\int_{\Gamma'\backslash G'}\sum_{\mathbf{m}_1,\mathbf{m}_2\in\mathbb{Z}^d}\chi_{\mathfrak{C}_c(\sigma_1)}(\mathbf{m}_1 g)\chi_{\mathfrak{C}_c(\sigma_2)}(\mathbf{m}_2 g)\, dm_{\Gamma'\backslash G'}(g).\end{align*} $$

Recall that for $\sigma>0$ , the area of $\mathfrak {C}_c(\sigma )$ is precisely $\sigma $ . Applying Proposition 7.1, the off-diagonal part of the right-hand side is equal to

$$ \begin{align*}\int_{\mathbb{R}^d\times\mathbb{R}^d}\chi_{\mathfrak{C}_c(\sigma_1)}(\mathbf{x})\chi_{\mathfrak{C}_c(\sigma_2)}(\mathbf{y})\,d\mathbf{x}\,d\mathbf{y}=\sigma_1\sigma_2.\end{align*} $$

For the diagonal part, let $\mathfrak {C}=\mathfrak {C}_c(\sigma _1)\cap \mathfrak {C}_c(\sigma _2)$ and note that $\mathfrak {C}=\mathfrak {C}_c(\min \{\sigma _1,\sigma _2\})$ . Then the diagonal part is evaluated as follows:

$$ \begin{align*} {\begin{aligned} & \int_{\Gamma'\backslash G'}\sum_{\mathbf{m}\in\mathbb{Z}^d} \chi_{\mathfrak{C}}(\mathbf{m} g)\, dm_{\Gamma'\backslash G'}(g) \\ &\quad=\int_{\Gamma\backslash G}\sum_{\mathbf{m}\in\mathbb{Z}^d}\int_{\mathbb{Z}^d\backslash\mathbb{R}^d}\chi_{\mathfrak{C}}((\mathbf{m}+\boldsymbol{\xi})M)\,d\boldsymbol{\xi}\, dm_{\Gamma\backslash G}(M)\\ &\quad=\int_{\Gamma\backslash G}\int_{\mathbb{R}^d}\chi_{\mathfrak{C}}(\mathbf{x} M)\,d\mathbf{x}\,dm_{\Gamma\backslash G}(M)=\int_{\mathbb{R}^d}\chi_{\mathfrak{C}}(\mathbf{x})\,dx=\min\{\sigma_1,\sigma_2\}. \end{aligned}} \end{align*} $$

This completes the proof of equation (7.1).

For the proof of Corollary 2.3, observe that for $z_1=z_2=1$ , one of the hypotheses of Theorem 2.2 holds under the assumption of Corollary 2.3. Combining equation (7.1) with property (b) above, Corollary 2.3 then follows from Theorem 2.2.

7.2. Proof of Corollary 2.4

In this section, we show that Corollary 2.3 implies Corollary 2.4. Throughout this section, we assume that the statement of Corollary 2.3 holds.

Lemma 7.2. Let $h\in \operatorname {C}(\mathbb {S}^{d-1})$ and $\sigma _1,\sigma _2>0$ . Then

(7.2) $$ \begin{align}&\lim_{N\to\infty}\int_{\mathbb{S}^{d-1}}\sum_{\substack{j_1,j_2=1 \\ j_1\neq j_2}}^N\chi_{[0,\sigma_1]}(N^{{1}/({d-1})}\mathbf{d}(\boldsymbol{\alpha}_{j_1},\boldsymbol{\alpha}))\chi_{[0,\sigma_2]}(N^{{1}/({d-1})}\mathbf{d}(\boldsymbol{\alpha}_{j_2},\boldsymbol{\alpha}))h(\boldsymbol{\alpha})\,d\boldsymbol{\alpha}\nonumber\\&\quad=\sigma_1\sigma_2\int_{\mathbb{S}^{d-1}}h(\boldsymbol{\alpha})\,d\boldsymbol{\alpha}. \end{align} $$

Proof. By Corollary 2.3, the left-hand side of equation (7.2) without the restriction ${j_1\neq j_2}$ converges to

(7.3) $$ \begin{align} {\min\{\sigma_1,\sigma_2\}\int_{\mathbb{S}^{d-1}}h(\boldsymbol{\alpha})\,d\boldsymbol{\alpha}+\sigma_1\sigma_2\int_{\mathbb{S}^{d-1}}h(\boldsymbol{\alpha})\,d\boldsymbol{\alpha}.} \end{align} $$

However, the diagonal part $j_1=j_2$ of the left-hand side of equation (7.2) is

(7.4) $$ \begin{align} {\int_{\mathbb{S}^{d-1}}\sum_{j=1}^N\chi_{[0,\min\{\sigma_1,\sigma_2\}]}(N^{{1}/({d-1})}\mathbf{d}(\boldsymbol{\alpha}_{j},\boldsymbol{\alpha}))h(\boldsymbol{\alpha})\,d\boldsymbol{\alpha}.} \end{align} $$

Since h is continuous and $\mathbf {d}(\boldsymbol {\alpha }_j,\boldsymbol {\alpha })\ll _{\sigma _1,\sigma _2} N^{-{1}/({d-1})}$ for any $1\leq j\leq N$ , for any $\epsilon>0$ , there exists $N_0$ such that for all $N\ge N_0$ , we have $|h(\boldsymbol {\alpha }_j)-h(\boldsymbol {\alpha })|<\epsilon $ for any $\boldsymbol {\alpha }\in \mathbb {S}^{d-1}$ and $1\leq j\leq N$ . It follows that the integral in equation (7.4) is approximated by

(7.5) $$ \begin{align} {\int_{\mathbb{S}^{d-1}}\sum_{j=1}^N\chi_{[0,\min\{\sigma_1,\sigma_2\}]}(N^{{1}/({d-1})}\mathbf{d}(\boldsymbol{\alpha}_{j},\boldsymbol{\alpha}))h(\boldsymbol{\alpha}_j)\,d\boldsymbol{\alpha}} \end{align} $$

up to error $<\epsilon \min \{\sigma _1,\sigma _2\}$ . Hence, equation (7.4) converges to

(7.6) $$ \begin{align} {\begin{aligned} &\lim_{N\to\infty}\int_{\mathbb{S}^{d-1}}\sum_{j=1}^N\chi_{[0,\min\{\sigma_1,\sigma_2\}]}(N^{{1}/({d-1})}\mathbf{d}(\boldsymbol{\alpha}_{j},\boldsymbol{\alpha}))h(\boldsymbol{\alpha})\,d\boldsymbol{\alpha}\\&\quad=\lim_{N\to\infty}\min\{\sigma_1,\sigma_2\}N^{-1}\sum_{j=1}^N h(\boldsymbol{\alpha}_j)\\ &\quad=\min\{\sigma_1,\sigma_2\}\int_{\mathbb{S}^{d-1}}h(\boldsymbol{\alpha})\,d\boldsymbol{\alpha} , \end{aligned}} \end{align} $$

since the $\boldsymbol {\alpha }_j$ terms are uniformly distributed over $\mathbb {S}^{d-1}$ . Therefore, the second summand of equation (7.3) is the off-diagonal contribution appearing in equation (7.2), as desired.

Lemma 7.3. Let $g\in \operatorname {C}(\mathbb {S}^{d-1}\times \mathbb {S}^{d-1})$ and $\sigma _1,\sigma _2>0$ . Then

(7.7) $$ \begin{align} &\lim_{N\to\infty}\!\sum_{\substack{j_1,j_2=1\\ j_1\neq j_2}}^N\!g(\boldsymbol{\alpha}_{j_1},\boldsymbol{\alpha}_{j_2})\int_{\mathbb{S}^{d-1}}\!\chi_{[0,\sigma_1]}(N^{{1}/({d-1})}\mathbf{d}(\boldsymbol{\alpha}_{j_1},\boldsymbol{\alpha}))\chi_{[0,\sigma_2]}(N^{{1}/({d-1})}\mathbf{d}(\boldsymbol{\alpha}_{j_2},\boldsymbol{\alpha}))\,d\boldsymbol{\alpha}\nonumber\\&\quad=\sigma_1\sigma_2\int_{\mathbb{S}^{d-1}}g(\boldsymbol{\alpha},\boldsymbol{\alpha})\,d\boldsymbol{\alpha}. \end{align} $$

Proof. Since g is continuous and $\mathbf {d}(\boldsymbol {\alpha }_j,\boldsymbol {\alpha })\ll _{\sigma _1,\sigma _2}N^{-{1}/({d-1})}$ for any $1\leq j\leq N$ , for any $\epsilon>0$ , there exists $N_0$ such that for all $N\geq N_0$ , we have $|g(\boldsymbol {\alpha },\boldsymbol {\alpha })-g(\boldsymbol {\alpha }_{j_1},\boldsymbol {\alpha }_{j_2})|<\epsilon $ for any $\boldsymbol {\alpha }\in \mathbb {S}^{d-1}$ and $1\leq j_1,j_2\leq N$ . It follows that the left-hand side of equation (7.7) is approximated by

(7.8) $$ \begin{align} {\sum_{\substack{j_1,j_2=1\\ j_1\neq j_2}}^N\int_{\mathbb{S}^{d-1}}g(\boldsymbol{\alpha},\boldsymbol{\alpha})\chi_{[0,\sigma_1]}(N^{{1}/({d-1})}\mathbf{d}(\boldsymbol{\alpha}_{j_1},\boldsymbol{\alpha}))\chi_{[0,\sigma_2]}(N^{{1}/({d-1})}\mathbf{d}(\boldsymbol{\alpha}_{j_2},\boldsymbol{\alpha}))\,d\boldsymbol{\alpha}} \end{align} $$

up to error

(7.9) $$ \begin{align} {<\epsilon\int_{\mathbb{S}^{d-1}}\sum_{\substack{j_1,j_2=1\\ j_1\neq j_2}}^N\chi_{[0,\sigma_1]}(N^{{1}/({d-1})}\mathbf{d}(\boldsymbol{\alpha}_{j_1},\boldsymbol{\alpha}))\chi_{[0,\sigma_2]}(N^{{1}/({d-1})}\mathbf{d}(\boldsymbol{\alpha}_{j_2},\boldsymbol{\alpha}))\,d\boldsymbol{\alpha}\ll\epsilon\sigma_1\sigma_2,} \end{align} $$

where the last inequality follows from Lemma 7.2 with the choice $h=1$ . Applying Lemma 7.2 again for equation (7.8) with the choice $h(\boldsymbol {\alpha })=g(\boldsymbol {\alpha },\boldsymbol {\alpha })$ , we conclude the proof.

Corollary 2.4 now follows from Lemma 7.3 by approximating ${f\kern1.3pt{\in}\kern1.3pt \operatorname {C}_0(\mathbb {S}^{d-1}\kern1.3pt{\times}\kern1.3pt \mathbb {S}^{d-1}\kern1.3pt{\times}\kern1.3pt \mathbb {R})}$ from above and below by finite linear combinations of functions of the form

(7.10) $$ \begin{align} {\widetilde{f}(\mathbf{x},\mathbf{y},z)=g(\mathbf{x},\mathbf{y})\int_{\mathbb{R}^{d-1}}\chi_{\mathcal{B}_{\sigma_1}^{d-1}}(\mathbf{w})\chi_{\mathcal{B}_{\sigma_2}^{d-1}}(\mathbf{w}+z\mathbf{e}_1)\,d\mathbf{w}} \end{align} $$

for suitable choices of $g\in \operatorname {C}(\mathbb {S}^{d-1}\times \mathbb {S}^{d-1})$ and $\sigma _1,\sigma _2>0$ .