Iterative linearised INLA method10 months ago
The INLA method for linear predictors | Approximate INLA for non-linear predictors | $$\ol{p}(\bm{y}|\bm{u},\bm{\theta}) | p(\bm{y}|\ol{\bm{\eta}}(\bm{u}),\bm{\theta}) | p(\bm{y}|g^{-1}[\ol{\bm{\eta}}(\bm{u})],\bm{\theta})\approxp(\bm{y}|g^{-1}[\wt{\bm{\eta}}(\bm{u})],\bm{\theta}) | p(\bm{y}|\wt{\bm{\eta}}(\bm{u}),\bm{\theta}) | Fixed point iteration | Line search | Let $\sigma_i^2 = \mathrm{Var}_{\bm{u}\sim \ol{p}(\bm{u}|\bm{y},\bm{\theta}_1)}(\ol{\bm{\eta}}_i(\bm{u}))$be the current estimate of the posterior variance for each predictor element $i$.We then define an inner product on the space of predictor vectors as$$\langle \bm{a},\bm{b} \rangle_V | \sum_i \frac{a_i b_i}{\sigma_i^2} .$$The squared norm for the difference between the predictor vectors $\wt{\bm{\eta}}(\bm{v}_\alpha)$and $\ol{\bm{\eta}}(\bm{u}1)$,with respect to this inner product, is defined as$$| \wt{\bm{\eta}}(\bm{v}\alpha) - \ol{\bm{\eta}}(\bm{u}_1)|^2_V | Posterior non-linearity checks | Whereas the inlabru optimisation method leads to an estimate where $| \wt{\bm{\eta}} (\bm{u}*) - \ol{\bm{\eta}}(\bm{u})|=0$ for a specific $\bm{u}_$, the overall posterior approximation accuracy depends on the degree of nonlinearity in the vicinity of $\bm{u}*$.There are two main options for evaluating this nonlinearity, using sampling from the approximate posterior distribution.The first option is$$\begin{aligned}\sum_i \frac{E{\bm{u}\sim \ol{p}(\bm{u}|\bm{y})}\left[|\ol{\bm{\eta}}_i(\bm{u})-\wt{\bm{\eta}}i(\bm{u})|^2\right]}{\mathrm{Var}{\bm{u}\sim \ol{p}(\bm{u}|\bm{y})}(\ol{\bm{\eta}}_i(\bm{u}))} ,\end{aligned}$$which is the posterior expectation of the component-wise variance-normalised squared deviation between the non-linear and linearised predictor. Note that the normalising variance includes the variability induced by the posterior uncertainty for $\bm{\theta}$, whereas the $|\cdot|V$ norm used for the line search used only the posterior mode.Another option is$$E{(\bm{u},\bm{\theta})\sim \ol{p}(\bm{u},\bm{\theta}|\bm{y})} \left[\ln \frac{\ol{p}(\bm{u} |\bm{y},{\bm{\theta}})}{\wt{p}(\bm{u}|\bm{y},{\bm{\theta}})}\right] | Accuracy | For a given $\bm{\theta}$,$$\begin{aligned}\pKL{\ol{p}}{\wt{p}} &=E_{\ol{p}}\left[\ln\frac{\ol{p}(\bm{u}|\bm{y},\bm{\theta})}{\wt{p}(\bm{u}|\bm{y},\bm{\theta})}\right]\&=E_{\ol{p}}\left[\ln\frac{\ol{p}(\bm{y}|\bm{u},\bm{\theta})}{\wt{p}(\bm{y}|\bm{u},\bm{\theta})}\right] | Well-posedness and initialisation
inlabru 2.15.0.9005Finn Lindgren and Man Ho Suenmethod.Rmd