https://arxiv.org/api/dDwHt5amCqnaifb//TW4dh1s71o 2026-07-18T22:06:49Z 10391 15 15 http://arxiv.org/abs/2607.12853v1 2026-07-14T15:06:12Z

Nonparametric permutation tests are widely used for statistical analysis. However, exact computation of test p-values can be algorithmically challenging, particularly for custom tests with complex test statistics. In contrast, Monte Carlo sampling can be easily applied to any test statistic, but it suffers from poor relative accuracy when estimating small p-values, interfering with multiple hypothesis testing correction and leading to other issues. In this work, we present a hash-augmented adaptive multilevel splitting Monte Carlo algorithm that enables accurate estimation of arbitrarily small p-values in two-sample permutation tests. Using the Kolmogorov-Smirnov and the Mann-Whitney U tests as examples, we highlight potential pitfalls related to the discreteness of the test statistic distribution and show how to address them. By comparing with an exact algorithm, we demonstrate the accuracy of the p-value estimates provided by the proposed algorithm and the validity of the associated confidence intervals. We provide a reference implementation of the proposed algorithm in the Python package hamstest, which allows p-value estimation for a user-defined statistic.

2026-07-14T15:06:12Z Nikita Golikov Vladimir Sukhov Gennady Korotkevich Alexey Sergushichev http://arxiv.org/abs/2606.11962v2 2026-07-14T12:36:16Z

The composite likelihood method reduces the computational cost of parameter estimation in time series by considering several subsets of observations instead of all observations at once. The asymptotic properties of this method are related to the Godambe information, an extension of the Fisher information that accounts for the dependence between subsets of observations. We aim to apply this method to linear Gaussian models, in particular fractional Brownian motion and fractional Gaussian noise. We derive theoretical expressions for their Fisher information and their Godambe information and deduce a subset selection design that sequentially maximizes the Godambe information. The size of the subsets then allows us to control the trade-off between estimation accuracy and computational cost. Through simulations, we compare this method with the method of moments and maximum likelihood estimation, and we apply it to real data, namely volatility series of a stock index and a wind speed time series.

2026-06-10T11:41:54Z Mathis Fourreau Matthieu Garcin http://arxiv.org/abs/2607.12611v1 2026-07-14T10:42:13Z

Synthetic data generation enables data curators to more easily share datasets that limits the potential for disclosive inferences about data subjects in confidential datasets. Generating synthetic data requires navigating numerous design choices; however, most existing open source software fails to provide common software infrastructure for making such design choices efficiently. In this paper, we introduce tidysynthesis, a meta-package for synthetic data generation that enables better interoperability between existing modeling frameworks and statistical data privacy methods. tidysynthesis allows users more flexibility to specify and iterate on synthetic data algorithms by providing a common syntax to easily create and modify synthetic data generation pipelines. We demonstrate the features and extensibility of tidysynthesis, as well as provide end-to-end examples for synthetic data generation using data from the American Community Survey

2026-07-14T10:42:13Z 23 pages Aaron R. Williams Jeremy Seeman Gabriel Morrison http://arxiv.org/abs/2510.12311v2 2026-07-14T09:30:27Z

We develop interacting particle algorithms for learning latent variable models with energy-based priors. To do so, we leverage recent developments in particle-based methods for solving maximum marginal likelihood estimation (MMLE) problems. Specifically, we provide a continuous-time framework for learning latent energy-based models, by defining stochastic differential equations (SDEs) that provably solve the MMLE problem. We obtain a practical algorithm as a discretisation of these SDEs and provide theoretical guarantees for the convergence of the proposed algorithm. Finally, we empirically validate the effectiveness of our method on synthetic and image datasets and demonstrate that using a particle based approach offers significant improvement in computational efficiency.

2025-10-14T09:10:37Z Accepted as an oral presentation at UAI'26 Conference on Uncertainty in Artificial Intelligence (UAI) 2026. Oral presentation Joanna Marks Tim Y. J. Wang O. Deniz Akyildiz http://arxiv.org/abs/2607.12184v1 2026-07-13T22:04:25Z

The lme4 R package can be used to fit generalized linear mixed models (GLMMs), which extend the class of linear mixed models (LMMs). The two main extensions provided by GLMMs are (1) allowing for the conditional distribution of the response given the random effects to be non-Gaussian (e.g. binomial, Poisson) and (2) allowing the conditional mean to be a nonlinear function of a linear combination of the fixed and random effect coefficients, via an inverse link function. The conditional mode of the random effects given the observed data, the variance-covariance matrix of the random effects, and the fixed effect parameters are determined using penalized iteratively reweighted least squares. We compute an approximation of the integral over the distributions of the conditional modes to compute the maximum likelihood estimate for a given set of parameters (by default we use the Laplace approximation or, alternatively, the more computationally expensive adaptive Gauss-Hermite quadrature). The package provides all the standard features available for GLMs in base R, including the standard set of accessor functions as well as the possibility of user-specified distributions (within the exponential dispersion family) and link functions.

2026-07-13T22:04:25Z Anna Ly Rune Haubo Bojesen Christensen Douglas Bates Martin Maechler Benjamin M. Bolker http://arxiv.org/abs/2607.11819v1 2026-07-13T17:13:27Z

Bayesian Factor Models (BFM) are well-established models that decompose the observed variability in a set of mean-zero, independent, and uncorrelated factors (random effects). While Factor Analysis (FA) was introduced in 1904 by Spearman, there has been renewed interest in inferential and computational methods that can adapt to large and complex modern data sets that are now routinely collected in a variety of applications. We provide reproducible, harmonized, and fast software for a variety of recent BFMs that allows the direct comparison of methods and provides a one-stop tutorial for the BFMs and their implementation. We neither endorse nor recommend any of the methods for a particular application; we simply provide a previously unavailable harmonized and reproducible common platform for BFMs. The accompanying factorverse R package is available at https://github.com/peterdunson/factorverse.

2026-07-13T17:13:27Z Code available at https://github.com/peterdunson/factorverse Peter Dunson Ciprian M. Crainiceanu http://arxiv.org/abs/2607.11631v1 2026-07-13T14:48:19Z

Sampling from multimodal distributions is a longstanding challenge for classical local Markov chain Monte Carlo (MCMC) methods. A popular remedy is to introduce a sequence of intermediate distributions that interpolate between the target and a simpler reference. The classical choice, tempering, raises the density to a power, but distorts the relative weights of asymmetric modes and can lead to poor mixing. We instead propose interpolating along the diffusion path, the marginals of a noising diffusion process that carries the target toward a Gaussian. This path preserves the relative weights of the modes and enjoys favorable mixing properties, which we make precise through a spectral-gap analysis of the corresponding ideal transition kernel. Sampling along the path requires its intermediate scores, which can be estimated from the unnormalized target through variational approaches, yielding only an approximate sampler. To remove the resulting bias, we introduce the Metropolis-adjusted diffusion path (MAD-Path) sampler, which corrects the diffusion-path proposal in an augmented path space and leaves the target invariant regardless of the accuracy of the learned score or the discretization error. We further quantify how these two errors affect the acceptance probability, providing guidance for practical tuning. Experiments on a range of Bayesian posteriors show that MAD-Path improves global exploration and mode-weight estimation relative to tempering-based MCMC methods and unadjusted diffusion samplers.

2026-07-13T14:48:19Z Han Chen Sifan Liu Jun Yang http://arxiv.org/abs/2604.14083v3 2026-07-13T12:59:08Z

For many materials, macroscopic mechanical behavior is determined by an intricate microstructure. Understanding the relation between these two scales helps scientists and engineers design better materials. The relation which maps microstructure to bulk material properties can be understood via the well-established theory of homogenization. However inverting the homogenization process, to recover microstructural information from measured macroscopic properties, is fraught with difficulties because of the averaging processes that underlie homogenization. Therefore, scientists and engineers usually need recourse to more invasive, often highly localized, investigations to estimate the microstructure. In this work, we develop a noninvasive methodology by which one can leverage large collections of measured bulk material properties to infer information about the statistics of microstructure at a global level. We call this, distributional inverse homogenization. We study this problem in one and two dimensions, considering both periodic and stochastic homogenization. We demonstrate the methodology in the context of 2D Voronoi constructions and underpin the observed empirical success with theory in 1D. We also show how the natural spatial variability of microstructure can be exploited to gather data that enables distributional inversion. And we concurrently learn a surrogate model, approximating the homogenization map, that accelerates the resulting computations in this setting. The work formulates a new class of inverse problems, bridging ideas from probability and homogenization to facilitate the inference of microstructural material variability from macroscopic measurements.

2026-04-15T16:56:53Z Arnaud Vadeboncoeur Mark Girolami Kaushik Bhattacharya Andrew M. Stuart http://arxiv.org/abs/2607.00586v2 2026-07-13T12:22:22Z

We present a simple, yet general approach to study the scaling properties as the dimensionality of Metropolised MCMC sampling algorithms increases. The study relies on the symmetries of the Hamiltonian formalism and ultimately on the symmetry of the Metropolis-Hastings formula. Our findings contain, as particular cases, many known results for the Random Walk Metropolis, MALA and other algorithms. In addition, they provide, in an easy way, new optimal scaling results for a variety of proposal mechanisms, including implicit proposals and proposals generated with the help of differential equation integrators. The analysis applies to targets that are products of a given, not necessarily univariate distribution, and also to cases where the different terms in the product are scaled differently. We show how to construct gradient-based MALA-like proposals where the variance of the proposal as the dimension $d$ increases may be taken as $O(1/d^μ)$, with $μ>0$ arbitrarily small, to be compared with the values $μ= 1$ for Random Walk Metropolis and $μ=1/3$ for MALA.

2026-07-01T08:08:54Z 25 pages, 3 figures P. Dobson J. M. Sanz-Serna K. C. Zygalakis http://arxiv.org/abs/2503.18381v4 2026-07-13T07:28:14Z

First passage time models describe the time it takes for a random process to exit a region of interest and are widely used across various scientific fields. Fast and accurate numerical methods for computing the likelihood function in these models are essential for efficient statistical inference of model parameters. Specifically, in computational cognitive neuroscience, generalized drift diffusion models (GDDMs) are an important class of first passage time models that describe the latent psychological processes underlying simple decision-making scenarios. GDDMs model the joint distribution over choices and response times as the first hitting time of a one-dimensional stochastic differential equation (SDE) to possibly time-varying upper and lower boundaries. They are widely applied to extract parameters associated with distinct cognitive and neural mechanisms. However, current likelihood computation methods struggle in common application scenarios in which drift rates dynamically vary within trials as a function of exogenous covariates (e.g., brain activity in specific regions or visual fixations). In this work, we propose a fast and flexible algorithm for computing the likelihood function of GDDMs based on a large class of SDEs satisfying the Cherkasov condition. Our method divides each trial into discrete stages, employs fast analytical results to compute stage-wise densities, and integrates these to compute the overall trial-wise likelihood. Numerical examples demonstrate that our method not only yields accurate likelihood evaluations for efficient statistical inference, but also considerably outperforms existing approaches in terms of speed.

2025-03-24T06:39:45Z 40 pages, 10 figures (incl. appendix); final revised version Statistics and computing, 36(3), 101 (2026) Sicheng Liu Alexander Fengler Michael J. Frank Matthew T. Harrison 10.1007/s11222-026-10854-4 http://arxiv.org/abs/2606.22636v2 2026-07-13T03:28:59Z

We prove an explicit spectral-gap lower bound for the lazy swap chain on binary matrices with prescribed row and column sums. This chain is a standard sampler for fixed-margin null models in ecology, statistics, and network analysis. Kannan, Tetali, and Vempala (KTV) conjectured that it mixes rapidly for all feasible margins \citep{kannan1997simple}. We show that for every feasible set of margins on an $m\times n$ binary matrix, the lazy swap chain has spectral gap at least $$\binom{m}{2}^{-1}\binom{n}{2}^{-1}.$$ The bound is tight in the worst case. Thus, our result proves this KTV conjecture in a stronger quantitative form. The same spectral-gap bound also verifies the Mihail--Vazirani conjecture for fixed-margin 0/1-matrix polytopes. The proof gives a new route to fixed-margin sampling that avoids stability assumptions and canonical-path constructions. We compare the swap chain with a two-row heat-bath chain and use a local-to-global spectral reduction to reduce the analysis from arbitrary $m\times n$ matrices to a three-row problem. The remaining three-row inequality is then proved by separating the scalar column-count sector from the non-scalar Johnson harmonic sectors. The proof itself was generated by ChatGPT 5.5 Pro. The author's role was to pose the problem, guide the search direction, evaluate the AI-generated arguments, rewrite the proof, and take responsibility for the final form and validity of the result. The full proof of the main theorem has been formalized in Lean, and the accompanying formalization is available at the anonymous repository https://github.com/guanyangwang/ktv-swap-lean.

2026-06-21T18:46:59Z add acorollary and additional references Weibo Fu Qian Qin Guanyang Wang http://arxiv.org/abs/2601.22911v2 2026-07-12T15:56:07Z

Metropolis-Hastings (MH) is a foundational Markov chain Monte Carlo (MCMC) algorithm. In this paper, we ask whether it is possible to formulate and analyse MH in terms of categorical probability, using a recent involutive framework for MH-type procedures as a concrete case study. We show how basic MCMC concepts such as invariance and reversibility can be formulated in Markov categories, and how one part of the MH kernel can be analysed using standard CD categories. To go further, we then study enrichments of CD categories over commutative monoids. This gives an expressive setting for reasoning abstractly about a range of important probabilistic concepts, including substochastic kernels, finite and $σ$-finite measures, absolute continuity, singular measures, and Lebesgue decompositions. Using these tools, we give synthetic necessary and sufficient conditions for a general MH-type sampler to be reversible with respect to a given target distribution.

2026-01-30T12:34:01Z LICS 2026 camera ready Rob Cornish Andi Q. Wang 10.4230/LIPIcs.LICS.2026.32 http://arxiv.org/abs/2607.10801v1 2026-07-12T15:15:18Z

We develop a systematic approach to quantify $L^2$-relaxation times for non-reversible Markov processes based on the singular value gap of the generator introduced by Chatterjee. The inverse of the singular value gap is equivalent to the relaxation time of the time-averaged transition semigroup. We show that, moreover, the singular value gap of the two-point motion also provides a lower bound on the usual spectral gap of the generator, and its inverse provides upper bounds on relaxation times without time averaging for sufficiently regular initial laws. We then introduce a method for deriving lower bounds on singular value gaps for Markov processes with degenerate noise that is based on the concept of a first- and second-order collapse of the generator. It follows ideas from hypocoercivity developed in a previous series of works but is simpler and more broadly applicable. In contrast to previous results, it includes settings with non-vanishing first-order collapse, and thus applies directly to Markov chains (in continuous time), but also to diffusion processes and piecewise-deterministic Markov processes. Our approach yields sharp upper and lower bounds for several classes of examples. First applications include the proof of a conjecture by Diaconis and Miclo on a square-root speed-up for lifted random walks on abelian groups, as well as bounds on relaxation times of switching flows perturbed by noise and of non-reversible diffusion processes.

2026-07-12T15:15:18Z 45 pages Andreas Eberle Francis Lörler http://arxiv.org/abs/2602.20448v3 2026-07-11T20:09:05Z

For large model spaces in linear regression with spike-and-slab priors, the potential entrapment of Markov chain Monte Carlo (MCMC)-based methods poses significant challenges in posterior computation. Existing maximum a posteriori (MAP)-based methods provide more computationally viable alternatives, but fail to perform tail heaviness estimation and uncertainty quantification. To address these problems, we propose a method that blends MAP estimation with MCMC-based stochastic search algorithms within an error framework comprising a combination of the hyperbolic and Student-t distributions. The hyperbolic distribution has the light-tailed normal and heavy-tailed Laplace distributions as limiting cases, but is thinner-tailed than the Student-t family. Including the Student-t distribution in the error density enables better adaptation to heavier tails. Amalgamating the two error densities thus ensures a model with more flexible tail behavior when faced with unknown tail thickness in the data, compared to MAP estimators with fixed levels of tail heaviness that assume the errors have a normal or Laplace distribution. Under this proposed error model, the current work develops a two-step expectation conditional maximization (ECM)-guided MCMC algorithm. First, we conduct an ECM-based posterior maximization to guide variable selection. We then execute a Gibbs sampler on the resulting ECM-guided model space for tail heaviness estimation and uncertainty quantification. Through simulation studies and benchmark real datasets, our proposed method is shown to exhibit several advantages in variable selection and uncertainty quantification over state-of-the-art MAP-based methods. To implement our proposed method, we developed the R package FlexBayesReg, available at https://github.com/shamriddha1998/FlexBayesReg.

2026-02-24T01:18:12Z 38 pages, 5 figures Shamriddha De Joyee Ghosh http://arxiv.org/abs/2607.10432v1 2026-07-11T18:25:48Z

We propose EM-INLA, a scalable algorithm for empirical-Bayes hierarchical quantile regression that combines the Expectation-Maximization (EM) algorithm with Integrated Nested Laplace Approximations (INLA). The method exploits the normal-exponential mixture representation of the Asymmetric Laplace Distribution (ALD) to reformulate each M-step as a weighted Gaussian regression handled by INLA, with the ALD scale and random-effect variances updated in closed form at each iteration. The scale and variance hyperparameters are estimated by marginal maximum likelihood via the EM algorithm, and posterior marginals for the regression and random-effect parameters are obtained from a final INLA call conditional on the converged hyperparameter estimates. The result is an algorithm that avoids all MCMC sampling while scaling to large datasets and complex hierarchical structures that are intractable for standard fully Bayesian approaches. In a simulation study across four error scenarios, EM-INLA recovers the true parameters with accuracy comparable to Hamiltonian Monte Carlo (HMC) while achieving speedups ranging from 15x to over 50x depending on the scenario. The method is applied to the 2023 Prueba Saber 11 standardized test in Colombia to model the conditional quantiles of student scores as a function of socioeconomic covariates under a hierarchical structure of students nested within schools and municipalities, with over 400,000 observations.

2026-07-11T18:25:48Z 28 pages, 5 figures, 9 tables Tomas Rodriguez Taborda Johnatan Cardona-Jiménez