https://arxiv.org/api/PGvqVOfy8oE2A0o7DYTIQsgH7v0 2026-11-12T03:27:34Z 39120 0 15 http://arxiv.org/abs/2611.14465v1 2026-11-10T18:29:50Z

AUC and the Brier score are standard summaries of a binary risk score, yet they can rank models differently. We introduce a weighted AUC, AUC$_π$, which weights each pair of observations by how differently a decision maker with probability of acting $π$ treats them. We show that all three are built on weighted averages of one curve, the Youden index $J(t) = \mathrm{TPR}(t) - \mathrm{FPR}(t)$ across cutoffs $t$, and that the averages differ in the weights they put on the cutoffs. Each weights a cutoff by how much something rises across it: for AUC, the distribution of all scores; for the Brier score, the true probability $\mathbb{E}[Y \mid S]$; for AUC$_π$, the decision maker's probability of acting. Up to normalization, AUC$_π$ is the Brier skill score of the ideal forecast with its weight moved to the cutoffs the decision maker cares about. We also show that weighting pairs by $|π(s) - π(s')|$ is, up to scale, the only pair weight fixed in advance that makes a pair-weighted AUC an average of the Youden curve for every score distribution. As a ranking measure, AUC weights every model the same way. Hand (2009) shows that it can also be read as an average over cost thresholds, and in that reading each model weights the thresholds differently. The numerator of AUC$_π$, which we call the policy Youden index, is the expected share of class 1 a fixed policy acts on minus the expected share of class 0. It judges every model by the same policy and so avoids this; the full ratio AUC$_π$ does not.

2026-11-10T18:29:50Z 19 pages, 3 figures Yegor Baranovski http://arxiv.org/abs/2611.14457v1 2026-11-10T18:26:33Z

Competing risks arise when individuals may experience multiple mutually exclusive event types. Competing events are frequently treated as censoring and analysed using Kaplan--Meier (KM) methods, which overestimate real-world event risks. While the existence of KM overestimation is well known, its determinants, magnitude, and inferential properties remain poorly characterised. We develop a nonparametric framework that treats competing risks overestimation as a statistical quantity in its own right. We show that competing event frequency alone is insufficient to characterise KM overestimation and develop an event ordering theory describing how temporal event allocation influences overestimation. Based on these results, we derive a closed-form Total Overestimation Diagnostic (TOD) that quantifies total KM overestimation directly from routine survival analysis output. We establish exact error equivalence results for both cause-specific and total overestimation. In particular, Product Limit Error Equivalence shows that inference for TOD reduces exactly to ordinary overall survival estimation. Simulation experiments validate the theoretical results and show that independent censoring primarily affects precision rather than overestimation magnitude. Across six benchmark competing risks datasets, cause-specific overestimation is characterised by both total overestimation and temporal event allocation. These results provide a practical framework for assessing competing risks relevance and determining when cumulative incidence methods should be preferred to naïve KM risks. The proposed framework transforms competing risks overestimation from a qualitative warning into a measurable quantity that can be routinely quantified, interpreted, and incorporated into reporting practice.

2026-11-10T18:26:33Z Ferran Espuny-Pujol http://arxiv.org/abs/2611.14428v1 2026-11-10T18:04:37Z

We study explicit Wasserstein--Fisher--Rao descent for fitting Gaussian location mixtures by nonparametric maximum likelihood. The full sequence converges weakly and has finite length in the bounded-Lipschitz metric throughout the original step-size range. These conclusions hold for any fixed data set in any dimension and any initial probability measure. By an earlier conditional optimality theorem, the limit maximizes the likelihood under full-support initialization. Fix any particle step size in $(0,1]$. Initialize the particles by resampling the observations. For an open set of triples of points in the plane, the probability of convergence to a strictly suboptimal fixed point tends to one exponentially as the particle count grows. Without reweighting, a centered Gaussian initialization can give a strictly suboptimal limit. Every finite iterate has a smooth, strictly positive density. The limit assigns positive mass to a nonglobal local maximum of the associated Gaussian sum. We also give the exact pure-transport limit for a one-dimensional initialization with full support and an atom. An exact finite-dimensional representation preserves the truncated likelihood moments and the retained region's contribution to the current dissipation. This lets us transfer an analytic gradient inequality to the measure trajectory.

2026-11-10T18:04:37Z Xingzhou Wang Ziyang Jiang Zheng Li Mingyan Liu Yiling Wang Jingze Yang http://arxiv.org/abs/2611.14369v1 2026-11-10T17:24:41Z

Spatial blocking is a common technique used in designed agricultural experiments. Spatial blocking, however, requires important assumptions about the spatial dependence patterns in the field. Statistical models of blocked agricultural experiments often show spatial structure in the residuals, suggesting that the original model may benefit from additional assumptions regarding the spatial dependence patterns present in the field. We propose a Bayesian model for checking block membership and estimating spatial patterns missing in the original block design. Our model is particularly motivated by cases with mis-specified blocks. To accomplish this, we embed a regression tree within a Bayesian statistical model to estimate spatial effects with a block-like spatial structure. We illustrate the benefits of our model using simulated data mimicking four typical scenarios we have encountered in our applied experience in agricultural research and using two datasets generated from designed agricultural experiments. We found that our model may serve two purposes: validating the originally designed block layout, or mis-specified block-like spatial structures. Thus, our model provides researchers with a novel tool for analyzing data from designed agricultural experiments.

2026-11-10T17:24:41Z 18 pages, 4 figures Josefina Lacasa Ignacio A. Ciampitti Trevor J. Hefley http://arxiv.org/abs/2609.29335v2 2026-11-10T15:43:12Z

In genomics, imaging and clinical studies, only a few of many candidate predictors are often nonlinearly associated with a response that may be, e.g. binary, categorical, a count or a censored event time. The Terminating-Random Experiments (T-Rex) selector is a scalable variable selection method that controls the false discovery rate (FDR) by letting synthetic null variables (dummies) compete with the real predictors. While the FDR control theory embraces more general settings, to date, the T-Rex selector has been specified only for linear models. We propose a memory-efficient selection procedure with FDR control for generalized linear models and Cox regression by extending the recently developed virtual dummy construction to score-based forward selection for Bernoulli, Poisson, multinomial and Cox responses. The virtual-dummy-based selection path remains equal in distribution to explicit augmentation, so FDR control carries over under the same assumptions. Simulations confirm this equivalence and the power gained by correct model specification. Real-world applicability is illustrated on simulated genotypes and on cancer survival data.

2026-09-24T10:09:03Z Helena Mehler Taulant Koka Michael Muma http://arxiv.org/abs/2607.19510v2 2026-11-10T15:40:19Z

Modern LLM deployments use a number of implementation choices and inference optimizations (e.g., batching, custom kernels, and quantization) on top of fixed weights, so two engines serving "the same model" can produce meaningfully different distributions. We study the problem of estimating the total variation (TV) distance between two length-$n$ autoregressive distributions to additive error $\varepsilon$, under three access models. (1) Under sample access, we use $\widetilde{O}(n^2 K/\varepsilon^2)$ queries, where $K$ is the maximum support of the next-token distribution. This improves upon the $\widetilde{O}(n^3 m/\varepsilon^5)$-query estimator of Meel et al. (2025), where $m \geq K$ is the total size of the token alphabet. (2) Under logit access, we use $O(n/\varepsilon^2)$ queries, and this is tight. (3) Under noisy logit access, we smoothly interpolate between the above two guarantees: if probability values are given to relative error $σ$, we use $\widetilde{O}((n+n^2σ^2)/\varepsilon^2)$ queries. We complement our theoretical results with an empirical evaluation of our algorithms, for example measuring the distance between SGLang and vLLM serving identical weights. Our experiments highlight the robustness and practicality of estimating the total variation distance, which remains estimable where the KL divergence is infinite. Our code is available at https://github.com/XunZhiyang/llm-tv-estimation.

2026-07-21T18:49:45Z Preliminary version of this paper is accepted by Neurips 2026. 40 pages, 11 figures, code is available at https://github.com/XunZhiyang/llm-tv-estimation Eric Price Kevin Tian Zhiyang Xun Yusong Zhu http://arxiv.org/abs/2403.03007v5 2026-11-10T15:09:10Z

Generalized linear mixed models (GLMMs) are widely used for analyzing correlated data, particularly in large-scale biomedical and social science applications. Scalable Bayesian inference for GLMMs is challenging due to an intractable marginal likelihood and a high computational cost incurred by conventional Markov chain Monte Carlo (MCMC) methods. We develop a stochastic gradient MCMC (SGMCMC) algorithm tailored to GLMMs that enables accurate posterior inference in the large-sample regime. Our approach uses Fisher's identity to construct a (biased) Monte Carlo estimator of the gradient of the marginal log-likelihood, making SGMCMC feasible when direct gradient computation is impossible. We analyze the additional variability, introduced by both data subsampling and gradient approximation, to derive a post-hoc covariance correction that yields properly calibrated posterior uncertainty. We show through simulated studies that the proposed method provides accurate posterior means and variances in settings with a large number of groups, outperforming existing approaches, including control variate methods. We further demonstrate the method's practical utility in an analysis of electronic health records data, where accounting for variance inflation materially changes scientific conclusions.

2024-03-05T14:35:34Z 33 pages, 5 figures, 2 tables. To be published in Statistics and Computing Youngsoo Baek Andrea Agazzi Felipe A. Medeiros Samuel I. Berchuck http://arxiv.org/abs/2605.06749v3 2026-11-10T14:59:01Z

As learning systems increasingly shape everyday decisions, Algorithmic Collective Action (ACA), i.e., users coordinating changes to shared data to steer model behavior, offers a complement to regulator-side policy and corporate model design. Real-world collective actions have traditionally been decentralized and fragmented into multiple collectives, despite sharing overarching objectives, with each collective differing in size, strategy, and actionable goals. However, most of the ACA literature focuses on single collective settings. To address this, we propose the first comprehensive statistical framework for ACA with multiple collectives acting on the same system. In particular, we focus on collective action in classification, studying how multiple collectives can influence a classifier's behavior. We provide quantitative statistical bounds on the success of the collectives, considering the role and the interplay of the collectives' sizes and the alignment of their goals. We make such bounds computable by each collective with only partial knowledge of other collectives' sizes and strategies. Finally, we numerically illustrate our framework on simulations inspired by interventions for climate adaptation in smart cities, demonstrating the usefulness of our bounds.

2026-05-07T15:45:53Z NeurIPS 2026. 35 pages, 17 figures, 4 tables Claudio Battiloro Pietro Greiner Dario Rancati Bret Nestor Oumaima Amezgar Francesca Dominici http://arxiv.org/abs/2610.04677v2 2026-11-10T14:37:21Z

Penalized function-on-function regression, as implemented in the R package refund, considers all grid values as independent conditional on the linear predictor, but some dependence typically remains. We study the consequences for estimates and pointwise intervals in a simulation and a plasmode study on nine real datasets. Under dependence, restricted maximum likelihood (REML) undersmooths the coefficient surface: in our simulations' main settings, its relative error is two to four times that of curve-blocked neighborhood cross-validation (NCV). In our plasmode study, both fits have large errors, possibly through weak identification, and NCV is usually, but not always, better. Under dependence, the independence-model-based intervals for means and surfaces undercover severely. We propose and evaluate a curve-clustered sandwich covariance with a leverage adjustment for the penalized hat matrix with Satterthwaite degrees of freedom which brings coverage close to nominal in most settings. Its intervals for function-on-function effects are wide because REML's estimate is noisy. The same construction at the NCV estimate is narrow but undercovers. We therefore recommend fitting twice: NCV for the shape of the surface, REML with these intervals for inference. For estimated means, intercept functions and scalar covariate effects, one REML fit with these intervals usually suffices.

2026-10-03T17:46:24Z v2: new title; revised and extended; 45 pages including appendices; supplement as ancillary file. Project website at https://fabian-s.github.io/fof-inf/ Fabian Scheipl http://arxiv.org/abs/2606.09153v2 2026-11-10T14:36:08Z

This paper studies the asymptotic behavior of sample canonical directions in a finite-rank spiked high-dimensional canonical correlation analysis model under a Gaussian population assumption. Under the asymptotic regime in which the dimensions of the two data blocks grow proportionally with the sample size, sample canonical directions are generally not consistent estimators of their population counterparts, even when the corresponding sample canonical correlations separate from the bulk spectrum. To quantify directional recovery, we investigate the squared alignment between a sample canonical direction and its associated population direction. For a supercritical simple population spike, we establish an explicit nonzero deterministic limit for the squared alignment. In contrast, for population non-spikes, we show that the alignment with the corresponding population signal directions vanishes asymptotically. Thus, the same phase transition that governs eigenvalue separation also marks a transition in directional recovery. For a supercritical simple spike, we further prove a central limit theorem for its fluctuations around the deterministic limit, with an explicit asymptotic variance expressed through deterministic limits of resolvent trace functionals. To make the theoretical quantities computable from data, we further construct plug-in estimators for both the deterministic alignment limit and the asymptotic variance by inverting the deterministic outlier eigenvalue map, and prove their consistency. Numerical simulations and a real-data illustration support the theoretical results and demonstrate how the proposed estimators assess the recovery quality of sample canonical directions.

2026-06-08T07:46:09Z Added the subcritical alignment result, refined the central limit theorem and its asymptotic variance, and improved the proofs and presentation Zhangni Pu Xiaozhuo Zhang Jiang Hu http://arxiv.org/abs/2611.14032v1 2026-11-10T13:01:06Z

Estimates of the limits of human performance are usually built on record books, on the premise that a record is the best an athlete could do. In Olympic weightlifting the premise fails, because the competitor declares the weight before each of three attempts per lift and only the heaviest successful attempt is recorded, so a record is a lower bound, chosen by the athlete, on a maximal capability never observed. We treat the maximal lift of each competitor on each competition day as a latent variable, of which every attempt is a trial and every declared weight a measurement. Its distribution at a given bodyweight follows an extreme value mixture model with an estimated threshold, and an athlete-specific random effect links the competitions of each athlete. The model is fitted to the 117,892 attempts of 5,040 athletes in 141 international competitions between 2017 and 2026. The upper tail of capability is bounded, with posterior probability above 0.999 for men, 0.96 for the women's snatch and 0.94 for the women's clean and jerk. At 110 kilograms of bodyweight the men's ceiling lies one to three per cent above the heaviest lifts, against twelve and sixteen per cent for women at 86 kilograms. The record book alone places the men's ceiling six and twelve kilograms higher, because the best lift of a day ending on a success overstates capability.

2026-11-10T13:01:06Z Manuele Leonelli http://arxiv.org/abs/2611.14011v1 2026-11-10T12:50:49Z

We study the problem of testing isotropy, i.e., distributional invariance under orthogonal transformations, for random fields taking values in abstract spaces. We propose a novel approach based on computing local directional characteristics, which are uniformly distributed under the assumption of isotropy. Our work is motivated by an application in material science, where we are testing the isotropy of function-valued porosity profiles of paper sheets, whose morphology is resolved by $μ$-CT imaging. While considerably more general, the presented methodology is competitive with existing isotropy tests for real-valued random fields.

2026-11-10T12:50:49Z 27 pages, 8 figures Julius Baumhakel Siegfried Hörmann Matthias Neumann http://arxiv.org/abs/2611.12513v2 2026-11-10T12:37:17Z

In archaeology and geochronology, stratigraphic information constrains the relative chronological order of dated samples. Bayesian chronological models incorporate these constraints either through the prior, or by projecting an unconstrained posterior distribution onto the set of ordered chronologies. Dating measurements may nevertheless appear inconsistent with their stratigraphic position, owing to disturbances that do not justify discarding them. We introduce different robust projection maps based on the Huber loss and characterize the non-uniqueness of the considered maps which justifies a Tikhonov regularization. The robust maps also decompose each sample into a monotone baseline and a spike, which flags questionable samples. We adapt the Sequential Block Merging algorithm for the Huber-type losses, and propose a data-driven heuristic for selecting the hyperparameter on which each loss depends on. Simulation studies and geochronological case studies illustrate the gains in robustness and their limits.

2026-11-09T14:52:56Z Im{è}ne Bouafia CFE Anne Philippe LMJL Guillaume Gu{é}rin GR http://arxiv.org/abs/2610.39684v2 2026-11-10T12:09:13Z

Generalized posteriors update a prior through empirical loss, with a learning rate controlling posterior concentration. Their credible intervals can misrepresent sampling uncertainty. We propose infinitesimal-jackknife variance matching (IJVM), which selects the learning rate for a prespecified scalar functional by matching its posterior variance to an IJ estimate of the sampling variance of its posterior mean. The IJ variance is computed from posterior covariances with observation-level losses. A one-step update uses a pilot posterior fit and one final fit. IJVM shares the functional-specific first-order target of rank-one weighted score matching but requires neither loss Hessians nor gradient covariance estimates for calibration. This facilitates applications with regular non-smooth convex losses, including check and hinge losses, without constructing problem-specific curvature estimators. Under suitable regularity and Monte Carlo conditions, we establish consistency of the one-step rate and, with additional assumptions, asymptotically nominal credible-interval coverage. In simulations of quadratic-loss regression, quantile regression, and hinge-loss classification, IJVM generally achieves coverage near 95%, although finite-sample undercoverage remains in quantile regression. A second update can improve finite-sample calibration in some settings, particularly at smaller sample sizes, but the benefits of further iterations are task-dependent and not necessarily monotone. Compared with bootstrap-based calibration, IJVM yields comparable interval lengths with substantially fewer posterior fits.

2026-10-29T09:29:01Z Masahiro Tanaka http://arxiv.org/abs/2611.13962v1 2026-11-10T11:56:26Z

Plotted against time since its first block on logarithmic axes, the price of Bitcoin lies close to a straight line, and a power law in time has been proposed as its long-run trend. A good fit is weak evidence: when deviations from a trend are as persistent as a random walk, regressions on time find trends and high $R^2$ where none exist. We first bound what fifteen years of weekly prices can reveal, then test only what is answerable. Using a few low-frequency averages, invariant to the noise scale and calibrated over a declared family of persistent deviations with a four-year cycle and declining volatility, we test constant drift in expected log price against an added log-age term. The procedure was fixed, validated and publicly hashed before it was applied once. Constant drift is rejected under this family at nominal 5%, and a log-age coefficient of 5.7, close to the published exponent, is not rejected. The rejection does not survive allowing persistence beyond a random walk, and a Gompertz curve with a ceiling fits about as well as the power law. Whether deviations revert to the trend cannot be decided. Registered forecasts for 2027-2030 will be scored by future prices.

2026-11-10T11:56:26Z 25 pages, 6 figures. Pre-registered protocol and forecasts: https://osf.io/2rdty. Replication package: https://doi.org/10.5281/zenodo.23218897 Carlos Baquero Raquel Menezes