https://arxiv.org/api/J1fRDjGOQrp9W8uxWv3MpxHQ/2M 2026-06-22T04:50:26Z 49870 300 15 http://arxiv.org/abs/2606.10562v1 2026-06-09T08:27:41Z

We propose a new optimization method, the Nyström-enhanced relaxed scalar auxiliary variable method (N-RSAV), which incorporates curvature information into the RSAV framework to accelerate convergence while preserving an unconditional modified energy dissipation law. Existing RSAV-based methods rely solely on first-order information and often suffer from slow convergence, particularly for ill-conditioned problems such as those arising in physics-informed neural networks (PINNs). To address this limitation, we design the linear operator in the RSAV scheme using approximate Hessian information obtained from a randomized low-rank Nyström approximation. To preserve the dissipation structure, we enforce positive semidefiniteness through eigenvalue truncation. Furthermore, we introduce an adaptive strategy that reuses the approximate Hessian based on the deviation between the original and modified energies, significantly reducing computational cost. We also provide a convergence analysis of the RSAV scheme with a general positive semidefinite operator under the Polyak-Lojasiewicz (PL) condition and establish corresponding convergence guarantees for N-RSAV under the PL condition and an additional convexity assumption. Numerical experiments on ill-conditioned problems with effectively low-rank structure, including convex quadratic problems and training of PINNs, demonstrate that the proposed methods achieve substantially faster convergence than conventional RSAV-based approaches.

2026-06-09T08:27:41Z 25 pages, 4 figures Ryo Sagawa Daisuke Furihata Yuto Miyatake http://arxiv.org/abs/2606.10524v1 2026-06-09T07:54:48Z

This review paper provides a comprehensive overview of the Constrained Energy Minimizing Generalized Multiscale Finite Element Method (CEM-GMsFEM) for solving elliptic PDEs characterized by highly heterogeneous, high-contrast coefficients. We detail the construction of multiscale basis functions via spectral auxiliary spaces, combined with an oversampling strategy that enables localized computations and guarantees exponential error decay. Rigorous error estimates are outlined for reference to confirm the method's optimal convergence and robustness. Numerical simulations are provided to verify the exponential decay property of the multiscale basis functions. Additionally, we discuss and comment several up-to-date applications of CEM-GMsFEMs.

2026-06-09T07:54:48Z Eric T. Chung Yalchin Efendiev Xingguang Jin Wing Tat Leung Changqing Ye http://arxiv.org/abs/2606.10480v1 2026-06-09T06:50:25Z

The fractional Laplacian has been widely used to model non-local diffusion on graphs, allowing interactions that extend beyond immediate neighbors. However, it suffers from a structural inconsistency as it breaks compatibility with the topology of the original network. To address this issue, a combination of the standard and fractional Laplacians aimed at restoring compatibility while retaining the spectral richness of the fractional operator was recently proposed. In this work, we provide a thorough analysis of the diffusion properties of the resulting regularized operator. We prove that it yields superdiffusive behavior independently of whether the underlying graph is weighted or unweighted -a property not generally satisfied by other nonlocal Laplacian variants. An efficient construction of the regularized operator which preserves the same asymptotic computational cost of the fractional Laplacian is also given. Our numerical experiments demonstrate the effectiveness and computational practicality of the regularized operator for modeling non-local diffusion on real-life networks.

2026-06-09T06:50:25Z 21 pages with 8 figures Alessandro Filippo Mariarosa Mazza http://arxiv.org/abs/2509.08745v4 2026-06-09T05:56:05Z

The extended-domain method is a strategy for applying spectral methods to complex geometries. Its stability is complicated by the ill-conditioning of the Fourier extension frame. This paper provides an analysis of the method's pre-asymptotic behavior. We confirm that the spectral collocation system is asymptotically ill-conditioned for both the Poisson and convection-diffusion operators, driven by the redundancy of the underlying frame. However, we prove a fundamental structural dichotomy in their discrete Green's functions. We show that the inverse of the convection-diffusion operator is numerically quasi-sparse, exhibiting exponential off-diagonal decay, in contrast to the numerically dense inverse of the Poisson operator. This intrinsic sparsity explains why the convection-diffusion operator is significantly more robust to the underlying frame instability in practical computations.

2025-09-10T16:36:20Z Po-Yi Wu http://arxiv.org/abs/2606.06839v2 2026-06-09T05:26:40Z

In this paper, we develop a Constraint Energy Minimizing Generalized Multiscale Finite Element Method (CEM-GMsFEM) for solving linear elasticity problems in heterogeneous perforated domains. The presence of numerous perforations introduces multiple scales into the computational domain, making direct fine-grid simulations computationally expensive. The proposed method follows the standard offline--online decomposition of CEM-GMsFEM. In the offline stage, local spectral problems are solved on coarse elements to construct auxiliary spaces, and localized energy-minimizing basis functions are then computed on oversampled regions to capture fine-scale geometric information induced by the perforations. In the online stage, residual-driven basis functions are constructed in enlarged coarse neighborhoods to incorporate source-term information and improve the accuracy of the multiscale approximation adaptively. We establish convergence results for both the offline and online stages. In particular, we derive error estimates for the localized multiscale approximation and prove the convergence of the adaptive online enrichment algorithm. Moreover, we show that the oversampling regions used in the online stage can be determined locally, leading to a reduction in computational cost while maintaining convergence properties. Numerical experiments on perforated media with different geometric configurations demonstrate the accuracy and efficiency of the proposed method.

2026-06-05T02:29:12Z Wei Xie Eric Chung Yin Yang Yunqing Huang http://arxiv.org/abs/2606.11263v1 2026-06-09T03:50:14Z

Spectral methods rely fundamentally on the stability of principal eigenspaces under random perturbations. Classically, this stability is quantified by the Davis-Kahan and Wedin theorems, which bound the eigenspace error using the operator norm of the noise and the relevant spectral gaps. While these worst-case bounds are sharp for arbitrary deterministic perturbations, they can be wasteful in the low-rank signal-plus-random-noise setting, as they fail to capture the fine-grained interaction between the signal geometry and the noise distribution. In this paper, we study the spectral perturbation of signal-plus-noise matrices corrupted by sparse, random noise with an arbitrary, inhomogeneous variance profile. We demonstrate that under heterogeneous noise variances, the empirical eigenvectors suffer a systematic, deterministic geometric bias that is entirely invisible to classical perturbation bounds. By leveraging the Quadratic Vector Equation (QVE) and establishing fine-grained isotropic local laws, we derive near-optimal, non-asymptotic perturbation bounds for the leading eigenspaces in the operator and $2\to\infty$ norms. The bounds separate the usual signal-to-noise contribution, stochastic fluctuations, and structured geometric bias terms determined by the alignment between the signal eigenspaces and the row-wise variance profile.

2026-06-09T03:50:14Z 104 pages, 1 figure Fengkai Liu Ke Wang Wanjie Wang http://arxiv.org/abs/2606.10383v1 2026-06-09T03:48:27Z

We study non-separable objectives in which the loss depend on dataset-level quantities. We introduce an SGD-style framework that employs two batch-gradient constructs: the ideal per-batch gradient `$G$' and a cached surrogate `$H$' for cases where full-data terms are expensive. Notably, in the sample-wise separable case, our method reduces to standard mini-batch SGD. Our main contribution is a unified local convergence theory: under mild smoothness and Jacobian-boundedness assumptions, we prove local linear convergence under local strong convexity and local $O(1/k)$ sublinear convergence under local convexity for both `$G$'-driven and `$H$'-driven updates. Crucially, these guarantees hold for fixed step sizes within explicitly characterized ranges; we provide explicit bounds showing how cache staleness, surrogate approximation error, batch size, and step size influence the convergence constants and allowable step-size ranges.

2026-06-09T03:48:27Z Yingzhou Li Ruofan Wu http://arxiv.org/abs/2601.09623v2 2026-06-09T03:22:57Z

Reduced Order Models (ROMs) have been regarded as an efficient alternative to conventional high-fidelity Computational Fluid Dynamics (CFD) for accelerating the design and optimization processes in engineering applications. Many industrial geometries feature repeating subdomains or contain sub-regions governed by distinct physical phenomena, making them well-suited to Domain Decomposition (DD) techniques. The integration of ROM and DD is promising to further reduce computational costs by constructing local ROMs and assembling them into global solutions. Due to the complexity and necessity of coupling ROMs, many approaches have been proposed in recent years. This review provides a concise overview of existing methodologies combining ROM and DD. We categorize existing methods into intrusive (projection-based) and non-intrusive (data-driven) frameworks. Various strategies for generating local reduced bases and coupling them across subdomains are illustrated. Particular emphasis is placed on intrusive techniques, including equations, numerical algorithms, and practical implementations. The non-intrusive framework is also discussed, highlighting its general procedures, basic formulations, and underlying principles. Finally, we summarise the state of the literature, identify open challenges, and present perspectives on future implementation from an engineering viewpoint.

2026-01-14T16:50:13Z Shenhui Ruan Andreas G. Class Gianluigi Rozza http://arxiv.org/abs/2606.10353v1 2026-06-09T03:04:18Z

Higher-order ODE solvers have shown strong empirical promise for accelerating diffusion models through the probability flow ODE, but rigorous non-asymptotic guarantees for such acceleration remain limited. In this paper, we develop a Chebyshev--Gauss--Seidel higher-order sampler and establish a non-asymptotic convergence guarantee that allows the approximation order to grow logarithmically with the number of outer iterations. In the exact-score setting, up to logarithmic factors, the proposed sampler requires at most \[ d^{1+o_T(1)}\varepsilon^{-1/K_1} \] score functions to approximate the target distribution on \(\mathbb{R}^d\) within total variation distance \(\varepsilon\), where \(o_T(1)\to 0\) as \(T\to\infty\) and \(K_1>0\) is a sufficiently large constant. The analysis assumes only a polynomial second-moment bound on the target distribution, thereby relaxing the bounded-support condition imposed in existing higher-order theory. Moreover, the guarantee is robust to score and Jacobian estimation errors and does not require higher-order smoothness assumptions on the score estimates. Numerical experiments on anisotropic Gaussian mixture benchmarks support the predicted improvement in the accuracy--cost tradeoff under finite score-evaluation budgets.

2026-06-09T03:04:18Z Bingyuan Wei Meng Huang http://arxiv.org/abs/2606.10335v1 2026-06-09T02:29:14Z

Continuous approximations of flow data are useful for downstream analysis, differentiation, and visualization, but purely data-driven reconstructions do not, in general, preserve the governing physics. This limitation becomes particularly important when input data are physically inconsistent, whether due to low-fidelity discretizations or unmodeled discrepancies. In such cases, reconstructed fields may exhibit inaccurate PDE residuals, violated balance laws, or unreliable derived quantities. To address this, we propose a physics-informed B-spline framework that embeds physical constraints directly into the reconstruction process. The method constructs compact, continuously differentiable representations of discrete fields using tensor-product B-splines and determines spline control points by solving an optimization problem balancing data fidelity with residuals of the governing PDEs, alongside initial and boundary conditions. Leveraging exact analytical derivatives of the B-spline basis enables efficient and accurate evaluation of physical residuals without storing full-resolution fields. We refer to this approach as physics-informed multivariate functional approximation (PI-MFA). Numerical studies on the 1D convection-diffusion, 2D coupled Burgers, and 2D incompressible Navier-Stokes equations show PI-MFA reduces PDE residuals and improves global balance-law consistency. Compared with standard and regularized MFA, PI-MFA produces more physically faithful reconstructions and, for physically inconsistent data, lower approximation errors, while offering computational advantages over tested physics-informed neural networks. Overall, PI-MFA preserves the compactness, local support, and exact differentiability of classical spline spaces while producing reliable continuous flow fields for scientific analysis and visualization.

2026-06-09T02:29:14Z 59 pages, 21 figures, 11 tables Junoh Jung David Lenz Emil Constantinescu Tom Peterka http://arxiv.org/abs/2606.10289v1 2026-06-09T01:24:52Z

Several recent papers have demonstrated the utility of using Lie groups within estimation problems, yielding improved accuracy and consistency. This paper introduces a new tool for describing operations with matrix Lie groups: tensors and the Einstein summation notation. While tensors and Einstein notation are well-known in other research fields, applying this mathematical notation to represent and compute matrix Lie derivatives is novel. More importantly, this new notation greatly clarifies the derivatives and operations necessary to work with matrix Lie Groups in (gradient-based) estimation frameworks. Therefore, the main contribution of this paper is not a new capability, but a more perspicuous mathematical notation for working with matrix Lie groups.

2026-06-09T01:24:52Z 12 pages, 4 figures + graphical abstract, 1 algorithm, 4 tables Clark Taylor http://arxiv.org/abs/2606.10218v1 2026-06-08T22:16:19Z

We consider a two-dimensional piecewise $C^2$ domain that cuts through a quasi-uniform fixed polygonal background mesh, for instance made of quadrilaterals. A simple procedure based on convex hulls gives rise to a rather small number of polygonal boundary elements of various shapes, including elements with small edges and large aspect ratios; this is the computational mesh for a virtual element method (VEM), a trimmed background mesh. We classify all possible geometric configurations and study their stability and approximability properties. This entails deriving robust stabilization mechanisms and interpolation estimates for anisotropic elements and elements with small cuts, as well as a weak maximum principle for enhanced virtual elements; these contributions have intrinsic interest for VEM theory on geometric flexibility. We prove that the resulting VEM is uniformly stable in $H^1$, and also show optimal order-regularity error estimates in $H^1$ and $L^2$. Insightful numerical experiments corroborate and complement our theory. The proposed method is suitable for treating ALE formulations of problems in moving domains.

2026-06-08T22:16:19Z L. Beirão da Veiga C. Canuto R. H. Nochetto G. Vacca M. Verani http://arxiv.org/abs/2404.09101v3 2026-06-08T20:50:17Z

Operator-learning systems are not governed solely by total parameter count; for one query, the relevant bottleneck can be the model that must be loaded and evaluated. We study this distinction for classical neural operators on compact Sobolev subsets through a constructive comparison between routed mixtures of neural operators (MoNOs) and a fixed single-neural-operator construction. The comparison concerns expert-active complexity relative to that baseline, with total stored size and routing search accounted separately. A MoNO routes each input function through a tree to one expert. Our main theorem shows that every scalar uniformly continuous nonlinear operator with bounded output Sobolev radius on the approximation set admits a MoNO approximation whose active expert has smaller depth, width, and rank scaling than the analyzed single-neural-operator construction; for Lipschitz targets these expert quantities are bounded by $\mathcal{O}(\varepsilon^{-1})$. The theorem turns localization into an operator-level accounting of active expert size, routing depth, and number of experts. We also prove a quantitative universal approximation theorem for the underlying neural-operator architecture, with explicit dependence on compact-set diameter and modulus of continuity.

2024-04-13T23:20:16Z Anastasis Kratsios Takashi Furuya Jose Antonio Lara Benitez Matti Lassas Maarten de Hoop http://arxiv.org/abs/2606.10138v1 2026-06-08T20:11:04Z

Asymptotic analysis is one of the classical tools for bridging models across scales. Behind many such derivations lies a common symbolic structure: an ansatz, a substitution, an order-by-order matching procedure, and the extraction of effective equations or interface conditions. This article revisits that structure through two representative bridges: the kinetic-to-fluid limit, illustrated by radiative transfer with interface layers and by neural-network approximations of Boltzmann equations, and the quantum-to-classical limit, illustrated by the Frozen Gaussian Approximation and its Dirac extension. We then explain why such derivations are natural candidates for AI-assisted formalization: their recurring symbolic structures can be organized, verified, and reused. In this sense, a carefully structured expository paper may serve not only as a review, but also as a mathematical seed for future AI-assisted environments.

2026-06-08T20:11:04Z Xu Yang http://arxiv.org/abs/2606.10132v1 2026-06-08T20:07:52Z

Many numerical methods require solution of a sequence of linear systems with the same matrix and similar right-hand sides. Krylov subspace methods are a common tool for solving such linear systems, and a carefully chosen initial guess for the solution can reduce the total number of iterations, and thereby the total computational cost, required for convergence to a specified numerical tolerance. This paper introduces the WING algorithm, a modification of Fischer's second algorithm, which lowers the cost of forming an acceptably close initial guess by skipping orthogonalization and solving the possibly singular normal equations with a pseudoinverse. We demonstrate the efficacy of the new algorithm, particularly for solving linear systems with coarse relative tolerances, with numerical benchmarks based on fluid-structure interaction, mantle convection, and earthquake models.

2026-06-08T20:07:52Z David Wells Matthew G. Knepley Boyce E. Griffith