https://arxiv.org/api/EWhkDQuuzIKCS0H8Z+4Mt5LgCFw2026-06-22T22:09:15Z4987052515http://arxiv.org/abs/2410.03503v2Kernel Methods in the Deep Ritz framework: Theory and practice2026-06-01T21:00:39ZIn this contribution, kernel approximations are applied as ansatz functions within the Deep Ritz method. This allows to approximate weak solutions of elliptic partial differential equations with weak enforcement of boundary conditions using Nitsche's method. A priori error estimates are proven in different norms leveraging both standard results for weak solutions of elliptic equations and well-established convergence results for kernel methods. This availability of a priori error estimates renders the method useful for practical purposes. The procedure is described in detail, meanwhile providing practical hints and implementation details. By means of numerical examples, the performance of the proposed approach is evaluated numerically and the results agree with the theoretical findings.2024-10-04T15:17:37ZHendrik KleikampTizian Wenzelhttp://arxiv.org/abs/2606.02887v1A Nonmonotone Gradient-Based Algorithm for Symmetric Nonnegative Matrix Factorization and Graph Clustering2026-06-01T20:59:33ZSymmetric nonnegative matrix factorization (Symmetric NMF) approximates a matrix as $WW^T$ with nonnegative rectangular factor $W$. It has broad applications in graph clustering and machine learning. In contrast to the NMF, projected gradient methods for the symmetric problem had been associated with slow convergence. To address this, we introduce SNMPBB, the first adaptation of nonmonotone projected Barzilai-Borwein methods to Symmetric NMF, demonstrating that gradient algorithms are significantly more effective than previously understood. We further extend SNMPBB to graph clustering using the graph Laplacian regularization (Graph-SNMPBB) and to large problems with low-rank approximations (LAI-SNMPBB). For all variants we prove global convergence to first-order stationary points and also that Barzilai-Borwein curvature information is preserved with randomized approximations. On synthetic data, SNMPBB achieves 6 times speedup over the alternative SymANLS for similar residuals, with advantages growing at higher ranks. Across six real-world clustering benchmarks, Graph-SNMPBB matches or exceeds SymANLS accuracy. Lastly, LAI-SNMPBB outperforms state-of-the-art LAI-SymPGNCG on 34 SuiteSparse matrices in both runtime and residual quality.2026-06-01T20:59:33ZRyan SwartJohannes Brusthttp://arxiv.org/abs/2606.04030v1Reduced order modeling for spatio-temporal pattern approximation in diffusive Lotka-Volterra equations2026-06-01T20:16:21ZThis paper presents an efficient reduced order modeling (ROM) framework for simulating spatio-temporal pattern formation in three-species diffusive Lotka-Volterra systems. To alleviate the high computational cost associated with long-time simulations of the high-dimensional full order model (FOM), we apply proper orthogonal decomposition (POD) to project the solution onto a low-dimensional subspace. Further efficiency is achieved through tensorial POD (TPOD), which preserves the quadratic nonlinear structure and enables offline-online decomposition. Numerical experiments demonstrate that both POD and TPOD accurately replicate the key features of spatial segregation patterns while substantially reducing computation time, whereas the TPOD is faster. Additionally, we demonstrate accurate long-time pattern prediction using limited training data.2026-06-01T20:16:21Z9 pages, 5 figuresBülent KarasözenMurat Uzuncahttp://arxiv.org/abs/2405.08764v2A Generalised Curvilinear Coordinate system-based Patch Dynamics Scheme in Equation-free Multiscale Modelling2026-06-01T18:11:38ZThe patch dynamics scheme in equation-free multiscale modelling has the potential to efficiently predict the macroscopic behaviours by simulating the microscale problem in a fraction of the space-time domain. The patch dynamics schemes developed so far are mainly on rectangular domains with uniform grids and uniform rectangular patches. In real-life problems, the geometry of the domain is not regular or simple, where rectangular and uniform grids or patches may not be useful. To address this kind of complexity, for the first time, a generalised orthogonal curvilinear coordinate system is employed in the patch dynamics scheme, applicable to both rectangular domains with non-uniform grids and non-rectangular domains; while applying this, the concept of non-uniform and non-rectangular patch configurations in the physical domain is also adopted for the first time. An explicit representation of a patch dynamics scheme on a generalised curvilinear coordinate system in a two-dimensional domain is proposed for unsteady, linear, heterogeneous convection-diffusion-reaction (CDR) problems. The proposed scheme is validated through heterogeneous convection-diffusion-reaction and non-axisymmetric diffusion problems on generalised curvilinear coordinate systems. The results demonstrate excellent accuracy and show that the method significantly outperforms full-domain simulations in terms of computational efficiency, memory usage and overall performance.2024-05-14T16:56:49Z44 pages, 8 figures, 7 tablesTanay Kumar KarmakarDurga Charan Dalalhttp://arxiv.org/abs/2306.05677v2A fast reduced order method for linear parabolic inverse source problems2026-06-01T17:05:37ZIn this paper, we propose a novel, computationally efficient reduced order method to solve linear parabolic inverse source problems. Our approach provides accurate numerical solutions without relying on specific training data. The forward solution is constructed using a Krylov sequence, while the source term is recovered via the conjugate gradient (CG) method. Under a weak regularity assumption on the solution of the parabolic partial differential equations (PDEs), we establish convergence of the forward solution and provide a rigorous error estimate for our method. Numerical results demonstrate that our approach offers substantial computational savings compared to the traditional finite element method (FEM) and retains equivalent accuracy.2023-06-09T05:25:54ZUnfinished workYuxuan HuangYangwen Zhanghttp://arxiv.org/abs/2605.30379v2Algebraic and FFT-Based Methods for Discrete-Time Matrix Convolutions with Applications to Semi-Markov Models2026-06-01T16:22:55ZWe study the convolution product of matrix-valued sequences and its role in the computation of Markov renewal equations. Explicit representations and recursive formulae for the convolutional inverse are derived and used to construct FFT-accelerated convolution and Newton-type inversion schemes, together with a Gauss--Jordan alternative in truncated power-series rings. The proposed framework is also applied to discrete approximations of matrix Stieltjes convolutions, which arise in continuous-time semi-Markov models. These tools are then used for the numerical evaluation of semi-Markov reliability and availability functions. The numerical results show substantial reductions in runtime, while preserving close agreement with exact benchmark solutions, direct computations, and Monte Carlo simulations.2026-05-27T19:15:19ZL. KordalisS. Trevezashttp://arxiv.org/abs/2606.02427v1Spectral Audit of In-Context Operator Networks2026-06-01T16:04:21ZExisting evaluations of neural operators and in-context operator learning rely primarily on prediction error, but accurate output prediction does not guarantee the correct local dynamical structure. A model may match solutions while exhibiting incorrect sensitivities, distorted frequency response, spurious mode coupling, or unstable tangent behavior. We introduce a Jacobian-based spectral audit for in-context operator learning. For a fixed prompt, we differentiate the network output with respect to the query function and view the resulting Jacobian as a learned tangent operator. Projecting it onto Fourier modes, we obtain a local spectral characterization of the inferred operator, including frequency-dependent gains, phase structure, and cross-mode coupling. The audit complements standard prediction metrics by testing whether the model reproduces local mechanisms of the underlying PDE operator rather than only outputs. Across benchmarks, the audit reveals distinct operator-level phenomena, including phase transport, viscosity-dependent damping, nonlinear mode coupling, and reaction--diffusion stability structure. It also detects failures partially hidden by prediction-error metrics, including high-frequency degradation, incorrect phase recovery, and prompt--operator inconsistencies. Corrupted or internally inconsistent prompts lead to degraded tangent-operator structure even when pointwise predictions remain partially accurate. Our results suggest that prediction accuracy and local operator fidelity are distinct properties of learned neural operators. Our framework also provides a diagnostic for stability, sensitivity, and operator consistency.2026-06-01T16:04:21ZZhiwei GaoLiu YangGeorge Em Karniadakishttp://arxiv.org/abs/2605.29072v2Ensemble Score Filtering for Real-Data Energy Consumption Forecast Correction2026-06-01T15:36:10ZAccurate estimation and forecasting of energy consumption are important for power-system operation, planning, and demand-side management. In practice, however, complete and timely measurements may not always be available, and the observed data can be partial, noisy, or delayed. This motivates the use of learned forecasting models for predicting the evolving consumption state, together with data assimilation methods for sequential forecast correction. In this work, we study a high-dimensional data assimilation problem for real energy-consumption data. \modeltext{The forward prediction is supplied by a pretrained black-box spatio-temporal forecasting model, which is treated as the state propagator in the filtering procedure.} We employ the Ensemble Score Filter (EnSF) to assimilate partial and noisy observations and to correct the forecast trajectory over time. The EnSF uses score-based diffusion models to approximate filtering distributions and avoids retraining neural-network score models during assimilation by using a closed-form score representation and Monte Carlo approximation. Numerical experiments demonstrate that open-loop propagation of the learned forecasting model can become unreliable over long horizons, while EnSF-based correction substantially improves state estimation. Comparisons with the Ensemble Kalman Filter (EnKF) further show that EnSF provides stronger correction under the nonlinear observation setting considered in this work.2026-05-27T20:27:38ZRuoyu HuDahai YuFeng BaoGuang WangGuannan Zhanghttp://arxiv.org/abs/2601.16884v3Multigrade Neural Network Approximation2026-06-01T14:41:19ZWe study multigrade deep learning (MGDL) as a principled framework for structured error refinement in deep neural networks. While the approximation power of neural networks is now relatively well understood, training very deep architectures remains challenging due to highly nonconvex and often ill-conditioned optimization landscapes. In contrast, for relatively shallow networks, most notably certain one-hidden-layer ReLU models, training admits convex reformulations with global guarantees under appropriate settings, motivating learning paradigms that improve stability while scaling to depth. MGDL builds on this insight by training deep networks grade by grade: previously learned grades are frozen, and each newly added grade-wise subnetwork is composed on top of the previously learned grades and trained to fit the residual left by the current approximation, yielding a structured and interpretable hierarchical refinement process. We develop an operator-theoretic foundation for MGDL and prove that, for any continuous target function defined on a hypercube, there exists a fixed-width multigrade ReLU scheme whose residuals are pointwise nonincreasing in magnitude and converge uniformly to zero, with strict $L^p$-norm decay at every nontrivial grade for $p\in [1,\infty)$. To the best of our knowledge, this work provides the first rigorous constructive approximation guarantee showing that a grade-wise residual refinement scheme can achieve vanishing error in a fixed-width multigrade ReLU architecture.2026-01-23T16:46:25ZShijun ZhangZuowei ShenYuesheng Xuhttp://arxiv.org/abs/2509.15385v3Variable-preconditioned transformed primal-dual method for generalized Wasserstein Gradient Flows2026-06-01T14:20:09ZWe propose a Variable-Preconditioned Transformed Primal-Dual (VPTPD) method for solving generalized Wasserstein gradient flows based on the structure-preserving JKO scheme. This is a nontrivial extension of the TPD method [Chen et al. (2025) SIAM J. Sci. Comput.] incorporating proximal splitting techniques to address the challenges arising from the nonsmoothness of the objective function. Our key contributions include: (i) a semi-implicit-explicit iterative scheme that combines proximal gradient steps with explicit gradient steps to treat the nonsmooth and smooth terms respectively; (ii) variable-dependent preconditioners constructed from the Hessian of a regularized objective to balance iteration count and per-iteration cost; (iii) a proof of existence and uniqueness of bounded solutions for the generalized proximal operator with the chosen preconditioner, along with a convergent and bound-preserving Newton solver; and (iv) an adaptive step-size strategy to improve robustness and accelerate convergence under poor Lipschitz conditions of the energy derivative. Comprehensive numerical experiments spanning from 1D to 3D settings demonstrate that our method achieves superior computational efficiency--achieving up to a 20$\times$ speedup over existing methods-thereby highlighting its broad applicability through several challenging simulations.2025-09-18T19:50:26Z33 pages, 15 figuresJin ZengDawei ZhanRuchi GuoChaozhen Weihttp://arxiv.org/abs/2506.21025v3An energy-stable parametric finite element method for the Willmore flow in three dimensions2026-06-01T14:19:41ZThis work develops novel energy-stable parametric finite element methods (ES-PFEM) for the Willmore flow and curvature-dependent geometric gradient flows of surfaces in three dimensions. The key to achieving the energy stability lies in the use of two novel geometric identities: (i) a reformulated variational form of the normal velocity field, and (ii) incorporation of the temporal evolution of the mean curvature into the governing equations. These identities enable the derivation of a new variational formulation. By using the parametric finite element method, an implicit fully discrete scheme is subsequently developed, which maintains the energy dissipative property at the fully discrete level. Based on the ES-PFEM, comprehensive insights into the design of ES-PFEM for general curvature-dependent geometric gradient flows and a new understanding of mesh quality improvement in PFEM are provided. In particular, we develop the first PFEM for the Gauss curvature flow of surfaces. Furthermore, a tangential velocity control methodology is applied to improve the mesh quality and enhance the robustness of the proposed numerical method. Extensive numerical experiments confirm that the proposed method preserves energy dissipation properties and maintain good mesh quality in the surface evolution under the Willmore flow.2025-06-26T06:06:34ZWeizhu BaoYifei LiDongmin Wanghttp://arxiv.org/abs/2604.11063v2An Adaptive Log-Laguerre Spectral Method for the Radial Dirac Equation: Resolving Asymptotic Decay and Core Singularities in Atomic Calculations2026-06-01T12:45:45ZThe high-precision solution of the radial Dirac equation is fundamental to relativistic quantum chemistry, essential for reliable pseudopotential generation and all-electron electronic structure methods. Capturing both the non-polynomial singularities at the origin and the state-dependent asymptotic decay on semi-infinite domains presents a significant computational challenge. In this work, we propose the Adaptive Log-Laguerre Spectral Method (ALLSM), a novel coupled spectral-element solver that seamlessly integrates three advanced mathematical methodologies into a unified framework. Specifically, Generalized Log-Orthogonal Functions (GLOFs) are deployed in the near-core region to intrinsically approximate complex $r^s$ singular behaviors without requiring prior knowledge of the exact analytical exponent $s$. Concurrently, an adaptive Laguerre spectral method is employed to dynamically capture diverse exponential tails on $[0, \infty)$, avoiding artificial domain truncation. To structurally guarantee spectral purity across this bipartite basis, the framework rigorously incorporates the Inverse Dirac Operator Method (IDOM), effectively eliminating variational collapse and spurious states. Validated across diverse physical regimes, including Coulomb, finite-nucleus, and screened potentials, the proposed solver restores exponential convergence and consistently achieves relative accuracies of $10^{-10}$. This work provides a robust, pollution-free computational kernel for atomic structure calculations, establishing a highly reliable numerical standard for complex molecular simulations.2026-04-13T06:44:04Z22 pages, 17 figuresSheng ChenSihong ShaoShuai Wuhttp://arxiv.org/abs/2606.02188v1Symmetric-Tensor Distributional Mixed Method for Fourth-Order Elliptic Singular Perturbation Problem2026-06-01T12:45:28ZA symmetric-tensor distributional mixed method for a fourth-order elliptic singular perturbation problem is developed in this paper. The moment variable is approximated by normal-normal continuous symmetric tensor elements, while the scalar variable is represented by an $H^1$-nonconforming virtual element space coupled with a polynomial multiplier on interior subsimplices of codimension two. Optimal parameter-uniform error estimates are derived, independent of the presence of boundary layers. A hybridized form of the method is also equivalent to stabilization-free weak Galerkin and $H^2$-nonconforming virtual element methods. In two dimensions, a close connection of the distributional mixed method to the classical Hellan-Herrmann-Johnson (HHJ) method is established, by naturally identifying the scalar virtual element-multiplier pair with the Lagrange finite element space. Thus the proposed method extends the two-dimensional HHJ method to arbitrary spatial dimensions. Three-dimensional numerical experiments support the theoretical convergence and robustness estimates.2026-06-01T12:45:28Z25 pages, 2 figures, 3 tablesXuehai HuangXinyue Zhaohttp://arxiv.org/abs/2508.08873v2A Parareal Algorithm with Low-Rank Coarse Solvers2026-06-01T12:32:48ZWe consider a new class of Parareal algorithms, which use ideas from localized reduced basis methods to construct the coarse solver from truncated SVD approximations of the transfer operators mapping initial values for a given time interval to the solution at the end of the interval. By leveraging randomized singular value decompositions, these low-rank approximations are obtained embarrassingly parallel by computing local fine solutions for random initial values. We show a priori and a posteriori error bounds in terms of the computed singular values of the transfer operators. Our numerical experiments demonstrate that our approach can significantly outperform Parareal with single-step coarse solvers. At the same time, it permits to further increase parallelism in Parareal by trading global iterations for a larger number of independent local solves.2025-08-12T11:59:08Z29 pages, 14 figuresMartin J. GanderMario OhlbergerStephan Ravehttp://arxiv.org/abs/2502.03847v2Error estimates for full discretization by an almost mass conservation technique for Cahn--Hilliard systems with dynamic boundary conditions2026-06-01T12:07:13ZA proof of optimal-order error estimates is given for the full discretization of the bulk--surface Cahn--Hilliard system with dynamic boundary conditions in a smooth domain. The numerical method combines a linear bulk--surface finite element discretization in space and linearly implicit backward difference formulae of order one to five in time. The error estimates are obtained by a consistency and stability analysis, based on an energy estimate and the novel approach of exploiting the almost mass conservation of the error equations to derive a Poincaré-type inequality. We demonstrate how this approach can be generalized to other almost mass conserving problems. To this end we prove optimal-order fully discrete error estimates for the Cahn--Hilliard equation on evolving surfaces. We illustrate and complement our findings by numerical experiments.2025-02-06T07:56:31ZNils Bullerjahn