https://arxiv.org/api/m3A7fVCvKw2aWJPTAwy1PyRRMEA 2026-03-22T15:52:20Z 48280 90 15 http://arxiv.org/abs/2511.12298v3 On the Spectral Clustering of a Class of Multigrid Preconditioners 2026-03-16T19:03:09Z We consider an algebraic multigrid (AMG) scheme for the direct solution of complex- valued square linear systems based on a recursive 2 x 2 block partitioning of the coefficient matrix and study the optimal choices of its components. In particular, we complement existing results that characterize the optimal choices for a nonsymmetric cycle method by analyzing the spectral behavior of its symmetric cycle variant. We analyze the error propagation operator of a specific two-level symmetric cycle method by calculating its invariant subspaces and its nonzero eigenvalues that influence the behavior of the error after a single cycle. We show that the error propagation operator can be studied separately for pairs of modes, working as bases of the invariant subspaces. The main result is an explicit choice of smoothing parameters that makes all the pairs of modes respond identically, forcing the nontrivial eigenvalues of the error propagation operator to collapse to a single, a priori known value. As a consequence, we give a new closed form formula for the inverse of a general square matrix. Additionally, the framework provides a clear, self-contained description of an ideal AMG K-cycle, offering a concrete target for the design of related schemes. We illustrate the theory with direct applications to general matrices and with analyses of representative matrices arising in numerical methods. 2025-11-15T17:18:22Z 24 pages, 2 figures Jose Pablo Lucero Lorca Conor McCoid Michal Outrata http://arxiv.org/abs/2603.15816v1 Efficient and Accurate Surrogate Modeling of Turbulent Flows via Space-Dependent Aggregation and Reduced Order Models 2026-03-16T18:48:13Z Reynolds-Averaged Navier-Stokes (RANS) models are widely used for turbulent flow simulations due to their computational efficiency, but their accuracy strongly depends on the selected turbulence closure and may vary across the flow domain. Space-dependent model aggregation has been shown to improve RANS predictions by combining multiple turbulence models, although at the cost of repeated high-fidelity simulations. The first novelty of this work is a unified framework that combines different turbulence models, space-dependent aggregation, and non-intrusive reduced order models to achieve both accuracy and efficiency. Two aggregation pipelines are proposed: a Mixed FOM-ROM (MFR) approach, where a reduced order model is trained on aggregated RANS solutions, and a Mixed-ROM (MR) approach, which directly aggregates multiple reduced order models built on top of different RANS full-order models. The second novelty is that the aggregation weights are learned via a neural-network that provides smooth, space-continuous weights and improves generalization with respect to standard weighting techniques. The resulting surrogate models are validated on the two-dimensional periodic hill benchmark and on the flow over a height-dependent bump, demonstrating improved accuracy over individual RANS and ROM predictions at near real-time computational cost. 2026-03-16T18:48:13Z Piero Zappi Anna Ivagnes Niccolò Tonicello Gianluigi Rozza http://arxiv.org/abs/2512.21891v2 Non-polynomial divided difference and blossoming 2026-03-16T18:16:08Z Two notable examples of dual functionals in approximation theory and computer-aided geometric design are the blossom and the divided difference operator. Both of these dual functionals satisfy a similar set of formulas and identities. Moreover, the divided differences of polynomials can be expressed in terms of the blossom. In this paper, an extended non-polynomial homogeneous blossom for a wide collection of spline spaces, including trigonometric splines, hyperbolic splines, and special Müntz spaces of splines, is defined. It is shown that there is a relation between the non-polynomial divided difference and the blossom, which is analogous to the polynomial case. 2025-12-26T06:45:28Z Fatma Zürnacı-Yetiş http://arxiv.org/abs/2403.11738v4 A path-dependent PDE solver based on signature kernels 2026-03-16T17:56:37Z We develop a kernel-based solver for path-dependent PDEs (PPDEs) along with a convergence theory. Our numerical scheme leverages signature kernels, a recently introduced class of kernels on path-space. Specifically, we solve an optimal recovery problem by approximating the solution of a PPDE with an element of minimal norm in the signature reproducing kernel Hilbert space constrained to satisfy the PPDE at a finite collection of collocation paths. In the linear case, we show that the optimisation has a unique closed-form solution expressed in terms of signature kernel evaluations at the collocation paths. Under strict assumptions, we prove consistency of the proposed scheme, guaranteeing convergence to the PPDE solution as the number of collocation points increases. Finally, several numerical examples are presented, in particular in the context of option pricing under rough volatility. Our numerical scheme constitutes a valid alternative to the ubiquitous Monte Carlo methods. 2024-03-18T12:47:19Z 37 pages, 1 figure Alexandre Pannier Cristopher Salvi http://arxiv.org/abs/2603.15580v1 A Data-Constrained Framework for Marine Biogeochemistry Modeling with Applications to the Paranaguá Estuarine Complex 2026-03-16T17:43:29Z Marine biogeochemical models are widely used to study nutrient dynamics, water quality, and climate-related processes in coastal and estuarine systems. However, developing models that reliably represent specific environments remains computationally demanding, which makes their application to complex systems such as river plumes and estuarine environments challenging. In addition, these models contain several parameters that must be calibrated for the region of interest, a process that is often performed empirically using limited observational data. This thesis advances the development and calibration of marine biogeochemical models in the Brazilian context through three main contributions. First, we develop a conceptual model describing nutrient-phytoplankton dynamics in the Paranagua Estuarine Complex (PEC) in southern Brazil. The model is intentionally simple and computationally inexpensive, allowing simulations to be performed on standard personal computers. Second, we propose a systematic calibration framework based on tracer datasets and derivative-free optimization techniques. Finally, we demonstrate the practical application of this approach by calibrating the PEC model using in situ observations. Results show that, despite its simplicity, the model can reproduce observed nutrient dynamics when properly calibrated. The proposed framework is general and can be extended to multi-parameter calibration, seasonal parameter variation, and the coupling of biogeochemical models with higher-fidelity hydrodynamic models. 2026-03-16T17:43:29Z PhD thesis, Federal University of Parana (UFPR), 2026, 146 pages, 74 figures Leticia Becher http://arxiv.org/abs/2602.02500v2 IFNSO: Iteration-Free Newton-Schulz Orthogonalization 2026-03-16T17:25:57Z The Newton-Schulz (NS) iteration has become a key technique for orthogonalization in optimizers such as Muon and for optimization on the Stiefel manifold. Despite its effectiveness, the conventional NS iteration incurs significant computational overhead due to repeated high-dimensional matrix multiplications. To overcome these limitations, we propose Iteration-Free Newton-Schulz Orthogonalization (IFNSO), a novel framework that consolidates the traditional iterative structure into a unified and Iteration-Free formulation. By analyzing the contribution of individual matrix powers, we streamline the process by removing insignificant terms and introducing a polynomial with learnable coefficients. These coefficients are optimized to ensure both superior computational efficiency and stable convergence. Extensive experiments demonstrate that IFNSO achieves superior performance compared to existing methods. Our code is available at: https://github.com/greekinRoma/Unified_Newton_Schulz_Orthogonalization. 2026-01-18T17:54:43Z Chen Hu Qianxi Zhao Xiaochen Yuan Hong Zhang Ding Yuan Yanbin Wu Xiying Li http://arxiv.org/abs/2603.15494v1 A practical randomized trust-region method to escape saddle points in high dimension 2026-03-16T16:20:27Z Without randomization, escaping the saddle points of $f \colon \mathbb{R}^d \to \mathbb{R}$ requires at least $Ω(d)$ pieces of information about $f$ (values, gradients, Hessian-vector products). With randomization, this can be reduced to a polylogarithmic dependence in $d$. The prototypical algorithm to that effect is perturbed gradient descent (PGD): through sustained jitter, it reliably escapes strict saddle points. However, it also never settles: there is no convergence. What is more, PGD requires precise tuning based on Lipschitz constants and a preset target accuracy. To improve on this, we modify the time-tested trust-region method with truncated conjugate gradients (TR-tCG). Specifically, we randomize the initialization of tCG (the subproblem solver), and we prove that tCG automatically amplifies the randomization near saddles (to escape) and absorbs it near local minimizers (to converge). Saddle escape happens over several iterations. Accordingly, our analysis is multi-step, with several novelties. The proposed algorithm is practical: it essentially tracks the good behavior of TR-tCG, with three minute modifications and a single new hyperparameter (the noise scale $σ$). We provide an implementation and numerical experiments. 2026-03-16T16:20:27Z 52 pages + appendices (61 pages in total) Radu-Alexandru Dragomir Xiaowen Jiang Bonan Sun Nicolas Boumal http://arxiv.org/abs/2510.13496v3 Data-intrinsic approximation in metric spaces 2026-03-16T16:13:53Z Analysis and processing of data is a vital part of our modern society and requires vast amounts of computational resources. To reduce the computational burden, compressing and approximating data has become a central topic. We consider the approximation of labeled data samples, mathematically described as site-to-value maps between finite metric spaces. Within this setting, we identify the discrete modulus of continuity as an effective data-intrinsic quantity to measure regularity of site-to-value maps without imposing further structural assumptions. We investigate the consistency of the discrete modulus of continuity in the infinite data limit and propose an algorithm for its efficient computation. Building on these results, we present a sample based approximation theory for labeled data. For data subject to statistical uncertainty we consider multilevel approximation spaces and a variant of the multilevel Monte Carlo method to compute statistical quantities of interest. Our considerations connect approximation theory for labeled data in metric spaces to the covering problem for (random) balls on the one hand and the efficient evaluation of the discrete modulus of continuity to combinatorial optimization on the other hand. We provide extensive numerical studies to illustrate the feasibility of the approach and to validate our theoretical results. 2025-10-15T12:45:29Z Jürgen Dölz Michael Multerer http://arxiv.org/abs/2603.15431v1 Physics-informed fine-tuning of foundation models for partial differential equations 2026-03-16T15:37:03Z Foundation models for partial differential equations (PDEs) have emerged as powerful surrogates pre-trained on diverse physical systems, but adapting them to new downstream tasks remains challenging due to limited task-specific data and distribution shifts. While fine-tuning has proven transformative in natural language processing, best practices for adapting PDE foundation models remain underexplored. Although physics-informed training has successfully trained accurate solvers across a wide range of PDE problems, its potential for fine-tuning data-based foundation models has not been systematically studied. In this work, we introduce a physics-informed fine-tuning framework that adapts pre-trained PDE foundation models by incorporating physical constraints (PDE residuals and boundary conditions) directly into the fine-tuning objective. This enables effective adaptation in data-scarce regimes while promoting physical consistency. We evaluate our method on a downstream task composed of an unseen PDE class and compare it with data-driven finetuning counterparts. Our results demonstrate that physics-informed fine-tuning achieves competitive accuracy without requiring PDE solutions for training. Furthermore, a hybrid fine-tuning strategy yields superior generalization to out-of-distribution scenarios when only minimal training data is available. These findings establish physics-informed fine-tuning as a scalable and data-efficient paradigm, providing a physically interpretable pathway for adapting foundation models in scientific machine learning. 2026-03-16T15:37:03Z 12 pages, 6 figures, 1 table ICLR 2026 Workshop on Artificial Intelligence and Partial Differential Equations Vlad Medvedev Leon Armbruster Christopher Straub Georg Kruse Andreas Rosskopf http://arxiv.org/abs/2603.15378v1 FFT-accelerated computation of the Dirichlet-to-Neumann map for inhomogeneous exterior Helmholtz problems using the method of fundamental solutions 2026-03-16T14:53:44Z An efficient numerical method is proposed for computing the Dirichlet-to-Neumann (DtN) map associated with the exterior Dirichlet problem for the two-dimensional Helmholtz equation with an inhomogeneous term. The exterior solution is approximated by the method of fundamental solutions (MFS). When the source and collocation points are equally spaced on concentric circles, the coefficient matrices arising in the discretization become circulant, which enables efficient evaluation of the discrete DtN map by the fast Fourier transform (FFT). By incorporating the boundary condition defined by the DtN map into a finite element formulation, the original exterior problem posed on an unbounded domain is reduced to an equivalent problem on a bounded computational domain, which can then be solved by the finite element method (FEM). Numerical examples show that the proposed MFS-based approach computes the DtN map with high accuracy, and that the FEM incorporating the boundary condition defined by the DtN map yields accurate solutions for exterior Helmholtz problems with an inhomogeneous term posed on unbounded domains. 2026-03-16T14:53:44Z 28 pages, 16 figures Takemi Shigeta http://arxiv.org/abs/2501.07470v3 Function Approximation in Numerically Rank-Deficient Bases 2026-03-16T14:45:59Z We study linear function approximation in a finite basis under finite-precision arithmetic. In a highly non-orthogonal basis, certain directions are only weakly represented, so that rounding errors can significantly distort the effectively spanned space. In the first part of the paper, we formalize this phenomenon through the notion of a numerical span. Using a novel model for the rounding errors involved, we prove that approximation in the numerical span behaves like approximation in exact arithmetic subject to an additional penalty proportional to the size of the expansion coefficients and the unit roundoff. A key implication is that straightforward numerical orthogonalization cannot mitigate the effects induced by finite-precision arithmetic. The framework also provides a theoretical justification for $\ell^2$-regularized approximation. Moreover, regularization controls the amplification of rounding errors in the computation of expansion coefficients. In the second part of the paper, we address sampling for function approximation in the presence of numerical rank-deficiency. We demonstrate that regularization has another fundamental benefit: it relaxes the conditions required for accurate least squares approximation from sampled data. This effect is made concrete through an analysis of randomized sampling based on a regularized variant of the Christoffel function. The resulting sample complexity bounds depend on an effective dimension that measures the number of directions that remain useful after finite-precision rounding. We also show that regularization renders the Christoffel function computable in contrast to the standard Christoffel function, whose numerical evaluation may require arbitrarily high precision in the presence of numerical rank-deficiency. We apply the derived theory to obtain new results for the discretization of univariate Fourier extension frames. 2025-01-13T16:37:16Z Astrid Herremans Daan Huybrechs http://arxiv.org/abs/2603.15331v1 A scaled TW-PINN: A physics-informed neural network for traveling wave solutions of reaction-diffusion equations with general coefficients 2026-03-16T14:21:38Z We propose an efficient and generalizable physics-informed neural network (PINN) framework for computing traveling wave solutions of $n$-dimensional reaction-diffusion equations with various reaction and diffusion coefficients. By applying a scaling transformation with the traveling wave form, the original problem is reduced to a one-dimensional scaled reaction-diffusion equation with unit reaction and diffusion coefficients. This reduction leads to the proposed framework, termed scaled TW-PINN, in which a single PINN solver trained on the scaled equation is reused for different coefficient choices and spatial dimensions. We also prove a universal approximation property of the proposed PINN solver for traveling wave solutions. Numerical experiments in one and two dimensions, together with a comparison to the existing wave-PINN method, demonstrate the accuracy, flexibility, and superior performance of scaled TW-PINN. Finally, we explore an extension of the framework to the Fisher's equation with general initial conditions. 2026-03-16T14:21:38Z Seungwan Han Kwanghyuk Park Jiaxi Gu Jae-Hun Jung http://arxiv.org/abs/2603.15284v1 Multilevel Sparse Tensor Approximation for High-Dimensional Parametric PDEs 2026-03-16T13:47:10Z In this paper the efficiency of multilevel sparse tensor approximation methods for high-dimensional affine parametric diffusion equations is investigated. Methodologically, the recently presented Sparse Alternating Least Squares (SALS) algorithm is employed to construct adaptive tensor train (TT) approximations of quantities of interest (QoI). By combining this tensor-based approach with a multilevel Galerkin discretization strategy, the solution's regularity can be exploited to significantly reduce computational costs by level-adapted sample sizes. A rigorous theoretical analysis is derived, demonstrating that the work overhead for the proposed multilevel method remains independent of the discretization level, which stands in stark contrast to the exponential growth observed in single-level approaches. The presented analysis is quite general and not constrained to the sparse TT format but uses a generic framework that can be extended to other model classes. Numerical experiments validate the predicted efficiency gains in high-dimensional settings. 2026-03-16T13:47:10Z Martin Eigel Philipp Trunschke Dana Wrischnig http://arxiv.org/abs/2510.12540v2 Empirical bounds for commuting dilations of free unitaries and the universal commuting dilation constant 2026-03-16T13:46:01Z For a tuple $T$ of Hilbert space operators, the 'commuting dilation constant' is the smallest number $c$ such that the operators of $T$ are a simultaneous compression of commuting normal operators of norm at most $c$. We present numerical experiments giving a strong indication that the commuting dilation constant of a pair of independent random $N{\times}N$ unitary matrices converges to $\sqrt2$ as $N \to \infty$ almost surely. Under the assumption that this is the case, we prove that the commuting dilation constant of an arbitrary pair of contractions is strictly smaller than $2$. Our experiments are based on a simple algorithm that we introduce for the purpose of computing dilation constants between tuples of matrices. 2025-10-14T14:04:02Z accepted for publication in Journal of Experimental Mathematics; changes in v2: new Remark 2.8, updated references and acknowledgements, minor corrections; 13 pages, 5 figures Malte Gerhold Marcel Scherer Orr Shalit http://arxiv.org/abs/2506.22428v2 Augmented Lagrangian methods for infeasible convex optimization problems and diverging proximal-point algorithms 2026-03-16T13:07:45Z This work investigates the convergence behavior of augmented Lagrangian methods (ALMs) when applied to convex optimization problems that may be infeasible. ALMs are a popular class of algorithms for solving constrained optimization problems. We demonstrate that, under mild assumptions, the sequences of iterates generated by ALMs converge to solutions of the ``closest feasible problem''. We establish progressively stronger convergence results, ranging from basic sequence convergence to more precise convergence rates, under a hierarchy of assumptions. This study leverages the classical relationship between ALMs and the proximal-point algorithm applied to the dual problem. A key technical contribution is a set of concise results on the behavior of the proximal-point algorithm when applied to functions that may lack minimizers. These results pertain to its convergence in terms of its subgradients and of the values of the convex conjugate. 2025-06-27T17:55:44Z Roland Andrews Justin Carpentier Adrien Taylor