Error formulas for block rational Krylov approximations of matrix functions

2026-03-20T13:27:51Z

This paper investigates explicit expressions for the error associated with the block rational Krylov approximation of matrix functions. Two formulas are proposed, both derived from characterizations of the block FOM residual. The first formula employs a block generalization of the residual polynomial, while the second leverages the block collinearity of the residuals. A posteriori error bounds based on the knowledge of spectral information of the argument are derived and tested on a set of examples. Notably, both error formulas and their corresponding upper bounds do not require the use of quadratures for their practical evaluation.

High order ghost-FEM for incompressible Navier-Stokes equations on moving domains

2026-03-20T13:15:34Z

We develop a new numerical technique for approximating solutions of the Navier-Stokes equations on moving domains. The method aims at simulating an incompressible fluid past an object whose motion is assigned a priori using a level-set function. The proposed approach relies on a space discretization based on the ghost finite element method (ghost-FEM), which allows computations on unfitted meshes and avoids costly remeshing as the domain evolves in time. Time integration is performed using an IMplicit-EXplicit (IMEX) scheme to address the nonlinearity of the convective term, ensuring high-order accuracy for incompressible flows. The error introduced by the geometrical approximation is handled using the Shifted Boundary Method, which allows higher order approximations of boundary conditions on unfitted meshes. Dirichlet boundary conditions are imposed weakly by means of Nitsche's method. The associated stabilization parameter is chosen by solving a generalized eigenvalue problem, ensuring stability and accuracy of the numerical scheme. We present a series of numerical experiments designed to validate the accuracy of the proposed method, as well as comparisons with established benchmark problems involving moving boundaries.

Infinite-dimensional spherical-radial decomposition for probabilistic functions, with application to constrained optimal control and Gaussian process regression

2026-03-20T12:45:12Z

The spherical-radial decomposition (SRD) is an efficient method for estimating probabilistic functions and their gradients defined over finite-dimensional elliptical distributions. In this work, we generalize the SRD to infinite stochastic dimensions by combining subspace SRD with standard Monte Carlo methods. The resulting method, which we call hybrid infinite-dimensional SRD (hiSRD) provides an unbiased, low-variance estimator for convex sets arising, for instance, in chance-constrained optimization. We provide a theoretical analysis of the variance of finite-dimensional SRD as the dimension increases, and show that the proposed hybrid method eliminates truncation-induced bias, reduces variance, and allows the computation of derivatives of probabilistic functions. We present comprehensive numerical studies for a risk-neutral stochastic PDE optimal control problem with joint chance state constraints, and for optimizing kernel parameters in Gaussian process regression under the constraint that the posterior process satisfies joint chance constraints.

Bounds on the determinant of an exponential matrix

2026-03-20T12:33:31Z

We derive upper and lower bounds on the determinant of an exponential matrix. They can be transformed into corresponding bounds for the determinant of a univariate Gaussian matrix.

Weak Adversarial Neural Pushforward Method for Fractional Fokker-Planck Equations

2026-03-20T11:54:18Z

We extend the Weak Adversarial Neural Pushforward Method (WANPM) to fractional Fokker-Planck equations, in which the classical Laplacian diffusion operator is replaced by the fractional Laplacian of order alpha in (0, 2]. The solution distribution is represented as the pushforward of a simple base distribution through a neural network, and the weak formulation is discretized entirely via Monte Carlo sampling without any temporal mesh. A key computational advantage is that plane-wave test functions are eigenfunctions of the fractional Laplacian, making the operator cost identical to that of classical diffusion for any alpha. We validate the method on seven benchmark problems with alpha = 1.5, spanning one and two spatial dimensions: the steady-state fractional Ornstein--Uhlenbeck (OU) process, a harmonic confining potential, a double-well potential, and a triple-well potential in one dimension, a steady-state 2D double-peak distribution, a time-dependent 2D ring distribution with rotational drift, and a five-dimensional harmonic potential. Each case is benchmarked against particle simulations using symmetric alpha-stable Lévy increments, and robust statistics confirm close agreement throughout. The method is mesh-free, requires no density evaluation or non-local quadrature, and provides a promising foundation for high-dimensional anomalous diffusion solvers.

Transformer Causality Regularization for Dynamic Inverse Problems

2026-03-20T10:58:41Z

We study the concept of including the causality principle as regularizer into the solution of linear time-dependent inverse problems. This is achieved by combining transformer-based predictions with classical variational regularization, resulting in what we call transformer causality regularization (TCR). The causality principle states that an object at time $t'$ depends only on its previous states at $t < t'$ and is independent of future states at $t > t'$. Since the transformer architecture represents sequence-to-sequence functions and can be equipped with a causal attention mask, transformers are the natural choice for a learned causality function that predicts the state of an object at time $t'$ given the previous states at $t < t'$. We combine this with the inductive bias of convolutional neural networks (CNNs) for imaging tasks to treat the spatial variable. The output of the spatial-temporal transformer is then used as a prior for variational regularization, such that classical results on regularization and convergence for solution methods directly transfer to our case. Using the example of dynamic computerized tomography, we compare TCR to a static and dynamic version of the earlier introduced unrolled adversarial regularizer for simulated and measured data. The results show that using TCR within a variational framework improves reconstruction results and data-consistency.

Eigenvalue Stability and New Perturbation Bounds for the extremal eigenvalues of a matrix

2026-03-20T08:42:36Z

Let $A$ be a full ranked $ n\times n$ matrix, with singular values $σ_1 (A) \ge \dots \ge σ_n (A) >0$. The condition number $κ(A):= σ_1(A)/σ_n(A)=\|A\|\cdot \|A\|^{-1}$ is a key parameter in the analysis of algorithms taking $A$ as input. In practice, matrices (representing real data) are often perturbed by noise. Technically speaking, the real input would be a noisy variant $\tilde A =A +E$ of $A$, where $E$ represents the noise. The condition number $κ(\tilde A)$ will be used instead of $κ(A)$. Thus, it is of importance to measure the impact of noise on the condition number. In this paper, we focus on the case when the noise is random. We introduce the notion of regional stability, via which we design a new framework to estimate the perturbation of the extremal singular values and the condition number of a matrix. Our framework allows us to bound the perturbation of singular values through the perturbation of singular spaces. We then bound the latter using a novel contour analysis argument, which, as a co-product, provides an improved version of the classical Davis-Kahan theorem in many settings. Our new estimates concerning the least singular value $σ_n(A)$ complement well-known results in this area, and are more favorable in the case when the ground matrix $A$ is large compared to the noise matrix $E$.

Surrogate Modeling with Low-Rank Function Representation for Electromagnetic Simulation

2026-03-20T08:19:57Z

High-fidelity electromagnetic (EM) simulations are indispensable for the design of microwave and wave devices, yet repeated full-wave evaluations over high-dimensional design spaces are often computationally prohibitive. While neural surrogates can amortize this cost, learning high-dimensional EM response mappings remains difficult under limited simulation budgets due to strong and heterogeneous parameter couplings. In this work, we introduce low-rank tensor function representations as a principled surrogate modeling paradigm for EM problems and provide a systematic study of representative low-rank formats, including Tucker-style low-rank tensor function representation (LRTFR) as well as neural functional tensor-train (TT) and tensor-ring (TR) baselines. Building on these insights, we propose a pairwise low-rank tensor network (PLRNet) that uses learnable pairwise interaction factors over compact coordinate-wise embeddings. Experiments on representative EM surrogate tasks demonstrate that the proposed framework achieves a more favorable overall trade-off between accuracy, robustness, and parameter efficiency, with stable optimization in high-dimensional regimes.

Regularized dynamical parametric approximation

2026-03-20T08:15:55Z

This paper studies the numerical approximation of evolution equations by nonlinear parametrizations $u(t)=Φ(\param(t))$ with time-dependent parameters $\param(t)$, which are to be determined in the computation. The motivation comes from approximations in quantum dynamics by multiple Gaussians and approximations of various dynamical problems by tensor networks and neural networks. In all these cases, the parametrization is typically irregular: the derivative $Φ'(\param)$ can have arbitrarily small singular values and may have varying rank. We derive approximation results for a regularized approach in the time-continuous case as well as in time-discretized cases. For the latter, there is a nontrivial interplay between the regularization parameter and the time stepsize, depending also on the defect size and local bounds of the second derivative of the parametrization map $Φ$. When this is appropriately taken into account, the approach can be successfully applied in irregular situations, even though it runs counter to the basic principle in numerical analysis to avoid solving ill-posed subproblems when aiming for a stable algorithm. The paper also includes two theoretical case studies: regularized parametric steepest descent for optimization and regularized parametric Strang splitting for the time-dependent Schrödinger equation. Numerical experiments with sums of Gaussians for approximating quantum dynamics and with neural networks for approximating the flow map of a system of ordinary differential equations illustrate and complement the theoretical results.

Local convergence behavior of extended local optimal block preconditioned conjugate gradient method for computing eigenvalues of Hermitian matrices

2026-03-20T08:10:45Z

This paper provides a comprehensive and detailed analysis of the local convergence behavior of an extended variation of the locally optimal preconditioned conjugate gradient method (LOBPCG) for computing the extreme eigenvalue of a Hermitian matrix. The convergence rates derived in this work are either obtained for the first time or sharper than those previously established, including those in Ovtchinnikov's work ({\em SIAM J. Numer. Anal.}, 46(5):2567--2592, 2008). The study also extends to generalized problems, including Hermitian matrix polynomials that admit an extended form of the Rayleigh quotient. The new approach used to obtain these rates may also serve as a valuable tool for the convergence analysis of other gradient-type optimization methods.

Stabilization of BiCGSTAB by the generalized residual cutting method

2026-03-20T07:28:59Z

The residual cutting (RC) method has been proposed as an outer-inner loop iteration for efficiently solving large and sparse linear systems of equations arising in solving numerically problems of elliptic partial differential equations. Then based on RC the generalized residual cutting (GRC) method has been introduced, which can be applied to more general sparse linear systems problems. In this paper, we show that GRC can stabilize the BiCGSTAB, which is also an iterative algorithm for solving large, sparse, and nonsymmetric linear systems, and widely used in scientific computing and engineering simulations, due to its robustness. BiCGSTAB converges faster and more smoothly than the original BiCG method, by reducing irregular convergence behavior by stabilizing residuals. However, it sometimes fails to converge due to stagnation or breakdown. We attempt to emphasize its robustness by further stabililizing it by GRC, avoiding such failures.

Enhancing Future Prediction of Linear and Nonlinear Reduced-Order Models for Transport-Dominated Problems Using Lagrangian Data

2026-03-20T07:13:15Z

Designing effective reduced-order models (ROMs) for parametrized transport-dominated problems remains challenging because of the well-known Kolmogorov barrier. Autoencoder-based nonlinear ROMs have been developed to improve the compression ability for such systems. However, despite their stronger compression ability, autoencoder-based ROMs constructed in the Eulerian frame may fail to accurately predict future solutions, due to the poor coherence between historical and future solutions in the Eulerian frame. In contrast, we show that representing transport-dominated dynamics in the Lagrangian frame can lead to a significantly faster decay of the Kolmogorov n-width and improve coherence between historical and future solutions. Building on these insights, we develop two non-intrusive ROMs leveraging Lagrangian data: a Lagrangian autoencoder-based ROM and a Lagrangian parametric dynamic mode decomposition. Numerical experiments demonstrate that these Lagrangian ROMs achieve more accurate and stable future predictions than their Eulerian counterparts.

On-the-Fly ROM-Based Acceleration of SI-DSA for Implicit Time Marching of the Radiative Transfer Equation

2026-03-20T05:14:04Z

In implicit time marching of the radiative transfer equation (RTE), the resulting linear systems are commonly solved using source iteration with diffusion synthetic acceleration (SI-DSA). Despite its widespread success, the performance of the DSA preconditioner may deteriorate when the RTE cannot be well approximated by its diffusion limit. Moreover, classical SI-DSA does not exploit low-rank structures of the solution manifold across time steps when the solution evolves smoothly. To address these limitations, we develop an on-the-fly reduced-order-model (ROM)-based acceleration for SI-DSA in implicit time marching of the RTE. Instead of relying on a diffusion approximation, the proposed approach constructs ROMs directly from the underlying kinetic formulation while exploiting low-rank structures in the temporal evolution of the solution. The method is fully offline-free and constructs ROMs to enhance both initial guesses and preconditioners on the fly during time marching. To handle streaming solution data, we design efficient and memory-lean ROM construction and adaptive update strategies based on dynamical mode decomposition, incremental low-rank singular value decomposition, and error indicators. Numerical experiments demonstrate that the proposed method consistently accelerates implicit time marching, delivering $1.4\times$ to $2.0\times$ speedup over classical SI-DSA while incurring only marginal overhead for ROM construction and updates.

An Adaptive Machine Learning Framework for Fluid Flow in Dual-Network Porous Media

2026-03-20T02:01:33Z

Porous materials -- natural or engineered -- often exhibit dual pore-network structures that govern processes such as mineral exploration and hydrocarbon recovery from tight shales. Double porosity/permeability (DPP) mathematical models describe incompressible fluid flow through two interacting pore networks with inter-network mass exchange. Despite significant advances in numerical methods, there remains a need for computational frameworks that enable rapid forecasting, data assimilation, and reliable inverse analysis. To address this, we present a physics-informed neural network (PINN) framework for forward and inverse modeling of DPP systems. The proposed approach encodes the governing equations in mixed form, along with boundary conditions, directly into the loss function, with adaptive weighting strategies to balance their contributions. Key features of the framework include adaptive weight tuning, dynamic collocation point selection, and the use of shared trunk neural architectures to efficiently capture the coupled behavior of the dual pore networks. It is inherently mesh-free, making it well-suited for complex geometries typical of porous media. It accurately captures discontinuities in solution fields across layered domains without introducing spurious oscillations commonly observed in classical finite element formulations. Importantly, the framework is well-suited for inverse analysis, enabling robust parameter identification in scenarios where key physical quantities -- such as the mass transfer coefficient in DPP models -- are difficult to measure directly. In addition, a systematic convergence analysis is provided to rigorously assess the stability, accuracy, and reliability of the method. The effectiveness and computational advantages of the approach are demonstrated through a series of representative numerical experiments.

A review of shape-morphing solutions and evolutional neural networks for spatiotemporal dynamics

2026-03-19T23:37:14Z

Shape-morphing solutions (SMS) refer to a class of approximate solutions of partial differential equations (PDEs) with the distinguishing feature that they depend nonlinearly on a set of time-dependent parameters. They generalize Galerkin truncations by allowing the basis (or trial functions) to evolve in time in order to adapt to the solution of the PDE. As such, SMS are particularly suitable for reduced-order modeling as well as high fidelity simulation of multiscale systems which exhibit localized time-dependent features, such as vortices, dispersive wave packets, and shocks. Furthermore, being mesh-free, SMS is scalable for solving PDEs in higher spatial dimensions. As a special case, SMS allows the approximation of the PDE's solution by a neural network whose weights and biases depend on time. Such neural networks are known as evolutional neural networks or neural Galerkin schemes. The evolution of SMS parameters is dictated by the SMS equation, a set of ordinary differential equations derived from the Dirac-Frenkel variational principle. Over the past five years, contributions to the theory and computation of SMS have been growing rapidly. Here, we survey these developments, showcase some applications of SMS, and highlight important open problems for future research. At the same time, this review is structured to serve as a tutorial for applied mathematicians, physicist, and engineers who wish to enter this field.