https://arxiv.org/api/U4P0AgGXmgOjZOcsmnxkc0dyAyU 2026-06-22T20:03:02Z 49870 495 15 http://arxiv.org/abs/2505.03057v2 2026-06-02T18:06:52Z

This paper addresses the $\mathcal{H}_2$-optimal approximation of linear dynamical systems with quadratic-output functions, also known as linear quadratic-output systems. Our major contributions are threefold. First, we derive interpolatory first-order optimality conditions for the linear quadratic-output $\mathcal{H}_2$ minimization problem. These conditions correspond to the mixed-multipoint tangential interpolation of the full-order linear- and quadratic-output transfer functions, and generalize the Meier-Luenberger optimality framework for the $\mathcal{H}_2$-optimal model reduction of linear time-invariant systems. Second, given the optimal interpolation data, we show how to enforce the interpolatory optimality conditions explicitly by Petrov-Galerkin projection of the full-order model. Third, to find the optimal interpolation data, we build on this projection framework and propose a generalization of the iterative rational Krylov algorithm for the $\mathcal{H}_2$-optimal model reduction of linear quadratic-output systems, called LQO-IRKA. Upon convergence, LQO-IRKA produces reduced linear quadratic-output systems that satisfy the interpolatory optimality conditions. The method only requires solving shifted linear systems and matrix-vector products, thus making it suitable for large-scale problems. Numerical examples are included to illustrate the effectiveness of the proposed method.

2025-05-05T22:39:27Z Sean Reiter Ion Victor Gosea Igor Pontes Duff Serkan Gugercin http://arxiv.org/abs/2312.08472v2 2026-06-02T18:00:02Z

Transcendental functions, such as the exponential, are central to scientific computing, yet they cannot be natively calculated by digital hardware. Instead, computers must approximate these functions by combining basic operations, such as $\{+, -, \times, ÷\}$, using methods like Taylor series. These methods were developed over centuries by mathematicians, who focused on approaches that could attain arbitrary accuracy. However, computers can handle most applications by using only finite-precision types, like float32, where any accuracy beyond the type's precision is effectively discarded. We explore, therefore, whether forgoing arbitrary accuracy can lead to the discovery of more efficient approximations. The evolutionary method of symbolic regression is particularly suitable, as it can search for arbitrary operation combinations and can optimize non-differentiable objectives, such as the number of operations used. Our results show that evolution can discover computer programs that outperform established methods in this setting, despite having no prior mathematical knowledge beyond the calculation of the basic operations. Starting from empty code, symbolic regression constructs programs representing novel mathematical expressions. In particular, we discovered a 10-operation program that approximates the exponential function to 14 significant figures, exceeding the accuracy of previously known approximations of this size by more than 6 orders of magnitude.

2023-12-13T19:17:43Z v2: Accepted to the International Conference on Machine Learning (ICML 2026); added results, clarified framing, and added proofs Esteban Real Mirko Rossini Connal de Souza Manav Garg Moritz Firsching Quoc V. Le Yao Chen Akhil Verghese Ekin Dogus Cubuk David H. Park http://arxiv.org/abs/2405.05951v2 2026-06-02T17:24:10Z

In this work, we consider the $H_2$ optimal model reduction of dynamical systems that are linear in the state equation and up to quadratic nonlinearity in the output equation. As our primary theoretical contributions, we derive gradients of the squared $H_2$ system error with respect to the reduced model quantities and, from the stationary points of these gradients, introduce Gramian-based first-order necessary conditions for the $H_2$ optimal approximation of a linear quadratic output (LQO) system. The resulting $H_2$ optimality framework neatly generalizes the analogous Gramian-based optimality framework for purely linear systems. Computationally, we show how to enforce the necessary optimality conditions using Petrov-Galerkin projection; the corresponding projection matrices are obtained from a pair of Sylvester equations. Based on this result, we propose an iteratively corrected algorithm for the $H_2$ model reduction of LQO systems, which we refer to as LQO-TSIA (linear quadratic output two-sided iteration algorithm). Numerical examples are included to illustrate the effectiveness of the proposed computational method against other existing approaches.

2024-05-09T17:44:25Z 21 pages, 3 figures IEEE Transactions on Automatic Control 71 (5), 3168 - 3183, 2026 Sean Reiter Igor Pontes Duff Ion Victor Gosea Serkan Gugercin 10.1109/TAC.2025.3636441 http://arxiv.org/abs/2606.03855v1 2026-06-02T16:31:33Z

We present new short exponential sum approximations of length $N$ for $f_1(x)=\frac{1}{a+x}$ with $a>0$ on $[0, \infty)$ and for $f_2(x)= {\mathrm e}^{-x^2/2σ}$ with $σ>0$ on ${\mathbb R}$ with geometric error decay $ρ^{-2N}$ for user-defined $N \ge 2$ and $ρ>1$. The approximations are built over consecutive intervals $[b_j, \, b_{j+1}) \subset [0, \infty)$, $j \in {\mathbb N}_{0}$, with interval lengths that depend on $ρ$ and grow exponentially for $f_1$ and are equidistant for $f_2$. All parameters determining the exponential sum approximations on $[b_j, \, b_{j+1})$ are easily computed from the initial parameters on $[b_0, \, b_{1})$, ensuring numerical stability. Our method is based on Gauss-Laguerre and Gauss-Hermite quadrature, respectively, applied to suitable parametric integral representations of $f_1$ and $f_2$. This technique ensures consistent relative errors across all intervals. Using the obtained exponential sum approximations, we achieve highly accurate approximations of $\log(x)$ on $[1,\infty)$ and of the error function $\mathrm{erf}(x)$ with predictable geometric error decay. Numerical examples for $N=8$ and $N=10$ clearly illustrate the theoretical error estimates.

2026-06-02T16:31:33Z 25 pages Gerlind Plonka Yannick Riebe Annie Cuyt http://arxiv.org/abs/2606.03845v1 2026-06-02T16:24:29Z

We present and analyze an embedded Trefftz discontinuous Galerkin method for reaction-diffusion problems on anisotropic meshes. The method is constructed by imposing a relaxed local Trefftz condition via an embedding into a tensor-product DG space, yielding a reduced global system while preserving the approximation properties of the underlying high-order discretization. We prove stability and quasi-optimality on anisotropic, possibly curved, quadrilateral elements, and derive anisotropic a priori error estimates. Numerical experiments for $h$- and $hp$-refinement, including curved-domain examples, validate the theoretical results.

2026-06-02T16:24:29Z 22 pages, 6 figures, 1 table Sergio Gómez Chiara Perinati Paul Stocker Igor Voulis http://arxiv.org/abs/2606.03833v1 2026-06-02T16:17:18Z

It is well-known that the midpoint rule preserves the dissipation inequality if applied to a certain class of energy-based models. We introduce an appropriate scaling of the state variables such that the symmetric part of the resulting iteration matrix is guaranteed to be positive definite. This allows the application of three-term iteration schemes such as the methods of Widlund and Rapoport. Special emphasis is put on examples where the symmetric part is block diagonal such that the computations decouple. This then leads to efficient dissipation-preserving numerical schemes as illustrated in two numerical examples, namely the biharmonic heat equation and linear poroelasticity.

2026-06-02T16:17:18Z R. Altmann J. Ramme P. Schulze http://arxiv.org/abs/2506.11518v2 2026-06-02T14:55:47Z

We propose transformed Diffsuion-Wave fractional Physics-Informed Neural Networks (tDWfPINNs) for efficiently solving time-fractional diffusion-wave equations with fractional order $α\in(1,2)$. Conventional numerical methods for these equations often compromise the mesh-free advantage of Physics-Informed Neural Networks (PINNs) or impose high computational costs when computing fractional derivatives. The proposed method avoids first-order derivative calculations at quadrature points by introducing an integrand transformation technique, significantly reducing computational costs associated with fractional derivative evaluation while preserving accuracy. We conduct a comprehensive comparative analysis applying this integrand transformation in conjunction with both Monte Carlo integration and Gauss-Jacobi quadrature schemes across various time-fractional PDEs. Our results demonstrate that tDWfPINNs achieve superior computational efficiency without sacrificing accuracy. Furthermore, we incorporate the proposed approach into adaptive sampling approaches such as the residual-based adaptive distribution (RAD) for the time-fractional Burgers equation with order $α\in(1,2)$, which exhibits complex solution dynamics. The experiments show that the Gauss-Jacobi method typically outperforms the Monte Carlo approach; however, careful consideration is required when selecting the number of quadrature points. Overall, the proposed tDWfPINNs offer a significant advancement in the numerical solution of time-fractional diffusion-wave equations, providing an accurate and scalable mesh-free alternative for challenging fractional models.

2025-06-13T07:21:49Z Jing Li Zhengqi Zhang http://arxiv.org/abs/2606.03651v1 2026-06-02T13:42:40Z

This paper presents a novel application of Jet Transport, a high-order automatic differentiation technique, to enhance classical numerical methods, with a focus on Newton's method. We prove a central theorem establishing that, under appropriate conditions, applying Jet Transport within a Newton iteration doubles the number of correct coefficients in the Taylor series approximation of the solution. This theoretical result is then extended to the practical case where the exact solution is unknown, demonstrating the expected quadratic convergence (error reduction from \( \varepsilon \) to \( \varepsilon^2 \)) while simultaneously doubling the order of accuracy in the series expansion. The efficacy of the resulting Jet-Newton method is demonstrated through three illustrative examples: an academic problem validating the theoretical convergence rates, the solution of Kepler's equation, and a new continuation algorithm for computing zero-velocity curves in the circular restricted three-body problem. These examples showcase the method's capability to provide high-order semi-analytical approximations.

2026-06-02T13:42:40Z 21 pages, 9 figures. submitted to Mathematics and Computers in Simulation Jordi Canela Daniel Pérez-Palau http://arxiv.org/abs/2601.10222v2 2026-06-02T13:23:42Z

Optimization is central to both modern machine learning (ML) and scientific machine learning (SciML), yet the structure of the underlying optimization problems differs substantially across these domains. Classical ML typically relies on stochastic, sample-separable objectives that favor first-order and adaptive gradient methods. In contrast, SciML often involves physics-informed or operator-constrained formulations in which differential operators induce global coupling, stiffness, and strong anisotropy in the loss landscape. As a result, optimization behavior in SciML is governed by the spectral properties of the underlying physical models rather than by data statistics, frequently limiting the effectiveness of standard stochastic methods and motivating deterministic or curvature-aware approaches. This document provides a unified introduction to optimization methods in ML and SciML, emphasizing how problem structure shapes algorithmic choices. We review first- and second-order optimization techniques in both deterministic and stochastic settings, discuss their adaptation to physics-constrained and data-driven SciML models, and illustrate practical strategies through tutorial examples, while highlighting open research directions at the interface of scientific computing and scientific machine learning.

2026-01-15T09:36:15Z Alena Kopaničáková Elisa Riccietti http://arxiv.org/abs/2606.03607v1 2026-06-02T13:10:56Z

We develop a hierarchical multi-fidelity (MF) framework for efficient uncertainty quantification of porous-medium equation (PME) tumor growth models with moving free boundaries. The proposed approach combines coarse-grid PME solvers, level-set approximations of the Hele--Shaw limit, and fine-grid asymptotic-preserving PME discretizations, thereby integrating both discretization-based and asymptotic-model-based fidelity reduction. To guide the selection of high-fidelity samples, we introduce a residual-based farthest-point sampling (RFPS) criterion that combines projection residual information with a distance-based separation term in the low-fidelity snapshot space. Based on this criterion, we construct both bi-fidelity and tri-fidelity approximations, together with empirical error indicators for adaptive refinement. Numerical experiments are conducted in both bi-fidelity and tri-fidelity settings under several uncertainty scenarios, showing that the proposed multi-fidelity approximations achieve accurate results with reduced high-fidelity sampling cost in the reported tests.

2026-06-02T13:10:56Z Huimin Yu Liu Liu Yu Feng Te Qi http://arxiv.org/abs/2602.06842v2 2026-06-02T13:05:51Z

Deep learning-based hybrid iterative methods (DL-HIMs) integrate classical numerical solvers with neural operators, utilizing their complementary spectral biases to accelerate convergence. Despite this promise, many DL-HIMs stagnate at false fixed points where neural updates vanish while the physical residual remains large, raising questions about reliability in scientific computing. In this paper, we provide evidence that performance is highly sensitive to training paradigms and update strategies, even when the neural architecture is fixed. Through a detailed study of a DeepONet-based hybrid iterative numerical transferable solver (HINTS) and an FFT-based Fourier neural solver (FNS), we show that significant physical residuals can persist when training objectives are not aligned with solver dynamics and problem physics. We further examine Anderson acceleration (AA) and demonstrate that its classical form is ill-suited for nonlinear neural operators. To overcome this, we introduce physics-aware Anderson acceleration (PA-AA), which minimizes the physical residual rather than the fixed-point update. Numerical experiments confirm that PA-AA restores reliable convergence in substantially fewer iterations. These findings provide a concrete answer to ongoing controversies surrounding AI-based PDE solvers: reliability hinges not only on architectures but on physically informed training and iteration design.

2026-02-06T16:35:16Z Accepted manuscript version of an article accepted for publication in IEEE Computing in Science & Engineering. The final published version will be available through IEEE Xplore Yuhan Wu Jan Willem van Beek Victorita Dolean Alexander Heinlein http://arxiv.org/abs/2606.03599v1 2026-06-02T13:04:54Z

Band-structure calculations for three-dimensional anisotropic phononic crystals require the repeated solution of large elastic generalized eigenvalue problems along Bloch paths. In standard staggered-grid discretizations, anisotropic coupling may involve derivative components located at incompatible grid positions, so additional interpolation or averaging closures are often introduced. This paper proposes a parity-blocked rotated staggered discretization based on four Bloch-periodic body-diagonal differences. The directional derivatives are reconstructed from these diagonal differences, leading to a Hermitian $B_hC_hB_h^H$ generalized eigenvalue formulation that incorporates anisotropic derivative coupling without separate interpolation closures. On even grids, when the stiffness and mass matrices are nodewise local multiplication matrices, the body-diagonal shifts preserve two independent parity invariants. The discrete velocity space is then decomposed exactly into four mutually independent block subspaces, and the full discrete spectrum can be recovered by solving the four smaller eigenvalue problems and merging their spectra. The full and block formulations are further organized in a unified Fourier SVD framework, which supports $Γ$-point zero-mode treatment, shift-invert Krylov iteration, inner PCG solves, and GPU matrix-vector products. Numerical experiments for a three-dimensional two-phase anisotropic phononic crystal show that the block implementation preserves the full-space spectrum while substantially reducing the wall-clock time. The results demonstrate that the proposed method provides a structured and efficient solver for large-scale band-structure computations of three-dimensional anisotropic phononic crystals.

2026-06-02T13:04:54Z 32 pages, 7 figures Jingkai Zhang Xing-Long Lyu Tiexiang Li Wen-Wei Lin http://arxiv.org/abs/2606.03594v1 2026-06-02T12:59:19Z

This paper compares three different multirate splitting approaches for the application on field-circuit coupled magnetoquasistatic simulations. For these methods, again three different variants for exchanging values between the field and circuit are tested, namely voltages, currents and flux correction terms. All scenarios are applied on two different benchmark problems, i.e. a coil inductor and transformer model coupled to different circuits. The convergence behavior of different time steppers (Implicit Euler and Trapezoidal Rule) is determined for all possible settings, and guidelines for practical applications are derived.

2026-06-02T12:59:19Z Submitted to SCEE 2026 proceedings Michael Wiesheu Sebastian Schöps Idoia Cortes Garcia http://arxiv.org/abs/2412.07723v5 2026-06-02T12:46:50Z

Nested integration problems arise in various scientific and engineering applications, including Bayesian experimental design, financial risk assessment, and uncertainty quantification. These nested integrals take the form $\int f\left(\int g(\boldsymbol{y},\boldsymbol{x})\mathrm{d}\boldsymbol{x}\right)\mathrm{d}\boldsymbol{y}$, for nonlinear $f$, making them computationally challenging, particularly in high-dimensional settings. Although widely used for single integrals, traditional Monte Carlo (MC) methods can be inefficient when encountering complexities of nested integration. This work introduces a novel multilevel estimator, combining deterministic and randomized quasi-MC (rQMC) methods to handle nested integration problems efficiently. In this context, the inner number of samples and the discretization accuracy of the inner integrand evaluation constitute the level. We provide a comprehensive theoretical analysis of the estimator, deriving error bounds demonstrating significant reductions in bias and variance compared with standard methods. The proposed estimator is particularly effective in scenarios where the integrand is evaluated approximately, as it adapts to different levels of resolution without compromising precision. We verify the performance of our method via numerical experiments, focusing on estimating the expected information gain of experiments. When applied to Gaussian noise in the experiment, a truncation scheme ensures finite error bounds. The results reveal that the proposed multilevel rQMC estimator outperforms existing MC and rQMC approaches, offering a substantial reduction in computational costs and offering a powerful tool for practitioners dealing with complex, nested integration problems across various domains.

2024-12-10T18:16:25Z 45 pages, 10 figures Arved Bartuska André Gustavo Carlon Luis Espath Sebastian Krumscheid Raúl Tempone http://arxiv.org/abs/2605.14320v2 2026-06-02T11:52:50Z

We develop an adaptive-metric framework for norm-minimization-based outer approximation algorithms in bounded convex vector optimization. The key idea is to let the scalarization metric vary across iterations while measuring approximation error in a fixed Euclidean norm. This enables the algorithm to exploit problem geometry dynamically. Our approach rests on two theoretical foundations. First, we prove that the improved Euclidean convergence rate $O(k^{2/(1-q)})$ -- previously known only for the standard $\ell_2$-norm -- extends to all fixed inner-product norms. Second, we establish a dispersion theorem showing that the cut-normals generated by the algorithm naturally spread across all directions when the upper image has a strictly convex boundary with bounded curvature. This geometric condition guarantees that the adaptive metric remains well-conditioned throughout execution. Building on these results, we derive explicit convergence bounds that quantify how metric conditioning influences the Hausdorff error estimates. Numerical experiments on three test problems validate the theoretical convergence rate; on the problems whose Pareto fronts have sufficient curvature, the adaptive metric additionally reduces the iteration count relative to the fixed Euclidean norm. Our results provide a rigorous foundation for adaptive metric selection in convex vector optimization.

2026-05-14T03:32:59Z Revised Mohammed Alshahrani