https://arxiv.org/api/VJXfHvUX+AYpEUHLrmbePcVX75Q2026-06-22T15:49:59Z4987043515http://arxiv.org/abs/2606.04882v2Arbitrary high order shaped stencils for time domain finite difference schemes in seismic wave propagation2026-06-04T12:33:03ZFinite Difference Schemes are widely used in the approximation of different hyperbolic (wave-like) differential equations, and are particularly important for seismic wave modelling and its applications. Classical methods based on Taylor Series are dominant in the literature; however, it is known that these methods can suffer from excessive numerical dispersion. In this paper, we review and extend existing high-order in space finite difference schemes for acoustic wave propagation, featuring different stencil geometries ranging from classical cross stencils to stencils with rhombus or square-like shapes, and propose a general mathematical framework for their derivation. The numerical implementation is performed in a symbolic, high-level framework (Devito), which compiles and runs highly optimized, stencil-based computations, allowing for a low-level interpretation of the methods efficiency. We demonstrate that non-cross stencil shapes, such as rhombus and square-based stencils, do not necessarily provide added accuracy or dispersion reduction in general, despite their increased computational cost. However, results on both idealized and realistic velocity models confirm the benefits of using dispersion-optimized cross-stencils, indicating adequate accuracy with reduced computational cost on more compact stencils compared to classic approaches. Finally, our implementation of the methods provides ease of use for full-scale acoustic seismic inversion problems using Devito.2026-06-03T13:46:02Z61 pages; 31 figuresPedro S. PeixotoFelipe A. G. Silvahttp://arxiv.org/abs/2606.06093v1A tensor-train multidimensional inverse Laplace transform2026-06-04T12:30:01ZLaplace transforms and their numerical inverses arise throughout applied mathematics, physics, finance, and probability theory. Numerical inversion, however, quickly becomes intractable in high dimensions because the number of quadrature evaluations grows exponentially with dimension. We develop a tensor train (TT) formulation of the multidimensional inverse Laplace transform. The method constructs a TT approximation of the transformed function on the complex quadrature grid and then performs the inversion through a sequence of tensor contractions. Under suitable low-rank assumptions, this reduces the computational cost from exponential to polynomial in the dimension, provided that the relevant bond dimensions remain bounded. The method has only a small number of tunable parameters and admits error estimations. We demonstrate its performance in numerical experiments, benchmarked against Monte Carlo estimates and exact references, for multivariate normal-inverse Gaussian, Wishart, and correlated Gamma-type distributions.2026-06-04T12:30:01Z21 pages, 19 figuresMartin MikkelsenMichael Kastoryanohttp://arxiv.org/abs/2605.08318v2When Attention Beats Fourier: Multi-Scale Transformers for PDE Solving on Irregular Domains2026-06-04T12:22:50ZWe study the problem of \emph{architecture selection} for deep learning models trained to solve partial differential equations (PDEs), asking when transformer-based architectures with learned attention outperform Fourier-domain neural operators. We introduce the \textbf{Multi-Scale Attention Transformer} (\msat{}), a deep learning architecture that encodes spatiotemporal solution histories as token sequences and trains end-to-end via a composite supervised objective with optional physics-informed regularization terms. We conduct a comprehensive empirical evaluation against nine baselines -- including physics-informed neural networks (PINNs), neural operators (FNO, DeepONet, GNOT), and state-space models (Mamba-NO) -- across five benchmark problems from the PINNacle suite, using identical train/test splits and reference data for all methods. \msat{} achieves state-of-the-art generalization on complex geometry problems ($L^2_\mathrm{rel} = 0.0101$ on Heat2D-CG, a $3.7\times$ improvement over FNO) at $34\,\mathrm{s}$ total inference vs.\ $120{,}812\,\mathrm{s}$ for Mamba-NO. Ablation studies over the physics regularization component reveal a precise inductive bias tradeoff: physics priors reduce test error on diffusion-dominated problems but degrade generalization on chaotic and recirculating-flow regimes, directly characterizing the prior misspecification boundary. Approximation error bounds as a function of domain boundary complexity $κ$ provide a theoretical basis for these empirical findings and a principled rule for architecture selection.2026-05-08T15:23:13ZSubstantial Revision RequiredBrandon YeePairie KohJack RodriguezMihir Tekalhttp://arxiv.org/abs/2606.06071v1Weak order one convergence of structure-preserving stochastic theta methods for stochastic differential algebraic equations with time-dependent singular matrices2026-06-04T12:12:08ZThis paper studies the weak convergence order of structure-preserving stochastic theta methods for a class of index-$1$ stochastic differential algebraic equations with time-dependent singular matrices. The singular matrix is allowed to vary in time but preserves a fixed differential-algebraic splitting, thereby extending the constant singular-matrix setting while retaining the projector structure required for constraint preservation. By exploiting the index-$1$ algebraic-differential decomposition of the exact solution, we establish an abstract weak convergence theorem for constraint-preserving one-step approximations and apply it to the stochastic theta method with $θ\in (0,1]$. Under global Lipschitz, linear growth, and suitable smoothness assumptions, the considered method is proved to be well posed, to preserve the algebraic constraints at all time levels, and to converge with weak order one. Numerical experiments are finally presented to confirm the structure-preserving property and the theoretical convergence order.2026-06-04T12:12:08Z35 pages, 12 figuresCaiyuan ZhuZiheng ChenLin ChenYiwei Zhouhttp://arxiv.org/abs/2606.06057v1Residual-based Kaczmarz methods for tensor linear equations with t-product2026-06-04T11:57:39ZTensor linear systems widely arise from high-dimensional data mining and computing, for instance, natural language processing and machine learning. A class of residual-based tensor Kaczmarz method is proposed for tensor linear equations with t-product. Theoretical analyses prove the convergence and give an upper bound of the convergence rate of the proposed method. Furthermore, an accelerated residual-based Kaczmarz method with heavy ball momentum is developed. Numerical experiments verify the efficiency of the proposed methods and demonstrate that they are faster than the existing tensor Kaczmarz methods.2026-06-04T11:57:39Z16 pages, 13 figuresLi-Lin JiJuanjuan SunJun-Feng Yinhttp://arxiv.org/abs/2606.06046v1Learning solution operators of PDEs with sparse approximation methods2026-06-04T11:42:09ZWe investigate the approximation of solution operators for partial differential equations (PDEs) using sparse high-dimensional techniques. Building on a dimension-incremental framework, we combine product basis expansions with sparse recovery methods, specifically orthogonal matching pursuit (OMP), to substantially reduce the required sample size compared with a previously considered cubature-based approach. We evaluate the resulting method numerically on several examples, comparing it against both cubature-based sparse approximation and Fourier neural operators in terms of accuracy, runtime, and sample size. The experiments show that our approach considerably reduces the number of required PDE solves relative to its predecessor while maintaining competitive accuracy, particularly when the solution admits a sparse representation in the chosen basis. Furthermore, the recovered sparse index sets yield interpretable insights into the relevant variables and parameter interactions.2026-06-04T11:42:09ZSebastian NeumayerDaniel PottsFabian Tauberthttp://arxiv.org/abs/2502.19947v3Numerical analysis of a finite volume method for a 1-D wave equation with non smooth wave speed and localized Kelvin-Voigt damping2026-06-04T11:36:45ZIn this paper, we study the numerical solution of an elastic/viscoelastic wave equation with non smooth wave speed and internal localized distributed Kelvin-Voigt damping acting faraway from the boundary. Our method is based on the Finite Volume Method (FVM) and we are interested in deriving the stability estimates and the convergence of the numerical solution to the continuous one. Numerical experiments are performed to confirm the theoretical study on the decay rate of the solution to the null one when a localized damping acts.2025-02-27T10:15:44ZStéphane GerbiLAMARayan NasserBIUAli WehbeKALMAhttp://arxiv.org/abs/2504.09458v4The Whitney method of fundamental solutions with Lusin wavelets2026-06-04T11:32:53ZWe establish the theoretical foundation for a variant of the method of fundamental solutions (MFS), where the source points $\{q_j\}_{j=1}^\infty$ accumulate towards the domain in a Whitney fashion, meaning that their separation is proportional to the distance to the domain. We prove that the normalized Lusin wavelets $ψ_j(w) = b_j(w-q_j)^{-2}$ constitute a generalized basis, known as a frame, for the Hardy subspace of $L_2$-traces of holomorphic functions on the domain. Consequently, our method, where $ψ_j$ are used as basis functions in the MFS, enables a numerically stable approximation of solutions to Laplace boundary value problems, even when the solutions lack analytic continuation across the boundary. Despite the source points accumulating towards the domain, our computations achieve at least 12 digits of accuracy uniformly up to the boundary, including cases when the solution lacks analytic continuation or when the boundary has corners.2025-04-13T07:04:24Z47 pages, 8 figures. Updated format and extended numerical sectionJakob JonssonAndreas RosénEmil Timlinhttp://arxiv.org/abs/2504.20728v2Sharp lower error bounds for strong approximation of SDEs with a drift coefficient of Hölder or Sobolev regularity using a Weierstraß scale2026-06-04T11:18:09ZWe study strong approximation of solutions of SDEs with bounded $α$-Hölder continuous drift coefficient and constant diffusion coefficient at time point $1$. Recently, it was shown in [arXiv:1909.07961v4 (2021)] that for such SDEs the equidistant Euler scheme achieves an $L^p$-error rate of at least $(1+α)/2$, up to an arbitrary small $\varepsilon$, for all $p\geq 1$ and $α\in (0,1]$, in terms of the number of evaluations of the driving Brownian motion $W$. In this article, we prove a matching lower error bound for $α\in (0,1)$. More precisely, we show that for every $α\in (0,1)$, the $L^p$-error rate $(1+α)/2$ of the Euler scheme in [arXiv:1909.07961v4 (2021)] cannot be improved in general by any numerical method based on finitely many evaluations of $W$ in $[0,1]$. Up to now, this result was known only for $α=1$. Even stronger, an $L^p$-error rate better than $(1+α)/2$ cannot be achieved, even if algorithms additionally use a finite number of time integrals of $W$. Thus, Wagner-Platen type schemes are not superior to the Euler scheme.
Additionally, we extend a result from [arXiv:2402.13732v2 (2024)] on final time approximation of SDEs with a bounded drift coefficient of fractional Sobolev regularity $α\in (0,1)$. We prove that for every $α\in (0,1)$, the $L^p$-error rate $(1+ α)/2$ shown in [arXiv:2101.12185v2 (2022)] for the equidistant Euler scheme can essentially not be improved by any numerical method based on finitely many evaluations and time integrals of $W$ in $[0,1]$. This lower bound was known from [arXiv:2402.13732v2 (2024)] only for $α\in (1/2,1)$, $p=2$ and numerical methods based on finitely many evaluations of $W$.
For the proof of our results we use variants of the Weierstrass function as a drift coefficient and we extend the coupling of noise technique introduced in [arXiv:2010.00915v1 (2020)].2025-04-29T13:11:46ZExtension of the results to cover a larger class of algorithmsSimon EllingerThomas Müller-GronbachLarisa Yaroslavtsevahttp://arxiv.org/abs/2504.04509v2Truncated Huber Penalty for Sparse Signal Recovery with Convergence Analysis2026-06-04T10:47:30ZSparse signal recovery from under-determined systems presents significant challenges when using conventional L_0 and L_1 penalties, primarily due to computational complexity and estimation bias. This paper introduces a truncated Huber penalty, a non-convex metric that effectively bridges the gap between unbiased sparse recovery and differentiable optimization. The proposed penalty applies quadratic regularization to small entries while truncating large magnitudes, avoiding non-differentiable points at optima. Theoretical analysis demonstrates that, for an appropriately chosen threshold, any s-sparse solution recoverable via conventional penalties remains a local optimum under the truncated Huber function. This property allows the exact and robust recovery theories developed for other penalty regularization functions to be directly extended to the truncated Huber function. To solve the optimization problem, we develop a block coordinate descent (BCD) algorithm with finite-step convergence guarantees under spark conditions. Numerical experiments are conducted to validate the effectiveness and robustness of the proposed approach. Furthermore, we extend the truncated Huber-penalized model to the gradient domain, illustrating its applicability in signal denoising and image smoothing.2025-04-06T14:47:21ZPublished in SIAM J. Sci. Comput. 48 (2026), pp. A929-A957. Code available at https://github.com/yangli161029/TH-sparse-recoverySIAM J. Sci. Comput. 48 (2026), pp. A929-A957Li YangSerena MorigiMichael K. NgYou-wei Wen10.1137/25M1748184http://arxiv.org/abs/2403.09941v5Bicausal optimal transport for SDEs with irregular coefficients2026-06-04T10:23:05ZWe solve constrained optimal transport problems in which the marginal laws are given by the laws of solutions of stochastic differential equations (SDEs). We consider SDEs with irregular coefficients, making only minimal regularity assumptions. We show that the so-called synchronous coupling is optimal among bicausal couplings, that is couplings that respect the flow of information encoded in the stochastic processes. Our results provide a method to numerically compute the adapted Wasserstein distance between laws of SDEs with irregular coefficients. We show that this can be applied to quantifying model uncertainty in stochastic optimisation problems. Moreover, we introduce a transformation-based semi-implicit numerical scheme and establish the first strong convergence result for SDEs with exponentially growing and discontinuous drift.2024-03-15T00:51:28Z44 pages, 5 figuresMichaela HitzBenjamin A. Robinsonhttp://arxiv.org/abs/2606.05977v1Direct reconstruction for acoustic inverse Born scattering2026-06-04T10:18:10ZWe consider the inverse medium scattering problem for the Helmholtz equation in two dimensions, i.e., the task to recover a compactly supported penetrable two-dimensional scatterer from full knowledge of the associated far field data or, equivalently, the far field operator. Although this problem is uniquely solvable, it is severely ill-posed and nonlinear. In the regime of weak scattering, the Born approximation yields a linearized relation between the contrast and the far field data, thus overcoming the second difficulty. This linear setting allows to build on recent work on linearized electrical impedance tomography, which relies on triangular Zernike decompositions, to derive an explicit reconstruction formula that expresses the expansion coefficients of the contrast in terms of those of the far field data. By choosing the expansion functions appropriately, the resulting system matrix decouples into separate (infinite) triangular systems for the spatial angular frequencies in the contrast. Consequently, each of these systems can be solved independently by performing forward substitutions. Our numerical experiments indicate that this approach, combined with an adequate regularization method, remains effective even when applied to full nonlinear far field data beyond the Born regime.2026-06-04T10:18:10ZNuutti HyvönenLisa Schätzlehttp://arxiv.org/abs/2606.05926v1Auxiliary Gradient-Flow Solvers for Generalized Newtonian Models2026-06-04T09:29:05ZWe introduce an auxiliary gradient-flow framework for variational problems with generalized Newtonian structure governed by an N-function. The key idea is to replace the nonlinear constitutive dependence on the gradient, or symmetric gradient, by an auxiliary scalar variable representing its squared magnitude. This shifts the nonlinearity from the state equation to the auxiliary variable, yielding a sequence of uniformly elliptic weighted linear problems.
At the continuous level, we construct an auxiliary energy on a metric space adapted to the growth of the underlying N-function. In this topology, we prove lower semicontinuity, geodesic $λ$-convexity, and exponential convergence of the associated minimizing-movement scheme. At the finite element level, we derive a metric gradient flow through an explicit Riesz map, prove global well-posedness of the resulting semi-discrete ODE, and establish convergence to the finite element solution of the Euler--Lagrange equations of the generalized Newtonian energy. For the $p$-Laplacian and $p$-Stokes models, this gives a rigorous convergence result for $4/3\le p\le 4$, $p\ne2$, with asymptotic rate estimates beyond this range.
We also propose practical time discretizations, including an operator-splitting scheme that gives the \kac iteration as a special case, and an adaptive pseudo-transient method that can be implemented using scalable linear solvers. Numerical experiments for power-law, Carreau--Yasuda, regularized Bingham, and optimal-design models demonstrate robustness, mesh-independent iteration counts in the tested regimes, and performance that matches or outperforms Newton's method.2026-06-04T09:29:05ZStefano ZampiniDaniele BoffiGurt DovletovPeter Markowichhttp://arxiv.org/abs/2606.05879v1Convergence of a discrete-in-time Approximation to a Degenerate Parabolic-Hyperbolic System2026-06-04T08:52:35ZIn this paper we consider an implicit semi-discrete approximation of a degenerate reaction-cross-diffusion system. Due to the symmetry in the parabolic part, this system is known to preserve segregation of densities -- initially non-overlapping densities belonging to different species remain segregated for all times, which leads to internal layers between different species. We show that time-discrete approximations exist and converge to a weak solution, as the timestep goes to zero.2026-06-04T08:52:35ZJulia HauserHideki MurakawaMarkus Schmidtchenhttp://arxiv.org/abs/2606.05657v1Iterative Thresholding Pursuit with Continuation for $\ell_{1-2}$-Regularized Sparse Recovery2026-06-04T03:38:01ZSparse recovery aims to reconstruct sparse signals from underdetermined and possibly noisy linear measurements. Existing $\ell_{1-2}$ iterative thresholding schemes are first-order methods. We propose an iterative thresholding pursuit method with continuation (ITP-C) for $\ell_{1-2}$-regularized sparse recovery. The method goes beyond first-order thresholding by combining the active-set identification capability of the $\ell_{1-2}$ proximal step with a restricted least-squares pursuit step that provides a second-order update on the identified support. The support is generated adaptively by the thresholding update, and no prior knowledge of the true sparsity level is required. To control the possible instability of the pursuit step while preserving the descent structure of the continuation scheme, we impose a strict descent check with respect to the dynamic objective. We establish convergence of the generated sequence under the Kurdyka-Lojasiewicz framework and prove a local oracle-type property after correct support identification. Numerical experiments on synthetic sparse recovery and image reconstruction illustrate the descent preservation of the proposed safeguard and demonstrate the improved recovery performance of ITP-C over the state-of-the-art baselines.2026-06-04T03:38:01Z23 pages, 6 figures, 2 tablesJunxi WuZeyu DongJun-Feng Yin