https://arxiv.org/api/pd3LbI/a+nQuxnyLnH15cJm4+Uc 2026-06-23T00:25:20Z 49870 555 15 http://arxiv.org/abs/2606.01622v1 2026-06-01T03:14:34Z

We propose the Alternating Learning-Based Collocation (ALBC) method for solving inverse elliptic problems. Our approach employs sinusoidal shallow networks as adaptive basis generators. By alternately updating the state variable and the unknown parameter, we decompose the original nonconvex joint optimization problem into a sequence of tractable linear subproblems. This strategy effectively overcomes the fixed-basis limitations of classical collocation methods while avoiding the slow convergence typically encountered in deep learning approaches. Theoretically, we establish stability estimates and prove the convergence of the proposed algorithm. Numerical experiments on five benchmark problems demonstrate the efficacy of ALBC, which consistently outperforms the standard collocation method in accuracy. Furthermore, it achieves performance comparable to or better than that of physics-informed neural networks at a substantially lower computational cost. Finally, the method remains robust under noise levels of up to twenty percent.

2026-06-01T03:14:34Z Zhizhong Kong Jerry Zhijian Yang Cheng Yuan http://arxiv.org/abs/2511.07438v3 2026-06-01T03:12:13Z

Cryo-electron microscopy (cryo-EM) is a powerful imaging technique for reconstructing three-dimensional molecular structures from noisy tomographic projection images of randomly oriented particles. We introduce a new data fusion framework, termed the method of double moments (MoDM), which reconstructs molecular structures from two instances of the second-order moment of projection images obtained under distinct orientation distributions: one uniform, the other non-uniform and unknown. We prove that these moments generically uniquely determine the underlying structure, up to a global rotation and reflection, and we develop a convex-relaxation-based algorithm that achieves accurate recovery using only second-order statistics. Our results demonstrate the advantage of collecting and modeling multiple datasets under different experimental conditions, illustrating that leveraging dataset diversity can substantially enhance reconstruction quality in computational imaging tasks.

2025-11-02T20:10:34Z Joe Kileel Oscar Mickelin Amit Singer Sheng Xu http://arxiv.org/abs/2606.01614v1 2026-06-01T03:02:26Z

In this paper, we introduce a new framework for designing stabilization-free virtual element methods (VEMs) based on an finite element interpolation-based strategy, where we can simultaneously eliminate the stabilization terms in the discretizations of diffusion and reaction terms. The core idea is to construct a computable, polynomial-preserving, and norm-equivalent interpolation operator from the virtual element space to a (local) finite element space. Leveraging the properties of this operator, we design two types of stabilization-free schemes. The first scheme requires the interpolation to preserve the polynomial consistency related to the bilinear forms, thereby maintaining both consistency and stability as in the standard VEM. The second scheme relaxes this consistency requirement. While it may not satisfy the standard polynomial consistency, the second scheme retains optimal convergence with simpler construction, fewer degrees of freedom and, more importantly, applicable to more complex problems such as those involving nonlinearities or variable coefficients. We construct concrete interpolation operators for both conforming and nonconforming virtual elements in two and three dimensions. These operators are then employed to realize stabilization-free schemes for conforming and nonconforming VEMs. Numerical experiments confirm the optimal convergence rates of the proposed methods. The presented framework can be extended to design stabilization-free schemes for other polytopal discretization methods, such as the hybrid high-order method and the weak Galerkin method.

2026-06-01T03:02:26Z Jikun Zhao Wenhao Zhu Bei Zhang Shipeng Mao http://arxiv.org/abs/2606.01596v1 2026-06-01T02:50:42Z

Learning chaotic dynamical systems from data requires more than short-term predictive accuracy: the learned model must preserve the attractor geometry and its invariant statistics. Trajectory (zero-order) and Jacobian (first-order) matching supervise the values and tangent structure of the vector field, but neither constrains how the field bends away from its tangent plane. A model can thus match values and tangents at the supervised states yet curve differently from the truth, remaining locally accurate while drifting toward spurious attractors and distorting long-time statistics. We show that enforcing second-order consistency mitigates these failures, but forming the full Hessian is prohibitive in high dimensions. We propose model-constrained randomized Jacobian matching, which compares the Jacobians of the true and learned vector fields at randomly perturbed inputs. A Taylor expansion shows that the expected randomized Jacobian loss decomposes into the nominal Jacobian mismatch plus a Hessian mismatch scaled by the noise variance, implicitly enforcing second-order consistency at $\mathcal{O}(d^2)$ cost without forming the $\mathcal{O}(d^3)$ Hessian tensor. Using only Jacobian evaluations, the method scales to high dimensions where explicit Hessian matching does not. Numerical experiments confirm that second-order methods are robust. For Lorenz~63, first-order methods produce catastrophic Lyapunov-exponent outliers under minimal temporal supervision, which second-order methods eliminate while recovering the correct attractor. For coupled Lorenz~96, an out-of-distribution forcing sweep separates the methods: all agree up to $F=16$, but beyond $F=18$ only second-order methods preserve the invariant measure and Lyapunov spectrum. On both systems, randomized Jacobian matching performs comparably to explicit Hessian matching at much lower cost.

2026-06-01T02:50:42Z 37 pages, 15 figures, 6 tables Shinhoo Kang Hai V. Nguyen Tan Bui-Thanh http://arxiv.org/abs/2506.17524v3 2026-06-01T02:23:42Z

We present a computational framework for simulating finite-dimensional ordinary differential equations by combining classical Koopman-Lie product formulas with coordinate-wise frozen subflows. The setting is model-known, since the vector field is assumed to be available, and no data-driven approximation of the Koopman operator is attempted. Under standard assumptions, the Koopman-Lie generator associated with the flow admits a coordinate decomposition into partial generators. This decomposition leads to elementary updates in which all but one state variable are frozen, and the resulting frozen scalar subproblems are evaluated either in closed form or by one-dimensional solves. Lie-Trotter, Strang, and higher-order exponential compositions are then converted into state-update algorithms for two- and three-dimensional systems, with the semigroup and product-formula theory used as background justification for the constructions. We also record the exponential-term counts produced by the recursive constructions used in the implementation. These counts are presented as implementation costs. Numerical experiments on the Lotka-Volterra, Van der Pol, and Lorenz systems compare the coordinate-wise splitting algorithms with high-accuracy RK45 reference solutions using root-mean-square errors and work-precision curves. The results illustrate the practical trade-off between splitting order, number of time steps, number of exponential factors, and runtime.

2025-06-21T00:24:15Z Arun Banjara Ibrahem AlJabea Theodore Papamarkou Frank Neubrander http://arxiv.org/abs/2606.01433v1 2026-05-31T20:09:29Z

For complex geometries, the coarse problem of geometric multigrid can be too large to be solved by a direct solver. Here, we report on the use of domain decomposition applied to the multigrid coarse problem. Additive overlapping Schwarz methods are domain decomposition methods for the iterative solution of partial differential equations whose numerical and parallel scalability can be improved by the addition of coarse levels. A successful coarse space for such methods, inspired by iterative substructuring, is the generalized Dryja--Smith--Widlund (GDSW) space. A monolithic two-level overlapping Schwarz preconditioner based on a GDSW coarse space has been introduced for the solution of saddle-point problems arising from incompressible fluid problems, and has subsequently been extended to a three-level method. In the present work, for the first time, we consider a monolithic four-level overlapping Schwarz preconditioner, obtained by applying the two-level monolithic GDSW construction recursively three times, so that the second- and third-level coarse problems are themselves treated by overlapping Schwarz and only the smallest fourth-level coarse problem is solved by a sparse direct method. Numerical results are presented for a three-dimensional incompressible stationary Stokes problem with a Carreau-type non-Newtonian viscosity model posed on the complex geometry of an extrusion die, on up to $4\,000$\,MPI ranks, comparing the four-level preconditioner with its two-level and three-level counterparts in both roles. This work is part of the StroemungsRaum project, funded by the German Bundesministerium für Forschung, Technologie und Raumfahrt (BMFTR, formerly BMBF) as part of the SCALEXA program on new methods and technologies for exascale computing.

2026-05-31T20:09:29Z GAMM 96th Annual Meeting Stephan Köhler Oliver Rheinbach http://arxiv.org/abs/2510.03745v2 2026-05-31T18:39:51Z

Low-discrepancy points are designed to efficiently fill the space in a uniform manner. This uniformity is highly advantageous in many problems in science and engineering, including in numerical integration, computer vision, machine perception, computer graphics, machine learning, and simulation. Whereas most previous low-discrepancy constructions rely on abstract algebra and number theory, Message-Passing Monte Carlo (MPMC) was recently introduced to exploit machine learning methods for generating point sets with lower discrepancy than previously possible. However, MPMC is limited to generating point sets and cannot be extended to low-discrepancy sequences (LDS), i.e., sequences of points in which every prefix has low discrepancy, a property essential for many applications. To address this limitation, we introduce Neural Low-Discrepancy Sequences (NeuroLDS), the first machine learning-based framework for generating finite LDS. Drawing inspiration from classical LDS, we train a neural network to map indices to points such that the resulting sequences exhibit minimal discrepancy across all prefixes. To this end, we deploy a two-stage learning process: supervised approximation of classical constructions followed by unsupervised fine-tuning to minimize prefix discrepancies. We demonstrate that NeuroLDS outperforms all previous LDS constructions by a significant margin with respect to discrepancy measures. Moreover, we demonstrate the effectiveness of NeuroLDS across diverse applications, including numerical integration, robot motion planning, and scientific machine learning. These results highlight the promise and broad significance of Neural Low-Discrepancy Sequences. Our code can be found at https://github.com/camail-official/neuro-lds.

2025-10-04T09:10:37Z ICML 2026 Michael Etienne Van Huffel Nathan Kirk Makram Chahine Daniela Rus T. Konstantin Rusch http://arxiv.org/abs/2606.01392v1 2026-05-31T18:33:00Z

Starting from Maxwell's and linear momentum balance equations, we derive a ferrofluid model using the generalized Onsager's principle. Guided by a discrete perturbation estimate, we design and analyze families of Galerkin schemes that converge to sufficiently regular solutions and derive error estimates. Finally, we numerically explore the model with our proposed method.

2026-05-31T18:33:00Z 25 pages, 3 figures Gonzalo A. Benavides Ricardo H. Nochetto Mansur Shakipov http://arxiv.org/abs/2606.01335v1 2026-05-31T16:38:43Z

We study the limitations of matrix-free algorithms that access a matrix $A$ only through forward matrix-vector products (matvecs) $x \mapsto Ax$, without access to the transpose $A^\top$ or its action. This setting arises naturally in operator learning, inverse problems, and matrix-free PDE solvers, where adjoint evaluations may be unavailable or prohibitively expensive. We show that the lack of transpose access creates severe and sometimes insurmountable theoretical barriers. For Krylov methods, we prove that the sequence of projected operator norms produced by Arnoldi iteration can follow any prescribed nondecreasing curve, showing that forward matvecs alone provide essentially no reliable information about the spectral norm. For several core problems, including least squares, norm estimation, column subset selection, and local maximum volume, we establish non-identifiability results; distinct matrices can generate identical forward-query transcripts while having fundamentally different solutions. We also prove quantitative lower bounds on the number of forward matvecs required for approximation tasks. In particular, any algorithm that computes a near-optimal rank-$k$ approximation must use at least $n$ queries, and estimating the Frobenius norm to relative accuracy $\eps$ requires $Ω(\eps^{-2})$ queries when $n$ is sufficiently large, matching the complexity of Hutchinson-type estimators up to constants. Although some problems remain solvable without transpose access, the transpose-free setting is fundamentally more limited in both identifiability and efficiency.

2026-05-31T16:38:43Z Diana Halikias Michiel E. Hochstenbach Alex Townsend http://arxiv.org/abs/2509.02107v2 2026-05-31T15:56:13Z

We develop high-order numerical schemes to solve random hyperbolic conservation laws using linear programming. The proposed schemes are high-order extensions of the existing first-order scheme introduced in [{\sc S. Chu, M. Herty, M. Lukáčová-Medvi{\softd}ová, and Y. Zhou}, SIAM J. Sci. Comput., 48 (2026)], where a novel structure-preserving numerical method using a concept of generalized, measure-valued solutions to solve random hyperbolic systems of conservation laws is proposed, yielding a linear partial differential equation concerning the Young measure and allowing the computation of approximations based on linear programming problems. The second-order extension is obtained using piecewise linear reconstructions of the one-sided point values of the unknowns. The fifth-order scheme is developed using the finite-difference alternative weighted essentially non-oscillatory (A-WENO) framework. These extensions significantly improve the resolution of discontinuities, as demonstrated by a series of numerical experiments on both random (Burgers equation, isentropic Euler equations) and deterministic (discontinuous flux, pressureless gas dynamics, Burgers equation with non-atomic support) hyperbolic conservation laws.

2025-09-02T09:04:28Z Shaoshuai Chu Michael Herty http://arxiv.org/abs/2606.01303v1 2026-05-31T15:47:57Z

We develop a multicontinuum Generalized Multiscale Finite Element Method (MC-GMsFEM) for constructing coarse-scale models in heterogeneous media that simultaneously provide accurate numerical approximations and physically consistent macroscopic equations. Classical multiscale methods efficiently approximate fine-scale solutions on coarse grids using localized basis functions, but they do not offer a systematic pathway for deriving macroscopic governing equations. To overcome this limitation, we introduce a unified framework that integrates multiscale finite element constructions with multicontinuum representations. The proposed method builds on the structure of GMsFEM and exploits a representation of multiscale basis functions that separates coarse variables and their gradients. We construct continuum-dependent basis functions using auxiliary fields defined through local problems with integral constraints, ensuring that each basis function is associated with a specific continuum. This leads to a decomposition of the coarse-scale solution into continuum variables and their gradients, establishing a direct connection between multiscale discretizations and multicontinuum homogenization. Compared to existing multicontinuum approaches, the proposed framework provides greater flexibility in handling heterogeneous media with spatially varying numbers of continua and is naturally embedded within a standard finite element setting. This enables both systematic derivation of macroscopic equations and straightforward numerical implementation. We apply the proposed method to the upscaling of two-phase immiscible flow in heterogeneous porous media, where multiple interacting continua, including mobile and trapped phases, arise. With the proposed approaches, we derive new macroscopic models and show that if classical models are used, the errors can be large.

2026-05-31T15:47:57Z Mohammed Al Kobaisi Dmitry Ammosov Yalchin Efendiev Wing Tat Leung http://arxiv.org/abs/2606.01244v1 2026-05-31T13:53:17Z

We study operator learning using encoder--decoder neural networks. Inspired by the function-space theory of neural networks, we introduce a variation space as an infinite-dimensional structural class for nonlinear operators. This space is defined through vector-valued measures directly on the input and output spaces. For operators in this space, we establish approximation bounds for encoder--decoder two-layer networks in the Bochner $L^q$ norm. The resulting error bound decomposes into the input encoding error, the output encoding error, and a finite-width approximation term of order $N^{-1/2}$, with a constant independent of the input and output encoding dimensions. When the input and output encoding errors decay polynomially in the encoding dimensions, these estimates yield algebraic approximation and learning rates. The results provide an theoretical guarantees for efficient neural operator learning beyond general Lipschitz or Fréchet differentiable operator classes.

2026-05-31T13:53:17Z 14 pages Jia-Qi Yang Lei Shi http://arxiv.org/abs/2605.26310v2 2026-05-31T13:48:28Z

The detection of unmanned aerial vehicles (UAVs) is important for the protection of civilian and military infrastructure. In this paper we propose a cost effective UAV detection system using sound signals obtained from microphones. The recorded signals are passed through a signal processing pipeline which employs interpretable adaptive feature extractors using so-called rational Gaussian wavelets. These adaptive wavelet transformations are embedded into and trained together with an underlying small neural network which detects and classifies UAVs based on the obtained features. This leads to a physically interpretable machine learning algorithm that in addition to classifying UAVs is also capable of detecting UAV swarms. We demonstrate our results using data collected in indoor studio and noisy outdoor environments. We conclude that the proposed method outperforms traditional machine learning approaches for detecting and classifying single UAVs as well as drone swarms, while retaining a high degree of interpretability. Our implementation of the proposed methods is made publicly available for reproducibility.

2026-05-25T20:04:47Z 19 pages, 4 figures Ungvári Gergő Ferenc Braun Attila Ámon Péter Kackstädter János Volk Péter Kovács Tamás Dózsa http://arxiv.org/abs/2606.01232v1 2026-05-31T13:29:29Z

We study randomized stationary methods for symmetric positive definite linear systems in which component $j$ is selected with probability proportional to $|r_j|^\ell$. This power-weighted family interpolates continuously between uniform randomized Jacobi as $\ell \to 0$ and Gauss--Southwell greedy relaxation as $\ell \to \infty$. For the central case $\ell = 2$, we sharpen the standard one-step convergence analysis using the inverse participation ratio (IPR) $ν^2(r) = n\|r\|_4^4/\|r\|_2^4$, which equals $1$ when the residual is uniform and grows toward $n$ as it concentrates. The resulting bound amplifies the expected per-step progress by exactly $ν^2$ over the uniform-sampling baseline. The IPR can be computed online at $O(n)$ cost and doubles as a per-iteration diagnostic. We extend the analysis to asynchronous power-weighted Jacobi via the Avron--Druinsky--Gupta framework, obtaining an epoch-based convergence theorem in which the IPR controls both the progress coefficient and the allowed-delay window. Numerical experiments on shared-memory hardware support the sharpened bound and show the IPR trajectory is essentially concurrency-insensitive. Unexpectedly, consistent-reads execution, the easier case for the ADG analysis, destabilizes power-weighted sampling at high concurrency while inconsistent reads remain stable; the same IPR that amplifies progress amplifies a thread-collision rate that inconsistent reads appear to absorb. We propose a feedback-damping mechanism and verify two predictions about its dependence on problem size.

2026-05-31T13:29:29Z Evan Coleman http://arxiv.org/abs/2512.11598v3 2026-05-31T13:19:30Z

We present a numerical method for simulating rarefied gases that interact with moving boundaries and rigid bodies. The gas is described by the BGK equation in Lagrangian form and solved using an Arbitrary Lagrangian-Eulerian method, in which grid points move with the local mean velocity of the gas. The main advantage of the moving grid is that the algorithm can deal well with cases where the domain boundaries are time-dependent and the simulation domain contains rigid objects. Due to the irregular nature of the grid, we use a novel meshless MUSCL-like Moving Least Squares Method (MLS) for spatial discretisation coupled with a higher-order Implicit-Explicit Runge-Kutta method. To avoid spurious oscillations at discontinuities, we use the so-called Multi-dimensional Optimal Order Detection (MOOD) method with an adapted criterion to relax the discrete maximum property. Finally, we employ a new implementation of the boundary conditions that requires no iterative or extrapolation procedure. The method achieves fourth-order in 1D and second-order in 2D for simulations with moving boundaries. We demonstrate the method's effectiveness on classical test cases such as the driven square cavity, shear layer, and shock tube.

2025-12-12T14:34:20Z Klaas Willems Axel Klar Giovanni Russo Giovanni Samaey Sudarshan Tiwari