https://arxiv.org/api/XMBGhH4FgREGfSCUUeQ6ytEjOR0 2026-09-11T00:21:59Z 3239 120 15 http://arxiv.org/abs/2606.24040v1 2026-06-23T00:53:14Z

MeMo proposes language models with explicit multi-layer correlation matrix memories (CMMs), where memorization, retrieval, and forgetting are architectural operations. This paper asks how such memories can reduce the need for retraining when knowledge changes. For changes expressible as MeMo memory associations, the model's accessible knowledge can be updated by editing explicit memories rather than retraining the whole model. We propose a version-aware operation layer in which high-level operations such as replace, obsolete, keep-history, rollback, and trace are compiled into MeMo-native primitive calls over sequences and tokens. The key observation is that a version-aware operation is rarely a single MeMo association. It is an ordered transaction of primitive edits, for example forgetting one sequence-token chain, memorizing another, preserving a historical chain, and recording an inverse program. The framework introduces two auxiliary CMMs: a Version CMM (V-CMM) for mapping version transitions to transaction handles, and a Transaction CMM (T-CMM) for storing reusable change contents and inverse programs. It supports both direct sequence-level edits and structured diff-level inputs, and outlines an evaluation route for update success, rollback, traceability, locality, and transaction reuse.

2026-06-23T00:53:14Z Accepted by MeMo Workshop on Mechanistic Interpretability & Neuro-symbolic Approaches by-design, Rome (Italy), 24/6/2026 Peiran Li http://arxiv.org/abs/2602.03289v2 2026-06-22T14:55:32Z

Continuing previous work, this paper focuses on the summability problem of multivariate rational functions in the mixed case in which both shift and $q$-shift operators can appear. Our summability criteria rely on three ingredients including orbital decompositions, Sato's isotropy groups, and difference transformations. This work settles the rational case of the long-term project aimed at developing algorithms for symbolic summation of multivariate functions.

2026-02-03T09:14:12Z 22 pages Shaoshi Chen Lixin Du Hanqian Fang Yisen Wang http://arxiv.org/abs/2606.23425v1 2026-06-22T14:46:16Z

Accurate electricity load forecasting is a crucial prerequisite for stable power system operations. While prevalent deep learning models present competitive performance, they often operate as black boxes and lack interpretability. While the Kolmogorov-Arnold network (KAN) has emerged as a promising alternative because of its learnable activation function design, its direct application to time-series forecasting faces challenges in modeling complex temporal data patterns. Also, simple integration into existing architectures, such as serving as replacement of neural modules, cannot fully leverage KAN's interpretability strengths. To address these gaps, this study develops LoadKAN, a novel hybrid and interpretable framework for load forecasting that synergistically combines a specifically-designed feature-isolated temporal attention mechanism with a KAN module. The attention stage aims to extract temporal dynamics from each input feature independently, such as historical load and human mobility, providing distilled feature representations to the KAN module for interpretable predictions. When evaluated on datasets from three representative U.S. electricity markets, our LoadKAN remains highly competitive when compared to extensively-tuned, state-of-the-art, black-box deep learning benchmarks. More importantly, LoadKAN's interpretability enables a granular analysis of the learned non-linear relationships between six distinct mobility patterns and electricity load. Through KAN-learned activation functions, our quantitative sensitivity analyses on mobility features reveal complex and market-specific dependencies. These findings further demonstrate the ability of our LoadKAN to generate insights often obscured by opaque black-box neural forecasting models.

2026-06-22T14:46:16Z Applied Energy, 2026 Jinhao Li Hao Wang 10.1016/j.apenergy.2026.128296 http://arxiv.org/abs/2606.23259v1 2026-06-22T12:43:25Z

In this paper, we present explicit formulas for the inverse and determinant in geometric (Clifford) algebras over vector spaces of dimension $n=7$. The derivation of these formulas is made possible by generalizing the concept of conjugation to basis conjugation operations. We further develop a general method for constructing such formulas over odd-dimensional spaces from the known even-dimensional case. To validate computational utility of the results, we provide a numerical implementation of the formulas. The code implementation is available at the repository github.com/kamranuz/clifford_7d. These formulas extend previous results for lower dimensions and offer new insights for applications in mathematical physics and computational geometry.

2026-06-22T12:43:25Z 21 pages K. S. Abdulkhaev D. S. Shirokov http://arxiv.org/abs/2606.23179v1 2026-06-22T11:17:09Z

The recently introduced EML (Exp-Minus-Log) function acts as continuous analogue of NAND gates, providing a compositional building block capable of representing elementary functions. In this work, we study the expressive power of tree-structured compositions of EML functions. We show that such trees enjoy a universal approximation property for functions in $W^{k, \infty}$ for $k \in \mathbb N$, drawing on classical neural network approximation arguments while exploiting the ability to explicitly construct EML trees that mimic polynomial representations. We further propose a learning algorithm for EML-type trees equipped with fitting parameters, and demonstrate its feasibility in practical optimization problems. Our results establish EML trees as a theoretically grounded framework for function approximation.

2026-06-22T11:17:09Z Joe Germany Elie Abdo Joseph Bakarji http://arxiv.org/abs/2501.08086v2 2026-06-22T11:04:26Z

Discovering governing equations from data remains challenging when the underlying dynamics involve nonlocal differential operators, field interactions governed by auxiliary equations, or temporal memory effects. We propose Neural Operator-based symbolic Model approximaTion and discOvery (NOMTO), a framework that extends Equation Learner-type symbolic architectures by incorporating pretrained neural operators as nodes in the symbolic network. NOMTO represents candidate equations as sparse differentiable computational graphs that combine algebraic operations with fixed neural operator surrogates pretrained to approximate nonlinear operators. We evaluate the method on model-discovery problems involving nonlocal spatial operators, couplings mediated by auxiliary field equations, and temporal integral terms representing memory effects. The results show that NOMTO can recover compact governing equations containing nonlocal operator terms, thereby extending symbolic model discovery beyond libraries restricted to local derivatives and point-wise algebraic combinations.

2025-01-14T12:55:48Z Sergei Garmaev Olga Fink http://arxiv.org/abs/2606.22851v1 2026-06-22T04:54:20Z

We describe several new algorithms for finding all prime numbers up to a given bound $N$, achieving the first ever speedup by a positive power of $\log N$ over the ancient sieve of Eratosthenes. The fastest version, which is not fully rigorous, runs in \[ N (\log \log N)^{1+o(1)} \] bit operations when analysed in the multitape Turing model. This improves on the best existing algorithms due to Pritchard (1981), Atkin--Bernstein (2004) and Sergeev (2016) by a factor of almost $\log N$. We also present a rigorous randomised (Las Vegas) variant that is slower by a factor of $(\log \log N)^{1+o(1)}$, and a rigorous deterministic variant that is slower by a factor of $(\log N)^{1/2+o(1)}$. The new algorithms make heavy use of fast polynomial arithmetic over finite fields, and also involve ideas from the theory of error-correcting codes.

2026-06-22T04:54:20Z 121 pages David Harvey http://arxiv.org/abs/2606.22694v1 2026-06-21T22:15:48Z

Vision-Language Models (VLMs) remain unreliable when spatial reasoning requires composing relations whose meanings depend on frames of reference. Existing neuro-symbolic methods make reasoning more explicit, but often depend on brittle geometric procedures and hard decisions over noisy perception. We propose SATURN, a neuro-symbolic framework for perspective-aware compositional spatial reasoning. SATURN reconstructs an approximate 3D scene, derives soft perspective-aware spatial predicates, and composes them with a training-free Pythonic symbolic executor, separating perception from reasoning while preserving uncertainty through multi-hop inference. We also introduce 3D FORCE, a diagnostic benchmark that controls reasoning depth, view, and perspective composition across spatial arrangement grounding (SAG) and referring expression grounding (REF). On 3D FORCE, VLMs and spatially trained models degrade sharply as depth and perspective complexity increase, whereas SATURN remains stable and outperforms strong baselines. On the real-world MindCube benchmark, SATURN achieves 78.57% overall accuracy, outperforming the strongest baseline by 14 pp.

2026-06-21T22:15:48Z Danial Kamali Tanawan Premsri Shreya Rajpal Amir Zadeh Chuan Li Parisa Kordjamshidi http://arxiv.org/abs/2505.20497v2 2026-06-20T17:20:51Z

Let $Ω$ be a finite set of finitary operation symbols. An $Ω$-expanded group is a group (written additively and called the additive group of the $Ω$-expanded group) with an $Ω$-algebra structure. We use the black-box model of computation in $Ω$-expanded groups. In this model, elements of a finite $Ω$-expanded group $H$ are represented (not necessarily uniquely) by bit strings of the same length, say, $n$. Given representations of elements of $H$, equality testing and the fundamental operations of $H$ are performed by an oracle. Assume that $H$ is distributive, i.e., all its fundamental operations associated with nonnullary operation symbols in $Ω$ are distributive over addition. Suppose $s=(s_1,\dots,s_m)$ is a generating system of $H$. In this paper, we present probabilistic polynomial-time black-box $Ω$-expanded group algorithms for the following problems: (i) given $(1^n,s)$, construct a generating system of the additive group of $H$, (ii) given $(1^n,s,(t_1,\dots,t_k))$ with $t_1,\dots,t_k\in H$, find a generating system of the additive group of the ideal in $H$ generated by $\{t_1,\dots,t_k\}$, and (iii) given $(1^n,s)$, decide whether $H\in\mathfrak V$, where $\mathfrak V$ is an arbitrary finitely based variety of distributive $Ω$-expanded groups with nilpotent additive groups. The error probability of these algorithms is exponentially small in $n$. In particular, this can be applied to groups, rings, $R$-modules, and $R$-algebras, where $R$ is a fixed finitely generated commutative associative ring with $1$. Rings and $R$-algebras may be here with or without $1$, where $1$ is considered as a nullary fundamental operation.

2025-05-26T19:59:22Z 16 pages. Published in the journal of Groups, Complexity, Cryptology journal of Groups, complexity, cryptology, Volume 18 Issue 2 (June 24, 2026) gcc:16903 Mikhail Anokhin 10.46298/jgcc.2026.18.2.16903 http://arxiv.org/abs/2606.21867v1 2026-06-20T04:10:02Z

Current evaluations of Large Language Models (LLMs) on logical fallacy detection focus on predicted labels, but do not establish whether those labels are supported by the reasoning the models provide. We propose ForEx (Formal Verification for Explainable Reasoning), a framework that translates LLM-generated explanations into Lean4 and verifies whether the translated rationale is derivable under encoded premises, not the logical validity of the original natural language argument. To distinguish prediction outcomes from the formal status of the supporting reasoning, we introduce the LLM Argument Verification Matrix, which separates label consistency from formal verification status. Experiments on LOGIC-Climate show that over 90% of LLM outputs can be translated into formal reasoning chains that pass verification, while agreement with human annotations remains around 20%. These results expose a systematic gap between formal derivability and label agreement, a distinction invisible to prediction-based metrics. ForEx moves LLM evaluation beyond label correctness toward machine-checkable analysis of formalized reasoning chains.

2026-06-20T04:10:02Z 2026 IEEE 27th International Conference on Information Reuse and Integration for Data Science Pei-Cing Huang Chienyu Liu Chan Hsu Ci-Siang Chen Pei-Ju Lee Yihuang Kang http://arxiv.org/abs/2606.20325v1 2026-06-18T15:03:42Z

Classical approximation theorems ask for a new neural network whenever the target accuracy is improved. This paper studies the opposite possibility: can the network be chosen once and for all, and can accuracy be bought only by letting it run longer? We prove that this is possible for every continuous function on [-1,1]. More precisely, each such function is uniformly approximated by the time evolution of a single ReLU recurrent neural network with fixed weights and fixed hidden dimension. The mechanism behind the construction is a new intermediate model, the Turing machine with neural units (TMNU). This model retains the algorithmic freedom needed to implement polynomial approximation schemes, while remaining rigid enough to be simulated by RNNs with explicit bounds on hidden dimension and weight magnitude. The resulting convergence rates reflect the underlying polynomial approximation rates. We complement the construction with minimax lower bounds showing that runtime is not merely a proof artifact, but an unavoidable resource in this fixed-network approximation paradigm.

2026-06-18T15:03:42Z Valentin Abadie Clemens Hutter Helmut Bölcskei http://arxiv.org/abs/2601.08522v2 2026-06-18T14:46:00Z

Linear differential equations and recurrences reveal many properties about their solutions. Therefore, these equations are well-suited for representing solutions and computing with special functions. We identify a large class of existing algorithms that compute such representations as a linear relation between the iterates of an elementary operator known as a \emph{pseudo-linear map}. Algorithms of this form have been designed and used for solving various computational problems, in different contexts, including effective closure properties for linear differential or recurrence equations, the computation of a differential equation satisfied by an algebraic function, and many others. We propose a unified approach for establishing precise degree bounds on the solutions of all these problems. This approach relies on a common structure shared by all the specific instances of the class. For each problem, the obtained bound is tight. It either improves or recovers the previous best known bound that was derived by ad hoc methods.

2026-01-13T13:05:06Z Louis Gaillard 10.1016/j.jsc.2026.102603 http://arxiv.org/abs/2406.02421v2 2026-06-17T21:50:44Z

Any continuous piecewise-linear function $F\colon \mathbb{R}^{n}\to \mathbb{R}$ can be represented as a linear combination of $\max$ functions of at most $n+1$ affine-linear functions. In our previous paper [``Representing piecewise linear functions by functions with small arity'', AAECC, 2023], we showed that this upper bound of $n+1$ arguments is tight. In the present paper, we extend this result by establishing a correspondence between the function $F$ and the minimal number of arguments that are needed in any such decomposition. We show that the tessellation of the input space $\mathbb{R}^{n}$ induced by the function $F$ has a direct connection to the number of arguments in the $\max$ functions.

2024-06-04T15:39:08Z Christoph Koutschan Anton Ponomarchuk Josef Schicho http://arxiv.org/abs/2505.23851v3 2026-06-17T17:18:26Z

Large language models (LLMs) are increasingly applied to symbolic mathematics, yet existing evaluations often conflate pattern memorization with genuine reasoning. To address this gap, we present ASyMOB, a high-resolution dataset of 35,368 validated symbolic math problems spanning integration, limits, differential equations, series, and hypergeometrics. Unlike prior benchmarks, ASyMOB systematically perturbs each seed problem using symbolic, numeric, and equivalence-preserving transformations, enabling a fine-grained assessment of generalization. Our evaluation reveals three key findings: (1) most models' performance collapses under minor perturbations, while top systems exhibit an apparent regime shift in robustness; (2) integrated code tools stabilize performance, particularly for weaker models; and (3) we identify examples where Computer Algebra Systems (CAS) fail while LLMs succeed, as well as problems solved only via a hybrid LLM-CAS approach, highlighting a promising integration frontier. ASyMOB serves as a principled diagnostic tool for measuring and accelerating progress toward building verifiable, trustworthy AI for scientific discovery.

2025-05-28T23:11:14Z Published in ICML2026: https://icml.cc/virtual/2026/poster/63549 Code repository: https://github.com/RamanujanMachine/ASyMOB Complete benchmark dataset: https://huggingface.co/datasets/Shalyt/ASyMOB-Algebraic_Symbolic_Mathematical_Operations_Benchmark Michael Shalyt Rotem Elimelech Ido Kaminer http://arxiv.org/abs/2508.21629v2 2026-06-15T18:39:55Z

Parametric linear systems are linear systems of equations in which some symbolic parameters, that is, symbols that are not considered to be candidates for elimination or solution in the course of analyzing the problem, appear in the coefficients of the system. In this paper we assume that the symbolic parameters appear polynomially in the coefficients and that the only variables to be solved for are those of the linear system. The consistency of the system and expression of the solutions may vary depending on the values of the parameters. It is well-known that it is possible to specify a covering set of regimes, each of which is a Zariski-constructible condition on the parameters together with a solution description valid under that condition. We provide a method of solution that requires time polynomial in the matrix dimension and the degrees of the polynomials when there are up to three parameters. We also discuss examples suggesting how the method may be useful beyond the formal three-parameter setting. In previous methods the number of regimes needed is exponential in the system dimension and polynomial degree of the parameters. Our approach exploits the Hermite and Smith normal forms that may be computed when the system coefficient domain is mapped to the univariate polynomial domain over suitably constructed fields. Our method identifies {intrinsic singularities} and {ramification points} where the algebraic and geometric structure of the matrix changes. Parametric eigenvalue problems are addressed as well.

2025-08-29T13:43:16Z Revised version submitted to a journal In: Boulier, F., England, M., Sadykov, T.M., Vorozhtsov, E.V. (eds) Computer Algebra in Scientific Computing. CASC 2020. Lecture Notes in Computer Science(), vol 12291. Springer, Cham Robert M. Corless Mark Giesbrecht Leili Rafiee Sevyeri B. David Saunders 10.1007/978-3-030-60026-6_11