https://arxiv.org/api/Do2ABz2YN+QBlym5ibBD5NBnUSg 2026-09-10T17:24:55Z 3239 15 15 http://arxiv.org/abs/2609.01102v1 Neural Symbollic Regression Using Deep Learning and Sparse Modelling 2026-09-01T11:46:28Z Symbolic Regression (SR) seeks to find succinct mathematical expressions that represent the fundamental relationships within data, providing interpretability and scientific understanding that exceeds that of black-box models. Nevertheless, traditional methods like Genetic Programming face challenges with scalability and are highly sensitive to noise, while sparse regression techniques such as SINDy rely significantly on predetermined feature libraries. In this work, we present a Neural Symbolic Regression (NSR) framework that treats neural networks as functional preconditioners for symbolic discovery. Our approach uses a decoupled pipeline: a neural network first learns a smooth, noise-robust approximation of the target function in an interaction- aware nonlinear feature space. LASSO is then applied to extract sparse, interpretable closed-form expressions. To improve predictive accuracy and symbolic fidelity by integrating distributed hyperparameter optimization with Ray Tune and ASHA scheduling. Experiments on the Nguyen benchmark suite show that our approach consistently outperforms SINDy and non-tuned neural baselines in RMSE, noise robustness, and out-of-distribution generalization. Ablation studies confirm the significance of feature interactions, neural depth, and tuning strategies. In general, this study presents a scalable and understandable neural-symbolic framework, creating a solid link between neural approximation and the discovery of sparse equations for scientific machine learning. 2026-09-01T11:46:28Z 11 pages, 5 tables, 5 figures, contains detailed mathematics behind the algorithm Ravi Kumar U Sumitra S http://arxiv.org/abs/2609.00824v1 The Indefinite Summation Problem for the Laurent Ring 2026-09-01T07:25:47Z This article solves the Indefinite Summation Problem (ISP) for the difference ring $(A, α)$, where $A$ is the Laurent ring of shift operators on the lattice $\Z^n$, and $α$ is any ring automorphism of $A$ of finite order. The solution translates to a finite procedure involving a matrix multiplication, where the size of the matrix can be estimated. It follows that the arithmetic complexity of the solution can also be determined. These results extend to a solution of the ISP for the ring of functions on $\Z^n$, on which $α$ acts by duality. The article points out that the solution to the ISP amounts to calculating the group cohomologies $H^i([α], A), i = 0, 1$, where $[α]$ is the cyclic group generated by $α$. 2026-09-01T07:25:47Z Shiva Shankar http://arxiv.org/abs/2609.00672v1 Deciding superellipticity and computing the Weierstrass normal form 2026-09-01T03:51:53Z Let \( \mathcal{S}_{g,n} \subset \mathcal{M}_g \) be the locus of curves of genus \( g \geq 2 \) admitting a model \( y^n = h(x) \) with \( h \) separable; such curves $C$ have a cyclic group \( C_n \leq \operatorname{Aut}(C) \) of order \( n \) with \( C/C_n \cong \mathbb{P}^1 \). % We give an algorithm which, given an absolutely irreducible plane model \( F(x,y) = 0 \) of a curve \( C \) over a field \( k_0 \) of characteristic zero, decides for which \( n \) the curve lies in \( \mathcal{S}_{g,n} \) and returns a model \( y^n = h(x) \) together with the birational transformation to it. 2026-09-01T03:51:53Z T. Shaska http://arxiv.org/abs/2602.17826v2 Ontology-Guided Neuro-Symbolic Inference: Grounding Language Models with Mathematical Domain Knowledge 2026-08-31T18:34:12Z Language models exhibit fundamental limitations -- hallucination, brittleness, and lack of formal grounding -- that are particularly problematic in high-stakes specialist fields requiring verifiable reasoning. I investigate whether formal domain ontologies can enhance language model reliability through retrieval-augmented generation. Using mathematics as proof of concept, I implement a neuro-symbolic pipeline leveraging the OpenMath ontology with hybrid retrieval and cross-encoder reranking to inject relevant definitions into model prompts. Evaluation on the MATH benchmark with three open-source models reveals that ontology-guided context improves performance when retrieval quality is high, but irrelevant context actively degrades it -- highlighting both the promise and challenges of neuro-symbolic approaches. 2026-02-19T20:45:16Z Supplementary materials and code: https://doi.org/10.5281/zenodo.18665030 Marcelo Labre http://arxiv.org/abs/2608.24620v2 Standard bases for shift-stable groups and Subgroup Membership in wreath products 2026-08-31T15:09:57Z We develop a notion of standard bases for subgroups of the restricted direct product $G^{(\mathbb{N}^n)}$ that are stable under translation by $\mathbb{N}^n$, where $G$ is an arbitrary finite group. We construct an algorithm that computes standard bases for such subgroups and use them to solve several algorithmic problems, including membership, saturation, and variable elimination. Our approach is inspired by Buchberger's algorithm and the theory of Gröbner bases for ideals in polynomial rings. Building on the standard bases and our solutions to the algorithmic problems above, we prove that Subgroup Membership is decidable in wreath products $G \wr \mathbb{Z}^n$ for finite $G$ and $n \in \mathbb{N}$. 2026-08-25T14:38:53Z added a consequence of Theorem 1.2, plus other minor changes Ruiwen Dong http://arxiv.org/abs/2608.29411v1 Where Induction Runs Out: Description-Length Difficulty and the Memorisation Gap in Integer-Sequence Benchmarks 2026-08-29T19:25:31Z Integer sequences from the On-Line Encyclopedia of Integer Sequences (OEIS) are increasingly used to benchmark mathematical reasoning in language models. We ask what such benchmarks actually measure, using an exactly computable reference learner: two-part minimum description length (MDL) over the class of P-recursive (holonomic) recurrences, evaluated on every prefix of a sequence as terms arrive. Three findings follow. First, MDL difficulty is a parameter count. The discovery point nd, the first prefix length at which a symbolic hypothesis beats verbatim storage, is predicted almost exactly by a combinatorial identifiability bound on the selected operator's order and degree. It is invariant to term magnitude: scaling Fibonacci over twelve orders of magnitude leaves nd unchanged, because a hypothesis must encode its own initial conditions and the magnitude cancels. Second, at scale the learner exhibits a regime our curated corpus could not produce even once: across 20,000 OEIS sequences, 89.98% of those that fit a recurrence on some prefix fit none at full length. We call this the wilderness -- induction acquires a theory, loses it, and never recovers. Third, evaluating three language models on sequences stratified by these MDL regimes refuted our pre-registered hypothesis: models do not confabulate where MDL reports no theory, but hedge appropriately. Confident errors are inverted, concentrating on the easy stratum, where apparent competence tracks recognition of the sequence rather than induction of its rule. OEIS-derived benchmarks therefore substantially measure memorisation, and MDL supplies a cheap, contamination-free difficulty signal they currently lack. Code and data are released. 2026-08-29T19:25:31Z 14 pages, 6 figures. Code and data: https://github.com/sabilashang/where-induction-runs-out. Archived: doi:10.5281/zenodo.21830331 Sabilashan Ganeshan http://arxiv.org/abs/2511.09703v3 Spectral and combinatorial methods for efficiently computing the rank of unambiguous finite automata 2026-08-29T15:48:15Z A zero-one matrix is a matrix with entries from $\{0, 1\}$. We study monoids containing only such matrices. A finite set of zero-one matrices generating such a monoid can be seen as the matrix representation of an unambiguous finite automaton, an important generalisation of deterministic finite automata which shares many of their good properties. Let $\mathcal{A}$ be a finite set of $n \times n$ zero-one matrices generating a monoid of zero-one matrices, and $m$ be the cardinality of $\mathcal{A}$. We study the computational complexity of computing the minimum rank of a matrix in the monoid generated by $\mathcal{A}$. By using linear-algebraic techniques, we show that this problem is in $\textsf{NC}$ and can be solved in $\mathcal{O}(mn^4)$ time and $\mathcal{O}(n^2)$ space. We also provide a combinatorial algorithm finding a matrix of minimum rank in $\mathcal{O}(mn^4)$ time and $\mathcal{O}(n^3)$ space. As a byproduct, we show a very weak version of a generalisation of the Černý conjecture: there always exists a straight line program of size $\mathcal{O}(n^2)$ describing a product resulting in a matrix of minimum rank. For the special case corresponding to total DFAs (that is, for the case where all matrices have exactly one 1 in each row), the minimum rank is the size of the smallest image of the set of all states under the action of a word. Our combinatorial algorithm finds a matrix of minimum rank in time $\mathcal{O}(n^3 + mn^2)$ in this case. 2025-11-12T20:00:48Z Accepted to the STACS 2025 special issue of Logical Methods in Computer Science Stefan Kiefer Andrew Ryzhikov http://arxiv.org/abs/2608.29189v1 Rate-Coding Bundle Memory: A Unified Model of Memory and Control for Symbolic Computation in the Brain 2026-08-29T10:51:47Z We propose a neurobiologically plausible model of cognition that combines the advantages of connectionist and symbolic systems, and that can explain a wide range of cognitive phenomena. This model, called Rate-Coding Bundle Memory (RCBM), is based on the Symbolic Subsystem Hypothesis, which posits that the brain implements a symbolic subsystem within its fundamentally connectionist nature. RCBM is a hybrid model that uses rate coding to represent symbols in a continuous space, and it uses a bundle memory system to store and retrieve these symbols. The model is capable of solving a wide range of cognitive phenomena, including one-shot learning, pattern separation, and the binding problem. We argue that RCBM provides a promising framework for understanding the nature of cognition, and that it can be used to develop more sophisticated models of cognition in the future. 2026-08-29T10:51:47Z Teun van Gils Rowan P. Sommers Markus Ostarek Peter Hagoort http://arxiv.org/abs/2602.02972v2 Learning Fast Monomial Orders for Gröbner Basis Computations 2026-08-28T12:06:32Z The efficiency of Gröbner basis computation, the standard engine for solving systems of polynomial equations, depends on the choice of monomial ordering. Despite a near-continuum of possible monomial orders, most implementations rely on static heuristics such as GrevLex, guided primarily by expert intuition. We address this gap by casting the selection of monomial orderings as a reinforcement learning problem over the space of admissible orderings. Our approach leverages domain-informed reward signals that accurately reflect the computational cost of Gröbner basis computations and admits efficient Monte Carlo estimation. Experiments on benchmark problems from systems biology and computer vision show that the resulting learned policies consistently outperform standard heuristics, yielding substantial reductions in computational cost. Moreover, we find that these policies resist distillation into simple interpretable models, providing empirical evidence that deep reinforcement learning allows the agents to exploit non-linear geometric structure beyond the scope of traditional heuristics. 2026-02-03T01:17:18Z added more experiments against baselines, corrected a few typos and cosmetics R. Caleb Bunch Alperen A. Ergür Melika Golestani Jessie Tong Malia Walewski Yunus E. Zeytuncu http://arxiv.org/abs/2509.19710v3 Probabilistic Symbolic Regression for Equation Discovery via Operator-induced and Regularized Symbolic Forests 2026-08-28T00:29:58Z Symbolic regression has emerged as a powerful tool for artificial intelligence-driven scientific discovery by learning interpretable analytical expressions that reveal governing relationships directly from data. Existing methods, however, often rely on heuristic search, struggle to balance predictive accuracy with expression complexity in noisy settings, and offer limited characterization of symbolic uncertainty. Probabilistic approaches that address these challenges in a unified manner remain underexplored. We introduce a probabilistic symbolic regression framework that represents mathematical expressions as ensembles of symbolic trees. A regularizing prior over tree topology controls expression complexity, while an Occam's window-based posterior summary captures uncertainty across multiple plausible symbolic models. Given the limited existing theoretical treatment of symbolic regression, we develop posterior concentration guarantees when symbolic expressions approximate the underlying relationship arbitrarily well, with a near-parametric rate when an exact finite formula exists. Additionally, we establish a sharp oracle concentration result under symbolic misspecification. Comparisons of our proposed framework with state-of-the-art competitors demonstrate superior predictive accuracy, optimal symbolic complexity, and stable structural recovery when learning benchmark scientific equations, together with the identification of scientifically interpretable descriptor formulas in a challenging materials discovery application. 2025-09-24T02:42:25Z 152 pages, 37 figures, 24 tables, Submitted Somjit Roy Pritam Dey Bani K. Mallick Debdeep Pati http://arxiv.org/abs/2605.25411v2 Heimdall: Formally Verified Automated Migration of Legacy eBPF Programs to Rust 2026-08-26T16:46:42Z Extended Berkeley Packet Filter (eBPF) programs are kernel extensions used for networking, observability, and security enforcement in the Linux kernel. The in-kernel eBPF verifier checks low-level memory safety and termination on eBPF programs, but it does not enforce many higher-level source-level properties, such as initialization discipline, schema consistency, or error handling. We document nine classes of source-level bugs that compile, pass the kernel verifier, and can silently corrupt data, leak kernel memory to userspace, or yield incorrect enforcement outcomes. To harden such verifier-accepted buggy programs and support safe migration, we present Heimdall, an automated pipeline that uses large language models to translate legacy libbpf C programs to Aya Rust. Heimdall iteratively repairs compilation and kernel-verifier failures, rejects unsafe escape hatches in Rust-Aya with a static analysis safety engine, and proves per-program equivalence to the original via symbolic execution and Z3-based equivalence checking. Across 115 eBPF programs, Heimdall generates 109 formally proven-equivalent translations (94.8%). In the process, Heimdall identifies nine bugs in real-world eBPF programs and fixes all of them, two of which leak randomized kernel addresses to userspace and break KASLR. Eight of the nine have also been acknowledged and fixed upstream by the developers. Heimdall is the first system to automate memory-safe-language migration of production eBPF programs with per-program formal guarantees that the migration preserves observable behavior. 2026-05-25T04:23:29Z Vishnu Asutosh Dasu Monika Santra Md Rafi Ur Rashid Ashish Kumar Saeid Tizpaz-Niari Gang Tan http://arxiv.org/abs/2608.24144v1 StabQ: Quantum Program Analysis via Weighted Stabilizer Representations 2026-08-25T07:08:25Z Quantum program analysis remains challenging due to the exponentially large state space of quantum programs and the difficulty of precisely characterizing their execution behavior. In particular, non-Clifford operations introduce additional complexity that limits the applicability of stabilizer-based techniques. Although stabilizer representations provide compact descriptions for Clifford circuits, their limited expressiveness prevents them from directly supporting general quantum program analysis. In this work, we propose StabQ, a symbolic execution framework for quantum program analysis based on stabilizer representations. StabQ extends stabilizer-based symbolic execution beyond Clifford-only programs by introducing a symbolic state representation that captures and propagates quantum state evolution while preserving execution semantics. Based on this representation, StabQ constructs a Tableau Chain that represents the evolution of intermediate symbolic states throughout program execution and enables reusable analysis of quantum program executions. Furthermore, StabQ incorporates tableau consolidation and global-phase recovery mechanisms to mitigate symbolic state growth during execution. Building upon the Tableau Chain, StabQ supports multiple quantum program analysis tasks, including quantum state reconstruction, entanglement analysis, and Clifford-property detection. We evaluate StabQ on three benchmark suites---Algorithms, MQT Bench, and QASMBench. The results demonstrate that StabQ constructs semantically consistent symbolic models, accurately preserves quantum state evolution, and effectively supports downstream analysis tasks across diverse quantum programs. 2026-08-25T07:08:25Z Shangzhou Xia Junjie Luo Jianjun Zhao http://arxiv.org/abs/2608.23324v1 Least-Squares and Low-Rank Approximation for Linear Relations Using a Diagrammatic Language 2026-08-24T14:39:00Z We employ the machinery of linear relations to the study of optimization problems in linear algebra. We first show that the relational version of the pseudo-inverse can be realized through a generalization of the least-squares problem. This allows one to prove that the pseudo-inverse realizes the solution of certain relational optimization problems. Our main result is showing that a certain truncation of this pseudo-inverse defines a solution to a relational version of the classical low-rank approximation problem which recovers both the Eckart-Young Theorem and several optimization problems involving pairs of matrices and vector spaces. 2026-08-24T14:39:00Z 47 pages Júlia de Araújo Mota Iago Leal de Freitas Lucas Rufino João Paixão http://arxiv.org/abs/2608.22671v1 Exact Finite-Length Theory of Uniform Car Parking: Spatial Laws, Absorption, and Aggregation 2026-08-24T00:14:49Z The uniform car-parking process is the one-dimensional random sequential adsorption of unit cars on a segment of finite length $s$: cars arrive at uniformly random positions and park wherever they fit, until no gap admits another. This paper develops the exact finite-$s$ theory. The joint density of the parked positions is resolved into jamming cells, on each of which it is a rational function, and evaluated by a subset recursion in $O(2^n n)$ operations; the marginal and gap order statistics are obtained as hyperlogarithms whose weight is fixed by the number of coordinates integrated out; and the absorption count and the aggregate quantities are treated through the integral equation descending from Rényi. 2026-08-24T00:14:49Z Ganesh P Kumar http://arxiv.org/abs/2608.21932v1 Computing the Determinant via the Generalized Euclidean Algorithm 2026-08-22T11:58:25Z We present an algorithm with a natural geometric interpretation for computing the determinant of a matrix $B\in\mathbb{Z}^{d\times d}$. It improves upon the current fastest deterministic algorithms by a factor of $d^{ω(1)+1-ω(2)}\approx d^{0.1213}$, where $ω(k)$ denotes the exponent required for multiplying a $d\times d$ matrix with a $d\times d^k$ matrix. Our approach builds on a recent result of Klein and Reuter (STOC 2025), who introduced a novel algorithmic idea for lattice basis computation that can be viewed as extending the Euclidean algorithm from $\mathbb{Z}$ to $\mathbb{Z}^d$. By adapting their techniques, we compute the determinant with the same bit complexity as applying the generalized Euclidean algorithm to an input matrix $A\in\mathbb{Z}^{d\times 2d}$ with $\|A\| = \|B\|$, namely $\tilde{O}(d^{ω(2)}\log\|B\|)$. Prior to this work, the fastest deterministic algorithm for computing the determinant required $\tilde{O}(d^{ω(1)+1}\log\|B\|)$ bit operations. 2026-08-22T11:58:25Z Janina Reuter