Neural Langevin Machine: a local asymmetric learning rule can be creative

2026-06-03T13:18:15Z

Fixed points of recurrent neural networks can be leveraged to store and generate information. These fixed points can be captured by the Boltzmann-Gibbs measure, which leads to neural Langevin dynamics that can be used to find them for generative learning of a real dataset. We call this type of generative model a neural Langevin machine, which derives an asymmetric and firing-rate-speed adjusted learning rule requiring only local neural signals, thereby bearing biological relevance in terms of local predictive learning. An interesting out-of-equilibrium regime of the generative process is revealed, together with a memorization-to-generalization transition with increasing training data size. The neuro-inspired machine can also realize a continuous exploration of the phase space for different kinds of generative images and can denoise a corrupted image as well.

Drift-Diffusion Matching: Embedding dynamics in latent manifolds of asymmetric neural networks

2026-06-03T11:34:12Z

Recurrent neural networks (RNNs) provide a theoretical framework for understanding computation in biological neural circuits, yet classical results, such as Hopfield's model of associative memory, rely on symmetric connectivity that restricts network dynamics to gradient-like flows. In contrast, biological networks support rich time-dependent behaviour facilitated by their asymmetry. Here we introduce a general framework, which we term drift-diffusion matching, for training continuous-time RNNs to represent arbitrary, nonlinear stochastic differential equations (SDEs), with given drift and diffusion coefficients, within a low-dimensional latent subspace. Allowing asymmetric connectivity, we show that RNNs can faithfully embed the drift and diffusion of a given SDE, including nonlinear and nonequilibrium dynamics such as chaotic attractors. As an application, we construct RNN realisations of stochastic systems that transiently explore various attractors through both input-driven switching and autonomous transitions driven by nonequilibrium currents, which we interpret as models of associative and sequential (episodic) memory. To elucidate how these dynamics are encoded in the network, we introduce decompositions of the RNN based on its asymmetric connectivity and its time-irreversibility. Our results extend attractor neural network theory beyond equilibrium, showing that asymmetric neural populations can implement a broad class of dynamical computations within low-dimensional manifolds, unifying ideas from associative memory, nonequilibrium statistical mechanics, and neural computation.

Percolation Criticality of Amorphous-Amorphous Transitions in Compressed Glasses

2026-06-03T11:29:29Z

The low-to-high-density transition in compressed silica glass is investigated using percolation theory. Large-scale molecular dynamics simulations of SiO$_2$ glasses, with system sizes of up to 10$^6$ atoms and pressures ranging from 0 to 35 GPa, were carried out to investigate the emergence of structural motifs and their growth to system-spanning length scales under compression. On this basis, we introduced long-range descriptors that complement conventional local and medium-range structural measures. The results reveal critical percolation transitions of SiO$_Z$-SiO$_Z$ clusters with increasing coordination number $Z$. The critical exponents slightly deviate from the standard (random) correlation, a behavior that seems to be more pronounced for higher coordinated polyhedra than for tetrahedra, suggesting a possible rigidity percolation mechanism. SiSi$_z$-SiSi$_z$ clusters were also analyzed using the non-bonded approach. Bonded and non-bonded approaches complement each other in a particularly illuminating way for describing pressure-induced structural transformations and common mechanisms shared by bonded glasses, such as SiO$_2$, and non-bonded glasses, such as amorphous ice.

Finite-Basis Duality Estimate for the Surface-Code Threshold under Correlated Bit-Flip Errors

2026-06-03T11:02:47Z

We apply finite-basis duality to a statistical-mechanical model introduced by Chubb and Flammia for the surface code under spatially correlated bit-flip noise. Their mapping gives a random-bond Ising model with both two-body edge interactions and four-body face interactions. The single-equation estimate based on the duality analysis is slightly deviated from their Monte Carlo estimate $p_c=0.1004(6)$. Following the finite-basis and graph-polynomial strategy, we instead use periodic and twisted-periodic sectors on toroidal bases. We have obtained an improved estimate of the critical point, $p_c = 0.10348$.

Comparing Symmetrized Determinant Neural Quantum States for the Hubbard Model

2026-06-03T09:39:27Z

Accurate simulations of the Hubbard model are crucial to understanding strongly correlated phenomena, where small energy differences between competing orders demand high numerical precision. In this work, Neural Quantum States are used to probe the strongly coupled and underdoped regime of the square-lattice Hubbard model. We systematically compare the Hidden Fermion Determinant State and the Jastrow-Backflow ansatz, parametrized by a Vision Transformer, finding that in practice, their accuracy is similar. We also test different symmetrization strategies, finding that output averaging yields the lowest energies, though it becomes costly for larger system sizes. On cylindrical systems, we consistently observe filled stripes. On the torus, our calculations display features consistent with a doped Mott insulator, including antiferromagnetic correlations and suppressed density fluctuations. Our results demonstrate both the promise and current challenges of neural quantum states for correlated fermions.

Spectral criteria for generalization in unsupervised Hebbian nets

2026-06-03T09:22:27Z

We consider an unsupervised Hebbian network where the pairwise interactions among neurons are built on noisy realizations of hidden ground-truth vectors. Unlike classical Hopfield models, designed as memory devices, this class of networks can be employed to extract latent structure and generalize beyond the "training" set. By combining random matrix theory and replica methods, we derive the asymptotic spectrum of the corresponding interaction matrix and show that the onset of generalization is controlled by a sharp spectral transition. Depending on the quality and the size of the accessible dataset, the spectrum displays either two separated bulks, encoding informative and noisy directions, or a merged single-bulk phase where such distinction is lost. We show that, when coupled with regularization, the emergence of such a spectral split predicts the network's capability to reconstruct the ground-truth vectors from corrupted samples.

Extremely slow scaling of minimal Hamming distance in quantum sampling data

2026-06-03T07:43:12Z

Quantum data can be obtained from a diverse range of sources, including direct measurements from noisy quantum processors, cold-atom simulators, and classical approximations such as variational neural-network states. However, our ability to characterize these systems is fundamentally limited, as the available measurement data is often sparse compared to the exponentially large Hilbert space of the system. To address this, we propose using the average minimal Hamming distance calculated for a set of unique bitstrings as a robust metric revealing a universal power-law behaviour. Through various examples of real experiments and simulations, we show that the power-law parameters reliably capture the complexity of quantum states and identify quantum phase transitions from limited quantum information, without the need for accumulating extensive statistics or explicitly calculating physical observables. This enables the analysis of completely different quantum experiments within a single framework.

Discrete signaling mediates chaotic regularization in recurrent neural networks

2026-06-03T04:17:06Z

Cortical circuits operate in a regime of intrinsic chaos, where even tiny changes in input can lead to divergent neural responses. Yet, remarkably, population codes in the brain vary smoothly with sensory stimuli, forming coherent representational manifolds. How can chaotic networks sustain such stable coding? Here, we develop a theoretical framework that links the microscopic chaos of recurrent networks to the macroscopic geometry of neural representations. Combining kernel methods with dynamical mean-field theory, we show that chaotic dynamics induce local roughness (introducing sharp distortions at small scales) while preserving global smoothness across larger stimulus variations. This structural property acts as an intrinsic regularizer, enhancing generalization while maintaining expressivity. Moreover, we show how chaotic networks naturally produce power-law spectral signatures, closely matching experimental observations in cortical recordings. These results explain how chaotic spiking networks can sustain smooth, differentiable population codes and establish a theoretical framework linking network dynamics, computational structure, and recorded neural activity.

Enhancing Neural-Network Variational Monte Carlo through Basis Transformation

2026-06-03T04:14:02Z

Neural-network variational Monte Carlo (NNVMC) has emerged as a powerful tool for solving quantum many-body problems, yet systematic pathways for improving its accuracy remain largely heuristic. Here, we introduce a physically motivated basis transformation for NNVMC that enhances variational expressivity without increasing the complexity of the neural-network ansatz itself. By formulating the many-body wave function in a Gaussian basis, we introduce a single learnable locality parameter, $α$, that reshapes the target ground state into a more learnable representation. This approach introduces minimal computational overhead and can be readily combined with existing neural-network architectures. Using the three-dimensional homogeneous electron gas as a benchmark, we show that the optimized basis transformation consistently lowers the variational energy for both FermiNet and message-passing neural-network architectures. Notably, for the latter, it enables a more precise determination of the Fermi liquid to Wigner crystal phase transition. More broadly, our results highlight basis transformation as a new route to improving NNVMC in continuous space, showing that accuracy can be enhanced not only by refining the ansatz but also by making the target ground state easier to represent.

Shortcomings and capacities of real-constrained neural networks in complex spaces

2026-06-03T03:11:03Z

We find the asymptotic ratio between the storage capacities when enforcing real pre-activations in a complex hypothesis class as opposed to complex ones in the same class. Our methods depend on Gardner volume comparisons at critical capacity. Our proof relies on an application of the Harish-Chandra-Itzykson-Zuber (HCIZ) formula, nonstandard in literature. With the HCIZ formula, we may obtain a more robust approximation for the final asymptotic ratio. This strategy is applicable to our work specifically since we integrate over the unitary and orthogonal compact manifolds, facilitated via the Weyl integration formula and the Haar measure.

Risk and cross validation in ridge regression with correlated samples

2026-06-02T21:27:54Z

Recent years have seen substantial advances in our understanding of high-dimensional ridge regression, but existing theories assume that training examples are independent. By leveraging techniques from random matrix theory and free probability, we provide sharp asymptotics for the in- and out-of-sample risks of ridge regression when the data points have arbitrary correlations. We demonstrate that in this setting, the generalized cross validation estimator (GCV) fails to correctly predict the out-of-sample risk. However, in the case where the noise residuals have the same correlations as the data points, one can modify the GCV to yield an efficiently-computable unbiased estimator that concentrates in the high-dimensional limit, which we dub CorrGCV. We further extend our asymptotic analysis to the case where the test point has nontrivial correlations with the training set, a setting often encountered in time series forecasting. Assuming knowledge of the correlation structure of the time series, this again yields an extension of the GCV estimator, and sharply characterizes the degree to which such test points yield an overly optimistic prediction of long-time risk. We validate the predictions of our theory across a variety of high dimensional data.

Transport scaling and critical tilt effects in disordered two-dimensional Dirac fermions

2026-06-02T15:57:37Z

Two-dimensional (2D) Dirac fermions occur ubiquitously in condensed matter systems from topological phases to quantum critical points. Since the advent of topological semimetals, where the dispersion is often tilted around the band crossing where the Dirac fermion can appear, tilt has emerged as a key handle that controls physical properties. We study how tilt affects the transport and spectral properties of tilted 2D Dirac fermions under scalar disorder. Although our spectral analyses always show conformity to appropriate Gaussian ensembles, suggestive of delocalization, the conductivity scaling $g(L)$ shows a surprising richness. For a single Dirac node, relevant for quantum Hall transitions and topological insulator surface states, we find $g(L)\sim a_1\log(L)$ with a tilt-dependent coefficient $a_1>0$. Interestingly, when the tilt and transport directions are aligned, $a_1$ and hence $g(L)$ shows a spike at the critical point between the type-I and type-II regimes of the Dirac node. For systems with two Dirac nodes with unbroken time-reversal symmetry, pertinent to quasi-2D Dirac materials, we find $g(L)\sim L^{a_1}(\log L)^{a_2}$. However, we find a surprising tension between tilt along and perpendicular to the transport directions. For the former, $a_1$ changes sign as a function of tilt, hinting at a tilt-driven localization-delocalization transition, while $a_1<0$ for all tilts in the latter case, implying localization. These localized behaviors also reveal tension with the delocalization seen in spectral properties and suggest differing localization tendencies in real and Hilbert spaces. Overall, our work identifies tilt as an essential control parameter that uncovers rich and unconventional transport physics in 2D Dirac materials.

Quantifying plasticity: a network-based framework linking structure to dynamical regimes

2026-06-02T13:27:47Z

Plasticity is a fundamental property of complex systems, such as the brain or an organism. Yet it typically remains a descriptive concept inferred retrospectively from observed outcomes, such as modifications in activity or morphology. Here, the network-based operationalization of plasticity is further formalized as the ratio between system size and connectivity strength among system elements. Within this framework, system size determines the dimensionality of the accessible state space, while connectivity strength tunes the system's regime. An optimal range of plasticity -- balancing capacity for change and capacity to maintain coherence -- emerges at intermediate connectivity strength. Notably, this balance coincides with the critical regime, which provides a theoretically motivated benchmark that enables a normalized unit of measure, termed effective plasticity, and comparisons of adaptive efficacy across diverse systems. Plasticity is thus transformed into a predictive tool that quantifies a system's capacity for change before it occurs. Its validity is supported across disciplines and, in particular, by evidence from psychopathology where it anticipates transitions between mental states. At a mechanistic level, plasticity acts as a structural tuning parameter for criticality, reframing their relationship as causal, with plasticity driving criticality rather than merely accompanying it. Furthermore, this network-based operationalization explains how larger systems can more robustly maintain critical dynamics. Crucially, the proposed perspective distinguishes functional regime shifts from thermodynamic phase changes, identifying plasticity as the system-level regulator that shapes and constrains the dynamic repertoire. This framework is applicable across domains, including ecology, economics, and social systems, and may foster cross-disciplinary integration within complexity science.

Training a Predictive Coding Network on ImageNet using Equilibrium Propagation

2026-06-02T12:52:29Z

Equilibrium Propagation (EP) is a physics-based training framework that has primarily been employed in energy-based models, including continuous Hopfield networks, nonlinear resistive networks and coupled phase oscillators. However, EP's practical applications have so far remained limited to relatively small-scale problems. Predictive coding networks (PCNs), another class of energy-based models rooted in computational neuroscience, are typically trained with a specialized algorithm and have likewise not yet been demonstrated at large scale. In this work, we develop an EP-based training method for PCNs which combines the centered variant of EP with a novel equilibration scheme for PCNs. Using this approach, we train a 10-layer convolutional PCN (VGG10) on full-size ImageNet, achieving 13.23\% test error rate on the top-5 classification task, close to the 12.2\% backpropagation baseline. To our knowledge, this is the first demonstration of both PCNs and EP-based training at ImageNet scale. These results significantly extend the scalability of both approaches and suggest that the primary challenges in scaling EP in other physical systems may come more from the computational properties of these systems than from inherent limitations of the EP framework.

Hierarchical crack patterns: Identification of crack generations

2026-06-02T10:49:36Z

Hierarchical crack patterns of various origins are ubiquitous in the world around us. We reduce the problem of classifying crack generations in an image of a part of the entire hierarchical crack pattern to the well-known topological sorting of a directed acyclic graph. The classification demonstrates robustness to reasonable shifts in the pattern image boundaries.