Compatibility of Higher-Order Slow-Manifold Reduction and Continuum Limits in Adaptive Networks

2026-06-10T19:03:32Z

Adaptive networks couple the evolution of node states to the evolution of the interactions between them. In fast-adapting phase oscillator networks, a slow-manifold reduction of a pairwise microscopic model can generate effective higher-order terms in the phase dynamics. We ask whether this higher-order structure survives the dense-graph continuum limit, and whether it matters if one first reduces and then passes to the continuum, or first passes to the continuum and then reduces. We prove well-posedness and discrete-to-continuum convergence for the unreduced and first-order reduced models, and we construct the continuum slow manifold directly in a Banach-space setting. Along admissible equal-cell step approximations, the two routes give the same first-order continuum vector field, including the same pairwise correction and triplet operator, up to controlled $O(\varepsilon^2)$ remainders. A continuum mixed-derivative criterion then shows that, for suitable coupling functions, the resulting triplet operator is genuinely nonpairwise in the smooth bounded-kernel class. Thus the higher-order term is not a finite-network artefact, but persists in the macroscopic continuum description considered here.

Multifractal human signals at the edge of life reveal a heart-brain anti-correlation

2026-06-10T18:56:09Z

This study investigates the terminal breakdown of human neurophysiological function through the lens of non-linear dynamics by analyzing the multifractal spectrum. Using Multifractal Detrended Fluctuation Analysis (MF-DFA), we quantify the temporal evolution of complexity in synchronized electroencephalogram (EEG) and electrocardiogram (ECG) time series from patients in the terminal stage. Our results reveal a marked divergence in multifractal spectrum width: while neural activity exhibits a collapse of multifractality toward a more constrained state, cardiac signals undergo anomalous spectral broadening, indicating increased non-linear fluctuations and dynamical instability. A negative correlation between these spectral widths suggests effective functional decoupling and the emergence of anti-correlated dynamics between neural and cardiac systems. Rather than reflecting a uniform physiological decline, this divergence is consistent with a body-to-brain breakdown in which peripheral dysfunction progressively overwhelms central regulatory processes. In a broader context, the observed opposing trends resemble patterns reported in other body-driven adaptive processes, suggesting that inverse dynamics across coupled systems may emerge when constraints originate from peripheral rather than central mechanisms. Ultimately, the dying process appears to represent an extreme form of cross-system disintegration, marked by the collapse of the hierarchical coordination that normally sustains integrated physiological function.

Attention by Synchronization in Coupled Oscillator Networks

2026-06-10T13:28:14Z

We address transformer attention on energy-constrained physical substrates. Softmax attention requires exponentiation and global reduction, operations with high energy cost on von Neumann hardware and no natural physical analog. We show that Kuramoto synchronization dynamics (which arise in electrical, mechanical, superconducting, and charge-density-wave oscillator arrays, among other physical systems) implement a well-defined attention operation without either. The resulting mechanism, fixed-query oscillator attention, replaces softmax's arithmetic with the equilibration of a gradient flow on the sphere: queries are learned anchors fixed on the sphere, and free oscillators evolve under Kuramoto-Lohe dynamics until they settle at positions encoding attention weights via cosine similarity. Because the computation is equilibration, it requires no exponentiation; the only global operation is an affine normalization at readout. The fixed point is provably unique and globally attractive from almost every initial condition, a guarantee that holds across every physical realization. Empirically, at the minimal hardware configuration (oscillator dimension $d_{\mathrm{osc}}$ = 2), oscillator attention outperforms softmax on keyword spotting (+1.00 pp) and on subject-verb agreement (+5.27 pp on hard sentences, with zero training failures versus one in five for softmax). On causal language modeling, where softmax retains an advantage, oscillator attention closes the gap as $d_{\mathrm{osc}}$ grows: from +11.09 PPL at $d_{\mathrm{osc}}$ = 2 to +2.98 PPL at $d_{\mathrm{osc}}$ = 32 on WikiText-2, and from +2.39 PPL at $d_{\mathrm{osc}}$ = 2 to +0.57 PPL at $d_{\mathrm{osc}}$ = 32 on TinyStories. The main objective of this work is not to replace softmax in software but to provide a mathematically grounded blueprint for accurate attention on physical substrates.

Time-multiplexed layer reuse for physical neural networks

2026-06-10T09:24:32Z

Physical neural networks (PNNs) are promising candidates for next-generation computing, but existing demonstrations remain several orders of magnitude smaller than modern digital neural networks, whose recent advances have been driven by rapid growth in trainable parameters. This situation resembles the constraints of early digital neural networks, which led to ideas around parameter reuse. We investigate what similarly efficient hardware architectures may look like, focusing specifically on the common bottleneck of slow re-adjustment of the weights in PNNs. We propose the Time-Indexed Deep Alternating Layers Network (TIDAL-Net), which occupies an intermediate regime between recurrent and deep neural networks, specifically aimed at the scales and restrictions of common PNN prototypes. TIDAL-Net leverages the timescale separation found in many PNNs between fast forward dynamics and slowly trainable weights and biases, using layer-by-layer time multiplexing to increase effective depth while limiting implementation cost. Numerical experiments on image classification and natural language processing tasks show that TIDAL-Net improves performance with only minor modifications to conventional PNNs.

Kuramoto Attention: Synchronizing Self-Attention on the Torus

2026-06-10T02:24:04Z

We introduce Kuramoto attention, a self-attention layer in which each hidden coordinate is an angle. The layer scores tokens by gated cosine similarity, attends over previous phase states, and updates each token by the tangent component of the attention-weighted circular mean. Because the values are the raw phase states, this update is exactly the Kuramoto coupling term $\sum_u A_{t,u}\sin(θ_u-θ_t)$, with the attention matrix acting as an adaptive, content-dependent coupling kernel. Equivalently, the gated score is a learned metric on the torus that selects which tokens couple, and the update pulls each token toward the circular mean of the tokens it selects, tightening their phase agreement. The same two ingredients, an invariant similarity score and an on-manifold mean, define such a layer on any compact group; the torus is the abelian case, where both are closed-form. The softmax weights solve an entropy-regularized phase-retrieval problem, and rotary position enters as a position-dependent phase drift in the score. On enwiki8 character-level language modeling, the layer trains as a functional language model whose bits-per-character stays close to a strong matched RoPE+SwiGLU transformer: within $0.02$ BPC at one million parameters ($1.637\pm0.010$ versus $1.616\pm0.004$) and level on the median at five million ($1.448$ versus $1.452$ over five seeds) with the transformer ahead on the mean ($1.468$ versus $1.456$). These experiments establish that the constrained geometric structure is a viable language model at this scale; the structure itself, and its synchronization reading, is the contribution. Ablations isolate the load-bearing components, and the result gives a compact bridge between self-attention and phase synchronization.

Complexity synchronization as a diagnostic and control principle for adaptive systems

2026-06-09T14:53:31Z

Adaptive systems can exhibit similar levels of performance while relying on fundamentally different internal modes of coordination. Standard metrics such as average cooperation or payoff indicate whether a system succeeds, but do not reveal how coordination is organized across interacting components or which adaptive variables should be targeted when performance fails. Here we propose complexity synchronization (CS), the synchronization of evolving temporal complexity across coupled variables, as a diagnostic and intervention guiding principle for adaptive systems. We test this idea in an adaptive multi agent system composed of Selfish Algorithm agents interacting in a reduced Predator Prey model with a Prisoners Dilemma like payoff structure. Temporal complexity is quantified using sliding window modified diffusion entropy analysis (MDEA) and detrended fluctuation analysis (DFA). CS is defined as the correlation between the resulting time dependent scaling exponents. In the high-interaction regime, MDEA-based CS increases with cooperative performance, whereas DFA based CS captures a distinct persistence dominated coordination mode. Our results show that CS can reveal functionally relevant subsystems and provide a principled basis for targeted repair. More broadly, CS offers a general diagnostic and engineering framework for understanding and controlling coordination in biological, social, human machine, and other adaptive systems.

Towards Critical Branching Mechanism in Recurrent Neural Networks

2026-06-09T03:49:03Z

Criticality has been proposed as a key organizing principle in biological neural systems, yet its origin and relevance in artificial neural networks remain unclear. We analyze hidden-state dynamics in trained long short-term memory (LSTM) networks and show that small networks near their optimal training epochs (steps) exhibit scale-free avalanche statistics and branching parameters close to unity, indicative of near-critical dynamics, while larger models remain subcritical. To explain the coexistence of subcritical branching with robust $1/f^β$ noise, we introduce a mixture branching process framework that links heterogeneous branching dynamics to long-range temporal correlations. These results identify critical-like behavior in LSTMs as an emergent, capacity-dependent dynamical regime.

Stabilizing Role of Uninformed Participants in Collective Decision Making

2026-06-09T01:24:38Z

For groups without strict hierarchy, collective decisions often emerge through compromise. We develop a second-order network model of collective decision-making using a dissipative Hamiltonian formulation, in which informed agents introduce preferred directions while uninformed participants contribute only direction-free dissipation. We show that under low conflict, the model admits a locally unique, exponentially stable compromise state. Using a structured modular network we further show that as conflict increases the local compromise branch terminates through a saddle-node fold rather than through a smooth mean-field symmetry-breaking transition. Modular polarized states persist on branches that are locally separated from the compromise branch. Direction-free dissipation does not shift the static structural threshold, but it delays escape from the saddle-node ghost and pushes the observable onset of polarization to larger conflicts. Our work identifies a dissipation-mediated mechanism, complementary to connectivity-based accounts, through which uninformed participants stabilize collective behavior in biological and engineered swarms.

Self-propulsion in the 1D swarmalator model

2026-06-09T01:10:16Z

We study the 1D swarmalator model augmented with self-propulsion. Each swarmalator swims along the ring at a speed $v_0\sinθ_i$ fixed by its orientation $θ_i$. Self-propulsion unfolds the static states of the ordinary model into traveling, breathing, split-wave, and chaotic states. Several of these states admit analytic reductions: an exact drifting two-cluster branch with a closed-form stability spectrum, and a four-cluster split-wave ansatz whose active pair reduces, in a constant-orientation approximation, to an Adler equation. Our numerical evidence suggests that the transition to chaos under broad random initial conditions is not caused by local destabilization of the ordered cluster branches, but by basin reorganization among coexisting attractors. The resulting states may serve as qualitative signatures for confined active oscillator arrays.

Coupling-split clusters in a swarmalator model with uniform coupling disorder

2026-06-09T00:21:19Z

We study the one-dimensional swarmalator model in which the phase coupling $K_i'$ is drawn from a uniform distribution. Our main result is a static coupling-split cluster, in which the population partitions across the threshold $K'=0$ that separates positively coupled ($K_i'>0$) from negatively coupled ($K_i'<0$) swarmalators, with smaller order parameter $s=μ/γ$ set by the positive-coupling excess. The familiar async, phase-wave, and sync states persist, but each stability boundary feels a different part of the distribution: async the mean same-coordinate response, sync the most negatively coupled particle, and the phase wave the full density through a logarithmic characteristic equation. At a cusp where its Hopf and real-eigenvalue branches meet, the phase-wave dispersion has a double zero -- the spectral signature of a Bogdanov--Takens point -- and simulations nearby show a small-amplitude breathing limit cycle. For supports containing strongly negatively coupled particles the order parameters instead oscillate persistently.

Collective drift and pinning in active rotator networks with Kuramoto coupling and mixed-sign feedback disorder

2026-06-08T18:09:47Z

Active rotator models provide a minimal phase description of excitable and oscillatory systems, and have long been used to study mutual entrainment, synchronization, and collective transitions. Here, we investigate fully connected active rotator networks with Kuramoto coupling, where a common intrinsic drive competes with local feedback amplitudes drawn from a zero-mean Gaussian distribution. This produces a competition between local pinning and collective phase alignment. Using mean absolute late-time drift and the fractions of positive and negative drifting oscillators, we construct numerical regime maps in the feedback-disorder-coupling plane. At weak coupling, increasing the feedback disorder strength suppresses drift, while stronger coupling can restore positive late-time drift when feedback disorder is not too strong. We interpret these regimes using analytical limits for the uncoupled and coherent strong-coupling cases. We also examine finite-size effects and zero-mean distributed intrinsic frequencies. Together, these results show that mixed-sign local feedback alone can reshape the balance between pinning and drifting in coupled active rotator networks, even when the intrinsic drive is homogeneous.

Towards personalised intervention: A causal-dynamical framework to determine psychological treatment trajectories

2026-06-08T09:51:31Z

For approximately half of the individuals receiving mental health care, the results are suboptimal, even when treatments align with evidence-based guidelines. These limited effects may partly stem from how clinical decisions on treatment focus are made in mental health care. Typically, treatment strategy is guided by the diagnostic classification combined with the individualized case conceptualization. While standard, this approach may fall short for several reasons such as biases on the part of both the patient and therapist, and treatment guidelines being based on average effects that may not (exactly) suit the individual patient. To address these challenges, we propose a novel framework that reduces biases in clinical decision-making and makes it genuinely possible to tailor treatment focus to the individual patient. This framework involves (a) constructing causal graphs and estimating causal effects from intensively collected, longitudinal patient data, (b) simulating new time series based upon the causal relationships, and (c) using these simulations to identify the most effective treatment focus for the individual patient. By simulating and comparing different intervention strategies and examining both the estimated individual's responsiveness and its long-term effectiveness, this approach may generate useful insights to guide treatment focus and strategy, which can lead to a significant improvement of treatment outcomes in mental health care.

Characterizing and modeling the patterns of vehicle movement on road networks

2026-06-08T06:29:01Z

Understanding vehicle movement on road networks is closely related to various practical and theoretical issues. While recent works have focused on which cost vehicles minimize while moving, how they move to minimize that cost remains less explored. In this work, we analyze large-scale data of individual vehicle trajectories in real-world road networks to identify cost-minimizing movement patterns of vehicles and the influence of road network structure on such movement. We observed that vehicle movements exhibit three phases: the beginning, middle, and end of trips. At the beginning and end, vehicles detour more, lose directional memory quickly, and travel at lower speeds than during the middle. In contrast, during the middle, they tend to detour less, maintain directional memory, and travel faster than at the beginning and end. Finally, at the beginning and end, vehicles exhibit similar detour and velocity patterns, except the direction of movement. To understand these patterns, we propose a double-layered network model mimicking the hierarchical structure of real-world road networks. We found that when vehicles move across our model network while minimizing travel time, they tend to concentrate on high-level roads, and the three observed movement phases are reproduced. Consequently, when a vehicle moves between a given origin-destination pair, it must enter and exit these high-level roads. This causes it to deviate from the trajectory that minimizes travel distance between the same origin-destination pair -- particularly at the beginning and end of the trip. Our results reveal common patterns underlying individual vehicle movements that appear highly diverse at first glance, demonstrating that these patterns emerge because vehicles leverage the characteristics of hierarchical road networks to minimize travel time.

Decomposition of Anomalous Diffusion in two-state random walks

2026-06-07T21:02:24Z

Two-state stochastic models, where motion alternates between distinct dynamical modes, are widely observed in complex systems. Here we study the Two-State Random Walk (TSRW), which switches between a continuous-time random walk (CTRW) rest state and a standard L'evy walk (LW) motion state, each with power-law distributed sojourn times. Using anomalous diffusion decomposition, we show that TSRWs exhibit a generic coexistence of Joseph (correlation), Noah (heavy-tailed increments), and Moses (aging) effects. Strikingly, although classical L'evy walks alone possess only the Joseph effect, both Noah and Moses effects emerge in TSRWs solely due to stochastic switching with the CTRW phase. Our results demonstrate that coupling between dynamical states can fundamentally reshape the mechanisms driving anomalous diffusion, offering a minimal yet powerful framework for transport in heterogeneous and intermittently switching environments.

Topological transitions in swarmalators systems

2026-06-05T20:00:01Z

After its development, the swarmalators model attracted a great deal of attention since it was found to be very suitable to reproduce several behaviors in collective dynamics. However, few works explain the transitions that are observed while varying system parameters. In this letter, we demonstrate that the changes observed in swarmalator dynamics are governed by changes in the system's topology. To provide a deeper understanding of these changes, we present a topological framework for the swarmalator system and determine the topological charge $Q$ and the helicity $γ$ of the corresponding topology. Investigations on synchronization and transition to synchronization are studied using this topological charge and the variance of the helicity.