https://arxiv.org/api/nlHeqxdmGKoD6MVWQ7OCrt2+lqk 2026-06-22T16:05:06Z 12181 435 15 http://arxiv.org/abs/2604.08537v1 2026-04-09T17:59:32Z

Visual decoding from brain signals is a key challenge at the intersection of computer vision and neuroscience, requiring methods that bridge neural representations and computational models of vision. A field-wide goal is to achieve generalizable, cross-subject models. A major obstacle towards this goal is the substantial variability in neural representations across individuals, which has so far required training bespoke models or fine-tuning separately for each subject. To address this challenge, we introduce a meta-optimized approach for semantic visual decoding from fMRI that generalizes to novel subjects without any fine-tuning. By simply conditioning on a small set of image-brain activation examples from the new individual, our model rapidly infers their unique neural encoding patterns to facilitate robust and efficient visual decoding. Our approach is explicitly optimized for in-context learning of the new subject's encoding model and performs decoding by hierarchical inference, inverting the encoder. First, for multiple brain regions, we estimate the per-voxel visual response encoder parameters by constructing a context over multiple stimuli and responses. Second, we construct a context consisting of encoder parameters and response values over multiple voxels to perform aggregated functional inversion. We demonstrate strong cross-subject and cross-scanner generalization across diverse visual backbones without retraining or fine-tuning. Moreover, our approach requires neither anatomical alignment nor stimulus overlap. This work is a critical step towards a generalizable foundation model for non-invasive brain decoding.

2026-04-09T17:59:32Z Accepted to CVPR 2026, website: https://github.com/ezacngm/brainCodec Mu Nan Muquan Yu Weijian Mai Jacob S. Prince Hossein Adeli Rui Zhang Jiahang Cao Benjamin Becker John A. Pyles Margaret M. Henderson Chunfeng Song Nikolaus Kriegeskorte Michael J. Tarr Xiaoqing Hu Andrew F. Luo http://arxiv.org/abs/2511.20162v2 2026-04-09T15:23:13Z

Large multi-modal models (LMMs) show increasing performance in realistic visual tasks for images and, more recently, for videos. For example, given a video sequence, such models are able to describe in detail objects, the surroundings and dynamic actions. In this study, we explored the extent to which these models ground their semantic understanding in the actual visual input. Specifically, given sequences of hands interacting with objects, we asked models when and where the interaction begins or ends. For this purpose, we introduce a first of its kind, large-scale dataset with more than 20K annotated interactions on videos from the Something-Something-V2 dataset. 250 AMTurk human annotators labeled core interaction events, particularly when and where objects and agents become attached (`contact') or detached (`release'). We asked SoTA LMMs, including GPT, Gemini and Qwen to locate these events in short videos, each with a single event. The results show that while models reliably name target objects and identify actions, they exhibit a form of `shortcut learning' where semantic success masks a failure in physical grounding. Specifically, they consistently fail to identify the frame where the interaction begins or ends and poorly localize the physical event within the scene. This disconnect suggests that while LMMs excel at System 1 intuitive pattern recognition (naming the action and objects), they lack the System 2 cognitive foundations required to reason about physical primitives like `contact' and `release', hence truly ground dynamic scenes in physical reality.

2025-11-25T10:38:41Z Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2026 workshop on Cognitive Foundations for Multimodal Models (CogVL) Daniel Harari Michael Sidorov Chen Shterental Liel David Abrham Kahsay Gebreselasie Muhammad Haris Khan http://arxiv.org/abs/2604.08312v1 2026-04-09T14:45:48Z

Many essential biological functions, such as breathing and locomotion, rely on the coordination of robust and adaptable rhythmic patterns, governed by specific network architectures known as connectomes. Rhythmic adaptation is often linked to slow structural modifications of the connectome through synaptic plasticity, but such mechanisms are too slow to support rapid, localized rhythmic transitions. Here, we propose a neuromodulation-based control architecture for dynamically reconfiguring rhythmic activity in networks with fixed connectivity. The key control challenge is to achieve reliable rhythm switching despite neuronal degeneracy, a form of structured variability where widely different parameter combinations produce similar functional output. Using equivariant bifurcation theory, we derive necessary symmetry conditions on the neuromodulatory projection topology for the existence of target gaits. We then show that an adaptive neuromodulation controller, operating in a low-dimensional feedback gain space, robustly enforces gait transitions in conductance-based neuron models despite large parametric variability. The framework is validated in simulation on a quadrupedal gait control problem, demonstrating reliable gallop-to-trot transitions across 200 degenerate networks with up to fivefold conductance variability.

2026-04-09T14:45:48Z Arthur Fyon Alessio Franci Pierre Sacré Guillaume Drion http://arxiv.org/abs/2604.18599v1 2026-04-09T13:40:48Z

Neurophysiologists are nowadays able to record from a large number of extracellular electrodes and to extract, from the raw data, the sequences of action potentials or spikes generated by many neurons. Unfortunately these ''many neurons'' still represent only a tiny fraction of the neuronal population that constitutes the network. Using association statistics such as the estimation of the cross-correlation functions, they are trying to infer the structure of the network formed by the recorded neurons. But this inference is compromised by the tremendous under-sampling of the neuronal population. We propose to focus instead on simple spike train statistics, like the empirical spikes frequency, or the interspike interval distribution. Their sampling distributions can be estimated by simulations, and, given a few observed spike train statistics, they provide enough information to infer the structure of the underlying network. We show that, on a ''toy model'', our method gives significantly better results than the sub-network reconstruction method with regards to the inference of the connection probability of the original network.

2026-04-09T13:40:48Z Pierre Charitat IRMA Ségolen Geffray IRMA Christophe Pouzat IRMA http://arxiv.org/abs/2509.12873v2 2026-04-09T12:37:45Z

The simulation of whole-brain dynamics should reproduce realistic spontaneous and evoked neural activity across different scales, including emergent rhythms, spatio-temporal activation patterns, and macroscale complexity. Once a mathematical model is selected, its configuration must be determined by properly setting its parameters. A critical preliminary step in this process is defining an appropriate set of observables to guide the selection of model configurations (parameter tuning), laying the groundwork for quantitative calibration of accurate whole-brain models. Here, we address this challenge by presenting a framework that integrates two complementary tools: The Virtual Brain (TVB) platform for simulating whole-brain dynamics, and the Collaborative Brain Wave Analysis Pipeline (Cobrawap) for analyzing simulation outputs using a set of standardized metrics. We apply this framework to a 998-node human connectome, using two configurations of the Larter-Breakspear neural mass model: one with the TVB default parameters, the other tuned using Cobrawap. The results reveal that the tuned configuration exhibits several biologically relevant features, absent in the default model for both spontaneous and evoked dynamics. In response to external perturbations, the tuned model generates non-stereotyped, complex spatio-temporal activity, as measured by the perturbational complexity index. In spontaneous activity, it exhibits robust alpha-band oscillations, infra-slow rhythms, scale-free characteristics, greater spatio-temporal heterogeneity, and asymmetric functional connectivity. This work demonstrates how combining TVB and Cobrawap can guide parameter tuning and lays the groundwork for data-driven calibration and validation of accurate whole-brain models.

2025-09-16T09:24:51Z 39 pages and 6 figures, plus supplementary material Neurocomputing 678, 132735 (2026) Gianluca Gaglioti Alessandra Cardinale Cosimo Lupo Thierry Nieus Federico Marmoreo Elena Focacci Robin Gutzen Michael Denker Andrea Pigorini Marcello Massimini Simone Sarasso Pier Stanislao Paolucci Giulia De Bonis 10.1016/j.neucom.2026.132735 http://arxiv.org/abs/2604.07745v1 2026-04-09T03:03:06Z

LLMs gain competence by predicting words in human text, which often reflects how people perform tasks. Consequently, coupling an LLM to an engineered runtime turns prediction into control: outputs trigger interventions that enact goal-oriented behavior. We argue that a central design lever is where control resides in these systems. Brains embed prediction within layered feedback controllers calibrated by the consequences of action. By contrast, LLM agents implement Cartesian agency: a learned core coupled to an engineered runtime via a symbolic interface that externalizes control state and policies. The split enables bootstrapping, modularity, and governance, but can induce sensitivity and bottlenecks. We outline bounded services, Cartesian agents, and integrated agents as contrasting approaches to control that trade off autonomy, robustness, and oversight.

2026-04-09T03:03:06Z Tim Sainburg Caleb Weinreb http://arxiv.org/abs/2604.07602v1 2026-04-08T21:20:24Z

The world is full of systems of distributed agents, collaborating and competing in complex ways: firms and workers specialise within economies, neurons adapt their tuning across brain circuits, and species compete and coexist within ecosystems. In that context, individual research fields built theories explaining how comparative advantage drives trade specialisation, how balanced neural representations emerge from sensory coding, and how biodiversity sustains ecological productivity. Here we propose that many of these well-understood findings across fields can be captured in one simple joint cross-disciplinary model, which we call the Distributed Production System. It captures how agent heterogeneity, resource constraints, communication topology, and task structure jointly determine the productivity, efficiency, and robustness of distributed systems across biology, economics, neuroscience, and computing. This model reveals that a small set of underlying laws generates the complex dynamics observed across fields. These can be summarised in our Principle of Maximum Heterogeneity: any distributed production system optimising for performance will converge on an increasingly heterogeneous configuration; environmental demands place an upper bound on the degree of heterogeneity required; and the communication topology determines the spatial scale over which heterogeneity spreads, with this principle applying recursively across all layers of nested production systems. Beyond explaining existing systems, these principles act as a blueprint for constructing ideal ones. We demonstrate this by suggesting specific redesigns for compute systems executing large-scale AI. In total, The Principle of Maximum Heterogeneity reveals a unique convergence of complex phenomena across fields onto simple underlying design principles with important predictive value for future distributed production systems.

2026-04-08T21:20:24Z 81 pages, 43 figures Guillhem Artis Danyal Akarca Jascha Achterberg http://arxiv.org/abs/2604.07038v1 2026-04-08T12:54:21Z

In neuroscience, joint receptors have traditionally been viewed as limit detectors, providing positional information only at extreme joint angles, while muscle spindles are considered the primary sensors of joint angle position. However, joint receptors are widely distributed throughout the joint capsule, and their full role in proprioception remains unclear. In this study, we specifically focused on mimicking Type I joint receptors, which respond to slow and sustained movements, and quantified their proprioceptive potential using a biomimetic joint developed with robotics technology. Results showed that Type I-like joint receptors alone enabled proprioceptive sensing with an average error of less than 2 degrees in both bending and twisting motions. These findings suggest that joint receptors may play a greater role in proprioception than previously recognized and that the relative contributions of muscle spindles and joint receptors are differentially weighted within neural networks during development and evolution. Furthermore, this work may prompt new discussions on the differential proprioceptive deficits observed between the elbows and knees in patients with hereditary sensory and autonomic neuropathy type III. Together, these findings highlight the potential of biomimetics-based robotic approaches for advancing interdisciplinary research bridging neuroscience, medicine, and robotics.

2026-04-08T12:54:21Z 26 pages including supplementary materials (17 pages main text), 6 main figures and 7 supplementary figures. Published in Scientific Reports Scientific Reports, 16, Article number: 4724 (2026) Akihiro Miki Shun Hasegawa Sota Yuzaki Yuta Sahara Yoshimoto Ribayashi Kento Kawaharazuka Kei Okada 10.1038/s41598-025-27311-3 http://arxiv.org/abs/2604.16463v1 2026-04-08T12:01:20Z

MLE-Toolbox is a comprehensive open-source MATLAB toolbox for end-to-end analysis of magnetoencephalography (MEG) and electroencephalography (EEG) data. Inspired by widely used neuroimaging platforms such as Brainstorm and FieldTrip, it integrates the full analysis pipeline within a unified and user-friendly graphical interface (GUI), covering raw data import, preprocessing, source localization, functional connectivity, oscillatory analysis, and machine learning-based classification. The toolbox includes automated artifact rejection methods, including independent component analysis (ICA), signal-space projection (SSP), and signal-space separation (SSS); multiple source localization approaches, including minimum norm estimation (MNE), dynamic statistical parametric mapping (dSPM), standardized low-resolution brain electromagnetic tomography (sLORETA), and beamforming; multi-atlas parcellation with anatomical visualization; spectral power analysis with frequency-band brain mapping; phase-amplitude coupling (PAC); graph-theoretic brain network analysis; and integrated machine learning and deep learning classifiers. MLE-Toolbox also provides native interoperability with Brainstorm, FieldTrip, EEGLAB, and FreeSurfer, allowing researchers to build on established workflows while benefiting from additional automation, interactive visualization, and one-click academic report generation. Freely available for non-commercial use, MLE-Toolbox is designed to lower the barrier to rigorous, reproducible MEG/EEG research.

2026-04-08T12:01:20Z Xiaobo Liu http://arxiv.org/abs/2512.02503v2 2026-04-08T10:29:46Z

Studying learning-related plasticity is central to understanding the acquisition of complex skills, for example learning to master a musical instrument. Over the past three decades, conventional group-based functional magnetic resonance imaging (fMRI) studies have advanced our understanding of how humans' neural representations change during skill acquisition. However, group-based fMRI studies average across heterogeneous learners and often rely on coarse pre- versus post-training comparisons, limiting the spatial and temporal precision with which neural changes can be estimated. Here, we outline an individual-specific precision approach that tracks neural changes within individuals by collecting high-quality neuroimaging data frequently over the course of training, mapping brain function in each person's own anatomical space, and gathering detailed behavioral measures of learning, allowing neural trajectories to be directly linked to individual learning progress. Complementing fMRI with mobile neuroimaging methods, such as functional near-infrared spectroscopy (fNIRS), will enable researchers to track plasticity during naturalistic practice and across extended time scales. This multi-modal approach will enhance sensitivity to individual learning trajectories and will offer more nuanced insights into how neural representations change with training. We also discuss how findings can be generalized beyond individuals, including through statistical methods based on replication in additional individuals. Together, this approach allows researchers to design highly informative longitudinal training studies that advance a personalized account of skill learning in the human brain.

2025-12-02T07:47:32Z Simon Leipold Ryssa Moffat http://arxiv.org/abs/2604.08604v1 2026-04-08T09:26:20Z

Various effects in human cognition, often considered `non-classical', have been argued to be most naturally modelled by quantum-like models of decision making. We extend this approach to describe models of cognition and decision-making in general probabilistic process theories, which include both classical probabilistic models and quantum instrument models as special cases. We show how many aspects of quantum-like cognition can be described diagrammatically in process theories, before using our approach to assess the arguments for quantum-like models. While standard Bayesian classical models are insufficient, we prove that any sequential decision data can in fact be given a more general form of classical instrument model, and see that even simple deterministic models can exhibit all cognitive effects. Restricting attention to instruments induced by measurements, such as classical Bayesian and quantum POVM models, rules out such a result, but is challenged by the fact that such instruments cannot account for certain effects. Finally, we argue that to strictly rule out classical instrument models one should make use of parallel composition in the modelling of joint decisions, and find real world cognitive data violating Bell inequalities.

2026-04-08T09:26:20Z Sean Tull Masanao Ozawa http://arxiv.org/abs/2503.02642v3 2026-04-08T08:57:05Z

In both machine learning and in computational neuroscience, plasticity in functional neural networks is frequently expressed as gradient descent on a cost. Often, this imposes symmetry constraints that are difficult to reconcile with local computation, as is required for biological networks or neuromorphic hardware. For example, wake-sleep learning in networks characterized by Boltzmann distributions assumes symmetric connectivity. Similarly, the error backpropagation algorithm is notoriously plagued by the weight transport problem between the representation and the error stream. Existing solutions such as feedback alignment circumvent the problem by deferring to the robustness of these algorithms to weight asymmetry. However, they scale poorly with network size and depth. We introduce spike-based alignment learning (SAL), a complementary learning rule for spiking neural networks, which uses spike timing statistics to extract and correct the asymmetry between effective reciprocal connections. Apart from being spike-based and fully local, our proposed mechanism takes advantage of noise. Based on an interplay between Hebbian and anti-Hebbian plasticity, synapses can thereby recover the true local gradient. This also alleviates discrepancies that arise from neuron and synapse variability -- an omnipresent property of physical neuronal networks. We demonstrate the efficacy of our mechanism using different spiking network models. First, SAL can significantly improve convergence to the target distribution in probabilistic spiking networks versus Hebbian plasticity alone. Second, in neuronal hierarchies based on cortical microcircuits, SAL effectively aligns feedback weights to the forward pathway, thus allowing the backpropagation of correct feedback errors. Third, our approach enables competitive performance in deep networks using only local plasticity for weight transport.

2025-03-04T14:05:39Z 28 pages, 15 figures. Updated with a comparison to the STDWI algorithm Timo Gierlich Andreas Baumbach Akos F. Kungl Kevin Max Mihai A. Petrovici http://arxiv.org/abs/2510.02824v2 2026-04-07T20:26:58Z

Background: The locus of the gene PTK2B encoding the tyrosine kinase Pyk2 has been associated with the risk of late-onset Alzheimer's disease, the predominant form of dementia. Pyk2 is primarily expressed in neurons where it is involved in excitatory neurotransmission and synaptic functions. Although previous studies have implicated Pyk2 in amyloid-beta and Tau pathologies of Alzheimer's disease, its exact role remains unresolved, with evidence showing both detrimental and protective effects in mouse models. Here, we investigate the role of Pyk2 in hippocampal hyperactivity, Tau synaptic localization and synaptic loss associated with Alzheimer's disease-related alterations occurring in the early stages of the disease. Methods: Pyk2's involvement in amyloid-beta oligomer-induced hippocampal neuronal hyperactivity was investigated using whole-cell patch clamp in hippocampal slices from WT and Pyk2 KO mice. Various Pyk2 mutants were overexpressed in cultured cortical neurons to study Pyk2's role in synaptic loss. Pyk2 and Tau interaction was assessed with bimolecular fluorescence complementation assays in cultured neurons and co-immunoprecipitation in mouse cortex. To evaluate the impact of Pyk2 on Tau expression in synapses, cellular fractionation was performed on hippocampi from WT and Pyk2 KO mice. Results: Genetic deletion of Pyk2 prevented amyloid-beta oligomer-induced hippocampal neuronal hyperactivity and synaptic loss. Overexpression of Pyk2 in neurons decreased dendritic spine density independently of its autophosphorylation or kinase activity, but through its proline-rich motif 1. Furthermore, Pyk2 interacted with Tau in synapses, while Pyk2 deletion decreased Tau synaptic localization in the hippocampus. Conclusions: Pyk2 contributes to hippocampal neuronal hyperactivity and synaptic loss, two early events in Alzheimer's disease pathogenesis. It is also involved in Tau synaptic localization, a process known to be detrimental in Alzheimer's disease. These findings highlight Pyk2 as a critical player in Alzheimer's disease pathophysiology and suggest its potential as a promising therapeutic target for early intervention.

2025-10-03T09:04:16Z Quentin Rodriguez GIN, UGA Floriane Payet GIN, UGA Karina Vargas-Baron GIN, UGA Eve Borel GIN, UGA Fabien Lanté GIN, UGA Sylvie Boisseau GIN, UGA Béatrice Blot GIN, UGA Jean-Antoine Girault IFM - Inserm U1270 - SU, INSERM Alain Buisson GIN, UGA http://arxiv.org/abs/2604.06395v1 2026-04-07T19:29:21Z

Spiking reservoir computing provides an energy-efficient approach to temporal processing, but reliably tuning reservoirs to operate at the edge-of-chaos is challenging due to experimental uncertainty. This work bridges abstract notions of criticality and practical stability by introducing and exploiting the robustness interval, an operational measure of the hyperparameter range over which a reservoir maintains performance above task-dependent thresholds. Through systematic evaluations of Leaky Integrate-and-Fire (LIF) architectures on both static (MNIST) and temporal (synthetic Ball Trajectories) tasks, we identify consistent monotonic trends in the robustness interval across a broad spectrum of network configurations: the robustness-interval width decreases with presynaptic connection density $β$ (i.e., directly with sparsity) and directly with the firing threshold $θ$. We further identify specific $(β, θ)$ pairs that preserve the analytical mean-field critical point $w_{\text{crit}}$, revealing iso-performance manifolds in the hyperparameter space. Control experiments on Erdős-Rényi graphs show the phenomena persist beyond small-world topologies. Finally, our results show that $w_{\text{crit}}$ consistently falls within empirical high-performance regions, validating $w_{\text{crit}}$ as a robust starting coordinate for parameter search and fine-tuning. To ensure reproducibility, the full Python code is publicly available.

2026-04-07T19:29:21Z Ruggero Freddi Nicolas Seseri Diana Nigrisoli Alessio Basti http://arxiv.org/abs/2602.07816v3 2026-04-07T00:53:33Z

Human eye-hand coordination relies on internal forward models that predict future states and compensate for sensory delays. During line tracing, the gaze typically leads the hand through predictive saccades, yet the extent to which this predictive window reflects expertise or intrinsic individual traits remains unclear. In this study, I examined eye-hand coordination in professional calligraphers and non-experts performing a controlled line tracing task. The temporal coupling between saccade distance (SD) and pen speed (PS) revealed substantial interpersonal variability: SD-PS peak times ranged from approximately -50 to 400 ms, forming stable, participant-specific predictive windows that were consistent across trials. These predictive windows closely matched each individual's pen catch-up time, indicating that the oculomotor system stabilizes fixation in anticipation of the hand's future velocity rather than relying on reactive pursuit. Neither the spatial indices (mean gaze-pen distance, mean saccade distance) nor the temporal index (SD-PS peak time) differed between calligraphers and non-calligraphers, and none of these predictive parameters correlated with tracing accuracy. These findings suggest that diverse predictive strategies can achieve equivalent performance, consistent with the minimum intervention principle of optimal feedback control. Together, the results indicate that predictive timing in eye-hand coordination reflects a stable, idiosyncratic Predictive Protocol shaped by individual neuromotor constraints rather than by expertise or training history.

2026-02-08T04:45:48Z 21 pages, 8 figures, 2 supplementary figures (in a separate pdf file), supplementary video (in youtube link) Emiko Shishido