https://arxiv.org/api/6E3wVrTpBy2kQXZm7+f/CYeuj+k 2026-06-25T21:04:32Z 54922 810 15 http://arxiv.org/abs/2512.06238v2 2026-05-15T18:05:40Z

Directed information and its causally conditioned variations are often used to measure causal influences between random processes. In practice, these quantities must be measured from data. Non-asymptotic error bounds for these estimates are known for sequences over finite alphabets, but less is known for real-valued data. This paper examines the case in which the data are sequences of Gaussian vectors. We provide an explicit formula for causally conditioned directed information rate based on optimal prediction and define an estimator based on this formula. We show that our estimator gives an error of order $O\left(N^{-1/2}\log(N)\right)$ with high probability, where $N$ is the total sample size.

2025-12-06T01:30:57Z 9 pages, 1 figure; accepted by IFAC World Congress 2026 Yuping Zheng Andrew Lamperski http://arxiv.org/abs/2605.16229v1 2026-05-15T17:39:57Z

Dependence among marginally constrained observations can break a finite-sample barrier. To formalize this phenomenon, we introduce the \emph{minimum list entropy coupling} $H(P\|Q_1,\dots,Q_m)$, the minimum conditional entropy $H(X|Y_1,\dots,Y_m)$ over all joint distributions with prescribed discrete marginals $X\sim P$ and $Y_i\sim Q_i$. Unlike classical formulations based on independent observations, our model allows $Y_1,\dots,Y_m$ to be arbitrarily dependent while keeping each marginal fixed. This enlarged coupling space reveals a sharp dichotomy: independent observations reduce residual uncertainty exponentially, whereas dependent observations can eliminate it exactly after finitely many samples. We characterize this zero-entropy regime through necessary and sufficient conditions and give concrete structural criteria under which it occurs. In particular, under mild support assumptions, zero entropy is achieved with $O(\log(1/P_{\min}))$ observations, where $P_{\min}$ is the minimum nonzero mass of $P$. We also develop a greedy algorithm with monotone approximation guarantees for computing $H(P\|Q_1,\dots,Q_m)$. Finally, we show that the same framework formalizes finite-sample limits in distribution-matching representation learning and randomness extraction, where zero entropy corresponds to exact recovery and exact extraction.

2026-05-15T17:39:57Z Shahab Asoodeh Jun Chen http://arxiv.org/abs/2605.16225v1 2026-05-15T17:35:52Z

The study of optimal preemption policies for status update systems has been a recurring topic in the age of information (AoI) literature, where threshold-based structures have been shown to be optimal under a generate-at-will update generation model under certain assumptions. In this work, we study the effectiveness of threshold-based policies for a system with random update arrivals. In this regard, we introduce an analytical framework for evaluating the AoI of multi-threshold preemption policies and present interesting characteristics of the structure of the optimal preemption policy. We show the effectiveness of these threshold-based policies over the traditional probabilistic preemption policies and single-threshold policies, where we observe that significant gains in terms of AoI can be obtained by utilizing both the age of the packet and the age of the system when designing these preemption policies.

2026-05-15T17:35:52Z Sahan Liyanaarachchi Sennur Ulukus Nail Akar http://arxiv.org/abs/2605.16196v1 2026-05-15T17:11:50Z

In this paper, we investigate a bistatic multiple-input multiple-output (MIMO) integrated sensing and communication (ISAC) system over block-fading channels, focusing on the scenario where the sensing and communication receivers (Rxs) are co-located. Under the assumption of unknown channel state information (CSI) at the Rx, two schemes are considered: pilot sensing (PS) and data-aided sensing (DAS). The communication rate-sensing distortion functions for both schemes are characterized. For the DAS scheme, a closed-form asymptotic expression for the sensing distortion is derived by using random matrix theory (RMT). The asymptotic performance analysis explicitly quantifies the significant gains of the DAS scheme, revealing a strict $3$ dB effective SNR improvement in the low-SNR regime and a strictly faster performance scaling rate in the high-SNR limit compared to the PS scheme.

2026-05-15T17:11:50Z Dongsheng Peng Chengkai Zhao Yihong Li Zhiqing Wei Jun Chen Ping Chen http://arxiv.org/abs/2605.16176v1 2026-05-15T16:55:00Z

The groundbreaking metric age of information (AoI) has been introduced to measure information freshness in communication networks. As transformational as it is, AoI metric falls short in some applications, such as remote monitoring, since it is a semantic-agnostic metric which does not consider the dynamics of the random process. There is a need to quantify the performance of a remote estimator via a metric that combines freshness and semantic aspects. To this end, in this paper, we introduce a novel metric coined age of staleness (AoS) that measures when the last time that the current estimation was correct. First, we analyze a simple scenario where an $n$-ary symmetric Markov source is observed by a monitor via a constant sampling rate, obtain a closed-form expression for the AoS, and show that it is a monotonically decreasing function of the sampling rate. Next, we consider multiple distinct Markov sources, and formulate an optimization problem, where the remote monitor allocates the total sampling rate to tracking the sources. Although the optimization problem is non-convex, its structure is suitable for obtaining a near-optimal solution using the polyblock algorithm, which leverages the monotonicity of the objective function. While the new AoS metric could be applicable in many scenarios, we believe it is particularly well-suited for a digital twin network (DTN) where multiple physical objects (POs) are monitored with a total sampling rate constraint to maintain a digital representation of them, namely, their digital twin (DT).

2026-05-15T16:55:00Z Ismail Cosandal Sennur Ulukus http://arxiv.org/abs/2605.16140v1 2026-05-15T16:19:29Z

We investigate the problem of covert quickest change detection in a Bayesian and infinite-horizon setting. A legitimate entity seeks to detect a change in the state of a discrete memoryless channel as quickly as possible by actively probing it. Simultaneously, the entity must ensure its probing remains covert from an adversary monitoring the channel for active sensing. We introduce the expected covertness budget (ECB) as an analytically tractable covertness metric that bounds from above the relative entropy between the observation sequences induced by active and passive sensing. Under constraints on both the probability of false alarm (PFA) and the ECB, we establish a second-order asymptotic converse bound on the average detection delay as the PFA constraint approaches zero, for any positive ECB constraint, explicitly quantifying the maximum square-root-order covert sensing gain possible. Furthermore, we propose an achievability scheme utilizing a constant-sensing-probability Shiryaev-type policy and show that it matches the second-order asymptotic converse. We illustrate our result with a numerical example.

2026-05-15T16:19:29Z 36 pages, 2 figures. Submitted to IEEE ITW 2026 Yun-Feng Lo Matthieu R. Bloch http://arxiv.org/abs/2605.16126v1 2026-05-15T16:11:10Z

For a fixed flow-based generative model under a small inference budget, sample quality can depend strongly on where the sampler spends its few function evaluations. Flow matching and Schrödinger bridges define probability paths, yet their inference grids are usually heuristic or inherited from one-endpoint diffusion. We derive a conditional-marginal entropy-rate objective for bridge-aware discretization, separating endpoint-conditioned bridge geometry from marginal flow evolution, and use it to build a training-free entropic inference-time scheduler from first principles. For Gaussian Brownian bridges this rate is closed-form and U-shaped, motivating boundary-heavy nonuniform grids. On trained two-dimensional bridge/flow models, the estimated profile recovers the predicted shape and improves 10-step ODE-Heun MMD over linear by 18.1%, with a paired 22.7% SDE-Heun improvement in the same low-NFE sweep. On EDM/CIFAR-10, the entropic time-discretization gives the best tested five-step FID (186.3 \pm 4.0 versus 200.5 \pm 2.9 for linear and 238.0 \pm 5.3 for cosine). On AlphaFlow protein generation, entropic conditional-marginal (cond-marg) scheduling shows advantage in low-NFE regimes on both CAMEO22 and ATLAS benchmarks. These results support entropy-rate scheduling as a practical low-budget allocation signal for high-dimensional bridge and flow samplers.

2026-05-15T16:11:10Z Bruno Trentini Dejan Stancevic Michael M. Bronstein Alexander Tong Luca Ambrogioni http://arxiv.org/abs/2605.16110v1 2026-05-15T15:57:08Z

Grain-boundary (GB) local stress is central to the initiation and evolution of long-term creep damage in polycrystalline superalloys. Owing to the high-dimensional nonlinear relationships between the GB stress response and multiple crystallographic, microstructural, and micromechanical characteristics, it remains challenging to identify the key characteristics governing GB stress and to elucidate their mechanisms of influence. Dislocation-climb-affected crystal-plasticity finite-element simulations of minimal grain clusters are combined with an integrated causation-guided machine-learning framework, in which mechanics-informed descriptors are analyzed by causation entropy to identify governing mechanisms and then distilled into a reduced-order regression form for interpretable prediction of GB normal stress. Among 18 physically motivated characteristics, the GB inclination angle, the slip transmission, the climb-related Schmid-type indicator, and the elastic-modulus mismatch are found to be dominant, revealing the coupled roles of interfacial geometry, crystallographic compatibility, creep stress relaxation, and micromechanical contrast. The identified characteristics hierarchy and functional representation remain effective under multiaxial loading and can be extended to tricrystal systems through physically interpretable nonlocal augmentation when a purely local description becomes insufficient, demonstrating strong physical consistency and robust generalizability across physical conditions. The extracted candidate functions also improve surrogate-model performance across multiple machine-learning model classes, providing supporting evidence for the physical relevance and efficiency of the identified representation. The proposed methods demonstrate strong potential for the development of interpretable machine-learning models and for the study of microscale nonlocal damage.

2026-05-15T15:57:08Z Weichen Kong Yanwei Dai Yinglin Zhang Yinghua Liu http://arxiv.org/abs/2605.16094v1 2026-05-15T15:49:42Z

Wideband channel estimation (CE) in high-mobility scenarios remains challenging because channel responses vary rapidly, while practical systems can allocate only sparse pilots to accommodate dense users. Fortunately, many high-mobility environments, such as high-speed railways, exhibit scheduled trajectories, predictable velocities, and a limited number of dominant propagation paths. These properties induce a delay--beam power spectrum that is more stable than the instantaneous complex channel frequency response (CFR), less sensitive to the random phase coherence, and rich in geometric information. To exploit such environmental properties, we propose GeoGS-CE, a two-stage channel estimation framework for sparse-pilot high-mobility scenarios. In the offline stage, GeoGS-CE jointly models: 1) a scene-level 3D Gaussian representation that captures the non-line-of-sight (NLoS) geometric scattering support, and 2) a leakage-aware differentiable wireless rendering process that maps the NLoS Gaussians, together with an explicit virtual line-of-sight (LoS) component, to the measured delay--beam power spectrum, while accounting for practical OFDM delay and array leakage effects. In the online stage, the delay--beam power spectrum is predicted for each user location and used as a strong covariance prior, enabling accurate full-band and full-array CFR reconstruction and tracking through a linear MMSE estimator. Simulations based on channels generated from a segment of the Guangshen high-speed railway show that the proposed geometric prior substantially improves CFR reconstruction over pilot-only and non-geometric baselines.

2026-05-15T15:49:42Z Yumeng Zhang Jiajia Guo Chaozheng Wen Chenghong Bian Jun Zhang http://arxiv.org/abs/2601.20477v4 2026-05-15T15:24:06Z

We study the training dynamics of neural classifiers through the lens of binary hypothesis testing. We re-formalize classification as a collection of binary tests between class-conditional distributions induced by learned representations and show empirically that, along training trajectories, well-generalizing networks progressively approach Neyman-Pearson optimal decision rules, as measured by monotonic growth in the KL divergence retained by learned representations. We provide sufficient conditions for exact optimality, discuss its implications for training regularization, and define an informational plane, (so-called Evidence-Error plane) where convergence can be assessed methodically across network architecture.

2026-01-28T10:46:44Z Kadircan Aksoy Protim Bhattacharjee Peter Jung http://arxiv.org/abs/2505.24573v2 2026-05-15T15:18:13Z

In this work, we introduce maximally recoverable codes with locality and availability. We consider locally repairable codes (LRCs) where certain subsets of $ t $ symbols belong each to $ N $ local repair sets, which are pairwise disjoint after removing the $ t $ symbols, and which are of size $ r+δ-1 $ and can correct $ δ-1 $ erasures locally. Classical LRCs with $ N $ disjoint repair sets and LRCs with $ N $-availability are recovered when setting $ t = 1 $ and $ t=δ-1=1 $, respectively. Allowing $ t > 1 $ enables our codes to reduce the storage overhead for the same locality and availability. In this setting, we define maximally recoverable LRCs (MR-LRCs) as those that can correct any globally correctable erasure pattern given the locality and availability constraints. We then identify a large class of global erasure patterns that can be corrected by such MR-LRCs and prove that they are all the correctable patterns when $ t=1 $. We provide three explicit constructions of LRCs that can correct such erasure patterns (thus MR-LRCs for $ t=1 $), based on MSRD codes, each attaining the smallest finite-field sizes for some parameter regime. Finally, we extend the known lower bound on finite-field sizes from classical MR-LRCs to our setting (for any value of $ t $).

2025-05-30T13:25:44Z Umberto Martínez-Peñas V. Lalitha http://arxiv.org/abs/2407.07689v5 2026-05-15T14:34:11Z

We give a complete characterization of simple graphs whose adjacency matrices generate binary linear complementary dual (LCD) codes. In particular, we completely characterize a distance-regular graph which yields an LCD code in terms of the intersection array parameters. This necessary and sufficient criterion strengthens the previously known sufficient conditions and unifies the cases of complete, Hamming, Johnson, and Grassmann graphs. As further applications, we prove that non-isomorphic conference graphs with $q \equiv 1 \pmod 8$ yield inequivalent codes and we classify all simple graphs with idempotent adjacency matrices on at most $13$ vertices via mass formulas for binary LCD codes.

2024-07-10T14:17:33Z Major revision. Update Abstract and Introduction Keita Ishizuka http://arxiv.org/abs/2605.15950v1 2026-05-15T13:41:19Z

This work extends the generalized nearest neighbor decoding (GNND), originally developed as a receiver architecture for memoryless channels, to a vectorized GNND (Vec-GNND) suitable for in-block memory (IBM) channels. Leveraging the generalized mutual information (GMI) as an operational lower bound on the mismatch capacity, an analytical characterization of the optimal Vec-GNND is obtained for general IBM channels with Gaussian codebooks. The formalism further provides closed-form optimality conditions and achievable GMIs for restricted variants of the receiver architecture. Furthermore, we formulate a GMI-based joint design viewpoint for Gaussian codebook covariance and decoding metrics. Since the metric optimization admits a closed-form solution for each fixed covariance, the joint design is reduced to an input-covariance optimization problem; for the diagonal covariance family, we derive first-order self-consistent optimality conditions. Numerical evaluations on block noncoherent additive white Gaussian noise channels and phase noise channels demonstrate consistent performance gains over conventional scaling-based baselines, highlighting the substantial advantages and potential relevance of the proposed Vec-GNND in realistic communication scenarios.

2026-05-15T13:41:19Z Yuhao Liu Xinwei Li Shuqin Pang Hao Wu Wenyi Zhang http://arxiv.org/abs/2605.15925v1 2026-05-15T13:07:37Z

Let $\mathbb{F}_{p^m}$ be the field containing $p^m$ elements where $p$ is an odd prime and $m \in \mathbb{N}$. In this article, we propose a unified approach to the study of skew constacyclic codes of length $np^s$ over the ring $R_k = \mathbb{F}_{p^m}[u]/\langle u^k \rangle,$ where $n, s, k \in \mathbb{N}$ and $\gcd(n, p)=1$. Consider the skew polynomial ring $R_k[x;Θ]$, where $Θ$ is an automorphism of $R_k$ such that $xa = Θ(a)x$ for all $a \in R_k$. Let $f(x)$ be a central irreducible divisor of $x^{np^s} - λ$ of degree $l$ and multiplicity $j$ in $R_k[x;Θ]$, where $λ$ is an invertible element in $R_k$. In this article, we study skew constacyclic codes of length \(np^s\) over \(R_k\), which reduces to the study of skew polycyclic codes of length $jl$ associated with a polynomial \(f(x)^j\). Using the fact that skew polycyclic codes associated with a polynomial \(f(x)^j\) can be described by the left ideal structure of the quotient ring $R_k[x;Θ]/\langle f(x)^{j}\rangle$, we investigate this class of codes for specific choices of $Θ$. In particular, if $λ$ is an invertible element of $\mathbb{F}_{p^m}$, we classify all left ideals and establish an isomorphism between skew cyclic and skew constacyclic codes, under suitable conditions. Furthermore, we provide a comprehensive analysis of skew constacyclic codes of length $3p^s$ over $R_k$. Finally, we examine skew cyclic and skew negacyclic codes of length $6p^s$ over $R_k$ using the factorization of $x^{6p^s} - 1$ and $x^{6p^s} + 1$, respectively; with a complete case-by-case analysis. Examples demonstrating codes with optimal parameters are also included.

2026-05-15T13:07:37Z Seema Chahal Seema Antil Sugandha Maheshwary Manju Khan http://arxiv.org/abs/2602.23892v2 2026-05-15T11:20:19Z

Fully Probabilistic design (FPD) is a powerful framework offering an elegant and unifying account of stochastic control, learning and decision-making. Here we introduce a generalized FPD framework, which we term as Tsallis FPD. Tsallis FPD uses Tsallis divergence in place of the Kullback-Leibler divergence that defines the standard FPD cost term. Tsallis divergence is a natural generalization of the KL divergence, rooted in non-extensive statistical mechanics and providing flexibility towards modeling stochastic processes with non-Gaussian tail behavior. After formulating Tsallis FPD, we develop a constructive proof of convergence by formulating a fixed point iteration. The construction takes the form of a double iteration scheme that performs a sequence of backwards inductions, rather than a single pass down the stages that constitutes the proven approach for classical FPD. We prove that this construction asymptotically converges to a fixed point and that this fixed point is an optimal solution to Tsallis FPD.

2026-02-27T10:39:41Z Vyacheslav Kungurtsev Giovanni Russo