https://arxiv.org/api/nklJSeZdKt7fAgUxoP7eLhO2J8Y 2026-03-30T10:20:44Z 60152 150 15 http://arxiv.org/abs/2603.22889v1 2026-03-24T07:38:06Z

Topology optimization (TO) can be viewed as seeking an optimal solution in the design space of a given TO problem. For weakly non-linear TO problems, e.g., compliance minimization, sensitivity-based methods typically converge well, whereas for strongly non-linear problems, e.g., maximum stress minimization, stabilization strategies such as stabilization terms and projection functions are often required to enhance convergence. Especially in scenarios with massive design variables, it is difficult to intuitively demonstrate the non-linear complexity of different TO problems and to elucidate the mechanisms by which stabilization strategies affect convergence. To address this challenge, we propose a visualization framework and a quantitative non-linearity index for objectives with varying complexity. We employ a multi-start fixed-gradient sampling tailored to similarity-based dimensionality reduction while keeping the computational cost under control. The samples are then parameterized via cosine similarity to obtain a low-dimensional visualization surface of the objective function. Based on this visualization, we construct a dimensionless complexity index with a clear geometric interpretation by measuring the gap between the visualization surface and the discrete approximation of its convex envelope, which enables quantitative comparisons of non-linearity across TO tasks, parameter choices, and stabilization strategies. Extensive comparative experiments show that the proposed approach is both adaptable and discriminative on a variety of representative TO problems, and it provides intuitive and measurable guidance for parameter selection.

2026-03-24T07:38:06Z 44 pages, 22 figures Ziliang Wang Jiahua Wu Jun Yang Shintaro Yamasaki http://arxiv.org/abs/2603.22881v1 2026-03-24T07:27:05Z

Sequential decision-making under uncertainty often involves multiple agents learning which actions (arms) yield the highest rewards through repeated interaction with a stochastic environment. This setting is commonly modeled by cooperative multi-agent multi-armed bandit problems, where agents explore and share information without centralized coordination. In many realistic systems, agents have heterogeneous capabilities that limit their access to subsets of arms and communicate over asymmetric networks represented by directed graphs. In this work, we study multi-agent multi-armed bandit problems with partial arm access, where agents explore and exploit only the arms available to them while exchanging information with neighbors. We propose a distributed consensus-based upper confidence bound (UCB) algorithm that accounts for both the arm accessibility structure and network asymmetry. Our approach employs a mass-preserving information mixing mechanism, ensuring that reward estimates remain unbiased across the network despite accessibility constraints and asymmetric information flow. Under standard stochastic assumptions, we establish logarithmic regret for every agent, with explicit dependence on network mixing properties and arm accessibility constraints. These results quantify how heterogeneous arm access and directed communication shape cooperative learning performance.

2026-03-24T07:27:05Z Evagoras Makridis Themistoklis Charalambous http://arxiv.org/abs/2603.22824v1 2026-03-24T05:51:50Z

Implicit bias induced by gradient-based algorithms is essential to the generalization of overparameterized models, yet its mechanisms can be subtle. This work leverages the Normalized Steepest Descent} (NSD) framework to investigate how optimization geometry shapes solutions on multiclass separable data. We introduce NucGD, a geometry-aware optimizer designed to enforce low rank structures through nuclear norm constraints. Beyond the algorithm itself, we connect NucGD with emerging low-rank projection methods, providing a unified perspective. To enable scalable training, we derive an efficient SVD-free update rule via asynchronous power iteration. Furthermore, we empirically dissect the impact of stochastic optimization dynamics, characterizing how varying levels of gradient noise induced by mini-batch sampling and momentum modulate the convergence toward the expected maximum margin solutions.Our code is accessible at: https://github.com/Tsokarsic/observing-the-implicit-bias-on-multiclass-seperable-data.

2026-03-24T05:51:50Z Shengping Xie Zekun Wu Quan Chen Kaixu Tang http://arxiv.org/abs/2510.27211v5 2026-03-24T05:44:17Z

It is known that the minimum-mean-squared-error (MMSE) denoiser under Gaussian noise can be written as a proximal operator, which suffices for asymptotic convergence of plug-and-play (PnP) methods but does not reveal the structure of the induced regularizer or give convergence rates. We show that the MMSE denoiser corresponds to a regularizer that can be written explicitly as an upper Moreau envelope of the negative log-marginal density, which in turn implies that the regularizer is 1-weakly convex. Using this property, we derive (to the best of our knowledge) the first sublinear convergence guarantee for PnP proximal gradient descent with an MMSE denoiser. We validate the theory with a one-dimensional synthetic study that recovers the implicit regularizer. We also validate the theory with imaging experiments (deblurring and computed tomography), which exhibit the predicted sublinear behavior.

2025-10-31T06:12:49Z Henry Pritchard Rahul Parhi http://arxiv.org/abs/2603.22802v1 2026-03-24T05:01:21Z

In this paper, we present new results on finite- and fixed-time convergence for dynamical systems using LaSalle-like invariance principles. In particular, we provide first and second-order non-smooth Lyapunov-like results for finite- and fixed-time convergence, thereby relaxing the requirement of existence a differentiable, positive definite Lyapunov function. Based on these findings, we show that a dynamical system whose equilibrium point is globally asymptotically stable can be modified through scaling so that the resulting dynamical system has a fixed-time stable equilibrium point. The results in this paper expand our understanding of various convergence rates and strengthen the hypothesis that all the convergence rates are interconnected through a suitable transformation.

2026-03-24T05:01:21Z Currently under review at an IEEE Conference Kunal Garg http://arxiv.org/abs/2603.22739v1 2026-03-24T03:04:30Z

This paper proposes a variational framework for multi-objective level set topology optimization. The approach interprets the level set function as a generalized coordinate of a fictitious material and derives its equation of motion from Hamilton's principle, resulting in a damped wave equation governing the optimization process. The objective functionals are combined using a weighted sum formulation. An analysis of the underlying system structure reveals a geometric interpretation of the problem, shifting the perspective beyond conventional approaches based on purely discrete approximations of the Pareto frontier. Under suitable regularity assumptions, the set of stationary solutions forms a structured subset in objective space, in which the Pareto frontier is locally embedded and the weighting factors act as intrinsic coordinates. This perspective motivates the introduction of a dynamic evolution of the weights, leading to a coupled dynamical system for the level set function and the weighting parameters that enables adaptive exploration of the objective landscape. Numerical results demonstrate that the proposed framework provides a stable and uniform approximation of the Pareto frontier and scales to higher-dimensional objective spaces.

2026-03-24T03:04:30Z Jan Oellerich Takayuki Yamada http://arxiv.org/abs/2603.22654v1 2026-03-24T00:14:41Z

We develop an optimization-free framework for safe stabilization of single-input control-affine nonlinear systems with a given control Lyapunov function (CLF) and a given control barrier function (CBF), where the desired equilibrium lies in the interior of the safe set. An explicit compatibility condition is derived that is necessary and sufficient for the pointwise simultaneous satisfaction of the CLF and CBF inequalities. When this condition holds, two closed-form continuous state-feedback laws are constructed from the Lie-derivative data of the CLF and CBF via standard universal stabilizer formulas, yielding asymptotic stabilization of the origin and forward invariance of the interior of the safe set, without online quadratic programming. The two laws belong to broader families parametrized by a free nondecreasing function, providing additional design flexibility. When the compatibility condition fails, a safety-prioritizing modification preserves forward invariance and drives the state toward the safe-set boundary until a compatible region is reached, whereupon continuity at the origin and asymptotic stabilization are recovered. The framework produces families of explicit constructive alternatives to CLF-CBF quadratic programming for scalar-input nonlinear systems.

2026-03-24T00:14:41Z Bo Wang Miroslav Krstic http://arxiv.org/abs/2310.03956v2 2026-03-23T23:24:03Z

In computed tomography (CT), the forward model consists of a linear Radon transform followed by an exponential nonlinearity based on the attenuation of light according to the Beer-Lambert Law. Conventional reconstruction often involves inverting this nonlinearity and then solving a linear inverse problem. However, this nonlinear measurement preprocessing is poorly conditioned in the vicinity of high-density materials, such as metal. This preprocessing makes CT reconstruction methods numerically sensitive and susceptible to artifacts near high-density regions. In this paper, we study a technique where the signal is directly reconstructed from raw measurements through the nonlinear forward model. Though this optimization is nonconvex, we show that gradient descent provably converges to the global optimum at a geometric rate, perfectly reconstructing the underlying signal with a near minimal number of random measurements. We also prove similar results in the under-determined setting where the number of measurements is significantly smaller than the dimension of the signal. This is achieved by enforcing prior structural information about the signal through constraints on the optimization variables. We illustrate the benefits of direct nonlinear CT reconstruction with cone-beam CT experiments on synthetic and real 3D volumes, in which metal artifacts are reduced compared to standard linear reconstruction methods. Our experiments also demonstrate that logarithmic preprocessing alone is sufficient to produce metal artifacts, even in the absence of other causes such as beam hardening.

2023-10-06T00:47:57Z Sara Fridovich-Keil Fabrizio Valdivia Gordon Wetzstein Benjamin Recht Mahdi Soltanolkotabi http://arxiv.org/abs/2603.19465v2 2026-03-23T19:13:27Z

We analyze a fixed-point iteration $v \leftarrow φ(v)$ arising in the optimization of a regularized nuclear norm objective involving the Hadamard product structure, posed in DMR+22 in the context of an optimization problem over the space of algorithms in private machine learning. We prove that the iteration $v^{(k+1)} = \text{diag}((D_{v^{(k)}}^{1/2} M D_{v^{(k)}}^{1/2})^{1/2})$ converges monotonically to the unique global optimizer of the potential function $J(v) = 2 \text{Tr}((D_v^{1/2} M D_v^{1/2})^{1/2}) - \sum v_i$, closing a problem left open there. The bulk of this proof was provided by Gemini 3, subject to some corrections and interventions. Gemini 3 also sketched the initial version of this note. Thus, it represents as much a commentary on the practical use of AI in mathematics as it represents the closure of a small gap in the literature. As such, we include a small narrative description of the prompting process, and some resulting principles for working with AI to prove mathematics.

2026-03-19T20:58:02Z 12 pages, 1 figure Keith Rush http://arxiv.org/abs/2603.22469v1 2026-03-23T18:38:29Z

The growing complexity of modern control tasks calls for controllers that can react online as objectives and disturbances change, while preserving closed-loop stability. Recent approaches for improving the performance of nonlinear systems while preserving closed-loop stability rely on time-invariant recurrent neural-network controllers, but offer no principled way to update the controller during operation. Most importantly, switching from one stabilizing policy to another can itself destabilize the closed-loop. We address this problem by introducing a stability-preserving update mechanism for nonlinear, neural-network-based controllers. Each controller is modeled as a causal operator with bounded $\ell_p$-gain, and we derive gain-based conditions under which the controller may be updated online. These conditions yield two practical update schemes, time-scheduled and state-triggered, that guarantee the closed-loop remains $\ell_p$-stable after any number of updates. Our analysis further shows that stability is decoupled from controller optimality, allowing approximate or early-stopped controller synthesis. We demonstrate the approach on nonlinear systems with time-varying objectives and disturbances, and show consistent performance improvements over static and naive online baselines while guaranteeing stability.

2026-03-23T18:38:29Z Danilo Saccani Luca Furieri Giancarlo Ferrari-Trecate http://arxiv.org/abs/2503.05606v3 2026-03-23T16:51:29Z

We study controllability and constructive synthesis for control-affine systems. We introduce trajectory-dependent Gramian maps that extend the linear time-varying Gramian and yield explicit fixed-point synthesis maps. On feasible coercivity classes (uniform eigenvalue lower bounds), the Gramian map is Lipschitz, synthesis iterates exhibit factorial decay, and the Caccioppoli fixed point theorem gives a unique fixed point that steers the system and satisfies an energy identity. When, in addition, an orthogonality condition holds, this fixed point coincides with the unique global minimum-energy control on the feasible set; if the coercivity bound holds uniformly for all bounded controls, the same conclusion holds on the full bounded-control space. We provide structural conditions on the input matrix that ensure the nonemptiness of the feasible class (and, in fully actuated regimes, equality with the full space) and sufficient conditions for underactuated systems via bounded-amplitude reference controls. Case studies on Hopfield network dynamics illustrate refined estimates that enlarge reachable targets. A trajectory-freezing and compactness step extends the synthesis to general nonlinear control-affine systems. The results yield verifiable controllability criteria with explicit, numerically implementable controllers.

2025-03-07T17:30:26Z Cyprien Tamekue ShiNung Ching http://arxiv.org/abs/2603.22155v1 2026-03-23T16:18:31Z

A celebrated method for Variational Inequalities (VIs) is Extragradient (EG), which can be viewed as a standard discrete-time integration scheme. With this view in mind, in this paper we show that EG may suffer from discretization bias when applied to non-linear vector fields, conservative or otherwise. To resolve this discretization shortcoming, we introduce RAndomized Mid-Point for debiAsed Gradient Extrapolation (RAMPAGE) and its variance-reduced counterpart, RAMPAGE+ which leverages antithetic sampling. In contrast with EG, both methods are unbiased. Furthermore, leveraging negative correlation, RAMPAGE+ acts as an unbiased, geometric path-integrator that completely removes internal first-order terms from the variance, provably improving upon RAMPAGE. We further demonstrate that both methods enjoy provable $\mathcal{O}(1/k)$ convergence guarantees for a range of problems including root finding under co-coercive, co-hypomonotone, and generalized Lipschitzness regimes. Furthermore, we introduce symmetrically scaled variants to extend our results to constrained VIs. Finally, we provide convergence guarantees of both methods for stochastic and deterministic smooth convex-concave games. Somewhat interestingly, despite being a randomized method, RAMPAGE+ attains purely deterministic bounds for a number of the studied settings.

2026-03-23T16:18:31Z Abolfazl Hashemi http://arxiv.org/abs/2603.22113v1 2026-03-23T15:41:30Z

Access to healthcare facilities is a critical issue in developing countries, where limited resources and significant challenges hinder progress toward universal health coverage, one of the targets pursued by the United Nations. As a result, the Operations Research (OR) community has become increasingly active in addressing this issue, employing various techniques, particularly optimization. However, making long-term strategic decisions remains challenging, as these often require substantial investments and directly affect large populations. Moreover, much of the existing literature is predominantly theoretical. This paper reviews studies published over the past two decades that use optimization techniques to inform strategic planning decisions aimed at improving health accessibility and specifically contain a case study conducted in a developing country. The review explores the nature of the problems tackled, considering factors such as the level of care, service delivery channels, objectives, criteria, or potential hierarchy, uncertainty, and multi-period settings. Additionally, we discuss the modeling approaches, solution methodologies, and the extent of practical implementation. The goal of this survey is not only to summarize existing work but also to provide a roadmap for future research, offering valuable insights for OR practitioners in the field.

2026-03-23T15:41:30Z Laura Davila-Pena Maria Paola Scaparra Dick den Hertog http://arxiv.org/abs/2603.12140v3 2026-03-23T15:22:56Z

When actions reshape opponents' signals, each agent's optimal response depends on an infinite hierarchy of beliefs about beliefs (Townsend, 1983) that has resisted exact analysis for four decades. We provide the first exact equilibrium characterization of finite-player continuous-time linear-quadratic games with endogenous signals. Estimating primitive shocks rather than the state collapses the belief hierarchy onto deterministic impulse-response maps, reducing Nash equilibrium to a deterministic fixed point with no truncation and no large-population limit. The characterization yields an information wedge pricing the marginal value of shifting opponents' posteriors; it vanishes precisely when signals are exogenous. In a two-player benchmark, nearly all welfare gains from pooling information come from eliminating bilateral belief manipulation rather than from improving state estimation. This strategic channel also governs optimal precision allocation: a planner should concentrate information on the efficient player, since arming the inefficient player maximizes the arms race while starving them of information collapses it.

2026-03-12T16:43:21Z 53 pages, 7 figures Sam Babichenko http://arxiv.org/abs/2603.22090v1 2026-03-23T15:20:26Z

Recommender systems play an essential role in online services by providing personalized item lists to support users' decision-making processes. While collaborative filtering methods can achieve high accuracy, it is crucial to consider not only accuracy but also the diversity of recommended items to improve user satisfaction. Although financial portfolio theory has been applied to balance these factors, existing models are often sensitive to estimation errors in rating statistics. To overcome these challenges, we establish a computational framework of distributionally robust optimization (DRO) for recommendation selection. We first formulate a cardinality-constrained DRO model based on moment-based ambiguity sets to select a specified number of items for each user. We then design a penalty alternating direction method (PADM) to efficiently compute high-quality solutions and prove its convergence properties. Computational experiments using three publicly available rating datasets demonstrate that our DRO model generates more diverse recommendations than existing models while maintaining the same level of accuracy. Additionally, our solution method computes these recommendations for each user in just a few seconds, proving its practical effectiveness. This study establishes a DRO framework that has the potential to enhance the recommendation quality of various collaborative filtering methods.

2026-03-23T15:20:26Z Tomoya Yanagi Shunnosuke Ikeda Ken Kobayashi Yuichi Takano