SciPhy Reinforcement Learning for Portfolio Optimization

2026-07-16T16:51:24Z

This paper introduces a dynamic portfolio optimization framework for large institutional investors using Scientific Physics-Informed Reinforcement Learning (SciPhyRL). Formulated in continuous time over an extended state space that includes explicit cumulative costs, the approach leverages offline historical data to learn optimal, distribution-aware strategies. A core innovation reduces the optimization challenge to solving an HJB equation by projecting it onto observed trajectories as a pathwise Hamilton-Jacobi equation. This is solved directly from data using PINN in a single offline sweep, eliminating the need for traditional value or policy iteration. To make the method effective at practical short horizons, the control variable is recast from a continuous trading rate to a discrete target holding. This ensures signal-implied positions are reached immediately, while execution costs are evaluated against a microstructure-grounded quadratic price impact model. Evaluated on a $14$-asset ETF universe using an engineered oracle signal, the learned Gibbs policy yields substantial out-of-sample Sharpe ratio improvements over static and myopic baselines. The results demonstrate that the proposed framework successfully translates known signal quality into a robust, multi-period, and cost-aware allocation mechanism with strictly controlled volatility and turnover.

Breaking the Trend: How to Avoid Cherry-Picked Signals

2026-07-15T13:58:30Z

Our empirical results show an impressive fit with the pretty complex theoretical Sharpe formula of a trend-following strategy depending on the parameter of the signal, which was derived by by Grebenkov and Serror (2014). That empirical fit convinces us that a mean-reversion process with only one time scale is enough to model, in a pretty precise way, the reality of the trend-following mechanism at the average scale of CTAs and as a consequence, using only one simple EMA, appears optimal to capture the trend. As a consequence, using a complex basket of different complex indicators as signal, do not seem to be so rational or optimal and exposes to the risk of cherry-picking.

Mean-Field Price Formation on Trees with Multi-Population and Non-Rational Agents

2026-07-15T13:34:16Z

This work solves the equilibrium price formation problem for the risky stock by combining mean-field game theory with the binomial tree framework, adapting the classic approach of Cox, Ross & Rubinstein. For agents with exponential and recursive utilities of exponential-type, we prove the existence of a unique mean-field market-clearing equilibrium and derive an explicit analytic formula for equilibrium transition probabilities of the stock price on the binomial lattice. The agents face stochastic terminal liabilities and incremental endowments that depend on unhedgeable common and idiosyncratic factors, in addition to the stock price path. We also incorporate an external order flow. Furthermore, the analytic tractability of the proposed approach allows us to extend the framework in two important directions: First, we incorporate multi-population heterogeneity, allowing agents to differ in functional forms for their liabilities, endowments, and risk coefficients. Second, we relax the rational expectations hypothesis by modeling agents operating under subjective probability measures which induce stochastically biased views on the stock transition probabilities. Our numerical examples illustrate the qualitative effects of these components on the equilibrium price distribution.

Wealth Taxation as a Drift Modification: A Fokker-Planck Approach to Tax Neutrality

2026-07-13T14:52:35Z

We reformulate the neutral wealth tax framework of Froeseth (2026; arXiv:2603.05264) in the language of stochastic dynamics and statistical physics. Individual wealth under geometric Brownian motion satisfies a Langevin equation with multiplicative noise; the probability density of wealth across a population then evolves according to a Fokker-Planck equation. A proportional wealth tax at market value enters as a uniform reduction of the drift coefficient, preserving the diffusion structure and all relative probability currents. This drift-shift symmetry is the physical content of tax neutrality. Each channel through which neutrality breaks down in practice - book-value assessment, liquidity frictions, forced dividend extraction, migration, and market impact - corresponds to a specific violation of this symmetry: a state-dependent, asset-dependent, or flow-dependent modification of the Fokker-Planck equation. The framework clarifies when wealth taxation is a benign rescaling of the dynamics and when it introduces genuinely new physics.

Decision-Induced Ranking Explains Prediction Inflation and Excessive Turnover in SPO-Based Portfolio Optimization

2026-07-13T10:36:25Z

Decision-focused learning (DFL) is attractive for portfolio optimization because it trains predictors according to downstream decision quality rather than prediction accuracy alone. However, SPO(Smart, Predict then Optimize surrogate)-based DFL may produce inflated return signals and unstable portfolio reallocations. This study provides a KKT-based interpretation showing that portfolio decisions can be viewed as ranking over risk- and transaction-cost-adjusted marginal scores. Empirically, we examine prediction inflation and excessive turnover in SPO-trained portfolios, and evaluate clipping, min-max rescaling, and partial portfolio adjustment as practical stabilization mechanisms. The results suggest that realistic output constraints and portfolio-level turnover control improve the implementability of SPO-based portfolio strategies.

Where the Quantum Lives in D-Wave Hybrid Portfolio Optimization: An Operational Decomposition Audit

2026-07-12T10:27:13Z

Hybrid quantum-classical solvers conceal how reported performance divides between quantum-processing-unit (QPU) access and other service time. We audit D-Wave's Leap service on cardinality-constrained mean-variance portfolio instances from N=10 to 640, comparing constraint-native CQMs, penalty-encoded BQMs, Gurobi MIQP, simulated annealing, and a matched-budget Tabu baseline, and we propose a four-metric operational audit of the exposed timing fields. LeapHybridCQM matches Gurobi's proven optimum on all 54 head-to-head instances at N<=120, yet its mean QPU access is 0.034 s: 0.68% of the nominal five-second budget; telemetry does not resolve the residual into classical computation, orchestration, or budget granularity. Across 108 fixed-seed five-second CPU runs on 36 instances, TabuSampler reaches CQM-level objectives with mean absolute delta 0.00078 (maximum 0.00798); at N in {400,640} the mean is 3.04e-5. This establishes classical objective achievability, not an internal QPU ablation. We prove that quadratic encoding of exact cardinality adds a dense rank-one term and, apart from isolated exact coefficient cancellations, yields a complete logical graph independent of covariance support, with a bounded-degree embedding lower bound; the resulting density collapse is consistent with hybrid-BQM degradation. A descriptive five-window Fama-French overlay of post-projection direct-QPU portfolios yields mean Sharpe 1.94 versus 2.22 for 1/N. These results do not establish a quantum-sampling advantage; they motivate reporting QPU wall-clock fraction, optimality gap, density amplification, service-output variance, and matched-budget classical controls, keeping operational accounting separate from causal attribution.

Universal portfolios in continuous time: an approach in pathwise Itô calculus

2026-07-11T15:41:18Z

We provide a simple and straightforward approach to a continuous-time version of Cover's universal portfolio strategies within the model-free context of Föllmer's pathwise Itô calculus. We establish the existence of the universal portfolio strategy and prove that its portfolio value process is the average of all values of constant rebalanced strategies. This result relies on a systematic comparison between two alternative descriptions of self-financing trading strategies within pathwise Itô calculus. We moreover provide a comparison result for the performance and the realized volatility and variance of constant rebalanced portfolio strategies.

Large-Scale Portfolio Optimization Problem Under Cardinality Constraint With Enhanced Multi-Objective Evolutionary Algorithms

2026-07-10T16:12:58Z

Decision-making is posing an increasingly formidable challenge to investors because of the growing number of alternatives available in financial markets. A hot area of research over the past few decades has been portfolio optimization that seeks to determine how much an investor should invest in which asset. Introducing real-world conditions to the optimization model turns the problem into an NP-hard one for whose solution exact methods become inefficient; hence, researchers have turned to evolutionary algorithms to approximate solutions. In this paper, strengthening strategies are presented for multi-objective evolutionary algorithms that can provide a faster convergence rate and extensive search ability in the portfolio optimization problem under the cardinality constraint. To implement those features, a unique solution representation, a novel operator, and new repair mechanisms are introduced for solving the aforementioned problem in which lower and upper limits are set on the number of assets in the portfolio. For this purpose, new mating strategies along with the aforesaid package are implemented in well-known multi-objective evolutionary algorithms to solve the problem. The customized algorithms are subsequently tested against traditional ones using well-known market indices as benchmarks. Results indicate that the proposed strategy not only provides better approximations but also converges faster as well at no loss of performance with an increasing number of assets in the market.

A novel robust mixed integer linear programming model for index tracking problem under no rebalancing: heuristic optimization approach

2026-07-10T16:02:16Z

Passive management has increasingly won popularity over the past few years because of its advantages, such as lower management fees and transaction costs. Index tracking endeavors to reproduce the performance of an index with smaller sets of assets. In this paper, a novel formulation is proposed that is not only more robust than the existing ones but also performs better on out-of-sample data and tracks indices over long periods without any considerable deviation or the need for rebalancing. Solving index tracking problems in a polynomial time is a challenging task due to their NP-hard nature. To address this issue, a novel heuristic based on metaheuristic algorithms and local branching is also developed to solve the proposed model. The heuristic enjoys not only the exploration capabilities of a genetic algorithm but the characteristics of local search algorithms as well. The data from the OR library is used to verify the capabilities of the proposed heuristic in comparison with commercial solvers. Results indicate that not only is the heuristic able to converge to optimal solutions for not-so-large problem sizes, but the portfolios it generates also outperform those yielded by commercial solvers in terms of both in-sample and out-of-sample data.

Objective and subjective entropy measures of portfolio suboptimality

2026-07-10T15:17:51Z

The cost of holding a suboptimal portfolio instead of the Kelly-optimal one admits two exact relative-entropy representations. Under the true measure, the expected log-wealth shortfall equals the KL divergence from the true measure to the measure under which the suboptimal portfolio would be optimal. Under that measure, the suboptimal portfolio appears to outperform the Kelly portfolio, and the apparent outperformance equals the reverse KL divergence.

Heterogeneous Returns and Wealth Tax Neutrality: A Fokker-Planck Framework

2026-07-10T13:57:06Z

We extend the Fokker-Planck framework of Froseth (2026, arXiv:2603.05283) to populations of investors with heterogeneous, persistent return-generating ability. When the drift coefficient in the Langevin equation for log-wealth varies across investors, the proportional wealth tax remains a uniform drift shift but ceases to be neutral in the economic sense: its real incidence differs across ability types, and the stationary wealth distribution changes shape. We derive the extended Fokker-Planck equation on the joint space of log-wealth and ability, characterise the conditions under which the drift-shift symmetry breaks, and identify the consequences for asset prices and portfolio allocations. The analysis connects the neutrality results of Froseth (2026, arXiv:2603.05264) and the Fokker-Planck dynamics of Froseth (2026, arXiv:2603.05283) to the heterogeneous-returns literature, notably the "use-it-or-lose-it" mechanism of Guvenen, Kambourov, Kuruscu, Ocampo-Diaz and Chen (2023).

Spectral Portfolio Theory: From SGD Weight Matrices to Wealth Dynamics

2026-07-10T13:43:58Z

We develop spectral portfolio theory by establishing a direct identification: neural network weight matrices trained on stochastic processes are portfolio allocation matrices, and their spectral structure encodes factor decompositions and wealth concentration patterns. The three forces governing stochastic gradient descent (SGD) - gradient signal, dimensional regularisation, and eigenvalue repulsion - translate directly into portfolio dynamics: smart money, survival constraint, and endogenous diversification. The spectral properties of SGD weight matrices transition from Marchenko-Pastur statistics (additive regime, short horizon) to inverse-Wishart via the free log-normal (multiplicative regime, long horizon), mirroring the transition from daily returns to long-run wealth compounding. We unify the cross-sectional wealth dynamics of Bouchaud and Mezard (2000), the within-portfolio dynamics of Olsen et al. (2025), and the scalar Fokker-Planck framework via a common spectral foundation. A central result is the Spectral Invariance Theorem: any isotropic perturbation to the portfolio objective preserves the singular-value distribution up to scale and shift, while anisotropic perturbations produce spectral distortion proportional to their cross-asset variance. We develop applications to portfolio design, wealth inequality measurement, tax policy, and neural network diagnostics. In the tax context, the invariance result recovers and generalises the neutrality conditions of Froseth (2026).

Augmenting Fundamental Analysis with Large Language Models: A RAG-Based System for Generating Investor Briefs

2026-07-10T06:20:40Z

In this study, we examine the opportunities brought by Large Language Models (LLMs) to various aspects of fundamental analysis of companies based on their reports as well as data and documents describing macroeconomic situation like GDP and inflation changes as well as documents filled to the U.S. Securities and Exchange Commission (SEC) which can be found in EDGAR. We were preprocessing those data and than sending via API to gpt-4o model in a Retrieval-Augmented Generation (RAG) like regime. We prepared as well a document describing an exemplar investor knowledge based on Kitchin cycles. We were scanning data important for analysis of 9 companies for 4 weeks. Using LLM we were producing automatic briefs about them. They were sent to nine participants who are individual investors to evaluate usefulness of such approach to data analysis.

Low-Turnover Rebalancing for Sparse Index Tracking

2026-07-08T16:33:21Z

Sparse index tracking is often evaluated through rolling reconstruction: a sparse portfolio is fitted on an in-sample window, held over the next period, and rebuilt when the window rolls forward. This can achieve low realised tracking error, but it treats rebalancing primarily as repeated construction and can generate large turnover and frequent substitutions in the selected constituents. We propose a new workflow that separates sparse-tracker construction from sparse-tracker maintenance. A hybrid optimisation-plus-sampling framework provides the metrics operating at the decision level for both layers. The initial tracker is built from a calibrated shrinkage model and uncertainty-aware posterior support screening. Subsequent rebalance dates are handled in the self-financing change variable $Δw$. The default action is to preserve the existing tracker; local repairs are implemented only when realised tracking deterioration and posterior directional evidence jointly suggest intervention. In a 2020-2025 S&P 500-style case study, we show that the proposed tracker occupies a distinct low-turnover operating region. Moreover, we demonstrate that the proposed $Δw$ maintenance layer can be attached to externally constructed trackers, where it gives consistent improvements over simply holding the initial tracker. Additional diagnostics, sensitivity experiments, and computational details are reported in the companion Supplementary Material. Replication code and logs of several experiments are available at \href{https://github.com/droxanas/Low-Turnover-Rebalancing-for-Sparse-Index-Tracking/}{https://github.com/droxanas/Low-Turnover-Rebalancing-for-Sparse-Index-Tracking/}.

Dynamic Causal Portfolio Choice: Hedging the Rotation of the Common-Driver Manifold

2026-07-07T18:20:45Z

When a portfolio is conditioned on a minimal set of observable drivers under which its assets become mutually independent over the investment horizon, the dynamic investment problem acquires a distinctive geometric structure. We study continuous-time portfolio choice in this setting. The conditioning representation, rather than the asset vector, becomes the natural state of the problem, and it moves: the sensitivity of returns to the drivers depends on the state, the conditioning set may itself change over time, and the induced information geometry both rotates and, at discrete instants, jumps. The optimal policy separates into a static component that allocates along the conditioning geometry at each instant and an intertemporal component that hedges the predictable motion of that geometry, a first-order effect in the model rather than a refinement, placing the coordinates of the information geometry in the role played by exogenous state variables in classical intertemporal asset pricing. Because the problem is organized by the drivers, its computational cost is governed by their number rather than by the number of assets. Changes in the conditioning set generate a risk that continuous trading cannot span, so the market is incomplete in the direction of its own geometry. The analysis is carried out in a controlled diffusion model, and the resulting structure is illustrated on synthetic economies designed to isolate each mechanism.