DRL Optimizes Investment Portfolios for Return and Downside Risk.

Sounaq Das, Tanmay Sen, Raghu Nandan Sengupta, Aditya Gupta· July 9, 2026 View original

Summary

This research proposes MORP-DRL, a deep reinforcement learning framework for bi-objective portfolio optimization that jointly optimizes expected return and downside risk. It uses PPO and advanced risk measures to handle market uncertainty and tail risk, outperforming traditional methods.

Portfolio optimization in uncertain markets is a complex multi-objective problem, balancing return, risk, and various constraints. Existing static optimization methods often fall short in capturing sequential decision-making, tail risk, and market frictions like transaction costs. To address these limitations, researchers developed MORP-DRL (Multi-Objective Reliability Based Deep Reinforcement Learning), a novel framework for portfolio optimization. MORP-DRL employs a deep reinforcement learning approach, specifically using Proximal Policy Optimization (PPO), to simultaneously optimize expected return and minimize downside risk. It incorporates three complementary risk measures: variance, Conditional Value-at-Risk (CVaR), and Entropic Value-at-Risk (EVaR). To model market uncertainty and heavy-tailed behavior, asset returns are simulated using GARCH(1,1), Extreme Value Theory, and t-copula dependence structures. Experiments across different market regimes (pre-COVID, COVID, post-COVID) on ten global equity indices demonstrate that MORP-DRL achieves competitive risk-return performance, significantly reduces downside risk during volatile periods, and scales effectively to high-dimensional portfolios, outperforming traditional methods like NSGA-II.

Why it matters

This framework offers a more dynamic and robust approach to portfolio management, potentially leading to better risk-adjusted returns and improved resilience during market downturns for investors and financial institutions.

How to implement this in your domain

  1. 1Evaluate the MORP-DRL framework for integrating into existing quantitative trading or portfolio management systems.
  2. 2Develop internal expertise in deep reinforcement learning techniques for financial applications.
  3. 3Backtest MORP-DRL strategies against historical data to validate performance across various market conditions.
  4. 4Consider regulatory implications and ethical considerations when deploying AI-driven portfolio optimization.

Who benefits

Financial ServicesInvestment ManagementFintechWealth ManagementInsurance

Key takeaways

  • MORP-DRL uses deep reinforcement learning for bi-objective portfolio optimization.
  • It jointly optimizes expected return and downside risk using multiple risk measures.
  • The framework models market uncertainty with advanced statistical techniques.
  • It shows competitive performance and reduced downside risk across diverse market regimes.

Original post by Sounaq Das, Tanmay Sen, Raghu Nandan Sengupta, Aditya Gupta

"arXiv:2607.06610v1 Announce Type: new Abstract: Portfolio optimization under uncertainty is inherently a multi-objective decision problem involving complex interactions among return, risk, market dynamics, and practical investment constraints. Existing reliability based portfolio…"

View on X

Originally posted by Sounaq Das, Tanmay Sen, Raghu Nandan Sengupta, Aditya Gupta on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses