arXiv · arXiv q-fin · 2025
Execution algorithms are vital to modern trading, they enable market participants to execute large orders while minimising market impact and transaction costs. As these algorithms grow more sophisticated, optimising them becomes increasingly challenging. In this work, we present a reinforcement learning (RL) framework for discovering optimal execution strategies, evaluated within a reactive agent-based market simulat…
Ollie Olby, Andreea Bacalum, Rory Baggott, Namid Stillman
arXiv · arXiv q-fin · 2021
We present a new financial framework where two families of RL-based agents representing the Liquidity Providers and Liquidity Takers learn simultaneously to satisfy their objective. Thanks to a parametrized reward formulation and the use of Deep RL, each group learns a shared policy able to generalize and interpolate over a wide range of behaviors. This is a step towards a fully RL-based market simulator replicating …
Leo Ardon, Nelson Vadori, Thomas Spooner, Mengda Xu, Jared Vann
arXiv · arXiv q-fin · 2024
Developing effective quantitative trading strategies using reinforcement learning (RL) is challenging due to the high risks associated with online interaction with live financial markets. Consequently, offline RL, which leverages historical market data without additional exploration, becomes essential. However, existing offline RL methods often struggle to capture the complex temporal dependencies inherent in financi…
Suyeol Yun
OpenAlex · Review of Financial Studies · 2012 · cites 548
Order flow is toxic when it adversely selects market makers, who may be unaware they are providing liquidity at a loss. We present a new procedure to estimate flow toxicity based on volume imbalance and trade intensity (the VPIN toxicity metric). VPIN is updated in volume time, making it applicable to the high-frequency world, and it does not require the intermediate estimation of non-observable parameters or the app…
David Easley, Marcos López de Prado, Maureen O’Hara
arXiv · arXiv · 2026
Scaling generative inverse and forward rendering to real-world scenarios is bottlenecked by the limited realism and temporal coherence of existing synthetic datasets. To bridge this persistent domain gap, we introduce a large-scale, dynamic dataset curated from visually complex AAA games. Using a novel dual-screen stitched capture method, we extracted 4M continuous frames (720p/30 FPS) of synchronized RGB and five G-…
Zheng-Hui Huang, Zhixiang Wang, Jiaming Tan, Ruihan Yu, Yidan Zhang
arXiv · arXiv · 2026
The Metaverse faces complex resource allocation challenges due to diverse Virtual Environments (VEs), Digital Twins (DTs), dynamic user demands, and strict immersion needs. This paper introduces CIVIC (Cooperative Immersion Via Intelligent Credit-sharing), a novel framework optimizing resource sharing among multiple Metaverse Service Providers (MSPs) to enhance user immersion. Unlike existing methods, CIVIC integrate…
Amr Aboeleneen, Mohamed Abdallah, Aiman Erbad, Amr Salem
OpenAlex · European Finance Review · 2014 · cites 64
Abstract Following the “flash crash” on May 6, 2010, warning signals for impending market stress have been in high demand, yet only the VPIN metric of Easley, López de Prado, and O’Hara (ELO) has claimed success. In addition, ELO find the metric useful in predicting short-term volatility. VPIN involves decomposing volume into active buys and sells. We utilize quotes and trade data to construct an accurate trade class…
Torben G. Andersen, Oleg Bondarenko
OpenAlex · Speech · 2020 · cites 31
Remarks at Brookings-Chicago Booth Task Force on Financial Stability (TFFS) meeting, panel on market liquidity (delivered via videoconference).
Lorie Logan
arXiv · arXiv q-fin · 2026
This study develops and evaluates a deep reinforcement learning framework for dynamic portfolio allocation across global equity markets. The Soft Actor-Critic algorithm is used to learn continuous portfolio weights within a Markov Decision Process, incorporating transaction costs, turnover penalties, and diversification constraints into the reward function. Five model configurations are compared, varying in reward fo…
Kamil Kashif, Robert Ślepaczuk
arXiv · arXiv q-fin · 2022
Market makers play an essential role in financial markets. A successful market maker should control inventory and adverse selection risks and provide liquidity to the market. As an important methodology in control problems, Reinforcement Learning enjoys the advantage of data-driven and less rigid assumptions, receiving great attention in the market-making field since 2018. However, although the China Commodity market…
Junshu Jiang, Thomas Dierckx, Duxiang Xiao, Wim Schoutens
arXiv · arXiv q-fin · 2026
This study aims to determine whether the application of Deep Reinforcement Learning (DRL) as a specialized execution overlay can enhance pair trading in highly volatile cryptocurrency markets. Although classical implementations of the strategy have proven successful in traditional equities, they frequently exhibit rigidity and suffer from severe divergence risks when applied to high-variance environments. To address …
Damian Lebiedź, Robert Ślepaczuk
arXiv · arXiv q-fin · 2025
Considering the continuous-time Mean-Variance (MV) portfolio optimization problem, we study a regime-switching market setting and apply reinforcement learning (RL) techniques to assist informed exploration within the control space. We introduce and solve the Exploratory Mean Variance with Regime Switching (EMVRS) problem. We also present a Policy Improvement Theorem. Further, we recognize that the widely applied Temp…
Yuling Max Chen, Bin Li, David Saunders
arXiv · arXiv q-fin · 2025
We investigate the mechanisms by which medium-frequency trading agents are adversely selected by opportunistic high-frequency traders. We use reinforcement learning (RL) within a Hawkes Limit Order Book (LOB) model in order to replicate the behaviours of high-frequency market makers. In contrast to the classical models with exogenous price impact assumptions, the Hawkes model accounts for endogenous price impact and …
Ali Raza Jafree, Konark Jain, Nick Firoozye
arXiv · arXiv q-fin · 2025
We develop a portfolio allocation framework that leverages deep learning techniques to address challenges arising from high-dimensional, non-stationary, and low-signal-to-noise market information. Our approach includes a dynamic embedding method that reduces the non-stationary, high-dimensional state space into a lower-dimensional representation. We design a reinforcement learning (RL) framework that integrates gener…
Jinghai He, Cheng Hua, Chunyang Zhou, Zeyu Zheng
arXiv · arXiv q-fin · 2024
Cryptocurrency is a cryptography-based digital asset with extremely volatile prices. Around USD 70 billion worth of cryptocurrency is traded daily on exchanges. Trading cryptocurrency is difficult due to the inherent volatility of the crypto market. This study investigates whether Reinforcement Learning (RL) can enhance decision-making in cryptocurrency algorithmic trading compared to traditional methods. In order to…
Hongshen Yang, Avinash Malik
arXiv · arXiv q-fin · 2023
Quantitative markets are characterized by swift dynamics and abundant uncertainties, making the pursuit of profit-driven stock trading actions inherently challenging. Within this context, reinforcement learning (RL), which operates on a reward-centric mechanism for optimal control, has surfaced as a potentially effective solution to the intricate financial decision-making conundrums presented. This paper delves into …
Hengxi Zhang, Zhendong Shi, Yuanquan Hu, Wenbo Ding, Ercan E. Kuruoglu
arXiv · arXiv q-fin · 2022
Within the mathematical finance literature there is a rich catalogue of mathematical models for studying algorithmic trading problems -- such as market-making and optimal execution -- in limit order books. This paper introduces \mbtgym, a Python module that provides a suite of gym environments for training reinforcement learning (RL) agents to solve such model-based trading problems. The module is set up in an extens…
Joseph Jerome, Leandro Sanchez-Betancourt, Rahul Savani, Martin Herdegen
arXiv · arXiv q-fin · 2021
The rapid changes in the finance industry due to the increasing amount of data have revolutionized the techniques on data processing and data analysis and brought new theoretical and computational challenges. In contrast to classical stochastic control theory and other analytical approaches for solving financial decision-making problems that heavily reply on model assumptions, new developments from reinforcement lear…
Ben Hambly, Renyuan Xu, Huining Yang