Papers, wiki, Option Blackboard, encyclopedia, and cards.
We find the equilibrium contract that an automated market maker (AMM) offers to their strategic liquidity providers (LPs) in order to maximize the order flow that gets processed by the venue. Our model is formulated as a leader-follower stochastic game, where the venue is the leader and a representative LP is the follower. We derive approximate closed-form equilibrium solutions to the stochastic game and analyze the …
Ethereum's beacon chain hosts over 920,000 active validators, a number inflated by the legacy 32 ETH stake cap. The Pectra upgrade (May 2025) addresses this by introducing 0x02 compounding validators, raising the maximum stake per validator from 32 to 2,048 ETH and enabling automatic reward reinvestment. This paper examines how compounding affects consensus-layer rewards, whether higher balances provide execution-lay…
Reinforcement Learning (RL) has enabled Large Language Models (LLMs) to achieve remarkable reasoning in domains like mathematics and coding, where verifiable rewards provide clear signals. However, extending this paradigm to financial decision is challenged by the market's stochastic nature: rewards are verifiable but inherently noisy, causing standard RL to degenerate into reward hacking. To address this, we propose…
Derivatives, as a critical class of financial instruments, isolate and trade the price attributes of risk assets such as stocks, commodities, and indices, aiding risk management and enhancing market efficiency. However, traditional hedging models, constrained by assumptions such as continuous trading and zero transaction costs, fail to satisfy risk control requirements in complex and uncertain real-world markets. Wit…
Recently, there are many trials to apply reinforcement learning in asset allocation for earning more stable profits. In this paper, we compare performance between several reinforcement learning algorithms - actor-only, actor-critic and PPO models. Furthermore, we analyze each models' character and then introduce the advanced algorithm, so called Reward clipping model. It seems that the Reward Clipping model is better…
In this paper, we propose a methodology based on piece-wise homogeneous Markov chain for credit ratings and a multivariate model of the credit spreads to evaluate the financial risk in European Union (EU). Two main aspects are considered: how the financial risk is distributed among the European countries and how large is the value of the total risk. The first aspect is evaluated by means of the expected value of a dy…
Transaction costs and regime shifts are major reasons why paper portfolios fail in live trading. We introduce FR-LUX (Friction-aware, Regime-conditioned Learning under eXecution costs), a reinforcement learning framework that learns after-cost trading policies and remains robust across volatility-liquidity regimes. FR-LUX integrates three ingredients: (i) a microstructure-consistent execution model combining proporti…
Concentrated liquidity automated market makers (AMMs), such as Uniswap v3, enable liquidity providers (LPs) to earn liquidity rewards by depositing tokens into liquidity pools. However, LPs often face significant financial losses driven by poorly selected liquidity provision intervals and high costs associated with frequent liquidity reallocation. To support LPs in achieving more profitable liquidity concentration, w…
To trade tokens in cryptoeconomic systems, automated market makers (AMMs) typically rely on liquidity providers (LPs) that deposit tokens in exchange for rewards. To profit from such rewards, LPs must use effective liquidity provisioning strategies. However, LPs lack guidance for developing such strategies, which often leads them to financial losses. We developed a measurement model based on impermanent loss to analy…
Portfolio management is an important yet challenging task in AI for FinTech, which aims to allocate investors' budgets among different assets to balance the risk and return of an investment. In this study, we propose a general Multi-objectIve framework with controLLable rIsk for pOrtfolio maNagement (MILLION), which consists of two main phases, i.e., return-related maximization and risk control. Specifically, in the …
Decentralized finance (DeFi) has revolutionized the financial landscape, with protocols like Uniswap offering innovative automated market-making mechanisms. This article explores the development of a backtesting framework specifically tailored for concentrated liquidity market makers (CLMM). The focus is on leveraging the liquidity distribution approximated using a parametric model, to estimate the rewards within liq…
In this research paper, we investigate into a paper named "A Deep Reinforcement Learning Framework for the Financial Portfolio Management Problem" [arXiv:1706.10059]. It is a portfolio management problem which is solved by deep learning techniques. The original paper proposes a financial-model-free reinforcement learning framework, which consists of the Ensemble of Identical Independent Evaluators (EIIE) topology, a …
The Proof of Efficient Liquidity (PoEL) protocol, designed for specialised Proof of Stake (PoS) consensus-based blockchains that incorporate intrinsic DeFi applications, aims to support sustainable liquidity bootstrapping and network security. This concept seeks to efficiently utilise budgeted staking rewards to attract and sustain liquidity through a risk-structuring engine and incentive allocation strategy, both of…
Liquidity providers are currently incentivised to provide liquidity through the LP Incentives Programme on dYdX. Based on the various parameters - makerVolume, depths and spreads, they are rewarded accordingly based on their activities. Given the maturity of the BTC and ETH markets, alongside other altcoins which enjoy a consistent amount of liquidity, this paper aims to update the formula to encourage more active an…
Solving portfolio management problems using deep reinforcement learning has been getting much attention in finance for a few years. We have proposed a new method using experts signals and historical price data to feed into our reinforcement learning framework. Although experts signals have been used in previous works in the field of finance, as far as we know, it is the first time this method, in tandem with deep RL,…
Traditional portfolio management methods can incorporate specific investor preferences but rely on accurate forecasts of asset returns and covariances. Reinforcement learning (RL) methods do not rely on these explicit forecasts and are better suited for multi-stage decision processes. To address limitations of the evaluated research, experiments were conducted on three markets in different economies with different ov…
This work proposes a novel portfolio management technique, the Meta Portfolio Method (MPM), inspired by the successes of meta approaches in the field of bioinformatics and elsewhere. The MPM uses XGBoost to learn how to switch between two risk-based portfolio allocation strategies, the Hierarchical Risk Parity (HRP) and more classical Naïve Risk Parity (NRP). It is demonstrated that the MPM is able to successfully ta…
Financial portfolio management is the process of constant redistribution of a fund into different financial products. This paper presents a financial-model-free Reinforcement Learning framework to provide a deep machine learning solution to the portfolio management problem. The framework consists of the Ensemble of Identical Independent Evaluators (EIIE) topology, a Portfolio-Vector Memory (PVM), an Online Stochastic…
Reinforcement learning trains a policy to maximize expected return by interacting with an environment: states, actions, rewards, and (usually) a discount factor.
RLHF fits a reward model to human (or AI) preference comparisons, then optimizes a language model against that reward, usually with a KL penalty back to a reference policy.
Reinforcement learning trains a policy to maximize expected return by interacting with an environment: states, actions, rewards, and (usually) a discount factor.
RLHF fits a reward model to human (or AI) preference comparisons, then optimizes a language model against that reward, usually with a KL penalty back to a reference policy.