Papers, wiki, Option Blackboard, encyclopedia, and cards.
The most commonly used form of regularization typically involves defining the penalty function as a L1 or L2 norm. However, numerous alternative approaches remain untested in practical applications. In this study, we apply ten different penalty functions to predict electricity prices and evaluate their performance under two different model structures and in two distinct electricity markets. The study reveals that LQ …
The task we consider is portfolio construction in a speculative market, a fundamental problem in modern finance. While various empirical works now exist to explore deep learning in finance, the theory side is almost non-existent. In this work, we focus on developing a theoretical framework for understanding the use of data augmentation for deep-learning-based approaches to quantitative finance. The proposed theory cl…
Improvements in return forecast accuracy do not always lead to proportional improvements in portfolio decision quality, especially under realistic trading frictions and constraints. This paper adopts the Smart Predict--then--Optimize (SPO) paradigm for portfolio optimization in real markets, which explicitly aligns the learning objective with downstream portfolio decision quality rather than pointwise prediction accu…
Deep Learning is evolving fast and integrates into various domains. Finance is a challenging field for deep learning, especially in the case of interpretable artificial intelligence (AI). Although classical approaches perform very well with natural language processing, computer vision, and forecasting, they are not perfect for the financial world, in which specialists use different metrics to evaluate model performan…
In this paper, we propose $\ell_p$-norm regularized models to seek near-optimal sparse portfolios. These sparse solutions reduce the complexity of portfolio implementation and management. Theoretical results are established to guarantee the sparsity of the second-order KKT points of the $\ell_p$-norm regularized models. More interestingly, we present a theory that relates sparsity of the KKT points with Projected cor…
We develop a behavioral model for liquidity and volatility based on empirical regularities in trading order flow in the London Stock Exchange. This can be viewed as a very simple agent based model in which all components of the model are validated against real data. Our empirical studies of order flow uncover several interesting regularities in the way trading orders are placed and cancelled. The resulting simple mod…
We address the problem of asset pricing in a market where there is no risky asset. Previous work developed a theoretical model for a shadow riskless rate (SRR) for such a market in terms of the drift component of the state-price deflator for that asset universe. Assuming asset prices are modeled by correlated geometric Brownian motion, in this work we develop a computational approach to estimate the SRR from empirica…
Finding the hedge ratios for a portfolio and risk compression is the same mathematical problem. Traditionally, regression is used for this purpose. However, regression has its own limitations. For example, in a regression model, we can't use highly correlated independent variables due to multicollinearity issue and instability in the results. A regression model cannot also consider the cost of hedging in the hedge ra…
We introduce a unified framework for rapid, large-scale portfolio optimization that incorporates both shrinkage and regularization techniques. This framework addresses multiple objectives, including minimum variance, mean-variance, and the maximum Sharpe ratio, and also adapts to various portfolio weight constraints. For each optimization scenario, we detail the translation into the corresponding quadratic programmin…
The goal of cryptocurrencies is decentralization. In principle, all currencies have equal status. Unlike traditional stock markets, there is no default currency of denomination (fiat), thus the trading pairs can be set freely. However, it is impractical to set up a trading market between every two currencies. In order to control management costs and ensure sufficient liquidity, we must give priority to covering those…
This article presents a Hawkes process model with Markovian baseline intensities for high-frequency order book data modeling. We classify intraday order book trading events into a range of categories based on their order types and the price changes after their arrivals. To capture the stimulating effects between multiple types of order book events, we use the multivariate Hawkes process to model the self- and mutuall…
We show that stochastic recovery always leads to counter-intuitive behaviors in the risk measures of a CDO tranche - namely, continuity on default and positive credit spread risk cannot be ensured simultaneously. We then propose a simple recovery variance regularization method to control the magnitude of negative credit spread risk while preserving the continuity on default.
We consider a structural stochastic volatility model for the loss from a large portfolio of credit risky assets. Both the asset value and the volatility processes are correlated through systemic Brownian motions, with default determined by the asset value reaching a lower boundary. We prove that if our volatility models are picked from a class of mean-reverting diffusions, the system converges as the portfolio become…
A new approach to obtaining market--directional information, based on a non-stationary solution to the dynamic equation "future price tends to the value that maximizes the number of shares traded per unit time" [1] is presented. In our previous work[2], we established that it is the share execution flow ($I=dV/dt$) and not the share trading volume ($V$) that is the driving force of the market, and that asset prices a…
We introduce a dynamic credit portfolio framework where optimal investment strategies are robust against misspecifications of the reference credit model. The risk-averse investor models his fear of credit risk misspecification by considering a set of plausible alternatives whose expected log likelihood ratios are penalized. We provide an explicit characterization of the optimal robust bond investment strategy, in ter…
We consider the problem of portfolio optimization in the presence of market impact, and derive optimal liquidation strategies. We discuss in detail the problem of finding the optimal portfolio under Expected Shortfall (ES) in the case of linear market impact. We show that, once market impact is taken into account, a regularized version of the usual optimization problem naturally emerges. We characterize the typical b…
The trade size $ω$ has direct impact on the price formation of the stock traded. Econophysical analyses of transaction data for the US and Australian stock markets have uncovered market-specific scaling laws, where a master curve of price impact can be obtained in each market when stock capitalization $C$ is included as an argument in the scaling relation. However, the rationale of introducing stock capitalization in…
Dropout randomly zeroes hidden units during training so the net cannot rely on any single co-adaptation, then scales weights at test time (or uses inverted dropout).
Early stopping treats training time as a capacity knob: halt when a validation metric stops improving so the model does not wander into overfit.
Overfitting is when a model fits training idiosyncrasies instead of the transferable regularity, so held-out or live error rises even as train loss falls.
Regularization is any constraint that trades train fit for expected live error: weight decay, dropout, early stopping, data augmentation, or a simpler hypothesis class.