A Scalable Reinforcement Learning-based System Using On-Chain Data for Cryptocurrency Portfolio Management
Abstract: On-chain data (metrics) of blockchain networks, akin to company fundamentals, provide crucial and comprehensive insights into the networks. Despite their informative nature, on-chain data have not been utilized in reinforcement learning (RL)-based systems for cryptocurrency (crypto) portfolio management (PM). An intriguing subject is the extent to which the utilization of on-chain data can enhance an RL-based system's return performance compared to baselines. Therefore, in this study, we propose CryptoRLPM, a novel RL-based system incorporating on-chain data for end-to-end crypto PM. CryptoRLPM consists of five units, spanning from information comprehension to trading order execution. In CryptoRLPM, the on-chain data are tested and specified for each crypto to solve the issue of ineffectiveness of metrics. Moreover, the scalable nature of CryptoRLPM allows changes in the portfolios' cryptos at any time. Backtesting results on three portfolios indicate that CryptoRLPM outperforms all the baselines in terms of accumulated rate of return (ARR), daily rate of return (DRR), and Sortino ratio (SR). Particularly, when compared to Bitcoin, CryptoRLPM enhances the ARR, DRR, and SR by at least 83.14%, 0.5603%, and 2.1767 respectively.
- Binance. 2022. Market Data Endpoints. https://binance-docs.github.io/apidocs/spot/en/
- Predicting Cryptocurrencies Market Phases through On-Chain Data Long-Term Forecasting. In Proceedings of the IEEE International Conference on Blockchain and Cryptocurrency 2023. 1–4.
- Optimal Versus Naive Diversification: How Inefficient is the 1/N Portfolio Strategy? The Review of Financial Studies 22, 5 (12 2007), 1915–1953. https://doi.org/10.1093/rfs/hhm075 arXiv:https://academic.oup.com/rfs/article-pdf/22/5/1915/24429471/hhm075.pdf
- Eugene F. Fama. 1970. Efficient Capital Markets: A Review of Theory and Empirical Work. The Journal of Finance 25, 2 (1970), 383–417. http://www.jstor.org/stable/2325486
- Zhenhan Huang and Fumihide Tanaka. 2022a. Investment Biases in Reinforcement Learning-based Financial Portfolio Management. In 2022 61st Annual Conference of the Society of Instrument and Control Engineers (SICE). 494–501. https://doi.org/10.23919/SICE56594.2022.9905789
- Zhenhan Huang and Fumihide Tanaka. 2022b. MSPM: A modularized and scalable multi-agent reinforcement learning-based system for financial portfolio management. PLOS ONE 17, 2 (02 2022), 1–24. https://doi.org/10.1371/journal.pone.0263689
- An On-Chain Analysis-Based Approach to Predict Ethereum Prices. IEEE Access 9 (2021), 167972–167989. https://doi.org/10.1109/ACCESS.2021.3135620
- Huisu Jang and Jaewook Lee. 2017. An empirical study on modeling and prediction of bitcoin prices with bayesian neural networks based on blockchain information. Ieee Access 6 (2017), 5427–5437.
- Stochastic neural networks for cryptocurrency price prediction. Ieee access 8 (2020), 82804–82818.
- A Deep Reinforcement Learning Framework for the Financial Portfolio Management Problem. arXiv:1706.10059Â [q-fin.CP] https://arxiv.org/abs/1706.10059 arXiv:1706.10059.
- Adversarial Deep Reinforcement Learning in Portfolio Management. arXiv:1808.09940Â [q-fin.PM] https://arxiv.org/abs/1808.09940 arXiv:1808.09940.
- Giorgio Lucarelli and Matteo Borrotti. 2019. A Deep Reinforcement Learning Approach for Automated Cryptocurrency Trading. In Artificial Intelligence Applications and Innovations, John MacIntyre, Ilias Maglogiannis, Lazaros Iliadis, and Elias Pimenidis (Eds.). Springer International Publishing, Cham, 247–258.
- Deep Reinforcement Learning to Automate Cryptocurrency Trading. In 2022 12th International Conference on System Engineering and Technology (ICSET). 36–41. https://doi.org/10.1109/ICSET57543.2022.10010940
- Toward characterizing blockchain-based cryptocurrencies for highly accurate predictions. IEEE Systems Journal 14, 1 (2019), 321–332.
- Santiment. 2022a. daily-active-addresses. https://academy.santiment.net/metrics/daily-active-addresses/
- Santiment. 2022b. On-chain, Social and Financial API. https://api.santiment.net
- Frank A. Sortino and Lee N. Price. 1994. Performance Measurement in a Downside Risk Framework. The Journal of Investing 3, 3 (1994), 59–64. https://doi.org/10.3905/joi.3.3.59
- Tether. 2022. What are Tether tokens and how do they work? https://tether.to/en/how-it-works
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.