Peivandizadeh, Ali, Hatami, Sima, Nakhjavani, Amirhossein, Khoshsima, Lida, Chalak Qazani, Mohammad Reza, Haleem, Muhammad, and Alizadehsani, Roohallah (2024) Stock market prediction with transductive long short-term memory and social media sentiment analysis. IEEE Access, 12. pp. 87110-87130.

Preview

PDF (Published Version) - Published Version Available under License Creative Commons Attribution Non-commercial No Derivatives. Download (2MB) | Preview

Abstract

In an era dominated by digital communication, the vast amounts of data generated from social media and financial markets present unique opportunities and challenges for forecasting stock market prices. This paper proposes an innovative approach that harnesses the power of social media sentiment analysis combined with stock market data to predict stock prices, directly addressing the critical challenges in this domain. A major challenge in sentiment analysis is the uneven distribution of data across different sentiment categories. Traditional models struggle to accurately identify fewer common sentiments (minority class) due to the overwhelming presence of more common sentiments (majority class). To tackle this, we introduce the Off-policy Proximal Policy Optimization (PPO) algorithm, specifically designed to handle class imbalance by adjusting the reward mechanism in the training phase, thus favoring the correct classification of minority class instances. Another challenge is effectively integrating the temporal dynamics of stock prices with sentiment analysis results. Our solution is implementing a Transductive Long Short-Term Memory (TLSTM) model that incorporates sentiment analysis findings with historical stock data. This model excels at recognizing temporal patterns and gives precedence to data points that are temporally closer to the prediction point, enhancing the prediction accuracy. Ablation studies confirm the effectiveness of the Off-policy PPO and TLSTM components on the overall model performance. The proposed approach advances the field of financial analytics by providing a more nuanced understanding of market dynamics but also offers actionable insights for investors and policymakers seeking to navigate the complexities of the stock market with greater precision and confidence.

Item ID:	86711
Item Type:	Article (Research - C1)
ISSN:	2169-3536
Copyright Information:	© 2024 The Authors. This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License. For more information, see https://creativecommons.org/licenses/by-nc-nd/4.0/
Date Deposited:	10 Sep 2025 04:58
FoR Codes:	46 INFORMATION AND COMPUTING SCIENCES > 4605 Data management and data science > 460501 Data engineering and data science @ 70% 46 INFORMATION AND COMPUTING SCIENCES > 4601 Applied computing > 460199 Applied computing not elsewhere classified @ 30%
SEO Codes:	22 INFORMATION AND COMMUNICATION SERVICES > 2201 Communication technologies, systems and services > 220199 Communication technologies, systems and services not elsewhere classified @ 100%
	More Statistics