Social media event prediction using DNN with feedback mechanism

Ma, Wanlun, Hu, Xiangyu, Chen, Chao, Wen, Sheng, Choo, Kim-Kwang Raymond, and Xiang, Yang (2022) Social media event prediction using DNN with feedback mechanism. ACM Transactions on Management Information Systems, 13 (3). 33.

[img] PDF (Publisher Accepted Version) - Published Version
Restricted to Repository staff only

View at Publisher Website:


Online social networks (OSNs) are a rich source of information, and the data (including user-generated content) can be mined to facilitate real-world event prediction. However, the dynamic nature of OSNs and the fast-pace nature of social events or hot topics compound the challenge of event prediction. This is a key limitation in many existing approaches. For example, our evaluations of six baseline approaches (i.e., logistic regression latent Dirichlet allocation (LDA)-based logistic regression (LR), multi-task learning (MTL), long short-term memory (LSTM) and convolutional neural networks, and transformer-based model) on three datasets collected as part of this research (two from Twitter and one from a news collection site1), reveal that the accuracy of these approaches is between 50% and 60%, and they are not capable of utilizing new events in event predictions. Hence, in this article, we develop a novel DNN-based framework (hereafter referred to as event prediction with feedback mechanism— EPFM. Specifically, EPFM makes use of a feedback mechanism based on emerging events detection to improve the performance of event prediction. The feedback mechanism ensembles three outlier detection processes and returns a list of new events. Some of the events will then be chosen by analysts to feed into the fine-tuning process to update the predictive model. To evaluate EPFM, we conduct a series of experiments on the same three datasets, whose findings show that EPFM achieves 80% accuracy in event detection and outperforms the six baseline approaches.We also validate EPFM’s capability of detecting new events by empirically analyzing the feedback mechanism under different thresholds.

Item ID: 73388
Item Type: Article (Research - C1)
ISSN: 2158-6578
Copyright Information: © 2022 Association for Computing Machinery.
Date Deposited: 27 Jul 2022 23:49
FoR Codes: 46 INFORMATION AND COMPUTING SCIENCES > 4609 Information systems > 460903 Information modelling, management and ontologies @ 50%
46 INFORMATION AND COMPUTING SCIENCES > 4602 Artificial intelligence > 460299 Artificial intelligence not elsewhere classified @ 50%
SEO Codes: 22 INFORMATION AND COMMUNICATION SERVICES > 2204 Information systems, technologies and services > 220401 Application software packages @ 100%
Downloads: Total: 2
Last 12 Months: 1
More Statistics

Actions (Repository Staff Only)

Item Control Page Item Control Page