Coherent Topic Modeling for Creative Multimodal Data on Social Media

Rashid, Junaid, Kim, Jungeun, and Naseem, Usman (2023) Coherent Topic Modeling for Creative Multimodal Data on Social Media. In: Proceedings of the ACM Web Conference 2023. pp. 3923-3927. From: WWW 2023: The ACM Web Conference 2023, April 30 - May 4 2023, Austin, TX, USA.

[img] PDF (Published Version) - Published Version
Restricted to Repository staff only

View at Publisher Website: https://doi.org/10.1145/3543507.3587433


Abstract

The creative web is all about combining different types of media to create a unique and engaging online experience. Multimodal data, such as text and images, is a key component in the creative web. Social media posts that incorporate both text descriptions and images offer a wealth of information and context. Text in social media posts typically relates to one topic, while images often convey information about multiple topics due to the richness of visual content. Despite this potential, many existing multimodal topic models do not take these criteria into account, resulting in poor quality topics being generated. Therefore, we proposed a Coherent Topic modeling for Multimodal Data (CTM-MM), which takes into account that text in social media posts typically relates to one topic, while images can contain information about multiple topics. Our experimental results show that CTM-MM outperforms traditional multimodal topic models in terms of classification and topic coherence.

Item ID: 79249
Item Type: Conference Item (Research - E1)
ISBN: 9781450394161
Keywords: Coherence, Creative Web, Multimodal, Topic Modeling
Copyright Information: © 2023 Copyright held by the owner/author(s).
Date Deposited: 08 Aug 2023 01:06
FoR Codes: 46 INFORMATION AND COMPUTING SCIENCES > 4602 Artificial intelligence > 460208 Natural language processing @ 100%
SEO Codes: 22 INFORMATION AND COMMUNICATION SERVICES > 2204 Information systems, technologies and services > 220403 Artificial intelligence @ 100%
More Statistics

Actions (Repository Staff Only)

Item Control Page Item Control Page