Microblog Emotion Analysis Using Improved DBN Under Spark Platform

Microblog Emotion Analysis Using Improved DBN Under Spark Platform

Wanjun Chang, Yangbo Li, Qidong Du
DOI: 10.4018/IJITSA.318141
Article PDF Download
Open access articles are freely available for download

Abstract

In order to solve the problems that traditional single-machine methods find it difficult to complete the task of emotion classification quickly, and the time efficiency and scalability are not high; a microblog emotion analysis method using improved deep belief network (DBN) under Spark platform is proposed. First, the Hadoop distributed file system is used to realize the distributed storage of text data, and the preprocessed data and emotion dictionary are converted into word vector representation based on the continuous bag-of-words model. Then, an improved DBN model is constructed by combining the adaptive learning method of DBN with the active learning method, and it is applied to the learning analysis of text word vectors. Finally, the data parallel optimization of the improved DBN model is realized, based on Spark platform to accurately and quickly obtain the emotion types of microblog texts. The experimental analysis of the proposed method based on the microblog text data set shows that the classification accuracy is more than 94%.
Article Preview
Top

Introduction

With the rapid development of information technology and the advent of the cloud era, the term big data is mentioned and recognized increasingly and people are becoming increasingly aware of the importance of data and trying to explore their hidden value. The term “big data” is usually used to describe the massive data generated in the era of information explosion, which is characterized by the massive information generated by social networks (Sravya, 2020). In brief, a social network is a structure established between people through friends, blood relatives, transactions, interests, links, and other relationships. Social networks are formed based on the relationships between their members, and their purpose is to establish social contact (Zhang et al., 2022). Users share personal information freely through social networks and can also obtain and disseminate other information from other people conveniently and quickly (Bharath et al., 2021; Saraswathy et al., 2021). Due to their influence and the breadth and depth of communication available, people express their emotions and opinions on social networks more and more widely. The massive emotional information flow hidden in social networks seems to be fragmented and disordered, but it may provide huge value when mined through appropriate techniques. This makes research on the emotion classification of texts based on massive data very important (Al, 2021).

Among social networks, microblogs are favored because of their convenient use, rapid dissemination, and strong interaction capabilities. Consequently, they have become one of the mainstream online social networking platforms. However, traditional text emotion classification research is carried out on a single machine. Given the massive data appearing in social networks, traditional emotion analysis algorithm implementations running on single machines cannot accomplish the task of emotion classification quickly, and their time efficiency and limited scalability become a bottleneck. It is therefore necessary to study calculation modes suitable for emotion classification tasks applied to massive data (Samah, 2021). The emergence and development of cloud computing provide a new solution for emotional classification tasks applied to massive data, which allows the shortcomings of traditional single-machine computing approaches to be overcome. The feasibility of emotion classification tasks on massive data is enhanced through distributed emotion classification algorithms and architectures (Mutanov et al., 2021). However, existing cloud computing platforms and methods do not take into account computational efficiency and analysis accuracy, so it is necessary to conduct in-depth research on these aspects.

Complete Article List

Search this Journal:
Reset
Volume 17: 1 Issue (2024)
Volume 16: 3 Issues (2023)
Volume 15: 3 Issues (2022)
Volume 14: 2 Issues (2021)
Volume 13: 2 Issues (2020)
Volume 12: 2 Issues (2019)
Volume 11: 2 Issues (2018)
Volume 10: 2 Issues (2017)
Volume 9: 2 Issues (2016)
Volume 8: 2 Issues (2015)
Volume 7: 2 Issues (2014)
Volume 6: 2 Issues (2013)
Volume 5: 2 Issues (2012)
Volume 4: 2 Issues (2011)
Volume 3: 2 Issues (2010)
Volume 2: 2 Issues (2009)
Volume 1: 2 Issues (2008)
View Complete Journal Contents Listing