Short Text Semantic Sentiment Analysis Based on Dual Channel Aspect Attention in Intelligent Systems

Short Text Semantic Sentiment Analysis Based on Dual Channel Aspect Attention in Intelligent Systems

Yan Li
Copyright: © 2024 |Pages: 28
DOI: 10.4018/IJSWIS.336480
Article PDF Download
Open access articles are freely available for download

Abstract

Traditional deep learning models for text sentiment analysis fail to fully harness the contextual semantic information of aspect nodes or use prior sentiment resources. This paper proposes a dual channel sentiment analysis model named M2BERT-BLSTM AA that is based on an enhanced Bidirectional Encoder Representations from Transformers(BERT)and Bidirectional Long short-term memory(BLSTM) model and incorporates a Dual Attention Mechanism. Firstly, an emotional resource database is constructed using existing emotional resources. Secondly, vectors are concatenated following mean and max pooling along the dimension of sentence length. These semantic features mitigate evaluation imbalance.Then the text and sentiment information are encoded separately, using distinct Attention Mechanism(Att-M) to extract contextual relationships and emotional features. The model's Aspect-Based multi-class sentiment prediction accuracies on the three Chinese datasets of Meituan ordering, restaurants, and laptops are 75.2%, 87.5%, and 75%, respectively, showing improved performance on sentiment classification.
Article Preview
Top

Introduction

With the rapid development of social platforms and e-commerce websites, people are now free to express their opinions and emotions on topics of interest. This sentiment-driven information is widely disseminated in various forms, including text, images, videos, and audio. Analyzing these sentiment-imbued opinions can facilitate a better understanding of user behavior, discern users' product preferences, identify user needs, customize marketing strategies, enhance public sentiment analysis, and detect fake news (Sahoo & Gupta, 2021; Sarkissian & Tekli, 2021;Zhang et al., 2021). Accurately analyzing this vast amount of sentiment information has become a research hotspot in the field of natural language processing (NLP).

Text Sentiment Analysis, also referred to as Opinion Mining, is a process aided by computers to swiftly capture and organize the subjective evaluation information on the internet. It adeptly mines and assesses individuals’ viewpoints, emotions, reviews, stances, and the sentimental inclinations of texts about entities like products, services, organizations, events, and topics, followed by inductive reasoning and inference of this mined data (Do et al., 2022; Hajjar & Tekli, 2022; Wang & Yang, 2021).

Currently, researchers both domestically and internationally have shifted their focus from traditional research based on dictionaries and machine learning to sentiment classification methods grounded in deep learning (Barbosa et al., 2022; Daou et al., 2021). For instance, Abdi et al. (2019) acknowledged the strengths of CNN (convolutional neural network) and RNN, proposing an LSTM (long short-term memory) model that elevates the accuracy of sentiment classification in reviews by over 5% through multi-feature fusion. Bin et al. (2022) embarked on sentiment tendency analysis on Weibo using Baidu's ERNIE and a dual attention mechanism (Att-M). Bin et al. performs dynamic Dynamic feature representation of text through ERNIE semantic representation capability, which combines combining sentiment resources and attention mechanism to solve the problem of different meanings for the same word in traditional word vectors, but their approach lacks the use of linguistic features. Xingjie and Yunze (2020) introduced a method based on convolutional neural networks and attention models for text sentiment analysis and personalized recommendations. The dimensions in the user preference vector indicate the user's preference for the corresponding dimension of the product, but there is no effective fusion of ratings and text. Dandan et al. (2021) utilized the BERT model to pre-train balanced short texts, representing language models with feature vectors, subsequently executing Chinese short text categorization; but it does not incorporate location information such as emoticons and symbols.

These deep learning-based methodologies outperform those built on manually crafted features, yet their capability in capturing deeper semantic information remains somewhat deficient (Barr et al., 2022; Tekli et al., 2021). Moreover, there is limited research both domestically and internationally on aspect-based sentiment classification of Chinese short texts. The majority of these studies directly apply attention mechanisms, overlooking the importance of syntactic relationships. This results in an inability to fully utilize the contextual semantic information of aspect nodes and represent polysemy within contexts (Ismail et al., 2022; Sarivougioukas & Vagelatos, 2022). Concurrently, the untapped potential of prior sentiment resources within neural networks leads to subpar sentiment classification outcomes.

Complete Article List

Search this Journal:
Reset
Volume 20: 1 Issue (2024)
Volume 19: 1 Issue (2023)
Volume 18: 4 Issues (2022): 2 Released, 2 Forthcoming
Volume 17: 4 Issues (2021)
Volume 16: 4 Issues (2020)
Volume 15: 4 Issues (2019)
Volume 14: 4 Issues (2018)
Volume 13: 4 Issues (2017)
Volume 12: 4 Issues (2016)
Volume 11: 4 Issues (2015)
Volume 10: 4 Issues (2014)
Volume 9: 4 Issues (2013)
Volume 8: 4 Issues (2012)
Volume 7: 4 Issues (2011)
Volume 6: 4 Issues (2010)
Volume 5: 4 Issues (2009)
Volume 4: 4 Issues (2008)
Volume 3: 4 Issues (2007)
Volume 2: 4 Issues (2006)
Volume 1: 4 Issues (2005)
View Complete Journal Contents Listing