2.1 Quadratic Regularization Clustering Algorithm
Among the fuzzy clustering algorithms, the fuzzy c-means clustering algorithm is the most classical algorithm(Dubey, Y.K., & Mushrif, M.M.,2016). FCM algorithm adjusts the fuzzy factor
, regards the nonlinear parameters
as the regularization of c-means, and iteratively updates the clustering center and membership matrix until the best clustering center is obtained. Different from FCM, quadratic regularization clustering algorithm takes maximum entropy clustering (MEC) as an example (Karayiannis, N.B.,1994; Li,R.,& Mukaidono,M.,1995) and quadratic function
as a new nonlinear term. Give a dataset
consist of
data, where
denotes the dimension of the data in the dataset, and
denotes the number of samples in the dataset. The number of clusters in the dataset can be expressed as
. The quadratic regularization clustering algorithm can be expressed mathematically as the following functions:
(1)where
![IJHSTM.2021070104.m11](https://igiprodst.blob.core.windows.net:443/source-content/9781799833642_241769/IJHSTM.2021070104.m11.png?sv=2015-12-11&sr=c&sig=uByqH5%2B36XyT3eK6QMDjIlNEfhwhaG4SUbAeeroNaEo%3D&se=2021-05-28T06%3A41%3A36Z&sp=r)
represents the clustering centroid,
![IJHSTM.2021070104.m12](https://igiprodst.blob.core.windows.net:443/source-content/9781799833642_241769/IJHSTM.2021070104.m12.png?sv=2015-12-11&sr=c&sig=uByqH5%2B36XyT3eK6QMDjIlNEfhwhaG4SUbAeeroNaEo%3D&se=2021-05-28T06%3A41%3A36Z&sp=r)
represents the membership matrix,
![IJHSTM.2021070104.m13](https://igiprodst.blob.core.windows.net:443/source-content/9781799833642_241769/IJHSTM.2021070104.m13.png?sv=2015-12-11&sr=c&sig=uByqH5%2B36XyT3eK6QMDjIlNEfhwhaG4SUbAeeroNaEo%3D&se=2021-05-28T06%3A41%3A36Z&sp=r)
indicates that the sample point
![IJHSTM.2021070104.m14](https://igiprodst.blob.core.windows.net:443/source-content/9781799833642_241769/IJHSTM.2021070104.m14.png?sv=2015-12-11&sr=c&sig=uByqH5%2B36XyT3eK6QMDjIlNEfhwhaG4SUbAeeroNaEo%3D&se=2021-05-28T06%3A41%3A36Z&sp=r)
belongs to the fuzzy membership value of the
![IJHSTM.2021070104.m15](https://igiprodst.blob.core.windows.net:443/source-content/9781799833642_241769/IJHSTM.2021070104.m15.png?sv=2015-12-11&sr=c&sig=uByqH5%2B36XyT3eK6QMDjIlNEfhwhaG4SUbAeeroNaEo%3D&se=2021-05-28T06%3A41%3A36Z&sp=r)
clustering centroid, and
![IJHSTM.2021070104.m16](https://igiprodst.blob.core.windows.net:443/source-content/9781799833642_241769/IJHSTM.2021070104.m16.png?sv=2015-12-11&sr=c&sig=uByqH5%2B36XyT3eK6QMDjIlNEfhwhaG4SUbAeeroNaEo%3D&se=2021-05-28T06%3A41%3A36Z&sp=r)
represents the regularization parameter.
By using Lagrange optimization and iteratively updating the objective function, it is easy to derive the updated clustering centroid equation as follows:
(2)(3)The formula (3) can be obtained from formula (1). Therefore:
Each
is minimized by
individually:
(4)Suppose
,
can be calculated by formula (4) to satisfy
. Let:
when
![IJHSTM.2021070104.m28](https://igiprodst.blob.core.windows.net:443/source-content/9781799833642_241769/IJHSTM.2021070104.m28.png?sv=2015-12-11&sr=c&sig=uByqH5%2B36XyT3eK6QMDjIlNEfhwhaG4SUbAeeroNaEo%3D&se=2021-05-28T06%3A41%3A36Z&sp=r)
, let
![IJHSTM.2021070104.m29](https://igiprodst.blob.core.windows.net:443/source-content/9781799833642_241769/IJHSTM.2021070104.m29.png?sv=2015-12-11&sr=c&sig=uByqH5%2B36XyT3eK6QMDjIlNEfhwhaG4SUbAeeroNaEo%3D&se=2021-05-28T06%3A41%3A36Z&sp=r)
. According to this algorithm, the membership matrix
![IJHSTM.2021070104.m30](https://igiprodst.blob.core.windows.net:443/source-content/9781799833642_241769/IJHSTM.2021070104.m30.png?sv=2015-12-11&sr=c&sig=uByqH5%2B36XyT3eK6QMDjIlNEfhwhaG4SUbAeeroNaEo%3D&se=2021-05-28T06%3A41%3A36Z&sp=r)
can be obtained.