LCBM : A Multi-View Probabilistic Model for Multi-Label Classification
Multi-label classification is an important research topic in machine learning, for which exploiting label dependencies is an effective modeling principle. Recently, probabilistic models have shown great potential in discovering dependencies among labels. In this paper, motivated by the recent success of multi-view learning to improve the generalization performance, we propose a novel multi-view probabilistic model named latent conditional Bernoulli mixture (LCBM) for multi-label classification. LCBM is a generative model taking features from different views as inputs, and conditional on the latent subspace shared by the views a Bernoulli mixture model is adopted to build label dependencies. Inside each component of the mixture, the labels have a weak correlation which facilitates computational convenience. The mean field variational inference framework is used to carry out approximate posterior inference in the probabilistic model, where we propose a Gaussian mixture variational autoencoder (GMVAE) for effective posterior approximation. We further develop a scalable stochastic training algorithm for efficiently optimizing the model parameters and variational parameters, and derive an efficient prediction procedure based on greedy search. Experimental results on multiple benchmark datasets show that our approach outperforms other state-of-the-art methods under various metrics.
Medienart: |
E-Artikel |
---|
Erscheinungsjahr: |
2021 |
---|---|
Erschienen: |
2021 |
Enthalten in: |
Zur Gesamtaufnahme - volume:43 |
---|---|
Enthalten in: |
IEEE transactions on pattern analysis and machine intelligence - 43(2021), 8 vom: 20. Aug., Seite 2682-2696 |
Sprache: |
Englisch |
---|
Beteiligte Personen: |
Sun, Shiliang [VerfasserIn] |
---|
Links: |
---|
Themen: |
---|
Anmerkungen: |
Date Revised 02.07.2021 published: Print-Electronic Citation Status PubMed-not-MEDLINE |
---|
doi: |
10.1109/TPAMI.2020.2974203 |
---|
funding: |
|
---|---|
Förderinstitution / Projekttitel: |
|
PPN (Katalog-ID): |
NLM306723506 |
---|
LEADER | 01000naa a22002652 4500 | ||
---|---|---|---|
001 | NLM306723506 | ||
003 | DE-627 | ||
005 | 20231225124011.0 | ||
007 | cr uuu---uuuuu | ||
008 | 231225s2021 xx |||||o 00| ||eng c | ||
024 | 7 | |a 10.1109/TPAMI.2020.2974203 |2 doi | |
028 | 5 | 2 | |a pubmed24n1022.xml |
035 | |a (DE-627)NLM306723506 | ||
035 | |a (NLM)32078533 | ||
040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
041 | |a eng | ||
100 | 1 | |a Sun, Shiliang |e verfasserin |4 aut | |
245 | 1 | 0 | |a LCBM |b A Multi-View Probabilistic Model for Multi-Label Classification |
264 | 1 | |c 2021 | |
336 | |a Text |b txt |2 rdacontent | ||
337 | |a ƒaComputermedien |b c |2 rdamedia | ||
338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
500 | |a Date Revised 02.07.2021 | ||
500 | |a published: Print-Electronic | ||
500 | |a Citation Status PubMed-not-MEDLINE | ||
520 | |a Multi-label classification is an important research topic in machine learning, for which exploiting label dependencies is an effective modeling principle. Recently, probabilistic models have shown great potential in discovering dependencies among labels. In this paper, motivated by the recent success of multi-view learning to improve the generalization performance, we propose a novel multi-view probabilistic model named latent conditional Bernoulli mixture (LCBM) for multi-label classification. LCBM is a generative model taking features from different views as inputs, and conditional on the latent subspace shared by the views a Bernoulli mixture model is adopted to build label dependencies. Inside each component of the mixture, the labels have a weak correlation which facilitates computational convenience. The mean field variational inference framework is used to carry out approximate posterior inference in the probabilistic model, where we propose a Gaussian mixture variational autoencoder (GMVAE) for effective posterior approximation. We further develop a scalable stochastic training algorithm for efficiently optimizing the model parameters and variational parameters, and derive an efficient prediction procedure based on greedy search. Experimental results on multiple benchmark datasets show that our approach outperforms other state-of-the-art methods under various metrics | ||
650 | 4 | |a Journal Article | |
700 | 1 | |a Zong, Daoming |e verfasserin |4 aut | |
773 | 0 | 8 | |i Enthalten in |t IEEE transactions on pattern analysis and machine intelligence |d 1979 |g 43(2021), 8 vom: 20. Aug., Seite 2682-2696 |w (DE-627)NLM098212257 |x 1939-3539 |7 nnns |
773 | 1 | 8 | |g volume:43 |g year:2021 |g number:8 |g day:20 |g month:08 |g pages:2682-2696 |
856 | 4 | 0 | |u http://dx.doi.org/10.1109/TPAMI.2020.2974203 |3 Volltext |
912 | |a GBV_USEFLAG_A | ||
912 | |a GBV_NLM | ||
951 | |a AR | ||
952 | |d 43 |j 2021 |e 8 |b 20 |c 08 |h 2682-2696 |