A regularized orthogonal activated inverse-learning neural network for regression and classification with outliers
Copyright © 2024 Elsevier Ltd. All rights reserved..
A novel regularized orthogonal activated inverse-learning (ROAIL) neural network is proposed and investigated for reducing the impact of outliers in regression and classification fields. The proposed ROAIL network does not require extensive iterative computations. Instead, it can achieve the desired results with a single step of computation, allowing for the efficient acquisition of network weights. By extending the Gegenbauer polynomials to a multi-variate version, and integrating the ℓ2 regularization and Welsch loss function into the orthogonal activated inverse-learning framework, two forms of ROAIL are obtained, i.e., ℓ2 norm ROAIL (ℓ2-ROAIL) and Welsch-ROAIL (W-ROAIL). ℓ2-ROAIL neural network is proposed to minimize the empirical and structural risk simultaneously since taking the structural risk as a part of loss function can effectively reduce the complexity of the model and thus improve the generalization ability. W-ROAIL neural network further improves the robustness of the ℓ2-ROAIL neural network by replacing the original two-norm in loss function with Welsch function. The Welsch function can determine the weights of each sample according to its output error, and influence of outliers could be weakened since the weights of outliers would be reduced. Both regression and classification experiments show that W-ROAIL neural network has strong ability to suppress the influence of outliers.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2024 |
|---|---|
| Erschienen: |
2024 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:173 |
|---|---|
| Enthalten in: |
Neural networks : the official journal of the International Neural Network Society - 173(2024) vom: 25. März, Seite 106208 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Zhang, Zhijun [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Inverse-learning |
|---|
| Anmerkungen: |
Date Completed 26.03.2024 Date Revised 26.03.2024 published: Print-Electronic Citation Status MEDLINE |
|---|
| doi: |
10.1016/j.neunet.2024.106208 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM369370643 |
|---|
| LEADER | 01000caa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM369370643 | ||
| 003 | DE-627 | ||
| 005 | 20240326235721.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 240307s2024 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1016/j.neunet.2024.106208 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1349.xml |
| 035 | |a (DE-627)NLM369370643 | ||
| 035 | |a (NLM)38447304 | ||
| 035 | |a (PII)S0893-6080(24)00132-1 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Zhang, Zhijun |e verfasserin |4 aut | |
| 245 | 1 | 2 | |a A regularized orthogonal activated inverse-learning neural network for regression and classification with outliers |
| 264 | 1 | |c 2024 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 26.03.2024 | ||
| 500 | |a Date Revised 26.03.2024 | ||
| 500 | |a published: Print-Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a Copyright © 2024 Elsevier Ltd. All rights reserved. | ||
| 520 | |a A novel regularized orthogonal activated inverse-learning (ROAIL) neural network is proposed and investigated for reducing the impact of outliers in regression and classification fields. The proposed ROAIL network does not require extensive iterative computations. Instead, it can achieve the desired results with a single step of computation, allowing for the efficient acquisition of network weights. By extending the Gegenbauer polynomials to a multi-variate version, and integrating the ℓ2 regularization and Welsch loss function into the orthogonal activated inverse-learning framework, two forms of ROAIL are obtained, i.e., ℓ2 norm ROAIL (ℓ2-ROAIL) and Welsch-ROAIL (W-ROAIL). ℓ2-ROAIL neural network is proposed to minimize the empirical and structural risk simultaneously since taking the structural risk as a part of loss function can effectively reduce the complexity of the model and thus improve the generalization ability. W-ROAIL neural network further improves the robustness of the ℓ2-ROAIL neural network by replacing the original two-norm in loss function with Welsch function. The Welsch function can determine the weights of each sample according to its output error, and influence of outliers could be weakened since the weights of outliers would be reduced. Both regression and classification experiments show that W-ROAIL neural network has strong ability to suppress the influence of outliers | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a Inverse-learning | |
| 650 | 4 | |a Neural networks | |
| 650 | 4 | |a Outlier suppress | |
| 650 | 4 | |a Regularization | |
| 650 | 4 | |a Robustness | |
| 700 | 1 | |a Song, Yating |e verfasserin |4 aut | |
| 700 | 1 | |a Chen, Tao |e verfasserin |4 aut | |
| 700 | 1 | |a He, Jie |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Neural networks : the official journal of the International Neural Network Society |d 1996 |g 173(2024) vom: 25. März, Seite 106208 |w (DE-627)NLM087746824 |x 1879-2782 |7 nnns |
| 773 | 1 | 8 | |g volume:173 |g year:2024 |g day:25 |g month:03 |g pages:106208 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1016/j.neunet.2024.106208 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 173 |j 2024 |b 25 |c 03 |h 106208 | ||