Towards a better negative sampling strategy for dynamic graphs
Copyright © 2024 Elsevier Ltd. All rights reserved..
As dynamic graphs have become indispensable in numerous fields due to their capacity to represent evolving relationships over time, there has been a concomitant increase in the development of Temporal Graph Neural Networks (TGNNs). When training TGNNs for dynamic graph link prediction, the commonly used negative sampling method often produces starkly contrasting samples, which can lead the model to overfit these pronounced differences and compromise its ability to generalize effectively to new data. To address this challenge, we introduce an innovative negative sampling approach named Enhanced Negative Sampling (ENS). This strategy takes into account two pervasive traits observed in dynamic graphs: (1) Historical dependence, indicating that nodes frequently reestablish connections they held in the past, and (2) Temporal proximity preference, which posits that nodes are more inclined to connect with those they have recently interacted with. Specifically, our technique employs a designed scheduling function to strategically control the progression of difficulty of the negative samples throughout the training. This ensures that the training progresses in a balanced manner, becoming incrementally challenging, and thereby enhancing TGNNs' proficiency in predicting links within dynamic graphs. In our empirical evaluation across multiple datasets, we discerned that our ENS, when integrated as a modular component, notably augments the performance of four SOTA baselines. Additionally, we further investigated the applicability of ENS in handling dynamic graphs of varied attributes. Our code is available at https://github.com/qqaazxddrr/ENS.
| Medienart: |
E-Artikel |
|---|
| Erscheinungsjahr: |
2024 |
|---|---|
| Erschienen: |
2024 |
| Enthalten in: |
Zur Gesamtaufnahme - volume:173 |
|---|---|
| Enthalten in: |
Neural networks : the official journal of the International Neural Network Society - 173(2024) vom: 18. März, Seite 106175 |
| Sprache: |
Englisch |
|---|
| Beteiligte Personen: |
Gao, Kuang [VerfasserIn] |
|---|
| Links: |
|---|
| Themen: |
Curriculum learning |
|---|
| Anmerkungen: |
Date Completed 26.03.2024 Date Revised 26.03.2024 published: Print-Electronic Citation Status MEDLINE |
|---|
| doi: |
10.1016/j.neunet.2024.106175 |
|---|
| funding: |
|
|---|---|
| Förderinstitution / Projekttitel: |
|
| PPN (Katalog-ID): |
NLM36877189X |
|---|
| LEADER | 01000caa a22002652 4500 | ||
|---|---|---|---|
| 001 | NLM36877189X | ||
| 003 | DE-627 | ||
| 005 | 20240326235513.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 240229s2024 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1016/j.neunet.2024.106175 |2 doi | |
| 028 | 5 | 2 | |a pubmed24n1348.xml |
| 035 | |a (DE-627)NLM36877189X | ||
| 035 | |a (NLM)38387201 | ||
| 035 | |a (PII)S0893-6080(24)00099-6 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rakwb | ||
| 041 | |a eng | ||
| 100 | 1 | |a Gao, Kuang |e verfasserin |4 aut | |
| 245 | 1 | 0 | |a Towards a better negative sampling strategy for dynamic graphs |
| 264 | 1 | |c 2024 | |
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a ƒaComputermedien |b c |2 rdamedia | ||
| 338 | |a ƒa Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Date Completed 26.03.2024 | ||
| 500 | |a Date Revised 26.03.2024 | ||
| 500 | |a published: Print-Electronic | ||
| 500 | |a Citation Status MEDLINE | ||
| 520 | |a Copyright © 2024 Elsevier Ltd. All rights reserved. | ||
| 520 | |a As dynamic graphs have become indispensable in numerous fields due to their capacity to represent evolving relationships over time, there has been a concomitant increase in the development of Temporal Graph Neural Networks (TGNNs). When training TGNNs for dynamic graph link prediction, the commonly used negative sampling method often produces starkly contrasting samples, which can lead the model to overfit these pronounced differences and compromise its ability to generalize effectively to new data. To address this challenge, we introduce an innovative negative sampling approach named Enhanced Negative Sampling (ENS). This strategy takes into account two pervasive traits observed in dynamic graphs: (1) Historical dependence, indicating that nodes frequently reestablish connections they held in the past, and (2) Temporal proximity preference, which posits that nodes are more inclined to connect with those they have recently interacted with. Specifically, our technique employs a designed scheduling function to strategically control the progression of difficulty of the negative samples throughout the training. This ensures that the training progresses in a balanced manner, becoming incrementally challenging, and thereby enhancing TGNNs' proficiency in predicting links within dynamic graphs. In our empirical evaluation across multiple datasets, we discerned that our ENS, when integrated as a modular component, notably augments the performance of four SOTA baselines. Additionally, we further investigated the applicability of ENS in handling dynamic graphs of varied attributes. Our code is available at https://github.com/qqaazxddrr/ENS | ||
| 650 | 4 | |a Journal Article | |
| 650 | 4 | |a Curriculum learning | |
| 650 | 4 | |a Dynamic graph | |
| 650 | 4 | |a Negative sampling | |
| 700 | 1 | |a Liu, Chuang |e verfasserin |4 aut | |
| 700 | 1 | |a Wu, Jia |e verfasserin |4 aut | |
| 700 | 1 | |a Du, Bo |e verfasserin |4 aut | |
| 700 | 1 | |a Hu, Wenbin |e verfasserin |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Neural networks : the official journal of the International Neural Network Society |d 1996 |g 173(2024) vom: 18. März, Seite 106175 |w (DE-627)NLM087746824 |x 1879-2782 |7 nnns |
| 773 | 1 | 8 | |g volume:173 |g year:2024 |g day:18 |g month:03 |g pages:106175 |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1016/j.neunet.2024.106175 |3 Volltext |
| 912 | |a GBV_USEFLAG_A | ||
| 912 | |a GBV_NLM | ||
| 951 | |a AR | ||
| 952 | |d 173 |j 2024 |b 18 |c 03 |h 106175 | ||