Tagged articles

graph transformer

2 articles · Page 1 of 1
NewBeeNLP
NewBeeNLP
Apr 26, 2024 · Artificial Intelligence

Self-Attention vs Virtual Nodes in Graph Neural Networks: What Really Works?

This article reviews the paper “Distinguished in Uniform: Self-Attention vs. Virtual Nodes,” comparing graph Transformers and MPGNNs with virtual nodes on theoretical consistency and experimental performance, revealing that neither approach universally dominates the other.

Graph Neural NetworksMPGNNgraph transformer
0 likes · 9 min read
Self-Attention vs Virtual Nodes in Graph Neural Networks: What Really Works?
NewBeeNLP
NewBeeNLP
Mar 26, 2024 · Artificial Intelligence

How OpenGraph Enables Zero‑Shot Graph Learning Across Datasets

OpenGraph introduces a zero‑shot graph learning framework that unifies graph tokenization, a scalable transformer with efficient sampling, and LLM‑driven data augmentation, achieving superior cross‑dataset generalization on node classification and link prediction tasks, as demonstrated by extensive experiments.

Graph Neural NetworksLLM data augmentationZero-shot Learning
0 likes · 20 min read
How OpenGraph Enables Zero‑Shot Graph Learning Across Datasets