Papers
Topics
Authors
Recent
Search
2000 character limit reached

RaftGP: Random Fast Graph Partitioning

Published 4 Dec 2023 in cs.SI | (2312.01560v1)

Abstract: Graph partitioning (GP), a.k.a. community detection, is a classic problem that divides the node set of a graph into densely-connected blocks. Following prior work on the IEEE HPEC Graph Challenge benchmark and recent advances in graph machine learning, we propose a novel RAndom FasT Graph Partitioning (RaftGP) method based on an efficient graph embedding scheme. It uses the Gaussian random projection to extract community-preserving features from classic GP objectives. These features are fed into a graph neural network (GNN) to derive low-dimensional node embeddings. Surprisingly, our experiments demonstrate that a randomly initialized GNN even without training is enough for RaftGP to derive informative community-preserving embeddings and support high-quality GP. To enable the derived embeddings to tackle GP, we introduce a hierarchical model selection algorithm that simultaneously determines the number of blocks and the corresponding GP result. We evaluate RaftGP on the Graph Challenge benchmark and compare the performance with five baselines, where our method can achieve a better trade-off between quality and efficiency. In particular, compared to the baseline algorithm of the IEEE HPEC Graph Challenge, our method is 6.68x -- 23.9x faster on graphs with 1E3 -- 5E4 nodes and at least 64.5x faster on larger (1E5 node) graphs on which the baseline takes more than 1E4 seconds. Our method achieves better accuracy on all test cases. We also develop a new graph generator to address some limitations of the original generator in the benchmark.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (34)
  1. T. Peixoto, “Efficient monte carlo and greedy heuristic for the inference of stochastic block models,” Physical Review. E, Statistical, Nonlinear, & Soft Matter Physics, vol. 89, p. 012804, 01 2014.
  2. M. Qin, D. Jin, K. Lei, B. Gabrys, and K. Musial-Gabrys, “Adaptive community detection incorporating topology and content in social networks,” Knowledge-Based Systems, vol. 161, pp. 342–356, 2018.
  3. W. Li, M. Qin, and K. Lei, “Identifying interpretable link communities with user interactions and messages in social networks,” in Proceedings of the 2019 IEEE International Conference on Parallel & Distributed Processing with Applications, Big Data & Cloud Computing, Sustainable Computing & Communications, Social Computing & Networking (ISPA/BDCloud/SocialCom/SustainCom).   IEEE, 2019, pp. 271–278.
  4. M. Qin and K. Lei, “Dual-channel hybrid community detection in attributed networks,” Information Sciences, vol. 551, pp. 146–167, 2021.
  5. B. Hendrickson and T. G. Kolda, “Graph partitioning models for parallel computing,” Parallel Computing, vol. 26, no. 12, pp. 1519–1534, 2000.
  6. L. Dai and B. Bai, “Optimal decomposition for large-scale infrastructure-based wireless networks,” IEEE Transactions on Wireless Communications, vol. 16, no. 8, pp. 4956–4969, 2017.
  7. M. Qin, K. Lei, B. Bai, and G. Zhang, “Towards a profiling view for unsupervised traffic classification by exploring the statistic features and link patterns,” in Proceedings of the 2019 ACM SIGCOMM NetAI Workshop, 2019, pp. 50–56.
  8. E. K. Kao, V. Gadepally, M. B. Hurley, M. Jones, J. Kepner, S. Mohindra, P. Monticciolo, A. Reuther, S. Samsi, W. Song, D. Staheli, and S. T. Smith, “Streaming graph challenge: Stochastic block partition,” in Proceedings of the 2017 IEEE High Performance Extreme Computing Conference (HPEC), 2017, pp. 1–12.
  9. D. Zhuzhunashvili and A. Knyazev, “Preconditioned spectral clustering for stochastic block partition streaming graph challenge (preliminary version at arxiv.),” in Proceedings of the 2017 IEEE High Performance Extreme Computing Conference (HPEC).   IEEE, 2017, pp. 1–6.
  10. L. Durbeck and P. Athanas, “Dpgs graph summarization preserves community structure,” in Proceedings of the 2021 IEEE High Performance Extreme Computing Conference (HPEC).   IEEE, 2021, pp. 1–9.
  11. A. J. Uppal, J. Choi, T. B. Rolinger, and H. H. Huang, “Faster stochastic block partition using aggressive initial merging, compressed representation, and parallelism control,” in Proceedings of the 2021 IEEE High Performance Extreme Computing Conference (HPEC).   IEEE, 2021, pp. 1–7.
  12. F. Wanye, V. Gleyzer, and W.-c. Feng, “Fast stochastic block partitioning via sampling,” in Proceedings of the 2019 IEEE High Performance Extreme Computing Conference (HPEC).   IEEE, 2019, pp. 1–7.
  13. Z. Zhang, P. Cui, and W. Zhu, “Deep learning on graphs: A survey,” IEEE Transactions on Knowledge & Data Engineering (TKDE), vol. 34, no. 1, pp. 249–270, 2020.
  14. R. I. Arriaga and S. Vempala, “An algorithmic theory of learning: Robust concepts and random projection,” Machine Learning, vol. 63, pp. 161–182, 2006.
  15. U. Von Luxburg, “A tutorial on spectral clustering,” Statistics & Computing, vol. 17, no. 4, pp. 395–416, 2007.
  16. M. E. Newman, “Modularity and community structure in networks,” Proceedings of the National Academy of Sciences (PNAS), vol. 103, no. 23, pp. 8577–8582, 2006.
  17. B. Wilder, E. Ewing, B. Dilkina, and M. Tambe, “End to end learning and optimization on graphs,” Proceedings of the 2019 Advances in Neural Information Processing Systems (NIPS), vol. 32, 2019.
  18. Z. Chen, J. Bruna, and L. Li, “Supervised community detection with line graph neural networks,” in Proceedings of the 7th International Conference on Learning Representations (ICLR), 2019.
  19. M. Qin, C. Zhang, B. Bai, G. Zhang, and D.-Y. Yeung, “Towards a better trade-off between quality and efficiency of community detection: An inductive embedding method across graphs,” ACM Transactions on Knowledge Discovery from Data (TKDD), 2023.
  20. F. Tian, B. Gao, Q. Cui, E. Chen, and T.-Y. Liu, “Learning deep representations for graph clustering,” in Proceedings of the 28th AAAI Conference on Artificial Intelligence, vol. 28, no. 1, 2014.
  21. L. Yang, X. Cao, D. He, C. Wang, X. Wang, and W. Zhang, “Modularity based community detection with deep learning,” in Proceedings of the 25th International Joint Conference on Artificial Intelligence (IJCAI), vol. 16, 2016, pp. 2252–2258.
  22. J. Bourgain, “On lipschitz embedding of finite metric spaces in hilbert space,” Israel Journal of Mathematics, vol. 52, no. 1-2, pp. 46–52, 1985.
  23. W. J. J. Lindenstrauss, “Extensions of lipschitz maps into a hilbert space,” Contemporary Mathematics, vol. 26, no. 189, pp. 189–206, 1984.
  24. T. N. Kipf and M. Welling, “Semi-supervised classification with graph convolutional networks,” in Proceedings of the 5th International Conference on Learning Representations (ICLR), 2017, p. 1609.02907.
  25. T. P. Peixoto, “The graph-tool python library,” figshare, 2014. [Online]. Available: http://figshare.com/articles/graph_tool/1164194
  26. A. Clauset, M. E. Newman, and C. Moore, “Finding community structure in very large networks,” Physical Review E, vol. 70, no. 6, p. 066111, 2004.
  27. C. Peng, Z. Zhang, K.-C. Wong, X. Zhang, and D. E. Keyes, “A scalable community detection algorithm for large graphs using stochastic block models,” Intelligent Data Analysis, vol. 21, no. 6, pp. 1463–1485, 2017.
  28. P. Zhang and C. Moore, “Scalable detection of statistically significant communities and hierarchies, using message passing for modularity,” Proceedings of the National Academy of Sciences (PNAS), vol. 111, no. 51, pp. 18 144–18 149, 2014.
  29. B. Hendrickson, R. W. Leland et al., “A multi-level algorithm for partitioning graphs,” Proceedings Supercomputing, vol. 95, no. 28, pp. 1–14, 1995.
  30. I. S. Dhillon, Y. Guan, and B. Kulis, “Weighted graph cuts without eigenvectors a multilevel approach,” IEEE Transactions on Pattern Analysis & Machine Intelligence (TPAMI), vol. 29, no. 11, pp. 1944–1957, 2007.
  31. K. Lei, M. Qin, B. Bai, and G. Zhang, “Adaptive multiple non-negative matrix factorization for temporal link prediction in dynamic networks,” in Proceedings of the 2018 SIGCOMM NetAI Workshop, 2018, pp. 28–34.
  32. K. Lei, M. Qin, B. Bai, G. Zhang, and M. Yang, “Gcn-gan: A non-linear temporal link prediction model for weighted dynamic networks,” in Proceedings of the 2019 IEEE Conference on Computer Communications (INFOCOM).   IEEE, 2019, pp. 388–396.
  33. M. Qin and D.-Y. Yeung, “Temporal link prediction: A unified framework, taxonomy, and review,” arXiv preprint arXiv:2210.08765, 2022.
  34. M. Qin, C. Zhang, B. Bai, G. Zhang, and D.-Y. Yeung, “High-quality temporal link prediction for weighted dynamic graphs via inductive embedding aggregation,” IEEE Transactions on Knowledge & Data Engineering (TKDE), vol. 35, no. 9, pp. 9378–9393, 2023.
Citations (4)

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.