Concept-free Causal Disentanglement with Variational Graph Auto-Encoder

  • 2023-11-17 16:50:00
  • Jingyun Feng, Lin Zhang, Lili Yang
  • 0


In disentangled representation learning, the goal is to achieve a compactrepresentation that consists of all interpretable generative factors in theobservational data. Learning disentangled representations for graphs becomesincreasingly important as graph data rapidly grows. Existing approaches oftenrely on Variational Auto-Encoder (VAE) or its causal structure learning-basedrefinement, which suffer from sub-optimality in VAEs due to the independencefactor assumption and unavailability of concept labels, respectively. In thispaper, we propose an unsupervised solution, dubbed concept-free causaldisentanglement, built on a theoretically provable tight upper boundapproximating the optimal factor. This results in an SCM-like causal structuremodeling that directly learns concept structures from data. Based on this idea,we propose Concept-free Causal VGAE (CCVGAE) by incorporating a novel causaldisentanglement layer into Variational Graph Auto-Encoder. Furthermore, weprove concept consistency under our concept-free causal disentanglementframework, hence employing it to enhance the meta-learning framework, calledconcept-free causal Meta-Graph (CC-Meta-Graph). We conduct extensiveexperiments to demonstrate the superiority of the proposed models: CCVGAE andCC-Meta-Graph, reaching up to $29\%$ and $11\%$ absolute improvements overbaselines in terms of AUC, respectively.


Quick Read (beta)

loading the full paper ...