FlowNeg Improves Knowledge Graph Embeddings with Diverse Negative Sampling

Ibne Farabi Shihab, Naoshin Anzum Hridi, Joyanta Jyoti Mondal· August 26, 2026 View original

Key takeaways

  • FlowNeg uses a GFlowNet to generate diverse hard negative samples for Knowledge Graph Embedding.
  • It combines model-based hardness with a structural score to create informative counterexamples.
  • FlowNeg significantly outperforms existing negative sampling methods in MRR across various benchmarks.
  • The method ensures mode-covering negative generation with high gradient informativeness and low collision.

Who benefits

E-commerceHealthcareFinanceSemantic WebAI Development

Summary

FlowNeg introduces a GFlowNet-guided framework for diverse hard negative sampling in Knowledge Graph Embedding (KGE) models. It generates informative counterexamples by combining model-based hardness with structural scores, significantly outperforming existing methods in accuracy and diversity.

The effectiveness of Knowledge Graph Embedding (KGE) models heavily relies on the quality of negative samples used during training. Traditional methods often struggle, with uniform negatives being too easy and hard-negative miners tending to focus on a limited set of entities, potentially colliding with actual positive examples. This research presents FlowNeg, a novel approach to address these limitations. FlowNeg utilizes a context-conditioned hierarchical generative flow network (GFlowNet) to amortize reward-proportional sampling. Given a positive triple, FlowNeg intelligently selects a type and then an entity for corruption. Its unique terminal reward function combines a bounded model-based hardness score with a training-only structural score, which helps prevent collisions with held-out positive examples and ensures type compatibility. Extensive experiments across multiple architectures and benchmarks demonstrated FlowNeg's superior performance. It consistently achieved higher mean MRR (Mean Reciprocal Rank) compared to leading hard-negative sampling methods like EMU and IF-NS, with significant average improvements. FlowNeg also maintained high gradient informativeness and low collision rates, supporting its ability to generate diverse, mode-covering negative samples without relying on structural similarity as an absolute truth oracle.

Why it matters

FlowNeg offers a significant advancement in training Knowledge Graph Embedding models, leading to more accurate and robust representations of relational data, which is crucial for applications like recommendation systems, semantic search, and question answering.

How to implement this in your domain

  1. 1Integrate FlowNeg into your knowledge graph embedding training pipelines to improve model accuracy and robustness.
  2. 2Evaluate FlowNeg against existing negative sampling strategies on your specific knowledge graph datasets.
  3. 3Leverage the improved KGE models for downstream tasks such as recommendation, entity linking, or semantic search.
  4. 4Consider the balance between computational cost and performance gains when adopting advanced negative sampling techniques like FlowNeg.

Original post by Ibne Farabi Shihab, Naoshin Anzum Hridi, Joyanta Jyoti Mondal

"arXiv:2608.23849v1 Announce Type: new Abstract: Negative sampling determines whether a knowledge graph embedding (KGE) model learns from informative counterexamples or wastes updates on implausible corruptions. Uniform negatives are diverse but easy, whereas hard-negative miners…"

View on X

Originally posted by Ibne Farabi Shihab, Naoshin Anzum Hridi, Joyanta Jyoti Mondal on X · view source

Want to go deeper?

Turn these trends into skills with Learnijoy's hands-on AI & tech courses.

Explore courses

More in AI Research

AI ResearchAI Engineering & DevToolsAI Investing

FraudBench Benchmarks Adversarial Robustness in Financial Risk Assessment

This paper introduces FraudBench, a protocol-sensitive benchmark for evaluating the adversarial robustness of machine learning models in financial fraud and credit-risk detection. It demonstrates that robustness conclusions are highly dependent on how domain-specific constraints and attacker capabilities are incorporated into the evaluation protocol.

Xitong Zeng, Zhaoge Bi, Yitian Yang, Huaming Chen, Quan Z. ShengAug 26, 2026
AI ResearchAI Engineering & DevTools

Persistent Cross Entropy Extends Topological Data Analysis

This paper introduces Persistent Cross Entropy (PCE), a novel extension of cross-entropy to persistence diagrams, which are used in topological data analysis. PCE bridges different event spaces of diagrams using an induced probability, enabling new applications like distinguishing diagrams with similar persistent entropy and separating causal directions in dynamical systems.

Sijin Yeom, Jae-Hun JungAug 26, 2026
AI ResearchAI Engineering & DevTools

Bridging Numerical PDE Solvers and Neural Emulators for Faster Simulation

This thesis explores the deep connections between traditional numerical solvers for Partial Differential Equations (PDEs) and neural emulators, arguing that they are more alike than different. It proposes that insights can flow profitably in both directions, leading to faster and more efficient scientific and engineering simulations.

Felix KoehlerAug 26, 2026