Awesome Scene Graphs

Literature survey of scene graphs

Table of Contents

• Survey

• Datasets

• Awesome Scene Graphs

  • 2020 Venues
  • 2019 Venues
  • 2018 Venues
  • 2017 Venues
  • 2010-2016 Venues

Survey

Title	Venue
A Survey of Scene Graph:Generation and Application	https://www.xiaojun.ai/papers/Scene-Graph-Survey.pdf

@Booklet{EasyChair:3385,

author = {Pengfei Xu and Xiaojun Chang and Ling Guo and Po-Yao Huang and Xiaojiang Chen and Alex Hauptmann},

title = {A Survey of Scene Graph: Generation and Application},

howpublished = {EasyChair Preprint no. 3385},

year = {EasyChair, 2020}}

Datasets

Title	Abbr
Visual Relationship Detection with Language Priors	VRD
Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations	Visual Genome
Weakly-supervised learning of visual relations	UnRel

2020

Title	Venue	Code
Bridging Knowledge Graphs to Generate Scene Graphs	arXiv	-
Unbiased Scene Graph Generation from Biased Training	CVPR	-
Cross-modal Scene Graph Matching for Relationship-aware Image-Text Retrieval	WACV	-
SOGNet: Scene Overlap Graph Network for Panoptic Segmentation	AAAI	-
Storytelling from an Image Stream Using Scene Graphs	-	-

2019

Title	Venue	Code
Adversarial Adaptation of Scene Graph Models for Understanding Civic Issues	WWW	-
Contextual Translation Embedding for Visual Relationship Detection and Scene Graph Generation	NLP	-
PasteGAN: A Semi-Parametric Method to Generate Image from Scene Graph	NIPS	-
Referring Expression Grounding by Marginalizing Scene Graph Likelihood	NIPS	-
Scene graph captioner: Image captioning based on structural visual representation	JVCIR	-
Know More Say Less: Image Captioning Based on Scene Graphs	IEEE	-
3-D Scene Graph: A Sparse and Semantic Representation of Physical Environments for Intelligent Agents	IEEE	-
PANet: A Context Based Predicate Association Network for Scene Graph Generation	ICME	-
Multi-Granularity Reasoning for Social Relation Recognition from Images	ICME	-
Deeply Supervised Multimodal Attentional Translation Embeddings for Visual Relationship Detection	ICIP	-
Layout and Context Understanding for Image Synthesis with Scene Graphs	ICIP	-
Triplet-Aware Scene Graph Embeddings	ICCV	-
Scene Graph based Image Retrieval -- A case study on the CLEVR Dataset	ICCV	-
Detecting Visual Relationships Using Box Attention	ICCV	-
Differentiable Scene Graphs	ICCV	-
VrR-VG: Refocusing Visually-Relevant Relationships	ICCV	-
Unpaired Image Captioning via Scene Graph Alignments	ICCV	-
Scene Graph Prediction with Limited Labels	ICCV	-
Seq-SG2SL: Inferring Semantic Layout from Scene Graph through Sequence to Sequence Learning	ICCV	-
Counterfactual Critic Multi-Agent Training for Scene Graph Generation	ICCV	-
3D Scene Graph: A Structure for Unified Semantics, 3D Space, and Camera	ICCV	-
Auto-Encoding Scene Graphs for Image Captioning	CVPR	-
Compact Scene Graphs for Layout Composition and Patch Retrieval	CVPR	-
Exploring Context and Visual Pattern of Relationship for Scene Graph Generation	CVPR	-
Explainable and Explicit Visual Reasoning over Scene Graphs	CVPR	-
Learning to Compose Dynamic Tree Structures for Visual Contexts	CVPR	-
Image Generation from Layout	CVPR	-
Scene Graph Generation with External Knowledge and Image Reconstruction	CVPR	-
Graphical Contrastive Losses for Scene Graph Parsing	CVPR	-
Knowledge-Embedded Routing Network for Scene Graph Generation	CVPR	-
Attentive Relational Networks for Mapping Images to Scene Graphs	CVPR	-
A hierarchical recurrent approach to predict scene graphs from a visual-attention-oriented perspective	CI	-
An Empirical Study on Leveraging Scene Graphs for Visual Question Answering	BMVC	-
Using Scene Graph Context to Improve Image Generation	arXiv	-
Neural-Symbolic Tensor Product Scene-Graph-Triplet Representation for Image Captioning	arXiv	-
Learning Visual Relation Priors for Image-Text Matching and Image Captioning with Neural Scene Graph Generators	arXiv	-
Learning Predicates as Functions to Enable Few-shot Scene Graph Prediction	arXiv	-
Learning Canonical Representations for Scene Graph to Image Generation	arXiv	-
Interactive Image Generation Using Scene Graphs	arXiv	-
Generating Natural Language Explanations for Visual Question Answering Using Scene Graphs and Visual Attention	arXiv	-
Action Genome Actions as Composition of Spatio-temporal Scene Graphs	arXiv	-
Large-Scale Visual Relationship Understanding	AAAI	-
BLOCK: Bilinear Superdiagonal Fusion for Visual Question Answering and Visual Relationship Detection	AAAI	-

2018

Title	Venue	Code
Scaling Human-Object Interaction Recognition through Zero-Shot Learning	WACV	-
Learning to Detect Human-Object Interactions	WACV	-
Scene Graph Parsing by Attention Graph	ViGIL	-
Mapping Images to Scene Graphs with Permutation-Invariant Structured Prediction	NIPS	-
LinkNet：Relational Embedding for Scene Graph	NIPS	-
An Interpretable Model for Scene Graph Generation	NIPS	-
Scene Graph Parsing as Dependency Parsing	NAACL	-
Representation Learning for Scene Graph Completion via Jointly Structural and Visual Embedding	IJCAI	-
Narrative Collage of Image Collections by Scene Graph Recombination	TVCG	-
Image Captioning with Scene-graph Based Semantic Concepts	ICMLC	-
Visual Relationship Detection Based on Guided Proposals and Semantic Knowledge Disti	ICME	-
Zoom-Net：Mining Deep Feature Interactions for Visual Relationship Recognition	ECCV	-
Learning Human-Object Interactions by Graph Parsing Neural Networks	ECCV	-
Graph R-CNN for Scene Graph Generation	ECCV	-
Factorizable Net： An Efficient Subgraph-based Framework for Scene Graph Generation	ECCV	-
Actor-Centric Relation Network	ECCV	-
Tensorize,Factorize and Regularize Robust Visual Relationship Learning	CVPR	-
Neural Motifs Scene Graph Parsing with Global Context	CVPR	-
Image Generation from Scene Graphs	CVPR	-
Detecting and Recognizing Human-Object Interactions	CVPR	-
Image Understanding using vision and reasoning through Scene Description	CVIU	-
Visual Social Relationship Recognition	arXiv	-
Transferable Interactiveness Prior for Human-Object Interaction Detection	arXiv	-
Scene Graph Reasoning with Prior Visual Relationship for Visual Question Answering	arXiv	-
Scene Graph Generation via Conditional Random Fields	arXiv	-
Detecting unseen visual relations using analogies	arXiv	-
Context-Dependent Diffusion Network for Visual Relationship Detection	AMC	-
Scene-centric Joint Parsing of Cross-view Videos	AAAI	-
HCVRD:A Benchmark for Large-Scale Human-Centered Visual Relationship Detecti	AAAI	-
Generating Triples with Adversarial Networks for Scene Graph Construction	AAAI	-

2017

Title	Venue	Code
Pixels to Graphs by Associative Embedding	NIPS	-
On support relations and semantic scene graphs	ISPRS	-
Joint Embeddings of Scene Graphs and Images	ICLR	-
Visual Relationship Detection with Internal and External Linguistic Knowledge Distillation	ICCV	-
Scene Graph Generation from Objects, Phrases and Region Captions	ICCV	-
Phrase Localization and Visual Relationship Detection with Comprehensive Image-Language Cues	ICCV	-
Visual Translation Embedding Network for Visual Relation Detection	CVPR	-
ViP-CNN: Visual Phrase Guided Convolutional Neural Network	CVPR	-
Scene Graph Generation by Iterative Message Passing	CVPR	-
Relationship Proposal Networks	CVPR	-
Modeling Relationships in Referential Expressions with Compositional Modular Networks	CVPR	-
Learning Object Interactions and Descriptions for Semantic Image Segmentation	CVPR	-
Detecting Visual Relationships with Deep Relational Networks	CVPR	-
Deep Variation-Structured Reinforcement Learning for Visual Relationship and Attribute Detection	CVPR	-
Online Cross-Modal Scene Retrieval by Binary Representation and Semantic Graph	ACM	-

2010-2016

Title	Venue	Code
Visual Relationship Detection with Language Priors	ECCV	-
Generating Semantically Precise Scene Graphs from Textual Descriptions for Improved Image Retrieval	WVL	-
Image Retrieval using Scene Graphs	CVPR	-
From Images to Sentences through Scene Description Graphs using Commonsense Reasoning and Knowledge	arXiv	-
Categorizing Object-Action Relations from Semantic Scene Graphs	ICRA	-