Introducing Concept And Syntax Transition Networks for Image Captioning

Philipp Blandfort, Tushar Karayil Ravindran Karayil, Damian Borth, Andreas Dengel
ICMR 2016 Conference Proceedings, New York, USA, ACM, New York, NY, USA, 6/2016


The area of image captioning i.e. the automatic generation of short textual descriptions of images has experienced much progress recently. However, image captioning approaches often only focus on describing the content of the image without any emotional or sentimental dimension which is common in human captions. This paper presents an approach for image captioning designed specifically to incorporate emotions and feelings into the caption generation process. The presented approach consists of a Deep Convolutional Neural Network (CNN) for detecting Adjective Noun Pairs in the image and a novel graphical network architecture called “Concept And Syntax Transition (CAST)” network for generating sentences from these detected concepts.


@inproceedings{ BLAN2016,
	Title = {Introducing Concept And Syntax Transition Networks for Image Captioning},
	Author = {Philipp Blandfort and Tushar Karayil Ravindran Karayil and Damian Borth and Andreas Dengel},
	BookTitle = {ICMR 2016 Conference Proceedings},
	Month = {6},
	Year = {2016},
	Publisher = {ACM}

Last modified:: 30.08.2016