Learning Visual Contexts for Image Annotation from Flickr Groups

Adrian Ulges, Marcel Worring, Thomas Breuel
In: Sheila S. Hemami (ed.) IEEE Transactions on Multimedia volume 13 number 3, Pages 1-12, IEEE Computer Society, 4/2011


We present an extension of automatic image annotation that takes the context of a picture into account. Our core assumption is that users do not only provide individual images to be tagged, but group their pictures into batches (e.g., all snapshots taken over the same holiday trip), whereas the images within a batch are likely to have a common style. These batches are matched with categories learned from Flickr groups, and an accurate context-specific annotation is performed. In quantitative experiments, we demonstrate that Flickr groups, with their user-driven categorization and their rich group space, provide an excellent basis for learning context categories. Our approach -- which can be integrated with virtually any annotation model -- is demonstrated to give significant improvements of above 100%, compared to standard annotations of individual images.


@article{ ULGE2011,
	Title = {Learning Visual Contexts for Image Annotation from Flickr Groups},
	Author = {Adrian Ulges and Marcel Worring and Thomas Breuel},
	Editor = {Sheila S. Hemami},
	Month = {4},
	Year = {2011},
	Publisher = {IEEE Computer Society},
	Publisher = {13},
	Pages = {1-12},
	Journal = {IEEE Transactions on Multimedia},
	Number = {3}

Last modified:: 30.08.2016