Informatics Report Series



Related Pages

Report (by Number) Index
Report (by Date) Index
Author Index
Institute Index

Title:A Model for Learning the Semantics of Pictures
Authors: Victor Lavrenko ; R Manmatha ; J Jeon
Date:Dec 2003
Publication Title:Proceedings of the 17th International Conference on Neural Information Processings Systems (NIPS) 2003
Publication Type:Conference Paper Publication Status:Published
We propose an approach to learning the semantics of images which allows us to automatically annotate an image with keywords and to retrieve images based on text queries. We do this using a formalism that models the generation of annotated images. We assume that every image is divided into regions, each described by a continuous-valued feature vector. Given a training set of images with annotations, we compute a joint probabilistic model of image features and words which allow us to predict the probability of generating a word given the image regions. This may be used to automatically annotate and retrieve images given a word as a query. Experiments show that our model significantly outperforms the best of the previously reported results on the tasks of automatic image annotation and retrieval.
Links To Paper
1st link
Bibtex format
author = { Victor Lavrenko and R Manmatha and J Jeon },
title = {A Model for Learning the Semantics of Pictures},
book title = {Proceedings of the 17th International Conference on Neural Information Processings Systems (NIPS) 2003},
year = 2003,
month = {Dec},
url = {},

Home : Publications : Report 

Please mail <> with any changes or corrections.
Unless explicitly stated otherwise, all material is copyright The University of Edinburgh