A Study on Low-Cost Representations for Image Feature Extraction on Mobile Devices

Conference: 20th Iberoamerican Congress on Pattern Recognition (CIARP 2015)
Book Series: Lecture Notes in Computer Science (LNIP, vol. 9423)
Publisher: Springer, Cham
Location: Montevideo, Uruguay
Published: October 25, 2015
Pages: 424–431
DOI: 10.1007/978-3-319-25751-8_51

Authors: Ramon F. Pessoa, William R. Schwartz, Jefersson A. dos Santos
Institution: Department of Computer Science, Universidade Federal de Minas Gerais (UFMG), Belo Horizonte, Brazil

Part of: Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications (CIARP 2015)
Included in: Iberoamerican Congress on Pattern Recognition

Abstract

Due the limited battery life and wireless network bandwidth limitations, compact and fast (but also accurate) representations of image features are important for multimedia applications running on mobile devices. The main purpose of this work is to analyze the behavior of techniques for image feature extraction on mobile devices by considering the triple trade-off problem regarding effectiveness, efficiency, and compactness.

We perform an extensive comparative study of state-of-the-art binary descriptors with bag of visual words. We employ a dense sampling strategy to select points for low-level feature extraction and implement four bag of visual words representations which use hard or soft assignments and two most commonly used pooling strategies: average and maximum. These mid-level representations are analyzed with and without lossless and lossy compression techniques.

Experimental evaluation point out ORB and BRIEF descriptors with soft assignment and maximum pooling as the best representation in terms of effectiveness, efficiency, and compactness.

Resources

BibTeX

@inproceedings{figueiredo2015mobilecbir,
  title={A Study on Low-Cost Representations for Image Feature Extraction on Mobile Devices},
  author={Figueiredo Pessoa, Ramon and Schwartz, William Robson and dos Santos, Jefersson Alex},
  booktitle={Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications (CIARP 2015)},
  series={Lecture Notes in Computer Science},
  volume={9423},
  pages={424--431},
  year={2015},
  publisher={Springer, Cham},
  doi={10.1007/978-3-319-25751-8\_51}
}