Depth-based descriptor for matching keypoints in 3D scenes
Abstract
Keypoint detection is a basic step in many computer vision algorithms aimed at recognition of objects, automatic navigation and analysis of biomedical images. Successful implementation of higher level image analysis tasks, however, is conditioned by reliable detection of characteristic image local regions termed keypoints. A large number of keypoint detection algorithms has been proposed and verified. In this paper we discuss the most important keypoint detection algorithms. The main part of this work is devoted to description of a keypoint detection algorithm we propose that incorporates depth information computed from stereovision cameras or other depth sensing devices. It is shown that filtering out keypoints that are context dependent, e.g. located at boundaries of objects can improve the matching performance of the keypoints which is the basis for object recognition tasks. This improvement is shown quantitatively by comparing the proposed algorithm to the widely accepted SIFT keypoint detector algorithm. Our study is motivated by a development of a system aimed at aiding the visually impaired in space perception and object identification.
References
T. Tuytelaars and K. Mikolajczyk, Local Invariant Feature Detectors:
A Survey, Foundations and Trends in Computer Graphics and Vision.
Volume 3, Issue 3 , pp. 177-280 (2007)
ZED Stereo Camera, www.stereolabs.com, accessed 2018.03.27
Google Tango Project, get.google.com/tango, accessed 2018.03.27
Structure Sensor, structure.io, accessed 2018.03.27
D. R. dos Santos, M. A. Basso, K. Khoshelham, E. de Oliveira, N. L.
Pavan, G. Vosselman, Mapping Indoor Spaces by Adaptive Coarse-to-
Fine Registration of RGB-D Data, IEEE Geoscience and Remote Sensing
Letters, Volume 13, Issue 2 (2016)
O. Wasenmller, M. Meyer, D. Stricker, CoRBS: Comprehensive RGBD
benchmark for SLAM using Kinect v2, IEEE Winter Conference on
Applications of Computer Vision (2016)
M. Karpushin, G. Valenzise and F. Dufaux, Improving distinctivness of
BRISK features using depth maps, IEEE International Conference on
Image Processing (2015)
M. Bujacz, P. Skulimowski, and P. Strumillo. Naviton - a prototype
mobility aid for auditory presentation of three-dimensional scenes to the
visually impaired. J. Audio Eng. Soc, 60(9):696–708, 2012.
K. Matusiak, P. Skulimowski, and P. Strumillo. Object recognition in
a mobile phone application for visually impaired users. In 2013 6th
International Conference on Human System Interactions (HSI), pages
–484, June 2013.
K. Matusiak, P. Skulimowski, P. Strumillo, Unbiased evaluation of
keypoint detectors with respect to rotation invariance, IET Computer
Vision, Volume 11, Issue 7, 507-516 (2017)
D. G. Lowe, Distinctive Image Features from Scale-Invariant Keypoints,
International Journal of Computer Vision, Volume 60, Issue 2, 91-110
(2004)
H. Bay, A. Ess, T. Tuytelaars, L. Van Gool, Speeded-Up Robust Features
(SURF), Computer Vision and Image Understanding, Volume 110, Issue
, 346-359 (2008)
E. Rublee, V. Rabaud, K. Konolige, G. Bradski, ORB: an efficient
alternative to SIFT or SURF, IEEE International Conference on Computer
Vision 2011
B. Steder, R. Bogdan, R. Kurt and K. W. Burgard, NARF: 3D Range
Image Features for Object Recognition, Workshop on Defining and Solving
Realistic Perception Problems in Personal Robotics at the IEEE/RSJ
Int. Conf. on Intelligent Robots and Systems (2010)
S. Leutenegger, M. Chliand and R. Y.Siegwart, BRISK: Binary Robust
invariant scalable keypoints, IEEE International Conference on Computer
Vision, pp. 2548 2555 (2011)
E. Rosten and T. Drummond, Machine Learning for High-Speed Corner
Detection, Computer Vision ECCV 2006, Volume 1, pp. 430-443 (2006)
S. Martull, M. P. Martorell, K. Fukui, Realistic CG Stereo Image Dataset
with Ground Truth Disparity Maps, ICPR2012 workshop TrakMark2012,
pp.40-42 (2012)
C. Choi, A. J. B. Trevor, H. I. Christensen, RGB-D edge detection
and edge-based registration, 2013 IEEE/RSJ International Conference on
Intelligent Robots and Systems (2013)
Q. Yu, J. Liang, J. Xiao, H. Lu, Z. Zheng, A Novel perspective
invariant feature transform for RGB-D images, Computer Vision and
Image Understanding, 167, 109-120 (2018)
E. R. Nascimento, G. L. Oliveira, M. F. M. Campos, A. W. Vieira
On the development of a robust, fast, lightweight keypoint descriptor,
Neurocomputing, 120, 141-155 (2013)
Downloads
Published
Issue
Section
License
Copyright (c) 2018 International Journal of Electronics and Telecommunications
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
1. License
The non-commercial use of the article will be governed by the Creative Commons Attribution license as currently displayed on https://creativecommons.org/licenses/by/4.0/.
2. Author’s Warranties
The author warrants that the article is original, written by stated author/s, has not been published before, contains no unlawful statements, does not infringe the rights of others, is subject to copyright that is vested exclusively in the author and free of any third party rights, and that any necessary written permissions to quote from other sources have been obtained by the author/s. The undersigned also warrants that the manuscript (or its essential substance) has not been published other than as an abstract or doctorate thesis and has not been submitted for consideration elsewhere, for print, electronic or digital publication.
3. User Rights
Under the Creative Commons Attribution license, the author(s) and users are free to share (copy, distribute and transmit the contribution) under the following conditions: 1. they must attribute the contribution in the manner specified by the author or licensor, 2. they may alter, transform, or build upon this work, 3. they may use this contribution for commercial purposes.
4. Rights of Authors
Authors retain the following rights:
- copyright, and other proprietary rights relating to the article, such as patent rights,
- the right to use the substance of the article in own future works, including lectures and books,
- the right to reproduce the article for own purposes, provided the copies are not offered for sale,
- the right to self-archive the article
- the right to supervision over the integrity of the content of the work and its fair use.
5. Co-Authorship
If the article was prepared jointly with other authors, the signatory of this form warrants that he/she has been authorized by all co-authors to sign this agreement on their behalf, and agrees to inform his/her co-authors of the terms of this agreement.
6. Termination
This agreement can be terminated by the author or the Journal Owner upon two months’ notice where the other party has materially breached this agreement and failed to remedy such breach within a month of being given the terminating party’s notice requesting such breach to be remedied. No breach or violation of this agreement will cause this agreement or any license granted in it to terminate automatically or affect the definition of the Journal Owner. The author and the Journal Owner may agree to terminate this agreement at any time. This agreement or any license granted in it cannot be terminated otherwise than in accordance with this section 6. This License shall remain in effect throughout the term of copyright in the Work and may not be revoked without the express written consent of both parties.
7. Royalties
This agreement entitles the author to no royalties or other fees. To such extent as legally permissible, the author waives his or her right to collect royalties relative to the article in respect of any use of the article by the Journal Owner or its sublicensee.
8. Miscellaneous
The Journal Owner will publish the article (or have it published) in the Journal if the article’s editorial process is successfully completed and the Journal Owner or its sublicensee has become obligated to have the article published. Where such obligation depends on the payment of a fee, it shall not be deemed to exist until such time as that fee is paid. The Journal Owner may conform the article to a style of punctuation, spelling, capitalization and usage that it deems appropriate. The Journal Owner will be allowed to sublicense the rights that are licensed to it under this agreement. This agreement will be governed by the laws of Poland.
By signing this License, Author(s) warrant(s) that they have the full power to enter into this agreement. This License shall remain in effect throughout the term of copyright in the Work and may not be revoked without the express written consent of both parties.
