Hostname: page-component-8448b6f56d-m8qmq Total loading time: 0 Render date: 2024-04-24T10:14:49.725Z Has data issue: false hasContentIssue false
  • English
  • Français

3D SLAM in texture-less environments using rank order statistics

Published online by Cambridge University Press:  21 October 2015

Khalid Yousif ,
Alireza Bab-Hadiashar Open the ORCID record for Alireza Bab-Hadiashar [Opens in a new window]  and
Reza Hoseinnezhad
Khalid Yousif*
Affiliation:
School of Aerospace, Mechanical and Manufacturing Engineering, RMIT University, Melbourne, VIC 3001, Australia
Alireza Bab-Hadiashar
Affiliation:
School of Aerospace, Mechanical and Manufacturing Engineering, RMIT University, Melbourne, VIC 3001, Australia
Reza Hoseinnezhad
Affiliation:
School of Aerospace, Mechanical and Manufacturing Engineering, RMIT University, Melbourne, VIC 3001, Australia
*
*Corresponding author. E-mail: s3362555@student.rmit.edu.au; abh@rmit.edu.au; rezah@rmit.edu.au
Get access Rights & Permissions [Opens in a new window]

Summary

We present a real time 3D SLAM system for texture-less scenes using only depth information provided by a low cost RGB-D sensor. The proposed method is based on a novel informative sampling scheme that extracts points carrying the most useful 3D information for registration. The aim of the proposed sampling technique is to informatively sample a point cloud into a subset of points based on their 3D information. The flatness of a point is measured by applying a rank order statistics based robust segmentation method to surface normals in its local vicinity. The extracted keypoints from sequential frames are then matched and a rank order statistics based robust estimator is employed to refine the matches and estimate a rigid-body transformation between the frames. Experimental evaluations show that the proposed keypoint extraction method is highly repeatable and outperforms the state of the art methods in terms of accuracy and repeatability. We show that the performance of the registration algorithm is also comparable to other well-known methods in texture-less environments.

Keywords

SLAMLocalizationMappingRGB-DTexture-less
Type
Articles
Information
Robotica , Volume 35 , Issue 4 , April 2017 , pp. 809 - 831
Copyright
Copyright © Cambridge University Press 2015 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

1. Newcombe, R., Izadi, S., Hilliges, O., Dolyneaux, D., Dim, D., Aavison, A., Pohli, P., Jhotton, J., Sodges, S. and Aitzgibbon, A., “Kinectfusion: Real-Time Dense Surface Mapping and Tracking,” Proceedings of the 10th IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Basel, Switzerland (2011) pp. 127–136.Google Scholar
2. Henry, P., Krainin, M., Eerbst, E., Xen, X. and Dox, D., “Rgb-d mapping: Using kinect-style depth cameras for dense 3d modeling of indoor environments,” Int. J. Robot. Res. 31 (5), 647–663 (2012).Google Scholar
3. Endres, F., Hess, J., Nngelhard, N., Jturm, J., Dremers, D. and Wurgard, W., “An Evaluation of the rgb-d Slam System,” Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), St - Paul, Minnosota, USA (2012) pp. 1691–1696.Google Scholar
4. Durrant-Whyte, H. and Tailey, T., “Simultaneous localization and mapping: Part i,” Robot. Autom. Mag. IEEE 13 (2), 99–110 (2006).CrossRefGoogle Scholar
5. Bab-Hadiashar, A. and Duter, D., “Robust segmentation of visual data using ranked unbiased scale estimate,” Robotica 17 (6), 649–660 (1999).Google Scholar
6. Kummerle, R., Grisetti, G., Htrasdat, H., Konolige, K. and Wurgard, W., “g 2 o: A General Framework for Graph Optimization,” Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China (2011) pp. 3607–3613.Google Scholar
7. Yousif, K., Bab-Hadiashar, A. and Roseinnezhad, R., “Real-Time rgb-d Registration and Mapping in Texture-Less Environments using Ranked Order Statistics,” Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2014), IEEE, Chicago, Illinois, USA (2014) pp. 2654–2660.Google Scholar
8. Sturm, J., Engelhard, N., Fndres, F., Wurgard, W. and Dremers, D., “A Benchmark for the Evaluation of rgb-d Slam Systems,” Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE, Vilamoura - Algarve, Portugal (2012) pp. 573–580.Google Scholar
9. Endres, F., Hess, J., Jturm, J., Dremers, D. and Wurgard, W., “3-d mapping with an rgb-d camera,” IEEE Trans. Robot. 30, 177–187 (2014).Google Scholar
10. Fraundorfer, F. and Scaramuzza, D., “Visual odometry: Part ii: Matching, robustness, optimization, and applications,” Robot. Autom. Mag. IEEE 19 (2), 78–90 (2012).Google Scholar
11. Segal, A., Haehnel, D. and Thrun, S., “Generalized-icp,” Robot.: Sci. Syst. 2, 4 (2009).Google Scholar
12. Lowe, D., “Distinctive image features from scale-invariant keypoints,” Int. J. Comput. Vis. 60 (2), 91–110 (2004).Google Scholar
13. Bay, H., Tuytelaars, T. and Van Gool, L., “Surf: Speeded Up Robust Features,” Computer Vision–ECCV 3951, 404–417 (Graz, Austria, 2006).Google Scholar
14. Rublee, E., Rabaud, V., Konolige, K. and Gradski, G., “Orb: An Efficient Alternative to Sift or Surf,” Proceedings of the IEEE International Conference on Computer Vision (ICCV), Barcelona, Spain (2011) pp. 2564–2571.Google Scholar
15. Du, H., Henry, P., Xen, X., Mheng, M., Doldman, D., Seitz, S. and Dox, D., “Interactive 3d Modeling of Indoor Environments with a Consumer Depth Camera,” Proceedings of the 13th International Conference on Ubiquitous Computing, ACM, Beijing, China (2011) pp. 75–84.Google Scholar
16. Audras, C., Comport, A., Meilland, M. and Pives, P., “Real-Time Dense Appearance-Based Slam for rgb-d Sensors,” Australasian Conference on Robotics and Automation, Melbourne, Australia (2011).Google Scholar
17. Whelan, T., Kaess, M., Fallon, M.F., Hohannsson, H., Leonard, J.J. and McDonald, J.B., “Kintinuous: Spatially Extended Kinectfusion,” RSS Workshop on RGB-D: Advanced Reasoning with Depth Cameras, Sydney, Australia (July 2012).Google Scholar
18. Bachrach, A., Prentice, S., Re, R., Penry, P., Auang, A., Mrainin, M., Daturana, D., Dox, D. and Noy, N., “Estimation, planning, and mapping for autonomous flight using an rgb-d camera in gps-denied environments,” Int. J. Robot. Res. 31 (11), 1320–1343 (2012).CrossRefGoogle Scholar
19. Yousif, K., Bab-Hadiashar, A. and Roseinnezhad, R., “3d Registration in Dark Environments using rgb-d Cameras,” Proceedings of the International Conference on Digital Image Computing: Techniques and Applications (DICTA), Hobart, Tasmania, Australia (2013) pp. 1–8.Google Scholar
20. Kerl, C., Sturm, J. and Cremers, D., “Dense Visual Slam for rgb-d Cameras,” Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Tokyo, Japan (2013) pp. 2100–2106.Google Scholar
21. Keller, M., Lefloch, D., Mambers, M., Szadi, S., Teyrich, T. and Aolb, A., “Real-Time 3d Reconstruction in Dynamic Scenes using Point-Based Fusion,” Proceedings of the International Conference on 3DTV-Conference, Tokyo, Japan (2013) pp. 1–8.Google Scholar
22. Hu, G., Huang, S., Lhao, L., Alempijevic, A. and Gissanayake, G., “A Robust rgb-d Slam Algorithm,” Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE, Vilamoura - Algarve, Portugal (2012) pp. 1714–1719.Google Scholar
23. Harris, C. and Stephens, M., “A Combined Corner and Edge Detector,” Alvey Vision Conference, vol. 15, Manchester, UK (1988), p. 50.Google Scholar
24. Rusu, R. B. and Cousins, S., “3d is Here: Point Cloud Library (pcl),” Proceedings of the 2011 IEEE International Conference on Robotics and Automation (ICRA), IEEE, Shanghai, China (2011) pp. 1–4.Google Scholar
25. Filipe, S. and Alexandre, L. A., “A Comparative Evaluation of 3d Keypoint Detectors,” Proceedings of the 9th Conference on Telecommunications, Conftele, Castelo Branco, Portugal (2013) pp. 145–148.Google Scholar
26. Gelfand, N., Ikemoto, L., Susinkiewicz, S. and Mevoy, M., “Geometrically Stable Sampling for the icp Algorithm,” Proceedings of the 4th International Conference on 3-D Digital Imaging and Modeling, Banff, Canada (2003) pp. 260–267.Google Scholar
27. Zhong, Y., “Intrinsic Shape Signatures: A Shape Descriptor for 3d Object Recognition,” Proceedings of the IEEE 12th International Conference on Computer Vision Workshops (ICCV Workshops), Kyoto, Japan (2009) pp. 689–696.Google Scholar
28. Tombari, F., Salti, S. and Di Stefano, L., “Unique Signatures of Histograms for Local Surface Description,” Computer Vision–ECCV, Springer, Haraklion, Crete, Greece (2010) pp. 356–369.Google Scholar
29. Hoseinnezhad, R., Bab-Hadiashar, A. and Duter, D., “Finite sample bias of robust estimators in segmentation of closely spaced structures: A comparative study,” J. Math. Imaging Vis. 37 (1), 66–84 (2010).Google Scholar
30. Rusu, R. B., “Semantic 3d object maps for everyday manipulation in human living environments,” KI-Künstliche Intelligenz 24 (4), 345–348 (2010).Google Scholar
31. Nister, D. and Stewenius, H., “Scalable Recognition with a Vocabulary Tree,” Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, New York, USA (2006) pp. 2161–2168.Google Scholar
32. Quigley, M., Conley, K., Gerkey, B. P., Jaust, J., Toote, T., Jeibs, J., Rheeler, R. and Yg, A. Y., “Ros: An Open-Source Robot Operating System,” ICRA Workshop on Open Source Software, Kobe, Japan (2009) p. 5.Google Scholar
33. Salti, S., Tombari, F. and Di Stefano, L., “A Performance Evaluation of 3d Keypoint Detectors,” Proceedings of the International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission (3DIMPVT), Hangzhou, China (2011) pp. 236–243.Google Scholar
34. Rusu, R. B., Blodow, N. and Beetz, M., “Fast Point Feature Histograms (fpfh) for 3d Registration,” Proceedings of the IEEE International Conference on Robotics and Automation, ICRA'09, Kobe, Japan (2009) pp. 3212–3217.Google Scholar
35. Frome, A., Huber, D., Rolluri, R., Bülow, T. and Jalik, J., “Recognizing Objects in Range Data using Regional Point Descriptors,” Computer Vision-ECCV, Springer, Prague, Czech Republic (2004) pp. 224–237.Google Scholar
36. Alexandre, L. A., “3d Descriptors for Object and Category Recognition: A Comparative Evaluation,” Workshop on Color-Depth Camera Fusion in Robotics at the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), vol. 1, no. 2, Vilamoura, Portugal (2012).Google Scholar
37. Buch, A. G., Kraft, D., Kämäräinen, J.-K., Getersen, H. G. and Nrüger, N., “Pose Estimation using Local Structure-Specific Shape and Appearance Context,” Proceedings of the IEEE International Conference on Robotics and Automation, ICRA, Karlsruhe, Germany (2013) pp. 2080–2087.Google Scholar

Yousif supplementary material

Yousif supplementary material 1

Download Yousif supplementary material(Video)
Video 40.3 MB