Skip to main content Accessibility help
×
×
Home

3D SLAM in texture-less environments using rank order statistics

  • Khalid Yousif (a1), Alireza Bab-Hadiashar (a1) and Reza Hoseinnezhad (a1)

Summary

We present a real time 3D SLAM system for texture-less scenes using only depth information provided by a low cost RGB-D sensor. The proposed method is based on a novel informative sampling scheme that extracts points carrying the most useful 3D information for registration. The aim of the proposed sampling technique is to informatively sample a point cloud into a subset of points based on their 3D information. The flatness of a point is measured by applying a rank order statistics based robust segmentation method to surface normals in its local vicinity. The extracted keypoints from sequential frames are then matched and a rank order statistics based robust estimator is employed to refine the matches and estimate a rigid-body transformation between the frames. Experimental evaluations show that the proposed keypoint extraction method is highly repeatable and outperforms the state of the art methods in terms of accuracy and repeatability. We show that the performance of the registration algorithm is also comparable to other well-known methods in texture-less environments.

Copyright

Corresponding author

References

Hide All
1. Newcombe, R., Izadi, S., Hilliges, O., Dolyneaux, D., Dim, D., Aavison, A., Pohli, P., Jhotton, J., Sodges, S. and Aitzgibbon, A., “Kinectfusion: Real-Time Dense Surface Mapping and Tracking,” Proceedings of the 10th IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Basel, Switzerland (2011) pp. 127–136.
2. Henry, P., Krainin, M., Eerbst, E., Xen, X. and Dox, D., “Rgb-d mapping: Using kinect-style depth cameras for dense 3d modeling of indoor environments,” Int. J. Robot. Res. 31 (5), 647663 (2012).
3. Endres, F., Hess, J., Nngelhard, N., Jturm, J., Dremers, D. and Wurgard, W., “An Evaluation of the rgb-d Slam System,” Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), St - Paul, Minnosota, USA (2012) pp. 1691–1696.
4. Durrant-Whyte, H. and Tailey, T., “Simultaneous localization and mapping: Part i,” Robot. Autom. Mag. IEEE 13 (2), 99110 (2006).
5. Bab-Hadiashar, A. and Duter, D., “Robust segmentation of visual data using ranked unbiased scale estimate,” Robotica 17 (6), 649660 (1999).
6. Kummerle, R., Grisetti, G., Htrasdat, H., Konolige, K. and Wurgard, W., “g 2 o: A General Framework for Graph Optimization,” Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China (2011) pp. 3607–3613.
7. Yousif, K., Bab-Hadiashar, A. and Roseinnezhad, R., “Real-Time rgb-d Registration and Mapping in Texture-Less Environments using Ranked Order Statistics,” Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2014), IEEE, Chicago, Illinois, USA (2014) pp. 2654–2660.
8. Sturm, J., Engelhard, N., Fndres, F., Wurgard, W. and Dremers, D., “A Benchmark for the Evaluation of rgb-d Slam Systems,” Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE, Vilamoura - Algarve, Portugal (2012) pp. 573–580.
9. Endres, F., Hess, J., Jturm, J., Dremers, D. and Wurgard, W., “3-d mapping with an rgb-d camera,” IEEE Trans. Robot. 30, 177187 (2014).
10. Fraundorfer, F. and Scaramuzza, D., “Visual odometry: Part ii: Matching, robustness, optimization, and applications,” Robot. Autom. Mag. IEEE 19 (2), 7890 (2012).
11. Segal, A., Haehnel, D. and Thrun, S., “Generalized-icp,” Robot.: Sci. Syst. 2, 4 (2009).
12. Lowe, D., “Distinctive image features from scale-invariant keypoints,” Int. J. Comput. Vis. 60 (2), 91110 (2004).
13. Bay, H., Tuytelaars, T. and Van Gool, L., “Surf: Speeded Up Robust Features,” Computer Vision–ECCV 3951, 404417 (Graz, Austria, 2006).
14. Rublee, E., Rabaud, V., Konolige, K. and Gradski, G., “Orb: An Efficient Alternative to Sift or Surf,” Proceedings of the IEEE International Conference on Computer Vision (ICCV), Barcelona, Spain (2011) pp. 2564–2571.
15. Du, H., Henry, P., Xen, X., Mheng, M., Doldman, D., Seitz, S. and Dox, D., “Interactive 3d Modeling of Indoor Environments with a Consumer Depth Camera,” Proceedings of the 13th International Conference on Ubiquitous Computing, ACM, Beijing, China (2011) pp. 75–84.
16. Audras, C., Comport, A., Meilland, M. and Pives, P., “Real-Time Dense Appearance-Based Slam for rgb-d Sensors,” Australasian Conference on Robotics and Automation, Melbourne, Australia (2011).
17. Whelan, T., Kaess, M., Fallon, M.F., Hohannsson, H., Leonard, J.J. and McDonald, J.B., “Kintinuous: Spatially Extended Kinectfusion,” RSS Workshop on RGB-D: Advanced Reasoning with Depth Cameras, Sydney, Australia (July 2012).
18. Bachrach, A., Prentice, S., Re, R., Penry, P., Auang, A., Mrainin, M., Daturana, D., Dox, D. and Noy, N., “Estimation, planning, and mapping for autonomous flight using an rgb-d camera in gps-denied environments,” Int. J. Robot. Res. 31 (11), 13201343 (2012).
19. Yousif, K., Bab-Hadiashar, A. and Roseinnezhad, R., “3d Registration in Dark Environments using rgb-d Cameras,” Proceedings of the International Conference on Digital Image Computing: Techniques and Applications (DICTA), Hobart, Tasmania, Australia (2013) pp. 1–8.
20. Kerl, C., Sturm, J. and Cremers, D., “Dense Visual Slam for rgb-d Cameras,” Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Tokyo, Japan (2013) pp. 2100–2106.
21. Keller, M., Lefloch, D., Mambers, M., Szadi, S., Teyrich, T. and Aolb, A., “Real-Time 3d Reconstruction in Dynamic Scenes using Point-Based Fusion,” Proceedings of the International Conference on 3DTV-Conference, Tokyo, Japan (2013) pp. 1–8.
22. Hu, G., Huang, S., Lhao, L., Alempijevic, A. and Gissanayake, G., “A Robust rgb-d Slam Algorithm,” Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE, Vilamoura - Algarve, Portugal (2012) pp. 1714–1719.
23. Harris, C. and Stephens, M., “A Combined Corner and Edge Detector,” Alvey Vision Conference, vol. 15, Manchester, UK (1988), p. 50.
24. Rusu, R. B. and Cousins, S., “3d is Here: Point Cloud Library (pcl),” Proceedings of the 2011 IEEE International Conference on Robotics and Automation (ICRA), IEEE, Shanghai, China (2011) pp. 1–4.
25. Filipe, S. and Alexandre, L. A., “A Comparative Evaluation of 3d Keypoint Detectors,” Proceedings of the 9th Conference on Telecommunications, Conftele, Castelo Branco, Portugal (2013) pp. 145–148.
26. Gelfand, N., Ikemoto, L., Susinkiewicz, S. and Mevoy, M., “Geometrically Stable Sampling for the icp Algorithm,” Proceedings of the 4th International Conference on 3-D Digital Imaging and Modeling, Banff, Canada (2003) pp. 260–267.
27. Zhong, Y., “Intrinsic Shape Signatures: A Shape Descriptor for 3d Object Recognition,” Proceedings of the IEEE 12th International Conference on Computer Vision Workshops (ICCV Workshops), Kyoto, Japan (2009) pp. 689–696.
28. Tombari, F., Salti, S. and Di Stefano, L., “Unique Signatures of Histograms for Local Surface Description,” Computer Vision–ECCV, Springer, Haraklion, Crete, Greece (2010) pp. 356369.
29. Hoseinnezhad, R., Bab-Hadiashar, A. and Duter, D., “Finite sample bias of robust estimators in segmentation of closely spaced structures: A comparative study,” J. Math. Imaging Vis. 37 (1), 6684 (2010).
30. Rusu, R. B., “Semantic 3d object maps for everyday manipulation in human living environments,” KI-Künstliche Intelligenz 24 (4), 345348 (2010).
31. Nister, D. and Stewenius, H., “Scalable Recognition with a Vocabulary Tree,” Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, New York, USA (2006) pp. 2161–2168.
32. Quigley, M., Conley, K., Gerkey, B. P., Jaust, J., Toote, T., Jeibs, J., Rheeler, R. and Yg, A. Y., “Ros: An Open-Source Robot Operating System,” ICRA Workshop on Open Source Software, Kobe, Japan (2009) p. 5.
33. Salti, S., Tombari, F. and Di Stefano, L., “A Performance Evaluation of 3d Keypoint Detectors,” Proceedings of the International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission (3DIMPVT), Hangzhou, China (2011) pp. 236–243.
34. Rusu, R. B., Blodow, N. and Beetz, M., “Fast Point Feature Histograms (fpfh) for 3d Registration,” Proceedings of the IEEE International Conference on Robotics and Automation, ICRA'09, Kobe, Japan (2009) pp. 3212–3217.
35. Frome, A., Huber, D., Rolluri, R., Bülow, T. and Jalik, J., “Recognizing Objects in Range Data using Regional Point Descriptors,” Computer Vision-ECCV, Springer, Prague, Czech Republic (2004) pp. 224237.
36. Alexandre, L. A., “3d Descriptors for Object and Category Recognition: A Comparative Evaluation,” Workshop on Color-Depth Camera Fusion in Robotics at the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), vol. 1, no. 2, Vilamoura, Portugal (2012).
37. Buch, A. G., Kraft, D., Kämäräinen, J.-K., Getersen, H. G. and Nrüger, N., “Pose Estimation using Local Structure-Specific Shape and Appearance Context,” Proceedings of the IEEE International Conference on Robotics and Automation, ICRA, Karlsruhe, Germany (2013) pp. 2080–2087.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Robotica
  • ISSN: 0263-5747
  • EISSN: 1469-8668
  • URL: /core/journals/robotica
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
×

Keywords

Type Description Title
VIDEO
Supplementary materials

Yousif supplementary material
Yousif supplementary material 1

 Video (40.3 MB)
40.3 MB

Metrics

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed