Hostname: page-component-848d4c4894-ttngx Total loading time: 0 Render date: 2024-06-04T06:14:26.245Z Has data issue: false hasContentIssue false
  • English
  • Français

Robust Ship Tracking via Multi-view Learning and Sparse Representation

Published online by Cambridge University Press:  13 September 2018

Xinqiang Chen ,
Shengzheng Wang ,
Chaojian Shi ,
Huafeng Wu ,
Jiansen Zhao  and
Junjie Fu
Xinqiang Chen*
Affiliation:
(Institute of Logistics Science and Engineering, Shanghai Maritime University, Shanghai, 201306, PR China)
Shengzheng Wang
Affiliation:
(Merchant Marine College, Shanghai Maritime University, Shanghai, 201306, PR China)
Chaojian Shi
Affiliation:
(Merchant Marine College, Shanghai Maritime University, Shanghai, 201306, PR China)
Huafeng Wu
Affiliation:
(Merchant Marine College, Shanghai Maritime University, Shanghai, 201306, PR China)
Jiansen Zhao
Affiliation:
(Merchant Marine College, Shanghai Maritime University, Shanghai, 201306, PR China)
Junjie Fu
Affiliation:
(Merchant Marine College, Shanghai Maritime University, Shanghai, 201306, PR China)
*
(E-mail: chenxinqiang@stu.shmtu.edu.cn)
Get access Rights & Permissions [Opens in a new window]

Abstract

Conventional visual ship tracking methods employ single and shallow features for the ship tracking task, which may fail when a ship presents a different appearance and shape in maritime surveillance videos. To overcome this difficulty, we propose to employ a multi-view learning algorithm to extract a highly coupled and robust ship descriptor from multiple distinct ship feature sets. First, we explore multiple distinct ship feature sets consisting of a Laplacian-of-Gaussian (LoG) descriptor, a Local Binary Patterns (LBP) descriptor, a Gabor filter, a Histogram of Oriented Gradients (HOG) descriptor and a Canny descriptor, which present geometry structure, texture and contour information, and more. Then, we propose a framework for integrating a multi-view learning algorithm and a sparse representation method to track ships efficiently and effectively. Finally, our framework is evaluated in four typical maritime surveillance scenarios. The experimental results show that the proposed framework outperforms the conventional and typical ship tracking methods.

Keywords

Ship trackingMulti-view learningSparse representationSmart ship
Type
Research Article
Information
The Journal of Navigation , Volume 72 , Issue 1 , January 2019 , pp. 176 - 192
Copyright
Copyright © The Royal Institute of Navigation 2018 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

REFERENCES

Allen, J. G., Xu, R. Y. and Jin, J. S. (2004). Object tracking using camshift algorithm and multiple quantized feature spaces. Proceedings of the Pan-Sydney area workshop on Visual information processing, Australian Computer Society, 36, 3–7.Google Scholar
Bardow, P., Davison, A. J., and Leutenegger, S. (2016). Simultaneous optical flow and intensity estimation from an event camera. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 884–892.Google Scholar
Burmeister, H. C., Bruhn, W., Rødseth, Ø. J., and Porathe, T. (2014). Autonomous Unmanned Merchant Vessel and its Contribution towards the e-Navigation Implementation: The MUNIN Perspective. International Journal of e-Navigation and Maritime Economy, 1, 1–13.Google Scholar
Canny, J. (1986). A computational approach to edge detection. IEEE Transactions on pattern analysis and machine intelligence, PAMI-8( 6), 679–698.Google Scholar
Chaturvedi, S. K., Yang, C. S., Ouchi, K., and Shanmugam, P. (2012). Ship recognition by integration of SAR and AIS. The Journal of Navigation, 65(02), 323–337.Google Scholar
Chauhan, A. K. and Krishan, P. (2013). Moving object tracking using gaussian mixture model and optical flow. International Journal of Advanced Research in Computer Science and Software Engineering, 3(4), 243–246.Google Scholar
Chen, Y. (2014). Satellite-based AIS and its Comparison with LRIT. Transnav International Journal on Marine Navigation & Safety of Sea Transportation, 8(2), 183–187.Google Scholar
Comaniciu, D., Ramesh, V., and Meer, P. (2000). Real-time tracking of non-rigid objects using mean shift. IEEE Conference on Computer Vision and Pattern Recognition, 2, 142–149.Google Scholar
Dalal, N., and Triggs, B. (2005). Histograms of oriented gradients for human detection. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1, 886–893.Google Scholar
Delamarre, Q. and Faugeras, O. (1999). 3D articulated models and multi-view tracking with silhouettes. Proceedings of the Seventh IEEE International Conference on Computer Vision, 2, 716–721.Google Scholar
Friedman, J., Hastie, T. and Tibshirani, R. (2008). Sparse inverse covariance estimation with the graphical lasso. Biostatistics, 9(3), 432–441.Google Scholar
Gong, P., Ye, J., and Zhang, C. (2012). Robust multi-task feature learning. Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining, 895–903.Google Scholar
Gray, G. J., Aouf, N., Richardson, M. A., Butters, B. and Walmsley, R. (2012). An Intelligent tracking algorithm for an imaging infrared anti-ship missile. SPIE Security+ Defence, International Society for Optics and Photonics, 8543, 85430L.Google Scholar
Gray, G. J., Aouf, N., Richardson, M. A., Butters, B., Walmsley, R. and Nicholls, E. (2011). Feature-based tracking algorithms for imaging infrared anti-ship missiles. SPIE Security+ Defence, International Society for Optics and Photonics, 8187, 81870T.Google Scholar
Gunn, S. R. (1999). On the discrete representation of the Laplacian of Gaussian. Pattern Recognition, 32(8), 1463–1472.Google Scholar
Han, S. K., Ra, W. S., Whang, I. H. and Park, J. B. (2014). Linear recursive passive target tracking filter for cooperative sea-skimming anti-ship missiles. IET Radar, Sonar & Navigation, 8(7), 805–814.Google Scholar
Hong, Z., Mei, X., Prokhorov, D. and Tao, D. (2013). Tracking via Robust Multi-task Multi-view Joint Sparse Representation. IEEE Conference on Computer Vision, 649–656.Google Scholar
Hong, Z., Chen, Z., Wang, C., Mei, X., Prokhorov, D. and Tao, D. (2015). Multi-store tracker (muster): A cognitive psychology inspired approach to object tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 749–758.Google Scholar
Hu, W. C., Yang, C. Y. and Huang, D. Y. (2011). Robust real-time ship detection and tracking for visual surveillance of cage aquaculture. Journal of Visual Communication and Image Representation, 22(6), 543–556.Google Scholar
Joshi, K. A. and Thakore, D. G. (2012). A survey on moving object detection and tracking in video surveillance system. International Journal of Soft Computing and Engineering, 2(3), 44–48.Google Scholar
Lapinski, A. L. S., Isenor, A. W. and Webb, S. (2016). Simulating Surveillance Options for the Canadian North. The Journal of Navigation, 69(5), 940–954.Google Scholar
Loomans, M. J., de With, P. H. and Wijnhoven, R. G. (2013). Robust automatic ship tracking in harbours using active cameras. 2013 IEEE International Conference on Image Processing, 4117–4121.Google Scholar
Ma, H., Shen, R. and Wu, Z. (2011). The Ship Automatic Tracking Technique and Implementation Based on VTS Images. ICTIS 2011: Multimodal Approach to Sustained Transportation System Development: Information, Technology, Implementation, ASCE, 2616–2623.Google Scholar
Mei, X. and Ling, H. (2011). Robust visual tracking and vehicle classification via sparse representation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(11), 2259–2272.Google Scholar
Mei, X., Hong, Z., Prokhorov, D. and Tao, D. (2015). Robust Multitask Multiview Tracking in Videos. IEEE transactions on Neural Networks and Learning Systems, 26(11), 2874–2890.Google Scholar
Silvas, E., Hereijgers, K., Peng, H., Hofman, T. and Steinbuch, M. (2016). Synthesis of Realistic Driving Cycles With High Accuracy and Computational Speed, including Slope Information. IEEE Transactions on Vehicular Technology, 65(6), 4118–4128.Google Scholar
Statheros, T., Howells, G. and Maier, K. M. (2008). Autonomous ship collision avoidance navigation concepts, technologies and techniques. The Journal of Navigation, 61(01), 129–142.Google Scholar
Suard, F., Rakotomamonjy, A., Bensrhair, A. and Broggi, A. (2006). Pedestrian detection using infrared images and histograms of oriented gradients. IEEE Intelligent Vehicles Symposium, 206–212.Google Scholar
Sun, Z., Bebis, G. and Miller, R. (2005). On-Road Vehicle Detection Using Evolutionary Gabor Filter Optimization. IEEE Transactions on Intelligent Transportation Systems, 6(2), 125–137.Google Scholar
Szpak, Z. L. and Tapamo, J. R. (2011). Maritime surveillance: Tracking ships inside a dynamic background using a fast level-set. Expert Systems with Applications, 38(6), 6669–6680.Google Scholar
Taj, M. and Cavallaro, A. (2010). Multi-view multi-object detection and tracking. In Computer Vision, Springer, Berlin, Heidelberg, 285, 263–280.Google Scholar
Tang, J., Wang, Y. and Liu, F. (2013). Characterizing traffic time series based on complex network theory. Physica A Statistical Mechanics & its Applications, 392(18), 4192–4201.Google Scholar
Tang, J., Zhang, G., Wang, Y., Wang, H. and Liu, F. (2015). A hybrid approach to integrate fuzzy C-means based imputation method with genetic algorithm for missing traffic volume data estimation. Transportation Research Part C Emerging Technologies, 51, 29–40.Google Scholar
Tang, J., Liu, F., Zou, Y., Zhang, W. and Wang, Y. (2017). An Improved Fuzzy Neural Network for Traffic Speed Prediction Considering Periodic Characteristic. IEEE Transactions on Intelligent Transportation Systems, 18(9), 2340–2350.Google Scholar
Teng, F. and Liu, Q. (2014). Robust Multiple Ship Tracking in Inland Waterway CCTV System. Indonesian Journal of Electrical Engineering and Computer Science, 12(11), 7772–7777.Google Scholar
Teng, F., Liu, Q. and Zhu, L. (2014). Robust Inland Waterway Ship Tracking via Orthogonal Particle Filter-based Predator. International Journal of Signal Processing, Image Processing and Pattern Recognition, 7(6), 125–136.Google Scholar
Teng, F., Liu, Q., Gao, X. Y. and Zhu, L. (2013). Real-time ship tracking via enhanced MIL tracker. IETET, Conference Publishing System, Kurukshetra, India, 399–404.Google Scholar
Tripathi, R. P., Ghosh, S. and Chandle, J. O. (2016). Tracking of object using optimal adaptive Kalman filter. IEEE International Conference on Engineering and Technology (ICETECH), 1128–1131.Google Scholar
Vespe, M., Greidanus, H. and Alvarez, M. A. (2015). The declining impact of piracy on maritime transport in the Indian Ocean: Statistical analysis of 5-year vessel tracking data. Marine Policy, 59, 9–15.Google Scholar
Wang, N. (2010). An intelligent spatial collision risk based on the quaternion ship domain. The Journal of Navigation, 63(04), 733–749.Google Scholar
Welch, G. and Bishop, G. (1995). An introduction to the Kalman filter. Technical Report TR 95-041, Department of Computer Science, University of North Carolina.Google Scholar
Xiao, F., Ligteringen, H., Van Gulijk, C. and Ale, B. (2015). Comparison study on AIS data of ship traffic behavior. Ocean Engineering, 95, 84–93.Google Scholar
Xu, C., Tao, D. and Xu, C. (2013). A survey on multi-view learning. Neural Computing and Applications, 23(7–8), 2031–2038.Google Scholar
Yan, Y., Zhang, S., Tang, J. and Wang, X. (2017). Understanding characteristics in multivariate traffic flow time series from complex network structure. Physica A Statistical Mechanics & its Applications, 477, 149–160.Google Scholar
Yang, J., Liang, W. and Jia, Y. (2012). Face pose estimation with combined 2D and 3D HOG features. IEEE 21st International Conference on Pattern Recognition (ICPR), 2492–2495.Google Scholar
Zhang, S., Tang, J., Wang, H., Wang, Y. and An, S. (2017b). Revealing intra-urban travel patterns and service ranges from taxi trajectories. Journal of Transport Geography, 61, 72–86.Google Scholar
Zhang, T., Ghanem, B., Liu, S. and Ahuja, N. (2012). Robust visual tracking via multi-task sparse learning. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2042–2049.Google Scholar
Zhang, W., Goerlandt, F., Kujala, P. and Wang, Y. (2016). An advanced method for detecting possible near miss ship collisions from AIS data. Ocean Engineering, 124, 141–156.Google Scholar
Zhang, W., Goerlandt, F., Montewka, J. and Kujala, P. (2015). A method for detecting possible near miss ship collisions from AIS data. Ocean Engineering, 107, 60–69.Google Scholar
Zhang, W., Kopca, C., Tang, J., Ma, D. and Wang, Y. (2017a). A systemic approach for near miss ship collision detection. The Journal of Navigation, 70(5), 1117–1132.Google Scholar
Zhao, Z., Ji, K., Xing, X., Zou, H. and Zhou, S. (2014). Ship Surveillance by Integration of Space-borne SAR and AIS–Further Research. The Journal of Navigation, 67(02), 295–309.Google Scholar