Hostname: page-component-8448b6f56d-m8qmq Total loading time: 0 Render date: 2024-04-23T08:26:27.525Z Has data issue: false hasContentIssue false
  • English
  • Français

Ship Type Recognition via a Coarse-to-Fine Cascaded Convolution Neural Network

Published online by Cambridge University Press:  28 February 2020

Xinqiang Chen Open the ORCID record for Xinqiang Chen [Opens in a new window] ,
Yongsheng Yang ,
Shengzheng Wang ,
Huafeng Wu ,
Jinjun Tang ,
Jiansen Zhao  and
Zhihuan Wang
Xinqiang Chen
Affiliation:
(Institute of Logistics Science and Engineering, Shanghai Maritime University)
Yongsheng Yang
Affiliation:
(Institute of Logistics Science and Engineering, Shanghai Maritime University)
Shengzheng Wang
Affiliation:
(Merchant Marine College, Shanghai Maritime University)
Huafeng Wu
Affiliation:
(Merchant Marine College, Shanghai Maritime University)
Jinjun Tang*
Affiliation:
(School of Traffic and Transportation Engineering, Central South University, Changsha)
Jiansen Zhao
Affiliation:
(Merchant Marine College, Shanghai Maritime University)
Zhihuan Wang
Affiliation:
(Institute of Logistics Science and Engineering, Shanghai Maritime University)
*
(E-mail: jinjuntang@csu.edu.cn)
Get access Rights & Permissions [Opens in a new window]

Abstract

Most previous research has handled the task of ship type recognition by exploring hand-craft ship features, which may fail to distinguish ships with similar visual appearances. This situation motivates us to propose a novel deep learning based ship type recognition framework which we have named coarse-to-fine cascaded convolution neural network (CFCCNN). First, the proposed CFCCNN framework formats the input training ship images and data, and provides trainable input data for the hidden layers of the CFCCNN. Second, the coarse and fine steps are run in a nesting manner to explore discriminative features for different ship types. More specifically, the coarse step is trained in a similar manner to the traditional convolution neural network, while the fine step introduces regularisation mechanisms to extract more intrinsic ship features, and fine tunes parameter settings to obtain better recognition performance. Finally, we evaluate the performance of the CFCCNN model for recognising the most common types of merchant ship (oil tanker, container, LNG tanker, chemical carrier, general cargo, bulk carrier, etc.). The experimental results show that the proposed framework obtains better recognition performance than the conventional methods of ship type recognition.

Keywords

Ship type recognitionCoarse-to-fine cascaded mechanismConvolution neural networkRandom heuristic selection mechanismSmart ship
Type
Research Article
Information
The Journal of Navigation , Volume 73 , Issue 4 , July 2020 , pp. 813 - 832
Copyright
Copyright © The Royal Institute of Navigation 2020

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

REFERENCES

Ahn, C. J., Jeong, I., Endo, I., Omori, T. and Hashimoto, K. Y. (2014). Maritime VHF communications with polarization diversity over a Rician channel. International Journal of Communication Systems, 27, 2443–2451.CrossRefGoogle Scholar
Bei, X., Chen, N. and Zhang, S. (2013). On the Complexity of Trial and Error. Proceedings of the ACM Symposium on Theory of Computing, California, USA.CrossRefGoogle Scholar
Bentes, C., Frost, A., Velotto, D. and Tings, B. (2016). Ship-Iceberg Discrimination with Convolutional Neural Networks in High Resolution SAR Images. Proceedings of the Proceedings of EUSAR 2016: 11th European Conference on Synthetic Aperture Radar, Hamburg, Germany.Google Scholar
Cao, X., Gao, S., Chen, L. and Wang, Y. (2019). Ship recognition method combined with image segmentation and deep learning feature extraction in video surveillance. Multimedia Tools and Applications, 1–16.Google Scholar
Chen, X., Wang, S., Shi, C., Wu, H., Zhao, J. and Fu, J. (2019). Robust ship tracking via multi-view learning and sparse representation. Journal of Navigation, 72, 176–192.CrossRefGoogle Scholar
Chuang, L. Z. H., Chung, Y. and Tang, S. T. (2015). A simple ship echo identification procedure with SeaSonde HF radar. Geoscience and Remote Sensing Letters IEEE, 12, 2491–2495.CrossRefGoogle Scholar
Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E. and Darrell, T. (2014). DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition. Proceedings of the 31st International Conference on International Conference on Machine Learning, Beijing, China.Google Scholar
Fang, J., Zhou, Y., Yu, Y. and Du, S. (2017). Fine-grained vehicle model recognition using a coarse-to-fine convolutional neural network architecture. IEEE Transactions on Intelligent Transportation Systems, 18, 1782–1792.CrossRefGoogle Scholar
Ferreira, A. and Giraldi, G. (2017). Convolutional neural network approaches to granite tiles classification. Expert Systems with Applications, 84, 1–11.CrossRefGoogle Scholar
Guo, J. and Gould, S. (2015). Deep CNN ensemble with data augmentation for object detection. Computer Science. arXiv preprint arXiv:1506.07224.Google Scholar
Guo, L. and Ding, S. (2015). Research progress on deep learning. Computer Science, 42, 28–33.Google Scholar
He, K., Zhang, X., Ren, S. and Sun, J. (2015). Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification. IEEE International Conference on Computer Vision (ICCV), Santiago, Chile, pp. 1026–1034.CrossRefGoogle Scholar
Hinton, G. E., Srivastava, N., Krishevsky, A., Sutskever, I. and Salakhutdinov, R. R. (2012). Improving neural networks by preventing co-adaptation of feature detectors. Computer Science, 3, 212–223.Google Scholar
Hu, W., Zhuo, Q., Zhang, C. and Li, J. (2017). Fast branch convolutional neural network for traffic sign recognition. IEEE Intelligent Transportation Systems Magazine, 9, 114–126.CrossRefGoogle Scholar
Huang, Y., Wu, R., Sun, Y., Wang, W. and Ding, X. (2015). Vehicle logo recognition system based on convolutional neural networks with a pretraining strategy. IEEE Transactions on Intelligent Transportation Systems, 16, 1951–1960.CrossRefGoogle Scholar
Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S. and Darrell, T. (2014). Caffe: Convolutional architecture for fast feature embedding. Proceedings of the 22nd ACM international conference on Multimedia, Florida, USA, pp. 675–678.CrossRefGoogle Scholar
Jiang, S., Pang, G., Wu, M. and Kuang, L. (2003). An improved K-nearest-neighbor algorithm for text categorisation. Expert Systems with Applications. An International Journal, 39, 1503–1509.CrossRefGoogle Scholar
Jin, J., Fu, K. and Zhang, C. (2014). Traffic sign recognition with hinge loss trained convolutional neural networks. IEEE Transactions on Intelligent Transportation Systems, 15, 1991–2000.CrossRefGoogle Scholar
Kaçar, Ü., Kumlu, D. and Kirci, M. (2015). A Novel Approach for Automatic Ship Type Classification. Proceedings of the 2015 23nd Signal Processing and Communications Applications Conference (SIU), Malatya, Turkey.CrossRefGoogle Scholar
Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R. and Fei-Fei, L. (2014). Large-scale Video Classification with Convolutional Neural Networks. Proceedings of the CVPR, Ohio, USA.CrossRefGoogle Scholar
Khaw, H. Y., Soon, F. C., Chuah, J. H. and Chow, C.-O. (2017). Image noise types recognition using convolutional neural network with principal components analysis. IET Image Processing, 11, 1238–1245.CrossRefGoogle Scholar
Krishevsky, A., Sutskever, I. and Hinton, G. E. (2012). Imagenet Classification with Deep Convolutional Neural Networks. Proceedings of the Advances in Neural Information Processing Systems, Nevada, USA.Google Scholar
Lang, H., Zhang, J., Zhang, X. and Meng, J. (2016). Ship classification in SAR image by joint feature and classifier selection. IEEE Geoscience and Remote Sensing Letters, 13, 212–216.CrossRefGoogle Scholar
Lin, H., Shi, Z. and Zou, Z. (2017). Fully convolutional network with task partitioning for inshore ship detection in optical remote sensing images. IEEE Geoscience and Remote Sensing Letters, 14, 1–5.CrossRefGoogle Scholar
Long, J., Shelhamer, E. and Darrell, T. (2015). Fully Convolutional Networks for Semantic Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, USA.CrossRefGoogle Scholar
Ma, X., Dai, Z., He, Z., Ma, J., Wang, Y. and Wang, Y. (2017). Learning traffic as images: A deep convolutional neural network for large-scale transportation network speed prediction. Sensors, 17, 818.CrossRefGoogle ScholarPubMed
Makedonas, A., Theoharatos, C., Tsagaris, V., Anastasopoulos, V. and Costicoglou, S. (2015). Vessel classification in Cosmo-Skymed SAR data using hierarchical feature selection. The International Archives of Photogrammetry. Remote Sensing and Spatial Information Sciences, 40, 975.Google Scholar
Rainey, K. (2016). Convolution Neural Networks for Ship Type Recognition. Proceedings of the SPIE Defense + Security, Baltimore, USA.Google Scholar
Razavian, A. S., Azispour, H., Sullivan, J. and Carlsson, S. (2014). CNN Features Off-the-Shelf: An Astounding Baseline for Recognition. 512–519.CrossRefGoogle Scholar
Reda, A. and Aoued, B. (2014). Artificial Neural Network-based Face Recognition. Proceedings of the International Symposium on Control, Communications and Signal Processing, Tunisia, Tunisia.Google Scholar
Robards, M., Silber, G., Adams, J., Arroyo, J., Lorenzini, D., Schwehr, K. and Amos, J. (2016). Conservation science and policy applications of the marine vessel Automatic Identification System (AIS) – a review. Bulletin of Marine Science, 92, 75–103.CrossRefGoogle Scholar
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., Berg, A. C. and Fei-Fei, L. (2015). ImageNet large scale visual recognition challenge. International Journal of Computer Vision, 115, 211–252.CrossRefGoogle Scholar
Sang, L.-Z., Wall, A., Mao, Z., Yan, X.-P. and Wang, J. (2015). A novel method for restoring the trajectory of the inland waterway ship by using AIS data. Ocean Engineering, 110, 183–194.CrossRefGoogle Scholar
Shu, Y., Daamen, W., Ligteringen, H. and Hoogendoorn, S. P. (2017). Influence of external conditions and vessel encounters on vessel behavior in ports and waterways using Automatic Identification System data. Ocean Engineering, 131, 1–14.CrossRefGoogle Scholar
Silveira, P., Teixeira, A. and Soares, C. G. (2013). Use of AIS data to characterise marine traffic patterns and ship collision risk off the coast of Portugal. The Journal of Navigation, 66, 879–898.CrossRefGoogle Scholar
Wan, L., Zeiler, M., Zhang, S., Le Cun, Y. and Fergus, R. (2013). Regularization of Neural Networks Using Dropconnect. Proceedings of the International Conference on Machine Learning, Atlanta, USA.Google Scholar
Wang, L., Wang, Y. and Zhao, D. (2010). Building Emerging Pattern (EP) Random Forest for Recognition. Proceedings of the IEEE International Conference on Image Processing, Hong Kong, China.CrossRefGoogle Scholar
Xu, C., Lu, C., Liang, X., Gao, J., Zheng, W., Wang, T. and Yan, S. (2016). Multi-loss regularized deep neural network. IEEE Transactions on Circuits and Systems for Video Technology, 26, 2273–2283.CrossRefGoogle Scholar
Yosinski, J., Clune, J., Bengio, Y. and Lipson, H. (2014). How transferable are features in deep neural networks? Eprint Arxiv, 27, 3320–3328.Google Scholar
Zhang, X., Zhang, Y. and Zheng, R. (2011). Image edge detection method of combining wavelet lift with Canny operator. Procedia Engineering, 15, 1335–1339.CrossRefGoogle Scholar