Skip to main content
×
×
Home

Non-linear contour-based multidirectional intra coding

  • Thorsten Laude (a1), Jan Tumbrägel (a1), Marco Munderloh (a1) and Jörn Ostermann (a1)
Abstract

Intra coding is an essential part of all video coding algorithms and applications. Additionally, intra coding algorithms are predestined for an efficient still image coding. To overcome limitations in existing intra coding algorithms (such as linear directional extrapolation, only one direction per block, small reference area), we propose non-linear Contour-based Multidirectional Intra Coding. This coding mode is based on four different non-linear contour models, on the connection of intersecting contours and on a boundary recall-based contour model selection algorithm. The different contour models address robustness against outliers for the detected contours and evasive curvature changes. Additionally, the information for the prediction is derived from already reconstructed pixels in neighboring blocks. The achieved coding efficiency is superior to those of related works from the literature. Compared with the closest related work, BD rate gains of 2.16% are achieved on average.

  • View HTML
    • Send article to Kindle

      To send this article to your Kindle, first ensure no-reply@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about sending to your Kindle. Find out more about sending to your Kindle.

      Note you can select to send to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be sent to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

      Find out more about the Kindle Personal Document Service.

      Non-linear contour-based multidirectional intra coding
      Available formats
      ×
      Send article to Dropbox

      To send this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Dropbox.

      Non-linear contour-based multidirectional intra coding
      Available formats
      ×
      Send article to Google Drive

      To send this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Google Drive.

      Non-linear contour-based multidirectional intra coding
      Available formats
      ×
Copyright
This is an Open Access article, distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives licence (http://creativecommons.org/licenses/by-ncnd/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is unaltered and is properly cited. The written permission of Cambridge University Press must be obtained for commercial re-use or in order to create a derivative work.
Corresponding author
Corresponding author: Thorsten Laude Email: laude@tnt.uni-hannover.de
References
Hide All
1ITU-T: Recommendation H.265/ ISO/IEC 23008-2:2013 MPEG-H Part 2: High Efficiency Video Coding (HEVC). 2013.
2Wien, M.: High Efficiency Video Coding – Coding Tools and Specification, Springer, Heidelberg, 2015.
3Hanhart, P.; Rerabek, M.; De Simone, F.; Ebrahimi, T.: Subjective quality evaluation of the upcoming HEVC video compression standard. in SPIE Optical Engineering + Applications, p. 84990V, October 2012.
4De Cock, J.; Mavlankar, A.; Moorthy, A.; Aaron, A.: A large-scale video codec comparison of x264, x265 and libvpx for practical VOD applications, in Tescher, A.G., (eds), Applications of Digital Image Processing XXXIX, International Society for Optics and Photonics, San Diego, 2016, 997116.
5Laude, T.; Adhisantoso, Y.G.; Voges, J.; Munderloh, M.; Ostermann, J.: A Comparison of JEM and AV1 with HEVC: Coding Tools Coding Efficiency and Complexity, in Proc. IEEE Picture Coding Symposium (PCS), 2018.
6Lainema, J.; Bossen, F.; Han, W.-J.; Min, J.; Ugur, K.: Intra coding of the HEVC standard. IEEE Trans. Circuits. Syst. Video Technol., 22 (2012), 17921801.
7Min, J.; Lee, S.; Kim, I.; Han, W.-J.; Lainema, J.; Ugur, K.: Unification of the Directional Intra Prediction Methods in TMuC, JCTVC-B100, Geneva, Switzerland, July 2010.
8Lottermann, C.; Steinbach, E.: Modeling the bit rate of H.264/AVC video encoding as a function of quantization parameter, frame rate and GoP characteristics, in 2014 IEEE Int. Conf. on Multimedia and Expo Workshops (ICMEW), July 2014, 16.
9Yuan, Y.; Sun, X.: Edge information based effective intra mode decision algorithm, in 2012 IEEE Int. Conf. on Signal Processing, Communication and Computing (ICSPCC), August 2012, 628633.
10Asheri, H.; Rabiee, H.; Pourdamghani, N.; Ghanbari, M.: Multi-directional spatial error concealment using adaptive edge thresholding. IEEE Trans. Consum. Electron., 58 (2012), 880885.
11Au, O.; Chan, S.-H.: Edge-directed error concealment. IEEE Trans. Circuits. Syst. Video Technol., 20 (2010), 382395.
12Liu, D.; Sun, X.; Wu, F.; Li, S.; Zhang, Y.-Q.: Image compression with edge-based inpainting. IEEE Trans. Circuits. Syst. Video. Technol., 17 (2007), 12731287.
13Liu, D.; Sun, X.; Wu, F.; Zhang, Y.-Q.: Edge-oriented uniform intra prediction. IEEE Trans. Image. Process., 17 (2008), 1827–36.
14Liu, D.; Sun, X.; Wu, F.: Edge-based inpainting and texture synthesis for image compression, in IEEE Int. Conf. on Multimedia and Expo (ICME), July 2007, 14431446.
15Laude, T.; Ostermann, J.: Contour-based multidirectional intra coding for HEVC, in IEEE Proc. of 32nd Picture Coding Symposium (PCS), Nuremberg, Germany, 2016.
16Andris, S.; Peter, P.; Weickert, J.: A proof-of-concept framework for PDE-based video compression, in Proc. of the Picture Coding Symposium (PCS), Nuremberg, Germany, 2016.
17Rares, A.; Reinders, M.; Biemond, J.: Edge-based image restoration. IEEE Trans. Image. Process., 14 (2005), 14541468.
18Canny, J.: A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. (PAMI), 8 (1986), 679698.
19Dollar, P.; Zitnick, C.L.: Fast edge detection using structured forests. IEEE Trans. Pattern. Anal. Mach. Intell., 37 (2015), 15581570.
20Suzuki, S.; Abe, K.: Topological structural analysis of digitized binary images by border following. Comput. Vis. Graph. Image. Process., 30 (1985), 3246.
21Holland, P.W.; Welsch, R.E.: Robust regression using iteratively reweighted least-squares. Commun. Stat. – Theory Methods, 6 (1977), 813827.
22Ostermann, J. et al. : Video coding with H.264/AVC: tools, performance, and complexity. IEEE Circuits. Syst. Mag., 4(1) (2004), 728.
23Ren, X.; Malik, J.: Learning a classification model for segmentation, in IEEE Proc. Ninth IEEE Int. Conf. on Computer Vision, 2003, 1017.
24Achanta, R.; Shaji, A.; Smith, K.; Lucchi, A.; Fua, P.; Süsstrunk, S.: SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Trans. Pattern. Anal. Mach. Intell., 34 (2012), 22742282.
25Reso, M.; Jachalsky, J.; Rosenhahn, B.; Ostermann, J.: Temporally consistent superpixels, in The IEEE Int. Conf. on Computer Vision (ICCV), 2013, 385392.
26I. J. Group: “http://www.ijg.org/ (accessed 2018-03-19)”.
27Sullivan, G.; Wiegand, T.: Rate-distortion optimization for video compression. IEEE Signal. Process. Mag., 15 (6) (1998), 7490.
28Bjøntegaard, G.: 35th Meeting VCEG-AI11: Improvements of the BD-PSNR model. ITU-T Study Group 16 Question 6, Berlin, Germany, 2008.
29Bossen, F.: JCT-VC L1100: Common HM test conditions and software reference configurations. 12th Meeting of the Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, Geneva, CH, 2013.
30Papadopoulos, M.A.; Zhang, F.; Agrafiotis, D.; Bull, D.: A video texture database for perceptual compression and quality assessment, in Int. Conf. Image Processing (ICIP), Quebec, Canada, 2015.
31Laude, T.; Meuel, H.; Liu, Y.; Ostermann, J.: Motion blur compensation in scalable HEVC hybrid video coding, in IEEE 2013 Picture Coding Symposium (PCS), San Jose, CA, USA, 313316, December 2013.
32Sullivan, G.J.; Ohm, J.-R.: Meeting Report of the Fourth Meeting of the Joint Collaborative Team on Video Coding. ITU-T/ISO/IEC JCT-VC Document JCTVC-D500, 2011.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

APSIPA Transactions on Signal and Information Processing
  • ISSN: 2048-7703
  • EISSN: 2048-7703
  • URL: /core/journals/apsipa-transactions-on-signal-and-information-processing
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
×

Keywords

Metrics

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed