Efficient intra mode decision for low complexity HEVC screen content compression


Autoři: Qiuwen Zhang aff001;  Yongbo Zhao aff001;  Weiwei Zhang aff001;  Lijun Sun aff002;  Rijian Su aff001
Působiště autorů: College of Computer and Communication Engineering, Zhengzhou University of Light Industry, Zhengzhou, Henan, China aff001;  School of Electrical Engineering, Henan University of Technology, Zhengzhou, Henan, China aff002
Vyšlo v časopise: PLoS ONE 14(12)
Kategorie: Research Article
prolekare.web.journal.doi_sk: 10.1371/journal.pone.0226900

Souhrn

High efficiency video coding screen content coding (HEVC-SCC) extension is the latest HEVC development to improve the compression performance of screen content (SC) video. Similar to HEVC, the intra mode selection in HEVC-SCC is performed all the coding unit (CU) partitions to find the least rate distortion (RD) cost. Furthermore, additional intra tools are introduced to improve HEVC-SCC coding efficiency. However, these new tools could cause high computation complexity which restricts HEVC-SCC from ongoing applications. To solve the problem, an efficient intra mode decision for HEVC-SCC that adaptively utilizes the texture complexity of SC treeblock is proposed. The texture complexity of a SC treeblock is first analyzed according to the variation degree of the luminance value. And then, two efficient approaches are proposed based on the constructed model, which are early CU depth level determination and adaptive intra mode selection. Experimental results demonstrate that the proposed method can save 48.5% encoder runtime while keeping nearly the same coding efficiency as the HEVC-SCC encoders.

Klíčová slova:

Algorithms – Decision trees – Luminance – Machine learning algorithms – Sequence analysis – Signal processing – Simulation and modeling – Video compression


Zdroje

1. Xu J., Joshi R., and Cohen R. A., “Overview of the emerging HEVC screen content coding extension,” IEEE Trans. Circuits Syst. Video Technol., vol. 26, no. 1, pp. 50–62, Jan. 2016.

2. Tsang S., Chan Y., Kuang W. and Siu W., “Reduced-complexity intra block copy (IntraBC) mode with early CU splitting and pruning for HEVC screen content coding,” IEEE Trans. Multimedia, vol. 21, no. 2, pp. 269–283, Feb. 2019.

3. Zhu W., Ding W., Xu J., Shi Y., and Yin B., “Screen content coding based on HEVC framework,” IEEE Trans. Multimedia, vol. 16, no. 5, pp. 1316–1326, Aug. 2014.

4. Ma Z., Wang W., Xu M., and Yu H., “Advanced screen content coding using color table and index map,” IEEE Trans. Image Process., vol. 23, no. 10, pp. 4399–4412, Oct. 2014.

5. Sullivan G. J., Boyce J.M., Ying C., Ohm J.-R., Segall C.A., and Vetro A., “Standardized extensions of High Efficiency Video Coding (HEVC),” IEEE J. Sel. Top. Sign. Proces., vol. 7, no. 6, pp. 1001–1016, Dec. 2013.

6. R. Joshi, J. Xu, R. Cohen, S. Liu, Z. Ma, and Y. Ye, “Screen Content Coding Test Model 3 Encoder Description (SCM 3)”, in Joint Collaborative Team on Video Coding (JCTVC), JCTVC-S1014, Strasbourg, October 2014.

7. Sullivan G. J., Ohm J.-R., Han W.-J., and Wiegand T., “Overview of the high efficiency video coding (HEVC) standard,” IEEE Trans. Circuits Syst. Video Technol., vol. 22, no. 12, pp. 1648–1667, Dec. 2012.

8. Xiao W., Shi G., Li B., Xu J., and Wu F., “Fast hash-based inter-block matching for screen content coding,'' IEEE Trans. Circuits Syst. Video Technol.,” vol. 28, no. 5, pp. 1169–1182, May 2018.

9. J. Sole and S. Liu, “HEVC Screen Content Coding Core Experiment 1 (SCCE1): Intra Block Copying Extensions,” in Joint Collaborative Team on Video Coding(JCTVC), JCTVC-Q1121, Valencia, ES, Mar. 2014.

10. Sun Y., Chuang T., Lai P., and Chen Y., “Palette mode—A new coding tool in screen content coding extensions of HEVC,” in Proc. IEEE Int. Conf. Image Process(ICIP), pp. 2409–2413, Quebec City, QC, Canada, 2015.

11. L. Zhang, J. Chen, J. Sole, and M. Karczewicz, “AHG8: In-loop color-space transform,” in Joint Collaborative Team on Video Coding (JCTVC), JCTVC-Q0112, Valencia, ES, Mar. 2014.

12. Xiong J., Li H., Wu Q., and Meng F., “A fast HEVC inter CU selection method based on pyramid motion divergence,” IEEE Trans. Multimedia, vol. 16, no. 2, pp. 559–564, Feb. 2014.

13. Shen L., Zhang Z., and Liu Z., “Adaptive inter-mode decision for HEVC jointly utilizing inter-level and spatio-temporal correlations,” IEEE Trans. Circuits Syst. Video Technol., vol. 24, no. 10, pp. 1709–1722, Oct. 2014.

14. Zhang H. and Ma Z., “Fast intra mode decision for high efficiency video coding (HEVC),” IEEE Trans. Circuits Syst. Video Technol., vol. 24, no. 4, pp. 660–668, Apr. 2014.

15. Shen L., Zhang Z., and Liu Z., “Effective CU Size Decision for HEVC Intracoding,” IEEE Trans. Image Process., vol. 23, no. 10, pp. 4232–4241, Oct. 2014.

16. Corrêa G., Assuncao P. A., Agostini L. V., and da Silva Cruz L. A., “Fast HEVC encoding decisions using data mining,” IEEE Trans. Circuits Syst. Video Technol., vol. 25, no. 4, pp. 660–673, Apr. 2015.

17. Zhang Q., Chang H., Wu Q., and Gan Y., “Fast motion and disparity estimation for HEVC based 3D video coding,” Multidim. Syst. Sign. Process., vol.27, no.3, pp. 743–761, Jul. 2016.

18. Zhang Y., Kwong S., Wang X., Yuan H., Pan Z., and Xu L., “Machine learning-based coding unit depth decisions for flexible complexity allocation in high efficiency video coding,” IEEE Trans. Image Process., vol. 24, no. 7, pp. 2225–2238, Jul. 2015.

19. Kwon D. and Budagavi M., “Fast intra block copy (IntraBC) search for HEVC screen content coding,” in Proc. IEEE Int. Symp. Circuits Syst., pp. 9–12, Jun. 2014.

20. Zhang M., Guo Y., and Bai H., “Fast intra partition algorithm for HEVC screen content coding,” in Proc. IEEE Vis. Commun. Image Process. (VCIP), pp. 390–393, Dec. 2014.

21. B. Li and J. Xu, “A fast algorithm for adaptive motion compensation precision in screen content coding,” in Proc. Data Compression Conference (DCC), pp. 243–252, Apr. 2015.

22. Lee D., Yang S., Shim H. J., and Jeon B., “Fast transform skip mode decision for HEVC screen content coding,” in Proc. IEEE Int. Symp. Broadband Multimedia Syst. Broadcast. (BMSB), pp. 1–4, Jun. 2015.

23. Tsang S., Chan Y., and Siu W., “Fast and efficient intra coding techniques for smooth regions in screen content coding based on boundary prediction samples,” in Proc. IEEE Int. Conf. Acoust. Speech Signal Process. (ICASSP) pp. 1409–1413, Apr. 2015.

24. Sanchez V., “Fast intra-prediction for lossless coding of screen content in HEVC,” in Proc. IEEE Glob. Conf. Signal Inf. Process. (GlobalSIP), pp. 1367–1371, Dec. 2015.

25. Zhang H., Zhou Q., Shi N., Yang F., Feng X., and Ma Z., “Fast intra mode decision and block matching for HEVC screen content compression,” in Proc. IEEE Int. Conf. Acoust., Speech Signal Process.(ICASSP), pp. 1377–1381, Mar. 2016.

26. Duanmu F., Ma Z., and Wang Y., “Fast CU partition decision using machine learning for screen content compression,” in Proc. IEEE Int. Conf. Image Process. (ICIP), pp. 4972–4976, Sep. 2015.

27. Duanmu F., Ma Z., and Wang Y., “Fast mode and partition decision using machine learning for intra-frame coding in HEVC screen content coding extension,” IEEE J. Emerg. Sel. Topic Circuits Syst., vol.6, no.4, pp. 517–531, Dec. 2016.

28. Lei J., Li D., Pan Z., Sun Z., Kwong S., and Hou C., “Fast intra prediction based on content property analysis for low complexity HEVC-based screen content coding,” IEEE Trans. Broadcast., vol. 63, no. 1, pp. 48–58, Mar. 2017.

29. Yang H., Shen L. Q., and An P., “Efficient screen content intra coding based on statistical learning,” Signal Process., Image Commun.,” vol. 62, pp. 74–81, Mar. 2018.

30. Duanmu F., Ma Z., and Wang Y., “An HEVC-Compliant fast screen content transcoding framework based on mode mapping,” IEEE Trans. Circuits Syst. Video Technol., Early Access Article, pp. 1–14, Oct. 2018.

31. Y. Xue, X. Wang, L. Zhu, Z. Pan and S. Kwong, “Fast coding unit decision for intra screen content coding based on ensemble learning,” in Proc. 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 8543–8547, Brighton, Apr. 2019.

32. Kuang W., Chan Y.-L., Tsang S.-H., and Siu W.-C., “Machine learning based fast intra mode decision for HEVC screen content coding via decision trees,” IEEE Trans. Circuits Syst. Video Technol., Early Access Article, pp. 1–15, Mar. 2019.

33. Shen L., Liu Z., Zhang X., Zhao W., and Zhang Z., “An effective CU size decision method for HEVC encoders,” IEEE Trans. Multimedia, vol. 15, no. 2, Feb.2013.

34. HEVC-SCC Reference Software Version 5.2 (SCM-5.2). [Online]. https://hevc.hhi.fraunhofer.de/svn/svn_HEVCSoftware/tags/HM-16.6+SCM-5.2/

35. H. Yu, R. Cohen, K. Rapaka, and J. Xu, Common Test Condition for Screen Content Coding, JCTVC-U1015, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11 21st Meeting, Warsaw, Poland, Jun. 2015.

36. G. Bjontegaard, “Calculation of average PSNR difference between RD-curves,” 13th VCEG Meeting, Doc. VCEG-M33, Austin, TX, Apr. 2001.


Článok vyšiel v časopise

PLOS One


2019 Číslo 12