Artificial neural network applications for data compression in video data transfer protocols

DOI: 10.31673/2412-9070.2020.043237

Abstract

The article describes the current state of data transfer protocols and methods of image and video compression through the use of artificial neural networks, namely convolutional multilayer networks and deep structured learning. Based on recent publications, a comparative analysis of the performance of classical compression methods and methods based on neural networks was performed. The most effective are those compression methods which are based on decorrelation transforms, namely discrete cosine (JPEG standard) and wavelet (JPEG-2000 standard) transforms. The transform coefficients have a well-understood physical content of spatial frequencies and can be further quantized for a more optimal representation of components that are less important for human perception. The HEVC standard guarantees a more efficient image compression scheme that further takes advantage of the similarity of adjacent blocks and uses interpolation (intracoding). Based on the HEVC standard, the BPG (better portable graphics) format was developed to be used on the Internet as an alternative to JPEG, which is much more efficient than other standards. An overview of the current state of open standards, provided in the article, gives an explanation of what properties of neural networks can be applied to image compression. There are two approaches towards the compression using neural networks: in case of the first approach neural network is used as a part of an existing algorithm (hybrid coding), and in case of the second approach the neural network gives a concise representation of the data (compression network). The final conclusions were made as regards to the application of these algorithms in H.265 protocol (HEVC) and the possibility of creating a new protocol which is completely based on the neural network. Protocols using neural network show better results during image compression, but are currently hard to be subjected to standardization in order to obtain the expected result in case of different network architects. We may expect and predict an increase in the need for video transmission in the future, which will bump into the imitating nature of classical approaches. At the same time, the development of specialized processors for parallel data processing and implementation of neural networks is currently underway. These two factors indicate that neural networks must be embedded into the industrial data standards.

Keywords: telecommunication data transfer protocol; artificial neural networks; video and image compression.

References
1. Overview of the High Efficiency Video Coding (HEVC) Standard / Gary J. Sullivan, Jens-Rainer Ohm, Woo-Jin Han, Thomas Wiegand // IEEE Trans. on Circuits and Systems for Video Technology. Dec. 2012.
2. Sullivan G. J. Comparison of the Coding Efficiency of Video Coding Standards – Including High Efficiency Video Coding (HEVC) // IEEE Trans. on Circuits and Systems for Video Technology. 2012.
3. Khalid Sayood. Introduction to Data Compression: 4th Edition. October 2012.
4. Cleary J. G., Witten I. H. Data compression using adaptive coding and partial string matching // IEEE transactions on communications. April 1984. Vol. COM-32, No. 4. P. 396.
5. Ian H. Witten, Radford M. Neal, John G. Cleary. Arithmetic coding for data compression // Commun. ACM. June 1987. Vol. 30, No. 6. P. 520–540.
6. Wallace G. K. The JPEG still picture compression standard // Comm. ACM. April 1991. Vol. 34. P. 30–44.
7. High-Performance Compression of Visual Information - A Tutorial Review - Part I: Still Pictures. / O. Egger, P. Fleury, T. Ebrahimi, M. Kunt // Proceedings of the IEEE. June 1999. Vol. 87, No 6.
8. Ahmed N. How I Came Up With the Discrete Cosine Transform. Digital Signal Processing. 1(1): 4–5.
9. U. S. patent 2605361, C. Chapin Cutler, Differential Quantization of Communication Signals, filed June 29, 1950, issued July 29, 1952.
10. Rabbani M., Joshi R. An overview of the JPEG2000 still image compression standard // Signal Processing: Image Communication 17. Jan. 2002. P. 3–48.
11. AhG4: Subjective evaluation of HEVC intra coding for still image compression / P. Hanhart, M. Rerabek, P. Korshunov, T. Ebrahimi // JCT-VC. 2013.
12. Bellard F. BPG Image format, 2014 [Електронний ресурс] URL: https://bellard.org/bpg/bpg_spec.txt
13. Hinton G. E., Salakhutdinov R. R. Reducing the Dimensionality of Data with Neural Networks // SCIENCE. 2006. Vol. 313. P. 504–507.
14. DeepZip: Lossless Data Compression using Recurrent Neural Networks arXiv:1811.08162v1 [cs. CL] / Mohit Goyal, Kedar Tatwawadi, Shubham Chandak, Idoia Ochoa. 20 Nov. 2018.
15. Schalkoff R. J. Artificial Neural Networks. McGraw-Hill, 1997.
16. Chua L., Lin T. A neural network approach to transform image coding // International Journal of Circuit Theory and Applications. 1988. Vol. 16, No. 3. P. 317–324.
17. Image data compression using a neural network model / N. Sonehara, M. Kawato, S. Miyake, K. Nakane // Proc. IJCNN. 1989. Vol. 2. P. 35–41.
18. Cotrell G. W., Munro P., Zipser D. Image compression by back propagation: an example of extensional programming // Models of cognition: rev. Of cognitive science. 1989. Vol. 1, No. 208. P. 1.
19. Full resolution image compression with recurrent neural networks / G. Toderici, D. Vincent, N. Johnston [et al.]. 2016. arXiv:1608.05148v1.
20. Lossy Image Compression with Compressive Autoencoders / L. Theis, W. Shi, A. Cunningham, F. Huszár. arXiv:1703.00395 [stat.ML]. 2017.
21. Minnen D., Ballé J., Toderic G. Joint Autoregressive and Hierarchical Priors for Learned Image Compression. arXiv:1809.02736v1 [cs.CV] 8 Sep. 2018.
22. Vigliano Daniele, Raffaele Parisi, Aurelio Unchini. Video compression by Neural Network // Studies in Fuzziness and Soft Computing. 2005.
23. Image and Video Compression with Neural Networks / Siwei Ma, Xinfeng Zhang, Chuanmin Jia [et al.] // A Review arXiv:1904.03567v2 [cs.CV] 10 Apr. 2019.
24. DeepCoder: A deep neural network based video compression / Chen, H. Liu, Q. Shen, T. Yue [et al.] // Visual Communications and Image Processing (VCIP), 2017. IEEE, P. 1–4.
25. Deep Learning-Based Video Coding / Dong Liu, Yue Li, Jianping Lin [et al.] // A Review and A Case Study. ArXiv:1904.12462v1 [cs.MM] 29 Apr. 2019.