Method and system for 2D-to-3D adaptive cloud unloading on handset

Abstract

The present invention discloses a method and a system for 2D-to-3D adaptive cloud unloading on a handset. The method comprises a first step of inputting a frame of 2D monocular image, and dividing the image into N equal image blocks; a second step of classifying the image blocks according to perspective view, linear view and common view; a third step of according to the category of the classified views, calculating algorithm complexity of depth estimation of each image block; a fourth step of substituting the algorithm complexity of each image block into a cloud unloading dynamic resource allocation model, and optimizing to obtain an allocation result; and a fifth step of according to the allocation result obtained in the fourth step, performing depth estimation at the handset end and the cloud end, so as to generate a depth graph. The cloud unloading dynamic resource allocation model is established, so that the cloud computing-based method and system for 2D-to-3D adaptive unloading on the handset are formed. Complex computing at the handset end is unloaded to the cloud end, so that the stored resource of the handset end is released, the handset processing speed is improved, and the handset power consumption is lowered, further, a high-quality depth graph which is reasonable in depth estimation and has high running speed is obtained.

Description

technical field [0001] The invention relates to the fields of computer vision and digital image processing, and in particular to a method and system for adaptive cloud offloading of mobile phone terminal 2D to 3D. Background technique [0002] In recent years, with the continuous improvement of mobile device technology and the gradual popularization of mobile phones, people have entered the era of smart phones, and users are becoming more and more accustomed to using mobile devices instead of traditional devices to watch pictures and videos. The development of hardware processing equipment such as multi-core processor memory GPU in smart phones has made the functions of mobile phones more and more powerful, and the related applications of mobile phones have also been continuously upgraded. Mobile phone 3D-TV is one of its main directions. However, the shooting of 3D video is complicated, and the post-production cycle is long and other factors lead to a lack of resources, whi...

AI Technical Summary

Problems solved by technology

[0004] The existing depth estimation algorithms for 2D images are limited in adapting to the scene, the stereo effect is not good, and the complexity is high

The development of 2D to 3D technology based on mobile phones is even more immature, and the main limiting factors are: 2D to 3D conversion requires considerable storage resources, which is undoubtedly a huge challenge for mobile phones with very limited storage capacity; followed by The processing speed of mobile phones is very limited, and it is difficult to meet the real-time requirements of 2D to 3D; moreover, both video conversion and video playback will consume a lot of power. Even if many mobile phones support flash charging technology, it will still cause inconvenience to users.

Images