Method and apparatus for compressing naked-eye three-dimensional video, device, and storage medium

Abstract

Embodiments of the present application disclose a naked-eye three-dimensional video compression method and device, equipment and a storage medium, wherein the method comprises the following steps: determining at least two views included in a first video frame image in the naked-eye three-dimensional video; performing first analysis on the at least two views to determine first weights of different views in the at least two views; determining a target view to be compressed from the at least two views according to the first weights of the different views in the at least two views; and compressing the naked-eye three-dimensional video based on the target view to be compressed.

Description

TECHNICAL FIELD

[0001] Embodiments of the present application relate to the technical field of data processing, and relate to, but are not limited to, a compression method and device for naked-eye three-dimensional video, equipment and a storage medium. BACKGROUND

[0002] At present, there is a naked-eye 3D (three-dimensional, 3-Dimension) display device composed of a display device and a grating device, which can allow a viewer to feel 3D effect without any auxiliary equipment. In order to solve the problem of simultaneous viewing of multiple people from multiple angles, a multi-viewpoint display mode is usually adopted. After the multi-viewpoint stereoscopic image is synthesized, the 3D effect can be viewed on the naked-eye 3D display device.

[0003] However, for a stereoscopic video of double viewpoints (left and right views) or a stereoscopic video of multiple people and multiple viewpoints, the information to be transmitted increases and the transmission bandwidth requirement increases with the increase of a viewpoint. SUMMARY

[0004] Therefore, embodiments of the present application provide a compression method and device for naked-eye three-dimensional video, equipment and a storage medium.

[0005] The technical solution of the embodiments of the present application is as follows:

[0006] In a first aspect, the embodiments of the present application provide a compression method for naked-eye three-dimensional video, which comprises:

[0007] determining at least two views included in a first video frame image in the naked-eye three-dimensional video;

[0008] performing a first analysis on the at least two views to determine first weights of different views in the at least two views;

[0009] determining a target view to be compressed from the at least two views according to the first weights of different views in the at least two views;

[0010] compressing the naked-eye three-dimensional video based on the target view to be compressed.

[0011] In some embodiments, the compression of the naked-eye three-dimensional video based on the target view to be compressed comprises: performing a second analysis on the target view to be compressed to determine second weights of different regions in the target view to be compressed; determining compression degrees of different regions in the target view based on the second weights of different regions in the target view to be compressed; and compressing the naked-eye three-dimensional video based on the compression degrees of different regions in the target view.

[0012] In some embodiments, the first analysis of the at least two views to determine the first weight of different views in the at least two views comprises: analyzing a user attribute corresponding to each view in the at least two views to determine the first weight of the each view; wherein the user attribute is used to represent user location information of the view and / or left and right eye information of the user of the view.

[0013] In some embodiments, the second analysis of the target view to be compressed to determine the second weight of different regions in the target view to be compressed comprises: analyzing display content corresponding to the target view to be compressed to determine the second weight of different regions in the target view to be compressed; and correspondingly, the compression of the naked-eye three-dimensional video based on the compression degree of different regions in the target view comprises: adjusting image resolution and / or image details of different regions in the target view based on the compression degree of different regions in the target view to achieve the compression of the naked-eye three-dimensional video.

[0014] In some embodiments, the analysis of the display content corresponding to the target view to be compressed to determine the second weight of different regions in the target view to be compressed comprises at least one of the following: segmenting objects displayed in the target view to be compressed, and determining the second weight of different regions according to the segmentation result; analyzing depth of objects displayed in the target view to be compressed, and determining the second weight of different regions according to the depth analysis result; analyzing spatial frequency of the target view to be compressed, and determining the second weight of different regions according to the analysis result; analyzing image distribution of the target view to be compressed, and determining the second weight of different regions according to the analysis result.

[0015] In some embodiments, the determination of the at least two views included in the first video frame image of the naked-eye three-dimensional video comprises: transmitting the obtained naked-eye three-dimensional video; detecting transmission bandwidth of the naked-eye three-dimensional video in real time during the transmission to obtain a detection result; determining bandwidth utilization of the naked-eye three-dimensional video based on the detection result; and if the bandwidth utilization is greater than a preset threshold, determining that the at least two views are included in the first video frame image of the naked-eye three-dimensional video.

[0016] In some embodiments, the compressing the naked-eye three-dimensional video based on the target view to be compressed comprises: transmitting the obtained naked-eye three-dimensional video; detecting a transmission bandwidth of the naked-eye three-dimensional video in real time during the transmission to obtain a detection result; determining a bandwidth utilization of the naked-eye three-dimensional video based on the detection result; and if the bandwidth utilization is greater than a preset threshold, compressing the naked-eye three-dimensional video based on the target view to be compressed.

[0017] In a second aspect, the embodiments of the present application provide a naked-eye three-dimensional video compression device, the device comprising:

[0018] a view determining unit configured to determine at least two views included in a first video frame image of the naked-eye three-dimensional video;

[0019] a first analyzing unit configured to perform first analysis on the at least two views to determine first weights of different views in the at least two views;

[0020] a view selecting unit configured to determine a target view to be compressed from the at least two views according to the first weights of the different views in the at least two views;

[0021] a video compressing unit configured to compress the naked-eye three-dimensional video based on the target view to be compressed.

[0022] In a third aspect, the embodiments of the present application provide an electronic device comprising a memory and a processor, wherein the memory stores a computer program capable of running on the processor, and the processor implements the steps in the compression method when executing the program.

[0023] In a fourth aspect, the embodiments of the present application provide a computer readable storage medium, which stores a computer program capable of being executed by a processor to implement the steps in the compression method. BRIEF DESCRIPTION OF DRAWINGS

[0024] Figure 1 An implementation flowchart of the naked-eye three-dimensional video compression method of the embodiments of the present application Figure One ;

[0025] Figure 2 An implementation flowchart of the naked-eye three-dimensional video compression method of the embodiments of the present application Figure Two ;

[0026] Figure 3 An implementation flowchart of the naked-eye three-dimensional video compression method of the embodiments of the present application Figure Three ;

[0027] Figure 4A flowchart of an implementation process of the naked-eye three-dimensional video compression method of the embodiment of the present application Figure Four ;

[0028] Figure 5 A structural diagram of the naked-eye three-dimensional video compression device of the embodiment of the present application

[0029] Figure 6 A hardware entity diagram of the electronic device of the embodiment of the present application DETAILED DESCRIPTION

[0030] The technical solutions of the present application are further described in detail below in combination with the drawings and embodiments. Obviously, the described embodiments are only some of the embodiments of the present application, not all the embodiments. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without creative labor fall within the scope of protection of the present application.

[0031] In the following description, "some embodiments" are described, which describe a subset of all possible embodiments, but it can be understood that "some embodiments" can be the same subset or different subsets of all possible embodiments, and can be combined with each other without conflict.

[0032] In the following description, the suffixes such as "module", "component", or "unit" used to represent elements are only for the convenience of the description of the present application, and have no specific meaning. Therefore, "module", "component", or "unit" can be used interchangeably.

[0033] It should be noted that the terms "first", "second", "third" involved in the embodiments of the present application are only to distinguish similar objects, and do not represent a specific order of the objects. It can be understood that "first", "second", "third" can be interchanged in a specific order or sequence as allowed, so that the embodiments of the present application described here can be implemented in an order other than that illustrated or described here.

[0034] Based on this, the embodiments of the present application provide a naked-eye three-dimensional video compression method, the function realized by the method can be realized by calling program code by the processor in the electronic device, and of course the program code can be saved in the storage medium of the electronic device. Figure 1 A flowchart of an implementation process of the naked-eye three-dimensional video compression method of the embodiment of the present application Figure One As shown in Figure 1 , the method comprises:

[0035] Step S101, determining that at least two views included in a first video frame image in the naked-eye three-dimensional video;

[0036] Here, the electronic device can be various types of devices with information processing capabilities, such as a navigator, a smart phone, a tablet computer, a wearable device, a laptop computer, a sweeping robot, a smart kitchen and bathroom, a smart home, a car, a server or a server cluster, etc. Of course, the electronic device can have a naked-eye 3D display function or can not have a naked-eye 3D display function, and the embodiments of the present application do not limit this.

[0037] The naked-eye three-dimensional video in the embodiments of the present application includes but is not limited to a stereoscopic video of two viewpoints (left and right views) and a stereoscopic video of multiple people and multiple viewpoints. Among them, the angles of view of the left and right views in the two viewpoints are different, and the angles of view of each viewpoint in the multiple viewpoints are also different. The naked-eye three-dimensional video includes a plurality of video frame images, and each video frame image includes at least two views. For example, each video frame image of the stereoscopic video of two viewpoints includes a left view and a right view; for another example, each video frame image of the stereoscopic video of multiple people and multiple viewpoints includes a plurality of left views and a plurality of right views. The first video frame image of the naked-eye three-dimensional video can be any frame video image in the naked-eye three-dimensional video, or can be a specified video frame image in the naked-eye three-dimensional video, which is set according to the actual use.

[0038] Step S102, performing first analysis on the at least two views to determine first weights of different views in the at least two views;

[0039] Here, the first analysis can be performed on each view in the at least two views to determine the first weights of different views in the at least two views. For example, if the first video frame image of the naked-eye three-dimensional video includes two views, it can be determined that the first weight of the right view is greater than the first weight of the left view; for another example, if the first video frame image of the naked-eye three-dimensional video includes more than two views, the position of the viewer relative to the display screen of each view can be analyzed first, and the first weight of the view corresponding to the viewer located in the central region of the display screen is greater than the first weight of the view corresponding to the viewer located in the edge region of the display screen.

[0040] It should be noted that the different views in the at least two views can be all the views in the at least two views, or can be part of the views in the at least two views, and the embodiments of the present application do not limit this.

[0041] Step S103, determining a target view to be compressed from the at least two views according to the first weights of different views in the at least two views;

[0042] In the embodiment of the present application, the different views included in the first video frame image have corresponding first weights, and then the first weights of the different views can be compared to obtain a weight comparison result; and then according to the comparison result, a target view to be compressed is determined from the at least two views. For example, if the first video frame image of the naked-eye three-dimensional video includes two views, and the first weight of view A is greater than the first weight of view B, then the target view to be compressed can be determined as view A. For another example, if the first video frame image of the naked-eye three-dimensional video includes more than two views, then the view with a first weight greater than a preset value can be taken as the target view to be compressed.

[0043] In step S104, the naked-eye three-dimensional video is compressed based on the target view to be compressed.

[0044] For example, the first video frame image can be each video frame image in the naked-eye three-dimensional video, and then the naked-eye three-dimensional video is compressed based on the target view to be compressed in each video frame image. For another example, the first video frame image can be a certain video frame image of a segment of video in the naked-eye three-dimensional video, and then the segment of video can be compressed based on the target view to be compressed in the video frame image.

[0045] Here, through the compression method of the naked-eye three-dimensional video in steps S101 to S104, the naked-eye three-dimensional video can be compressed based on the target view to be compressed, so as to reduce the video transmission bandwidth while not affecting the user's viewing experience.

[0046] Based on the foregoing embodiment, an embodiment of the present application further provides a compression method of a naked-eye three-dimensional video, which is applied to an electronic device, and the method comprises:

[0047] In step S111, at least two views included in a first video frame image of the naked-eye three-dimensional video are determined.

[0048] In step S112, a user attribute corresponding to each view of the at least two views is analyzed to determine a first weight of the each view.

[0049] The user attribute is used to represent user position information to which the view belongs and / or left and right eye information of a user to which the view belongs.

[0050] Here, the video frame image of the naked-eye three-dimensional video includes a corresponding user attribute for each view, and the user attribute corresponding to each view can be analyzed to obtain an analysis result, and then the first weight of each view is determined according to the analysis result. The user attribute of the view is used to represent the user position information of the view and / or the left and right eye information of the user to which the view belongs. For example, the user attribute of view A is analyzed to analyze whether view A belongs to a left view or a right view (i.e., the left and right eye information of the user to which the view belongs, the left view is a view watched by the left eye of the user, and the right view is a view watched by the right eye of the user). If view A belongs to a left view and view B belongs to a right view, the first weight of view B is greater than the first weight of view A. For another example, the user attribute of view A and view B is analyzed to analyze the user position information of view A and view B. If the user position corresponding to view A corresponds to the center area of the display screen, and the user position corresponding to view B corresponds to the edge area of the display screen, the first weight of view A is greater than the first weight of view B. For another example, the user attribute of view A and view B is analyzed. If view A belongs to a right view and the user position corresponding to view A corresponds to the center area of the display screen, view B belongs to a left view and the user position corresponding to view B corresponds to the edge area of the display screen, the first weight of view A is greater than the first weight of view B.

[0051] It should be noted that in actual use, the first weight of the view can be determined only according to the user position information of the view, or only according to the left and right eye information of the user to which the view belongs, or the first weight of the view can be determined according to the left and right eye information of the user to which the view belongs and the user position information of the view. The embodiments of the present application do not limit this.

[0052] Step S113, determining a target view to be compressed from the at least two views according to the first weights of different views in the at least two views;

[0053] Here, the view with a first weight greater than a preset threshold in the at least two views can be determined as the target view to be compressed.

[0054] Step S114, compressing the naked-eye three-dimensional video based on the target view to be compressed.

[0055] In the embodiments of the present application, each video frame image of the naked-eye three-dimensional video can be analyzed to determine the corresponding target view to be compressed in each video frame image, and the naked-eye three-dimensional video is compressed. The naked-eye three-dimensional video (or a section of the naked-eye three-dimensional video) can be analyzed first to determine a specific video frame image, and then the target view to be compressed is determined from the specific video frame image, and the naked-eye three-dimensional video is compressed. Of course, the naked-eye three-dimensional video (or a section of the naked-eye three-dimensional video) can be analyzed first to determine a plurality of specific video frame images, and then the corresponding target view to be compressed is determined from the plurality of specific video frame images, and the naked-eye three-dimensional video is compressed. That is, the number and nature of the first video frame image are not limited in the embodiments of the present application, and can be selected according to the specific situation in actual use.

[0056] Based on the foregoing embodiments, the embodiments of the present application further provide a compression method of a naked-eye three-dimensional video, which is applied to an electronic device, Figure 2 The implementation process of the compression method of the naked-eye three-dimensional video in the embodiments of the present application is shown in Figure Two As shown in Figure 2 The method comprises the following steps:

[0057] In step S201, at least two views included in a first video frame image of the naked-eye three-dimensional video are determined.

[0058] In step S202, first analysis is performed on the at least two views to determine first weights of different views in the at least two views.

[0059] In step S203, a target view to be compressed is determined from the at least two views according to the first weights of the different views in the at least two views.

[0060] In step S204, second analysis is performed on the target view to be compressed to determine second weights of different regions in the target view to be compressed.

[0061] Here, the second analysis can be performed on the target view to be compressed to determine the second weights of the different regions in the target view to be compressed. For example, in the naked-eye 3D case, the resolution and details of one of the left and right views can be appropriately reduced without affecting the naked-eye 3D effect. When the stereoscopic video is compressed and transmitted, the resolution compression and detail retention of different regions can be performed on the target view to be compressed, and the transmission bandwidth requirement is reduced. Therefore, the second analysis can be performed on the target view to be compressed, and different degrees of resolution compression and different degrees of detail reduction can be performed on different regions based on the analyzed second weights of the different regions.

[0062] Step S205, determining the compression degree of different regions in the target view based on the second weight of different regions in the target view to be compressed.

[0063] In the embodiments of the present application, the target view to be compressed can be divided into different regions, and the compression degree of each region can be determined based on the second weight.

[0064] Step S206, compressing the naked-eye three-dimensional video based on the compression degree of different regions in the target view.

[0065] For example, the target view includes at least region 1 and region 2, the compression degree of region 1 is greater than that of region 2, and then region 1 in the target view can be compressed to a greater extent of resolution and a greater extent of detail reduction.

[0066] Here, through the compression method of the naked-eye three-dimensional video in steps S201 to S206, the naked-eye three-dimensional video can be compressed based on the target view to be compressed, and different regions in the view correspond to different compression degrees, so that the video transmission bandwidth is reduced while the user's viewing experience is not affected.

[0067] In some embodiments, the first analysis of the at least two views to determine the first weight of different views in the at least two views comprises:

[0068] The first analysis of the at least two views to determine the first weight of different views in the at least two views is performed through a first preset algorithm.

[0069] In some embodiments, the second analysis of the target view to be compressed to determine the second weight of different regions in the target view to be compressed comprises:

[0070] The second analysis of the target view to be compressed to determine the second weight of different regions in the target view to be compressed is performed through a second preset algorithm.

[0071] Correspondingly, in some embodiments, the method further comprises:

[0072] Step S21, transmitting the compressed naked-eye three-dimensional video to display the naked-eye three-dimensional video.

[0073] Step S22, obtaining feedback information of a viewer during display.

[0074] Step S23, if the feedback information meets a preset condition, updating the first preset algorithm and / or the second preset algorithm.

[0075] Here, in the process of transmitting the naked-eye three-dimensional video, the viewer can be detected in real time to obtain feedback information of the viewer. If it is judged through the feedback information that the viewer is not satisfied with the effect of the currently displayed naked-eye three-dimensional video, the algorithm for determining the first weight and / or the second weight can be updated. Of course, in this process, machine learning and other algorithms can also be used to adjust the compression effect.

[0076] Based on the foregoing embodiments, the embodiments of the present application further provide a naked-eye three-dimensional video compression method, which is applied to an electronic device, and the method comprises:

[0077] Step S211, determining that at least two views included in a first video frame image in the naked-eye three-dimensional video;

[0078] Step S212, performing first analysis on the at least two views to determine first weights of different views in the at least two views;

[0079] Step S213, determining a target view to be compressed from the at least two views according to the first weights of the different views in the at least two views;

[0080] Step S214, analyzing display content corresponding to the target view to be compressed to determine second weights of different regions in the target view to be compressed;

[0081] In the embodiments of the present application, the display content of the target view to be compressed can be analyzed to determine the second weights of the different regions. The analysis of the display content includes but is not limited to object segmentation analysis, depth analysis, spatial frequency analysis, and image distribution analysis.

[0082] Step S215, determining compression degrees of the different regions in the target view based on the second weights of the different regions in the target view to be compressed;

[0083] Step S216, adjusting image resolution and / or image details of the different regions in the target view based on the compression degrees of the different regions in the target view to realize compression of the naked-eye three-dimensional video.

[0084] In the embodiments of the present application, the manner of video compression includes but is not limited to compression of resolution and reduction of display details.

[0085] In some embodiments, the step S214 of analyzing the display content corresponding to the target view to be compressed to determine the second weights of the different regions in the target view to be compressed comprises at least one of the following:

[0086] The first way is to segment the object displayed in the target view to be compressed, and determine the second weight of different regions according to the segmentation result.

[0087] Here, the display content of the target view to be compressed can be segmented to segment the foreground (object) and the background, so as to determine the second weight of different regions. The weight corresponding to the foreground region is greater than the weight corresponding to the background region. Further, the compression degree of the foreground region is set to be lower than the compression degree of the background region. For example, the background is compressed to a greater degree of resolution; for example, the background is reduced to a greater degree of detail.

[0088] The second way is to analyze the depth of the object displayed in the target view to be compressed, and determine the second weight of different regions according to the depth analysis result.

[0089] Here, the depth of the target view to be compressed can be analyzed to obtain the close-up and the long shot in the view (which can be calculated in pixel points), so as to determine the second weight of different regions. The weight of the region where the close-up is located is greater than the weight of the region where the long shot is located. Further, the compression degree of the region where the close-up is located is set to be lower than the compression degree of the region where the long shot is located. For example, the long shot is compressed to a greater degree of resolution.

[0090] The third way is to analyze the spatial frequency of the target view to be compressed, and determine the second weight of different regions according to the analysis result.

[0091] Here, the spatial frequency of the target view to be compressed can be analyzed to obtain the spatial frequency of different regions in the view, so as to determine the second weight of different regions. The weight of the high-frequency region is greater than the weight of the low-frequency region. Further, the compression degree of the low-frequency region is set to be higher than the compression degree of the high-frequency region. For example, the low-frequency region is reduced to a greater degree of detail.

[0092] The fourth way is to analyze the image distribution of the target view to be compressed, and determine the second weight of different regions according to the analysis result.

[0093] Here, the image distribution of the target view to be compressed can be analyzed to obtain the image distribution of different regions in the view, so as to determine the second weight of different regions. The weight of the central region is greater than the weight of the edge region. Further, the compression degree of the edge region is set to be higher than the compression degree of the central region. For example, the edge region is compressed to a greater degree of resolution and less detail is maintained.

[0094] It should be noted that one or more of the above ways can be used to determine the second weight of different regions in the target view to be compressed in the embodiments of the present application, and the embodiments of the present application do not limit this.

[0095] Based on the foregoing embodiments, the embodiments of the present application further provide a compression method of a naked-eye three-dimensional video, which is applied to an electronic device, and the method comprises:

[0096] Step S221, determining that at least two views are included in a first video frame image in the naked-eye three-dimensional video;

[0097] Step S222, analyzing a user attribute corresponding to each view in the at least two views to determine a first weight of the each view;

[0098] The user attribute is used to represent user position information to which the view belongs and / or left and right eye information of a user to which the view belongs.

[0099] Step S223, determining a target view to be compressed from the at least two views according to the first weight of different views in the at least two views;

[0100] Step S224, analyzing display content corresponding to the target view to be compressed to determine a second weight of different regions in the target view to be compressed;

[0101] Step S225, determining a compression degree of different regions in the target view based on the second weight of different regions in the target view to be compressed;

[0102] Step S226, adjusting image resolution and / or image details of different regions in the target view according to the compression degree of different regions in the target view to realize compression of the naked-eye three-dimensional video.

[0103] Based on the foregoing embodiments, the embodiments of the present application further provide a compression method of a naked-eye three-dimensional video, which is applied to an electronic device, Figure 3 The implementation process of the compression method of the naked-eye three-dimensional video of the embodiments of the present application is shown in Figure Three As shown in Figure 3 The method comprises:

[0104] Step S301, transmitting the naked-eye three-dimensional video obtained;

[0105] Here, the naked-eye three-dimensional video can be transmitted to display the naked-eye three-dimensional video.

[0106] Step S302, detecting a transmission bandwidth of the naked-eye three-dimensional video in real time during transmission to obtain a detection result;

[0107] Step S303, determining a bandwidth utilization rate of the naked-eye three-dimensional video based on the detection result;

[0108] Step S304, if the bandwidth utilization is greater than a preset threshold, determining that the first video frame image in the naked-eye three-dimensional video includes at least two views;

[0109] In the embodiment, the transmission bandwidth can be detected in real time during the transmission of the naked-eye three-dimensional video. If the detected transmission bandwidth at a moment is greater than a preset threshold (which is set according to the actual situation), the first video frame image in the naked-eye three-dimensional video is analyzed, so that the naked-eye three-dimensional video is compressed to reduce the transmission bandwidth.

[0110] Step S305, performing first analysis on the at least two views to determine first weights of different views in the at least two views;

[0111] Step S306, determining a target view to be compressed from the at least two views according to the first weights of the different views in the at least two views;

[0112] Step S307, compressing the naked-eye three-dimensional video based on the target view to be compressed.

[0113] Here, through the compression method of the naked-eye three-dimensional video in steps S301 to S307, the video transmission bandwidth can be detected in real time, and the naked-eye three-dimensional video is compressed based on the target view to be compressed when the transmission bandwidth does not meet the demand, so that the video transmission bandwidth is reduced without affecting the user's viewing experience.

[0114] Based on the foregoing embodiment, the embodiment further provides a compression method of a naked-eye three-dimensional video, which is applied to an electronic device and includes:

[0115] Step S311, determining that the first video frame image in the naked-eye three-dimensional video includes at least two views;

[0116] Step S312, performing first analysis on the at least two views to determine first weights of different views in the at least two views;

[0117] Step S313, determining a target view to be compressed from the at least two views according to the first weights of the different views in the at least two views;

[0118] Step S314, transmitting the obtained naked-eye three-dimensional video;

[0119] Step S315, detecting the transmission bandwidth of the naked-eye three-dimensional video in real time during the transmission to obtain a detection result;

[0120] Step S316: Based on the detection results, determine the bandwidth utilization rate of the naked-eye 3D video;

[0121] Step S317: If the bandwidth utilization rate is greater than a preset threshold, compress the naked-eye 3D video based on the target view to be compressed.

[0122] In this embodiment, the target view to be compressed corresponding to the naked-eye 3D video can be determined first. Then, during the transmission of the naked-eye 3D video, if it is detected that the transmission bandwidth does not meet the requirements, the naked-eye 3D video is directly compressed based on the previously determined target view. That is to say, the compression method in steps S101 to S104 above can be executed before or during the transmission of the naked-eye 3D video. This embodiment does not limit this. Those skilled in the art can determine the specific execution scheme based on parameters such as the current computing power of the electronic device and the total network bandwidth in actual use.

[0123] Based on the foregoing embodiments, this application further provides a method for compressing naked-eye 3D video. Existing video compression methods reduce overall resolution and frame rate, which is noticeable to users and impacts user experience. The solution in this application addresses these issues. This application employs compression encoding on one viewpoint (determining resolution / detail degradation weights based on transmitted content and receiver user analysis), thereby reducing bandwidth requirements. The resulting technical effect is that, unlike previous compression methods, this method does not affect user experience because users are not sensitive to resolution / detail degradation within a certain range in a single-eye view.

[0124] The method for compressing naked-eye 3D video in the embodiments of this application will be described in detail below:

[0125] By appropriately reducing the resolution and detail of one viewpoint in the left or right view during glasses-free 3D imaging without affecting the 3D effect, and by compressing and transmitting stereoscopic video containing both left and right viewpoints, one viewpoint is compressed at a higher resolution with less detail preserved, thereby reducing transmission bandwidth requirements. Factors influencing the compression weight include the transmitted content and user analysis.

[0126] Figure 4 This is a schematic diagram illustrating the implementation process of the naked-eye 3D video compression method in this application embodiment. Figure Four ,like Figure 4 As shown, the method includes:

[0127] Step S401: Detect the bandwidth utilization of the naked-eye 3D video;

[0128] Step S402, judging whether the bandwidth utilization rate is greater than a preset value;

[0129] Here, if the bandwidth utilization rate is greater than the preset value, step S403 and step S404 are executed.

[0130] Step S403, receiving-end user analysis is performed on the naked-eye three-dimensional video to obtain a first analysis result;

[0131] Here, the initial algorithm of the receiving-end user analysis includes two kinds, one is left eye: the right eye weight is greater than the left eye weight; the other is multi-person: the center weight is greater than the edge weight.

[0132] Step S404, transmission content analysis is performed on the naked-eye three-dimensional video to obtain a second analysis result;

[0133] Here, the initial algorithm of the transmission content analysis includes but is not limited to:

[0134] Object segmentation: object weight is greater than background weight; depth analysis: near view weight is greater than far view weight; spatial frequency: high frequency weight is greater than low frequency weight; image distribution: central weight is greater than peripheral weight.

[0135] Step S405, based on the first analysis result and the second analysis result, a compression scheme is determined;

[0136] Here, the compression scheme includes: reducing the resolution and detail retention of a given view, and the resolution and detail degradation of the audio and video position with low weight are greater.

[0137] Step S406, based on the compression scheme, the naked-eye three-dimensional video is compressed and transmitted to the display end;

[0138] Step S407, user eye movement monitoring is performed, and weight updating is performed based on the monitoring result.

[0139] Here, if the user's pupil diameter is reduced in the monitoring result, it means dissatisfaction, and if the user is dissatisfied, weight updating is needed.

[0140] Based on the foregoing embodiments, the embodiments of the present application provide a compression device for naked-eye three-dimensional video, which comprises units, modules and components, and can be realized by a processor in an electronic device. Of course, the device can also be realized by a specific logic circuit. In the implementation process, the processor can be a CPU (Central Processing Unit), MPU (Microprocessor Unit), DSP (Digital Signal Processing) or FPGA (Field Programmable Gate Array).

[0141] Figure 5 The constituent structure of the naked-eye three-dimensional video compression device of the embodiments of the present application is shown in FIG. 5, which comprises: Figure 5

[0142] A view determination unit 501 is configured to determine at least two views included in a first video frame image of the naked-eye three-dimensional video.

[0143] A first analysis unit 502 is configured to perform first analysis on the at least two views to determine first weights of different views in the at least two views.

[0144] A view selection unit 503 is configured to determine a target view to be compressed from the at least two views according to the first weights of different views in the at least two views.

[0145] A video compression unit 504 is configured to compress the naked-eye three-dimensional video based on the target view to be compressed.

[0146] In some embodiments, the video compression unit 504 comprises:

[0147] A second analysis module is configured to perform second analysis on the target view to be compressed to determine second weights of different regions in the target view to be compressed.

[0148] A compression degree determination module is configured to determine compression degrees of different regions in the target view based on the second weights of different regions in the target view to be compressed.

[0149] A video compression module is configured to compress the naked-eye three-dimensional video based on the compression degrees of different regions in the target view.

[0150] In some embodiments, the first analysis unit 502 comprises:

[0151] ​a first analysis subunit configured to analyze a user attribute corresponding to each view in the at least two views to determine a first weight of each view;

[0152] The user attribute is used to represent user position information of the view and / or left and right eye information of a user to which the view belongs.

[0153] In some embodiments, the second analysis module comprises:

[0154] a second analysis subunit configured to analyze display content corresponding to the target view to be compressed to determine a second weight of different regions in the target view to be compressed.

[0155] Correspondingly, the video compression module comprises:

[0156] a video compression subunit configured to adjust image resolution and / or image details of different regions in the target view based on a compression degree of the different regions in the target view to achieve compression of the naked-eye three-dimensional video.

[0157] In some embodiments, the second analysis subunit comprises at least one of the following:

[0158] a second analysis component configured to segment an object displayed in the target view to be compressed and determine a second weight of different regions according to a result of the segmentation;

[0159] The second analysis component is further configured to analyze a depth of the object displayed in the target view to be compressed and determine a second weight of different regions according to a result of the depth analysis;

[0160] The second analysis component is further configured to analyze a spatial frequency of the target view to be compressed and determine a second weight of different regions according to a result of the analysis;

[0161] The second analysis component is further configured to analyze an image distribution of the target view to be compressed and determine a second weight of different regions according to a result of the analysis.

[0162] In some embodiments, the view determination unit 501 comprises:

[0163] a view determination subunit configured to transmit the acquired naked-eye three-dimensional video;

[0164] The view determination subunit is further configured to detect a transmission bandwidth of the naked-eye three-dimensional video in real time during transmission to obtain a detection result.

[0165] The view determining sub-unit is further configured to determine a bandwidth utilization of the naked-eye three-dimensional video based on the detection result.

[0166] The view determining sub-unit is further configured to determine that at least two views are included in a first video frame image in the naked-eye three-dimensional video if the bandwidth utilization is greater than a preset threshold.

[0167] In some embodiments, the video compression unit 504 comprises:

[0168] A video compression sub-unit is configured to compress the acquired naked-eye three-dimensional video.

[0169] The video compression sub-unit is further configured to detect a transmission bandwidth of the naked-eye three-dimensional video in real time during the transmission to obtain a detection result.

[0170] The video compression sub-unit is further configured to determine a bandwidth utilization of the naked-eye three-dimensional video based on the detection result.

[0171] The video compression sub-unit is further configured to compress the naked-eye three-dimensional video based on the target view to be compressed if the bandwidth utilization is greater than a preset threshold.

[0172] The above description of the device embodiments is similar to the description of the above method embodiments, and has similar beneficial effects as the method embodiments. For technical details not disclosed in the device embodiments of the present application, please refer to the description of the method embodiments of the present application for understanding.

[0173] It should be noted that, in the embodiments of the present application, if the naked-eye three-dimensional video compression method described above is realized in the form of a software function module and sold or used as an independent product, it can also be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application can be embodied in the form of a software product, which is stored in a storage medium and includes a plurality of instructions for causing an electronic device (which can be a personal computer, a server, etc.) to execute all or part of the methods described in the embodiments of the present application. The aforementioned storage medium includes: a U disk, a mobile hard disk, a ROM (Read Only Memory), a magnetic disk or an optical disk, and various media that can store program codes. Thus, the embodiments of the present application are not limited to any specific combination of hardware and software.

[0174] Correspondingly, the embodiments of the present application provide an electronic device comprising a memory and a processor, wherein the memory stores a computer program capable of running on the processor, and the processor executes the program to realize the steps in the naked-eye three-dimensional video compression method provided in the above embodiments.

[0175] Correspondingly, the embodiment of the present application provides a readable storage medium, which stores a computer program, and the computer program is executed by a processor to realize the steps in the compression method of the naked-eye three-dimensional video.

[0176] It should be noted that the description of the above storage medium and device embodiments is similar to the description of the above method embodiments, and has similar beneficial effects to the method embodiments. For technical details not disclosed in the storage medium and device embodiments of the present application, please refer to the description of the method embodiments of the present application for understanding.

[0177] It should be noted that, Figure 6 A hardware entity diagram of the electronic device of the embodiment of the present application is shown in FIG. 6, which includes a processor 601, a communication interface 602 and a memory 603. Figure 6 The hardware entity of the electronic device 600 includes a processor 601, a communication interface 602 and a memory 603.

[0178] The processor 601 generally controls the overall operation of the electronic device 600.

[0179] The communication interface 602 can enable the electronic device 600 to communicate with other electronic devices or servers or platforms through a network.

[0180] The memory 603 is configured to store instructions and applications executable by the processor 601, and can also cache data to be processed by the processor 601 and modules in the electronic device 600 (for example, image data, audio data, voice communication data and video communication data) that have been processed or have been processed, which can be realized by FLASH (flash memory) or RAM (Random Access Memory, random access memory).

[0181] In several embodiments provided by the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There can be another division way in actual implementation. For example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the various components shown or discussed can be through some interfaces, indirect coupling or communication connection between devices or units, which can be electrical, mechanical or in other forms.

[0182] The units described as separate parts above can or can not be physically separate, the parts shown as units can or can not be physical units, that is, can be located in one place or distributed on multiple network units; part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment scheme.

[0183] In addition, each functional unit in each embodiment of the present application can be integrated into one processing module, or each unit can be separately as a unit, or two or more units can be integrated into one unit; the integrated unit can be realized in the form of hardware or in the form of hardware plus software functional unit. Those skilled in the art can understand that all or part of the steps of the above method embodiments can be completed by program instruction related hardware, and the above program can be stored in a computer readable storage medium, and the program executes the steps including the above method embodiments when executed; and the above storage medium includes mobile storage equipment, ROM, RAM, magnetic disc or optical disc and various storage program codes.

[0184] The methods disclosed in the several method embodiments provided by the present application can be combined arbitrarily without conflict to obtain new method embodiments.

[0185] The features disclosed in the several product embodiments provided by the present application can be combined arbitrarily without conflict to obtain new product embodiments.

[0186] The features disclosed in the several method or device embodiments provided by the present application can be combined arbitrarily without conflict to obtain new method or device embodiments.

[0187] The above is only a specific embodiment of the present application, but the protection scope of the present application is not limited to this, any person skilled in the art can easily think of changes or replacements within the technical range disclosed by the present application, which should be covered in the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A method for compressing a naked-eye three-dimensional video, the method comprising: determining at least two views included in a first video frame image of the naked-eye three-dimensional video; performing a first analysis on the at least two views to determine first weights of different views in the at least two views; the first weights being determined based on an analysis on user position information to which each view in the at least two views belongs and left and right eye information of a user to which the view belongs, the user position information being used to represent a position of the user to which the view belongs relative to a display screen; determining a target view to be compressed from the at least two views according to the first weights of different views in the at least two views; if the first video frame image includes two views, determining the target view to be compressed as the view with a larger first weight, or if the first video frame image includes more than two views, determining the target view to be compressed as the view with a first weight greater than a preset value; and compressing the naked-eye three-dimensional video based on the target view to be compressed. 2.The method of claim 1, wherein the compressing the naked-eye three-dimensional video based on the target view to be compressed comprises: performing a second analysis on the target view to be compressed to determine second weights of different regions in the target view to be compressed; determining compression degrees of different regions in the target view based on the second weights of different regions in the target view to be compressed; and compressing the naked-eye three-dimensional video based on the compression degrees of different regions in the target view. 3.The method of claim 2, wherein the performing the second analysis on the target view to be compressed to determine the second weights of different regions in the target view to be compressed comprises: analyzing display content corresponding to the target view to be compressed to determine the second weights of different regions in the target view to be compressed; and correspondingly, the compressing the naked-eye three-dimensional video based on the compression degrees of different regions in the target view comprises: adjusting image resolution and / or image details of different regions in the target view based on the compression degrees of different regions in the target view to compress the naked-eye three-dimensional video. 4.The method of claim 3, wherein the analyzing the display content corresponding to the target view to be compressed to determine the second weights of different regions in the target view to be compressed comprises at least one of: segmenting objects displayed in the target view to be compressed and determining the second weights of different regions based on a result of the segmentation; analyzing depth of objects displayed in the target view to be compressed and determining the second weights of different regions based on a result of the depth analysis; analyzing spatial frequency of the target view to be compressed and determining the second weights of different regions based on a result of the analysis; and analyzing image distribution of the target view to be compressed and determining the second weights of different regions based on a result of the analysis. ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ 5. The method of any one of claims 1 to 4, wherein the determining the at least two views included in a first video frame image of the naked-eye three-dimensional video comprises: transmitting the obtained naked-eye three-dimensional video; detecting a transmission bandwidth of the transmitted naked-eye three-dimensional video in real time during the transmission to obtain a detection result; determining a bandwidth utilization of the naked-eye three-dimensional video based on the detection result; and determining that the first video frame image of the naked-eye three-dimensional video includes the at least two views if the bandwidth utilization is greater than a preset threshold.

6. The method of any one of claims 1 to 4, wherein the compressing the naked-eye three-dimensional video based on the target view to be compressed comprises: transmitting the obtained naked-eye three-dimensional video; detecting a transmission bandwidth of the transmitted naked-eye three-dimensional video in real time during the transmission to obtain a detection result; determining a bandwidth utilization of the naked-eye three-dimensional video based on the detection result; and compressing the naked-eye three-dimensional video based on the target view to be compressed if the bandwidth utilization is greater than a preset threshold.

7. An apparatus for compressing a naked-eye three-dimensional video, the apparatus comprising: a view determining unit configured to determine at least two views included in a first video frame image of the naked-eye three-dimensional video; a first analyzing unit configured to perform a first analysis on the at least two views to determine a first weight of different views in the at least two views, wherein the first weight is determined based on an analysis of user position information of each view in the at least two views and left-eye and right-eye information of a user to which the view belongs, and the user position information is used to represent a position of the user to which the view belongs relative to a display screen; a view selecting unit configured to determine a target view to be compressed from the at least two views according to the first weight of different views in the at least two views; wherein if the first video frame image includes two views, the target view to be compressed is determined as the view with a greater first weight, or if the first video frame image includes more than two views, the target view to be compressed is determined as the view with a first weight greater than a preset value; and a video compressing unit configured to compress the naked-eye three-dimensional video based on the target view to be compressed.

8. An electronic device comprising a memory and a processor, wherein the memory stores a computer program capable of being run on the processor, and the processor implements steps in the compression method of any one of claims 1 to 6 when executing the program.

9. A computer readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements steps in the compression method of any one of claims 1 to 6. ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​

Images