Compression method and compression device for VR image

Abstract

The invention provides a compression method and a compression device for a VR image, and solves or improves the problems that in the prior art, a high-resolution game picture is compressed to a resolution range which can be processed by VR head-mounted equipment in an equal proportion, although the bandwidth requirement is reduced, the definition of a picture center area seen by human eyes is reduced, and the image quality is poor. And the user experience is influenced. According to the compression method of the VR image provided by the invention, when the video image is compressed, differential compression ratios are adopted for the peripheral region and the central region in the video image to realize compression of the video image, and a relatively low compression ratio is adopted for the central region of the video image, so that high definition of the video is kept, and the compression efficiency is improved. The centrality is improved; a high compression ratio is adopted for the peripheral area of the target video image to reduce bandwidth occupation, so that the definition of the central area most concerned by a user can be ensured, the transmission quantity of overall data can be reduced by compressing the edge area of the video image, and more efficient wireless transmission and better visual experience are realized.

Description

Technical Field

[0001] The present application relates to the field of image compression technology, and in particular to a VR image compression method and a compression device. Background Art

[0002] Virtual Reality (VR) technology is a computer-generated, interactive, immersive visual virtual environment proposed in the 1980s. It can generate a variety of virtual environments as needed. With the rapid development of virtual reality technology, the popularity of VR head-mounted devices has brought a new era of immersive experience. VR head-mounted devices include a VR helmet and a pair of lens assemblies mounted on the helmet. The lens assembly includes a lens and a display screen corresponding to the lens. The human eye can see interactive visual images through the lens and the display screen.

[0003] However, the image transmission quality of VR headsets currently on the market still faces great challenges in wireless streaming (video transmission over the network, where sound and image data are transmitted to users in the form of data streams). Due to the limitations of computing resources, GPU performance and display resolution, VR headsets need to compress high-resolution images during wireless transmission to balance display effects and latency experience.

[0004] Traditional compression methods usually use geometric compression, that is, compressing all areas of the entire image at the same ratio, compressing high-resolution game images to a resolution range that VR headsets can handle. Although this geometric compression has a significant effect in reducing bandwidth requirements and controlling latency, it ignores the visual characteristics of the human eye when viewing VR content, resulting in a decrease in the clarity of the central area of ​​the image seen by the human eye, which in turn affects the user experience. Summary of the invention

[0005] In view of this, the present application provides a VR image compression method and a compression device, which solve or improve the technical problem that the existing technology compresses high-resolution game images at a medium ratio to a resolution range that can be processed by a VR head-mounted device, and due to the limitation of the transmission bandwidth, the clarity of the central area of ​​the image before and after transmission will decrease, thereby affecting the user experience.

[0006] As a first aspect of the present application, the present application provides a VR image compression method, comprising:

[0007] Acquire target video image;

[0008] Performing region segmentation on the target video image to segment the target video image into a plurality of compression regions, wherein the plurality of compression regions include a first compression region and a second compression region surrounding the first compression region;

[0009] Compressing the plurality of compression regions respectively to form a compressed video image corresponding to the target video image, wherein a first compression ratio of the first compression region is less than a second compression ratio of the second compression region;

[0010] The compressed video image is subjected to video encoding processing to form a transmission video image, and the transmission video image is transmitted to a client, wherein the client performs video decoding processing and decompression processing on the transmission video image and generates a display video image.

[0011] In an embodiment of the present application, the first compression area is a central area of ​​the target video image, and the second compression area is an edge area of ​​the target video image.

[0012] In one embodiment of the present application, the plurality of compression regions further include: a transition region between the first compression region and the second compression region;

[0013] The third compression ratio of the transition region is greater than the first compression ratio of the first compression region, and less than the second compression ratio of the second compression region.

[0014] In an embodiment of the present application, in a first direction, the transition area includes a plurality of sub-transition areas, and the first direction is a direction extending outward from the center of the target video image;

[0015] Wherein, in the first direction, the compression ratios of the plurality of sub-transition regions gradually increase.

[0016] In an embodiment of the present application, the difference between the compression ratios of any two adjacent sub-transition regions is equal.

[0017] In one embodiment of the present application, the difference between the compression ratio of the sub-transition zone close to the first compression zone and the compression ratio of the first compression zone is equal to the difference between the compression ratio of the second compression zone and the compression ratio of the sub-transition zone close to the second compression zone.

[0018] In an embodiment of the present application, in the first direction, the difference in compression ratio between two adjacent sub-transition regions gradually increases.

[0019] In one embodiment of the present application, the target video image is segmented into regions to divide the target video image into a plurality of compressed regions, including:

[0020] Obtaining a distortion curve of a target VR lens in a target VR head mounted device;

[0021] Determining a first width of the first compression region, a second width of the second compression region, and a third width of the transition region according to a distortion curve of the target VR lens;

[0022] The target video image is divided into regions based on the first width, the second width, and the third width, so as to divide the target video image into the first compression region, the transition region, and the second compression region.

[0023] In one embodiment of the present application, the VR image compression method further includes:

[0024] Determining a compression ratio curve of the transition region according to a distortion curve of the target VR lens;

[0025] The compression ratios of the plurality of sub-transition regions are determined according to the compression ratio curve.

[0026] As a second aspect of the present application, the present application also provides a VR image compression device, including:

[0027] A data acquisition module, used for acquiring a target video image;

[0028] An image segmentation module, used for performing region segmentation on the target video image to segment the target video image into a plurality of compression regions, wherein the plurality of compression regions include a first compression region and a second compression region surrounding the first compression region;

[0029] A compression module, compressing the plurality of compression areas respectively to form a compressed video image corresponding to the target video image, wherein a first compression ratio of the first compression area is less than a second compression ratio of the second compression area;

[0030] The sending module is used to perform video encoding processing on the compressed video image to form a transmission video image, and transmit the transmission video image to the client, wherein the client performs video decoding processing and decompression processing on the transmission video image and generates a display video image.

[0031] The present application provides a VR image compression method, which first divides a target video image into multiple compression areas, wherein the multiple compression areas at least include a first compression area and a second compression area surrounding the first compression area. After the target video image is divided into multiple compression areas, the multiple compressed video areas can be compressed separately, and a first compression ratio of the first compression area is less than a second compression ratio of the second compression area. In this way, when compressing the video image, differentiated compression ratios are used for the peripheral area and the central area of ​​the video image to achieve compression of the video image. A lower compression ratio is used for the central area of ​​the video image to maintain high definition of the video and improve the centrality; a higher compression ratio is used for the peripheral area of ​​the target video image to reduce bandwidth occupancy. In this way, the clarity of the central area that the user is most concerned about can be ensured, and the overall data transmission amount can be reduced by compressing the edge area of ​​the video image, thereby achieving more efficient wireless transmission and a better visual experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] By describing the embodiments of the present application in more detail in conjunction with the accompanying drawings, the above and other purposes, features and advantages of the present application will become more apparent. The accompanying drawings are used to provide a further understanding of the embodiments of the present application and constitute a part of the specification. Together with the embodiments of the present application, they are used to explain the present application and do not constitute a limitation of the present application. In the accompanying drawings, the same reference numerals generally represent the same components or steps.

[0033] Figure 1 The figure is a flow chart of a VR image compression method provided in one embodiment of the present application.

[0034] Figure 2 The figure shows the effect of decompressing the VR video image compressed in equal proportion provided by the present application.

[0035] Figure 3 The figure shows the effect of a VR video image compressed by the VR image compression method of an embodiment of the present application after being decompressed.

[0036] Figure 4 It is a schematic diagram showing a method of dividing a target video image into a first compression area, a transition area and a second compression area according to an embodiment of the present application.

[0037] Figure 5 It is a schematic diagram showing another embodiment of the present application of dividing a target video image into a first compression area, a transition area and a second compression area.

[0038] Figure 6 The figure is a flow chart of a VR image compression method provided in another embodiment of the present application.

[0039] Figure 7 Shown is a distortion curve diagram of a lens in a target VR head mounted device provided in one embodiment of the present application.

[0040] Figure 8 The figure is a flow chart of a VR image compression method provided in another embodiment of the present application.

[0041] Fig. 9 The figure is a structural block diagram of a VR image compression device provided by an embodiment of the present application.

[0042] Fig.10 Shown is a structural block diagram of an electronic device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0043] In the description of the application, the meaning of "multiple" is at least two, for example, two, three, etc., unless otherwise clearly and specifically limited. In the embodiment of the present application, all directional indications (such as up, down, left, right, front, back, top, bottom ...) are only used to explain the relative position relationship, motion conditions, etc. between the components under a certain specific posture (as shown in the drawings). If the specific posture changes, the directional indication also changes accordingly. In addition, the terms "including" and "having" and any of their deformations are intended to cover non-exclusive inclusions. For example, the process, method, system, product or equipment comprising a series of steps or units are not limited to the steps or units listed, but optionally also include the steps or units not listed, or optionally also include other steps or units inherent to these processes, methods, products or equipment.

[0044] In addition, the reference to "embodiment" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiment may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0045] Application Overview

[0046] As described in the background technology, the traditional compression method for compressing video images usually uses geometric compression of the entire video image. Due to the physiological structure of the human eye, the eye is much more sensitive to the central area of ​​a picture than to the edge area. The fovea of ​​the human eye is located in the macular area of ​​the retina, which is rich in a large number of cone cells. It is responsible for perceiving fine details and colors and is the area with the highest visual resolution. In contrast, the density of visual cells in the peripheral retina is lower, and it mainly perceives light and dynamic changes, and has a lower resolution. Therefore, when a user wears a VR headset to watch the image displayed on the display screen, the central area of ​​the displayed image is the part that the user pays most attention to, and the processing of visual information is mainly concentrated in this area, and the user has lower requirements for the clarity of the edge area. Therefore, if the entire screen of the video image is compressed in equal proportion, such as Figure 2 As shown, the center of the video image displayed on the display screen of the VR head-mounted device will be significantly reduced due to the high compression ratio, affecting the user's perception of image details and further affecting the immersive experience.

[0047] During the research, the applicant discovered that when compressing a video image, differentiated compression ratios are used for the peripheral areas and the central areas of the video image to achieve compression of the video image. A lower compression ratio is used for the central area of ​​the video image to maintain high video clarity and improve centrality; a higher compression ratio is used for the peripheral areas of the target video image to reduce bandwidth occupancy. In this way, the clarity of the central area that the user is most concerned about can be ensured, and the overall data transmission volume can be reduced by compressing the edge areas of the video image, thereby achieving more efficient wireless transmission and a better visual experience.

[0048] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0049] Exemplary Compression Methods

[0050] As a first aspect of the present application, the present application provides a method for compressing a VR image, such as Figure 2 As shown, a VR image compression method provided by the present application includes the following steps:

[0051] S1: Acquire target video image;

[0052] Specifically, the target video image is a video image displayed on a display screen corresponding to each eye in a VR head mounted device.

[0053] The target video image may be sent by a server, or may be sent by a video image shooting device, such as a camera.

[0054] S2: performing region segmentation on the target video image to segment the target video image into a plurality of compression regions, wherein the plurality of compression regions include a first compression region and a second compression region surrounding the first compression region;

[0055] The target video image is segmented into regions. The image can be segmented into regions in the following ways:

[0056] (1) Graph-based segmentation: Use the minimum cut algorithm in graph theory to segment video images. The video image is regarded as a graph, with pixels as the vertices of the graph and the similarity between pixels as the weight of the edges of the graph. The segmentation of the video image is achieved by solving the minimum cut problem.

[0057] (2) Segmentation based on geometric models: using the geometric characteristics of video images (such as shape, contour, etc.) for modeling and segmentation.

[0058] (3) Edge detection segmentation: Segment the video image by detecting the edges in the video image.

[0059] (4) Interactive segmentation: image segmentation through user interaction, such as the GrabCut algorithm.

[0060] Specifically, the target video image is divided into a plurality of compression areas, and the plurality of compression areas include a first compression area and a second compression area surrounding the first compression area, that is, the second compression area surrounds the first compression area.

[0061] The number of compression areas may be 2, that is, the target video image is divided into a first compression area and a second compression area.

[0062] The number of compression areas can also be greater than 2, for example: the target video image is divided into a first compression area, a second compression area, and a transition area between the first compression area and the second compression area; another example is that the target video image is divided into a first compression area, a second compression area, and a third compression area surrounding the second compression area (that is, the point compression area surrounds the second compression area); another example is that the target video image is divided into a first compression area, a second compression area, and a fourth compression area within the first compression area (that is, the first compression area surrounds the fourth compression area).

[0063] S3: compressing the multiple compression areas respectively to form a compressed video image corresponding to the target video image, wherein a first compression ratio of the first compression area is less than a second compression ratio of the second compression area;

[0064] After the target video image is divided into multiple compression areas, the multiple compression areas can be compressed separately to form compression information of each compression area, and then the compression information corresponding to the multiple compression areas can be integrated into a compressed video image corresponding to the target video image.

[0065] When the plurality of compression regions are compressed respectively, the first compression ratio of the first compression region is smaller than the second compression ratio of the second compression region, that is, the compression ratio of the compression region located at the periphery is larger than the compression ratio of the compression region located at the interior.

[0066] Optionally, the first compression ratio of the first compression zone may be half of the second compression ratio of the second zone, for example, the first compression ratio of the first compression zone may be 1:1, and the second compression ratio of the second zone may be 2:1.

[0067] In this application, a lower compression ratio is used for the inner area of ​​the target video image to maintain the high definition of the video and improve the centrality. The effect is shown in the figure Figure 3 As shown; a higher compression ratio is used for the peripheral areas of the target video image to reduce bandwidth usage, thereby ensuring the clarity of the central area that the user is most concerned about, and reducing the overall data transmission volume by compressing the edge area of ​​the video image, thereby achieving more efficient wireless transmission and a better visual experience.

[0068] S4: Perform video encoding processing on the compressed video image to form a transmission video image, and transmit the transmission video image to the client, wherein the client performs video decoding processing and decompression processing on the transmission video image and generates a display video image.

[0069] After the target video image is compressed to form a compressed video image, the compressed video image can be encoded to form a transmission video image, and the transmission video image is transmitted to the client (such as a VR head-mounted device). After the client performs video decoding and decompression on the transmission video image, a display video image can be formed. The display video image is displayed on the display screen of the VR head-mounted device, so that the user can see an interactive visual image through the display screen of the VR head-mounted device.

[0070] The present application provides a VR image compression method, which first divides a target video image into multiple compression areas, wherein the multiple compression areas include at least a first compression area and a second compression area surrounding the first compression area. After the target video image is divided into multiple compression areas, the multiple compressed video areas can be compressed separately, and a first compression ratio of the first compression area is less than a second compression ratio of the second compression area. In this way, when compressing the video image, differentiated compression ratios are used for the peripheral area and the central area of ​​the video image to achieve compression of the video image. A lower compression ratio is used for the central area of ​​the video image to maintain high definition of the video and improve the centrality; a higher compression ratio is used for the peripheral area of ​​the target video image to reduce bandwidth occupancy. In this way, the clarity of the central area that the user is most concerned about can be ensured, and the overall data transmission amount can be reduced by compressing the edge area of ​​the video image, thereby improving transmission efficiency and reducing the risk of delay and jamming, so as to achieve more efficient wireless transmission and a better visual experience.

[0071] Optionally, the first compression area is the central area of ​​the target video image, and the second compression area is the edge area of ​​the target video image. That is, when compressing the target video image, a lower compression ratio is used for the central area of ​​the target video image, and a higher compression ratio is used for the edge area of ​​the target video image, so as to maintain the high definition of the video, so that the part that the human eye pays the most attention to has high definition, and the part that the human eye pays less attention to can have relatively low definition; in this way, it is possible to ensure the clarity of the central area that the user pays the most attention to, and reduce the overall data transmission amount by compressing the edge area of ​​the video image, so as to achieve more efficient wireless transmission and better visual experience.

[0072] In one embodiment of the present application, the target video image is divided into a plurality of compression areas, which, in addition to the first compression area and the second compression area described above, also include: a transition area between the first compression area and the second compression area, that is, the target video image is divided into the first compression area, the transition area and the second compression area, such as Figure 4 shown.

[0073] The third compression ratio of the transition area is greater than the first compression ratio of the first area, and less than the second compression ratio of the second compression area. That is, in the first direction (i.e., the first direction is the direction extending outward from the center of the target video image), the compression ratios of the three compression areas gradually increase. By setting a transition area between the first compression area and the second compression area, abrupt changes in clarity between different areas are avoided, and the overall consistency and smoothness of the picture are ensured.

[0074] Optional, such as Figure 5As shown, in the first direction, the transition area includes multiple sub-transition areas, that is, the transition area is divided into multiple sub-transition areas; wherein, in the first direction, the compression ratios of the multiple sub-transition areas gradually increase; for example, the transition area includes three sub-transition areas, namely: the first sub-transition area, the second sub-transition area and the third sub-transition area, and the compression ratio of the first sub-transition area is less than that of the second sub-transition area, and the compression ratio of the second sub-transition area is less than that of the third sub-transition area. The compression ratio of the transition area of ​​the present application gradually increases, that is, it presents a gradual change, so that the image quality difference between the first compression area and the second compression area (i.e., the central area and the edge area) does not appear too abrupt.

[0075] Optionally, the difference in compression ratios between any two adjacent sub-transition regions in the multiple sub-transition regions in the transition region is equal, that is, the compression ratios of the multiple sub-transition regions gradually increase in equal proportion. For example, the transition region includes four sub-transition regions, namely: a first sub-transition region, a second sub-transition region, a third sub-transition region and a fourth sub-transition region, and the difference in compression ratio between the second sub-transition region and the first sub-transition region is equal to the difference in compression ratio between the third sub-transition region and the second sub-transition region, and the difference in compression ratio between the fourth sub-transition region and the third sub-transition region.

[0076] Optionally, the difference between the compression ratio of the sub-transition region near the first compression region and the compression ratio of the first compression region is equal to the difference between the compression ratio of the second compression region and the compression ratio of the sub-transition region near the second compression region. Figure 5 As shown, the transition area includes three sub-transition areas, namely: the first sub-transition area, the second sub-transition area and the third sub-transition area. The first sub-transition area is a sub-transition area close to the first compression area, and the third sub-transition area is a sub-transition area close to the second compression area. Then, the difference between the compression ratio of the second compression area and the compression ratio of the third sub-transition area is equal to the difference between the compression ratio of the first sub-transition area and the compression ratio of the first compression area. In this way, the compression ratio in the transition area can be made uniform with the compression ratio of the first compression area and the compression ratio of the second compression area, and further, the image quality difference between the first compression area and the second compression area (i.e., the central area and the edge area) will not appear too abrupt.

[0077] Alternatively, in the first direction, the difference in compression ratio between two adjacent sub-transition areas gradually increases. That is, in the first direction, the compression ratio of the sub-transition area increases at an accelerated rate. For example, the transition area includes four sub-transition areas, namely: a first sub-transition area, a second sub-transition area, a third sub-transition area, and a fourth sub-transition area, and the difference between the compression ratio of the second sub-transition area and the compression ratio of the first sub-transition area is less than the difference between the compression ratio of the third sub-transition area and the compression ratio of the second sub-transition area, which is less than the difference between the compression ratio of the fourth sub-transition area and the compression ratio of the third sub-transition area. The compression ratio of the sub-transition area in the present application shows an accelerating increase trend, which not only ensures that the closer to the center area, the higher the clarity of the target video image, but also further improves the transmission efficiency and reduces the risk of delay and freeze, so as to achieve more efficient wireless transmission and a better visual experience.

[0078] Optionally, in the first direction, the compression ratio of the second compression area gradually increases. The increase in the compression ratio of the second compression area is greater than the gradual increase in the compression ratio of the transition area. The increase in the compression ratio of the second compression area can also be equal to the gradual increase in the compression ratio of the transition area.

[0079] In one embodiment of the present application, the target video image is divided into three regions, which are respectively: a first compression region, a transition region, and a second compression region in the first direction. The transition region includes multiple sub-transition regions, and the compression ratio of the first compression region is smaller than that of the transition region, and the compression ratio of the transition region is smaller than that of the second compression region. In the first direction, the compression ratios of multiple sub-transition regions in the transition region gradually increase. Then the specific division method of dividing the target video image into the first compression region, the transition region, and the second compression region is as follows: Figure 6 As shown, S2 (dividing the target video image into regions to divide the target video image into multiple compression regions) specifically includes the following steps:

[0080] S21: Obtain a distortion curve of a target VR lens in a target VR head mounted device;

[0081] Specifically, the target VR head-mounted device is a VR head-mounted device worn by a user, and the target VR lens is a lens in the VR head-mounted device worn by the user.

[0082] After the user selects a target VR headset, the distortion curve of the target VR lens can be obtained according to the product description of the target VR headset.

[0083] The distortion curve of a lens is a graphical representation of the degree of lens distortion. It shows the relationship between the degree of distortion (usually expressed as a percentage) and the pixel position in the image (usually with the center of the image as the origin and the radial distance as the independent variable).

[0084] S22: determining a first width of the first compression region, a second width of the second compression region, and a third width of the transition region according to a distortion curve of the target VR lens;

[0085] After the distortion curve of the target VR lens is determined, the first width L1 of the first compression area, the second width L2 of the second compression area, and the third width L3 of the transition area can be determined according to the distortion curve of the target VR lens. Figure 4 The distortion curve of the target VR lens can be as follows: Figure 7 Specifically, the first width of the first compression area, the second width of the second compression area, and the third width of the transition area can be determined in a specific manner according to the distortion curve of the target VR lens:

[0086] According to the distortion curve of the target VR lens (e.g. Figure 7 The width of the first compression area (i.e., the width of the central area) is determined by a relatively gentle range of the curve in FIG. 1 , and the width of the second compression area (i.e., the width of the edge area) is determined by a relatively steep range. After the first width and the second width are calculated, the third width can be determined. S23: Based on the first width, the second width, and the third width, the target video image is segmented into a first compression area, a transition area, and a second compression area.

[0087] After the first width, the second width and the third width are determined, the target video image can be segmented according to the first width, the second width and the third width, so as to segment the target video image into a first compression area with the first width, a second compression area with the second width and a transition area with the third width.

[0088] The present application can adjust the width of the transition area, the width of the first compression area, and the width of the second compression area according to the distortion curve of the lens of the target VR head-mounted device worn by the user (i.e., the optical properties of the lens), thereby ensuring that the user feels a natural transition effect in the visual experience.

[0089] Optional, such as Figure 8 As shown, after S23 and before S3, the VR image compression method further includes the following steps:

[0090] S30: determining a compression ratio curve of the transition region according to the distortion curve of the target VR lens; and

[0091] Specifically, the distortion curve of the target VR lens may be fitted according to preset conditions to fit the compression ratio curve of the transition region.

[0092] For example, the distortion curve of the target VR lens may be a third-order polynomial simulation distortion curve, and the third-order polynomial is a mathematical expression, and the mathematical expression is:

[0093] f(x)=ax^3+bx^2+cx+d

[0094] In the formula, a, b, c, d are the coefficients of the polynomial, which are the parameters determined by the fitting data.

[0095] x: independent variable, representing the input value of curve fitting (such as radial distance);

[0096] f(x): function value, representing the output result (such as degree of distortion or related parameters).

[0097] Therefore, after obtaining the third-order polynomial simulated distortion curve of the target VR lens, the mathematical expression can be inverted based on the third-order polynomial simulated distortion curve. After inverting the mathematical expression, the four parameters a, b, c, and d in the mathematical expression can be determined. After determining the four parameters a, b, c, and d, the compression ratio curve of the transition area can be determined based on the four parameters a, b, c, and d.

[0098] S31: Determine the compression ratios of the plurality of sub-transition regions according to the compression ratio curve.

[0099] After the compression ratio curve is fitted, the compression ratios of multiple sub-transition regions in the transition region can be determined according to the compression ratio curve.

[0100] The present application can adjust the compression ratio variation curve in the transition area according to the distortion curve of the lens of the target VR head-mounted device worn by the user (i.e., the optical properties of the lens), thereby ensuring that the user feels a natural transition effect in the visual experience.

[0101] Exemplary Compression Devices

[0102] As a second aspect of the present application, the present application also provides a VR image compression device, such as Fig. 9 As shown, the VR image compression device 1 includes:

[0103] A data acquisition module 10 is used to acquire a target video image;

[0104] That is, the data acquisition module 10 is used to execute S1 (acquire the target video image) in the above-mentioned VR image compression method.

[0105] An image segmentation module 20 is used to segment a target video image into multiple compressed regions, wherein the multiple compressed regions include a first compressed region and a second compressed region surrounding the first compressed region;

[0106] That is, the image segmentation module 20 is used to execute S2 in the above-mentioned VR image compression method (regionally segmenting the target video image to divide the target video image into multiple compression regions, the multiple compression regions including a first compression region and a second compression region surrounding the first compression region).

[0107] A compression module 30 compresses the plurality of compression regions respectively to form a compressed video image corresponding to the target video image, wherein a first compression ratio of a first compression region is less than a second compression ratio of a second compression region;

[0108] That is, the compression module 30 is used to execute S3 in the above-mentioned VR image compression method (compressing multiple compression areas separately to form a compressed video image corresponding to the target video image, and the first compression ratio of the first compression area is less than the second compression ratio of the second compression area).

[0109] The sending module 40 is used to perform video encoding processing on the compressed video image to form a transmission video image, and transmit the transmission video image to the client, wherein the client performs video decoding processing and decompression processing on the transmission video image and generates a display video image.

[0110] That is, the sending module 40 is used to execute S4 in the above-mentioned VR image compression method (performing video encoding processing on the compressed video image to form a transmission video image, and transmitting the transmission video image to the client).

[0111] The present application provides a VR image compression device, which adopts differentiated compression ratios for the peripheral area and the central area of ​​the video image to achieve compression of the video image. A lower compression ratio is adopted for the central area of ​​the video image to maintain the high definition of the video and improve the centrality; a higher compression ratio is adopted for the peripheral area of ​​the target video image to reduce bandwidth occupancy, thereby ensuring the clarity of the central area that the user is most concerned about, and reducing the overall data transmission volume by compressing the edge area of ​​the video image, thereby improving transmission efficiency, reducing the risk of delay and jamming, and achieving more efficient wireless transmission and a better visual experience.

[0112] Exemplary Electronic Devices

[0113] Next, as a second aspect of the present application, the present application further provides an electronic device. Fig.10 To describe an electronic device according to an embodiment of the present application.

[0114] Fig.10 The figure illustrates a structural block diagram of an electronic device according to an embodiment of the present application.

[0115] like Fig.10As shown, the electronic device 60 includes one or more processors 601 and a memory 602 .

[0116] The processor 601 may be a central processing unit (CPU) or other forms of processing units having data processing capabilities and / or instruction execution capabilities, and may control other components in the electronic device 60 to perform desired functions.

[0117] The memory 602 may include one or more computer program products, and the computer program product may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory may include, for example, a random access memory (RAM) and / or a cache memory (cache), etc. The non-volatile memory may include, for example, a read-only memory (ROM), a hard disk, a flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 601 may execute the program instructions to implement the steps of a VR image compression method of the present application described above and / or other desired functions.

[0118] In one example, the electronic device 60 may further include: an input device 603 and an output device 604, and these components are interconnected via a bus system and / or other forms of connection mechanisms (not shown).

[0119] When the electronic device is a stand-alone device, the input device 603 may be a communication network connector, which is used to receive the collected input signals from the first device and the second device.

[0120] In addition, the input device 603 may also include, for example, a keyboard, a mouse, and the like.

[0121] The output device 604 can output various information to the outside, including the determined distance information, direction information, etc. The output device 604 can include, for example, a display, a speaker, a printer, a communication network and a remote output device connected thereto, and the like.

[0122] Of course, to simplify, Fig.10 Only some of the components related to the present application in the electronic device 60 are shown, and components such as a bus, an input / output interface, etc. are omitted. In addition, according to specific application situations, the electronic device 60 may also include any other appropriate components.

[0123] As a fifth aspect of the present application, the present application provides a computer-readable storage medium, the storage medium stores a computer program, and the computer program is used to execute the steps of a VR image compression method in each of the above embodiments.

[0124] Computer readable storage media can adopt any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can include, for example, but is not limited to, a system, device or device of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0125] In addition to the above-mentioned methods and devices, an embodiment of the present application may also be a computer program product, which includes computer program information. When the computer program information is executed by a processor, the processor executes the steps of a VR image compression method of each embodiment of the present application.

[0126] The computer program product may be written in any combination of one or more programming languages ​​to write program codes for performing the operations of the embodiments of the present application, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" language or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0127] The basic principles of the present application are described above in conjunction with specific embodiments. However, it should be noted that the advantages, strengths, effects, etc. mentioned in the present application are only examples and not limitations, and it cannot be considered that these advantages, strengths, effects, etc. are required by each embodiment of the present application. In addition, the specific details disclosed above are only for the purpose of illustration and ease of understanding, not for limitation, and the above details do not limit the present application to being implemented by adopting the above specific details.

[0128] The block diagrams of the devices, apparatuses, equipment, and systems involved in this application are only illustrative examples and are not intended to require or imply that they must be connected, arranged, and configured in the manner shown in the block diagram. As will be appreciated by those skilled in the art, these devices, apparatuses, equipment, and systems can be connected, arranged, and configured in any manner. Words such as "including", "comprising", "having", etc. are open words, referring to "including but not limited to", and can be used interchangeably with them. The words "or" and "and" used here refer to the words "and / or" and can be used interchangeably with them, unless the context clearly indicates otherwise. The words "such as" used here refer to the phrase "such as but not limited to", and can be used interchangeably with them.

[0129] It should also be noted that in the apparatus, device and method of the present application, each component or each step can be decomposed and / or recombined. Such decomposition and / or recombination should be regarded as equivalent solutions of the present application.

Claims

1. A VR image compression method, characterized in that: include: Acquire target video image; Performing region segmentation on the target video image to segment the target video image into a plurality of compression regions, wherein the plurality of compression regions include a first compression region and a second compression region surrounding the first compression region; Compressing the plurality of compression regions respectively to form a compressed video image corresponding to the target video image, wherein a first compression ratio of the first compression region is less than a second compression ratio of the second compression region; The compressed video image is subjected to video encoding processing to form a transmission video image, and the transmission video image is transmitted to a client, wherein the client performs video decoding processing and decompression processing on the transmission video image and generates a display video image.

2. The VR image compression method according to claim 1, characterized in that: The first compression area is a central area of ​​the target video image, and the second compression area is an edge area of ​​the target video image.

3. The VR image compression method according to claim 2, characterized in that: The plurality of compression regions further include: a transition region between the first compression region and the second compression region; The third compression ratio of the transition region is greater than the first compression ratio of the first compression region, and less than the second compression ratio of the second compression region.

4. The VR image compression method according to claim 3, characterized in that: In a first direction, the transition area includes a plurality of sub-transition areas, and the first direction is a direction extending outward from the center of the target video image; Wherein, in the first direction, the compression ratios of the plurality of sub-transition regions gradually increase.

5. The VR image compression method according to claim 4, characterized in that: The difference in compression ratio between any two adjacent sub-transition regions is equal.

6. The VR image compression method according to claim 5, characterized in that: The difference between the compression ratio of the sub-transition area near the first compression area and the compression ratio of the first compression area is equal to the difference between the compression ratio of the second compression area and the compression ratio of the sub-transition area near the second compression area.

7. The VR image compression method according to claim 5, characterized in that: In the first direction, the difference in compression ratio between two adjacent sub-transition regions gradually increases.

8. The VR image compression method according to claim 4, characterized in that: Performing region segmentation on the target video image to divide the target video image into a plurality of compression regions, including: Obtaining a distortion curve of a target VR lens in a target VR head mounted device; Determining a first width of the first compression region, a second width of the second compression region, and a third width of the transition region according to a distortion curve of the target VR lens; The target video image is divided into regions based on the first width, the second width, and the third width, so as to divide the target video image into the first compression region, the transition region, and the second compression region.

9. The VR image compression method according to claim 8, characterized in that: Also includes: The compression ratios of the plurality of sub-transition regions are determined according to the distortion curve of the target VR lens.

10. A VR image compression device, characterized in that: include: A data acquisition module, used for acquiring a target video image; An image segmentation module, used for performing region segmentation on the target video image to segment the target video image into a plurality of compression regions, wherein the plurality of compression regions include a first compression region and a second compression region surrounding the first compression region; A compression module, compressing the plurality of compression areas respectively to form a compressed video image corresponding to the target video image, wherein a first compression ratio of the first compression area is less than a second compression ratio of the second compression area; The sending module is used to perform video encoding processing on the compressed video image to form a transmission video image, and transmit the transmission video image to the client, wherein the client performs video decoding processing and decompression processing on the transmission video image and generates a display video image.

Images