Multi-view image processing system and method thereof

Abstract

A multi-view image processing system and method thereof, wherein the multi-view image processing system comprises a processing device and a display device; the processing device comprises an acquisition module and an encoding module; the acquisition module is configured to acquire K view images, wherein each view image comprises M rows and N columns of pixel points, K is a positive integer greater than or equal to 2, and M and N are positive integers greater than or equal to 1; the encoding module is configured to receive the K view images, encode the K view images, generate a plurality of encoded images, and send the plurality of encoded images to the display device; the display device is configured to receive the plurality of encoded images, obtain M display information according to the plurality of encoded images, wherein the i-th display information comprises the i-th row of pixel points of the K view images, i = 1, 2, …, M, and perform stereoscopic display according to the M display information; the processing device is arranged in the display device, or the processing device and the display device are arranged separately.

Description

Technical Field

[0001] This disclosure relates to, but is not limited to, the field of image processing technology, specifically to a multi-view image processing system and method. Background Technology

[0002] Stereoscopic imaging is one of the hottest technologies in the visual industry, driving the technological transformation from flat to stereoscopic displays. Stereoscopic display technology is a crucial component of the stereoscopic imaging industry, primarily divided into two categories: glasses-based stereoscopic displays and glasses-free stereoscopic displays. Glasses-free stereoscopic displays allow viewers to see stereoscopic images directly without wearing glasses. Compared to glasses-based stereoscopic displays, glasses-free stereoscopic displays are a free-viewing stereoscopic technology, reducing constraints on the viewer.

[0003] Typically, glasses-free stereoscopic displays are based on multi-viewpoints, forming a sequence of parallax images (frames) at different locations in space. This allows stereoscopic image pairs with parallax relationships to enter the left and right eyes of the viewer separately, thus providing a sense of depth. Stereoscopic displays are usually achieved through multi-viewpoint glasses-free stereoscopic displays. Summary of the Invention

[0004] The following is an overview of the subject matter described in detail in this disclosure. This overview is not intended to limit the scope of the claims.

[0005] In a first aspect, this disclosure provides a multi-viewpoint image processing system, comprising: a processing device and a display device; the processing device includes: an acquisition module and an encoding module;

[0006] The acquisition module is configured to acquire K viewpoint images, wherein the viewpoint images comprise: M rows and N columns of pixels, where K is a positive integer greater than or equal to 2, and M and N are positive integers greater than or equal to 1;

[0007] The encoding module is configured to receive K viewpoint images, encode the K viewpoint images to generate multiple encoded images, and send the multiple encoded images to the display device.

[0008] The display device is configured to receive multiple encoded images, obtain M display information based on the multiple encoded images, wherein the i-th display information includes: the i-th row of pixels of K viewpoint images, i = 1, 2, ..., M; and perform stereoscopic display based on the M display information.

[0009] The processing device is disposed in the display device, or the processing device and the display device are disposed separately.

[0010] In one possible implementation, the acquisition module is configured to acquire an image to be displayed, and based on the image to be displayed, acquire K viewpoint images.

[0011] In one possible implementation, it further includes: a multi-view acquisition device, which includes: multiple CCD cameras, each of which performs dynamic scene acquisition to obtain K viewpoint images;

[0012] The acquisition module is configured to receive K viewpoint images obtained by the multi-viewpoint acquisition device.

[0013] In one possible implementation, the encoding module is configured to select the m-th viewpoint image from K viewpoint images as a first viewpoint image, and all viewpoint images other than the m-th viewpoint image as second viewpoint images, the number of second viewpoint images being K-1, 1≤m≤K; obtain K-1 first images based on the first viewpoint image and K-1 second viewpoint images, wherein the k-th first image is obtained based on the first viewpoint image and the k-th second viewpoint image, k=1,2,…,K-1; obtain K-1 encoded images based on the first viewpoint image, K-1 second viewpoint images, and K-1 first images, wherein the k-th encoded image is obtained based on the first viewpoint image, the k-th second viewpoint image, and the k-th first image; send the K-1 encoded images and the first viewpoint image; both the first image and the encoded image include: M rows and N columns of pixels.

[0014] In one possible implementation, the encoding module is further configured to obtain the information of the pixel in the i-th row and j-th column of the k-th first image based on the information of the pixel in the i-th row and j-th column of the first viewpoint image and the information of the pixel in the i-th row and j-th column of the k-th second viewpoint image; and to obtain the k-th first image, j = 1, 2, ..., N, based on the information of all pixels in the k-th first image.

[0015] In one possible implementation, the information of the pixel includes: color component information, which includes: a first color component value, a second color component value, and a third color component value, wherein the first color, the second color, and the third color are respectively one of red, green, and blue, and are different colors;

[0016] The encoding module is further configured to obtain the grayscale value of the pixel in the i-th row and j-th column of the first viewpoint image based on the color component information of the pixel in the i-th row and j-th column of the first viewpoint image; and to obtain the grayscale value of the pixel in the i-th row and j-th column of the k-th second viewpoint image based on the color component information of the pixel in the i-th row and j-th column of the k-th second viewpoint image; when the difference between the grayscale value of the pixel in the i-th row and j-th column of the first viewpoint image and the grayscale value of the pixel in the i-th row and j-th column of the k-th second viewpoint image is less than a threshold difference, the pixel in the i-th row and j-th column of the k-th first image is a black pixel; when the difference between the grayscale value of the pixel in the i-th row and j-th column of the first viewpoint image and the grayscale value of the pixel in the i-th row and j-th column of the k-th second viewpoint image is greater than a threshold difference, the pixel in the i-th row and j-th column of the k-th first image is a white pixel;

[0017] Alternatively, the encoding module is further configured to: subtract the first color component value of the pixel in the i-th row and j-th column of the first viewpoint image from the first color component value of the pixel in the i-th row and j-th column of the k-th second viewpoint image to obtain a first color component difference value; subtract the second color component value of the pixel in the i-th row and j-th column of the first viewpoint image from the second color component value of the pixel in the i-th row and j-th column of the k-th second viewpoint image to obtain a second color component difference value; subtract the third color component value of the pixel in the i-th row and j-th column of the first viewpoint image from the third color component value of the pixel in the i-th row and j-th column of the k-th second viewpoint image to obtain a third color component difference value; obtain a grayscale difference value based on the first color component difference value, the second color component difference value, and the third color component difference value; when the grayscale difference value is less than a threshold difference value, the pixel in the i-th row and j-th column of the k-th first image is a black pixel; when the grayscale difference value is greater than the threshold difference value, the pixel in the i-th row and j-th column of the k-th first image is a white pixel;

[0018] When the colors of the pixels in the i-th row and j-th column of the k-th second viewpoint image are different, the threshold difference will be different when obtaining the k-th first image.

[0019] In one possible implementation, the encoding module is further configured to use the first row of pixels in the first viewpoint image as the first row of pixels in each encoded image; scan the first row of pixels in the kth first image; when there are no white pixels in the first row of pixels in the kth first image, select the next row of pixels in the first viewpoint image as the next row of pixels in the kth encoded image; when there are white pixels in the first row of pixels in the kth first image, obtain the position information of the white pixels and the information of the pixels corresponding to the white pixels in the kth second viewpoint image, and set the white pixels... The location information and the information of the pixel corresponding to the white pixel in the kth second viewpoint image are stored in the two adjacent pixels of the next row of pixels in the kth coded image. The rth row of pixels in the kth first image is scanned sequentially until the last row of pixels in the kth first image is scanned to obtain the kth coded image, where 2≤r≤M. The location information includes: the row number and column number of the white pixel in the first image, and the pixel corresponding to the white pixel in the second viewpoint image is the pixel in the second viewpoint image located at the row number and column number of the white pixel in the first image.

[0020] In one possible implementation, the display device includes: a decoding module and a display module;

[0021] The decoding module is configured to receive multiple encoded images and obtain M display information based on the multiple encoded images;

[0022] The display module is configured to receive M pieces of display information and perform a stereoscopic display based on the M pieces of display information.

[0023] In one possible implementation, the decoding module is further configured to obtain K-1 second viewpoint images based on K-1 encoded images, wherein the kth second viewpoint image is obtained based on the kth encoded image; and to obtain M display information based on the first viewpoint image and the K-1 second viewpoint images.

[0024] In one possible implementation, the decoding module is further configured to use the first row of pixels of the kth encoded image as the first row of pixels of the kth second viewpoint image, scan the next row of pixels of the kth encoded image, and if the next row of pixels includes position information, then obtain the information of the pixels stored in the adjacent pixels of the pixel containing the position information, and update the information of the pixel located at the position information in the kth second viewpoint image to the information of the pixels stored in the adjacent pixels of the pixel containing the position information; if the next row of pixels does not include position information, then use the next row of pixels of the kth encoded image as the next row of pixels of the kth second viewpoint image, and scan the rth row of pixels of the kth encoded image sequentially until the last row of pixels of the kth encoded image is scanned to obtain the kth second viewpoint image.

[0025] In one possible implementation, the decoding module is configured to obtain the i-th row of pixels of K viewpoint images, i = 1, 2, ..., M, based on the first viewpoint image and K-1 second viewpoint images; and to obtain M display information based on the first row of pixels to the M-th row of pixels of the K viewpoint images.

[0026] The display module is configured to display the i-th row of K viewpoint images based on the i-th display information.

[0027] In one possible implementation, the encoding module is configured to sequentially extract the i-th row of pixels from each viewpoint image to form M second images. Each second image includes K rows and N columns of pixels, and the n-th row of pixels in the i-th second image is the i-th row of pixels in the n-th viewpoint image, where n = 1, 2, ..., K. The M second images are then encoded to generate M encoded images.

[0028] In one possible implementation, the display device is configured to sequentially decode M encoded images to obtain M second images, wherein the i-th second image includes i-th display information; and display the i-th row of K viewpoint images based on the i-th second image.

[0029] Secondly, this disclosure also provides an image processing method, the method comprising:

[0030] Obtain K viewpoint images, wherein each viewpoint image comprises M rows and N columns of pixels, where K is a positive integer greater than or equal to 2, and M and N are positive integers greater than or equal to 1;

[0031] Receive K viewpoint images, encode the K viewpoint images to generate multiple encoded images, and send the multiple encoded images to the display device;

[0032] Receive multiple encoded images, and obtain M display information based on the multiple encoded images. The i-th display information includes: the i-th row of pixels in K viewpoint images, i = 1, 2, ..., M;

[0033] A 3D display is generated based on M pieces of information.

[0034] In one possible implementation, acquiring the K viewpoint images includes: acquiring an image to be displayed, and acquiring the K viewpoint images based on the image to be displayed, or acquiring the K viewpoint images obtained by the multi-viewpoint acquisition device.

[0035] In one possible implementation, encoding the K viewpoint images to generate multiple encoded images includes: selecting the m-th viewpoint image from the K viewpoint images as a first viewpoint image, and all viewpoint images other than the m-th viewpoint image as second viewpoint images, the number of second viewpoint images being K-1, 1≤m≤K; obtaining K-1 first images based on the first viewpoint images and K-1 second viewpoint images, wherein the k-th first image is obtained based on the first viewpoint image and the k-th second viewpoint image, k=1,2,…,K-1; obtaining K-1 encoded images based on the first viewpoint image, K-1 second viewpoint images, and K-1 first images, wherein the k-th encoded image is obtained based on the first viewpoint image, the k-th second viewpoint image, and the k-th first image; and sending the K-1 encoded images and the first viewpoint images, wherein both the first images and the encoded images include: M rows and N columns of pixels.

[0036] In one possible implementation, obtaining K-1 first images based on the first viewpoint image and K-1 second viewpoint images includes: obtaining information about the pixels in the i-th row and j-th column of the k-th first image based on the information of the pixels in the i-th row and j-th column of the first viewpoint image and the information of the pixels in the i-th row and j-th column of the k-th second viewpoint image; and obtaining the k-th first image, j = 1, 2, ..., N, based on the information of all pixels in the k-th first image.

[0037] The information of the pixel includes: color component information, which includes: a first color component value, a second color component value, and a third color component value, wherein the first color, the second color, and the third color are respectively one of red, green, and blue, and are different colors;

[0038] The step of obtaining the information of the pixel in the i-th row and j-th column of the k-th first image based on the information of the pixel in the i-th row and j-th column of the first viewpoint image and the information of the pixel in the i-th row and j-th column of the k-th second viewpoint image includes:

[0039] Based on the color component information of the pixel in the i-th row and j-th column of the first viewpoint image, the grayscale value of the pixel in the i-th row and j-th column of the first viewpoint image is obtained; based on the color component information of the pixel in the i-th row and j-th column of the k-th second viewpoint image, the grayscale value of the pixel in the i-th row and j-th column of the k-th second viewpoint image is obtained; when the difference between the grayscale value of the pixel in the i-th row and j-th column of the first viewpoint image and the grayscale value of the pixel in the i-th row and j-th column of the k-th second viewpoint image is less than a threshold difference, the pixel in the i-th row and j-th column of the k-th first image is a black pixel; when the difference between the grayscale value of the pixel in the i-th row and j-th column of the first viewpoint image and the grayscale value of the pixel in the i-th row and j-th column of the k-th second viewpoint image is greater than a threshold difference, the pixel in the i-th row and j-th column of the k-th first image is a white pixel;

[0040] Alternatively, the difference between the first color component value of the pixel in the i-th row and j-th column of the first viewpoint image and the first color component value of the pixel in the i-th row and j-th column of the k-th second viewpoint image is obtained to get the first color component difference value; the difference between the second color component value of the pixel in the i-th row and j-th column of the first viewpoint image and the second color component value of the pixel in the i-th row and j-th column of the k-th second viewpoint image is obtained to get the second color component difference value; the difference between the third color component value of the pixel in the i-th row and j-th column of the first viewpoint image and the third color component value of the pixel in the i-th row and j-th column of the k-th second viewpoint image is obtained to get the third color component difference value; a grayscale difference value is obtained based on the first color component difference value, the second color component difference value, and the third color component difference value; when the grayscale difference value is less than a threshold difference value, the pixel in the i-th row and j-th column of the k-th first image is a black pixel, and when the grayscale difference value is greater than the threshold difference value, the pixel in the i-th row and j-th column of the k-th first image is a white pixel;

[0041] When the colors of the pixels in the i-th row and j-th column of the k-th second viewpoint image are different, the threshold difference will be different when obtaining the k-th first image.

[0042] The step of obtaining K-1 encoded images based on a first viewpoint image, K-1 second viewpoint images, and K-1 first images includes: using the first row of pixels in the first viewpoint image as the first row of pixels in each encoded image; scanning the first row of pixels in the k-th first image; when there are no white pixels in the first row of pixels in the k-th first image, selecting the next row of pixels in the first viewpoint image as the next row of pixels in the k-th encoded image; when there are white pixels in the first row of pixels in the k-th first image, obtaining the position information of the white pixels and the corresponding pixels in the k-th second viewpoint image. The information is stored in the two adjacent pixels of the next row of pixels in the k-th coded image, and the position information of the white pixel and the information of the pixel corresponding to the white pixel in the second viewpoint image are stored in the next row of pixels in the k-th coded image. The r-th row of pixels in the k-th first image is scanned sequentially until the last row of pixels in the k-th first image is scanned to obtain the k-th coded image, where 2≤r≤M. The position information includes: the row number and column number of the white pixel in the first image, and the pixel corresponding to the white pixel in the second viewpoint image is the pixel in the second viewpoint image located at the row number and column number of the white pixel in the first image.

[0043] In one possible implementation, obtaining M display information based on multiple coded images includes: obtaining K-1 second viewpoint maps based on K-1 coded images, wherein the k-th second viewpoint map is obtained based on the k-th coded image; and obtaining M display information based on the first viewpoint map and the K-1 second viewpoint maps.

[0044] The step of obtaining the K-1 second viewpoint map based on K-1 coded images includes: using the first row of pixels of the k-th coded image as the first row of pixels of the k-th second viewpoint map; scanning the next row of pixels of the k-th coded image; if the next row of pixels includes position information, obtaining the information of pixels stored in the adjacent pixels of the pixel including position information; updating the information of the pixel located at the position information in the k-th second viewpoint map to the information of pixels stored in the adjacent pixels of the pixel including position information; if the next row of pixels does not include position information, using the next row of pixels of the k-th coded image as the next row of pixels of the k-th second viewpoint map; and sequentially scanning the r-th row of pixels of the k-th coded image until the last row of pixels of the k-th coded image is scanned to obtain the k-th second viewpoint map.

[0045] The step of obtaining M display information from K viewpoint images based on the first viewpoint image and K-1 second viewpoint images includes: sequentially obtaining the i-th row of pixels in the K viewpoint images; and obtaining M display information based on the first row of pixels to the M-th row of pixels in the K viewpoint images.

[0046] The stereoscopic display based on M display information includes: displaying the i-th row of K viewpoint images based on the i-th display information.

[0047] In one possible implementation, encoding the K viewpoint images to generate multiple encoded images includes: sequentially extracting the i-th row of pixels from each viewpoint image to form M second images, each second image comprising: K rows and N columns of pixels, where the n-th row of pixels in the i-th second image is the i-th row of pixels in the n-th viewpoint image, n = 1, 2, ..., K; and encoding the M second images to generate M encoded images.

[0048] In one possible implementation, obtaining M display information of K viewpoint images based on multiple encoded images includes: sequentially decoding the M encoded images to obtain M second images, the i-th second image including the i-th display information; and displaying the i-th row of the K viewpoint images based on the i-th second image.

[0049] After reading and understanding the accompanying diagrams and detailed descriptions, the other aspects can be understood. Attached Figure Description

[0050] The accompanying drawings are used to provide an understanding of the technical solutions of this disclosure and form part of the specification. They are used together with the embodiments of this disclosure to explain the technical solutions of this disclosure and do not constitute a limitation on the technical solutions of this disclosure.

[0051] Figure 1 This is a schematic diagram of the structure of the multi-view image processing system provided in the embodiments of this disclosure;

[0052] Figure 2 A schematic diagram of the processing apparatus provided in the embodiments of this disclosure;

[0053] Figure 3 A schematic diagram of obtaining a first image provided for an exemplary embodiment;

[0054] Figure 4 A schematic diagram of obtaining an encoded image provided for an exemplary embodiment;

[0055] Figure 5 A schematic diagram of the structure of a display device provided for an exemplary embodiment;

[0056] Figure 6 This is a schematic diagram illustrating the decoding of an encoded image as an exemplary embodiment.

[0057] Figure 7 A schematic diagram of a processing apparatus encoding provided for an exemplary embodiment;

[0058] Figure 8A schematic diagram of a display device encoding provided for an exemplary embodiment. Detailed Implementation

[0059] This disclosure describes several embodiments, but these descriptions are exemplary and not restrictive, and many more embodiments and implementations are possible within the scope of the embodiments described herein, which will be apparent to those skilled in the art. Although many possible combinations of features are shown in the drawings and discussed in the detailed description, many other combinations of the disclosed features are also possible. Unless specifically limited, any feature or element of any embodiment may be used in combination with or in lieu of any other feature or element in any other embodiment.

[0060] This disclosure includes and contemplates combinations of features and elements known to those skilled in the art. The embodiments, features, and elements disclosed in this disclosure may also be combined with any conventional features or elements to form a technical solution defined by the claims. Any feature or element of any embodiment may also be combined with features or elements from other technical solutions to form another technical solution defined by the claims. Therefore, it should be understood that any feature shown and discussed in this disclosure may be implemented individually or in any suitable combination. Therefore, the embodiments are not limited except by the limitations imposed by the appended claims and their equivalents. Furthermore, various modifications and changes may be made within the scope of the appended claims.

[0061] Unless otherwise defined, the technical or scientific terms used in this disclosure shall have the ordinary meaning understood by one of ordinary skill in the art to which this disclosure pertains. The terms “first,” “second,” and similar terms used in this disclosure do not indicate any order, quantity, or importance, but are merely used to distinguish different components. Terms such as “comprising” or “including” mean that the element or object preceding the word encompasses the elements or objects listed following the word and their equivalents, without excluding other elements or objects. Terms such as “connected” or “linked” are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect. Terms such as “upper,” “lower,” “left,” and “right” only indicate relative positional relationships, and these relative positional relationships may change accordingly when the absolute position of the described objects changes.

[0062] There is no effective data transmission method for ultra-high resolution multi-view naked-eye stereoscopic displays, which typically achieve stereoscopic display through multi-view naked-eye stereoscopic displays.

[0063] Figure 1This is a schematic diagram of the structure of the multi-view image processing system provided in the embodiments of this disclosure. Figure 2 This is a schematic diagram of the structure of the processing apparatus provided in an embodiment of this disclosure. Figure 1 and Figure 2 As shown, the multi-view image processing system provided in this embodiment includes a processing device 10 and a display device 20 connected to the processing device 10. The processing device 10 includes an acquisition module 11 and an encoding module 12. The acquisition module 11 is configured to acquire K viewpoint images. The encoding module 12 is configured to receive the K viewpoint images, encode the K viewpoint images to generate multiple encoded images, and send the multiple encoded images to the display device 20. The display device 20 is configured to receive the multiple encoded images, obtain M display information based on the multiple encoded images, wherein the i-th display information includes the i-th row of pixels in the K viewpoint images; and perform stereoscopic display based on the M display information.

[0064] In one exemplary embodiment, the viewpoint image may include M rows and N columns of pixels. M and N are both positive integers greater than 1, and the values ​​of M and N depend on the content of the stereoscopic display, which is not limited in this disclosure.

[0065] In one exemplary embodiment, K can be a positive integer greater than or equal to 2, for example, K can be 28 or 45. The value of K can be determined according to the requirements of stereoscopic display; the higher the requirements for stereoscopic display, the larger the value of K.

[0066] In one exemplary embodiment, i = 1, 2, ..., M. The first display information includes: the first row of pixels of the K viewpoint images; the second display information includes: the second row of pixels of the K viewpoint images; and so on, with the Mth display information including: the Mth row of pixels of the K viewpoint images.

[0067] In one exemplary embodiment, the processing device may be a server, a personal computer, or a processor that performs logical operations, such as a central processing unit (CPU), a field-programmable array (FPGA), a digital signal processor (DSP), a microcontroller (MCU), an application-specific logic circuit (ASIC), or other devices with data processing and program execution capabilities.

[0068] In one exemplary embodiment, the display device may consist of a display unit and a grating unit. The display unit may be a liquid crystal display panel, an organic light-emitting diode display panel, or a plasma display panel. The grating unit may be a slit grating or a lenticular grating; this disclosure does not limit the specific type. The display device forms a stereoscopic display by displaying two or more viewpoint images. Different display devices have different resolutions, number of viewpoints, and viewpoint arrangements; therefore, the format of the multiple viewpoint images is determined by the display device.

[0069] In one exemplary embodiment, when the processing device is a processor, the processing device may be disposed in the display device.

[0070] In one exemplary embodiment, the processing device and the display device may be configured separately, such as... Figure 1 The explanation is based on the example of setting the processing device and the display device separately.

[0071] In one exemplary embodiment, the connection includes connection via a wireless network, a wired network, or any combination of wireless and wired networks. The network may include a local area network (LAN), the Internet, a telecommunications network, an Internet of Things (IoT) based on the Internet and telecommunications networks, or any combination of the above networks. Wired networks may transmit information using methods such as wires, twisted-pair cables, coaxial cables, or optical fibers, while wireless networks may use communication methods such as WWAN mobile communication networks, Bluetooth, Zigbee, or WiFi.

[0072] The multi-view image processing system provided in this disclosure includes a processing device and a display device. The processing device includes an acquisition module and an encoding module. The acquisition module is configured to acquire K view images, wherein each view image comprises M rows and N columns of pixels, K is a positive integer greater than or equal to 2, and M and N are positive integers greater than or equal to 1. The encoding module is configured to receive the K view images, encode the K view images to generate multiple encoded images, and send the multiple encoded images to the display device. The display device is configured to receive the multiple encoded images, obtain M display information based on the multiple encoded images, wherein the i-th display information includes the i-th row of pixels in the K view images, and perform stereoscopic display based on the M display information. The multi-view image processing system provided in this disclosure effectively solves the data transmission and display problems of multi-view naked-eye stereoscopic screens, is simple and easy to implement, and can quickly achieve intelligent operation.

[0073] In one exemplary embodiment, the processing device may include a first interface, the display device may include a second interface, and the encoded image may be transmitted from the first interface to the second interface.

[0074] In one exemplary embodiment, the display device may perform image rendering on the image to be displayed to obtain K viewpoint images.

[0075] In one exemplary embodiment, the acquisition module may be configured to acquire an image to be displayed, and based on the image to be displayed, acquire K viewpoint images.

[0076] In one exemplary embodiment, the image to be displayed can be a two-dimensional image.

[0077] In one exemplary embodiment, the multi-view image processing system may further include a multi-view acquisition device, which includes multiple CCD cameras. Each CCD camera in the multi-view acquisition device performs dynamic scene acquisition to obtain K view images.

[0078] In one exemplary embodiment, the acquisition module is configured to receive K viewpoint images acquired by the multi-viewpoint acquisition device.

[0079] In one exemplary embodiment, each CCD camera in the multi-view acquisition device undergoes system calibration before acquiring dynamic scenes.

[0080] In one exemplary embodiment, the multi-viewpoint acquisition device may include a multi-camera acquisition array and a light field environment. The multi-camera acquisition array is arranged in a ring to capture information from different angles as much as possible. The CCD cameras are required to achieve a frame rate of 30 frames per second, 10 megapixels, and an image resolution of 1920×1080 or higher to meet the requirements of high-quality dynamic capture information. The light field environment consists of uniformly distributed light-emitting diodes (LEDs) in a ring, whose main function is to provide illumination to facilitate information acquisition by the CCD cameras. A view acquisition device using multiple CCD cameras arranged in a circular pattern is more suitable for real-time data acquisition. This device installs a circle of CCD cameras at a certain height, with each CCD camera capturing a view from its own perspective. Since all CCD cameras acquire images simultaneously, the time for capturing a full circle of views is very short, which is beneficial for acquiring viewpoint images.

[0081] In one exemplary embodiment, the encoding module may be configured to select the m-th viewpoint image from K viewpoint images as a first viewpoint image, and all viewpoint images other than the m-th viewpoint image as second viewpoint images, the number of second viewpoint images being K-1, 1≤m≤K; obtain K-1 first images based on the first viewpoint image and K-1 second viewpoint images, wherein the k-th first image is obtained based on the first viewpoint image and the k-th second viewpoint image, k=1,2,…,K-1; obtain K-1 encoded images based on the first viewpoint image, K-1 second viewpoint images and K-1 first images, wherein the k-th encoded image is obtained based on the first viewpoint image, the k-th second viewpoint image and the k-th first image.

[0082] In one exemplary embodiment, m is any value from 1 to K. m can be 1 or other numbers.

[0083] In one exemplary embodiment, the first image comprises M rows and N columns of pixels.

[0084] In one exemplary embodiment, the encoded image comprises: M rows and N columns of pixels.

[0085] In one exemplary embodiment, an intermediate viewpoint image is selected as the first viewpoint image, and all viewpoint images other than the intermediate viewpoint image are selected as the second viewpoint image. Selecting the intermediate viewpoint image as the first viewpoint image can reduce the computational complexity of image processing.

[0086] In one exemplary embodiment, the bit depth of each pixel can be 24.

[0087] In one exemplary embodiment, the encoding module is configured to send K-1 encoded images and a first viewpoint map.

[0088] In one exemplary embodiment, Figure 3 This is a schematic diagram illustrating the acquisition of a first image, provided as an exemplary embodiment. Figure 3 As shown, the encoding module is also configured to obtain the information of the pixel in the i-th row and j-th column of the k-th first image based on the information of the pixel in the i-th row and j-th column of the first viewpoint image and the information of the pixel in the i-th row and j-th column of the k-th second viewpoint image; and to obtain the k-th first image based on the information of all pixels in the k-th first image, where j = 1, 2, ..., N.

[0089] In one exemplary embodiment, the information of a pixel may include color component information, color voltage information, or other possible data information, which are not limited in this disclosure.

[0090] In one exemplary embodiment, the color component information may include: a first color component value, a second color component value, and a third color component value. The color voltage information may include: a first color voltage value, a second color voltage value, and a third color voltage value. The first color, the second color, and the third color are each one of red, green, and blue, and are different colors.

[0091] In an exemplary embodiment, when the information of a pixel includes color component information, the encoding module can also be configured to obtain the grayscale value of the pixel in the i-th row and j-th column of the first viewpoint image based on the color component information of the pixel in the i-th row and j-th column of the first viewpoint image; and to obtain the grayscale value of the pixel in the i-th row and j-th column of the k-th second viewpoint image based on the color component information of the pixel in the i-th row and j-th column of the k-th second viewpoint image; when the difference between the grayscale value of the pixel in the i-th row and j-th column of the first viewpoint image and the grayscale value of the pixel in the i-th row and j-th column of the k-th second viewpoint image is less than a threshold difference, the pixel in the i-th row and j-th column of the k-th first image is a black pixel; when the difference between the grayscale value of the pixel in the i-th row and j-th column of the first viewpoint image and the grayscale value of the pixel in the i-th row and j-th column of the k-th second viewpoint image is greater than a threshold difference, the pixel in the i-th row and j-th column of the k-th first image is a white pixel.

[0092] In an exemplary embodiment, when the information of a pixel includes color component information, the encoding module may further be configured to: subtract the first color component value of a pixel in the i-th row and j-th column of the first viewpoint image from the first color component value of the pixel in the i-th row and j-th column of the k-th second viewpoint image to obtain a first color component difference; subtract the second color component value of a pixel in the i-th row and j-th column of the first viewpoint image from the second color component value of the pixel in the i-th row and j-th column of the k-th second viewpoint image to obtain a second color component difference; subtract the third color component value of a pixel in the i-th row and j-th column of the first viewpoint image from the third color component value of the pixel in the i-th row and j-th column of the k-th second viewpoint image to obtain a third color component difference; obtain a grayscale difference based on the first color component difference, the second color component difference, and the third color component difference; when the grayscale difference is less than a threshold difference, the pixel in the i-th row and j-th column of the k-th first image is a black pixel; when the grayscale difference is greater than the threshold difference, the pixel in the i-th row and j-th column of the k-th first image is a white pixel.

[0093] In one exemplary embodiment, the encoding module stores the correspondence between pixel color and pixel color component information. The encoding module obtains the color component information of the pixel in the i-th row and j-th column of the first viewpoint image based on the color of the pixel in the i-th row and j-th column of the first viewpoint image and the correspondence between pixel color and pixel color component information. The encoding module also obtains the color component information of the pixel in the i-th row and j-th column of the second viewpoint image based on the color of the pixel in the i-th row and j-th column of the second viewpoint image and the correspondence between pixel color and pixel color component information.

[0094] In one exemplary embodiment, if the pixel in the i-th row and j-th column of the first image is a white pixel, it indicates that the color difference between the pixel in the i-th row and j-th column of the first viewpoint image and the pixel in the i-th row and j-th column of the second viewpoint image is significant. If the pixel in the i-th row and j-th column of the first image is a black pixel, it indicates that the color difference between the pixel in the i-th row and j-th column of the first viewpoint image and the pixel in the i-th row and j-th column of the second viewpoint image is not significant.

[0095] In one exemplary embodiment, when the colors of the pixels in the i-th row and j-th column of the k-th second viewpoint image are different, the threshold difference used to obtain the k-th first image is different. That is, the judgment of color difference satisfies Weber's law. The threshold difference used to determine whether a pixel in the k-th first image is white or black when the color of the pixel in the i-th row and j-th column of the k-th second viewpoint image is the first color is different from the threshold difference used when the color of the pixel in the i-th row and j-th column of the k-th second viewpoint image is the second color. Here, the first color and the second color are different colors.

[0096] Figure 3The example given is that the color of the pixel in the first row and fourth column of the first viewpoint image differs significantly from the color of the pixel in the first row and fourth column of the kth second viewpoint image, and the color of the pixel in the third row and third column of the first viewpoint image differs significantly from the color of the pixel in the third row and third column of the kth second viewpoint image. In this case, the pixels in the first row and fourth column and the third row and third column of the kth first image are white pixels.

[0097] Figure 4 A schematic diagram of obtaining an encoded image provided as an exemplary embodiment. Figure 4 This explanation uses M=5 and N=5 as an example. Figure 4 As shown, in an exemplary embodiment, the encoding module is configured to use the first row of pixels in the first viewpoint map as the first row of pixels in each encoded image; scan the first row of pixels in the kth first image; when there are no white pixels in the first row of pixels in the kth first image, select the next row of pixels in the first viewpoint map as the next row of pixels in the kth encoded image; when there are white pixels in the first row of pixels in the kth first image, obtain the position information of the white pixels and the information of the pixels corresponding to the white pixels in the kth second viewpoint map, and store the position information of the white pixels and the information of the pixels corresponding to the white pixels in the kth second viewpoint map in the two adjacent pixels of the next row of pixels in the kth encoded image, and sequentially scan the r-th row of pixels in the first image corresponding to the kth second viewpoint map until the last row of pixels in the first image corresponding to the kth second viewpoint map is scanned to obtain the kth encoded image, 2≤r≤M.

[0098] like Figure 4As shown, in the k-th first image, there is one white pixel in the first row of pixels. Based on the location information of the white pixel (i.e., the first row, fourth column, and the color component information of the pixel corresponding to the white pixel in the second viewpoint image), the location information of the white pixel and the information of the pixel corresponding to the white pixel in the k-th second viewpoint image are stored in the first and second pixels of the second row of pixels in the encoded image corresponding to the second viewpoint image. When there are multiple white pixels in the first row, the location information of the ith white pixel and the information of the pixel corresponding to the white pixel in the k-th second viewpoint image are stored in the (2i-1)th and 2ith pixels of the second row of pixels in the k-th encoded image. That is, the location information of the first white pixel and the information of the pixel corresponding to the white pixel in the k-th second viewpoint image are stored in the first and second pixels of the second row of pixels in the k-th encoded image, the location information of the second white pixel and the information of the pixel corresponding to the white pixel in the k-th second viewpoint image are stored in the third and fourth pixels of the second row of pixels in the k-th encoded image, and so on. At this point, the other pixels in the second row of pixels in the k-th encoded image can be white pixels.

[0099] The encoding method disclosed herein can effectively maintain image quality.

[0100] In one exemplary embodiment, the location information may include the row and column number of the white pixel in the first image.

[0101] In one exemplary embodiment, the pixel corresponding to the white pixel in the second viewpoint image is the pixel in the second viewpoint image located at the same row and column number as the white pixel in the first image.

[0102] Figure 5 This is a schematic diagram of the structure of a display device provided for an exemplary embodiment. (See diagram below.) Figure 5 As shown, in one exemplary embodiment, the display device 20 may include a decoding module 21 and a display module 22. The decoding module 21 is configured to receive multiple encoded images and obtain M display information based on the multiple encoded images; the display module 22 is configured to receive the M display information and perform stereoscopic display based on the M display information.

[0103] In one exemplary embodiment, the decoding module is further configured to obtain K-1 second viewpoint maps corresponding to K-1 encoded images based on K-1 encoded images, wherein the k-th second viewpoint map is obtained based on the k-th encoded image; and to obtain M display information based on the first viewpoint map and the K-1 second viewpoint maps.

[0104] Figure 6This is a schematic diagram illustrating the decoding of an encoded image, provided as an exemplary embodiment. Figure 6 As shown, in an exemplary embodiment, the decoding module is configured to use the first row of pixels of the kth encoded image as the first row of pixels of the kth second viewpoint image, scan the next row of pixels of the kth encoded image, if the second row of pixels includes position information, then obtain the information stored in the adjacent pixels of the pixel including the position information, update the information of the pixel located at the position information in the kth second viewpoint image, and update it with the information stored in the adjacent pixels of the pixel including the position information; if the next row of pixels does not include position information, then use the next row of pixels of the kth encoded image as the next row of pixels of the kth second viewpoint image, and scan the rth row of pixels of the kth encoded image sequentially until the last row of pixels of the kth encoded image is scanned to obtain the kth second viewpoint image.

[0105] In one exemplary embodiment, the decoding module is configured to obtain the i-th row of pixels of K viewpoint images based on the first viewpoint image and K-1 second viewpoint images; and to obtain M display information based on the first row of pixels to the M-th row of pixels of the K viewpoint images.

[0106] In one exemplary embodiment, the display module is configured to display the i-th row of K viewpoint images based on the i-th display information.

[0107] This disclosure allows the display module to display the i-th row of K viewpoint images row by row, which reduces the storage space required during decoding and facilitates faster display.

[0108] The encoding and decoding method disclosed herein can not only achieve lossless viewpoint images, but is also simple, easy to implement, and easy to make intelligent.

[0109] Figure 7 This is a schematic diagram illustrating the encoding of a processing apparatus provided for an exemplary embodiment. (See diagram below.) Figure 7 As shown, in one exemplary embodiment, the encoding module is configured to sequentially extract the i-th row of pixels from each viewpoint image to form M second images; and to encode the M second images to generate M encoded images. Figure 7 In this context, Viewi represents the image at the i-th viewpoint.

[0110] In one exemplary embodiment, each second image includes: K rows and N columns of pixels, where the nth row of the i-th second image is the i-th row of the n-th viewpoint image, and n = 1, 2, ..., K.

[0111] In one exemplary embodiment, the M second images can be encoded using Huffman coding, run-length coding, or orthogonal transform coding. This disclosure employs Huffman coding, run-length coding, or orthogonal transform coding, resulting in a higher compression ratio between the encoded image and the second images, and the technology is relatively mature.

[0112] Figure 8 This is a schematic diagram illustrating the encoding of a display device according to an exemplary embodiment. (See diagram below.) Figure 8 As shown, in an exemplary embodiment, the display device is configured to sequentially decode M encoded images to obtain M second images, wherein the i-th second image includes i-th display information; and display the i-th row of K viewpoint images based on the i-th second image.

[0113] This disclosure displays the i-th row of K viewpoint images line by line, and processes one row of the viewpoint image, which can save storage space.

[0114] This disclosure also provides an image processing method applied to a multi-view image processing system. The image processing method provided in this disclosure may include the following steps:

[0115] Step S1: Obtain K viewpoint images.

[0116] In one exemplary embodiment, the viewpoint image includes: M rows and N columns of pixels; K is a positive integer greater than or equal to 2, and M and N are positive integers greater than or equal to 1.

[0117] Step S2: Receive K viewpoint images, encode the K viewpoint images to generate multiple encoded images, and send the multiple encoded images to the display device.

[0118] Step S3: Receive multiple encoded images and obtain M display information based on the multiple encoded images.

[0119] In one exemplary embodiment, the i-th display information includes: the i-th row of pixels in K viewpoint images, i = 1, 2, ..., M.

[0120] Step S4: Perform a 3D display based on the M display information.

[0121] The multi-view image processing system is the same as the multi-view image processing system provided in any of the foregoing embodiments. The implementation principle and effect are similar, and will not be described again here.

[0122] In one exemplary embodiment, acquiring K viewpoint images includes: acquiring an image to be displayed, acquiring K viewpoint images based on the image to be displayed, or acquiring K viewpoint images obtained by a multi-viewpoint acquisition device.

[0123] In one exemplary embodiment, encoding K viewpoint images to generate multiple encoded images includes: selecting the m-th viewpoint image from the K viewpoint images as a first viewpoint image, and all viewpoint images other than the m-th viewpoint image as second viewpoint images, wherein the number of second viewpoint images is K-1, 1≤m≤K; obtaining K-1 first images based on the first viewpoint images and K-1 second viewpoint images, wherein the k-th first image is obtained based on the first viewpoint image and the k-th second viewpoint image, k=1,2,…,K-1; obtaining K-1 encoded images based on the first viewpoint image, K-1 second viewpoint images, and K-1 first images, wherein the k-th encoded image is obtained based on the first viewpoint image, the k-th second viewpoint image, and the k-th first image; and sending the K-1 encoded images and the first viewpoint images, wherein both the first images and the encoded images include M rows and N columns of pixels.

[0124] In one exemplary embodiment, obtaining K-1 first images based on a first viewpoint map and K-1 second viewpoint maps includes: obtaining information about the i-th row and j-th column of the k-th first image based on information about the i-th row and j-th column of the first viewpoint map and information about the i-th row and j-th column of the k-th second viewpoint map; and obtaining the k-th first image, j = 1, 2, ..., N, based on information about all pixels of the k-th first image.

[0125] In one exemplary embodiment, the information of a pixel may include color component information, color voltage information, or other possible data information, which are not limited in this disclosure.

[0126] In one exemplary embodiment, the color component information may include: a first color component value, a second color component value, and a third color component value. The color voltage information may include: a first color voltage value, a second color voltage value, and a third color voltage value. The first color, the second color, and the third color are each one of red, green, and blue, and are different colors.

[0127] In one exemplary embodiment, when the pixel information includes color component information, obtaining the information of the pixel in the i-th row and j-th column of the first image based on the information of the pixel in the i-th row and j-th column of the first viewpoint image and the information of the pixel in the i-th row and j-th column of the k-th second viewpoint image includes: obtaining the grayscale value of the pixel in the i-th row and j-th column of the first viewpoint image based on the color component information of the pixel in the i-th row and j-th column of the first viewpoint image; and obtaining the grayscale value of the pixel in the i-th row and j-th column of the k-th second viewpoint image based on the color component information of the pixel in the i-th row and j-th column of the k-th second viewpoint image. The grayscale values ​​of the pixels in the i-th row and j-th column of the k second viewpoint images are considered. When the difference between the grayscale value of the pixel in the i-th row and j-th column of the first viewpoint image and the grayscale value of the pixel in the i-th row and j-th column of the kth second viewpoint image is less than a threshold difference, the pixel in the i-th row and j-th column of the kth first image is a black pixel. When the difference between the grayscale value of the pixel in the i-th row and j-th column of the first viewpoint image and the grayscale value of the pixel in the i-th row and j-th column of the kth second viewpoint image is greater than a threshold difference, the pixel in the i-th row and j-th column of the kth first image is a white pixel.

[0128] In one exemplary embodiment, when the pixel information includes color component information, obtaining the information of the pixel in the i-th row and j-th column of the k-th first image based on the information of the pixel in the i-th row and j-th column of the first viewpoint image and the information of the pixel in the i-th row and j-th column of the k-th second viewpoint image includes: subtracting the first color component value of the pixel in the i-th row and j-th column of the first viewpoint image from the first color component value of the pixel in the i-th row and j-th column of the k-th second viewpoint image to obtain a first color component difference value; and subtracting the second color component value of the pixel in the i-th row and j-th column of the first viewpoint image from the second color component value of the pixel in the i-th row and j-th column of the k-th second viewpoint image. The second color component value of a pixel is subtracted to obtain the second color component difference value; the third color component value of the pixel in the i-th row and j-th column of the first viewpoint image is subtracted from the third color component value of the pixel in the i-th row and j-th column of the k-th second viewpoint image to obtain the third color component difference value; the grayscale difference value is obtained based on the first color component difference value, the second color component difference value, and the third color component difference value; when the grayscale difference value is less than the threshold difference value, the pixel in the i-th row and j-th column of the k-th first image is a black pixel, and when the grayscale difference value is greater than the threshold difference value, the pixel in the i-th row and j-th column of the k-th first image is a white pixel.

[0129] In one exemplary embodiment, when the colors of the pixels in the i-th row and j-th column of the k-th second viewpoint image are different, the threshold difference when obtaining the k-th first image is different.

[0130] In one exemplary embodiment, obtaining K-1 encoded images based on a first viewpoint map, K-1 second viewpoint maps, and K-1 first images includes: using the first row of pixels in the first viewpoint map as the first row of pixels in each encoded image; scanning the first row of pixels in the kth first image; when there are no white pixels in the first row of pixels in the kth first image, selecting the next row of pixels in the first viewpoint map as the next row of pixels in the kth encoded image; when there are white pixels in the first row of pixels in the kth first image, obtaining the position information of the white pixels and the information of the pixels corresponding to the white pixels in the kth second viewpoint map, and storing the position information of the white pixels and the information of the pixels corresponding to the white pixels in the second viewpoint map in the two adjacent pixels of the next row of pixels in the kth encoded image, and sequentially scanning the r-th row of pixels in the kth first image until the last row of pixels in the kth first image is scanned to obtain the kth encoded image, where 2≤r≤M.

[0131] In one exemplary embodiment, the location information may include the row and column number of the white pixel in the first image.

[0132] In one exemplary embodiment, the pixel corresponding to the white pixel in the second viewpoint image is the pixel in the second viewpoint image located at the same row and column number as the white pixel in the first image.

[0133] In one exemplary embodiment, obtaining M display information based on multiple coded images includes: obtaining K-1 second viewpoint maps based on K-1 coded images; and obtaining M display information based on the first viewpoint map and the K-1 second viewpoint maps.

[0134] In one exemplary embodiment, the kth second viewpoint map is obtained based on the kth coded image.

[0135] In one exemplary embodiment, obtaining a K-1 second viewpoint map based on K-1 coded images includes: using the first row of pixels of the k-th coded image as the first row of pixels of the k-th second viewpoint map; scanning the next row of pixels of the k-th coded image; if the next row of pixels includes position information, obtaining the information stored in the adjacent pixels of the pixel including the position information; updating the information of the pixel in the k-th second viewpoint map located at the position information, updating it to the information stored in the adjacent pixels of the pixel including the position information; if the next row of pixels does not include position information, using the next row of pixels of the k-th coded image as the next row of pixels of the k-th second viewpoint map; sequentially scanning the r-th row of pixels of the k-th coded image until the last row of pixels of the k-th coded image is scanned, thereby obtaining the k-th second viewpoint map.

[0136] In one exemplary embodiment, obtaining M display information of K viewpoint images based on a first viewpoint image and K-1 second viewpoint images includes: sequentially obtaining the i-th row of pixels of the K viewpoint images; and obtaining M display information based on the first row of pixels to the M-th row of pixels of the K viewpoint images.

[0137] In one exemplary embodiment, stereoscopic display based on M display information includes: displaying the i-th row of K viewpoint images based on the i-th display information.

[0138] In one exemplary embodiment, encoding K viewpoint images to generate multiple encoded images includes: sequentially extracting the i-th row of pixels from each viewpoint image to form M second images, and encoding the M second images to generate M encoded images.

[0139] In one exemplary embodiment, each second image includes: K rows and N columns of pixels, where the nth row of the i-th second image is the i-th row of the n-th viewpoint image, and n = 1, 2, ..., K.

[0140] In one exemplary embodiment, obtaining M display information of K viewpoint images based on multiple encoded images includes: sequentially decoding the M encoded images to obtain M second images, wherein the i-th second image includes the i-th display information; and displaying the i-th row of the K viewpoint images based on the i-th second image.

[0141] Those skilled in the art should understand that modifications or equivalent substitutions can be made to the technical solutions of the embodiments of this disclosure without departing from the spirit and scope of the technical solutions of this disclosure, and all such modifications and substitutions should be covered within the scope of the claims of this application.

[0142] It will be understood by those skilled in the art that all or some of the steps, systems, or apparatuses disclosed above, and their functional modules / units, can be implemented as software, firmware, hardware, or suitable combinations thereof. In hardware implementations, the division between functional modules / units mentioned above does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed collaboratively by several physical components. Some or all components may be implemented as software executed by a processor, such as a digital signal processor or microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit (ASIC). Such software may be distributed on a computer-readable medium, which may include computer storage media (or non-transitory media) and communication media (or transient media). As is known to those skilled in the art, the term computer storage media includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disc (DVD) or other optical disc storage, magnetic cartridges, magnetic tape, disk storage or other magnetic storage devices, or any other medium that can be used to store desired information and can be accessed by a computer. Furthermore, it is well known to those skilled in the art that communication media typically contain computer-readable instructions, data structures, program modules, or other data in modulated data signals such as carrier waves or other transmission mechanisms, and may include any information delivery medium.

[0143] The accompanying drawings in this disclosure only relate to the structures involved in the embodiments of this disclosure; other structures can be referred to in general design.

[0144] While the embodiments disclosed herein are as described above, the content is merely for the purpose of facilitating understanding of this disclosure and is not intended to limit this disclosure. Any person skilled in the art to which this disclosure pertains may make any modifications and changes in the form and details of the implementation without departing from the spirit and scope disclosed herein; however, the scope of patent protection of this disclosure shall still be determined by the scope defined in the appended claims.

Claims

1. A multi-view image processing system, comprising: Processing device and display device; The processing device includes: an acquisition module and an encoding module; The acquisition module is configured to acquire K viewpoint images, wherein the viewpoint images comprise: M rows and N columns of pixels, where K is a positive integer greater than or equal to 2, and M and N are positive integers greater than or equal to 1; The encoding module is configured to receive K viewpoint images, encode the K viewpoint images to generate multiple encoded images, and send the multiple encoded images to the display device. Specifically, the encoding module is configured to select the m-th viewpoint image from the K viewpoint images as the first viewpoint image, and all viewpoint images other than the m-th viewpoint image as the second viewpoint images. The number of second viewpoint images is K-1. m K; Based on the first viewpoint map and K-1 second viewpoint maps, obtain K-1 first images, wherein the k-th first image is obtained based on the first viewpoint map and the k-th second viewpoint map, k=1,2,…,K-1; Based on the first viewpoint map, K-1 second viewpoint maps, and K-1 first images, obtain K-1 encoded images, wherein the k-th encoded image is obtained based on the first viewpoint map, the k-th second viewpoint map, and the k-th first image; Send the K-1 encoded images and the first viewpoint map; Both the first image and the encoded image include: M rows and N columns of pixels; The display device is configured to receive multiple encoded images, obtain M display information based on the multiple encoded images, wherein the i-th display information includes: the i-th row of pixels in K viewpoint images, i=1,2,…,M; and perform stereoscopic display based on the M display information. The processing device is disposed in the display device, or the processing device and the display device are disposed separately.

2. The system according to claim 1, wherein, The acquisition module is configured to acquire an image to be displayed, and based on the image to be displayed, acquire K viewpoint images.

3. The system according to claim 1, further comprising: A multi-viewpoint acquisition device, comprising: multiple CCD cameras, each CCD camera in the multi-viewpoint acquisition device performing dynamic scene acquisition to obtain K viewpoint images; The acquisition module is configured to receive K viewpoint images obtained by the multi-viewpoint acquisition device.

4. The system according to claim 1, wherein, The encoding module is further configured to obtain the information of the pixel in the i-th row and j-th column of the k-th first image based on the information of the pixel in the i-th row and j-th column of the first viewpoint image and the information of the pixel in the i-th row and j-th column of the k-th second viewpoint image; and to obtain the k-th first image based on the information of all pixels in the k-th first image, where j=1,2,…,N.

5. The system according to claim 4, wherein, The information of the pixel includes: color component information, which includes: a first color component value, a second color component value, and a third color component value, wherein the first color, the second color, and the third color are respectively one of red, green, and blue, and are different colors; The encoding module is further configured to obtain the grayscale value of the pixel in the i-th row and j-th column of the first viewpoint image based on the color component information of the pixel in the i-th row and j-th column of the first viewpoint image; and to obtain the grayscale value of the pixel in the i-th row and j-th column of the k-th second viewpoint image based on the color component information of the pixel in the i-th row and j-th column of the k-th second viewpoint image; when the difference between the grayscale value of the pixel in the i-th row and j-th column of the first viewpoint image and the grayscale value of the pixel in the i-th row and j-th column of the k-th second viewpoint image is less than a threshold difference, the pixel in the i-th row and j-th column of the k-th first image is a black pixel; when the difference between the grayscale value of the pixel in the i-th row and j-th column of the first viewpoint image and the grayscale value of the pixel in the i-th row and j-th column of the k-th second viewpoint image is greater than a threshold difference, the pixel in the i-th row and j-th column of the k-th first image is a white pixel; Alternatively, the encoding module is further configured to: subtract the first color component value of the pixel in the i-th row and j-th column of the first viewpoint image from the first color component value of the pixel in the i-th row and j-th column of the k-th second viewpoint image to obtain a first color component difference value; subtract the second color component value of the pixel in the i-th row and j-th column of the first viewpoint image from the second color component value of the pixel in the i-th row and j-th column of the k-th second viewpoint image to obtain a second color component difference value; subtract the third color component value of the pixel in the i-th row and j-th column of the first viewpoint image from the third color component value of the pixel in the i-th row and j-th column of the k-th second viewpoint image to obtain a third color component difference value; obtain a grayscale difference value based on the first color component difference value, the second color component difference value, and the third color component difference value; when the grayscale difference value is less than a threshold difference value, the pixel in the i-th row and j-th column of the k-th first image is a black pixel; when the grayscale difference value is greater than the threshold difference value, the pixel in the i-th row and j-th column of the k-th first image is a white pixel; When the colors of the pixels in the i-th row and j-th column of the k-th second viewpoint image are different, the threshold difference will be different when obtaining the k-th first image.

6. The system according to claim 4 or 5, wherein, The encoding module is further configured to use the first row of pixels in the first viewpoint image as the first row of pixels in each encoded image; scan the first row of pixels in the kth first image; when there are no white pixels in the first row of pixels in the kth first image, select the next row of pixels in the first viewpoint image as the next row of pixels in the kth encoded image; when there are white pixels in the first row of pixels in the kth first image, obtain the position information of the white pixels and the information of the pixels corresponding to the white pixels in the kth second viewpoint image, and store the position information of the white pixels and the information of the pixels corresponding to the white pixels in the kth second viewpoint image in the two adjacent pixels of the next row of pixels in the kth encoded image, and sequentially scan the rth row of pixels in the kth first image until the last row of pixels in the kth first image is scanned to obtain the kth encoded image. r M; The location information includes: the row number and column number of the white pixel in the first image, and the pixel corresponding to the white pixel in the second viewpoint image is the pixel in the second viewpoint image located at the row number and column number of the white pixel in the first image.

7. The system according to claim 1, wherein, The display device includes: a decoding module and a display module; The decoding module is configured to receive multiple encoded images and obtain M display information based on the multiple encoded images; The display module is configured to receive M pieces of display information and perform a stereoscopic display based on the M pieces of display information.

8. The system according to claim 7, wherein, The decoding module is further configured to obtain K-1 second viewpoint images based on K-1 encoded images, wherein the kth second viewpoint image is obtained based on the kth encoded image; and to obtain M display information based on the first viewpoint image and K-1 second viewpoint images.

9. The system according to claim 8, wherein, The decoding module is further configured to use the first row of pixels of the kth encoded image as the first row of pixels of the kth second viewpoint image, scan the next row of pixels of the kth encoded image, and if the next row of pixels includes position information, obtain the information of the pixels stored in the adjacent pixels of the pixel containing position information, update the information of the pixel located at the position information in the kth second viewpoint image, and update it to the information of the pixels stored in the adjacent pixels of the pixel containing position information. If the next row of pixels does not contain position information, then the next row of pixels of the kth coded image is taken as the next row of pixels of the kth second viewpoint image. The rth row of pixels of the kth coded image is scanned sequentially until the last row of pixels of the kth coded image is scanned, thus obtaining the kth second viewpoint image.

10. The system according to claim 7, wherein, The decoding module is configured to obtain the i-th row of pixels in K viewpoint images based on the first viewpoint image and K-1 second viewpoint images; and to obtain M display information based on the first row of pixels to the M-th row of pixels in the K viewpoint images. The display module is configured to display the i-th row of K viewpoint images based on the i-th display information.

11. The system according to claim 1, wherein, The encoding module is configured to extract the i-th row of pixels from each viewpoint image sequentially to form M second images. Each second image includes K rows and N columns of pixels, and the n-th row of pixels in the i-th second image is the i-th row of pixels in the n-th viewpoint image, n=1,2,…,K. The M second images are then encoded to generate M encoded images.

12. The system according to claim 11, wherein, The display device is configured to decode M encoded images sequentially to obtain M second images, wherein the i-th second image includes the i-th display information; and display the i-th row of K viewpoint images based on the i-th second image.

13. An image processing method, the method comprising: Obtain K viewpoint images, wherein each viewpoint image comprises M rows and N columns of pixels, where K is a positive integer greater than or equal to 2, and M and N are positive integers greater than or equal to 1; The system receives K viewpoint images, encodes the K viewpoint images to generate multiple encoded images, and sends the multiple encoded images to a display device. The encoding of the K viewpoint images to generate multiple encoded images includes: selecting the m-th viewpoint image from the K viewpoint images as a first viewpoint image, and using all viewpoint images other than the m-th viewpoint image as second viewpoint images, wherein the number of second viewpoint images is K-1. m K; Based on the first viewpoint map and K-1 second viewpoint maps, obtain K-1 first images, wherein the k-th first image is obtained based on the first viewpoint map and the k-th second viewpoint map, k=1,2,…,K-1; Based on the first viewpoint map, K-1 second viewpoint maps, and K-1 first images, obtain K-1 encoded images, wherein the k-th encoded image is obtained based on the first viewpoint map, the k-th second viewpoint map, and the k-th first image; Send the K-1 encoded images and the first viewpoint map, wherein both the first image and the encoded image include: M rows and N columns of pixels; Receive multiple encoded images, and obtain M display information based on the multiple encoded images. The i-th display information includes: the i-th row of pixels in K viewpoint images, i=1,2,…,M; A 3D display is generated based on M pieces of information.

14. The method according to claim 13, wherein, The acquisition of K viewpoint images includes: acquiring an image to be displayed, and acquiring K viewpoint images based on the image to be displayed, or acquiring K viewpoint images obtained by a multi-viewpoint acquisition device.

15. The method according to claim 13, wherein, The step of obtaining K-1 first images based on the first viewpoint image and K-1 second viewpoint images includes: obtaining the information of the pixel in the i-th row and j-th column of the k-th first image based on the information of the pixel in the i-th row and j-th column of the first viewpoint image and the information of the pixel in the i-th row and j-th column of the k-th second viewpoint image; and obtaining the k-th first image, j=1,2,…,N, based on the information of all pixels in the k-th first image. The information of the pixel includes: color component information, which includes: a first color component value, a second color component value, and a third color component value, wherein the first color, the second color, and the third color are respectively one of red, green, and blue, and are different colors; The step of obtaining the information of the pixel in the i-th row and j-th column of the k-th first image based on the information of the pixel in the i-th row and j-th column of the first viewpoint image and the information of the pixel in the i-th row and j-th column of the k-th second viewpoint image includes: Based on the color component information of the pixel in the i-th row and j-th column of the first viewpoint image, the grayscale value of the pixel in the i-th row and j-th column of the first viewpoint image is obtained; based on the color component information of the pixel in the i-th row and j-th column of the k-th second viewpoint image, the grayscale value of the pixel in the i-th row and j-th column of the k-th second viewpoint image is obtained; when the difference between the grayscale value of the pixel in the i-th row and j-th column of the first viewpoint image and the grayscale value of the pixel in the i-th row and j-th column of the k-th second viewpoint image is less than a threshold difference, the pixel in the i-th row and j-th column of the k-th first image is a black pixel; when the difference between the grayscale value of the pixel in the i-th row and j-th column of the first viewpoint image and the grayscale value of the pixel in the i-th row and j-th column of the k-th second viewpoint image is greater than a threshold difference, the pixel in the i-th row and j-th column of the k-th first image is a white pixel; Alternatively, the difference between the first color component value of the pixel in the i-th row and j-th column of the first viewpoint image and the first color component value of the pixel in the i-th row and j-th column of the k-th second viewpoint image is obtained to get the first color component difference value; the difference between the second color component value of the pixel in the i-th row and j-th column of the first viewpoint image and the second color component value of the pixel in the i-th row and j-th column of the k-th second viewpoint image is obtained to get the second color component difference value; the difference between the third color component value of the pixel in the i-th row and j-th column of the first viewpoint image and the third color component value of the pixel in the i-th row and j-th column of the k-th second viewpoint image is obtained to get the third color component difference value; a grayscale difference value is obtained based on the first color component difference value, the second color component difference value, and the third color component difference value; when the grayscale difference value is less than a threshold difference value, the pixel in the i-th row and j-th column of the k-th first image is a black pixel, and when the grayscale difference value is greater than the threshold difference value, the pixel in the i-th row and j-th column of the k-th first image is a white pixel; When the colors of the pixels in the i-th row and j-th column of the k-th second viewpoint image are different, the threshold difference will be different when obtaining the k-th first image. The step of obtaining K-1 encoded images based on a first viewpoint image, K-1 second viewpoint images, and K-1 first images includes: using the first row of pixels in the first viewpoint image as the first row of pixels in each encoded image; scanning the first row of pixels in the k-th first image; when there are no white pixels in the first row of pixels in the k-th first image, selecting the next row of pixels in the first viewpoint image as the next row of pixels in the k-th encoded image; when there are white pixels in the first row of pixels in the k-th first image, obtaining the position information of the white pixels and the information of the pixels corresponding to the white pixels in the k-th second viewpoint image, and storing the position information of the white pixels and the information of the pixels corresponding to the white pixels in the second viewpoint image in the two adjacent pixels of the next row of pixels in the k-th encoded image, and sequentially scanning the r-th row of pixels in the k-th first image until the last row of pixels in the k-th first image is scanned to obtain the k-th encoded image. r M; The location information includes: the row number and column number of the white pixel in the first image, and the pixel corresponding to the white pixel in the second viewpoint image is the pixel in the second viewpoint image located at the row number and column number of the white pixel in the first image.

16. The method according to claim 13, wherein, The step of obtaining M display information based on multiple coded images includes: obtaining K-1 second viewpoint images based on K-1 coded images, wherein the k-th second viewpoint image is obtained based on the k-th coded image; and obtaining M display information based on the first viewpoint image and the K-1 second viewpoint images. The step of obtaining the K-1 second viewpoint map based on K-1 coded images includes: using the first row of pixels of the k-th coded image as the first row of pixels of the k-th second viewpoint map; scanning the next row of pixels of the k-th coded image; if the next row of pixels includes position information, obtaining the information of pixels stored in the adjacent pixels of the pixel including position information; updating the information of the pixel located at the position information in the k-th second viewpoint map to the information of pixels stored in the adjacent pixels of the pixel including position information; if the next row of pixels does not include position information, using the next row of pixels of the k-th coded image as the next row of pixels of the k-th second viewpoint map; and sequentially scanning the r-th row of pixels of the k-th coded image until the last row of pixels of the k-th coded image is scanned to obtain the k-th second viewpoint map. The step of obtaining M display information from K viewpoint images based on the first viewpoint image and K-1 second viewpoint images includes: sequentially obtaining the i-th row of pixels in the K viewpoint images; and obtaining M display information based on the first row of pixels to the M-th row of pixels in the K viewpoint images. The stereoscopic display based on M display information includes: displaying the i-th row of K viewpoint images based on the i-th display information.

17. The method according to claim 13, wherein, The step of encoding K viewpoint images to generate multiple encoded images includes: sequentially extracting the i-th row of pixels from each viewpoint image to form M second images, each second image including: K rows and N columns of pixels, the n-th row of pixels of the i-th second image being the i-th row of pixels of the n-th viewpoint image, n=1,2,…,K; and encoding the M second images to generate M encoded images.

18. The method according to claim 13, wherein, The step of obtaining M display information from K viewpoint images based on multiple encoded images includes: sequentially decoding the M encoded images to obtain M second images, the i-th second image including the i-th display information; and displaying the i-th row of the K viewpoint images based on the i-th second image.

Images