SYSTEMS AND METHODS FOR PROCESSING MULTI-POINT OBSERVATION IMAGES

Abstract

The invention relates to a multi-point image processing system and a method. The multi-point image processing system comprises a processing device and a display device. The processing device comprises an acquisition module and an encoding module, wherein the acquisition module is configured to acquire K point images, each point image consisting of M rows and N columns of pixels, where K is a positive integer greater than or equal to 2, and M and N are positive integers greater than or equal to 1; and the encoding module is configured to receive K point images, to encode K point images, to generate encoded images, and to send encoded images to the display device. The display device is configured to receive the encoded images, and to acquire M segments of information according to the encoded images, wherein the i-th display segment comprises the i-th row of pixels of the K point images, where i = 1, 2, ..., M; The display device is also configured to perform stereoscopic display of M segments of information.The processing unit is either integrated into the display unit, or the processing unit and display unit are housed separately.

Description

Multi-view image processing system and method thereof Technical Field

[0001] The embodiments of the present disclosure relate to, but are not limited to, the field of image processing technology, and more particularly to a multi-viewpoint image processing system and method thereof. Background Art

[0002] Stereoscopic imaging is one of the hottest technologies in the video industry, driving the technological shift from flat-screen displays to stereoscopic displays. Stereoscopic display technology, a key component of the 3D imaging industry, is primarily categorized into two types: eye-guided stereo and naked-eye stereo. Naked-eye stereo technology allows viewers to directly view 3D images without wearing glasses. Compared to eye-guided stereo, naked-eye stereo is a self-contained stereo technology, placing fewer constraints on the viewer.

[0003] Typically, autostereoscopic displays are based on multiple viewpoints, forming a sequence of parallax images (frames) at different locations in space. This allows a pair of stereoscopic images with parallax relationships to appear in each eye, creating a sense of 3D. This is typically achieved using a multi-view autostereoscopic display.

[0004] SUMMARY OF THE INVENTION

[0005] The following is an overview of the subject matter described in detail in this disclosure. This overview is not intended to limit the scope of the claims.

[0006] In a first aspect, the present disclosure provides a multi-view image processing system, comprising: a processing device and a display device; the processing device comprises: an acquisition module and an encoding module;

[0007] The acquisition module is configured to acquire K viewpoint images, wherein the viewpoint images include: M rows and N columns of pixels, K is a positive integer greater than or equal to 2, and M and N are positive integers greater than or equal to 1;

[0008] The encoding module is configured to receive K viewpoint images, encode the K viewpoint images to generate a plurality of encoded images, and send the plurality of encoded images to the display device;

[0009] The display device is configured to receive a plurality of coded images, obtain M display information based on the plurality of coded images, wherein the i-th display information includes: pixel points in the i-th row of K viewpoint images, where i=1, 2, ..., M; and perform stereoscopic display based on the M display information;

[0010] The processing device is provided in the display device, or the processing device and the display device are provided separately.

[0011] In a possible implementation, the acquisition module is configured to acquire an image to be displayed, and acquire K viewpoint images based on the image to be displayed.

[0012] In a possible implementation, the system further includes: a multi-viewpoint acquisition device, wherein the multi-viewpoint acquisition device includes: a plurality of CCD cameras, wherein each CCD camera in the multi-viewpoint acquisition device acquires a dynamic scene to obtain K viewpoint images;

[0013] The acquisition module is configured to receive K viewpoint images obtained by a multi-viewpoint acquisition device.

[0014] In one possible implementation, the encoding module is configured to select the mth viewpoint image from K viewpoint images as the first viewpoint image, and all viewpoint images except the mth viewpoint image as the second viewpoint image, the number of the second viewpoint images is K-1, 1≤m≤K; based on the first viewpoint image and K-1 second viewpoint images, K-1 first images are obtained, wherein the kth first image is obtained based on the first viewpoint image and the kth second viewpoint image, k=1,2,…,K-1; based on the first viewpoint image, K-1 second viewpoint images and K-1 first images, K-1 coded images are obtained, wherein the kth coded image is obtained based on the first viewpoint image, the kth second viewpoint image and the kth first image; K-1 coded images and the first viewpoint image are sent; the first image and the coded image both include: M rows and N columns of pixels.

[0015] In one possible implementation, the encoding module is further configured to obtain information of the pixel point in the i-th row and j-th column of the k-th first image based on information of the pixel point in the i-th row and j-th column of the first view image and information of the pixel point in the i-th row and j-th column of the k-th second view image; and obtain the k-th first image based on information of all pixels of the k-th first image, where j = 1, 2,…, N.

[0016] In a possible implementation, the pixel information includes: color component information, the color component information including: a first color component value, a second color component value, and a third color component value, where the first color, the second color, and the third color are respectively one of red, green, and blue, and are different colors;

[0017] The encoding module is further configured to obtain a grayscale value of a pixel in the i-th row and j-th column of the first view image based on the color component information of the pixel in the i-th row and j-th column of the first view image; and obtain a grayscale value of a pixel in the i-th row and j-th column of the k-th second view image based on the color component information of the pixel in the i-th row and j-th column of the k-th second view image; when the difference between the grayscale value of the pixel in the i-th row and j-th column of the first view image and the grayscale value of the pixel in the i-th row and j-th column of the k-th second view image is less than a threshold difference, the pixel in the i-th row and j-th column of the k-th first image is a black pixel; and when the difference between the grayscale value of the pixel in the i-th row and j-th column of the first view image and the grayscale value of the pixel in the i-th row and j-th column of the k-th second view image is greater than the threshold difference, the pixel in the i-th row and j-th column of the k-th first image is a white pixel;

[0018] Alternatively, the encoding module is further configured to perform a subtraction between a first color component value of a pixel in the i-th row and j-th column of the first view image and a first color component value of a pixel in the i-th row and j-th column of the k-th second view image to obtain a first color component difference; perform a subtraction between a second color component value of a pixel in the i-th row and j-th column of the first view image and a second color component value of a pixel in the i-th row and j-th column of the k-th second view image to obtain a second color component difference; perform a subtraction between a third color component value of a pixel in the i-th row and j-th column of the first view image and a third color component value of a pixel in the i-th row and j-th column of the k-th second view image to obtain a third color component difference; and perform a grayscale difference according to the first color component difference, the second color component difference, and the third color component difference; when the grayscale difference is less than a threshold difference, the pixel in the i-th row and j-th column of the k-th first image is a black pixel; and when the grayscale difference is greater than the threshold difference, the pixel in the i-th row and j-th column of the k-th first image is a white pixel.

[0019] When the colors of the pixels in the i-th row and the j-th column of the k-th second view image are different, the threshold difference values ​​when obtaining the k-th first image are different.

[0020] In a possible implementation, the encoding module is further configured to use the first row of pixels of the first view image as the first row of pixels of each encoded image; scan the first row of pixels of the kth first image; when there are no white pixels in the first row of pixels of the kth first image, select the next row of pixels of the first view image as the next row of pixels of the kth encoded image; when there are white pixels in the first row of pixels of the kth first image, obtain the position information of the white pixels and the information of the pixels corresponding to the white pixels in the kth second view image, and convert the white pixels into the pixels of the kth second view image. The position information and the information of the pixel corresponding to the white pixel in the k-th second viewpoint image are stored in two adjacent pixel points of the next row of pixels in the k-th encoded image, and the r-th row of pixels of the k-th first image are scanned in sequence until the scanning of the last row of pixels of the k-th first image is completed to obtain the k-th encoded image, 2≤r≤M; the position information includes: the row number and column number of the white pixel in the first image, and the pixel corresponding to the white pixel in the second viewpoint image is the pixel in the second viewpoint image located at the row number and column number of the white pixel in the first image.

[0021] In a possible implementation, the display device includes: a decoding module and a display module;

[0022] The decoding module is configured to receive a plurality of coded images and obtain M display information according to the plurality of coded images;

[0023] The display module is configured to receive M display information and perform stereoscopic display according to the M display information.

[0024] In one possible implementation, the decoding module is further configured to obtain K-1 second viewpoint images based on K-1 encoded images, wherein the kth second viewpoint image is obtained based on the kth encoded image; and M display information is obtained based on the first viewpoint image and the K-1 second viewpoint images.

[0025] In one possible implementation, the decoding module is further configured to use the first row of pixels of the k-th encoded image as the first row of pixels of the k-th second viewpoint image, and scan the next row of pixels of the k-th encoded image. If the next row of pixels includes position information, the information of the pixels stored in the adjacent pixels of the pixels including the position information is obtained, and the information of the pixels located at the position information in the k-th second viewpoint image is updated to the information of the pixels stored in the adjacent pixels of the pixels including the position information; if the next row of pixels does not include position information, the next row of pixels of the k-th encoded image is used as the next row of pixels of the k-th second viewpoint image, and the r-th row of pixels of the k-th encoded image is scanned in sequence until the last row of pixels of the k-th encoded image is scanned to obtain the k-th second viewpoint image.

[0026] In one possible implementation, the decoding module is configured to obtain pixel points in the i-th row of K viewpoint images, where i=1, 2, …, M, based on the first viewpoint image and K-1 second viewpoint images; and obtain M display information based on pixel points in the first row to the M-th row of the K viewpoint images;

[0027] The display module is configured to display the i-th row of K viewpoint images according to the i-th display information.

[0028] In one possible implementation, the encoding module is configured to extract the i-th row of pixels from each viewpoint image in sequence to form M second images, each second image including: K rows and N columns of pixels, the n-th row of pixels of the i-th second image is the i-th row of pixels of the n-th viewpoint image, n = 1, 2,…., K; the M second images are encoded to generate M encoded images.

[0029] In one possible implementation, the display device is configured to decode M encoded images in sequence to obtain M second images, where the i-th second image includes the i-th display information; and display the i-th row of K viewpoint images according to the i-th second image.

[0030] In a second aspect, the present disclosure further provides an image processing method, the method comprising:

[0031] Acquire K viewpoint images, wherein the viewpoint images include: M rows and N columns of pixels, K is a positive integer greater than or equal to 2, and M and N are positive integers greater than or equal to 1;

[0032] receiving K viewpoint images, encoding the K viewpoint images to generate a plurality of encoded images, and sending the plurality of encoded images to a display device;

[0033] Receive multiple coded images, and obtain M display information according to the multiple coded images, where the i-th display information includes: pixel points in the i-th row of K viewpoint images, where i=1, 2, ..., M;

[0034] Stereoscopic display is performed according to the M display information.

[0035] In a possible implementation, acquiring K viewpoint images includes: acquiring an image to be displayed, and acquiring K viewpoint images based on the image to be displayed, or acquiring K viewpoint images obtained by a multi-viewpoint acquisition device.

[0036] In one possible implementation, the encoding of K viewpoint images to generate multiple encoded images includes: selecting the mth viewpoint image from the K viewpoint images as the first viewpoint image, and all viewpoint images except the mth viewpoint image as the second viewpoint image, the number of the second viewpoint images is K-1, 1≤m≤K; obtaining K-1 first images based on the first viewpoint image and K-1 second viewpoint images, wherein the kth first image is obtained based on the first viewpoint image and the kth second viewpoint image, k=1,2,…,K-1; obtaining K-1 encoded images based on the first viewpoint image, K-1 second viewpoint images and K-1 first images, wherein the kth encoded image is obtained based on the first viewpoint image, the kth second viewpoint image and the kth first image; and sending K-1 encoded images and the first viewpoint image, wherein the first image and the encoded image both include: M rows and N columns of pixels.

[0037] In a possible implementation, obtaining K-1 first images according to the first view image and the K-1 second view images includes: obtaining information of the pixel in the i-th row and j-th column of the k-th first image according to information of the pixel in the i-th row and j-th column of the first view image and information of the pixel in the i-th row and j-th column of the k-th second view image; obtaining the k-th first image according to information of all pixels of the k-th first image, where j=1, 2, …, N;

[0038] The pixel information includes: color component information, the color component information includes: a first color component value, a second color component value, and a third color component value, the first color, the second color, and the third color are respectively one of red, green, and blue, and are different colors;

[0039] The obtaining, according to information of a pixel point in the i-th row and j-th column of the first view image and information of a pixel point in the i-th row and j-th column of the k-th second view image, information of a pixel point in the i-th row and j-th column of the k-th first image comprises:

[0040] Obtaining, according to the color component information of the pixel in the i-th row and j-th column of the first view image, a grayscale value of the pixel in the i-th row and j-th column of the first view image; obtaining, according to the color component information of the pixel in the i-th row and j-th column of the k-th second view image, a grayscale value of the pixel in the i-th row and j-th column of the k-th second view image; when the difference between the grayscale value of the pixel in the i-th row and j-th column of the first view image and the grayscale value of the pixel in the i-th row and j-th column of the k-th second view image is less than a threshold difference, the pixel in the i-th row and j-th column of the k-th first image is a black pixel; and when the difference between the grayscale value of the pixel in the i-th row and j-th column of the first view image and the grayscale value of the pixel in the i-th row and j-th column of the k-th second view image is greater than the threshold difference, the pixel in the i-th row and j-th column of the k-th first image is a white pixel;

[0041] Alternatively, a first color component value of the pixel in the i-th row and j-th column of the first view image is subtracted from the first color component value of the pixel in the i-th row and j-th column of the k-th second view image to obtain a first color component difference; a second color component value of the pixel in the i-th row and j-th column of the first view image is subtracted from the second color component value of the pixel in the i-th row and j-th column of the k-th second view image to obtain a second color component difference; a third color component value of the pixel in the i-th row and j-th column of the first view image is subtracted from the third color component value of the pixel in the i-th row and j-th column of the k-th second view image to obtain a third color component difference; a grayscale difference is obtained based on the first color component difference, the second color component difference, and the third color component difference; when the grayscale difference is less than a threshold difference, the pixel in the i-th row and j-th column of the k-th first image is a black pixel, and when the grayscale difference is greater than the threshold difference, the pixel in the i-th row and j-th column of the k-th first image is a white pixel;

[0042] When the colors of the pixels in the i-th row and j-th column of the k-th second view image are different, the threshold difference values ​​when obtaining the k-th first image are different;

[0043] The method of obtaining K-1 coded images according to the first view image, K-1 second view images and K-1 first images includes: using the first row of pixels of the first view image as the first row of pixels of each coded image; scanning the first row of pixels of the k-th first image; when there are no white pixels in the first row of pixels of the k-th first image, selecting the next row of pixels of the first view image as the next row of pixels of the k-th coded image; when there are white pixels in the first row of pixels of the k-th first image, obtaining position information of the white pixels and the pixel points corresponding to the white pixels in the k-th second view image; , and store the position information of the white pixel and the information of the pixel corresponding to the white pixel in the second viewpoint image in two adjacent pixels of the next row of pixels in the k-th encoded image, and scan the r-th row of pixels of the k-th first image in sequence until the scanning of the last row of pixels of the k-th first image is completed to obtain the k-th encoded image, 2≤r≤M; the position information includes: the row number and column number of the white pixel in the first image, and the pixel corresponding to the white pixel in the second viewpoint image is the pixel in the second viewpoint image located at the row number and column number of the white pixel in the first image.

[0044] In a possible implementation, obtaining M display information according to the multiple coded images includes: obtaining K-1 second view images according to K-1 coded images, wherein the k-th second view image is obtained according to the k-th coded image; and obtaining M display information according to the first view image and the K-1 second view images;

[0045] The obtaining of the K-1 second view image according to the K-1 coded images includes: using the first row of pixels of the k-th coded image as the first row of pixels of the k-th second view image, scanning the next row of pixels of the k-th coded image, and if the next row of pixels includes position information, obtaining information of pixels stored in the adjacent pixels of the pixel including the position information, and updating information of the pixels located at the position information in the k-th second view image to information of pixels stored in the adjacent pixels of the pixel including the position information; if the next row of pixels does not include position information, using the next row of pixels of the k-th coded image as the next row of pixels of the k-th second view image, sequentially scanning the r-th row of pixels of the k-th coded image until the last row of pixels of the k-th coded image is scanned, thereby obtaining the k-th second view image;

[0046] The obtaining of M display information of K viewpoint images according to the first viewpoint image and K-1 second viewpoint images comprises: sequentially obtaining pixel points in the i-th row of the K viewpoint images; and obtaining M display information according to pixel points in the first row to the M-th row of the K viewpoint images.

[0047] The performing stereoscopic display according to the M display information includes: displaying the i-th row of the K viewpoint images according to the i-th display information.

[0048] In one possible implementation, encoding K viewpoint images to generate multiple encoded images includes: extracting the i-th row of pixels from each viewpoint image in sequence to form M second images, each second image including: K rows and N columns of pixels, the n-th row of pixels of the i-th second image is the i-th row of pixels of the n-th viewpoint image, n = 1, 2,…, K; encoding the M second images to generate M encoded images.

[0049] In one possible implementation, obtaining M display information of K viewpoint images based on multiple encoded images includes: decoding the M encoded images in sequence to obtain M second images, the i-th second image including the i-th display information; and displaying the i-th row of the K viewpoint images based on the i-th second image.

[0050] Still other aspects will become apparent upon reading and understanding the accompanying drawings and detailed description.

[0051] Summary of the Figures

[0052] The accompanying drawings are used to provide an understanding of the technical solution of the present disclosure and constitute a part of the specification. Together with the embodiments of the present disclosure, they are used to explain the technical solution of the present disclosure and do not constitute a limitation to the technical solution of the present disclosure.

[0053] FIG1 is a schematic structural diagram of a multi-view image processing system provided by an embodiment of the present disclosure;

[0054] FIG2 is a schematic structural diagram of a processing device provided in an embodiment of the present disclosure;

[0055] FIG3 is a schematic diagram of obtaining a first image provided by an exemplary embodiment;

[0056] FIG4 is a schematic diagram of obtaining a coded image provided by an exemplary embodiment;

[0057] FIG5 is a schematic structural diagram of a display device provided by an exemplary embodiment;

[0058] FIG6 is a schematic diagram of decoding a coded image provided by an exemplary embodiment;

[0059] FIG7 is a schematic diagram of a processing device encoding provided by an exemplary embodiment;

[0060] FIG8 is a schematic diagram of encoding of a display device provided by an exemplary embodiment.

[0061] Details

[0062] The present disclosure describes multiple embodiments, but this description is exemplary rather than restrictive, and it will be apparent to those skilled in the art that more embodiments and implementations may be included within the scope of the embodiments described in the present disclosure. Although many possible feature combinations are shown in the drawings and discussed in the detailed description, many other combinations of the disclosed features are also possible. Unless specifically limited, any feature or element of any embodiment may be used in combination with any other feature or element in any other embodiment, or may replace any other feature or element in any other embodiment.

[0063] The present disclosure includes and contemplates combinations of features and elements known to those of ordinary skill in the art. The embodiments, features, and elements disclosed in the present disclosure may also be combined with any conventional features or elements to form a technical solution defined by the claims. Any features or elements of any embodiment may also be combined with features or elements from other technical solutions to form another technical solution defined by the claims. Therefore, it should be understood that any features shown and discussed in this disclosure may be implemented individually or in any appropriate combination. Therefore, the embodiments are not subject to other limitations except for the limitations set forth in the appended claims and their equivalents. In addition, various modifications and changes may be made within the scope of protection of the appended claims.

[0064] Unless otherwise defined, the technical or scientific terms used in this disclosure shall have the usual meanings understood by persons of ordinary skill in the field to which this disclosure belongs. The words "first", "second" and similar terms used in this disclosure do not indicate any order, quantity or importance, but are only used to distinguish different components. Words such as "include" or "comprise" mean that the elements or objects preceding the word include the elements or objects listed after the word and their equivalents, without excluding other elements or objects. Words such as "connect" or "connected" are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "Up", "down", "left", "right" and the like only indicate relative positional relationships. When the absolute position of the object being described changes, the relative positional relationship may also change accordingly.

[0065] For ultra-high-resolution multi-viewpoint autostereoscopic displays, there is no effective data transmission method that can enable ultra-high-resolution stereoscopic displays to be realized through multi-viewpoint autostereoscopic displays.

[0066] FIG1 is a schematic diagram of the structure of a multi-view image processing system provided by an embodiment of the present disclosure, and FIG2 is a schematic diagram of the structure of a processing device provided by an embodiment of the present disclosure. As shown in FIG1 and FIG2, the multi-view image processing system provided by an embodiment of the present disclosure includes: a processing device 10 and a display device 20 connected to the processing device 10. The processing device 10 includes: an acquisition module 11 and an encoding module 12. Among them, the acquisition module 11 is configured to acquire K viewpoint images. The encoding module 12 is configured to receive K viewpoint images, encode the K viewpoint images, generate multiple encoded images, and send the multiple encoded images to the display device 20. The display device 20 is configured to receive multiple encoded images, obtain M display information based on the multiple encoded images, and the i-th display information includes: the i-th row of pixels of the K viewpoint images; and perform stereoscopic display based on the M display information.

[0067] In an exemplary embodiment, the viewpoint image may include: M rows and N columns of pixels. M and N are both positive integers greater than 1. The values ​​of M and N depend on the content of the stereoscopic display, and this disclosure does not impose any limitation on this.

[0068] In an exemplary embodiment, K may be a positive integer greater than or equal to 2, for example, K may be 28 or 45. The value of K may be determined according to the requirements of stereoscopic display. The higher the requirements of stereoscopic display, the larger the value of K.

[0069] In an exemplary embodiment, i = 1, 2, ..., M. The first display information includes: the first row of pixels of K viewpoint images, the second display information includes: the second row of pixels of K viewpoint images, and so on. The Mth display information includes: the Mth row of pixels of K viewpoint images.

[0070] In an exemplary embodiment, the processing device may be a server, a personal computer, or a processor that performs logical operations, such as a central processing unit (CPU), a field programmable logic array (FPGA), a digital signal processor (DSP), a single-chip microcomputer (MCU), an application-specific logic circuit (ASIC), or other devices with data processing and program execution capabilities.

[0071] In an exemplary embodiment, a display device may be composed of a display unit and a grating unit. The display unit may be a liquid crystal display panel, an organic light-emitting diode display panel, or a plasma display panel. The grating unit may be a slit grating or a lenticular grating, which is not limited in this disclosure. The display device creates a stereoscopic display by displaying two or more viewpoint images. Different display devices have different resolutions, viewpoint numbers, and viewpoint arrangements, so the format of the multiple viewpoint images is determined by the display device.

[0072] In an exemplary embodiment, when the processing device is a processor, the processing device may be provided in the display device.

[0073] In an exemplary embodiment, the processing device and the display device may be provided separately. FIG1 illustrates an example in which the processing device and the display device are provided separately.

[0074] In an exemplary embodiment, the connection includes connecting via a wireless network, a wired network, or any combination of a wireless network and a wired network. The network may include a local area network, the Internet, a telecommunications network, an Internet of Things based on the Internet and telecommunications networks, or any combination of the above networks. A wired network may, for example, use wires, twisted pairs, coaxial cables, or optical fibers to transmit information, while a wireless network may, for example, use a WWAN mobile communication network, Bluetooth, Zigbee, or WiFi.

[0075] The multi-view image processing system provided by the embodiment of the present disclosure includes: a processing device and a display device; the processing device includes: an acquisition module and an encoding module; the acquisition module is configured to acquire K viewpoint images, wherein the viewpoint image includes: M rows and N columns of pixels, K is a positive integer greater than or equal to 2, and M and N are positive integers greater than or equal to 1; the encoding module is configured to receive the K viewpoint images, encode the K viewpoint images, generate multiple encoded images, and send the multiple encoded images to the display device; the display device is configured to receive the multiple encoded images, obtain M display information based on the multiple encoded images, the i-th display information includes: the i-th row of pixels of the K viewpoint images; stereoscopic display is performed based on the M display information. The multi-view image processing system provided by the embodiment of the present disclosure effectively solves the data transmission and display of the multi-view naked-eye stereo screen, is simple and easy to implement, and can quickly achieve intelligentization.

[0076] In an exemplary embodiment, the processing device may include a first interface, the display device may include a second interface, and the encoded image may be transmitted to the second interface through the first interface.

[0077] In an exemplary embodiment, the display device may perform image rendering on the image to be displayed to obtain K viewpoint images.

[0078] In an exemplary embodiment, the acquisition module may be configured to acquire an image to be displayed, and acquire K viewpoint images based on the image to be displayed.

[0079] In an exemplary embodiment, the image to be displayed may be a two-dimensional image.

[0080] In an exemplary embodiment, the multi-view image processing system may further include: a multi-view acquisition device, the multi-view acquisition device including: multiple CCD cameras, each CCD camera in the multi-view acquisition device performs dynamic scene acquisition to obtain K viewpoint images.

[0081] In an exemplary embodiment, the acquisition module is configured to receive K viewpoint images obtained by a multi-viewpoint acquisition device.

[0082] In an exemplary embodiment, before each CCD camera in the multi-viewpoint acquisition device acquires a dynamic scene, a system calibration is performed on each CCD camera.

[0083] In an exemplary embodiment, a multi-viewpoint acquisition device may include: a multi-camera acquisition array and a light field environment. The multi-camera acquisition array is arranged in a circular manner to collect information from as many angles as possible. The CCD camera used for acquisition is required to be able to achieve 30 frames per second, 10 million pixels acquisition, and an image resolution of 1920×1080 or above, meeting the requirements of high-quality dynamic capture of information. The light field environment is composed of light-emitting diodes (LEDs) evenly distributed in a ring, and its main function is to provide lighting to facilitate information acquisition by the CCD camera. A view acquisition device using multiple CCD cameras based on a circular distribution is more suitable for real-time data acquisition. The device installs a circle of CCD cameras on a circle at a certain height, and each CCD camera captures the view in its own viewing direction. Since all CCD cameras capture images simultaneously, the capture time of a circle of views is very short, which is conducive to the acquisition of viewpoint images.

[0084] In an exemplary embodiment, the encoding module can be configured to select the mth viewpoint image from K viewpoint images as the first viewpoint image, and all viewpoint images except the mth viewpoint image as the second viewpoint image, the number of second viewpoint images is K-1, 1≤m≤K; based on the first viewpoint image and K-1 second viewpoint images, K-1 first images are obtained, wherein the kth first image is obtained based on the first viewpoint image and the kth second viewpoint image, k=1,2,…,K-1; based on the first viewpoint image, K-1 second viewpoint images and K-1 first images, K-1 encoded images are obtained, wherein the kth encoded image is obtained based on the first viewpoint image, the kth second viewpoint image and the kth first image.

[0085] In an exemplary embodiment, m is any value from 1 to K, and m can be 1 or other numbers.

[0086] In an exemplary embodiment, the first image includes: M rows and N columns of pixels.

[0087] In an exemplary embodiment, the encoded image includes: M rows and N columns of pixels.

[0088] In an exemplary embodiment, the middle viewpoint image is selected as the first viewpoint image, and all viewpoint images except the middle viewpoint image are selected as the second viewpoint image. Selecting the middle viewpoint image as the first viewpoint image can reduce the computational complexity of image processing.

[0089] In an exemplary embodiment, the bit depth of each pixel may be 24.

[0090] In an exemplary embodiment, the encoding module is configured to send K-1 encoded images and a first view image.

[0091] In an exemplary embodiment, FIG3 is a schematic diagram of obtaining a first image provided by an exemplary embodiment. As shown in FIG3 , the encoding module is further configured to obtain information about the pixel in the i-th row and j-th column of the k-th first image based on information about the pixel in the i-th row and j-th column of the first view image and information about the pixel in the i-th row and j-th column of the k-th second view image; and obtain the k-th first image based on information about all pixels in the k-th first image, where j = 1, 2, ..., N.

[0092] In an exemplary embodiment, the pixel information may include: color component information, or color voltage information, or other data information, which is not limited in the present disclosure.

[0093] In an exemplary embodiment, the color component information may include: a first color component value, a second color component value, and a third color component value. The color voltage information may include: a first color voltage value, a second color voltage value, and a third color voltage value. The first color, the second color, and the third color are respectively one of red, green, and blue, and are different colors.

[0094] In an exemplary embodiment, when the pixel information includes: color component information, the encoding module can also be configured to obtain the grayscale value of the pixel in the i-th row and j-th column of the first view image based on the color component information of the pixel in the i-th row and j-th column of the first view image; obtain the grayscale value of the pixel in the i-th row and j-th column of the k-th second view image based on the color component information of the pixel in the i-th row and j-th column of the k-th second view image; when the difference between the grayscale value of the pixel in the i-th row and j-th column of the first view image and the grayscale value of the pixel in the i-th row and j-th column of the k-th second view image is less than a threshold difference, the pixel in the i-th row and j-th column of the k-th first image is a black pixel; when the difference between the grayscale value of the pixel in the i-th row and j-th column of the first view image and the grayscale value of the pixel in the i-th row and j-th column of the k-th second view image is greater than the threshold difference, the pixel in the i-th row and j-th column of the k-th first image is a white pixel.

[0095] In an exemplary embodiment, when the pixel information includes: color component information, the encoding module can also be configured to subtract the first color component value of the pixel in the i-th row and j-th column of the first view image from the first color component value of the pixel in the i-th row and j-th column of the k-th second view image to obtain a first color component difference; subtract the second color component value of the pixel in the i-th row and j-th column of the first view image from the second color component value of the pixel in the i-th row and j-th column of the k-th second view image to obtain a second color component difference; subtract the third color component value of the pixel in the i-th row and j-th column of the first view image from the third color component value of the pixel in the i-th row and j-th column of the k-th second view image to obtain a third color component difference; obtain a grayscale difference based on the first color component difference, the second color component difference and the third color component difference; when the grayscale difference is less than the threshold difference, the pixel in the i-th row and j-th column of the k-th first image is a black pixel; when the grayscale difference is greater than the threshold difference, the pixel in the i-th row and j-th column of the k-th first image is a white pixel.

[0096] In an exemplary embodiment, the encoding module stores the correspondence between pixel color and color component information of the pixel. The encoding module obtains the color component information of the pixel in the i-th row and j-th column of the first view image based on the color of the pixel in the i-th row and j-th column of the first view image and the correspondence between the color of the pixel and the color component information of the pixel. The encoding module obtains the color component information of the pixel in the i-th row and j-th column of the second view image based on the color of the pixel in the i-th row and j-th column of the second view image and the correspondence between the color of the pixel and the color component information of the pixel.

[0097] In an exemplary embodiment, when the pixel in the i-th row and j-th column in the first image is white, it indicates that the color of the pixel in the i-th row and j-th column of the first view image is significantly different from the color of the pixel in the i-th row and j-th column of the second view image. When the pixel in the i-th row and j-th column in the first image is black, it indicates that the color of the pixel in the i-th row and j-th column of the first view image is not significantly different from the color of the pixel in the i-th row and j-th column of the second view image.

[0098] In an exemplary embodiment, when the colors of the pixels in the i-th row and j-th column of the k-th second view image are different, the threshold difference values ​​used when obtaining the k-th first image are different, that is, the determination of the color difference satisfies Weber's law. When the color of the pixel in the i-th row and j-th column of the k-th second view image is the first color, the threshold difference value used when determining whether the pixel in the k-th first image is a white pixel or a black pixel is different from the threshold difference value used when the color of the pixel in the i-th row and j-th column of the k-th second view image is the second color, wherein the first color and the second color are different colors.

[0099] Figure 3 is illustrated by taking the example that the color of the pixel in the first row and fourth column of the first view image is significantly different from the color of the pixel in the first row and fourth column of the k-th second view image, and the color of the pixel in the third row and third column of the first view image is significantly different from the color of the pixel in the third row and third column of the k-th second view image. At this time, the pixels in the first row and fourth column and the third row and third column in the k-th first image are white pixels.

[0100] FIG4 is a schematic diagram of obtaining an encoded image provided by an exemplary embodiment. FIG4 is illustrated using M=5 and N=5 as an example. As shown in FIG4 , in an exemplary embodiment, the encoding module is configured to use the first row of pixels in the first view image as the first row of pixels in each encoded image; scan the first row of pixels in the kth first image; when there are no white pixels in the first row of pixels in the kth first image, select the next row of pixels in the first view image as the next row of pixels in the kth encoded image; when there are white pixels in the first row of pixels in the kth first image, obtain the position information of the white pixel and the information of the pixel corresponding to the white pixel in the kth second view image, and store the position information of the white pixel and the information of the pixel corresponding to the white pixel in the kth second view image in two adjacent pixels in the next row of pixels in the kth encoded image; sequentially scan the rth row of pixels in the first image corresponding to the kth second view image until the last row of pixels in the first image corresponding to the kth second view image is scanned, thereby obtaining the kth encoded image, where 2≤r≤M.

[0101] As shown in FIG4 , there is a white pixel in the first row of pixels in the kth first image. Based on the position information of the white pixel, i.e., the fourth column in the first row and the color component information of the pixel corresponding to the white pixel in the second view image, the position information of the white pixel and the information of the pixel corresponding to the white pixel in the kth second view image are stored in the first and second pixels in the second row of pixels in the encoded image corresponding to the second view image. If there are multiple white pixels in the first row of pixels, the position information of the i-th white pixel and the information of the pixel corresponding to the white pixel in the k-th second view image are stored in the 2i-1 and 2i pixels in the second row of pixels in the k-th encoded image. That is, the position information of the first white pixel and the information of the pixel corresponding to the white pixel in the k-th second view image are stored in the first and second pixels in the second row of pixels in the k-th encoded image. The position information of the second white pixel and the information of the pixel corresponding to the white pixel in the k-th second view image are stored in the third and fourth pixels in the second row of pixels in the k-th encoded image, and so on. At this time, other pixels in the second row of pixels in the k-th encoded image may be white pixels.

[0102] The encoding method provided by the present disclosure can effectively maintain image quality.

[0103] In an exemplary embodiment, the position information may include: the row number and column number of the white pixel in the first image.

[0104] In an exemplary embodiment, the pixel points in the second view image corresponding to the white pixel points are the pixel points in the second view image that are located at the same row and column as the white pixel points in the first image.

[0105] Figure 5 is a schematic diagram of the structure of a display device provided by an exemplary embodiment. As shown in Figure 5, in an exemplary embodiment, the display device 20 may include: a decoding module 21 and a display module 22. The decoding module 21 is configured to receive multiple encoded images and obtain M display information based on the multiple encoded images; the display module 22 is configured to receive the M display information and perform stereoscopic display based on the M display information.

[0106] In an exemplary embodiment, the decoding module is further configured to obtain K-1 second viewpoint images corresponding to K-1 encoded images based on K-1 encoded images, wherein the kth second viewpoint image is obtained based on the kth encoded image; and M display information is obtained based on the first viewpoint image and the K-1 second viewpoint images.

[0107] FIG6 is a schematic diagram of decoding a coded image provided by an exemplary embodiment. As shown in FIG6 , in an exemplary embodiment, the decoding module is configured to use the first row of pixels of the k-th coded image as the first row of pixels of the k-th second view image, scan the next row of pixels of the k-th coded image, and if the second row of pixels includes position information, obtain information stored in the neighboring pixels of the pixel including the position information, and update the information of the pixel located at the position information in the k-th second view image with the information stored in the neighboring pixels of the pixel including the position information. If the next row of pixels does not include position information, use the next row of pixels of the k-th coded image as the next row of pixels of the k-th second view image, and scan the r-th row of pixels of the k-th coded image in sequence until the last row of pixels of the k-th coded image is scanned, thereby obtaining the k-th second view image.

[0108] In an exemplary embodiment, the decoding module is configured to obtain the i-th row of pixels of K viewpoint images based on the first viewpoint image and K-1 second viewpoint images; and obtain M display information based on the first row of pixels to the M-th row of pixels of the K viewpoint images.

[0109] In an exemplary embodiment, the display module is configured to display the i-th row of K viewpoint images according to the i-th display information.

[0110] The present disclosure displays the i-th row of K viewpoint images row by row through a display module, which can reduce the storage space occupied during decoding and facilitate fast display.

[0111] The encoding and decoding method provided by the present disclosure can not only achieve lossless viewpoint images, but also be simple, easy to implement, and easy to be intelligent.

[0112] Figure 7 is a schematic diagram of encoding by a processing device according to an exemplary embodiment. As shown in Figure 7 , in one exemplary embodiment, the encoding module is configured to sequentially extract the i-th row of pixels from each viewpoint image to form M second images; then, the M second images are encoded to generate M encoded images. Viewi in Figure 7 represents the i-th viewpoint image.

[0113] In an exemplary embodiment, each second image includes K rows and N columns of pixels, the nth row of pixels of the i-th second image is the i-th row of pixels of the n-th viewpoint image, and n=1, 2, …, K.

[0114] In an exemplary embodiment, the M second images can be encoded using Huffman coding, run length coding, or orthogonal transform coding. The present disclosure uses Huffman coding, run length coding, or orthogonal transform coding for encoding, so that the compression ratio of the encoded image and the second image is relatively large, and the technology is relatively mature.

[0115] Figure 8 is a schematic diagram of encoding for a display device according to an exemplary embodiment. As shown in Figure 8 , in one exemplary embodiment, the display device is configured to sequentially decode M encoded images to obtain M second images, where the i-th second image includes the i-th display information; and then display the i-th row of K viewpoint images based on the i-th second image.

[0116] The present disclosure displays the i-th row of K viewpoint images row by row, and processes one row of the viewpoint images, which can save storage space.

[0117] The present disclosure also provides an image processing method, which is applied in a multi-view image processing system. The image processing method provided by the present disclosure may include the following steps:

[0118] Step S1: Acquire K viewpoint images.

[0119] In an exemplary embodiment, the viewpoint image includes: M rows and N columns of pixels; K is a positive integer greater than or equal to 2, and M and N are positive integers greater than or equal to 1.

[0120] Step S2: Receive K viewpoint images, encode the K viewpoint images to generate multiple encoded images, and send the multiple encoded images to a display device.

[0121] Step S3: Receive multiple coded images, and obtain M display information according to the multiple coded images.

[0122] In an exemplary embodiment, the i-th display information includes: pixel points in the i-th row of K viewpoint images, where i=1, 2, . . . , M.

[0123] Step S4: Perform stereoscopic display according to the M display information.

[0124] The multi-view image processing system is the multi-view image processing system provided by any of the aforementioned embodiments, and its implementation principle and implementation effect are similar, which will not be described in detail here.

[0125] In an exemplary embodiment, acquiring K viewpoint images includes: acquiring an image to be displayed, acquiring K viewpoint images based on the image to be displayed, or acquiring K viewpoint images obtained by a multi-viewpoint acquisition device.

[0126] In an exemplary embodiment, K viewpoint images are encoded to generate multiple encoded images, including: selecting the mth viewpoint image from the K viewpoint images as the first viewpoint image, and all viewpoint images except the mth viewpoint image as the second viewpoint image, the number of the second viewpoint images is K-1, 1≤m≤K; obtaining K-1 first images based on the first viewpoint image and K-1 second viewpoint images, wherein the kth first image is obtained based on the first viewpoint image and the kth second viewpoint image, k=1,2,…,K-1; obtaining K-1 encoded images based on the first viewpoint image, K-1 second viewpoint images and K-1 first images, wherein the kth encoded image is obtained based on the first viewpoint image, the kth second viewpoint image and the kth first image; sending K-1 encoded images and the first viewpoint image, wherein the first image and the encoded image both include: M rows and N columns of pixels.

[0127] In an exemplary embodiment, obtaining K-1 first images based on the first view image and K-1 second view images includes: obtaining information of the pixel point in the i-th row and j-th column of the k-th first image based on information of the pixel point in the i-th row and j-th column of the first view image and information of the pixel point in the i-th row and j-th column of the k-th second view image; obtaining the k-th first image based on information of all pixels of the k-th first image, j = 1, 2,…, N.

[0128] In an exemplary embodiment, the pixel information may include: color component information, or color voltage information, or other data information, which is not limited in the present disclosure.

[0129] In an exemplary embodiment, the color component information may include: a first color component value, a second color component value, and a third color component value. The color voltage information may include: a first color voltage value, a second color voltage value, and a third color voltage value. The first color, the second color, and the third color are respectively one of red, green, and blue, and are different colors.

[0130] In an exemplary embodiment, when the pixel information includes: color component information, obtaining the information of the pixel in the i-th row and j-th column of the k-th first image according to the information of the pixel in the i-th row and j-th column of the first view image and the information of the pixel in the i-th row and j-th column of the k-th second view image includes: obtaining the grayscale value of the pixel in the i-th row and j-th column of the first view image according to the color component information of the pixel in the i-th row and j-th column of the first view image; obtaining the grayscale value of the pixel in the i-th row and j-th column of the k-th second view image according to the color component information of the pixel in the i-th row and j-th column of the k-th second view image. the grayscale value of the pixel in the i-th row and j-th column of the k-th second view image; when the difference between the grayscale value of the pixel in the i-th row and j-th column of the first view image and the grayscale value of the pixel in the i-th row and j-th column of the k-th second view image is less than the threshold difference, the pixel in the i-th row and j-th column of the k-th first image is a black pixel; when the difference between the grayscale value of the pixel in the i-th row and j-th column of the first view image and the grayscale value of the pixel in the i-th row and j-th column of the k-th second view image is greater than the threshold difference, the pixel in the i-th row and j-th column of the k-th first image is a white pixel.

[0131] In an exemplary embodiment, when the pixel information includes color component information, obtaining the information of the pixel in the i-th row and j-th column of the k-th first image according to the information of the pixel in the i-th row and j-th column of the first view image and the information of the pixel in the i-th row and j-th column of the k-th second view image includes: performing a subtraction between the first color component value of the pixel in the i-th row and j-th column of the first view image and the first color component value of the pixel in the i-th row and j-th column of the k-th second view image to obtain the first color component difference value; ...; performing a subtraction between the first color component value of the pixel in the i-th row and j-th column of the first view image and the first color component value of the pixel in the i-th row and j-th column of the k-th second view image; performing a subtraction between the first color component value of the pixel in the i-th row and j-th column of the first view image and the first color component value of the pixel in the i-th row and j-th column of the k-th second view image; performing a subtraction between the first color component value of the pixel in the i-th row and j-th column of the first view image and the first color component value of the pixel in the i-th row and j-th column of the The second color component value of the pixel in the jth row and column is subtracted from the second color component value of the pixel in the i-th row and j-th column of the k-th second view image to obtain a second color component difference; the third color component value of the pixel in the i-th row and j-th column of the first view image is subtracted from the third color component value of the pixel in the i-th row and j-th column of the k-th second view image to obtain a third color component difference; a grayscale difference is obtained based on the first color component difference, the second color component difference and the third color component difference; when the grayscale difference is less than the threshold difference, the pixel in the i-th row and j-th column of the k-th first image is a black pixel; when the grayscale difference is greater than the threshold difference, the pixel in the i-th row and j-th column of the k-th first image is a white pixel.

[0132] In an exemplary embodiment, when the colors of the pixels in the i-th row and the j-th column of the k-th second view image are different, the threshold difference values ​​when obtaining the k-th first image are different.

[0133] In an exemplary embodiment, obtaining K-1 coded images based on a first view image, K-1 second view images and K-1 first images includes: taking the first row of pixels of the first view image as the first row of pixels of each coded image; scanning the first row of pixels of the kth first image; when there are no white pixels in the first row of pixels of the kth first image, selecting the next row of pixels of the first view image as the next row of pixels of the kth coded image; when there are white pixels in the first row of pixels of the kth first image, obtaining the position information of the white pixels and the information of the pixels corresponding to the white pixels in the kth second view image, and storing the position information of the white pixels and the information of the pixels corresponding to the white pixels in the second view image in two adjacent pixels in the next row of pixels of the kth coded image, scanning the rth row of pixels of the kth first image in sequence until the last row of pixels of the kth first image is scanned, and obtaining the kth coded image, 2≤r≤M.

[0134] In an exemplary embodiment, the position information may include: the row number and column number of the white pixel in the first image.

[0135] In an exemplary embodiment, the pixel points in the second view image corresponding to the white pixel points are the pixel points in the second view image that are located at the same row and column as the white pixel points in the first image.

[0136] In an exemplary embodiment, obtaining M display information according to the plurality of coded images includes: obtaining K-1 second view images according to K-1 coded images; obtaining M display information according to the first view image and the K-1 second view images;

[0137] In an exemplary embodiment, the kth second view image is obtained according to the kth encoded image.

[0138] In an exemplary embodiment, obtaining K-1 second viewpoint images based on K-1 encoded images includes: using the first row of pixels of the k-th encoded image as the first row of pixels of the k-th second viewpoint image, scanning the next row of pixels of the k-th encoded image, if the next row of pixels includes position information, obtaining the information stored in the adjacent pixels of the pixel including the position information, updating the information of the pixel located at the position information in the k-th second viewpoint image, and updating it to the information stored in the adjacent pixels of the pixel including the position information; if the next row of pixels does not include position information, using the next row of pixels of the k-th encoded image as the next row of pixels of the k-th second viewpoint image, scanning the rth row of pixels of the k-th encoded image in sequence, until the last row of pixels of the k-th encoded image is scanned, and obtaining the k-th second viewpoint image.

[0139] In an exemplary embodiment, obtaining M display information of K viewpoint images based on the first viewpoint image and K-1 second viewpoint images includes: obtaining the i-th row of pixels of the K viewpoint images in sequence; and obtaining M display information based on the first row of pixels to the M-th row of pixels of the K viewpoint images.

[0140] In an exemplary embodiment, performing stereoscopic display according to M display information includes: displaying an i-th row of K viewpoint images according to an i-th display information.

[0141] In an exemplary embodiment, encoding K viewpoint images to generate multiple encoded images includes: extracting the i-th row of pixels from each viewpoint image in sequence to form M second images, and encoding the M second images to generate M encoded images.

[0142] In an exemplary embodiment, each second image includes: K rows and N columns of pixels, the nth row of pixels of the i-th second image is the i-th row of pixels of the n-th viewpoint image, n=1, 2, ..., K;.

[0143] In an exemplary embodiment, obtaining M display information of K viewpoint images based on multiple encoded images includes: decoding the M encoded images in sequence to obtain M second images, the i-th second image including the i-th display information; and displaying the i-th row of the K viewpoint images based on the i-th second image.

[0144] Those skilled in the art should understand that the technical solutions of the embodiments of the present disclosure may be modified or replaced by equivalents without departing from the spirit and scope of the technical solutions of the present disclosure, and all should be included in the scope of the claims of this application.

[0145] It will be appreciated by those skilled in the art that all or some of the steps, systems, and functional modules / units in the methods disclosed above may be implemented as software, firmware, hardware, and appropriate combinations thereof. In hardware implementations, the division between the functional modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed by several physical components in cooperation. Some or all components may be implemented as software executed by a processor, such as a digital signal processor or a microprocessor, or implemented as hardware, or implemented as an integrated circuit, such as an application-specific integrated circuit. Such software may be distributed on a computer-readable medium, which may include a computer storage medium (or non-transitory medium) and a communication medium (or temporary medium). As is well known to those skilled in the art, the term computer storage medium includes volatile and non-volatile, removable, and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and can be accessed by a computer. In addition, it is well known to those skilled in the art that communication media generally embodies computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media.

[0146] The drawings in this disclosure only relate to the structures involved in the embodiments of this disclosure, and other structures may refer to general designs.

[0147] Although the embodiments disclosed in this disclosure are as described above, the contents described are merely embodiments adopted to facilitate understanding of the disclosure and are not intended to limit the disclosure. Any person skilled in the art to which the disclosure belongs may make any modifications and changes in the form and details of the implementation without departing from the spirit and scope of the disclosure. However, the scope of patent protection of the disclosure shall still be based on the scope defined by the attached claims.

Claims

1. A multi-view image processing system, comprising: processing device and display device; The processing device includes: an acquisition module and an encoding module; The acquisition module is configured to acquire K viewpoint images, wherein the viewpoint images include: M rows and N columns of pixels, K is a positive integer greater than or equal to 2, and M and N are positive integers greater than or equal to 1; The encoding module is configured to receive K viewpoint images, encode the K viewpoint images to generate a plurality of encoded images, and send the plurality of encoded images to the display device; The display device is configured to receive a plurality of coded images, obtain M display information based on the plurality of coded images, wherein the i-th display information includes: pixel points in the i-th row of K viewpoint images, where i=1, 2, ..., M; and perform stereoscopic display based on the M display information; The processing device is provided in the display device, or the processing device and the display device are provided separately.

2. The system according to claim 1, wherein: The acquisition module is configured to acquire an image to be displayed, and acquire K viewpoint images according to the image to be displayed.

3. The system according to claim 1, further comprising: A multi-viewpoint acquisition device, comprising: a plurality of CCD cameras, each CCD camera in the multi-viewpoint acquisition device performs dynamic scene acquisition to obtain K viewpoint images; The acquisition module is configured to receive K viewpoint images obtained by a multi-viewpoint acquisition device.

4. The system according to claim 1, wherein: The encoding module is configured to select the mth viewpoint image from K viewpoint images as the first viewpoint image, and all viewpoint images except the mth viewpoint image as the second viewpoint image, where the number of the second viewpoint images is K-1, 1≤m≤K; obtain K-1 first images based on the first viewpoint image and K-1 second viewpoint images, wherein the kth first image is obtained based on the first viewpoint image and the kth second viewpoint image, k=1,2,…,K-1; obtain K-1 coded images based on the first viewpoint image, K-1 second viewpoint images and K-1 first images, wherein the kth coded image is obtained based on the first viewpoint image, the kth second viewpoint image and the kth first image; send K-1 coded images and the first viewpoint image; the first image and the coded image both include: M rows and N columns of pixels.

5. The system according to claim 4, wherein: The encoding module is also configured to obtain information of the pixel point in the i-th row and j-th column of the k-th first image based on information of the pixel point in the i-th row and j-th column of the first view image and information of the pixel point in the i-th row and j-th column of the k-th second view image; and obtain the k-th first image based on information of all pixels of the k-th first image, where j = 1, 2,…, N.

6. The system according to claim 5, wherein: The pixel information includes: color component information, the color component information includes: a first color component value, a second color component value, and a third color component value, the first color, the second color, and the third color are respectively one of red, green, and blue, and are different colors; The encoding module is further configured to obtain a grayscale value of a pixel in the i-th row and j-th column of the first view image based on the color component information of the pixel in the i-th row and j-th column of the first view image; and obtain a grayscale value of a pixel in the i-th row and j-th column of the k-th second view image based on the color component information of the pixel in the i-th row and j-th column of the k-th second view image; when the difference between the grayscale value of the pixel in the i-th row and j-th column of the first view image and the grayscale value of the pixel in the i-th row and j-th column of the k-th second view image is less than a threshold difference, the pixel in the i-th row and j-th column of the k-th first image is a black pixel; and when the difference between the grayscale value of the pixel in the i-th row and j-th column of the first view image and the grayscale value of the pixel in the i-th row and j-th column of the k-th second view image is greater than the threshold difference, the pixel in the i-th row and j-th column of the k-th first image is a white pixel; Alternatively, the encoding module is further configured to perform a subtraction between a first color component value of a pixel in the i-th row and j-th column of the first view image and a first color component value of a pixel in the i-th row and j-th column of the k-th second view image to obtain a first color component difference; perform a subtraction between a second color component value of a pixel in the i-th row and j-th column of the first view image and a second color component value of a pixel in the i-th row and j-th column of the k-th second view image to obtain a second color component difference; perform a subtraction between a third color component value of a pixel in the i-th row and j-th column of the first view image and a third color component value of a pixel in the i-th row and j-th column of the k-th second view image to obtain a third color component difference; and perform a grayscale difference according to the first color component difference, the second color component difference, and the third color component difference; when the grayscale difference is less than a threshold difference, the pixel in the i-th row and j-th column of the k-th first image is a black pixel; and when the grayscale difference is greater than the threshold difference, the pixel in the i-th row and j-th column of the k-th first image is a white pixel. When the colors of the pixels in the i-th row and the j-th column of the k-th second view image are different, the threshold difference values ​​when obtaining the k-th first image are different.

7. The system according to any one of claims 4 to 6, wherein: The encoding module is further configured to use the first row of pixels of the first view image as the first row of pixels of each encoded image; scan the first row of pixels of the kth first image; when there are no white pixels in the first row of pixels of the kth first image, select the next row of pixels of the first view image as the next row of pixels of the kth encoded image; when there are white pixels in the first row of pixels of the kth first image, obtain the position information of the white pixels and the information of the pixels corresponding to the white pixels in the kth second view image, and use the position information of the white pixels and the information of the pixels corresponding to the white pixels in the kth second view image as the encoding module; The information of the pixel corresponding to the white pixel in the kth second viewpoint image is stored in two adjacent pixels in the next row of pixels in the kth encoded image, and the rth row of pixels in the kth first image is scanned in sequence until the last row of pixels in the kth first image is scanned to obtain the kth encoded image, 2≤r≤M; the position information includes: the row number and column number of the white pixel in the first image, and the pixel corresponding to the white pixel in the second viewpoint image is the pixel in the second viewpoint image located at the row number and column number of the white pixel in the first image.

8. The system according to claim 1, wherein: The display device includes: a decoding module and a display module; The decoding module is configured to receive a plurality of coded images and obtain M display information according to the plurality of coded images; The display module is configured to receive M display information and perform stereoscopic display according to the M display information.

9. The system according to claim 8, wherein: The decoding module is further configured to obtain K-1 second viewpoint images based on K-1 encoded images, wherein the kth second viewpoint image is obtained based on the kth encoded image; and obtain M display information based on the first viewpoint image and the K-1 second viewpoint images.

10. The system according to claim 9, wherein: The decoding module is further configured to use the first row of pixels of the k-th encoded image as the first row of pixels of the k-th second view image, scan the next row of pixels of the k-th encoded image, and if the next row of pixels includes position information, obtain information of the pixels stored in the adjacent pixels of the pixel including the position information, and update the information of the pixel located at the position information in the k-th second view image to the information of the pixels stored in the adjacent pixels of the pixel including the position information; If the next row of pixels does not include position information, the next row of pixels of the k-th coded image is used as the next row of pixels of the k-th second viewpoint image, and the r-th row of pixels of the k-th coded image is scanned in sequence until the last row of pixels of the k-th coded image is scanned to obtain the k-th second viewpoint image.

11. The system according to claim 8, wherein: The decoding module is configured to obtain pixel points in the i-th row of K viewpoint images according to the first viewpoint image and K-1 second viewpoint images; and obtain M display information according to pixel points in the first row to the M-th row of K viewpoint images; The display module is configured to display the i-th row of K viewpoint images according to the i-th display information.

12. The system according to claim 1, wherein: The encoding module is configured to extract the i-th row of pixels from each viewpoint image in sequence to form M second images, each second image including: K rows and N columns of pixels, the n-th row of pixels of the i-th second image being the i-th row of pixels of the n-th viewpoint image, n = 1, 2, …, K; the M second images are encoded to generate M encoded images.

13. The system according to claim 12, wherein: The display device is configured to decode M coded images in sequence to obtain M second images, where the i-th second image includes the i-th display information; and display the i-th row of K viewpoint images according to the i-th second image.

14. An image processing method, the method comprising: Acquire K viewpoint images, wherein the viewpoint images include: M rows and N columns of pixels, K is a positive integer greater than or equal to 2, and M and N are positive integers greater than or equal to 1; receiving K viewpoint images, encoding the K viewpoint images to generate a plurality of encoded images, and sending the plurality of encoded images to a display device; Receive multiple coded images, and obtain M display information according to the multiple coded images, where the i-th display information includes: pixel points in the i-th row of K viewpoint images, where i=1, 2, ..., M; Stereoscopic display is performed according to the M display information.

15. The method according to claim 14, wherein The acquiring of K viewpoint images includes: acquiring an image to be displayed, and acquiring K viewpoint images according to the image to be displayed, or acquiring K viewpoint images obtained by a multi-viewpoint acquisition device.

16. The method according to claim 14, wherein The encoding of K viewpoint images to generate multiple encoded images includes: selecting the mth viewpoint image from the K viewpoint images as the first viewpoint image, and all viewpoint images except the mth viewpoint image as the second viewpoint image, the number of the second viewpoint images is K-1, 1≤m≤K; obtaining K-1 first images based on the first viewpoint image and K-1 second viewpoint images, wherein the kth first image is obtained based on the first viewpoint image and the kth second viewpoint image, k=1,2,…,K-1; obtaining K-1 encoded images based on the first viewpoint image, K-1 second viewpoint images and K-1 first images, wherein the kth encoded image is obtained based on the first viewpoint image, the kth second viewpoint image and the kth first image; and sending K-1 encoded images and the first viewpoint image, wherein the first image and the encoded image both include: M rows and N columns of pixels.

17. The method according to claim 15, wherein: The step of obtaining K-1 first images according to the first view image and the K-1 second view images includes: obtaining information of a pixel in the i-th row and j-th column of the k-th first image according to information of a pixel in the i-th row and j-th column of the first view image and information of a pixel in the i-th row and j-th column of the k-th second view image; and obtaining a k-th first image according to information of all pixels in the k-th first image, where j=1, 2, ..., N. The pixel information includes: color component information, the color component information includes: a first color component value, a second color component value, and a third color component value, the first color, the second color, and the third color are respectively one of red, green, and blue, and are different colors; The obtaining, according to information of a pixel point in the i-th row and j-th column of the first view image and information of a pixel point in the i-th row and j-th column of the k-th second view image, information of a pixel point in the i-th row and j-th column of the k-th first image comprises: Obtaining, according to the color component information of the pixel in the i-th row and j-th column of the first view image, a grayscale value of the pixel in the i-th row and j-th column of the first view image; obtaining, according to the color component information of the pixel in the i-th row and j-th column of the k-th second view image, a grayscale value of the pixel in the i-th row and j-th column of the k-th second view image; when the difference between the grayscale value of the pixel in the i-th row and j-th column of the first view image and the grayscale value of the pixel in the i-th row and j-th column of the k-th second view image is less than a threshold difference, the pixel in the i-th row and j-th column of the k-th first image is a black pixel; and when the difference between the grayscale value of the pixel in the i-th row and j-th column of the first view image and the grayscale value of the pixel in the i-th row and j-th column of the k-th second view image is greater than the threshold difference, the pixel in the i-th row and j-th column of the k-th first image is a white pixel; Alternatively, a first color component value of the pixel in the i-th row and j-th column of the first view image is subtracted from the first color component value of the pixel in the i-th row and j-th column of the k-th second view image to obtain a first color component difference; a second color component value of the pixel in the i-th row and j-th column of the first view image is subtracted from the second color component value of the pixel in the i-th row and j-th column of the k-th second view image to obtain a second color component difference; a third color component value of the pixel in the i-th row and j-th column of the first view image is subtracted from the third color component value of the pixel in the i-th row and j-th column of the k-th second view image to obtain a third color component difference; a grayscale difference is obtained based on the first color component difference, the second color component difference, and the third color component difference; when the grayscale difference is less than a threshold difference, the pixel in the i-th row and j-th column of the k-th first image is a black pixel, and when the grayscale difference is greater than the threshold difference, the pixel in the i-th row and j-th column of the k-th first image is a white pixel; When the colors of the pixels in the i-th row and j-th column of the k-th second view image are different, the threshold difference values ​​when obtaining the k-th first image are different; The method of obtaining K-1 coded images according to the first view image, K-1 second view images and K-1 first images includes: using the first row of pixels of the first view image as the first row of pixels of each coded image; scanning the first row of pixels of the k-th first image; when there are no white pixels in the first row of pixels of the k-th first image, selecting the next row of pixels of the first view image as the next row of pixels of the k-th coded image; when there are white pixels in the first row of pixels of the k-th first image, obtaining position information of the white pixels and the pixel points corresponding to the white pixels in the k-th second view image; , and store the position information of the white pixel and the information of the pixel corresponding to the white pixel in the second viewpoint image in two adjacent pixels of the next row of pixels in the k-th encoded image, and scan the r-th row of pixels of the k-th first image in sequence until the scanning of the last row of pixels of the k-th first image is completed to obtain the k-th encoded image, 2≤r≤M; the position information includes: the row number and column number of the white pixel in the first image, and the pixel corresponding to the white pixel in the second viewpoint image is the pixel in the second viewpoint image located at the row number and column number of the white pixel in the first image.

18. The method according to claim 14, wherein The obtaining of M display information according to the plurality of coded images comprises: obtaining K-1 second view images according to K-1 coded images, wherein the k-th second view image is obtained according to the k-th coded image; and obtaining M display information according to the first view image and the K-1 second view images; The obtaining of the K-1 second view image according to the K-1 coded images includes: using the first row of pixels of the k-th coded image as the first row of pixels of the k-th second view image, scanning the next row of pixels of the k-th coded image, and if the next row of pixels includes position information, obtaining information of pixels stored in neighboring pixels of the pixel including the position information, and updating information of pixels located at the position information in the k-th second view image to information of pixels stored in neighboring pixels of the pixel including the position information; if the next row of pixels does not include position information, using the next row of pixels of the k-th coded image as the next row of pixels of the k-th second view image, sequentially scanning the r-th row of pixels of the k-th coded image until the last row of pixels of the k-th coded image is scanned, thereby obtaining the k-th second view image; The obtaining of M display information of K viewpoint images according to the first viewpoint image and K-1 second viewpoint images comprises: sequentially obtaining pixel points in the i-th row of the K viewpoint images; and obtaining M display information according to pixel points in the first row to the M-th row of the K viewpoint images. The performing stereoscopic display according to the M display information includes: displaying the i-th row of the K viewpoint images according to the i-th display information.

19. The method according to claim 14, wherein The encoding of K viewpoint images to generate multiple encoded images includes: extracting the i-th row of pixels from each viewpoint image in sequence to form M second images, each second image including: K rows and N columns of pixels, the n-th row of pixels of the i-th second image being the i-th row of pixels of the n-th viewpoint image, n = 1, 2, ..., K; encoding the M second images to generate M encoded images.

20. The method according to claim 14, wherein The method of obtaining M display information of K viewpoint images based on multiple encoded images includes: decoding the M encoded images in sequence to obtain M second images, where the i-th second image includes the i-th display information; and displaying the i-th row of the K viewpoint images based on the i-th second image.

Images