Integrated imaging display system, integrated imaging display processing method and virtual device

Abstract

The invention provides an integrated imaging display system, an integrated imaging display processing method and a virtual device.The system comprises a liquid crystal panel lamination layer and an optical device array, and the liquid crystal panel lamination layer is arranged on one side of the optical device array and comprises a plurality of liquid crystal panels with preset intervals; the optical device array is used for coding each to-be-displayed image displayed in each liquid crystal panel on each imaging plane corresponding to each liquid crystal panel to form each three-dimensional image unit, so that each three-dimensional image unit is formed by adjusting the distance between each liquid crystal panel and the optical device array; and enabling the depths of field of the three-dimensional image units formed in the imaging planes to be connected and to be spliced to form three-dimensional imaging display which has continuous depths of field and corresponds to the to-be-displayed image, and obtaining complete coding information of the to-be-displayed image based on the to-be-displayed image coding displayed in the liquid crystal panels. The complexity of the imaging system can be reduced on the premise of improving the imaging depth of field.

Description

Technical Field

[0001] The present invention relates to the field of integral imaging technology, and in particular to an integral imaging display system, an integral imaging display processing method, and a virtual device. Background Art

[0002] As a typical light field display technology, integral imaging forms an image of a two-dimensional plane in space through a lens array and stitches it into a complete image with parallax in different directions. Since the viewer's two eyes receive signals with parallax, a three-dimensional stereoscopic effect scene can be perceived.

[0003] As can be known from related technologies, current integral imaging systems usually use a single-layer display panel as an image source, and its imaging process is limited by the physical characteristics of a single main imaging plane. Specifically, the lens array can only form a clear main image plane at a fixed depth position, resulting in a severely limited depth of field range of the display scene and making it difficult to restore the sense of hierarchy of objects in a real three-dimensional space. In addition, currently, a combination of semi-transmissive and semi-reflective optical elements is proposed to combine two sets of integral imaging devices with different imaging distances, attempting to expand the total depth of field through optical superposition. However, this method is difficult to assemble and align.

[0004] Therefore, finding an integral imaging display system that can reduce the complexity of the imaging system while increasing the imaging depth of field has become a current research hotspot. Summary of the Invention

[0005] The present invention provides an integral imaging display system, an integral imaging display processing method, and a virtual device, which can reduce the complexity of the imaging system while increasing the imaging depth of field.

[0006] The present invention provides an integral imaging display system, the system includes a liquid crystal panel stack and an optical device array, wherein, the liquid crystal panel stack is arranged on one side of the optical device array and includes a plurality of liquid crystal panels with a preset interval; the optical device array is used to encode each to-be-displayed image displayed in each liquid crystal panel to form each stereoscopic image unit in each imaging plane corresponding to each liquid crystal panel, so that by adjusting the distance between the liquid crystal panel and the optical device array, the depth of field of each stereoscopic image unit formed in each imaging plane is connected, and stitched to form a stereoscopic imaging display corresponding to the to-be-displayed image with a continuous depth of field, wherein, based on the encoding of each to-be-displayed image displayed in each liquid crystal panel, complete encoding information of the to-be-displayed image can be obtained.

[0007] An integral imaging display system provided by the present invention, wherein the liquid crystal panel stack is disposed on one side of the optical device array, and specifically includes: each liquid crystal panel in the liquid crystal panel stack is disposed on one side of the optical device array and within the focal length of the optical device array, or each liquid crystal panel in the liquid crystal panel stack is disposed on one side of the optical device array and outside the focal length of the optical device array, or each liquid crystal panel in the liquid crystal panel stack is disposed on one side of the optical device array, and some of the liquid crystal panels are outside the focal length of the optical device array while the other liquid crystal panels are within the focal length of the optical device array.

[0008] An integral imaging display system provided by the present invention, wherein the image to be displayed is an image with a foreground and a background; encoding of each image to be displayed is performed in each liquid crystal panel by the following method: based on the Gaussian formula, determining the distance between the image depth of different depth-of-field sub-images in the image to be displayed and each imaging plane; encoding each image to be displayed corresponding to different depth-of-field sub-images and encoding and displaying them on each target liquid crystal panel, where the target liquid crystal panel is the liquid crystal panel corresponding to the target imaging plane, and the target imaging plane is the imaging plane corresponding to the minimum distance between the image depth of the depth-of-field sub-image and the imaging plane.

[0009] An integral imaging display system provided by the present invention, wherein the optical device array includes a one-dimensional optical device array and / or a two-dimensional optical device array, wherein the one-dimensional optical device array provides one-dimensional parallax; the two-dimensional optical device array provides two-dimensional full parallax.

[0010] An integral imaging display system provided by the present invention, wherein a diffusion film is provided between adjacent liquid crystal panels in the liquid crystal panel stack and / or on the outermost liquid crystal panel.

[0011] An integral imaging display system provided by the present invention, wherein the polarization directions of the liquid crystal panels in the liquid crystal panel stack are staggered to reduce interlayer light interference.

[0012] The present invention also provides an integral imaging display processing method, which is applied to the integral imaging display system described above. The method includes: acquiring an image to be displayed, where the image to be displayed is an image with a foreground and a background; encoding the images to be displayed corresponding to different depth-of-field sub-images in the image to be displayed and encoding and displaying them on each liquid crystal panel; encoding each image to be displayed displayed on each liquid crystal panel on each imaging plane corresponding to each liquid crystal panel based on the optical device array to form each stereoscopic image unit, so that by adjusting the distance between the liquid crystal panel and the optical device array, the depth of field of each stereoscopic image unit formed on each imaging plane is connected, and a stereoscopic imaging display corresponding to the image to be displayed with continuous depth of field is spliced.

[0013] An integrated imaging display processing method provided by the present invention encodes the images to be displayed corresponding to sub-images with different depths of field in the image to be displayed and encodes and displays them on each liquid crystal panel, which is implemented in the following manner: based on the Gaussian formula, determine the distance between the image depth of the sub-images with different depths of field in the image to be displayed and each imaging plane; encode the images to be displayed corresponding to the sub-images with different depths of field and encode and display them on each target liquid crystal panel, where the target liquid crystal panel is the liquid crystal panel corresponding to the target imaging plane, and the target imaging plane is the imaging plane corresponding to the minimum distance between the image depth of the sub-image with depth of field and the imaging plane.

[0014] An integrated imaging display processing method provided by the present invention further includes: obtaining an imaging display type request for stereoscopic imaging display corresponding to the image to be displayed; in the case where the imaging display type request is a virtual image imaging display type request, based on the virtual image imaging display type request, arrange each of the liquid crystal panels in the liquid crystal panel stack on one side of the optical device array and within the focal length of the optical device array; in the case where the imaging display type request is a real image imaging display type request, based on the real image imaging display type request, arrange each of the liquid crystal panels in the liquid crystal panel stack on one side of the optical device array and outside the focal length of the optical device array; in the case where the imaging display type request is a real and virtual image hybrid imaging display type request, based on the real and virtual image hybrid imaging display type request, arrange each of the liquid crystal panels in the liquid crystal panel stack on one side of the optical device array, and part of the liquid crystal panels are outside the focal length of the optical device array and the other part of the liquid crystal panels are within the focal length of the optical device array.

[0015] The present invention also provides a virtual device for integrated imaging display processing. The virtual device is applied to the integrated imaging display system according to any one of the above. The virtual device includes: an acquisition module for acquiring an image to be displayed, where the image to be displayed is an image with a foreground and a background; an encoding module for encoding the images to be displayed corresponding to the sub-images with different depths of field in the image to be displayed and encoding and displaying them on each liquid crystal panel; a display module for encoding the images to be displayed displayed on each liquid crystal panel on each imaging plane corresponding to each liquid crystal panel based on the optical device array to form each stereoscopic image unit, so that by adjusting the distance between the liquid crystal panel and the optical device array, the depths of field of the stereoscopic image units formed on each imaging plane are connected and spliced to form a stereoscopic imaging display corresponding to the image to be displayed with a continuous depth of field.

[0016] The present invention also provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the computer program, the integrated imaging display processing method as described in any one of the above is implemented.

[0017] The present invention also provides a non-transitory computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the integrated imaging display processing method as described in any one of the above is implemented.

[0018] The present invention also provides a computer program product, including a computer program. When the computer program is executed by a processor, the integrated imaging display processing method as described in any one of the above is implemented.

[0019] The integrated imaging display system, integrated imaging display processing method, and virtual device provided by the present invention include a liquid crystal panel stack and an optical device array. Among them, the liquid crystal panel stack is disposed on one side of the optical device array and includes a plurality of liquid crystal panels with a preset interval; the optical device array is used to encode each to-be-displayed image displayed in each liquid crystal panel into each three-dimensional image unit formed on each imaging plane corresponding to each liquid crystal panel, so that by adjusting the distance between the liquid crystal panel and the optical device array, the depth of field of each three-dimensional image unit formed on each imaging plane is connected, and stitched to form a three-dimensional imaging display corresponding to the to-be-displayed image with a continuous depth of field. Among them, based on the encoding of each to-be-displayed image displayed in each liquid crystal panel, complete encoding information of the to-be-displayed image can be obtained. It realizes reducing the complexity of the imaging system while improving the imaging depth of field. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the drawings in the following description are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0021] Figure 1 It is a schematic diagram of an application scenario of the integrated imaging display system provided by the present invention.

[0022] Figure 2 It is one of the flow schematic diagrams of the integrated imaging display processing method provided by the present invention.

[0023] Figure 3 It is a flow schematic diagram of the to-be-displayed image encoding corresponding to different depth-of-field sub-images in the to-be-displayed image provided by the present invention, and the encoding is displayed on each liquid crystal panel.

[0024] Figure 4It is the second flowchart diagram of the integrated imaging display processing method provided by the present invention.

[0025] Figure 5 It is the structural schematic diagram of the integrated imaging display virtual device provided by the present invention.

[0026] Figure 6 It is the structural schematic diagram of the electronic device provided by the present invention. Description of the Drawings: 100: Integrated imaging display system; 110: Liquid crystal panel stack. 120: Optical device array; 130: Imaging plane. Detailed Embodiments

[0028] To make the objectives, technical solutions and advantages of the present invention clearer, the technical solutions in the present invention will be clearly and completely described below with reference to the accompanying drawings in the present invention. Apparently, the described embodiments are some but not all of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in the present invention without making creative efforts shall fall within the protection scope of the present invention.

[0029] Figure 1 It is the application scenario schematic diagram of the integrated imaging display system provided by the present invention.

[0030] Next, the structure of the integrated imaging display system provided by the present invention will be described in conjunction with Figure 1 In an exemplary embodiment of the present invention, as can be seen from

[0031] In an exemplary embodiment of the present invention, in combination with Figure 1 it can be known that the integrated imaging display system 100 may include a liquid crystal panel stack 110 and an optical device array 120. The following will introduce each component separately.

[0032] In one embodiment, the liquid crystal panel stack 110 may be disposed on one side of the optical device array 120; wherein, the liquid crystal panel stack 110 may include a plurality of liquid crystal panels with a preset interval. The liquid crystal panel may be a conventional liquid crystal display screen, and each liquid crystal panel can independently display an image to be displayed. It should be noted that the images to be displayed in each liquid crystal panel may be parts or perspectives that make up the final stereoscopic image. The preset interval between the liquid crystal panels can be adjusted according to actual needs to ensure that the images displayed by each liquid crystal panel will not interfere with each other during subsequent encoding.

[0033] In yet another embodiment, the optical device array 120 is configured to encode each image to be displayed in each liquid crystal panel into each stereoscopic image unit formed on each imaging plane 130 corresponding to each liquid crystal panel, so that by adjusting the distance between the liquid crystal panel and the optical device array 120, the depth of field of each stereoscopic image unit formed on each imaging plane 130 is connected, and they are spliced to form a stereoscopic imaging display corresponding to the image to be displayed with a continuous depth of field, wherein the complete encoded information of the image to be displayed can be obtained based on the encoding of each image to be displayed in each liquid crystal panel.

[0034] During application, the optical elements in the optical device array 120 can project the images on the liquid crystal panel onto different imaging planes 130 in a specific manner, thereby forming multiple stereoscopic image units.

[0035] Furthermore, by adjusting the distance between the liquid crystal panel and the optical device array 120, the depth of field of the stereoscopic image units formed on each imaging plane 130 can be connected to each other. This means that the stereoscopic image units on different imaging planes 130 can smoothly transition in the depth direction to form a stereoscopic imaging display with a continuous depth of field. In addition, these stereoscopic image units are spliced together in the horizontal or vertical direction to form a complete stereoscopic image. Since each liquid crystal panel displays a part or perspective of the image to be displayed, a complete stereoscopic imaging display corresponding to the image to be displayed can be obtained by splicing these stereoscopic image units.

[0036] In yet another embodiment, the optical device array 120 can be a one-dimensional optical device array. For example, it can be a group of cylindrical lens gratings arranged horizontally, which can provide one-dimensional parallax to provide horizontal stereoscopic information. When the viewer moves horizontally, a sense of stereoscopy can be felt; the optical device array 120 can also be a two-dimensional optical device array. For example, it can be a lens array, which can provide two-dimensional full parallax, and the viewer can feel stereoscopic information when moving up, down, left, or right. Among them, Figure 1 the optical device array 120 in shows both a one-dimensional optical device array and a two-dimensional optical device array.

[0037] In this embodiment, the multi-layer liquid crystal panel can provide multiple display imaging depths, and each imaging depth has a certain display depth of field. The display depth of field is related to the imaging characteristics of the optical device. By adjusting the distance between the multi-layers of liquid crystals, the depth of field position of each layer can be adjusted. When their depths of field can be connected in space, a continuous large depth of field can be obtained. Within this depth of field range, a sense of stereoscopy can be effectively provided, and the display depth is large. The integrated imaging display system 100 provided by the present invention realizes a stereoscopic imaging display with a continuous depth of field through the combined use of the liquid crystal panel stack 110 and the optical device array 120. The implementation manner of this system is simple and effective, and has high practical value and application prospects.

[0038] The integrated imaging display system 100 provided by the present invention includes a liquid crystal panel stack 110 and an optical device array 120. Among them, the liquid crystal panel stack 110 is disposed on one side of the optical device array 120 and includes a plurality of liquid crystal panels with a preset interval; the optical device array 120 is configured to encode each to-be-displayed image displayed in each liquid crystal panel into each stereoscopic image unit formed on each imaging plane 130 corresponding to each liquid crystal panel, so that by adjusting the distance between the liquid crystal panel and the optical device array 120, the depths of field of the stereoscopic image units formed on each imaging plane 130 are connected and spliced to form a stereoscopic imaging display corresponding to the to-be-displayed image with a continuous depth of field. Among them, the complete encoding information of the to-be-displayed image can be obtained based on the encoding of each to-be-displayed image displayed in each liquid crystal panel. It realizes reducing the complexity of the imaging system on the premise of improving the imaging depth of field.

[0039] In another exemplary embodiment of the present invention, continuing with the example described above, the liquid crystal panel stack 110 is disposed on one side of the optical device array 120, specifically including: Each liquid crystal panel in the liquid crystal panel stack 110 is disposed on one side of the optical device array 120 and within the focal length of the optical device array 120, or Each liquid crystal panel in the liquid crystal panel stack 110 is disposed on one side of the optical device array 120 and outside the focal length of the optical device array 120, or Each liquid crystal panel in the liquid crystal panel stack 110 is disposed on one side of the optical device array 120, and some liquid crystal panels are outside the focal length of the optical device array 120, and the other part of the liquid crystal panels are within the focal length of the optical device array 120.

[0040] In one embodiment, the positions of the liquid crystal panels in the liquid crystal panel stack 110 can also be adjusted according to the focal length of the optical device array 120 to achieve an out-of-screen stereoscopic or in-of-screen stereoscopic effect.

[0041] When each liquid crystal panel in the liquid crystal panel stack 110 is placed outside the focal length of the optical device array 120, it is a real image mode, which can provide an out-of-screen, continuous-depth stereoscopic effect; When each liquid crystal panel in the liquid crystal panel stack 110 is placed within the focal length of the optical device array 120, it is a virtual image mode, which can provide an in-of-screen, continuous-depth stereoscopic effect.

[0042] When the two are mixed, that is, some liquid crystal panels in the liquid crystal panel stack 110 are outside the focal length of the optical device array 120, and the other part of the liquid crystal panels are within the focal length of the optical device array 120, an out-of-screen and in-of-screen, continuous-depth stereoscopic effect can be provided simultaneously. Thus, different imaging display requirements of users can be met.

[0043] In another exemplary embodiment of the present invention, taking the embodiment described above as an example, the image to be displayed may be an image with a foreground and a background; in each liquid crystal panel, encoding each image to be displayed may be implemented in the following manner: Based on the Gaussian formula, determine the distance between the image depths of sub-images with different depths of field in the image to be displayed and each imaging plane; Encode each image to be displayed corresponding to sub-images with different depths of field, and encode and display them on each target liquid crystal panel, where the target liquid crystal panel is the liquid crystal panel corresponding to the target imaging plane, and the target imaging plane is the imaging plane corresponding to the minimum distance between the image depth of the sub-image with depth of field and the imaging plane.

[0044] In one embodiment, during image acquisition and imaging, according to the Gaussian imaging formula, it can be determined which imaging plane is closer, so as to image the image on this plane, that is, image the corresponding image on the target imaging plane. Further, during encoding and display, only the content of one liquid crystal panel is displayed under each lens between multiple liquid crystal panels. Each layer images the image (the image corresponding to the encoding of each image to be displayed) at the position closest to the three-dimensional object (corresponding to the image to be displayed). Thus, the original three-dimensional information can be better restored using multiple layers. Using this method, there will be no interference between multiple liquid crystals, so methods such as timing refreshing are not required, and thus an effective display method with continuous depth can be formed.

[0045] During application, based on the Gaussian formula, the distance between the image depths of sub-images with different depths of field in the image to be displayed and each imaging plane can be determined; further, each image to be displayed corresponding to sub-images with different depths of field is encoded and displayed on each target liquid crystal panel. The target liquid crystal panel is the liquid crystal panel corresponding to the target imaging plane, the target liquid crystal panel is the imaging plane corresponding to the minimum distance between the image depth of the sub-image with depth of field and the imaging plane, and the target imaging plane is also the "plane" described in "during image acquisition and imaging, according to the Gaussian imaging formula, it can be determined which imaging plane is closer, so as to image the image on this plane" described above.

[0046] In another exemplary embodiment of the present invention, the optical device array 120 may include a one-dimensional optical device array and / or a two-dimensional optical device array, where the one-dimensional optical device array provides one-dimensional parallax; the two-dimensional optical device array provides two-dimensional full parallax.

[0047] In one embodiment, the optical device array 120 may include a one-dimensional optical device array. Among them, the one-dimensional optical device array may be a group of cylindrical lens gratings arranged horizontally, which can provide one-dimensional parallax to provide horizontal stereoscopic information. When the viewer moves horizontally, a sense of three-dimensionality can be felt. The optical device array 120 may include a two-dimensional optical device array. Among them, the two-dimensional optical device array may be a lens array, which can provide two-dimensional full parallax, and the viewer can feel stereoscopic information when moving up, down, left, or right.

[0048] In another exemplary embodiment of the present invention, a diffusion film may be provided between adjacent liquid crystal panels in the liquid crystal panel stack 110, and / or on the outermost liquid crystal panel.

[0049] In one embodiment, in order to reduce moiré patterns, an AG film or a similar diffusion film may be inserted between every two layers and on the outermost liquid crystal panel.

[0050] In another exemplary embodiment of the present invention, the polarization directions of the liquid crystal panels in the liquid crystal panel stack 110 are staggered to reduce interlayer light interference.

[0051] In one embodiment, the polarization directions of the liquid crystal panels in the liquid crystal panel stack 110 may be staggered, so as to be able to reduce interlayer light interference.

[0052] In another embodiment, a high-brightness backlight may also be used to improve the display brightness of each layer of liquid crystal panel, so as to avoid the problem of darkening of multiple layers of liquid crystal panels.

[0053] According to the foregoing description, the integrated imaging display system provided by the present invention places multiple layers of liquid crystals (corresponding to the liquid crystal panel stack) on one side of a one-dimensional or two-dimensional optical device array, and the viewer can see horizontal parallax or full parallax content on the other side. In addition, multiple layers of liquid crystals can provide multiple display imaging depths, and their spacing is adjusted by the spacing. When the depth of field of each layer is connected, a continuous three-dimensional depth will be obtained. The display depth of field is large and the effect is good. This method provides a new solution for the wide application of future three-dimensional displays, thus solving the problems that the current integrated imaging-based light field display systems generally have a single display depth, a small depth of field, or the problem of difficult multi-device splicing.

[0054] Based on the same inventive concept, the present invention also provides an integrated imaging display processing method, which will be described below in conjunction with the following embodiments.

[0055] Figure 2 It is one of the flow schematic diagrams of the integrated imaging display processing method provided by the present invention.

[0056] In an exemplary embodiment of the present invention, the integrated imaging display processing method may be applied to the integrated imaging display system described above, in combination with Figure 1It can be known that the integral imaging display processing method may include step 210 to step 230, and each step will be introduced separately below.

[0057] In step 210, an image to be displayed is acquired, where the image to be displayed is an image with a foreground and a background; In step 220, the images to be displayed corresponding to sub-images with different depths of field in the image to be displayed are encoded and displayed on each liquid crystal panel; In step 230, based on the optical device array, the images to be displayed displayed on each liquid crystal panel are encoded into respective three-dimensional image units formed on respective imaging planes corresponding to each liquid crystal panel, so that by adjusting the distance between the liquid crystal panel and the optical device array, the depths of field of the respective three-dimensional image units formed on each imaging plane are connected, and are spliced to form a three-dimensional imaging display corresponding to the image to be displayed with a continuous depth of field.

[0058] In one embodiment, an image to be displayed can be acquired. Among them, the image to be displayed may be an image containing a foreground and a background, such as a photo containing a person in the foreground and a landscape in the background.

[0059] Furthermore, the sub-images with different depths of field in the image to be displayed can be encoded to obtain the encoded image to be displayed. Specifically, image processing technology can be used to separate regions with different depths of field such as the foreground, middle ground, and background in the image, and encode the image of each region to obtain the encoded image to be displayed, and the encoded images to be displayed corresponding to the sub-images with different depths of field are encoded and displayed on each liquid crystal panel.

[0060] In another embodiment, based on the optical device array, the images to be displayed displayed on each liquid crystal panel can be encoded into respective three-dimensional image units formed on respective imaging planes corresponding to each liquid crystal panel. These three-dimensional image units visually present different depth-of-field effects, respectively corresponding to different depth-of-field regions in the original image. Furthermore, the distance between the liquid crystal panel and the optical device array can be adjusted so that the depths of field of the respective three-dimensional image units formed on each imaging plane are connected, and are spliced to form a three-dimensional imaging display corresponding to the image to be displayed with a continuous depth of field. Among them, the three-dimensional imaging display corresponds to the original image to be displayed, but visually presents a more real and three-dimensional effect.

[0061] In this embodiment, an integrated imaging display system is used to realize a three-dimensional imaging display with a continuous depth of field. This method not only improves the three-dimensional sense of the image, but also enables the observer to more realistically feel the spatial relationship in the image and improves the imaging depth of field.

[0062] Figure 3 It is a schematic flow diagram of the encoded images to be displayed corresponding to the sub-images with different depths of field in the image to be displayed provided by the present invention, which are encoded and displayed on each liquid crystal panel.

[0063] The following will be combined Figure 3 The process of encoding the image to be displayed corresponding to the sub-images with different depths of field in the image to be displayed and displaying the encoding on each liquid crystal panel is described.

[0064] In an exemplary embodiment of the present invention, Figure 3 It can be known that the image to be displayed corresponding to the sub-images with different depths of field in the image to be displayed is encoded and displayed on each liquid crystal panel, which may include step 310 and step 320. Each step will be introduced below.

[0065] In step 310, based on the Gaussian formula, the image depths of sub-images with different depths of field in the image to be displayed and the distances between each imaging plane are determined; In step 320, each image to be displayed corresponding to a sub-image with different depths of field is encoded and displayed on each target liquid crystal panel, wherein the target liquid crystal panel is a liquid crystal panel corresponding to a target imaging plane, and the target imaging plane is an imaging plane corresponding to the image depth of the depth of field sub-image and the imaging plane having the minimum distance.

[0066] In one embodiment, when collecting images, it is possible to determine which imaging plane is closer based on the Gaussian imaging formula, so that the image is imaged on that plane, that is, the corresponding image is imaged on the target imaging plane. Furthermore, when encoding and displaying, only one layer of liquid crystal panel content is displayed under each lens between the multiple layers of liquid crystal panels. Each layer images the image (the image corresponding to the encoding of each image to be displayed) at the position closest to the three-dimensional object (corresponding to the image to be displayed), thereby using multiple layers to better restore the original three-dimensional information. Using this method, there will be no interference between multiple layers of liquid crystal, so there is no need for methods such as timed refresh, thereby forming an effective display method with continuous depth.

[0067] In the application process, the image depth of different depth of field sub-images in the image to be displayed and the distance from each imaging plane can be determined based on the Gaussian formula; further, each image to be displayed corresponding to the different depth of field sub-images is encoded and displayed on each target liquid crystal panel. Among them, the target liquid crystal panel is the liquid crystal panel corresponding to the target imaging plane, and the target liquid crystal panel is the imaging plane corresponding to the image depth of the depth of field sub-image and the imaging plane as the minimum distance. The target imaging plane is also the "plane" mentioned in the above "When acquiring images, it can be determined according to the Gaussian imaging formula which layer of imaging plane is closer, so that the image is imaged on this plane".

[0068] Figure 4 This is the second flow chart of the integrated imaging display processing method provided by the present invention.

[0069] The following will be combined Figure 4Describe the process of another integral imaging display processing method.

[0070] In an exemplary embodiment of the present invention, combined with Figure 4 it can be known that the integral imaging display processing method may further include steps 410 to 440, and each step will be introduced separately below.

[0071] In step 410, obtain an imaging display type request for stereoscopic imaging display corresponding to the image to be displayed; In step 420, when the imaging display type request is a virtual image imaging display type request, based on the virtual image imaging display type request, arrange each liquid crystal panel in the liquid crystal panel stack on one side of the optical device array and within the focal length of the optical device array; In step 430, when the imaging display type request is a real image imaging display type request, based on the real image imaging display type request, arrange each liquid crystal panel in the liquid crystal panel stack on one side of the optical device array and outside the focal length of the optical device array; In step 440, when the imaging display type request is a real and virtual image hybrid imaging display type request, based on the real and virtual image hybrid imaging display type request, arrange each liquid crystal panel in the liquid crystal panel stack on one side of the optical device array, with some liquid crystal panels outside the focal length of the optical device array and some liquid crystal panels within the focal length of the optical device array.

[0072] In one embodiment, it is possible to obtain an imaging display type request for stereoscopic imaging display corresponding to the image to be displayed.

[0073] In one example, when the imaging display type request is a virtual image imaging display type request, based on the virtual image imaging display type request, arrange each liquid crystal panel in the liquid crystal panel stack on one side of the optical device array and within the focal length of the optical device array. In this scenario, it is a virtual image mode, which can provide an in-screen, continuous-depth stereoscopic effect.

[0074] In another example, when the imaging display type request is a real image imaging display type request, based on the real image imaging display type request, arrange each liquid crystal panel in the liquid crystal panel stack on one side of the optical device array and outside the focal length of the optical device array. In this scenario, it is a real image mode, which can provide an out-of-screen, continuous-depth stereoscopic effect.

[0075] In yet another example, in the case where the imaging display type request is a real image and virtual image hybrid imaging display type request, based on the real image and virtual image hybrid imaging display type request, each liquid crystal panel in the liquid crystal panel stack can be disposed on one side of the optical device array, and some liquid crystal panels are located outside the focal length of the optical device array, and another part of the liquid crystal panels are located within the focal length of the optical device array. In this scenario, a stereoscopic effect with continuous depth that exits and enters the screen can be provided simultaneously. Thus, different imaging display requirements of users can be satisfied.

[0076] The integrated imaging display processing virtual device provided by the present invention will be described below. The integrated imaging display processing virtual device described below can be correspondingly referred to the integrated imaging display method described above.

[0077] Figure 5 It is a schematic structural diagram of the integrated imaging display processing virtual device provided by the present invention.

[0078] In yet another exemplary embodiment of the present invention, the integrated imaging display processing virtual device can be applied to the integrated imaging display system described in any one of the foregoing, and in combination with Figure 5 it can be known that the virtual device may include an acquisition module 510, an encoding module 520, and a display module 530. Each module will be introduced separately below.

[0079] The acquisition module 510 can be configured to acquire an image to be displayed, where the image to be displayed is an image with a foreground and a background; The encoding module 520 can be configured to encode the image to be displayed corresponding to different depth-of-field sub-images in the image to be displayed and encode and display them on each liquid crystal panel; The display module 530 can be configured to encode each image to be displayed displayed on each liquid crystal panel into each stereoscopic image unit formed on each imaging plane corresponding to each liquid crystal panel based on the optical device array, so that by adjusting the distance between the liquid crystal panel and the optical device array, the depth of field of each stereoscopic image unit formed on each imaging plane is connected, and they are spliced to form a stereoscopic imaging display corresponding to the image to be displayed with continuous depth of field.

[0080] In yet another exemplary embodiment of the present invention, the encoding module 520 can implement the encoding of the image to be displayed corresponding to different depth-of-field sub-images in the image to be displayed and encode and display them on each liquid crystal panel in the following manner: Based on the Gaussian formula, determine the image depth of different depth-of-field sub-images in the image to be displayed and the distance from each imaging plane; Encode each image to be displayed corresponding to sub-images with different depths of field, and encode and display them on each target liquid crystal panel, where the target liquid crystal panel is the liquid crystal panel corresponding to the target imaging plane, and the target imaging plane is the imaging plane corresponding to the minimum distance between the image depth of the sub-image with depth of field and the imaging plane.

[0081] In another exemplary embodiment of the present invention, the display module 530 can also be configured to: Obtain an imaging display type request for stereoscopic imaging display corresponding to the image to be displayed; In the case where the imaging display type request is a virtual image imaging display type request, based on the virtual image imaging display type request, set each of the liquid crystal panels in the liquid crystal panel stack on one side of the optical device array and within the focal length of the optical device array; In the case where the imaging display type request is a real image imaging display type request, based on the real image imaging display type request, set each of the liquid crystal panels in the liquid crystal panel stack on one side of the optical device array and outside the focal length of the optical device array; In the case where the imaging display type request is a real image and virtual image hybrid imaging display type request, based on the real image and virtual image hybrid imaging display type request, set each of the liquid crystal panels in the liquid crystal panel stack on one side of the optical device array, and part of the liquid crystal panels are outside the focal length of the optical device array, and the other part of the liquid crystal panels are within the focal length of the optical device array.

[0082] Figure 6 An exemplary schematic diagram of the physical structure of an electronic device is shown as Figure 6 shown. The electronic device may include: a processor 610, a communication interface 620, a memory 630, and a communication bus 640. Among them, the processor 610, the communication interface 620, and the memory 630 communicate with each other through the communication bus 640. The processor 610 can call the logical instructions in the memory 630 to execute an integrated imaging display processing method, which is applied to the integrated imaging display system described in any one of the above, and the method includes: obtaining an image to be displayed, where the image to be displayed is an image with a foreground and a background; encoding the images to be displayed corresponding to the sub-images with different depths of field in the image to be displayed, and encoding and displaying them on each liquid crystal panel; encoding each image to be displayed displayed on each liquid crystal panel on each imaging plane corresponding to each liquid crystal panel through an optical device array to form each stereoscopic image unit, so that by adjusting the distance between the liquid crystal panel and the optical device array, the depths of field of each stereoscopic image unit formed on each imaging plane are connected and spliced to form a stereoscopic imaging display corresponding to the image to be displayed with continuous depth of field.

[0083] In addition, when the logical instructions in the above-mentioned memory 630 are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes: various media such as USB flash drives, mobile hard disks, read-only memories (ROM, Read-Only Memory), random access memories (RAM, Random Access Memory), magnetic disks, or optical discs that can store program codes.

[0084] On the other hand, the present invention also provides a computer program product. The computer program product includes a computer program that can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the integrated imaging display processing method provided by the above-mentioned various methods. The method is applied to the integrated imaging display system described in any one of the above, and the method includes: obtaining an image to be displayed, where the image to be displayed is an image with a foreground and a background; encoding the image to be displayed corresponding to different depth-of-field sub-images in the image to be displayed and encoding and displaying them on each liquid crystal panel; encoding each image to be displayed displayed on each liquid crystal panel on each imaging plane corresponding to each liquid crystal panel based on an optical device array to form each three-dimensional image unit, so that by adjusting the distance between the liquid crystal panel and the optical device array, the depth of field of each three-dimensional image unit formed on each imaging plane is connected, and they are spliced to form a three-dimensional imaging display corresponding to the image to be displayed with a continuous depth of field.

[0085] In another aspect, the present invention also provides a non-transitory computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, it implements the integrated imaging display processing method provided by the above-mentioned various methods. The method is applied to any one of the integrated imaging display systems, and the method includes: obtaining an image to be displayed, where the image to be displayed is an image with a foreground and a background; encoding the image to be displayed corresponding to different depth-of-field sub-images in the image to be displayed, and encoding and displaying on each liquid crystal panel; based on an optical device array, encoding each image to be displayed displayed on each liquid crystal panel on each imaging plane corresponding to each liquid crystal panel to form each stereoscopic image unit, so that by adjusting the distance between the liquid crystal panel and the optical device array, the depth of field of each stereoscopic image unit formed on each imaging plane is connected, and stitched to form a stereoscopic imaging display corresponding to the image to be displayed with a continuous depth of field.

[0086] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art can understand and implement it without creative work.

[0087] Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on this understanding, the essence of the above technical solution, or the part that contributes to the prior art, can be embodied in the form of a software product. The computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disc, etc., and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0088] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and are not intended to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. An integrated imaging display system, characterized in that: The system includes a liquid crystal panel stack and an optical device array, wherein: The liquid crystal panel stack is arranged on one side of the optical device array and includes a plurality of liquid crystal panels with a preset interval; The optical device array is used to encode each image to be displayed displayed in each liquid crystal panel on each imaging plane corresponding to each liquid crystal panel to form each stereoscopic image unit, so that by adjusting the distance between the liquid crystal panel and the optical device array, the depth of field of each stereoscopic image unit formed on each imaging plane is connected, and spliced ​​to form a stereoscopic imaging display corresponding to the image to be displayed with a continuous depth of field, wherein the complete encoding information of the image to be displayed can be obtained based on the encoding of each image to be displayed displayed in each liquid crystal panel.

2. The integrated imaging display system according to claim 1, characterized in that: The liquid crystal panel stack is arranged on one side of the optical device array, and specifically comprises: Each of the liquid crystal panels in the liquid crystal panel stack is arranged on one side of the optical device array and is located within the focal length of the optical device array, or Each of the liquid crystal panels in the liquid crystal panel stack is arranged on one side of the optical device array and is located outside the focal length of the optical device array, or Each of the liquid crystal panels in the liquid crystal panel stack is arranged on one side of the optical device array, and some of the liquid crystal panels are located outside the focal length of the optical device array, while another part of the liquid crystal panels are located within the focal length of the optical device array.

3. The integrated imaging display system according to claim 1, characterized in that: The image to be displayed is an image with a foreground and a background; each image code to be displayed is displayed in each of the liquid crystal panels, and is implemented in the following manner: Based on the Gaussian formula, determining the image depths of sub-images with different depths of field in the image to be displayed and the distances between each imaging plane; The images to be displayed corresponding to the sub-images with different depths of field are encoded and displayed on the target liquid crystal panels, wherein the target liquid crystal panel is a liquid crystal panel corresponding to the target imaging plane, and the target imaging plane is an imaging plane corresponding to the image depth of the depth of field sub-image and the imaging plane having the minimum distance.

4. The integrated imaging display system according to any one of claims 1 to 3, characterized in that: The optical device array includes a one-dimensional optical device array and / or a two-dimensional optical device array, wherein the one-dimensional optical device array provides a one-dimensional parallax; and the two-dimensional optical device array provides a two-dimensional full parallax.

5. The integrated imaging display system according to claim 1, characterized in that: A diffusion film is provided between adjacent liquid crystal panels in the liquid crystal panel stack and / or on the outermost liquid crystal panel.

6. The integrated imaging display system according to claim 1, characterized in that: The polarization directions of the liquid crystal panels in the liquid crystal panel stack are staggered to reduce interlayer light interference.

7. An integrated imaging display processing method, characterized in that: The method is applied to the integrated imaging display system according to any one of claims 1 to 6, and the method comprises: Acquire an image to be displayed, wherein the image to be displayed is an image having a foreground and a background; Encoding the to-be-displayed images corresponding to the sub-images with different depths of field in the to-be-displayed images, and displaying the encoded images on each liquid crystal panel; Based on the optical device array, each image to be displayed in each liquid crystal panel is encoded on each imaging plane corresponding to each liquid crystal panel to form each stereoscopic image unit, so that by adjusting the distance between the liquid crystal panel and the optical device array, the depth of field of each stereoscopic image unit formed on each imaging plane is connected, and they are spliced ​​to form a stereoscopic imaging display corresponding to the image to be displayed with a continuous depth of field.

8. The integrated imaging display processing method according to claim 7, characterized in that: The to-be-displayed images corresponding to the sub-images with different depths of field in the to-be-displayed images are encoded and displayed on each liquid crystal panel in the following manner: Based on the Gaussian formula, determining the image depths of sub-images with different depths of field in the image to be displayed and the distances between each imaging plane; The images to be displayed corresponding to the sub-images with different depths of field are encoded and displayed on the target liquid crystal panels, wherein the target liquid crystal panel is a liquid crystal panel corresponding to the target imaging plane, and the target imaging plane is an imaging plane corresponding to the image depth of the depth of field sub-image and the imaging plane having the minimum distance.

9. The integrated imaging display processing method according to claim 7, characterized in that: The method further comprises: Obtaining an imaging display type request for a stereoscopic imaging display corresponding to an image to be displayed; In the case where the imaging display type request is a virtual imaging display type request, based on the virtual imaging display type request, each of the liquid crystal panels in the liquid crystal panel stack is arranged on one side of the optical device array and is located within the focal length of the optical device array; In the case where the imaging display type request is a real image imaging display type request, based on the real image imaging display type request, each of the liquid crystal panels in the liquid crystal panel stack is arranged on one side of the optical device array and outside the focal length of the optical device array; In a case where the imaging display type request is a real-virtual mixed imaging display type request, based on the real-virtual mixed imaging display type request, each of the liquid crystal panels in the liquid crystal panel stack is arranged on one side of the optical device array, and some of the liquid crystal panels are located outside the focal length of the optical device array, and another part of the liquid crystal panels are located within the focal length of the optical device array.

10. An integrated imaging display processing virtual device, characterized in that: The virtual device is applied to the integrated imaging display system according to any one of claims 1 to 6, and the virtual device comprises: An acquisition module, used for acquiring an image to be displayed, wherein the image to be displayed is an image having a foreground and a background; An encoding module, used for encoding the to-be-displayed image corresponding to the sub-images with different depths of field in the to-be-displayed image, and displaying the encoded image on each liquid crystal panel; The display module is used to encode the images to be displayed in the liquid crystal panels on the imaging planes corresponding to the liquid crystal panels to form three-dimensional image units based on the optical device array, so that the depth of field of the three-dimensional image units formed on the imaging planes is connected by adjusting the distance between the liquid crystal panel and the optical device array, and they are spliced ​​to form a three-dimensional imaging display corresponding to the image to be displayed with a continuous depth of field.

Images