Integrated imaging system and imaging method based on multi-layer atomized liquid crystal fast refresh

Abstract

The application provides an integrated imaging system and imaging method based on multi-layer atomized liquid crystal quick refreshing, and relates to the technical field of three-dimensional imaging. The system comprises a liquid crystal panel, a lens array and multi-layer atomized liquid crystals. A target value corresponding to a to-be-displayed image is acquired. Each light ray in a target light ray set is fitted based on the target value to determine a pixel value set corresponding to each layer of atomized liquid crystal in the multi-layer atomized liquid crystal. Each layer of atomized liquid crystal in the multi-layer atomized liquid crystal is sequentially controlled to atomize through a time sequence voltage. When each layer of atomized liquid crystal atomizes, the pixel value displayed by each pixel on the liquid crystal panel is controlled based on the pixel value set corresponding to each layer of atomized liquid crystal. The integrated imaging system and imaging method based on multi-layer atomized liquid crystal quick refreshing provided by the application introduces a multi-layer atomized liquid crystal structure, provides multi-layer display content, and further forms multi-layer imaging planes, thereby having a large range of display depth of field.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of three-dimensional imaging, in particular to an integrated imaging system and imaging method based on multi-layer atomized liquid crystal rapid refresh. BACKGROUND

[0002] Integrated imaging is a kind of light field display, which uses a lens array to image a two-dimensional plane of images in space and splices into a complete image with parallax in different directions. The viewer's two eyes receive signals with parallax, thereby realizing three-dimensional stereoscopic display.

[0003] In the related art, the integrated imaging scheme generally uses a single-layer display panel as a content source, and light rays can only have one layer as a main imaging plane in space after passing through the lens, which limits the total depth of field of imaging and results in poor three-dimensional stereoscopic visual effect.

[0004] Therefore, there is an urgent need for an integrated imaging scheme that can improve the depth of field of imaging and thus improve the three-dimensional stereoscopic visual effect. SUMMARY

[0005] The present application aims to provide an integrated imaging system and imaging method based on multi-layer atomized liquid crystal rapid refresh, which introduces a multi-layer atomized liquid crystal structure to provide multi-layer display content for display, thereby forming multi-layer imaging planes and having a large range of display depth of field.

[0006] The present application provides an integrated imaging method based on multi-layer atomized liquid crystal rapid refresh, comprising:

[0007] A liquid crystal panel for loading a to-be-displayed image, a lens array, a multi-layer atomized liquid crystal between the liquid crystal panel and the lens array, and an imaging control unit; the imaging control unit is configured to obtain a target value corresponding to the to-be-displayed image; the target value is used to represent a real light field distribution corresponding to real three-dimensional imaging of the to-be-displayed image; the imaging control unit is further configured to fit each light ray in a target light ray set based on the target value to determine a pixel value set corresponding to each layer of the multi-layer atomized liquid crystal; the target light ray set includes light rays at different viewing angles in a light field constructed based on the multi-layer atomized liquid crystal; the imaging control unit is further configured to control each layer of the multi-layer atomized liquid crystal to be atomized in sequence through a time sequence voltage, and based on the pixel value set corresponding to each layer of the multi-layer atomized liquid crystal, control the pixel value displayed by each pixel on the liquid crystal panel when each layer of the multi-layer atomized liquid crystal is atomized; wherein the parallel light emitted by the liquid crystal panel is scattered after being incident on the atomization area of the atomized liquid crystal; the light rays scattered after passing through the atomized liquid crystal are imaged through the lens array; and each layer of the atomized liquid crystal layer is controlled to be atomized at a time during imaging.

[0008] Optionally, the imaging control unit is specifically configured to calculate the imaging position of the multi-layer atomized liquid crystal by using a Gaussian formula to obtain a corresponding point of a point on each layer of the atomized liquid crystal on an imaging plane; the imaging control unit is specifically further configured to determine a light ray composed of points on the imaging plane corresponding to points on each layer of the atomized liquid crystal in the multi-layer atomized liquid crystal based on the corresponding points of the points on each layer of the atomized liquid crystal on the imaging plane to obtain the target light ray set; the imaging control unit is specifically further configured to calculate a light ray value of each light ray based on the points on each light ray in the target light ray set, and calculate a loss value of the light ray value of each light ray and the target value; and the imaging control unit is specifically further configured to update the pixel value of the liquid crystal panel by gradient descent based on the loss value of the light ray value of each light ray and the target value to obtain a pixel value set corresponding to each layer of the atomized liquid crystal.

[0009] Optionally, the display mode of the integrated imaging system includes: a real image mode and a virtual image mode; in the real image mode, the imaging position of the integrated imaging system is located outside the focal length range of the lens array; and in the virtual image mode, the imaging position of the integrated imaging system is located within the focal length range of the lens array.

[0010] Optionally, the refresh rate of the integrated imaging system is a preset multiple of a target refresh rate; the target refresh rate is obtained based on a human eye perception refresh rate; and the preset multiple is the number of layers of the atomized liquid crystals contained in the multi-layer atomized liquid crystal.

[0011] Optionally, each layer of the multi-layer atomized liquid crystal is uniformly distributed; and the layers of the multi-layer atomized liquid crystal are filled with a transparent material or a gas with uniform density.

[0012] Optionally, in the case that the focal length of the lens in the lens array is fixed, the distance between any atomized liquid crystal in the multi-layer atomized liquid crystal and the lens is negatively correlated with the imaging distance.

[0013] The present application provides an integrated imaging method based on multi-layer atomized liquid crystal rapid refresh, comprising:

[0014] acquire a target value corresponding to the to-be-displayed image; the target value is used to represent a real light field distribution corresponding to real three-dimensional imaging of the to-be-displayed image; fit each light ray in a target light ray set based on the target value, to determine a pixel value set corresponding to each layer of the multi-layered atomized liquid crystal; the target light ray set includes light rays at different viewing angles in a light field constructed based on the multi-layered atomized liquid crystal; control each layer of the multi-layered atomized liquid crystal to be atomized in turn through a time sequence voltage, and based on the pixel value set corresponding to each layer of the atomized liquid crystal, control a pixel value displayed by each pixel on the liquid crystal panel when each layer of the atomized liquid crystal is atomized; wherein parallel light emitted by the liquid crystal panel is scattered after being incident on an atomization area of the atomized liquid crystal; the light scattered by the atomized liquid crystal is imaged through a lens array; and each time, one layer of the atomized liquid crystal layer is controlled to be atomized when imaging.

[0015] Optionally, the fitting each light ray in the target light ray set based on the target value to determine the pixel value set corresponding to each layer of the multi-layered atomized liquid crystal includes: calculating an imaging position of the multi-layered atomized liquid crystal by using a Gaussian formula to obtain a corresponding point on an imaging plane of a point on each layer of the atomized liquid crystal; determining a light ray composed of points on the imaging plane corresponding to the points on each layer of the atomized liquid crystal to obtain the target light ray set; calculating a light ray value of each light ray based on the points on each light ray in the target light ray set, and calculating a loss value of the light ray value of each light ray and the target value; and updating the pixel value of the liquid crystal panel by gradient descent based on the loss value of the light ray value of each light ray and the target value to obtain the pixel value set corresponding to each layer of the atomized liquid crystal.

[0016] The application further provides a computer program product, including computer programs / instructions, which, when executed by a processor, implement the steps of the integrated imaging method based on multi-layered atomized liquid crystal fast refresh as described in any of the above.

[0017] The application further provides an electronic device, which is provided with an integrated imaging system based on multi-layered atomized liquid crystal fast refresh, and further includes a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor implements the steps of the integrated imaging method based on multi-layered atomized liquid crystal fast refresh as described in any of the above when executing the program.

[0018] The application further provides a computer-readable storage medium, which stores a computer program, and the computer program, when executed by a processor, implements the steps of the integrated imaging method based on multi-layered atomized liquid crystal fast refresh as described in any of the above.

[0019] The application provides an integrated imaging system and an imaging method based on multi-layer atomized liquid crystal quick refreshing, which comprises a liquid crystal panel for loading a to-be-displayed image, a lens array, multi-layer atomized liquid crystals between the liquid crystal panel and the lens array, and an imaging control unit; the imaging control unit is used for acquiring a target value corresponding to the to-be-displayed image; the target value is used for characterizing a real light field distribution corresponding to real three-dimensional imaging of the to-be-displayed image; the imaging control unit is further used for fitting each light ray in a target light ray set based on the target value to determine a pixel value set corresponding to each layer of the multi-layer atomized liquid crystals; the target light ray set comprises light rays at different viewing angles in a light field constructed based on the multi-layer atomized liquid crystals; the imaging control unit is further used for sequentially controlling each layer of the multi-layer atomized liquid crystals to be atomized through time sequence voltage, and controlling a pixel value displayed by each pixel on the liquid crystal panel based on the pixel value set corresponding to each layer of the multi-layer atomized liquid crystals when each layer of the multi-layer atomized liquid crystals is atomized; wherein parallel light emitted by the liquid crystal panel is scattered after being incident on an atomization area of the atomized liquid crystals; the light rays scattered by the atomized liquid crystals are imaged through the lens array; and each layer of the atomized liquid crystals is controlled to be atomized at a time when imaging is performed. In this way, the multi-layer atomized liquid crystal structure is introduced to provide multi-layer display content for display, thereby forming multi-layer imaging planes and having a large range of display depth of field. BRIEF DESCRIPTION OF DRAWINGS

[0020] In order to more clearly illustrate the technical solutions of the present application or the prior art, the following will briefly introduce the drawings needed to be used in the embodiments or prior art description. Obviously, the drawings in the following description are some embodiments of the present application, and other drawings can also be obtained by those skilled in the art without any creative effort.

[0021] Figure 1 is one of the integrated imaging display effect schematic diagrams in the related technology provided by the present application;

[0022] Figure 2 is the second integrated imaging display effect schematic diagram in the related technology provided by the present application;

[0023] Figure 3 is the architecture schematic diagram of the integrated imaging system based on multi-layer atomized liquid crystal quick refreshing provided by the present application;

[0024] Figure 4 is the light ray schematic diagram of the integrated compressed light field based on multi-layer atomized liquid crystal provided by the present application;

[0025] Figure 5 is the integrated compressed light field display schematic diagram of the multi-layer atomized liquid crystal in the real image mode provided by the present application;

[0026] Figure 6 is a schematic diagram of a multi-layer atomized liquid crystal integrated compressive light field display in a virtual image mode provided by the present application;

[0027] Figure 7 is one of the schematic diagrams of atomized liquid crystal atomization modes provided by the present application;

[0028] Figure 8 is another schematic diagram of atomized liquid crystal atomization modes provided by the present application;

[0029] Figure 9 is a schematic diagram of a flow of an integrated imaging method based on multi-layer atomized liquid crystal fast refresh provided by the present application;

[0030] Figure 10 is a schematic diagram of the structure of an electronic device provided by the present application. DETAILED DESCRIPTION

[0031] To make the objectives, technical solutions, and advantages of the present application clearer, the technical solutions in the present application will be described clearly and completely below with reference to the drawings in the present application. Obviously, the described embodiments are some of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the scope of protection of the present application.

[0032] The terms “first”, “second”, and the like in the specification of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by “first”, “second”, and the like are generally of a kind and do not limit the number of objects, for example, the first object can be one or more. In addition, “and / or” in the specification means at least one of the connected objects, and the character “ / ” generally represents an “or” relationship between the front and rear associated objects.

[0033] In related technologies, as shown in Figure 1 , integrated imaging generally uses a single-layer display panel as a content source, and only one layer in space can serve as a main imaging plane, so the total depth of field of imaging is limited. In order to solve this problem and improve the imaging effect, as shown in Figure 2 , two sets of integrated imaging devices with different imaging distances can be combined together by using a half-mirror half-transmission lens to obtain a three-dimensional display effect with extended depth of field. However, this method is difficult to assemble and align.

[0034] In view of the above technical problems existing in the related art, the embodiments of the present application provide an integrated imaging system based on multi-layer atomized liquid crystal fast refresh, as shown inFigure 3 As shown, the system comprises a liquid crystal panel for loading an image to be displayed, a lens array, a multi-layered fogging liquid crystal between the liquid crystal panel and the lens array, and an imaging control unit. As shown, Figure 3 As shown, the main difference between the integrated imaging system based on multi-layered fogging liquid crystal quick refresh in the present application and the imaging system in the related art is that a multi-layered fogging liquid crystal is added between the liquid crystal panel and the optical device array (i.e. the lens array mentioned above).

[0035] Exemplarily, as shown, Figure 3 In the system in the related art, the multi-layered fogging liquid crystal is introduced to provide multi-layered display content by refreshing for display, thereby forming multi-layered imaging planes and having much larger display depth of field than the traditional one. The integrated imaging system in the embodiment of the present application adopts the fogging liquid crystal refreshed in time sequence, and each time the fogging liquid crystal is fully transparent or fully fogging.

[0036] Exemplarily, each layer of the multi-layered fogging liquid crystal can be fogging individually, and the parallel light rays after the fogging liquid crystal after fogging will be scattered, and the parallel light rays after the fogging liquid crystal without fogging (i.e. transparent) will not be scattered. And in each small lens of the integrated imaging, the multi-layered imaging planes are constructed to compress the light field, that is, the continuous space of multi-layered can be obtained. As shown, Figure 4 The compressed light field is combined through a plurality of lenses, thereby realizing the three-dimensional light field display with continuous large depth of field. The content calculated in the scheme can be loaded on the three-dimensional corresponding liquid crystal panel. Since each layer of liquid crystal can be imaged through the optical device array, the correct imaging can be realized at multiple positions in space. The one-dimensional optical device array can provide one-dimensional content to provide horizontal stereoscopic information for the viewer; the two-dimensional optical device array can provide two-dimensional full parallax to provide up-down and left-right stereoscopic information for the viewer. Therefore, the integrated compressed light field display for horizontal viewing or the full-parallax integrated compressed light field display can be realized.

[0037] The integrated imaging system based on multi-layered fogging liquid crystal quick refresh provided by the embodiment of the present application will be described in detail in combination with the specific embodiments and application scenarios of the present application.

[0038] Exemplarily, the imaging control unit is configured to acquire a target value corresponding to the to-be-displayed image, the target value being used to represent a real light field distribution corresponding to real three-dimensional imaging of the to-be-displayed image; the imaging control unit is further configured to fit each light ray in a target light ray set based on the target value, to determine a pixel value set corresponding to each layer of the multi-layered fogging liquid crystal; the target light ray set includes light rays at different viewing angles in a light field constructed based on the multi-layered fogging liquid crystal; the imaging control unit is further configured to control each layer of the multi-layered fogging liquid crystal to perform fogging in sequence through a time sequence voltage, and control a pixel value displayed by each pixel on the liquid crystal panel based on the pixel value set corresponding to each layer of the multi-layered fogging liquid crystal when each layer of the multi-layered fogging liquid crystal performs fogging; wherein parallel light emitted by the liquid crystal panel is scattered after being incident on a fogging area of the fogging liquid crystal; the light scattered by the fogging liquid crystal is imaged through a lens array; and each layer of the multi-layered fogging liquid crystal is controlled to perform fogging at a time during imaging.

[0039] Exemplarily, a refresh rate of the integrated imaging system is a preset multiple of a target refresh rate, the target refresh rate is obtained based on a human eye perceived refresh rate, and the preset multiple is a number of layers of the fogging liquid crystals included in the multi-layered fogging liquid crystal. The layers of the multi-layered fogging liquid crystal are uniformly distributed, and the layers of the multi-layered fogging liquid crystal are filled with a transparent material or a gas with uniform density.

[0040] Exemplarily, in the embodiment of the present application, the multi-layered fogging liquid crystal layers are placed in stack, and the fogging liquid crystal can be quickly refreshed by adjusting the time sequence voltage. Each layer of liquid crystal is fogged in sequence, and the rest remains transparent. The system uses parallel light source as input. Parallel light is incident on the liquid crystal panel and exits as parallel light loaded with information. The multi-layered fogging liquid crystal is used to refresh quickly in sequence. When the parallel light is incident on the fogging liquid crystal, scattering occurs, and imaging can be performed through subsequent optical devices. Due to the visual persistence effect, the multi-layered fogging liquid crystal forms multiple discrete planes. In order to solve this problem, the content calculation method of integrated compressed light field is further proposed in the embodiment of the present application, so that the content of three-dimensional display has a large continuous depth of field.

[0041] Specifically, the imaging control unit is specifically configured to calculate the imaging position of the multi-layered fogging liquid crystal by using a Gaussian formula to obtain a corresponding point of a point on each layer of the fogging liquid crystal on an imaging plane; the imaging control unit is specifically further configured to determine a light ray composed of points on the imaging plane corresponding to points on each layer of the fogging liquid crystal in the multi-layered fogging liquid crystal based on the corresponding points of the points on each layer of the fogging liquid crystal on the imaging plane to obtain the target light ray set; the imaging control unit is specifically further configured to calculate a light ray value of each light ray based on the points on each light ray in the target light ray set, and calculate a loss value of the light ray value of each light ray and the target value; and the imaging control unit is specifically further configured to update the pixel value of the liquid crystal panel by gradient descent based on the loss value of the light ray value of each light ray and the target value to obtain a pixel value set corresponding to each layer of the fogging liquid crystal.

[0042] Exemplarily, the integrated imaging system in the embodiment of the present application can be divided into a real image mode as shown in Figure 5 and a virtual image mode as shown in Figure 6 The display mode of the integrated imaging system includes: the real image mode and the virtual image mode; in the real image mode, the imaging position of the integrated imaging system is located outside the lens focal length range of the lens array; in the virtual image mode, the imaging position of the integrated imaging system is located within the lens focal length range of the lens array. The integrated imaging system in the embodiment of the present application can image each layer of liquid crystal through an optical device, and the imaging process satisfies the Gaussian imaging formula. The above-mentioned content calculation method of integrated compressed light field is suitable for one-dimensional or two-dimensional optical device array. The one-dimensional optical device array is a group of horizontally arranged cylindrical grating, which can provide one-dimensional parallax to provide horizontal stereoscopic information, and the viewer can feel stereoscopic when moving in the horizontal direction; the two-dimensional optical device array is generally a lens array, which can provide two-dimensional full parallax, and the viewer can feel stereoscopic information when moving up, down, left and right.

[0043] Exemplarily, in the embodiment of the present application, the imaging position of each layer of the fogging liquid crystal is calculated according to the following Gaussian imaging formula:

[0044]

[0045] wherein, is the distance between the fogging liquid crystal and the lens array, is the imaging distance, is the focal length of the lens. In the case that the focal length of the lens in the lens array is fixed, the distance between any fogging liquid crystal in the multi-layered fogging liquid crystal and the lens is negatively related to the imaging distance.

[0046] Therefore, the point on the imaging plane can be calculated according to the point on the multi-layered liquid crystal. As Figure 5 and Figure 6As shown, taking the three-layered diffused liquid crystal as an example, three points on the three-layered diffused liquid crystal , , can respectively obtain three points on three imaging planes (i.e. , , ) , , . The three imaging points can be adjusted to be a light ray. Since the compressed light field of the multi-layered diffused liquid crystal adopts multiplication modulation, the numerical calculation of the light ray is as follows:

[0047]

[0048] It can be understood that in the embodiments of the present application, the light rays to be fitted can be understood as light rays under different viewing angles after imaging by the lens, and the numerical value of each light ray is fitted with the target numerical value corresponding to the image to be displayed, so as to adjust and determine the pixel value of each pixel on the liquid crystal panel during the diffusing of each layer of the diffused liquid crystal.

[0049] Exemplarily, in order to obtain the best display result, the light rays of all viewing angles can be summarized and the loss is calculated with the target numerical value . In the embodiments of the present application, the above loss can be calculated by using n-norm, and the pixel value of each pixel on the liquid crystal panel is updated by gradient descent. Specifically, the calculation can be performed by the following formula:

[0050]

[0051] Exemplarily, the refresh rate of the integrated imaging system is a preset multiple of the target refresh rate; the target refresh rate is obtained based on the refresh rate perceived by the human eye; and the preset multiple is the number of layers of the diffused liquid crystals contained in the multi-layered diffused liquid crystal.

[0052] It can be understood that by using the above integrated compressed light field content calculation method, a practical large depth of field three-dimensional display effect can be obtained. Taking the refresh rate perceived by the human eye as 30Hz as an example, the refresh rate of the diffused liquid crystal should be N*30Hz or more, and N is the number of layers of the diffused liquid crystal.

[0053] It should be noted that the above refresh rate in the embodiments of the present application can be represented as the diffusing period of the diffused liquid crystal, and since the display content of the liquid crystal panel corresponds to the diffusing of the diffused liquid crystal, the refresh rate can also represent the content update frequency of the liquid crystal panel.

[0054] Exemplarily, the atomized liquid crystal comprises: a first mode and a second mode; the imaging control unit is specifically configured to control the atomized liquid crystal to atomize by applying a voltage when the atomized liquid crystal is in the first mode; and the imaging control unit is specifically further configured to control the atomized liquid crystal to atomize by canceling the voltage applied on the atomized liquid crystal when the atomized liquid crystal is in the second mode.

[0055] Exemplarily, the atomized liquid crystal is a liquid crystal of a special material, which is divided into a normal mode and a non-normal mode (i.e. the first mode and the second mode described above), as shown in FIG. 1, which is a schematic diagram of atomization of the atomized liquid crystal in the normal mode (i.e. the first mode described above). In the case where no voltage is applied, the atomized liquid crystal does not atomize, at this time, the light does not change the propagation direction after passing through the atomized liquid crystal; in the case where a voltage is applied, the atomized liquid crystal atomizes, at this time, the light is scattered after passing through the atomized liquid crystal. Figure 7 Figure 8 Exemplarily, the atomized liquid crystal is a liquid crystal of a special material, which is divided into a normal mode and a non-normal mode (i.e. the first mode and the second mode described above), as shown in FIG. 1, which is a schematic diagram of atomization of the atomized liquid crystal in the normal mode (i.e. the first mode described above). In the case where no voltage is applied, the atomized liquid crystal does not atomize, at this time, the light does not change the propagation direction after passing through the atomized liquid crystal; in the case where a voltage is applied, the atomized liquid crystal atomizes, at this time, the light is scattered after passing through the atomized liquid crystal.

[0056] It should be noted that the integrated imaging system based on the multi-layer atomized liquid crystal fast refresh in the embodiment of the present application, the timing voltage is used to control each layer of the atomized liquid crystal in the multi-layer atomized liquid crystal to atomize periodically, and only one layer of the atomized liquid crystal atomizes each time.

[0057] ​The integrated imaging system based on fast refresh of multilayer fogged liquid crystal provided in this application includes: a liquid crystal panel for loading an image to be displayed, a lens array, a multilayer fogged liquid crystal located between the liquid crystal panel and the lens array, and an imaging control unit; the imaging control unit is used to acquire a target value corresponding to the image to be displayed; the target value is used to characterize the real light field distribution corresponding to the real three-dimensional imaging of the image to be displayed; the imaging control unit is further used to fit each ray in the target ray set based on the target value to determine the pixel value set corresponding to each layer of fogged liquid crystal in the multilayer fogged liquid crystal. The target light set includes light rays from different viewing angles within the light field constructed based on the multilayer atomized liquid crystal. The imaging control unit is further configured to sequentially control the atomization of each layer of the multilayer atomized liquid crystal via a timing voltage, and, during the atomization of each layer, control the pixel value displayed on the liquid crystal panel based on the pixel value set corresponding to each layer. Parallel light emitted from the liquid crystal panel is scattered upon entering the atomized area of ​​the atomized liquid crystal. The scattered light rays are imaged through a lens array. During imaging, one layer of atomized liquid crystal is controlled to atomize at a time. Thus, by introducing a multilayer atomized liquid crystal structure, multiple layers of display content are provided for the display, thereby forming a multilayer imaging plane with a large display depth of field.

[0058] The integrated imaging method based on fast refresh of multilayer atomized liquid crystal provided in this application will be described in detail below with reference to the accompanying drawings, through specific embodiments and application scenarios.

[0059] like Figure 9 As shown in the embodiment of this application, an integrated imaging method based on fast refresh of multilayer fogged liquid crystal is provided. The method may include the following steps 901 to 903:

[0060] Step 901: Obtain the target value corresponding to the image to be displayed.

[0061] The target value is used to characterize the true light field distribution corresponding to the true three-dimensional imaging of the image to be displayed.

[0062] Step 902: Fit each ray in the target ray set based on the target value to determine the set of pixel values ​​corresponding to each layer of the multilayer atomized liquid crystal.

[0063] The target ray set includes rays from different angles within the light field constructed based on the multilayer atomized liquid crystal.

[0064] Step 903, sequentially control each layer of the atomized liquid crystal in the multi-layer atomized liquid crystal to perform atomization by timing voltage, and when each layer of the atomized liquid crystal performs atomization, control the pixel value displayed by each pixel on the liquid crystal panel based on the pixel value set corresponding to each layer of the atomized liquid crystal.

[0065] Wherein, the parallel light emitted by the liquid crystal panel is scattered after being incident on the atomization area of the atomized liquid crystal; the light scattered after passing through the atomized liquid crystal is imaged by the lens array; and each time, one layer of the atomized liquid crystal layer is controlled to perform atomization when imaging.

[0066] Specifically, the above step 902 can further include the following steps 902a1 to 902a4:

[0067] Step 902a1, calculate the imaging position of the multi-layer atomized liquid crystal by using the Gaussian formula to obtain the corresponding point of the point on each layer of the atomized liquid crystal on the imaging plane.

[0068] Step 902a2, based on the corresponding point of the point on each layer of the atomized liquid crystal on the imaging plane, determine the light ray composed of the points on the imaging plane corresponding to the points on each layer of the atomized liquid crystal in the multi-layer atomized liquid crystal to obtain the target light ray set.

[0069] Step 902a3, based on the point on each light ray in the target light ray set, calculate the light ray value of each light ray, and calculate the loss value of the light ray value of each light ray and the target value.

[0070] Step 902a4, based on the loss value of the light ray value of each light ray and the target value, update the pixel value of the liquid crystal panel by gradient descent to obtain the pixel value set corresponding to each layer of the atomized liquid crystal.

[0071] It should be noted that the steps of the integrated imaging method based on the multi-layer atomized liquid crystal fast refresh provided by the application embodiment have been described in detail in the above integrated imaging system based on the multi-layer atomized liquid crystal fast refresh, and to avoid repetition, will not be repeated here.

[0072] The integrated imaging method based on fast refresh of multilayer fogged liquid crystal provided in this application embodiment is applied to the imaging control unit in an integrated imaging system based on fast refresh of multilayer fogged liquid crystal. The method includes: acquiring a target value corresponding to the image to be displayed; the target value is used to characterize the real light field distribution corresponding to the real three-dimensional imaging of the image to be displayed; fitting each ray in the target ray set based on the target value to determine the pixel value set corresponding to each fogged liquid crystal layer in the multilayer fogged liquid crystal; the target ray set includes: rays under different viewing angles in the light field constructed based on the multilayer fogged liquid crystal; controlling each fogged liquid crystal layer in the multilayer fogged liquid crystal to fog up sequentially through a timing voltage, and controlling the pixel value displayed by each pixel on the liquid crystal panel based on the pixel value set corresponding to each fogged liquid crystal layer during fogging; wherein, parallel light emitted by the liquid crystal panel is scattered after entering the fogged area of ​​the fogged liquid crystal; the light scattered by the fogged liquid crystal is imaged through a lens array; during imaging, one fogged liquid crystal layer is controlled to fog up at a time.

[0073] Figure 10 An example is a schematic diagram of the physical structure of an electronic device, such as... Figure 10 As shown, the electronic device may include: a processor 1010, a communications interface 1020, a memory 1030, and a communications bus 1040, wherein the processor 1010, the communications interface 1020, and the memory 1030 communicate with each other through the communications bus 1040. The processor 1010 can call logic instructions in the memory 1030 to execute an integrated imaging method based on fast refresh of multilayer fogged liquid crystal. This method includes: acquiring a target value corresponding to the image to be displayed; the target value is used to characterize the real light field distribution corresponding to the real three-dimensional imaging of the image to be displayed; fitting each ray in the target ray set based on the target value to determine the pixel value set corresponding to each layer of fogged liquid crystal in the multilayer fogged liquid crystal; the target ray set includes: rays from different viewing angles in the light field constructed based on the multilayer fogged liquid crystal; sequentially controlling each layer of fogged liquid crystal in the multilayer fogged liquid crystal to fog up using a timing voltage, and controlling the pixel value displayed on the liquid crystal panel based on the pixel value set corresponding to each layer of fogged liquid crystal during fogging; wherein, parallel light emitted by the liquid crystal panel is scattered after entering the fogged area of ​​the fogged liquid crystal; the light scattered by the fogged liquid crystal is imaged through a lens array; during imaging, one layer of fogged liquid crystal is controlled to fog up at a time.

[0074] Further, the logic instructions in the memory 1030 described above can be implemented in the form of software functional units and sold or used as independent products, and can be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application essentially or the parts of the prior art that make contributions or parts of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium, and includes a number of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk or an optical disk, and various media that can store program codes.

[0075] In another aspect, the present application also provides a computer program product, which comprises a computer program stored on a computer readable storage medium, and the computer program comprises program instructions, when the program instructions are executed by a computer, the computer can execute the integrated imaging method based on the multi-layer atomized liquid crystal fast refresh provided by the above-mentioned method, and the method comprises: obtaining a target value corresponding to the to-be-displayed image; the target value is used to represent the real light field distribution corresponding to the real three-dimensional imaging of the to-be-displayed image; fitting each light ray in a target light ray set based on the target value to determine a pixel value set corresponding to each layer of atomized liquid crystal in the multi-layer atomized liquid crystal; the target light ray set comprises light rays at different viewing angles in the light field constructed based on the multi-layer atomized liquid crystal; atomization of each layer of atomized liquid crystal in the multi-layer atomized liquid crystal is controlled in time sequence, and based on the pixel value set corresponding to each layer of atomized liquid crystal, the pixel value displayed by each pixel on the liquid crystal panel is controlled when each layer of atomized liquid crystal is atomized; wherein the parallel light emitted by the liquid crystal panel will be scattered after being incident on the atomization area of the atomized liquid crystal; the light rays scattered after passing through the atomized liquid crystal are imaged through the lens array; when imaging, one layer of atomized liquid crystal layer is controlled to atomize each time.

[0076] In yet another aspect, the present application also provides a computer readable storage medium having stored thereon a computer program, which, when executed by a processor, implements the above-provided integrated imaging method based on multi-layer atomized liquid crystal fast refresh, which comprises: obtaining a target value corresponding to the image to be displayed; the target value is used to represent a real light field distribution corresponding to real three-dimensional imaging of the image to be displayed; fitting each light ray in a target light ray set based on the target value to determine a pixel value set corresponding to each layer of the multi-layer atomized liquid crystal; the target light ray set comprises light rays at different viewing angles in a light field constructed based on the multi-layer atomized liquid crystal; sequentially controlling each layer of the multi-layer atomized liquid crystal to be atomized through a time sequence voltage, and based on the pixel value set corresponding to each layer of the atomized liquid crystal, controlling the pixel value displayed by each pixel on the liquid crystal panel when each layer of the atomized liquid crystal is atomized; wherein the parallel light emitted by the liquid crystal panel is scattered after being incident on the atomization area of the atomized liquid crystal; the light ray scattered after passing through the atomized liquid crystal is imaged through a lens array; and each time, one layer of the atomized liquid crystal layer is controlled to be atomized when imaging.

[0077] The apparatus embodiments described above are merely illustrative, wherein the units described as separate components can or can not be physically separate, and the components displayed as units can or can not be physical units, i.e., can be located in one place, or can be distributed on multiple network units. Part or all of the modules can be selected to achieve the purpose of the embodiment scheme according to actual needs. Those skilled in the art can understand and implement without creative labor.

[0078] From the above description of the embodiments, those skilled in the art can clearly understand that the embodiments can be realized by means of software plus the necessary general hardware platform, and of course, can also be realized by hardware. Based on such understanding, the above technical solutions can be embodied in the form of a software product, which can be stored in a computer readable storage medium, such as a ROM / RAM, a magnetic disk, an optical disk, etc., and includes a plurality of instructions to make a computer device (which can be a personal computer, a server, or a network device, etc.) execute the methods described in each embodiment or some parts of the embodiments.

[0079] Finally, it should be noted that the above examples are only used to illustrate the technical solutions of the present application, and are not intended to limit the same; although the present application has been described in detail with reference to the foregoing examples, those of ordinary skill in the art should understand that they can still modify the technical solutions recorded in the foregoing examples, or make equivalent replacements for some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. An integrated imaging system based on multi-layer atomized liquid crystal with fast refresh, characterized in that, include: A liquid crystal panel for loading an image to be displayed, a lens array, a multilayer atomized liquid crystal located between the liquid crystal panel and the lens array, and an imaging control unit; The imaging control unit is used to acquire the target value corresponding to the image to be displayed; the target value is used to characterize the real light field distribution corresponding to the real three-dimensional imaging of the image to be displayed; The imaging control unit is further configured to fit each ray in the target ray set based on the target value, and determine the set of pixel values ​​corresponding to each layer of the multilayer atomized liquid crystal; The target ray set includes: rays from different perspectives in the light field constructed based on the multilayer atomized liquid crystal; The imaging control unit is also used to control each layer of the multilayer atomized liquid crystal to atomize sequentially through timing voltage, and to control the pixel value displayed on each pixel on the liquid crystal panel based on the pixel value set corresponding to each layer of atomized liquid crystal during atomization. In this process, parallel light emitted by the liquid crystal panel is scattered after it is incident on the atomized area of ​​the atomized liquid crystal; the light scattered by the atomized liquid crystal is imaged through a lens array; during image formation, one atomized liquid crystal layer is controlled to atomize at a time.

2. The system according to claim 1, characterized in that, The atomized liquid crystal layers of the multilayer atomized liquid crystal are uniformly distributed; the spaces between the atomized liquid crystal layers of the multilayer atomized liquid crystal are filled with a transparent material or a gas of uniform density.

3. The system according to claim 1, characterized in that, When the focal length of the lenses in the lens array is fixed, the distance between any of the atomized liquid crystals in the multilayer atomized liquid crystal and the lens is negatively correlated with the imaging distance.

4. The system according to any one of claims 1 to 3, characterized in that, The imaging control unit is specifically used to calculate the imaging position of the multilayer atomized liquid crystal using the Gaussian formula, and obtain the point on the imaging plane corresponding to the point on each layer of atomized liquid crystal. The imaging control unit is further configured to determine the light rays formed by the points on the imaging plane corresponding to the points on each layer of the atomized liquid crystal in the multilayer atomized liquid crystal, based on the points on the imaging plane corresponding to the points on each layer of the atomized liquid crystal, and obtain the target light ray set. The imaging control unit is further configured to calculate the ray value of each ray based on the point on each ray in the target ray set, and to calculate the loss value between the ray value of each ray and the target value. The imaging control unit is further configured to update the pixel values ​​of the liquid crystal panel through gradient descent based on the loss value between the light value of each ray and the target value, thereby obtaining a set of pixel values ​​corresponding to each layer of atomized liquid crystal.

5. The system according to claim 4, characterized in that, The integrated imaging system has two display modes: a real image mode and a virtual image mode. In the real image mode, the imaging position of the integrated imaging system is outside the focal length range of the lens array. In the virtual image mode, the imaging position of the integrated imaging system is within the focal length range of the lens array.

6. The system according to claim 4, characterized in that, The refresh rate of the integrated imaging system is a preset multiple of the target refresh rate; the target refresh rate is obtained based on the refresh rate perceived by the human eye; the preset multiple is the number of layers of the atomized liquid crystal contained in the multilayer atomized liquid crystal.

7. An integrated imaging method based on fast refresh of multilayer fogged liquid crystal, characterized in that, An imaging control unit is applied to an integrated imaging system based on fast refresh of multilayer atomized liquid crystal, the system further comprising: a liquid crystal panel for loading an image to be displayed, a lens array, and multilayer atomized liquid crystal located between the liquid crystal panel and the lens array; Obtain the target value corresponding to the image to be displayed; the target value is used to characterize the real light field distribution corresponding to the real three-dimensional imaging of the image to be displayed. Based on the target value, each ray in the target ray set is fitted to determine the pixel value set corresponding to each layer of the multilayer atomized liquid crystal; the target ray set includes: rays from different viewing angles in the light field constructed based on the multilayer atomized liquid crystal; The timing voltage is used to control the atomization of each layer of the multilayer atomized liquid crystal in sequence, and when each layer of atomized liquid crystal is atomized, the pixel value displayed on each pixel on the liquid crystal panel is controlled based on the pixel value set corresponding to each layer of atomized liquid crystal. In this process, parallel light emitted by the liquid crystal panel is scattered after it is incident on the atomized area of ​​the atomized liquid crystal; the light scattered by the atomized liquid crystal is imaged through a lens array; during image formation, one atomized liquid crystal layer is controlled to atomize at a time.

8. The method according to claim 7, characterized in that, The step of fitting each ray in the target ray set based on the target value to determine the pixel value set corresponding to each layer of the multilayer atomized liquid crystal includes: The imaging position of the multilayer atomized liquid crystal is calculated using the Gaussian formula, and the corresponding point on the imaging plane is obtained for each point on the atomized liquid crystal layer. Based on the points on the imaging plane corresponding to the points on each layer of the atomized liquid crystal, the light rays formed by the points on the imaging plane corresponding to the points on each layer of the atomized liquid crystal in the multilayer atomized liquid crystal are determined, and the target light ray set is obtained. Based on the points on each ray in the target ray set, calculate the ray value of each ray, and calculate the loss value between the ray value of each ray and the target value; Based on the loss value between the ray value of each ray and the target value, the pixel values ​​of the liquid crystal panel are updated by gradient descent to obtain the set of pixel values ​​corresponding to each layer of atomized liquid crystal.

9. An electronic device, characterized in that, The system includes a memory, a processor, a computer program stored in the memory and executable on the processor, and an integrated imaging system based on rapid refresh of a multilayer atomized liquid crystal as described in any one of claims 1 to 6, wherein the processor executes the program to implement the steps of the integrated imaging method based on rapid refresh of a multilayer atomized liquid crystal as described in claim 7 or 8.

10. A computer-readable storage medium, characterized in that, It stores a computer program, which, when executed by a processor, implements the steps of the integrated imaging method based on fast refresh of multilayer fogged liquid crystal as described in claim 7 or 8.

Images