Integrated imaging system and imaging method based on multilayer atomized liquid crystal rapid refreshing

Abstract

The invention provides an integrated imaging system and an imaging method based on rapid refreshing of multilayer atomized liquid crystals, and relates to the technical field of three-dimensional imaging, the system comprises a liquid crystal panel, a lens array and the multilayer atomized liquid crystals; obtaining a target numerical value corresponding to the to-be-displayed image; fitting each light in the target light set based on the target numerical value, and determining a pixel value set corresponding to each layer of atomized liquid crystal in the multiple layers of atomized liquid crystals; and sequentially controlling each layer of atomized liquid crystal in the plurality of layers of atomized liquid crystal to be atomized through the time sequence voltage, and controlling the pixel value displayed by each pixel on the liquid crystal panel based on the pixel value set corresponding to each layer of atomized liquid crystal when each layer of atomized liquid crystal is atomized. According to the integrated imaging system and the imaging method based on rapid refreshing of the multi-layer atomized liquid crystal, the multi-layer atomized liquid crystal structure is introduced, multi-layer display content is provided, then a multi-layer imaging plane is formed, and a large-range display depth of field is achieved.

Description

Technical Field

[0001] This application relates to the field of three-dimensional imaging technology, and in particular to an integrated imaging system and imaging method based on rapid refresh of multilayer atomized liquid crystal. Background Technology

[0002] Integrated imaging is a type of light field display. This method uses a lens array to image a two-dimensional plane image in space and stitches them together in different directions to form a complete image with parallax. Because the viewer's eyes receive signals with parallax, a three-dimensional stereoscopic display is achieved.

[0003] Integrated imaging solutions in related technologies generally use a single-layer display panel as the content source. When light passes through a lens, only one layer in space can serve as the main imaging plane, which results in a limited total depth of field and poor three-dimensional stereoscopic visual effects.

[0004] Therefore, there is an urgent need for an integrated imaging solution that can improve the depth of field of imaging and thus enhance the three-dimensional stereoscopic visual effect. Summary of the Invention

[0005] The purpose of this application is to provide an integrated imaging system and imaging method based on multi-layer atomized liquid crystal fast refresh. By introducing a multi-layer atomized liquid crystal structure, multiple layers of display content are provided for the display, thereby forming a multi-layer imaging plane with a large range of display depth.

[0006] This application provides an integrated imaging method based on fast refresh of multilayer fogged liquid crystal, including: The system comprises a liquid crystal panel for loading an image to be displayed, a lens array, a multilayer atomized liquid crystal located between the liquid crystal panel and the lens array, and an imaging control unit. The imaging control unit is used to acquire a target value corresponding to the image to be displayed. The target value is used to characterize the true light field distribution corresponding to the true three-dimensional imaging of the image to be displayed. The imaging control unit is also used to fit each ray in the target ray set based on the target value to determine the pixel value set corresponding to each layer of the multilayer atomized liquid crystal. The target ray set includes rays from different viewing angles in the light field constructed based on the multilayer atomized liquid crystal. The imaging control unit is also used to sequentially control each layer of the multilayer atomized liquid crystal to atomize using a timing voltage, and while each layer of atomized liquid crystal is atomized, it controls the pixel value displayed on each pixel of the liquid crystal panel based on the pixel value set corresponding to each layer of atomized liquid crystal. Parallel light emitted by the liquid crystal panel is scattered after incident on the atomized area of ​​the atomized liquid crystal. The light scattered by the atomized liquid crystal is imaged through the lens array. During imaging, one layer of atomized liquid crystal is atomized at a time.

[0007] Optionally, the imaging control unit is specifically configured to calculate the imaging position of the multilayer atomized liquid crystal using the Gaussian formula, obtaining the points corresponding to the points on the imaging plane of each layer of atomized liquid crystal; the imaging control unit is further configured to determine the light rays formed by the points on the imaging plane corresponding to the points on the imaging plane of each layer of atomized liquid crystal, based on the points corresponding to the points on the imaging plane of each layer of atomized liquid crystal, to obtain the target light ray set; the imaging control unit is further configured to calculate the light ray value of each light ray based on the points on each light ray in the target light ray set, and calculate the loss value between the light ray value of each light ray and the target value; the imaging control unit is further configured to update the pixel values ​​of the liquid crystal panel through gradient descent based on the loss value between the light ray value of each light ray and the target value, to obtain the pixel value set corresponding to each layer of atomized liquid crystal.

[0008] Optionally, the display modes of the integrated imaging system include: a real image mode and a virtual image mode; in the real image mode, the imaging position of the integrated imaging system is located outside the focal length range of the lens array; in the virtual image mode, the imaging position of the integrated imaging system is located within the focal length range of the lens array.

[0009] Optionally, the refresh rate of the integrated imaging system is a preset multiple of the target refresh rate; the target refresh rate is obtained based on the refresh rate perceived by the human eye; and the preset multiple is the number of layers of the atomized liquid crystal contained in the multilayer atomized liquid crystal.

[0010] Optionally, the atomized liquid crystal layers of the multilayer atomized liquid crystal are uniformly distributed; the spaces between the atomized liquid crystal layers of the multilayer atomized liquid crystal are filled with a transparent material or a gas of uniform density.

[0011] Optionally, when the focal length of the lenses in the lens array is fixed, the distance between any of the atomized liquid crystals in the multilayer atomized liquid crystal and the lens is negatively correlated with the imaging distance.

[0012] This application provides an integrated imaging method based on fast refresh of multilayer fogged liquid crystal, including: The target value corresponding to the image to be displayed is obtained; the target value is used to characterize the real light field distribution corresponding to the real three-dimensional imaging of the image to be displayed; each ray in the target ray set is fitted based on the target value to determine the pixel value set corresponding to each layer of the multilayer atomized liquid crystal; the target ray set includes: rays under different viewing angles in the light field constructed based on the multilayer atomized liquid crystal; each layer of the multilayer atomized liquid crystal is controlled to atomize sequentially by timing voltage, and when each layer of atomized liquid crystal is atomized, the pixel value displayed by each pixel on the liquid crystal panel is controlled based on the pixel value set corresponding to each layer of atomized liquid crystal; wherein, the parallel light emitted by the liquid crystal panel is scattered after entering the atomized area of ​​the atomized liquid crystal; the light scattered by the atomized liquid crystal is imaged through a lens array; during imaging, one layer of atomized liquid crystal is controlled to atomize at a time.

[0013] Optionally, the step of fitting each ray in the target ray set based on the target value to determine the pixel value set corresponding to each layer of the multilayer atomized liquid crystal includes: calculating the imaging position of the multilayer atomized liquid crystal using the Gaussian formula to obtain the point corresponding to the point on the imaging plane of each layer of atomized liquid crystal; determining the ray formed by the points on the imaging plane corresponding to the points on each layer of atomized liquid crystal based on the points on the imaging plane of each layer of atomized liquid crystal, to obtain the target ray set; calculating the ray value of each ray based on the points on each ray in the target ray set, and calculating the loss value between the ray value of each ray and the target value; updating the pixel value of the liquid crystal panel through gradient descent based on the loss value between the ray value of each ray and the target value, to obtain the pixel value set corresponding to each layer of atomized liquid crystal.

[0014] This application also provides a computer program product, including a computer program / instructions that, when executed by a processor, implement the steps of the integrated imaging method based on fast refresh of multilayer fogged liquid crystal as described above.

[0015] This application also provides an electronic device equipped with an integrated imaging system based on fast refresh of multilayer atomized liquid crystal. The electronic device further includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the program, it implements the steps of the integrated imaging method based on fast refresh of multilayer atomized liquid crystal as described above.

[0016] This application also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the integrated imaging method based on fast refresh of multilayer atomized liquid crystal as described above.

[0017] This application provides an integrated imaging system and method based on fast refresh of multilayer atomized liquid crystal. The system includes: a liquid crystal panel for loading an image to be displayed, a lens array, multilayer atomized liquid crystal located between the liquid crystal panel and the lens array, and an imaging control unit. The imaging control unit is used to acquire a target value corresponding to the image to be displayed; the target value is used to characterize the true light field distribution corresponding to the true three-dimensional imaging of the image to be displayed; the imaging control unit is further used to fit each ray in the target ray set based on the target value to determine the image corresponding to each layer of atomized liquid crystal in the multilayer atomized liquid crystal. The set of prime values; the target light set includes: light rays from different viewing angles in the light field constructed based on the multilayer fogged liquid crystal; the imaging control unit is further configured to sequentially control each layer of fogged liquid crystal in the multilayer fogged liquid crystal to fog up through a timing voltage, and, when each layer of fogged liquid crystal is fogged up, control the pixel value displayed by each pixel on the liquid crystal panel based on the pixel value set corresponding to each layer of fogged liquid crystal; wherein, parallel light emitted by the liquid crystal panel is scattered after entering the fogged area of ​​the fogged liquid crystal; the light rays scattered by the fogged liquid crystal are imaged through a lens array; during imaging, one layer of fogged liquid crystal is controlled to fog up at a time. Thus, by introducing a multilayer fogged liquid crystal structure, multiple layers of display content are provided for the display, thereby forming a multilayer imaging plane with a large range of display depth. Attached Figure Description

[0018] To more clearly illustrate the technical solutions in this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0019] Figure 1 This is one of the schematic diagrams illustrating the integrated imaging display effect in the related technologies provided in this application; Figure 2 This is the second schematic diagram of the integrated imaging display effect in the related technology provided in this application; Figure 3 This is a schematic diagram of the architecture of the integrated imaging system based on fast refresh of multi-layer atomized liquid crystal provided in this application; Figure 4 This is a schematic diagram of the light rays after constructing an integrated compressed light field based on multilayer atomized liquid crystal, as provided in this application; Figure 5 This is a schematic diagram of a multi-layer atomized liquid crystal integrated compressed light field display in real-image mode provided in this application; Figure 6 This is a schematic diagram of a multi-layer atomized liquid crystal integrated compressed light field display in virtual image mode provided in this application; Figure 7 This is one of the schematic diagrams of the atomization method of the atomized liquid crystal provided in this application; Figure 8 This is the second schematic diagram of the atomization method of the atomized liquid crystal provided in this application; Figure 9 This is a flowchart illustrating the integrated imaging method based on fast refresh of multilayer atomized liquid crystal provided in this application; Figure 10 This is a schematic diagram of the structure of the electronic device provided in this application. Detailed Implementation

[0020] To make the objectives, technical solutions, and advantages of this application clearer, the technical solutions of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0021] The terms "first," "second," etc., used in this application's specification are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class, without limiting the number of objects; for example, a first object can be one or more. Furthermore, in the specification, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects have an "or" relationship.

[0022] In related technologies, such as Figure 1 As shown, integrated imaging typically uses a single-layer display panel as the content source, with only one layer serving as the main imaging plane in space, resulting in a limited total depth of field. To address this issue and improve imaging performance, such as... Figure 2 As shown, two integrated imaging devices with different imaging distances can be combined using a semi-reflective mirror to achieve a 3D display effect with extended depth of field. However, this method is quite difficult to assemble and align.

[0023] To address the aforementioned technical problems in related technologies, embodiments of this application provide an integrated imaging system based on multilayer atomized liquid crystal fast refresh, such as... Figure 3 As shown, the system includes: a liquid crystal panel for loading an image to be displayed, a lens array, a multilayer atomized liquid crystal located between the liquid crystal panel and the lens array, and an imaging control unit. Figure 3As shown, the main difference between the integrated imaging system based on multilayer atomized liquid crystal for fast refresh in this application and the imaging system in related technologies is that multilayer atomized liquid crystal is added between the liquid crystal panel and the optical device array (i.e., the lens array mentioned above).

[0024] For example, such as Figure 3 As shown, a multi-layered atomized liquid crystal is introduced into the system of related technologies. Through refresh, multiple layers of display content are provided for the display, thereby forming a multi-layered imaging plane and exhibiting a much larger display depth of field than traditional methods. The integrated imaging system in this application embodiment uses a time-refreshed atomized liquid crystal, with each refresh resulting in either full transparency or full atomization.

[0025] For example, each layer of the aforementioned multilayer atomized liquid crystal can be atomized independently. Parallel light rays incident upon passing through the atomized liquid crystal will be scattered, while those passing through the un-atomized (i.e., transparent) liquid crystal will not be scattered. Furthermore, within each integrated imaging microlens, a compressed light field is constructed using multiple imaging planes, meaning that multiple continuous spatial layers can be obtained. For example... Figure 4 As shown, this compressed light field is then combined with multiple lenses to achieve a continuous, large depth-of-field 3D light field display. The calculated content can be loaded onto a corresponding 3D liquid crystal panel. Since each layer of liquid crystal can be imaged through an optical device array, it can correctly image at multiple positions in space. A one-dimensional optical device array can provide one-dimensional content, offering the viewer horizontal stereoscopic information; a two-dimensional optical device array can provide two-dimensional full parallax, offering the viewer vertical and horizontal stereoscopic information. Therefore, it is possible to achieve integrated compressed light field display for horizontal viewing, or integrated compressed light field display with full parallax.

[0026] The integrated imaging system based on multi-layer atomized liquid crystal fast refresh provided in this application will be described in detail below with reference to the accompanying drawings, through specific embodiments and application scenarios.

[0027] For example, the imaging control unit is used to acquire a target value corresponding to the image to be displayed; the target value is used to characterize the real light field distribution corresponding to the real three-dimensional imaging of the image to be displayed; the imaging control unit is also used to fit each ray in the target ray set based on the target value to determine the pixel value set corresponding to each layer of the multilayer atomized liquid crystal; the target ray set includes: rays under different viewing angles in the light field constructed based on the multilayer atomized liquid crystal; the imaging control unit is also used to control each layer of the multilayer atomized liquid crystal to atomize sequentially through a timing voltage, and when each layer of atomized liquid crystal is atomized, control the pixel value displayed by each pixel on the liquid crystal panel based on the pixel value set corresponding to each layer of atomized liquid crystal; wherein, the parallel light emitted by the liquid crystal panel is scattered after being incident on the atomized area of ​​the atomized liquid crystal; the light scattered by the atomized liquid crystal is imaged through a lens array; during imaging, one layer of atomized liquid crystal is controlled to atomize at a time.

[0028] For example, the refresh rate of the integrated imaging system is a preset multiple of the target refresh rate; the target refresh rate is obtained based on the refresh rate perceived by the human eye; the preset multiple is the number of layers of atomized liquid crystal contained in the multilayer atomized liquid crystal. The atomized liquid crystal layers of the multilayer atomized liquid crystal are uniformly distributed; the spaces between the atomized liquid crystal layers of the multilayer atomized liquid crystal are filled with a transparent material or a gas of uniform density.

[0029] Exemplarily, in this embodiment, multiple layers of atomized liquid crystal are stacked. By adjusting the timing voltage, the atomized liquid crystal can be refreshed rapidly. The timing process atomizes each layer of liquid crystal separately, while the others remain transparent. The system uses a parallel light source as input. Parallel light is incident on the liquid crystal panel and emits parallel light loaded with information. We use multiple layers of atomized liquid crystal, which are refreshed rapidly according to the timing sequence. When parallel light is incident on the atomized liquid crystal, scattering occurs, which can then be imaged by subsequent optical devices. Due to the persistence of vision effect, the multiple layers of atomized liquid crystal form multiple discrete planes. To solve this problem, this embodiment also proposes an integrated compressed light field content calculation method, enabling the 3D displayed content to have a large continuous depth of field.

[0030] Specifically, the imaging control unit is used to calculate the imaging position of the multilayer atomized liquid crystal using the Gaussian formula, obtaining the points corresponding to the points on the imaging plane of each layer of atomized liquid crystal; the imaging control unit is also used to determine the light rays formed by the points on the imaging plane corresponding to the points on the imaging plane of each layer of atomized liquid crystal, based on the points corresponding to the points on the imaging plane of each layer of atomized liquid crystal, to obtain the target light ray set; the imaging control unit is also used to calculate the light ray value of each light ray based on the points on each light ray in the target light ray set, and calculate the loss value between the light ray value of each light ray and the target value; the imaging control unit is also used to update the pixel values ​​of the liquid crystal panel through gradient descent based on the loss value between the light ray value of each light ray and the target value, to obtain the pixel value set corresponding to each layer of atomized liquid crystal.

[0031] For example, the integrated imaging system in the embodiments of this application can be divided into the following categories: Figure 5 The real image mode shown and as Figure 6 The integrated imaging system, as shown in the virtual image mode, includes two display modes: a real image mode and a virtual image mode. In the real image mode, the imaging position of the integrated imaging system is outside the focal length range of the lens array. In the virtual image mode, the imaging position of the integrated imaging system is within the focal length range of the lens array. In the integrated imaging system of this application embodiment, each layer of liquid crystal can be imaged by optical devices, and the imaging process satisfies the Gaussian imaging formula. The above-mentioned method for calculating the content of the integrated compressed light field is applicable to one-dimensional or two-dimensional optical device arrays. A one-dimensional optical device array is a set of horizontally arranged cylindrical gratings, which can provide one-dimensional parallax and provide horizontal stereoscopic information. When the viewer moves horizontally, they can feel the stereoscopic effect. A two-dimensional optical device array is generally a lens array that can provide two-dimensional total parallax, and when the viewer moves up, down, left, and right, they can feel the stereoscopic information.

[0032] For example, in the embodiments of this application, the imaging position of each layer of atomized liquid crystal is calculated according to the following Gaussian imaging formula:

[0033] in, The distance between the atomized liquid crystal and the lens array. For imaging distance, Let be the focal length of the lens. When the focal length of the lenses in the lens array is fixed, the distance between any of the atomized liquid crystals in the multilayer atomized liquid crystal and the lens is negatively correlated with the imaging distance.

[0034] Therefore, points on the imaging surface can be calculated from points on the multilayer liquid crystal. For example... Figure 5 and Figure 6As shown, taking the above-mentioned multilayer atomized liquid crystal as an example of a three-layer atomized liquid crystal, the three dots on the three-layer atomized liquid crystal... , , Three imaging planes can be obtained respectively (i.e.) , , Three points on) , , The three imaging points can be adjusted and combined into a single ray. Since the compressed light field of the multilayer atomized liquid crystal uses multiplicative modulation, the numerical calculation method for this ray is as follows:

[0035] It is understood that, in the embodiments of this application, the light rays that need to be fitted can be understood as light rays under different viewing angles after being imaged by a lens. The value of each light ray is fitted with the target value corresponding to the image to be displayed, thereby adjusting and determining the pixel value of each pixel on the liquid crystal panel when each layer of atomized liquid crystal is atomized.

[0036] For example, to obtain the best display results, the light from all viewing angles can be aggregated and compared with the target value. Calculate the loss. In this embodiment, the n-norm can be used to calculate the above loss, and gradient descent can be used to update the pixel value of each pixel on the liquid crystal panel. Specifically, it can be calculated using the following formula:

[0037] For example, the refresh rate of the integrated imaging system is a preset multiple of the target refresh rate; the target refresh rate is obtained based on the refresh rate perceived by the human eye; and the preset multiple is the number of layers of the atomized liquid crystal contained in the multilayer atomized liquid crystal.

[0038] Understandably, by utilizing the aforementioned integrated compressed light field content calculation method, a feasible large depth-of-field 3D display effect can be obtained. Taking a refresh rate of 30Hz as perceived by the human eye as an example, the refresh rate of the atomized liquid crystal should be N×30Hz or higher, where N is the number of atomized liquid crystal layers.

[0039] It should be noted that the refresh rate mentioned above in the embodiments of this application can be expressed as the atomization period of the atomized liquid crystal, and since the display content of the liquid crystal panel corresponds to the atomization of the atomized liquid crystal, the refresh rate can also represent the content update frequency of the liquid crystal panel.

[0040] For example, the atomized liquid crystal includes: a first mode and a second mode; the imaging control unit is specifically configured to control the atomized liquid crystal to atomize by applying a voltage when the atomized liquid crystal is in the first mode; the imaging control unit is further configured to control the atomized liquid crystal to atomize by canceling the voltage applied to the atomized liquid crystal when the atomized liquid crystal is in the second mode.

[0041] For example, atomized liquid crystal is a liquid crystal made of a special material, which is divided into normal mode and non-normal mode (i.e., the first mode and the second mode mentioned above), such as Figure 7 The diagram shows a fogging schematic of a fogging liquid crystal in normal mode (i.e., the first mode mentioned above). When no voltage is applied, the fogging liquid crystal does not fog, and light does not change its propagation direction after passing through it. When a voltage is applied, the fogging liquid crystal fogs, and light is scattered after passing through it. Figure 8 The diagram shows the atomization of a liquid crystal in a non-normal mode (i.e., the second mode mentioned above). When a voltage is applied, the liquid crystal does not atomize, and the light does not change its propagation direction after passing through the liquid crystal. When no voltage is applied, the liquid crystal atomizes, and the light is scattered after passing through the liquid crystal.

[0042] It should be noted that in the integrated imaging system based on fast refresh of multi-layer atomized liquid crystal in the embodiments of this application, the timing voltage is used to control each layer of atomized liquid crystal in the multi-layer atomized liquid crystal to perform periodic atomization, and only one layer of atomized liquid crystal is atomized at a time.

[0043] The integrated imaging system based on fast refresh of multilayer fogged liquid crystal provided in this application includes: a liquid crystal panel for loading an image to be displayed, a lens array, a multilayer fogged liquid crystal located between the liquid crystal panel and the lens array, and an imaging control unit; the imaging control unit is used to acquire a target value corresponding to the image to be displayed; the target value is used to characterize the real light field distribution corresponding to the real three-dimensional imaging of the image to be displayed; the imaging control unit is further used to fit each ray in the target ray set based on the target value to determine the pixel value set corresponding to each layer of fogged liquid crystal in the multilayer fogged liquid crystal. The target light set includes light rays from different viewing angles within the light field constructed based on the multilayer atomized liquid crystal. The imaging control unit is further configured to sequentially control the atomization of each layer of the multilayer atomized liquid crystal via a timing voltage, and, during the atomization of each layer, control the pixel value displayed on the liquid crystal panel based on the pixel value set corresponding to each layer. Parallel light emitted from the liquid crystal panel is scattered upon entering the atomized area of ​​the atomized liquid crystal. The scattered light rays are imaged through a lens array. During imaging, one layer of atomized liquid crystal is controlled to atomize at a time. Thus, by introducing a multilayer atomized liquid crystal structure, multiple layers of display content are provided for the display, thereby forming a multilayer imaging plane with a large display depth of field.

[0044] The integrated imaging method based on fast refresh of multilayer atomized liquid crystal provided in this application will be described in detail below with reference to the accompanying drawings, through specific embodiments and application scenarios.

[0045] like Figure 9 As shown in the embodiment of this application, an integrated imaging method based on fast refresh of multilayer fogged liquid crystal is provided. The method may include the following steps 901 to 903: Step 901: Obtain the target value corresponding to the image to be displayed.

[0046] The target value is used to characterize the true light field distribution corresponding to the true three-dimensional imaging of the image to be displayed.

[0047] Step 902: Fit each ray in the target ray set based on the target value to determine the set of pixel values ​​corresponding to each layer of the multilayer atomized liquid crystal.

[0048] The target ray set includes rays from different angles within the light field constructed based on the multilayer atomized liquid crystal.

[0049] Step 903: Control each layer of the multilayer atomized liquid crystal to atomize sequentially by using timing voltage, and control the pixel value displayed on the liquid crystal panel based on the pixel value set corresponding to each layer of atomized liquid crystal during atomization.

[0050] In this process, parallel light emitted by the liquid crystal panel is scattered after it is incident on the atomized area of ​​the atomized liquid crystal; the light scattered by the atomized liquid crystal is imaged through a lens array; during image formation, one atomized liquid crystal layer is controlled to atomize at a time.

[0051] Specifically, step 902 above may further include steps 902a1 to 902a4: Step 902a1: Calculate the imaging position of the multilayer atomized liquid crystal using the Gaussian formula to obtain the point on the imaging plane corresponding to the point on each layer of atomized liquid crystal.

[0052] Step 902a2: Based on the points on the imaging plane corresponding to the points on each layer of the atomized liquid crystal, determine the light rays formed by the points on the imaging plane corresponding to the points on each layer of the atomized liquid crystal in the multilayer atomized liquid crystal, and obtain the target light ray set.

[0053] Step 902a3: Based on the points on each ray in the target ray set, calculate the ray value of each ray, and calculate the loss value between the ray value of each ray and the target value.

[0054] Step 902a4: Based on the loss value between the ray value of each ray and the target value, update the pixel value of the liquid crystal panel through gradient descent to obtain the set of pixel values ​​corresponding to each layer of atomized liquid crystal.

[0055] It should be noted that each step of the integrated imaging method based on fast refresh of multilayer atomized liquid crystal provided in the application embodiments has been described in detail in the above section on integrated imaging system based on fast refresh of multilayer atomized liquid crystal, and will not be repeated here to avoid repetition.

[0056] The integrated imaging method based on fast refresh of multilayer fogged liquid crystal provided in this application embodiment is applied to the imaging control unit in an integrated imaging system based on fast refresh of multilayer fogged liquid crystal. The method includes: acquiring a target value corresponding to the image to be displayed; the target value is used to characterize the real light field distribution corresponding to the real three-dimensional imaging of the image to be displayed; fitting each ray in the target ray set based on the target value to determine the pixel value set corresponding to each fogged liquid crystal layer in the multilayer fogged liquid crystal; the target ray set includes: rays under different viewing angles in the light field constructed based on the multilayer fogged liquid crystal; controlling each fogged liquid crystal layer in the multilayer fogged liquid crystal to fog up sequentially through a timing voltage, and controlling the pixel value displayed by each pixel on the liquid crystal panel based on the pixel value set corresponding to each fogged liquid crystal layer during fogging; wherein, parallel light emitted by the liquid crystal panel is scattered after entering the fogged area of ​​the fogged liquid crystal; the light scattered by the fogged liquid crystal is imaged through a lens array; during imaging, one fogged liquid crystal layer is controlled to fog up at a time.

[0057] Figure 10 An example is a schematic diagram of the physical structure of an electronic device, such as... Figure 10 As shown, the electronic device may include: a processor 1010, a communications interface 1020, a memory 1030, and a communications bus 1040, wherein the processor 1010, the communications interface 1020, and the memory 1030 communicate with each other through the communications bus 1040. The processor 1010 can call logic instructions in the memory 1030 to execute an integrated imaging method based on fast refresh of multilayer fogged liquid crystal. This method includes: acquiring a target value corresponding to the image to be displayed; the target value is used to characterize the real light field distribution corresponding to the real three-dimensional imaging of the image to be displayed; fitting each ray in the target ray set based on the target value to determine the pixel value set corresponding to each layer of fogged liquid crystal in the multilayer fogged liquid crystal; the target ray set includes: rays from different viewing angles in the light field constructed based on the multilayer fogged liquid crystal; sequentially controlling each layer of fogged liquid crystal in the multilayer fogged liquid crystal to fog up using a timing voltage, and controlling the pixel value displayed on the liquid crystal panel based on the pixel value set corresponding to each layer of fogged liquid crystal during fogging; wherein, parallel light emitted by the liquid crystal panel is scattered after entering the fogged area of ​​the fogged liquid crystal; the light scattered by the fogged liquid crystal is imaged through a lens array; during imaging, one layer of fogged liquid crystal is controlled to fog up at a time.

[0058] Furthermore, the logical instructions in the aforementioned memory 1030 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0059] On the other hand, this application also provides a computer program product, which includes a computer program stored on a computer-readable storage medium. The computer program includes program instructions, and when the program instructions are executed by a computer, the computer is able to execute the integrated imaging method based on fast refresh of multilayer fogged liquid crystal provided by the above methods. The method includes: obtaining a target value corresponding to the image to be displayed; the target value is used to characterize the real light field distribution corresponding to the real three-dimensional imaging of the image to be displayed; fitting each ray in the target ray set based on the target value to determine the light field distribution in the multilayer fogged liquid crystal. The set of pixel values ​​corresponding to each layer of atomized liquid crystal; the set of target light rays includes: light rays from different viewing angles in the light field constructed based on the multi-layer atomized liquid crystal; each layer of atomized liquid crystal in the multi-layer atomized liquid crystal is atomized sequentially by a timing voltage, and when each layer of atomized liquid crystal is atomized, the pixel value displayed by each pixel on the liquid crystal panel is controlled based on the set of pixel values ​​corresponding to each layer of atomized liquid crystal; wherein, the parallel light emitted by the liquid crystal panel is scattered after being incident on the atomized area of ​​the atomized liquid crystal; the light rays scattered by the atomized liquid crystal are imaged through a lens array; during imaging, one layer of atomized liquid crystal is atomized at a time.

[0060] In another aspect, this application also provides a computer-readable storage medium storing a computer program thereon, which, when executed by a processor, performs the aforementioned integrated imaging method based on fast refresh of multilayer fogged liquid crystal. The method includes: acquiring a target value corresponding to the image to be displayed; the target value being used to characterize the true light field distribution corresponding to the true three-dimensional imaging of the image to be displayed; fitting each ray in the target ray set based on the target value to determine a set of pixel values ​​corresponding to each layer of fogged liquid crystal in the multilayer fogged liquid crystal; the target ray set including: rays from different viewing angles in the light field constructed based on the multilayer fogged liquid crystal; sequentially controlling each layer of fogged liquid crystal in the multilayer fogged liquid crystal to fog up using a timing voltage, and controlling the pixel value displayed on the liquid crystal panel based on the set of pixel values ​​corresponding to each layer of fogged liquid crystal during fogging; wherein, parallel light emitted by the liquid crystal panel is scattered after incident on the fogged area of ​​the fogged liquid crystal; the light scattered by the fogged liquid crystal is imaged through a lens array; during imaging, one layer of fogged liquid crystal is controlled to fog up at a time.

[0061] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0062] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.

[0063] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. An integrated imaging system based on multi-layer atomized liquid crystal with fast refresh, characterized in that, include: A liquid crystal panel for loading an image to be displayed, a lens array, a multilayer atomized liquid crystal located between the liquid crystal panel and the lens array, and an imaging control unit; The imaging control unit is used to acquire the target value corresponding to the image to be displayed; the target value is used to characterize the real light field distribution corresponding to the real three-dimensional imaging of the image to be displayed; The imaging control unit is further configured to fit each ray in the target ray set based on the target value, and determine the set of pixel values ​​corresponding to each layer of the multilayer atomized liquid crystal; The target ray set includes: rays from different perspectives in the light field constructed based on the multilayer atomized liquid crystal; The imaging control unit is also used to control each layer of the multilayer atomized liquid crystal to atomize sequentially through timing voltage, and to control the pixel value displayed on each pixel on the liquid crystal panel based on the pixel value set corresponding to each layer of atomized liquid crystal during atomization. In this process, parallel light emitted by the liquid crystal panel is scattered after it is incident on the atomized area of ​​the atomized liquid crystal; the light scattered by the atomized liquid crystal is imaged through a lens array; during image formation, one atomized liquid crystal layer is controlled to atomize at a time.

2. The system according to claim 1, characterized in that, The atomized liquid crystal layers of the multilayer atomized liquid crystal are uniformly distributed; the spaces between the atomized liquid crystal layers of the multilayer atomized liquid crystal are filled with a transparent material or a gas of uniform density.

3. The system according to claim 1, characterized in that, When the focal length of the lenses in the lens array is fixed, the distance between any of the atomized liquid crystals in the multilayer atomized liquid crystal and the lens is negatively correlated with the imaging distance.

4. The system according to any one of claims 1 to 3, characterized in that, The imaging control unit is specifically used to calculate the imaging position of the multilayer atomized liquid crystal using the Gaussian formula, and obtain the point on the imaging plane corresponding to the point on each layer of atomized liquid crystal. The imaging control unit is further configured to determine the light rays formed by the points on the imaging plane corresponding to the points on each layer of the atomized liquid crystal in the multilayer atomized liquid crystal, based on the points on the imaging plane corresponding to the points on each layer of the atomized liquid crystal, and obtain the target light ray set. The imaging control unit is further configured to calculate the ray value of each ray based on the point on each ray in the target ray set, and to calculate the loss value between the ray value of each ray and the target value. The imaging control unit is further configured to update the pixel values ​​of the liquid crystal panel through gradient descent based on the loss value between the light value of each ray and the target value, thereby obtaining a set of pixel values ​​corresponding to each layer of atomized liquid crystal.

5. The system according to claim 4, characterized in that, The integrated imaging system has two display modes: a real image mode and a virtual image mode. In the real image mode, the imaging position of the integrated imaging system is outside the focal length range of the lens array. In the virtual image mode, the imaging position of the integrated imaging system is within the focal length range of the lens array.

6. The system according to claim 4, characterized in that, The refresh rate of the integrated imaging system is a preset multiple of the target refresh rate; the target refresh rate is obtained based on the refresh rate perceived by the human eye; the preset multiple is the number of layers of the atomized liquid crystal contained in the multilayer atomized liquid crystal.

7. An integrated imaging method based on fast refresh of multilayer fogged liquid crystal, characterized in that, An imaging control unit is applied to an integrated imaging system based on fast refresh of multilayer atomized liquid crystal, the system further comprising: a liquid crystal panel for loading an image to be displayed, a lens array, and multilayer atomized liquid crystal located between the liquid crystal panel and the lens array; Obtain the target value corresponding to the image to be displayed; the target value is used to characterize the real light field distribution corresponding to the real three-dimensional imaging of the image to be displayed. Based on the target value, each ray in the target ray set is fitted to determine the pixel value set corresponding to each layer of the multilayer atomized liquid crystal; the target ray set includes: rays from different viewing angles in the light field constructed based on the multilayer atomized liquid crystal; The timing voltage is used to control the atomization of each layer of the multilayer atomized liquid crystal in sequence, and when each layer of atomized liquid crystal is atomized, the pixel value displayed on each pixel on the liquid crystal panel is controlled based on the pixel value set corresponding to each layer of atomized liquid crystal. In this process, parallel light emitted by the liquid crystal panel is scattered after it is incident on the atomized area of ​​the atomized liquid crystal; the light scattered by the atomized liquid crystal is imaged through a lens array; during image formation, one atomized liquid crystal layer is controlled to atomize at a time.

8. The method according to claim 7, characterized in that, The step of fitting each ray in the target ray set based on the target value to determine the pixel value set corresponding to each layer of the multilayer atomized liquid crystal includes: The imaging position of the multilayer atomized liquid crystal is calculated using the Gaussian formula, and the corresponding point on the imaging plane is obtained for each point on the atomized liquid crystal layer. Based on the points on the imaging plane corresponding to the points on each layer of the atomized liquid crystal, the light rays formed by the points on the imaging plane corresponding to the points on each layer of the atomized liquid crystal in the multilayer atomized liquid crystal are determined, and the target light ray set is obtained. Based on the points on each ray in the target ray set, calculate the ray value of each ray, and calculate the loss value between the ray value of each ray and the target value; Based on the loss value between the ray value of each ray and the target value, the pixel values ​​of the liquid crystal panel are updated by gradient descent to obtain the set of pixel values ​​corresponding to each layer of atomized liquid crystal.

9. An electronic device, characterized in that, The system includes a memory, a processor, a computer program stored in the memory and executable on the processor, and an integrated imaging system based on rapid refresh of a multilayer atomized liquid crystal as described in any one of claims 1 to 6, wherein the processor executes the program to implement the steps of the integrated imaging method based on rapid refresh of a multilayer atomized liquid crystal as described in claim 7 or 8.

10. A computer-readable storage medium, characterized in that, It stores a computer program, which, when executed by a processor, implements the steps of the integrated imaging method based on fast refresh of multilayer fogged liquid crystal as described in claim 7 or 8.

Images