Display method and device for near-eye light field scanning, electronic equipment and storage medium

Abstract

The invention provides a near-eye light field scanning display method and device, electronic equipment and a storage medium, and the method comprises the steps: displaying a plurality of to-be-processed near-eye light field display contents at different moments based on a time division multiplexing technology; performing offset display processing on the plurality of near-eye light field display contents to be processed to obtain a plurality of offset near-eye light field display contents; the multiple pieces of shifted near-eye light field display content are stacked, target near-eye light field display content is obtained, and the first spatial resolution of the target near-eye light field display content is higher than the second spatial resolution of the near-eye light field display content to be processed. And the spatial resolution of the near-eye light field display content is improved.

Description

Technical Field

[0001] The present invention relates to the field of near-eye display technology, and in particular to a display method, device, electronic device and storage medium for near-eye light field scanning. Background Art

[0002] As a core technology in the field of virtual reality and augmented reality, near-eye display technology has received extensive attention and development in recent years. At present, the mainstream near-eye display technology mainly relies on virtual reality display technology, which uses two flat display screens to provide different display content for the user's two eyes respectively. Through the principle of binocular parallax, that is, the image difference caused by different viewing angles when the two eyes observe the same object, this technology can achieve a three-dimensional display effect.

[0003] It is known from related technologies that for near-eye light field display technology, a microlens array is added in front of the display panel to achieve 3D optical modulation of the flat display content, thereby reproducing the light field visual information received by the human eye. However, the current near-eye light field display technology often has the problem of relatively low spatial resolution of the displayed content, which affects the clarity and detail of the image.

[0004] Therefore, finding a near-eye light field scanning display method that can improve the spatial resolution of near-eye light field display content has become a current research hotspot. Summary of the invention

[0005] The present invention provides a display method, device, electronic device and storage medium for near-eye light field scanning, which improve the spatial resolution of near-eye light field display content and increase the clarity and detail expression of the image of the displayed content.

[0006] The present invention provides a display method for near-eye light field scanning, the method comprising: based on a time division multiplexing technology, displaying a plurality of near-eye light field display contents to be processed at different times; performing offset display processing on the plurality of near-eye light field display contents to be processed to obtain a plurality of offset near-eye light field display contents; performing stacking processing on the plurality of offset near-eye light field display contents to obtain target near-eye light field display contents, wherein a first spatial resolution of the target near-eye light field display contents is higher than a second spatial resolution of the near-eye light field display contents to be processed.

[0007] According to a near-eye light field scanning display method provided by the present invention, before performing offset display processing on the multiple near-eye light field display contents to be processed to obtain multiple offset near-eye light field display contents, the method also includes: calling a scanning device, wherein the scanning device is used to implement offset display processing on the near-eye light field display contents to be processed; performing offset display processing on the multiple near-eye light field display contents to be processed to obtain multiple offset near-eye light field display contents specifically includes: based on the scanning device, performing offset display processing on the multiple near-eye light field display contents to be processed to obtain multiple offset near-eye light field display contents.

[0008] According to a near-eye light field scanning display method provided by the present invention, the scanning device includes a horizontal scanning device and a vertical scanning device; before performing offset display processing on a plurality of near-eye light field display contents to be processed based on the scanning device to obtain a plurality of offset near-eye light field display contents, the method also includes: determining an improvement multiple of the first spatial resolution relative to the second spatial resolution; based on the improvement multiple, determining a horizontal offset of the horizontal scanning device and a vertical offset of the vertical scanning device; performing offset display processing on a plurality of near-eye light field display contents to be processed based on the scanning device to obtain a plurality of offset near-eye light field display contents, specifically includes: performing offset display processing on a plurality of near-eye light field display contents to be processed based on the horizontal scanning device and the vertical scanning device, respectively, according to the horizontal offset and the vertical offset, to obtain a plurality of offset near-eye light field display contents.

[0009] According to a near-eye light field scanning display method provided by the present invention, the horizontal scanning device includes a horizontal galvanometer and a horizontal transparent plate, wherein the horizontal galvanometer drives the horizontal transparent plate to perform a horizontal offset; the vertical scanning device includes a vertical galvanometer and a vertical transparent plate, wherein the vertical galvanometer drives the vertical transparent plate to perform a vertical offset; the offset display processing of the plurality of near-eye light field display contents to be processed is performed based on the horizontal scanning device and the vertical scanning device respectively according to the horizontal offset amount and the vertical offset amount, specifically comprising: determining a first rotation angle of the horizontal galvanometer according to the horizontal offset amount, based on the first thickness of the horizontal transparent plate and the first refractive index of the horizontal transparent plate; determining a second rotation angle of the vertical galvanometer according to the vertical offset amount, based on the second thickness of the vertical transparent plate and the second refractive index of the vertical transparent plate; and controlling the horizontal scanning device and the vertical scanning device respectively based on the first rotation angle and the second rotation angle to perform an offset processing according to the horizontal offset amount and the vertical offset amount in sequence, so as to realize an offset display processing of the plurality of near-eye light field display contents to be processed.

[0010] According to a near-eye light field scanning display method provided by the present invention, the near-eye light field display content to be processed is obtained based on a plane display content after optical modulation of a microlens array, wherein the plane display content is obtained by a flat panel display; the lateral offset of the lateral scanning device and / or the longitudinal offset of the longitudinal scanning device are determined in the following manner: determining the lens size of the microlenses in the microlens array; determining the lateral offset of the lateral scanning device and / or the longitudinal offset of the longitudinal scanning device based on the quotient of the lens size and the lifting multiple.

[0011] According to a near-eye light field scanning display method provided by the present invention, the first size of the transverse transparent plate and / or the second size of the longitudinal transparent plate is greater than the product of the number of microlenses in the microlens array and the lens size.

[0012] The present invention also provides a display device for near-eye light field scanning, the device comprising: a display module, used to display multiple near-eye light field display contents to be processed at different times based on time division multiplexing technology; a processing module, used to perform offset display processing on the multiple near-eye light field display contents to be processed to obtain multiple offset near-eye light field display contents; a generation module, used to stack the multiple offset near-eye light field display contents to obtain target near-eye light field display contents, wherein the first spatial resolution of the target near-eye light field display content is higher than the second spatial resolution of the near-eye light field display content to be processed.

[0013] The present invention also provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the display method of near-eye light field scanning as described above is implemented.

[0014] The present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the display method of near-eye light field scanning as described in any one of the above is implemented.

[0015] The present invention also provides a computer program product, comprising a computer program, wherein when the computer program is executed by a processor, the display method of near-eye light field scanning as described above is implemented.

[0016] The display method, device, electronic device and storage medium of near-eye light field scanning provided by the present invention are based on time-division multiplexing technology to display multiple near-eye light field display contents to be processed at different times; multiple near-eye light field display contents to be processed are subjected to offset display processing to obtain multiple offset near-eye light field display contents; multiple offset near-eye light field display contents are stacked to obtain target near-eye light field display contents, wherein the first spatial resolution of the target near-eye light field display contents is higher than the second spatial resolution of the near-eye light field display contents to be processed. In the present invention, multiple near-eye light field display contents to be processed in time are translated to different spatial positions to obtain offset near-eye light field display contents, and multiple offset near-eye light field display contents are stacked to obtain target near-eye light field display contents, and the persistence effect of the human eye is used to improve the spatial resolution of the near-eye light field, thereby increasing the clarity and detail expression of the image of the displayed content. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0018] Figure 1 This is one of the flow charts of the near-eye light field scanning display method provided by the present invention.

[0019] Figure 2 It is a flow chart of performing offset display processing on a plurality of near-eye light field display contents to be processed to obtain a plurality of offset near-eye light field display contents provided by the present invention.

[0020] Figure 3 The present invention provides a flow chart of performing offset display processing on a plurality of near-eye light field display contents to be processed based on a scanning device to obtain a plurality of offset near-eye light field display contents.

[0021] Figure 4 It is a schematic diagram of an application scenario of the near-eye light field scanning display method provided by the present invention.

[0022] Figure 5 It is a schematic structural diagram of a display device for near-eye light field scanning provided by the present invention.

[0023] Figure 6 It is a structural schematic diagram of the electronic device provided by the present invention.

[0024] Reference numerals: 410: 2D display device; 420: micro lens array; 430: lateral scanning device; 440: Longitudinal scanning device. DETAILED DESCRIPTION

[0025] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the drawings of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0026] The near-eye light field scanning display method provided by the present invention displays different light field contents at different times through a time division multiplexing method, and translates the above-displayed light field contents to different spatial positions through a spatial scanning device, thereby improving the spatial resolution of the displayed content and increasing the clarity and detail expression of the image of the displayed content.

[0027] Figure 1 This is one of the flow charts of the near-eye light field scanning display method provided by the present invention.

[0028] The following will be combined Figure 1 The process of the near-eye light field scanning display method provided by the present invention is described.

[0029] In an exemplary embodiment of the present invention, Figure 1 It can be known that the display method of near-eye light field scanning may include steps 110 to 130, and each step will be introduced below.

[0030] In step 110, based on the time division multiplexing technology, a plurality of near-eye light field display contents to be processed at different times are displayed.

[0031] In one embodiment, multiple near-eye light field display contents to be processed at different times can be displayed based on time division multiplexing technology. Specifically, a microlens array can be added in front of the display panel to implement 3D optical modulation of the flat display content, reproduce the light field visual information received by the human eye, and thus obtain multiple near-eye light field display contents to be processed.

[0032] In step 120 , a plurality of near-eye light field display contents to be processed are subjected to offset display processing to obtain a plurality of offset near-eye light field display contents.

[0033] In step 130 , a plurality of offset near-eye light field display contents are stacked to obtain target near-eye light field display contents, wherein a first spatial resolution of the target near-eye light field display contents is higher than a second spatial resolution of the near-eye light field display contents to be processed.

[0034] Furthermore, in order to solve the problem that the light field display (which may correspond to the near-eye light field display content to be processed) needs to reuse the pixels under a single microlens to display light information at different angles, resulting in a low spatial resolution, in one embodiment, multiple near-eye light field display contents to be processed may be offset and displayed to obtain multiple offset near-eye light field display contents. The multiple offset near-eye light field display contents are then stacked to obtain the target near-eye light field display content, wherein the first spatial resolution of the target near-eye light field display content is higher than the second spatial resolution of the near-eye light field display content to be processed. In this embodiment, multiple near-eye light field display contents to be processed in time are translated to different spatial positions to obtain offset near-eye light field display contents, and multiple offset near-eye light field display contents are stacked to obtain the target near-eye light field display content, and the persistence effect of the human eye is used to improve the spatial resolution of the near-eye light field, and increase the clarity and detail of the image of the display content (which may correspond to the target near-eye light field display content).

[0035] The display method of near-eye light field scanning provided by the present invention is based on time division multiplexing technology to display multiple near-eye light field display contents to be processed at different times; multiple near-eye light field display contents to be processed are subjected to offset display processing to obtain multiple offset near-eye light field display contents; multiple offset near-eye light field display contents are stacked to obtain target near-eye light field display contents, wherein the first spatial resolution of the target near-eye light field display contents is higher than the second spatial resolution of the near-eye light field display contents to be processed. In the present invention, multiple near-eye light field display contents to be processed in time are translated to different spatial positions to obtain offset near-eye light field display contents, and multiple offset near-eye light field display contents are stacked to obtain target near-eye light field display contents, and the persistence effect of the human eye is used to improve the spatial resolution of the near-eye light field, thereby increasing the clarity and detail expression of the image of the displayed content.

[0036] Figure 2 It is a flow chart of performing offset display processing on a plurality of near-eye light field display contents to be processed to obtain a plurality of offset near-eye light field display contents provided by the present invention.

[0037] The following will be combined Figure 2 The process of performing offset display processing on a plurality of near-eye light field display contents to be processed to obtain a plurality of offset near-eye light field display contents provided by the present invention is described.

[0038] In another exemplary embodiment of the present invention, Figure 2 It can be known that performing offset display processing on a plurality of near-eye light field display contents to be processed to obtain a plurality of offset near-eye light field display contents may include step 210 and step 220, and each step will be described below.

[0039] In step 210, a scanning device is called, wherein the scanning device is used to implement offset display processing of near-eye light field display content to be processed.

[0040] In step 220 , based on the scanning device, a plurality of near-eye light field display contents to be processed are subjected to offset display processing to obtain a plurality of offset near-eye light field display contents.

[0041] In one embodiment, a scanning device may be called, and multiple near-eye light field display contents to be processed may be subjected to offset display processing based on the scanning device to obtain multiple offset near-eye light field display contents. The offset near-eye light field display contents may be understood as the result of translating the near-eye light field display contents to be processed to different spatial positions. In the application process, the persistence effect of the human eye may be utilized to improve the spatial resolution of the near-eye light field based on multiple offset near-eye light field display contents.

[0042] Figure 3 The present invention provides a flow chart of performing offset display processing on a plurality of near-eye light field display contents to be processed based on a scanning device to obtain a plurality of offset near-eye light field display contents.

[0043] The following will be combined Figure 3 The process of performing offset display processing on a plurality of near-eye light field display contents to be processed based on a scanning device to obtain a plurality of offset near-eye light field display contents is described.

[0044] In an exemplary embodiment of the present invention, the scanning device may include a transverse scanning device and a longitudinal scanning device. Figure 3 It can be seen that, based on the scanning device, performing offset display processing on a plurality of near-eye light field display contents to be processed to obtain a plurality of offset near-eye light field display contents may include steps 310 to 330, and each step will be described below.

[0045] In step 310, a factor by which the first spatial resolution is increased relative to the second spatial resolution is determined.

[0046] In step 320, based on the lifting factor, the lateral offset of the lateral scanning device and the longitudinal offset of the longitudinal scanning device are determined.

[0047] In one embodiment, the scanning device may include a horizontal scanning device and a vertical scanning device. In the application process, the improvement factor N of the first spatial resolution relative to the second spatial resolution may be determined, that is, the improvement factor N of the spatial resolution of the near-eye light field display content to be processed by the user may be determined. Further, based on the improvement factor N, the horizontal offset of the horizontal scanning device may be determined. and the longitudinal offset of the longitudinal scanning device .

[0048] In one embodiment, based on the lifting factor N, the lateral offset of the lateral scanning device is determined. Can be , ,in, Represents the amount of spatial translation; represents the lens size of the microlens in the microlens array; Indicates the lateral offset; Indicates the number of offsets.

[0049] In another embodiment, based on the lifting factor N, the longitudinal offset of the longitudinal scanning device is determined. Can be , ,in, Represents the amount of spatial translation; represents the lens size of the microlens in the microlens array; Indicates the longitudinal offset; Indicates the number of offsets.

[0050] In step 330, based on the horizontal scanning device and the vertical scanning device, the plurality of near-eye light field display contents to be processed are subjected to offset display processing in accordance with the horizontal offset and the vertical offset in turn, to obtain a plurality of offset near-eye light field display contents.

[0051] In another embodiment, the lateral scanning device can be respectively based on the lateral offset Along the lateral offset, and based on the longitudinal scanning device according to the longitudinal offset By performing an offset display process on a plurality of near-eye light field display contents to be processed along the longitudinal offset, a plurality of offset near-eye light field display contents can be obtained, and the displayed light field contents (corresponding to the near-eye light field display contents to be processed) can be shifted to different spatial positions, laying a foundation for improving the spatial resolution of the displayed contents.

[0052] In another exemplary embodiment of the present invention, the transverse scanning device may include a transverse galvanometer and a transverse transparent plate, wherein the transverse galvanometer drives the transverse transparent plate to perform a transverse displacement; the longitudinal scanning device may include a longitudinal galvanometer and a longitudinal transparent plate, wherein the longitudinal galvanometer drives the longitudinal transparent plate to perform a longitudinal displacement.

[0053] Wherein, based on the horizontal scanning device and the vertical scanning device, the multiple near-eye light field display contents to be processed are subjected to offset display processing according to the horizontal offset and the vertical offset in sequence, which can be realized in the following manner: Determine a first rotation angle of the transverse galvanometer according to the transverse offset, based on a first thickness of the transverse transparent plate and a first refractive index of the transverse transparent plate; According to the longitudinal offset, based on the second thickness of the longitudinal transparent plate and the second refractive index of the longitudinal transparent plate, determining a second rotation angle of the longitudinal galvanometer; Based on the first rotation angle and the second rotation angle, the horizontal scanning device and the vertical scanning device are respectively controlled to perform offset processing according to the horizontal offset amount and the vertical offset amount in sequence, so as to achieve offset display processing of multiple near-eye light field display contents to be processed.

[0054] In one embodiment, the lateral offset may be , based on the first thickness d1 of the transverse transparent plate and the first refractive index n1 of the transverse transparent plate, determining the first rotation angle θ1 of the transverse galvanometer; and according to the longitudinal offset , based on the second thickness d2 of the longitudinal transparent plate and the second refractive index n2 of the longitudinal transparent plate, the second rotation angle θ2 of the longitudinal galvanometer is determined. It should be noted that the lateral offset , can determine , or based on the longitudinal offset , can determine , that is , ,in, Represents the amount of spatial translation; represents the lens size of the microlens in the microlens array; Indicates the lateral offset; Indicates the number of offsets. Or, , ,in, Represents the amount of spatial translation; represents the lens size of the microlens in the microlens array; Indicates the longitudinal offset; Indicates the number of offsets.

[0055] Among them, at time t, the first rotation angle θ1 of the lateral galvanometer (in the scenario at time t, it can be expressed as ) can be realized by formula (1): (1)

[0056] in, Represents the spatial translation corresponding to the first rotation angle θ1 at time t.

[0057] The second rotation angle θ2 of the longitudinal galvanometer (at this time t, it can be expressed as ) can be realized by formula (2): (2)

[0058] in, Represents the spatial translation corresponding to the second rotation angle θ2 at time t.

[0059] It should be noted that the transverse scanning device and the longitudinal scanning device are two-axis translation devices, the transverse and longitudinal axial translation devices. In the application process, the translation of the transverse scanning device and the longitudinal scanning device can be achieved by the transverse galvanometer and the longitudinal galvanometer. Specifically, in each axial direction, taking the transverse direction as an example, the transverse galvanometer drives a transparent plate (corresponding to the transverse transparent plate) with a certain thickness (corresponding to the first thickness d1) to rotate, so that the light field content in each axial direction can be translated.

[0060] In another embodiment, the above-mentioned embodiment is continued as an example to illustrate that based on the first rotation angle θ1 and the second rotation angle θ2, the horizontal scanning device and the vertical scanning device can be controlled to rotate in accordance with the horizontal offset amount. and longitudinal offset Offset processing is performed to achieve offset display processing of multiple near-eye light field display contents to be processed.

[0061] In another exemplary embodiment of the present invention, the near-eye light field display content to be processed can be obtained based on the planar display content after optical modulation of the microlens array, wherein the planar display content can be obtained by a planar display. In one example, the lateral offset of the lateral scanning device and / or the longitudinal offset of the longitudinal scanning device can be determined in the following manner: Determining the lens size of microlenses in a microlens array ; Based on the lens size and magnification The quotient of the horizontal scanning device determines the horizontal offset and\or longitudinal offset of the longitudinal scanning device .

[0062] In one example, the lateral offset of the lateral scanning device Can be , ,in, Represents the amount of spatial translation; represents the lens size of the microlens in the microlens array; Indicates the lateral offset; Indicates the number of offsets.

[0063] In yet another example, the longitudinal offset of the longitudinal scanning device Can be , ,in, Represents the amount of spatial translation; represents the lens size of the microlens in the microlens array; Indicates the longitudinal offset; Indicates the number of offsets.

[0064] In yet another exemplary embodiment of the present invention, the first size of the transverse transparent plate and / or the second size of the longitudinal transparent plate is greater than the product of the number of microlenses in the microlens array and the size of the lens.

[0065] In one example, the number of lenses in the microlens array is , where horizontal , vertical , the lens size of the microlens is The first dimension of the lateral transparent plate of the lateral scanning device is slightly larger than The second dimension of the longitudinal transparent plate of the longitudinal scanning device is slightly larger than .

[0066] Figure 4 It is a schematic diagram of an application scenario of the near-eye light field scanning display method provided by the present invention.

[0067] The following will be combined Figure 4 The process of the near-eye light field scanning display method provided by the present invention is described.

[0068] In an exemplary embodiment of the present invention, Figure 4 It can be seen that the 2D display device 410 and the microlens array 420 maintain a fixed spatial position, wherein the microlens array 420 can modulate the plane display content displayed by the 2D display device 410 into the near-eye light field display content to be processed. In the application process, multiple near-eye light field display contents to be processed at different times can be displayed based on the time division multiplexing technology; then based on the horizontal scanning device 430 and the vertical scanning device 440, the multiple near-eye light field display contents to be processed are offset and displayed to obtain multiple offset near-eye light field display contents, and the multiple offset near-eye light field display contents are stacked to obtain the target near-eye light field display content, wherein the first spatial resolution of the target near-eye light field display content is higher than the second spatial resolution of the near-eye light field display content to be processed.

[0069] In yet another embodiment, the number of lenses in the microlens array is , where horizontal , vertical , the lens size of the microlens is The first dimension of the lateral transparent plate of the lateral scanning device is slightly larger than The second dimension of the longitudinal transparent plate of the longitudinal scanning device is slightly larger than The thickness of the horizontal transparent plate is d1, the thickness of the vertical transparent plate is d2, the refractive index of the horizontal transparent plate is n1, and the refractive index of the vertical transparent plate is n2. In an example, d1 may be the same as d2, and n1 may be the same as n2. For ease of description, an example is given in which d1 is the same as d2, and n1 is the same as n2.

[0070] exist t At this moment, the rotation angle is When , the spatial translation is formula (3): (3)

[0071] in, Indicates the rotation angle θ at time t t The corresponding spatial translation.

[0072] When the lateral offset angle, that is, the first rotation angle, is determined, it can correspond to Figure 4 In x; when the longitudinal offset angle is determined, that is, the second rotation angle is determined, it can correspond to Figure 4 In y; Figure 4 In Representation and x corresponds to the lateral offset of the lateral scanning device; Figure 4 In Representation and y corresponds to the longitudinal offset of the longitudinal scanning device.

[0073] The scanning axes of the longitudinal scanning device and the transverse scanning device are perpendicular, and the other parameters are consistent with those of the transverse scanning device.

[0074] Set the horizontal or vertical offset each time to , , where the horizontal and vertical spatial resolutions are increased by N times respectively.

[0075] exist At this moment, the displayed content is , the corresponding lateral offset , the corresponding lateral galvanometer rotation angle ; The corresponding longitudinal offset ; Longitudinal galvanometer rotation angle .

[0076] The near-eye light field scanning display method proposed in the present invention uses a scanning device to translate multiple light field displays in time to different spatial positions, and uses the persistence effect of the human eye to improve the spatial resolution of the near-eye light field. The galvanometer and flat-panel scanning method proposed in the present invention uses rotation to achieve a translation effect, which has a faster response speed than traditional translation devices and can achieve a light field display effect with a higher spatial resolution.

[0077] According to the foregoing description, the display method of near-eye light field scanning provided by the present invention is based on time-division multiplexing technology to display multiple near-eye light field display contents to be processed at different times; multiple near-eye light field display contents to be processed are subjected to offset display processing to obtain multiple offset near-eye light field display contents; multiple offset near-eye light field display contents are stacked to obtain target near-eye light field display contents, wherein the first spatial resolution of the target near-eye light field display contents is higher than the second spatial resolution of the near-eye light field display contents to be processed. In the present invention, multiple near-eye light field display contents to be processed in time are translated to different spatial positions to obtain offset near-eye light field display contents, and multiple offset near-eye light field display contents are stacked to obtain target near-eye light field display contents, and the persistence effect of the human eye is used to improve the spatial resolution of the near-eye light field, thereby increasing the clarity and detail of the image of the displayed content.

[0078] The display device for near-eye light field scanning provided by the present invention is described below. The display device for near-eye light field scanning described below and the display method for near-eye light field scanning described above can be referred to each other.

[0079] Figure 5 It is a schematic structural diagram of a display device for near-eye light field scanning provided by the present invention.

[0080] The following will be combined Figure 5 The structure of the near-eye light field scanning display device provided by the present invention is described.

[0081] In an exemplary embodiment of the present invention, Figure 5 It can be known that the display device for near-eye light field scanning may include a display module 510, a processing module 520, and a generating module 530, and each module will be introduced below.

[0082] The display module 510 may be configured to display a plurality of near-eye light field display contents to be processed at different times based on a time division multiplexing technology; The processing module 520 may be configured to perform offset display processing on the plurality of near-eye light field display contents to be processed to obtain a plurality of offset near-eye light field display contents; The generation module 530 may be configured to stack the plurality of offset near-eye light field display contents to obtain target near-eye light field display contents, wherein a first spatial resolution of the target near-eye light field display contents is higher than a second spatial resolution of the near-eye light field display contents to be processed.

[0083] In an exemplary embodiment of the present invention, the processing module 520 may also be configured to: Invoking a scanning device, wherein the scanning device is used to implement offset display processing of the near-eye light field display content to be processed; The processing module 520 may implement offset display processing on the plurality of near-eye light field display contents to be processed to obtain a plurality of offset near-eye light field display contents in the following manner: Based on the scanning device, the plurality of near-eye light field display contents to be processed are subjected to offset display processing to obtain a plurality of offset near-eye light field display contents.

[0084] In an exemplary embodiment of the present invention, the scanning device includes a transverse scanning device and a longitudinal scanning device; The processing module 520 may also be configured to: Determining a multiple by which the first spatial resolution is increased relative to the second spatial resolution; Based on the lifting factor, determining a lateral offset of the lateral scanning device and a longitudinal offset of the longitudinal scanning device; The processing module 520 may also implement, based on the scanning device, performing offset display processing on the plurality of near-eye light field display contents to be processed to obtain a plurality of offset near-eye light field display contents in the following manner: Based on the horizontal scanning device and the vertical scanning device respectively, the plurality of near-eye light field display contents to be processed are subjected to offset display processing according to the horizontal offset and the vertical offset in turn, so as to obtain a plurality of offset near-eye light field display contents.

[0085] In an exemplary embodiment of the present invention, the transverse scanning device includes a transverse galvanometer and a transverse transparent plate, wherein the transverse galvanometer drives the transverse transparent plate to shift transversely; the longitudinal scanning device includes a longitudinal galvanometer and a longitudinal transparent plate, wherein the longitudinal galvanometer drives the longitudinal transparent plate to shift longitudinally; The processing module 520 may also implement offset display processing of the plurality of near-eye light field display contents to be processed based on the horizontal scanning device and the vertical scanning device respectively according to the horizontal offset and the vertical offset in sequence in the following manner: Determining a first rotation angle of the transverse galvanometer according to the transverse offset, based on a first thickness of the transverse transparent plate and a first refractive index of the transverse transparent plate; Determine a second rotation angle of the longitudinal galvanometer according to the longitudinal offset, based on a second thickness of the longitudinal transparent plate and a second refractive index of the longitudinal transparent plate; Based on the first rotation angle and the second rotation angle, the horizontal scanning device and the vertical scanning device are respectively controlled to perform offset processing according to the horizontal offset amount and the vertical offset amount in sequence, so as to achieve offset display processing of the plurality of near-eye light field display contents to be processed.

[0086] In an exemplary embodiment of the present invention, the near-eye light field display content to be processed is obtained based on a planar display content after optical modulation of a microlens array, wherein the planar display content is obtained by a planar display; The lateral offset of the lateral scanning device and / or the longitudinal offset of the longitudinal scanning device are determined in the following manner: Determining the lens size of the microlenses in the microlens array; Based on the quotient of the lens size and the lifting factor, the lateral offset of the lateral scanning device and / or the longitudinal offset of the longitudinal scanning device are determined.

[0087] In an exemplary embodiment of the present invention, the first size of the transverse transparent plate and / or the second size of the longitudinal transparent plate is greater than the product of the number of microlenses in the microlens array and the lens size.

[0088] Figure 6 An example of a physical structure diagram of an electronic device is shown in FIG. Figure 6 As shown, the electronic device may include: a processor 610, a communication interface 620, a memory 630 and a communication bus 640, wherein the processor 610, the communication interface 620 and the memory 630 communicate with each other through the communication bus 640. The processor 610 may call the logic instructions in the memory 630 to execute the display method of near-eye light field scanning, the method comprising: based on the time division multiplexing technology, displaying a plurality of near-eye light field display contents to be processed at different times; performing offset display processing on the plurality of near-eye light field display contents to be processed to obtain a plurality of offset near-eye light field display contents; performing stacking processing on the plurality of offset near-eye light field display contents to obtain target near-eye light field display contents, wherein the first spatial resolution of the target near-eye light field display contents is higher than the second spatial resolution of the near-eye light field display contents to be processed.

[0089] In addition, the logic instructions in the above-mentioned memory 630 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when it is sold or used as an independent product. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc. Various media that can store program codes.

[0090] On the other hand, the present invention also provides a computer program product, which includes a computer program. The computer program can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the near-eye light field scanning display method provided by the above-mentioned methods, and the method includes: based on time division multiplexing technology, displaying multiple near-eye light field display contents to be processed at different times; offsetting the display processing of the multiple near-eye light field display contents to be processed to obtain multiple offset near-eye light field display contents; stacking the multiple offset near-eye light field display contents to obtain target near-eye light field display content, wherein the first spatial resolution of the target near-eye light field display content is higher than the second spatial resolution of the near-eye light field display content to be processed.

[0091] On the other hand, the present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, is implemented to execute the near-eye light field scanning display method provided by the above-mentioned methods, the method comprising: based on time division multiplexing technology, displaying a plurality of near-eye light field display contents to be processed at different times; performing offset display processing on the plurality of near-eye light field display contents to be processed to obtain a plurality of offset near-eye light field display contents; stacking the plurality of offset near-eye light field display contents to obtain target near-eye light field display contents, wherein a first spatial resolution of the target near-eye light field display content is higher than a second spatial resolution of the near-eye light field display content to be processed.

[0092] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.

[0093] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0094] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A display method for near-eye light field scanning, characterized in that: The method comprises: Based on time division multiplexing technology, multiple near-eye light field display contents to be processed at different times are displayed; Performing offset display processing on the plurality of near-eye light field display contents to be processed to obtain a plurality of offset near-eye light field display contents; The plurality of offset near-eye light field display contents are stacked to obtain target near-eye light field display contents, wherein a first spatial resolution of the target near-eye light field display contents is higher than a second spatial resolution of the near-eye light field display contents to be processed.

2. The display method of near-eye light field scanning according to claim 1, characterized in that: Before performing offset display processing on the plurality of near-eye light field display contents to be processed to obtain a plurality of offset near-eye light field display contents, the method further includes: Invoking a scanning device, wherein the scanning device is used to implement offset display processing of the near-eye light field display content to be processed; The step of performing offset display processing on the plurality of near-eye light field display contents to be processed to obtain a plurality of offset near-eye light field display contents specifically includes: Based on the scanning device, the plurality of near-eye light field display contents to be processed are subjected to offset display processing to obtain a plurality of offset near-eye light field display contents.

3. The display method of near-eye light field scanning according to claim 2, characterized in that: The scanning device includes a horizontal scanning device and a vertical scanning device; Before performing offset display processing on the plurality of near-eye light field display contents to be processed based on the scanning device to obtain a plurality of offset near-eye light field display contents, the method further includes: Determining a multiple by which the first spatial resolution is increased relative to the second spatial resolution; Based on the lifting factor, determining a lateral offset of the lateral scanning device and a longitudinal offset of the longitudinal scanning device; Based on the scanning device, performing offset display processing on the plurality of near-eye light field display contents to be processed to obtain a plurality of offset near-eye light field display contents specifically includes: Based on the horizontal scanning device and the vertical scanning device respectively, the plurality of near-eye light field display contents to be processed are subjected to offset display processing according to the horizontal offset and the vertical offset in turn, so as to obtain a plurality of offset near-eye light field display contents.

4. The display method of near-eye light field scanning according to claim 3, characterized in that: The transverse scanning device comprises a transverse galvanometer and a transverse transparent plate, wherein the transverse galvanometer drives the transverse transparent plate to shift transversely; the longitudinal scanning device comprises a longitudinal galvanometer and a longitudinal transparent plate, wherein the longitudinal galvanometer drives the longitudinal transparent plate to shift longitudinally; The step of performing offset display processing on the plurality of near-eye light field display contents to be processed based on the horizontal scanning device and the vertical scanning device respectively according to the horizontal offset and the vertical offset in sequence specifically includes: Determining a first rotation angle of the transverse galvanometer according to the transverse offset, based on a first thickness of the transverse transparent plate and a first refractive index of the transverse transparent plate; Determine a second rotation angle of the longitudinal galvanometer according to the longitudinal offset, based on a second thickness of the longitudinal transparent plate and a second refractive index of the longitudinal transparent plate; Based on the first rotation angle and the second rotation angle, the horizontal scanning device and the vertical scanning device are respectively controlled to perform offset processing according to the horizontal offset amount and the vertical offset amount in sequence, so as to achieve offset display processing of the plurality of near-eye light field display contents to be processed.

5. The display method of near-eye light field scanning according to claim 4, characterized in that: The near-eye light field display content to be processed is obtained based on the planar display content after optical modulation of the microlens array, wherein the planar display content is obtained by a planar display; The lateral offset of the lateral scanning device and / or the longitudinal offset of the longitudinal scanning device are determined in the following manner: Determining the lens size of the microlenses in the microlens array; Based on the quotient of the lens size and the lifting factor, the lateral offset of the lateral scanning device and / or the longitudinal offset of the longitudinal scanning device are determined.

6. The display method of near-eye light field scanning according to claim 5, characterized in that: The first size of the transverse transparent plate and / or the second size of the longitudinal transparent plate is greater than the product of the number of microlenses in the microlens array and the lens size.

7. A near-eye light field scanning display device, characterized in that: The device comprises: A display module, used for displaying a plurality of near-eye light field display contents to be processed at different times based on a time division multiplexing technology; A processing module, configured to perform offset display processing on the plurality of near-eye light field display contents to be processed, so as to obtain a plurality of offset near-eye light field display contents; A generation module is used to stack the multiple offset near-eye light field display contents to obtain target near-eye light field display contents, wherein a first spatial resolution of the target near-eye light field display contents is higher than a second spatial resolution of the near-eye light field display contents to be processed.

8. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, the display method of near-eye light field scanning according to any one of claims 1 to 6 is implemented.

9. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the display method of near-eye light field scanning as claimed in any one of claims 1 to 6 is implemented.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the display method of near-eye light field scanning as claimed in any one of claims 1 to 6 is implemented.

Images