Optical waveguide system, driving method thereof, display device, and storage medium

Abstract

The invention discloses an optical waveguide system and a driving method thereof, a display device and a storage medium, and relates to the technical field of optical waveguides, and the optical waveguide system comprises a waveguide sensing module and a thin film steering layer. The thin film steering layer is attached to the eye entering side of the waveguide sensing module, and the eye entering side is the upper layer surface of the surface of the side, adjacent to the human eyes, of the waveguide sensing module; the waveguide sensing module is used for acquiring an image optical axis of an optical image and an eye optical axis of a human eye, and applying pupil expanding voltage corresponding to an optical axis distance to the film turning layer after determining that the eye optical axis deviates from the optical axis distance of the image optical axis; the thin film turning layer is configured to deflect the director to form a thin film grating structure under the driving of a pupil expanding voltage after the pupil expanding voltage applied by the waveguide sensing module is accessed, so that an optical image coupled out by the waveguide sensing module is diffracted by the thin film grating structure and then enters a visual field area of human eyes. The optical efficiency of the optical waveguide system is improved.

Description

Technical Field

[0001] The present application relates to the field of optical waveguide technology, and in particular to an optical waveguide system and a driving method thereof, a display device, and a storage medium. Background Art

[0002] In optical waveguide technology, especially in the field of diffractive optical waveguides used in AR (Augmented Reality) and VR (Virtual Reality) devices, the eyebox is a key parameter to ensure that users can clearly see the full FOV (Field of View) under different head postures and eye movements.

[0003] Considering the wide variability of human interpupillary distance and the natural movement characteristics of the eyeball, existing diffraction waveguides usually adopt a larger eyebox design, such as the common 12x8mm specification, to meet the visual needs of different users. However, this large-size eyebox design requires that the grating structure in the waveguide must be highly customized and optimized to achieve consistent and excellent optical performance at different eyebox positions, which not only greatly increases the complexity and cost of the design, but also the larger eyebox area will cause the light to diffuse and attenuate during propagation, thereby reducing the effective light energy entering the human eye and seriously affecting the optical efficiency of the waveguide.

[0004] Therefore, how to improve the optical efficiency of optical waveguides is a technical problem that needs to be solved urgently. Summary of the invention

[0005] The main purpose of the present application is to provide an optical waveguide system and a driving method thereof, a display device and a storage medium, aiming to improve the optical efficiency of the optical waveguide.

[0006] To achieve the above-mentioned object, the present application provides an optical waveguide system, the optical waveguide system comprising a waveguide sensing module and a thin film steering layer;

[0007] The thin film turning layer is attached to the eye-entry side of the waveguide sensing module, and the eye-entry side is the upper surface of the side surface of the waveguide sensing module adjacent to the human eye;

[0008] The waveguide sensing module is configured to obtain the image optical axis of the optical image and the eye optical axis of the human eye, and after determining the optical axis distance of the eye optical axis deviating from the image optical axis, apply a pupil expansion voltage corresponding to the optical axis distance to the thin film steering layer;

[0009] The thin film steering layer is configured to, after being connected to the pupil expansion voltage applied by the waveguide sensing module, deflect the pointing vector to form a thin film grating structure under the drive of the pupil expansion voltage, so that the optical image coupled out by the waveguide sensing module is incident on the field of view of the human eye after diffraction by the thin film grating structure.

[0010] In one embodiment, the thin film steering layer is an electrically controlled steering layer, and the electrically controlled steering layer includes a liquid crystal thin film layer and an electrically controlled steering component;

[0011] The electric control steering assembly comprises a pixel electrode layer and a common electrode layer which are arranged opposite to each other, and the liquid crystal film layer is arranged between the pixel electrode layer and the common electrode layer;

[0012] The electrically controlled steering component is configured to, after applying the pupil expansion voltage to the pixel electrode layer and the common electrode layer, determine the specific electric field formed between the pixel electrode layer and the common electrode layer, and drive the director of the liquid crystal film layer to deflect to be consistent with the direction of the electric field force corresponding to the specific electric field to form the thin film grating structure.

[0013] In one embodiment, the electrically controlled steering layer further comprises a glass substrate and a protective layer, and the liquid crystal film layer comprises a liquid crystal layer and two orientation control film layers;

[0014] The glass substrate and the protective layer are arranged opposite to each other with a gap, the liquid crystal layer is arranged between the glass substrate and the protective layer, a side of the glass substrate away from the liquid crystal layer is arranged at the eye-entering side, and the liquid crystal layer is provided with a plurality of liquid crystal molecules arranged in an array;

[0015] The two orientation control film layers are respectively arranged on both sides of the liquid crystal layer, and are used to give an initial director to each of the liquid crystal molecules;

[0016] The pixel electrode layer is arranged on a side of one of the orientation regulating film layers close to the protective layer, and the common electrode layer is arranged on a side of the other orientation regulating film layer close to the glass substrate.

[0017] In one embodiment, the thin film steering layer is a motor drive layer, and the motor drive layer includes a micro motor, a thin film reflective surface, and a support structure of the thin film reflective surface;

[0018] The film reflective surface is attached to the eye-entry side of the waveguide sensing module, and the support structure is fixedly arranged on the rotating shaft of the micro motor;

[0019] The motor driving layer is configured to, after receiving the pupil expansion voltage applied by the waveguide sensing module, drive the micro motor to drive the thin film reflective surface to deflect the pointing vector until the light propagation path of the optical image incident on the thin film reflective surface on the horizontal plane is the optical axis spacing, thereby constructing a thin film grating structure.

[0020] In one embodiment, the waveguide sensing module includes a left-eye waveguide module, a right-eye waveguide module, a left eyeglass frame, a right eyeglass frame, a nose pad, and two temples;

[0021] The thin film turning layer is attached to the left eye entrance side of the left eye waveguide module and the right eye entrance side of the right eye waveguide module, and the left eye entrance side and the right eye entrance side constitute the eye entrance side of the waveguide sensing module;

[0022] One side of the nose pad is fixedly connected to the left eyeglass frame, the other side of the nose pad is fixedly connected to the right eyeglass frame, the left-eye waveguide module is embedded in the left eyeglass frame, and the right-eye waveguide module is embedded in the right eyeglass frame;

[0023] One of the two temples is movably connected to a side of the left eyeglass frame away from the nose pad, and the other of the two temples is movably connected to a side of the right eyeglass frame away from the nose pad.

[0024] In one embodiment, the left-eye waveguide module and the right-eye waveguide module are both the same waveguide plate, and a pupil positioning component is disposed on a surface of each waveguide plate adjacent to a human eye;

[0025] The waveguide plate comprises a coupling-in unit and a coupling-out unit, wherein the coupling-out unit is arranged at a side close to the human eye, and the coupling-in unit is arranged at a side close to the projection light source.

[0026] In addition, to achieve the above-mentioned purpose, the present application also provides a driving method of an optical waveguide system, the driving method of the optical waveguide system is applied to the optical waveguide system described in any one of the above-mentioned items, and the driving method of the optical waveguide system includes:

[0027] Acquire the image optical axis of the optical image and the eye optical axis of the human eye through the waveguide sensing module;

[0028] After determining the optical axis distance of the eye optical axis deviating from the image optical axis, applying a pupil expansion voltage corresponding to the optical axis distance to the thin film steering layer attached to the eye entrance side of the waveguide sensing module, wherein the eye entrance side is an upper surface of a side surface of the waveguide sensing module adjacent to the human eye;

[0029] After the thin film steering layer is connected to the pupil expansion voltage applied by the waveguide sensing module, the thin film steering layer is driven to deflect the director to form a thin film grating structure, so that the optical image coupled out by the waveguide sensing module is incident on the field of view of the human eye after diffraction by the thin film grating structure.

[0030] In one embodiment, the thin film steering layer is the electrically controlled steering layer, and the driving method of the optical waveguide system further includes: obtaining a pupil expansion voltage corresponding to the optical axis spacing;

[0031] The step of obtaining the pupil expansion voltage corresponding to the optical axis spacing comprises:

[0032] The optical axis of the image is taken as the Y axis, the direction in which the axis center of the image optical axis extends horizontally toward the temple is the negative direction of the X axis, and the direction in which the axis center of the image optical axis extends horizontally toward the nose pad is the positive direction of the X axis, to construct an optical axis coordinate system;

[0033] Detecting whether the optical axis spacing is greater than a preset reference spacing according to the optical axis coordinate system;

[0034] If the optical axis spacing is greater than the reference spacing, the periodic voltage change value of the optical axis spacing in the positive direction of the X-axis found from a preset periodic voltage query table is used as the pupil expansion voltage corresponding to the optical axis spacing;

[0035] If the optical axis spacing is smaller than the reference spacing, the periodic voltage change value of the optical axis spacing in the negative direction of the X-axis found in the periodic voltage lookup table is used as the pupil expansion voltage corresponding to the optical axis spacing.

[0036] In addition, to achieve the above-mentioned purpose, the present application also provides a display device, which includes an optical waveguide system, a memory, a processor, and a driver program for the optical waveguide system stored in the memory and executable on the processor, and the driver program for the optical waveguide system, when executed by the processor, implements the steps of the driving method of the above-mentioned optical waveguide system.

[0037] In addition, to achieve the above-mentioned purpose, the present application also provides a storage medium, which is a computer-readable storage medium, and a driver program of the optical waveguide system is stored on the computer-readable storage medium. When the driver program of the optical waveguide system is executed by a processor, the steps of the above-mentioned driving method of the optical waveguide system are implemented.

[0038] The present application provides an optical waveguide system and a driving method thereof, a display device, and a storage medium, wherein a thin film steering layer is provided in the optical waveguide system to achieve a significant improvement in optical efficiency. Specifically, the present application attaches the thin film steering layer to the eye-entry side of the waveguide sensing module, that is, the upper surface of the side surface of the waveguide sensing module adjacent to the human eye, thereby greatly reducing the complexity and cost of grating design in the optical waveguide system. The waveguide sensing module provided in the present application can automatically obtain the image optical axis of the optical image and the eye optical axis of the human eye, and can accurately calculate the optical axis spacing of the eye optical axis deviating from the image optical axis; next, the waveguide sensing module applies a pupil expansion voltage corresponding to the optical axis spacing to the thin film steering layer, and the thin film steering layer deflects the director under the drive of the pupil expansion voltage to form a dynamic thin film grating structure, which diffracts the optical image coupled out by the waveguide sensing module, that is, the image reflection optical axis after the light of the optical image coupled out by the waveguide sensing module is reflected by the thin film grating structure coincides with the eye optical axis of the human eye, so that the optical image can be completely incident on the field of view of the human eye, avoiding the diffusion and attenuation of light during the propagation process caused by the large size of the Eyebox, and increasing the effective light energy entering the human eye, thereby significantly improving the optical efficiency of the optical waveguide system. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0040] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0041] Figure 1 It is a block diagram of the large-size Eyebox design involved in the embodiment of the present application;

[0042] Figure 2 is a structural block diagram of an optical waveguide system involved in the first embodiment of the present application;

[0043] Figure 3 It is a schematic diagram of the electric control steering layer involved in the embodiment of the present application;

[0044] Figure 4 is a schematic diagram of the change in the refractive index of the liquid crystal film layer involved in the embodiment of the present application;

[0045] Figure 5 is a schematic diagram of periodic changes in the refractive index of liquid crystal involved in an embodiment of the optical waveguide system of the present application;

[0046] Figure 6 is a schematic diagram of the refractive index distribution of liquid crystal in two-dimensional directions involved in an embodiment of the optical waveguide system of the present application;

[0047] Figure 7 It is a schematic diagram of pupil expansion achieved by liquid crystal molecules in two-dimensional directions according to an embodiment of the optical waveguide system of the present application;

[0048] Figure 8 is a schematic diagram of a waveguide sensing module involved in an embodiment of the optical waveguide system of the present application;

[0049] Fig. 9 It is a driving schematic diagram involved in an embodiment of the optical waveguide system of the present application.

[0050] Fig.10 is a schematic flow chart of a second embodiment of a driving method for an optical waveguide system of the present application;

[0051] Fig.11 It is a schematic diagram of the structure of the display device involved in the embodiment of the present application.

[0052] Description of Figure Numbers:

[0053] 10. Waveguide sensing module; 20. Thin film steering layer; 30. Human eye; 200. Electric steering layer; 201. Liquid crystal thin film layer; 202. Electric steering assembly; 203. Glass substrate; 204. Protective layer; 21. Liquid crystal layer; 22. Directional control film layer; X1. Pixel electrode layer; X2. Common electrode layer; 11. Left-eye waveguide module; 12. Right-eye waveguide module; 13. Left-eye frame; 14. Right-eye frame; 15. Nose pads; 16. Temples.

[0054] The realization of the purpose, functional features and advantages of this application will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0055] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0056] It should be noted that if the embodiments of the present application involve directional indications (such as up, down, left, right, front, back...), the directional indications are only used to explain the relative position relationship, movement status, etc. between the components under a certain specific posture (as shown in the accompanying drawings). If the specific posture changes, the directional indication will also change accordingly.

[0057] In addition, if there are descriptions involving "first", "second", etc. in the embodiments of the present application, the descriptions of "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or suggesting their relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In addition, the technical solutions between the various embodiments can be combined with each other, but they must be based on the ability of ordinary technicians in the field to implement them. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such combination of technical solutions does not exist and is not within the scope of protection required by this application.

[0058] Here, exemplary embodiments are described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application.

[0059] In the field of optical waveguide technology, Eyebox refers to the area where the eyes can see the complete FOV (Field of View) when they are in different positions. It is a key parameter in the design of diffractive optical waveguides.

[0060] Because the interpupillary distances of different races vary greatly, and the eyes move up, down, left, and right when observing, refer to Figure 1 , Figure 1 This is a block diagram of the large-size eyebox design involved in the embodiment of the present application. The OG in the figure is an outcoupling grating. Existing diffraction optical waveguides usually adopt a larger-size eyebox design, such as the common 12x8mm specification. However, a larger eyebox has many disadvantages: first, the grating structure needs to be optimized according to the optical performance of different eyeboxes in design, which puts forward greater requirements for the grating design; second, a larger eyebox will reduce the energy of the light entering the human eye, seriously affecting the optical efficiency of the optical waveguide system, which is one of the bottlenecks restricting the development of the optical waveguide system.

[0061] In order to solve the technical defect of low optical efficiency in the large-size Eyebox design of the above-mentioned existing optical waveguide system, the present application provides an optical waveguide system and a driving method thereof, a display device and a storage medium.

[0062] The present application embodiment provides an optical waveguide system, referring to Figure 2 As shown, Figure 21 is a block diagram of the structure of the optical waveguide system involved in the first embodiment of the present application. The optical waveguide system includes a waveguide sensing module 10 and a thin film steering layer 20; the thin film steering layer 20 is attached to the eye-entry side of the waveguide sensing module 10, and the eye-entry side is the upper surface of the side surface of the waveguide sensing module 10 adjacent to the human eye 30.

[0063] In this embodiment, the optical waveguide system provided by the present application integrates a waveguide sensing module 10 and a thin film steering layer 20, and the thin film steering layer 20 is attached to the eye-entry side of the waveguide sensing module 10, that is, the upper surface of the side surface of the waveguide sensing module 10 adjacent to the human eye 30, so that the overall structure of the optical waveguide system is more compact and integrated, the volume and weight of the product are reduced, and the comfort and convenience of the user wearing the optical waveguide system are improved. When the waveguide sensing module 10 detects that the eye optical axis deviates from the image optical axis of the optical image, a corresponding pupil expansion voltage is applied to the thin film steering layer 20, so that the thin film steering layer 20 deflects the thin film grating structure formed by the director under the drive of the pupil expansion voltage, so that the reflected optical axis of the optical image after being reflected by the liquid crystal film layer 201 coincides with the eye optical axis of the human eye 30, reducing the loss and scattering of the light of the optical image during the propagation process, thereby significantly improving the optical efficiency of the optical waveguide system.

[0064] The waveguide sensing module 10 is configured to obtain the image optical axis of the optical image and the eye optical axis of the human eye 30, and after determining the optical axis distance of the eye optical axis deviating from the image optical axis, apply a pupil expansion voltage corresponding to the optical axis distance to the thin film steering layer 20.

[0065] In this embodiment, the present application sets a pupil positioning component on the surface of the waveguide sensing module 10 facing the user's eye 30, and uses the pupil positioning component to capture and accurately analyze in real time the dynamic relationship between the image optical axis of the optical image and the eye optical axis of the user's eye 30. Specifically, the image optical axis of the optical image and the eye optical axis of the user's eye 30 are obtained through the pupil positioning component. Once it is detected that the eye optical axis deviates from the image optical axis, the optical axis distance of the eye optical axis deviating from the image optical axis is quickly calculated, and a pupil expansion voltage corresponding to the optical axis distance is applied to the thin film steering layer 20 through the waveguide sensing module 10, thereby ensuring that the thin film steering layer 20 attached to the eye-entrance side of the waveguide sensing module 10 can dynamically adjust the propagation direction of the optical image according to the optical axis distance of the eye optical axis deviating from the image optical axis, so that the reflected optical axis of the optical image after reflection by the thin film steering layer 20 coincides with the optical axis of the human eye 30, avoiding the problem of incomplete or unclear image caused by the fixed-size Eyebox design, ensuring that the light of the optical image can always accurately and efficiently enter the field of view of the user's eye 30, bringing a seamless and smooth visual experience to the user, while significantly improving the optical efficiency of the optical waveguide system.

[0066] The thin film steering layer 20 is configured to, after being connected to the pupil expansion voltage applied by the waveguide sensing module 10, deflect the pointing vector under the drive of the pupil expansion voltage to form a thin film grating structure, so that the optical image coupled out by the waveguide sensing module 10 is incident on the field of view of the human eye 30 after diffraction by the thin film grating structure.

[0067] In this embodiment, the thin film steering layer 20 provided in the present application can ensure that the optical waveguide system can dynamically adjust the propagation direction of the optical image according to the actual usage of different users and the changes in the position of the human eye 30, so that the reflected optical axis of the optical image after being reflected by the liquid crystal film layer 201 coincides with the optical axis of the eye, so that the user can always see a complete and clear image. Exemplarily, after the thin film steering layer 20 provided in the present application is connected to the pupil dilation voltage applied by the waveguide sensing module 10, the thin film steering layer 20 deflects the pointing vector under the drive of the pupil dilation voltage to form a dynamic thin film grating structure, and the optical image coupled out by the waveguide sensing module 10 is translated by the light reflected by the thin film grating structure in the horizontal plane by the optical axis spacing, that is, the optical image coupled out by the waveguide sensing module 10 after being reflected by the thin film grating structure has the image reflection optical axis coincident with the eye optical axis of the human eye 30, so that the optical image can be completely incident on the field of view of the human eye 30, which not only ensures the accuracy of light propagation of the optical waveguide system, but also realizes instant adaptation to changes in the user's eye position, so that the user can clearly and completely observe the image content of the optical image at different angles and postures, greatly improving the flexibility and optical efficiency of the optical waveguide system, and bringing a more natural and comfortable visual experience to the user.

[0068] In summary, the present application provides an optical waveguide system and a driving method thereof, a display device, and a storage medium, through which a thin film steering layer 20 is provided to achieve a significant improvement in optical efficiency. Specifically, the present application attaches the thin film steering layer 20 to the eye-entry side of the waveguide sensing module 10, that is, the upper surface of the side surface of the waveguide sensing module 10 adjacent to the human eye 30, thereby greatly reducing the complexity and cost of grating design in the optical waveguide system. The waveguide sensing module 10 provided in the present application can automatically obtain the image optical axis of the optical image and the eye optical axis of the human eye 30, and can accurately calculate the optical axis spacing of the eye optical axis deviating from the image optical axis; next, the waveguide sensing module 10 applies a pupil expansion voltage corresponding to the optical axis spacing to the thin film steering layer 20. After the thin film steering layer 20 is connected to the pupil expansion voltage applied by the waveguide sensing module 10, the thin film steering layer 20 deflects the director under the drive of the pupil expansion voltage to form a dynamic thin film grating structure, and diffracts the optical image coupled out by the waveguide sensing module 10, that is, the image reflection optical axis after the light of the optical image coupled out by the waveguide sensing module 10 is reflected by the thin film grating structure coincides with the eye optical axis of the human eye 30, so that the optical image can be completely incident on the field of view of the human eye 30, avoiding the diffusion and attenuation of light during the propagation process caused by the large-size eyebox, and increasing the effective light energy entering the human eye 30, thereby significantly improving the optical efficiency of the optical waveguide system.

[0069] Further, in some feasible embodiments, referring to Figure 3 , Figure 3 Schematic diagram of the electrically controlled steering layer involved in the embodiment of the present application. The thin film steering layer 20 is an electrically controlled steering layer 200, which includes a liquid crystal film layer 201 and an electrically controlled steering component 202; the electrically controlled steering component 202 includes a pixel electrode layer X1 and a common electrode layer X2 arranged opposite to each other, and the liquid crystal film layer 201 is arranged between the pixel electrode layer X1 and the common electrode layer X2; the electrically controlled steering component is configured to determine the specific electric field formed between the pixel electrode layer X1 and the common electrode layer X2 after applying a pupil expansion voltage to the pixel electrode layer X1 and the common electrode layer X2, and drive the director of the liquid crystal film layer 201 to deflect to form a thin film grating structure in the same direction as the electric field force corresponding to the specific electric field.

[0070] In this embodiment, refer to Figure 3, the thin film steering layer 20 provided in the present application may be an electrically controlled steering layer 200, which is integrated with a liquid crystal film layer 201 and an electrically controlled steering component 202. The present application arranges the pixel electrode layer X1 and the common electrode layer X2 in the electrically controlled steering component on both sides of the liquid crystal film layer 201. Exemplarily, when a pupil expansion voltage is applied to the pixel electrode layer X1 and the common electrode layer X2, the charges of the pixel electrode layer X1 and the common electrode layer X2 move under the action of the pupil expansion voltage, generating a specific electric field corresponding to the pupil expansion voltage, thereby driving the director of the liquid crystal film layer 201 to deflect in the same direction as the electric field force corresponding to the specific electric field, forming a dynamic thin film grating structure; that is to say, the liquid crystal film layer 201 provided in the present application can dynamically control the diffraction direction of the optical image under the drive of the pupil expansion voltage corresponding to the optical axis spacing, so that the optical image can be accurately and completely incident on the visual field area of ​​the human eye 30, ensuring that the user sees a complete and clear image.

[0071] It should be noted that the liquid crystal film layer 201 can be understood as a liquid crystal film having a photoelectric effect. Figure 4 , Figure 4 It is a schematic diagram of the change of the liquid crystal refractive index of the liquid crystal film layer involved in the embodiment of the present application. Figure 4 The shaded ellipse shown is the liquid crystal molecules distributed in an array in the liquid crystal film layer 201. Figure 4 The E direction shown is the electric field direction. Figure 4 The voltage U shown in the figure is represented by a voltage value, and the voltage value along the U direction gradually increases. The liquid crystal molecules will rotate under the action of the electric field, and as the voltage value increases, the angle of rotation of the liquid crystal molecules increases until the long axis direction of the liquid crystal molecules is parallel to the electric field direction. In this way, the refractive index of the liquid crystal film layer 201 can be adjusted by applying different voltages U to the liquid crystal. o and n e The long axis directions of each liquid crystal molecule are parallel to each other, and the director of the liquid crystal film layer 201 refers to a vector arranged in the long axis directions of all liquid crystal molecules, and the director is used to control the refractive index change of the liquid crystal film layer 201.

[0072] In the present application, the director of the liquid crystal film layer 201 is set to be parallel to the horizontal plane, and the right side of the director facing the horizontal plane is 0°. The above is only a feasible implementation of the present application, and the present application does not impose any limitation thereto.

[0073] For example, when the long axis direction of each liquid crystal molecule is parallel to the U direction (ie, the director is parallel to the U direction), the refractive index of the liquid crystal film layer 201 is n o When the long axis direction of each liquid crystal molecule is parallel to the E direction (ie, the director is parallel to the E direction), the refractive index of the liquid crystal film layer 201 is n e .

[0074] Further, in some other feasible embodiments, referring to Figure 3 The electrically controlled steering layer 200 further includes a glass substrate 203 and a protective layer 204, and the liquid crystal film layer 201 includes a liquid crystal layer 21 and two directional control film layers 22; the glass substrate 203 and the protective layer 204 are arranged opposite to each other with an interval, the liquid crystal layer 21 is arranged between the glass substrate 203 and the protective layer 204, the side of the glass substrate 203 away from the liquid crystal layer 21 is arranged on the eye side, and the liquid crystal layer 21 is provided with a plurality of array-arranged liquid crystal molecules; the two directional control film layers 22 are respectively arranged on both sides of the liquid crystal layer 21, for giving each liquid crystal molecule an initial pointing vector; the pixel electrode layer X1 is arranged on a side of one directional control film layer 22-1 close to the protective layer, and the common electrode layer X2 is arranged on a side of another directional control film layer 22-2 close to the glass substrate 203.

[0075] In this embodiment, the present application arranges the glass substrate 203 and the protective layer 204 in a relative manner, places the liquid crystal layer 21 between the glass substrate 203 and the protective layer 204, and arranges the side of the glass substrate 203 away from the liquid crystal layer 21 at the eye-entering side, providing stable support and protection for the entire structure of the liquid crystal film layer 201. At the same time, a plurality of array-arranged liquid crystal molecules are arranged in the liquid crystal layer 21, and the initial director of each liquid crystal molecule is given by the directional control film layer 22 on both sides, so that the arrangement of the liquid crystal molecules has a certain regularity and controllability, so that the thin film steering layer 20 can effectively drive the director of the liquid crystal molecule to change when the pupil expansion voltage applied by the waveguide sensing module 10 is connected, thereby forming a thin film grating structure, that is, the diffraction direction of the optical image can be controlled by the liquid crystal film layer 201 arranged in the present application, so that the optical image can be accurately incident on the visual field of the human eye 30, ensuring that the user sees a complete and clear image.

[0076] It should be noted that the initial director of each liquid crystal molecule can be understood as a vector whose long axis direction of each liquid crystal molecule is parallel to the U direction, that is, the liquid crystal refractive index corresponding to the initial director is Figure 4 The n shown o .

[0077] When the thin film steering layer 20 is an electrically controlled steering layer 200, the pupil expansion voltage corresponding to the optical axis spacing applied by the waveguide sensing module 10 to the thin film steering layer 20 can be understood as a periodically changing voltage value, that is, a periodic voltage.

[0078] In a specific embodiment, the thin film steering layer 20 provided in the present application integrates an electrically controlled steering component 202 of a relatively arranged pixel electrode layer X1 and a common electrode layer X2, and the pixel electrode layer X1 is provided on a side of a directional control film layer 22 close to the protective layer 204, and the common electrode layer X2 is provided on a side of another directional control film layer 22 close to the glass substrate 203, thereby realizing precise control of the director of the liquid crystal layer 21 provided between the two directional control film layers 22. Specifically, a specific electric field is formed between the pixel electrode layer X1 and the common electrode layer X2 after applying a periodic voltage, and the specific electric field directly acts on the array-distributed liquid crystal molecules in the liquid crystal layer 21, guiding the initial director of each liquid crystal molecule to deflect until it is consistent with the direction of the electric field force, thereby forming a thin film grating structure that can accurately and accurately allow the light of the optical image to be incident on the visual field area of ​​the human eye 30.

[0079] For example, refer to Figure 5 , Figure 5 Schematic diagram of periodic change of liquid crystal refractive index involved in an embodiment of the optical waveguide system of the present application. By applying pupil expansion voltage to the pixel electrode layer X1 and the common electrode layer X2 arranged opposite to each other on both sides of the liquid crystal layer 21, a specific electric field is formed between the pixel electrode layer X1 and the common electrode layer X2 after the periodic voltage is applied, so that each liquid crystal molecule in the liquid crystal layer 21 produces a periodic change in refractive index, that is, the directional control of the initial director of each liquid crystal molecule is achieved through the pixel electrode layer X1, that is, the initial director of each liquid crystal molecule is deflected to form a thin film grating structure formed in the same direction as the electric field force corresponding to the specific electric field, so that the incident optical axis of the optical image coupled out of the waveguide body and the eye optical axis of the human eye 30 can be dynamically adjusted according to different usage conditions and the position of the human eye 30, ensuring that the human eye 30 can see a complete and clear optical image, and significantly improving the optical efficiency of the optical waveguide system.

[0080] In another embodiment, referring to Figure 6 , Figure 6 It is a schematic diagram of the refractive index distribution of liquid crystal in two-dimensional directions involved in an embodiment of the optical waveguide system of the present application. Figure 6 The X shown is the change in the refractive index of the liquid crystal molecules in the horizontal direction. Figure 6 The Y shown is the change in the liquid crystal refractive index of the liquid crystal molecules in the vertical direction. Figure 7 , Figure 7 It is a schematic diagram of pupil expansion achieved by liquid crystal molecules in two-dimensional directions according to an embodiment of the optical waveguide system of the present application. Figure 730-1 in the figure represents the user's left eye (i.e., the left human eye), and 30-2 represents the user's right eye (i.e., the right human eye). When there are multiple thin film steering layers 20, the multiple thin film steering layers 20 can be expressed by thin film steering layer 20-1, thin film steering layer 20-2, thin film steering layer 20-3, and thin film steering layer 20-4. Specifically, if the eye optical axis of the user's left eye 30-1 coincides with the image optical axis coupled out by the coupling unit of the waveguide sensing module 10, the optical image coupled out by the coupling unit of the waveguide sensing module 10 can be accurately incident on the visual field of the user's left eye. At this time, if the user's right eye also wants to completely receive the optical image coupled out by the coupling unit of the waveguide sensing module 10, the pupil distance area between the left eye optical axis of the user's left eye and the right eye optical axis of the user's right eye is obtained. Next, the liquid crystal layer 21 overlapping with the pupil distance area in each thin film steering layer 20 is used as the liquid crystal to-be-adjusted layer of each thin film steering layer 20, and the corresponding liquid crystal to-be-adjusted layer is controlled by each thin film steering layer 20 to apply a pupil expansion voltage, thereby controlling the direction of the director of all liquid crystal molecules in each liquid crystal to-be-adjusted layer, so as to obtain the pupil distance of each liquid crystal to-be-adjusted layer in the image. Figure 6 The refractive index distribution changes periodically in the XY direction as shown, until the sum of the horizontal movement distances of the directors in all the liquid crystal layers to be adjusted is equal to the pupil distance between the left eye optical axis and the right eye optical axis, pupil expansion on a two-dimensional plane is achieved.

[0081] It should be noted that the application scenarios of the two-dimensional plane pupil expansion set in the present application can be scenarios such as augmented reality devices, virtual reality devices, and smart glasses.

[0082] Furthermore, in some feasible embodiments, the thin film steering layer 20 is a motor drive layer, which includes a micro motor, a thin film reflective surface and a support structure for the thin film reflective surface; the thin film reflective surface is attached to the eye-entrance side of the waveguide sensing module 10, and the support structure is fixedly arranged on the rotating shaft of the micro motor; the motor drive layer is configured to, after receiving the pupil expansion voltage applied by the waveguide sensing module 10, drive the micro motor to drive the thin film reflective surface to deflect the pointing vector until the light propagation path of the optical image incident on the thin film reflective surface on the horizontal plane is the optical axis spacing, thereby constructing a thin film grating structure.

[0083] In this embodiment, the thin film steering layer 20 provided in the present application may also be a motor drive layer, which is provided with at least a micro motor, a thin film reflective surface and a support structure of the thin film reflective surface. Specifically, the thin film reflective surface is attached to the eye-entrance side of the waveguide sensing module 10, and the support structure is fixed on the rotating shaft of the micro motor. Exemplarily, after the motor driving layer is connected to the pupil expansion voltage applied by the waveguide sensing module 10, it can quickly drive the micromotor to drive the thin film reflective surface to deflect the pointing vector, so that the micromotor can flexibly adjust the light reflection angle of the thin film reflective surface according to the specific situation of the optical axis spacing, ensuring that the light propagation path of the optical image incident on the thin film reflective surface on the horizontal plane can be accurately adjusted to be the same as the optical axis spacing; that is, when the micromotor drives the thin film reflective surface to deflect the pointing vector until the light propagation path of the optical image incident on the thin film reflective surface on the horizontal plane is the optical axis spacing, the thin film grating structure can be accurately constructed. In other words, the present application sets a micromotor to drive the thin film reflective surface to deflect under the drive of the pupil expansion voltage, which can adapt to different usage scenarios and changes in the position of the human eye 30, and flexibly adjust the light reflection angle of the thin film reflective surface to ensure that the human eye 30 can see a complete and clear image, thereby significantly improving the optical efficiency of the optical waveguide system.

[0084] It should be noted that the director of the film reflective surface set in the present application is parallel to the horizontal plane, and the director is 0° to the right of the horizontal plane. In addition, the film reflective surface set in the present application can be a liquid crystal film layer. The above is only a feasible implementation of the present application, and the present application does not make any limitation here.

[0085] Further, in some other feasible embodiments, referring to Figure 8 , Figure 8 FIG. 1 is a schematic diagram of a waveguide sensing module 10 according to an embodiment of the optical waveguide system of the present application. Figure 8 △L1 is the distance between the optical axis of the left eye 30-1 and the optical axis of the image coupled out of the left eye waveguide module 11. Figure 8ΔL2 is the distance between the optical axis of the right eye 30 - 2 and the optical axis of the image coupled out by the right-eye waveguide module 12 . The waveguide sensing module 10 includes a left-eye waveguide module 11, a right-eye waveguide module 12, a left eye frame 13, a right eye frame 14, a nose pad 15 and two temples 16; a thin film steering layer 20 is attached to the left eye entrance side of the left-eye waveguide module 11 and the right eye entrance side of the right eye waveguide module 12, and the left eye entrance side and the right eye entrance side constitute the eye entrance side of the waveguide sensing module 10; one side of the nose pad 15 is fixedly connected to the left eye frame 13, and the other side of the nose pad 15 is fixedly connected to the right eye frame 14, the left-eye waveguide module 11 is embedded in the left eye frame 13, and the right-eye waveguide module 12 is embedded in the right eye frame 14; one of the two temples 16 is movably connected to a side of the left eye frame 13 away from the nose pad 15, and the other temple 16 of the two temples 16 is movably connected to a side of the right eye frame 14 away from the nose pad 15.

[0086] In this embodiment, the left-eye waveguide module 11 and the right-eye waveguide module 12 are respectively embedded in the left eye frame 13 and the right eye frame 14, and a thin film steering layer 20 is attached to the left eye entrance side and the right eye entrance side, so that the optical image incident on the corresponding human eye 30 by the left-eye waveguide module 11 and the right-eye waveguide module 12 is adjusted by the corresponding thin film steering layer 20 to meet the needs of different users' left and right eye vision differences, and improve the clarity and integrity of the optical image incident on the left and right human eyes 30. In addition, the nose pad 15 connects the left eye frame 13 and the right eye frame 14, which increases the stability and comfort of wearing glasses and reduces the discomfort caused by long-term wearing. The temple 16 is movably connected to the eyeglass frame, which is convenient for users to adjust the angle and length of the temple 16 according to their needs, so as to improve the adaptability of wearing.

[0087] Furthermore, in some feasible embodiments, the left-eye waveguide module 11 and the right-eye waveguide module 12 are both the same waveguide plate, and a pupil positioning component is provided on a surface of each waveguide plate adjacent to the human eye 30; the waveguide plate includes a coupling unit and a coupling unit, the coupling unit is provided on a side close to the human eye 30, and the coupling unit is provided on a side close to the projection light source.

[0088] In this embodiment, the left-eye waveguide module 11 and the right-eye waveguide module 12 use the same waveguide plate, which ensures that the image quality seen by the left and right eyes of the user is the same, and reduces the discomfort caused by visual differences. In addition, a pupil positioning component is set on the surface of one side of each waveguide plate adjacent to the human eye 30, which can accurately determine the pupil position of the human eye 30 and provide accurate data support for the light adjustment of the subsequent light image. In addition, the waveguide plate is composed of a coupling unit and a coupling unit. The coupling unit is set on the side close to the human eye 30, which can efficiently guide the light of the optical image to the human eye 30, thereby improving the brightness and clarity of the optical image. The coupling unit is set on the side close to the projection light source, which can effectively receive the light emitted by the projection light source to project the optical image, and guide the light into the waveguide plate for transmission, so that the waveguide plate can efficiently transmit and process the image light, significantly improving the optical efficiency of the optical waveguide system.

[0089] It should be noted that the coupling-in unit can be understood as a coupling-in grating, and the coupling-out unit can be understood as a coupling-out grating.

[0090] In summary, refer to Fig. 9 , Fig. 9 This is a driving schematic diagram of an embodiment of the optical waveguide system of the present application. After the light of the optical image is coupled out through the coupling unit of the waveguide sensing module 10, the thin film steering layer 20 arranged between the human eye 30 and the waveguide sensing module 10 can be adjusted to drive the internal liquid crystal film layer 201 to deflect the director to form a thin film grating structure, so that the light coupled out of the coupling unit can achieve pupil expansion in the horizontal direction. That is to say, the present application can apply a corresponding pupil expansion voltage to the thin film steering layer 20 according to the optical axis spacing of the eye optical axis deviating from the image optical axis, drive the thin film steering layer 20 to electrically control the liquid crystal film layer 201 to turn, so that the horizontal spacing from the liquid crystal film layer 201 to the liquid crystal reflection interface 201' is the optical axis spacing △L, that is, drive the thin film steering layer 20 to electrically control the liquid crystal reflection interface 201' parallel to the liquid crystal film layer 201 to horizontally move the distance of the optical axis spacing △L, so that the image reflection optical axis after the light of the optical image is reflected by the liquid crystal reflection interface 201' coincides with the eye optical axis, ensuring that the human eye 30 can see a complete and clear image, and significantly improving the optical efficiency of the optical waveguide system.

[0091] Further, based on the first embodiment of the optical waveguide system of the present application, a second embodiment of the driving method of the optical waveguide system of the present application is proposed, referring to Fig.10 , Fig.10 It is a schematic flow chart of the second embodiment of the driving method of the optical waveguide system of the present application.

[0092] The driving method of the optical waveguide system of the present application is applied to any of the above optical waveguide systems. The driving method of the optical waveguide system of the present application includes the following implementation steps S10 to S30.

[0093] Step S10: acquiring the image optical axis of the optical image and the eye optical axis of the human eye through a waveguide sensing module;

[0094] Step S20: After determining the optical axis distance of the eye optical axis deviating from the image optical axis, a pupil expansion voltage corresponding to the optical axis distance is applied to the thin film steering layer attached to the eye entrance side of the waveguide sensing module, and the eye entrance side is the upper surface of the side surface of the waveguide sensing module adjacent to the human eye.

[0095] In this embodiment, the present application sets a pupil positioning component on the surface of the waveguide sensing module facing the user's human eye, and the pupil positioning component is used to capture and accurately analyze the dynamic relationship between the image optical axis of the optical image and the eye optical axis of the user's human eye in real time. Specifically, the image optical axis of the optical image and the eye optical axis of the user's human eye are obtained by the pupil positioning component. Once it is detected that the eye optical axis deviates from the image optical axis, the optical axis spacing of the eye optical axis deviating from the image optical axis is quickly calculated, and the pupil expansion voltage corresponding to the optical axis spacing is applied to the thin film steering layer through the waveguide sensing module, thereby ensuring that the thin film steering layer attached to the eye entrance side of the waveguide sensing module can dynamically adjust the propagation direction of the optical image according to the optical axis spacing of the eye optical axis deviating from the image optical axis, so that the reflected optical axis of the optical image after being reflected by the thin film steering layer coincides with the human eye optical axis, avoiding the problem of incomplete or unclear image caused by the fixed size Eyebox design, ensuring that the light of the optical image can always accurately and efficiently enter the visual field of the user's human eye, bringing a seamless and smooth visual experience to the user, and significantly improving the optical efficiency of the optical waveguide system.

[0096] Step S30: After the thin film steering layer is connected to the pupil expansion voltage applied by the waveguide sensing module, the liquid crystal film layer in the thin film steering layer is driven to deflect the pointing vector to form a thin film grating structure, so that the optical image coupled out by the waveguide sensing module is incident on the field of view of the human eye after diffraction by the thin film grating structure.

[0097] In this embodiment, the thin film steering layer provided in the present application can ensure that the optical waveguide system can dynamically adjust the propagation direction of the optical image according to the actual usage of different users and the change of the human eye position, so that the reflected optical axis of the optical image after being reflected by the liquid crystal film layer coincides with the optical axis of the eye, so that the user can always see a complete and clear image. Exemplarily, after the thin film steering layer provided in the present application is connected to the pupil expansion voltage applied by the waveguide sensing module, it immediately drives the internal liquid crystal film layer to deflect the director to form a dynamic thin film grating structure, and the optical image coupled out of the waveguide sensing module is reflected by the thin film grating structure. The light axis of the image reflected by the thin film grating structure of the optical image coupled out of the waveguide sensing module coincides with the optical axis of the human eye, so that the optical image can be completely incident on the visual field of the human eye, which not only ensures the accuracy of the light propagation of the optical waveguide system, but also realizes the instant adaptation to the change of the user's eyeball position, so that the user can clearly and completely observe the image content of the optical image at different angles and postures, greatly improving the flexibility and optical efficiency of the optical waveguide system, and bringing a more natural and comfortable visual experience to the user.

[0098] Further, in some feasible embodiments, the thin film steering layer is the electrically controlled steering layer, and the driving method of the optical waveguide system may further include step A10: obtaining the pupil expansion voltage corresponding to the optical axis spacing, and the above step A10 also includes steps A101 to A104.

[0099] Step A101: construct an optical axis coordinate system with the image optical axis as the Y axis, the direction from the center point of the image optical axis horizontally extending toward the temple as the negative direction of the X axis, and the direction from the center point of the image optical axis horizontally extending toward the nose pad as the positive direction of the X axis.

[0100] In this embodiment, the image optical axis is used as the Y axis, and the position of the light coupled out of the optical image via the waveguide sensing module in the optical axis coordinate system is clarified, which provides a reference benchmark for the subsequent adjustment of the light coupled out of the optical image via the waveguide sensing module; next, the direction of the axis center point of the image optical axis extending horizontally toward the temple is defined as the negative direction of the X axis, and the direction of the horizontal extension toward the nose pad is defined as the positive direction of the X axis, so that the coordinate system is closely integrated with the actual structure of the waveguide sensing module. Thus, the constructed optical axis coordinate system can accurately describe the relative position relationship between the eye optical axis of the human eye and the image optical axis of the optical image, and provide an intuitive and accurate reference framework for the subsequent detection of the optical axis spacing and the adjustment of the light coupled out of the optical image via the waveguide sensing module. That is, through the optical axis coordinate system, the size and direction of the optical axis spacing can be obtained more accurately, so that the pupil expansion voltage can be applied in a targeted manner, and the thin film steering layer is driven to adjust to ensure that the human eye can see a complete and clear optical image.

[0101] Step A101: Detecting whether the optical axis spacing is greater than a preset reference spacing according to the optical axis coordinate system.

[0102] In this embodiment, the relationship between the optical axis spacing and the preset reference spacing can be accurately detected based on the optical axis coordinate system, so as to determine whether it is necessary to drive the thin film steering layer to adjust the light of the optical image coupled out through the waveguide sensing module.

[0103] It should be noted that the reference spacing set in the present application is a zero value, or an interval value floating above and below the zero value customized according to user needs. Exemplarily, when the optical axis spacing is equal to the preset reference spacing, the thin film steering layer is not activated to avoid unnecessary energy consumption. Since the optical axis of the human eye matches the optical axis position of the optical image well at this time and no adjustment is required, not activating the thin film steering layer can reduce the power consumption of the entire optical waveguide system product and improve energy efficiency, especially for portable augmented reality (AR) or virtual reality (VR) devices, which helps to extend the use time of the device.

[0104] Step A101: If the optical axis spacing is greater than the reference spacing, the periodic voltage change value of the optical axis spacing in the positive direction of the X-axis found from a preset periodic voltage query table is used as the pupil expansion voltage corresponding to the optical axis spacing.

[0105] In this embodiment, when the optical axis spacing is greater than the reference spacing, the periodic voltage change value in the positive direction of the X-axis is found from the preset periodic voltage lookup table as the pupil expansion voltage, which can effectively drive the thin film steering layer to adjust the internal liquid crystal film layer deflection pointing vector to form a thin film grating structure, so that the light coupled out of the optical image through the waveguide sensing module can be completely incident on the field of view of the human eye after diffraction by the thin film grating structure, ensuring that the human eye can see a complete and clear image, thereby significantly improving the optical efficiency of the optical waveguide system.

[0106] It should be noted that the preset periodic voltage lookup table is provided with periodic voltage variation values ​​corresponding to different optical axis spacings in the positive / negative direction of the X-axis.

[0107] Step A104: If the optical axis spacing is smaller than the reference spacing, the periodic voltage change value of the optical axis spacing in the negative direction of the X-axis found in the periodic voltage lookup table is used as the pupil expansion voltage corresponding to the optical axis spacing.

[0108] In this embodiment, when the optical axis spacing is smaller than the reference spacing, the periodic voltage change value in the negative direction of the X-axis is found from the preset periodic voltage lookup table as the pupil expansion voltage, which can effectively drive the thin film steering layer to adjust the internal liquid crystal film layer deflection pointing vector to form a thin film grating structure, so that the light coupled out of the optical image through the waveguide sensing module can be completely incident on the field of view of the human eye after diffraction through the thin film grating structure, ensuring that the human eye can see a complete and clear image, thereby significantly improving the optical efficiency of the optical waveguide system.

[0109] In another embodiment, when the thin film steering layer is a motor drive layer, the waveguide sensing module provided in the present application applies a pupil expansion voltage corresponding to the optical axis spacing to the thin film steering layer as the starting voltage of the micro motor, and the starting voltage carries a thin film reflective surface driving direction mark that is the same as the image optical axis movement direction specified by the optical axis spacing. Exemplarily, after the micro motor is connected to the starting voltage, it drives the thin film reflective surface to move in the direction of the image optical axis movement until the light propagation path of the optical image incident on the thin film reflective surface on the horizontal plane is the optical axis spacing, and then constructs a thin film grating structure of the thin film reflective surface, so that the light coupled out of the optical image through the waveguide sensing module can be completely incident on the field of view of the human eye after diffraction of the thin film grating structure, ensuring that the human eye can see a complete and clear image, and significantly improving the optical efficiency of the optical waveguide system.

[0110] In summary, the present application provides an optical waveguide system and a driving method thereof, a display device, and a storage medium, through which a thin film steering layer is set to achieve a significant improvement in optical efficiency. Specifically, the present application attaches the thin film steering layer to the eye-entry side of the waveguide sensing module, that is, the upper surface of the side surface of the waveguide sensing module adjacent to the human eye, thereby greatly reducing the complexity and cost of grating design in the optical waveguide system. The waveguide sensing module provided in the present application can automatically obtain the image optical axis of the optical image and the eye optical axis of the human eye, and can accurately calculate the optical axis spacing of the eye optical axis deviating from the image optical axis; next, the waveguide sensing module applies a pupil expansion voltage corresponding to the optical axis spacing to the thin film steering layer. After receiving the pupil expansion voltage applied by the waveguide sensing module, the thin film steering layer immediately drives the internal liquid crystal film layer to deflect the director to form a dynamic thin film grating structure, and diffracts the optical image coupled out by the waveguide sensing module, that is, the light of the optical image coupled out by the waveguide sensing module is reflected by the thin film grating structure. The image reflection optical axis coincides with the eye optical axis of the human eye, so that the optical image can be completely incident on the field of view of the human eye, avoiding the diffusion and attenuation of light during the propagation process caused by the large size of the eyebox, and increasing the effective light energy entering the human eye, thereby significantly improving the optical efficiency of the optical waveguide system.

[0111] In addition, the present application also provides a display device, the display device includes a memory, a processor, and a driver program of the optical waveguide system stored in the memory and executable on the processor, and the driver program of the optical waveguide system is executed by the processor to implement the steps of the above-mentioned driving method of the optical waveguide system. Fig.11 , Fig.11 1 is a schematic diagram of the structure of a display device according to an embodiment of the present application. The display device according to the embodiment of the present application may be a device for locally running a driving method of an optical waveguide system.

[0112] like Fig.11 As shown, the display device of the embodiment of the present application may include: an optical waveguide system, a processor 1001, such as a CPU, a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Among them, the communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a Wi-Fi interface).

[0113] The memory 1005 is arranged on the display device body, and a program is stored in the memory 1005, and the program is executed by the processor 1001 to implement the corresponding operation. The memory 1005 is also used to store parameters for use by the display device. The memory 1005 can be a high-speed RAM memory, or a stable memory (non-volatile memory), such as a disk memory. The memory 1005 can also be a storage device independent of the aforementioned processor 1001.

[0114] Those skilled in the art will understand that Fig.11 The display device structure shown in the figure does not constitute a limitation on the display device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0115] like Fig.11 As shown, the memory 1005 as a storage medium may include an operating system, a network communication module, a user interface module, and a driver of the optical waveguide system.

[0116] exist Fig.11 In the display device shown, the processor 1001 can be used to call the driving program of the optical waveguide system stored in the memory 1005 and execute the steps of the driving method of the optical waveguide system as described above.

[0117] In addition, to achieve the above-mentioned purpose, the present application also provides a storage medium, which is a computer-readable storage medium, and a driver program of the optical waveguide system is stored on the computer-readable storage medium. When the driver program of the optical waveguide system is executed by a processor, the steps of the above-mentioned driving method of the optical waveguide system are implemented.

[0118] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.

[0119] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0120] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium such as ROM / RAM, a magnetic disk, or an optical disk as described above, and includes a number of instructions for enabling a display device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0121] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. An optical waveguide system, characterized in that: The optical waveguide system includes a waveguide sensing module and a thin film steering layer; The thin film turning layer is attached to the eye-entry side of the waveguide sensing module, and the eye-entry side is the upper surface of the side surface of the waveguide sensing module adjacent to the human eye; The waveguide sensing module is configured to obtain the image optical axis of the optical image and the eye optical axis of the human eye, and after determining the optical axis distance of the eye optical axis deviating from the image optical axis, apply a pupil expansion voltage corresponding to the optical axis distance to the thin film steering layer; The thin film steering layer is configured to, after being connected to the pupil expansion voltage applied by the waveguide sensing module, deflect the pointing vector to form a thin film grating structure under the drive of the pupil expansion voltage, so that the optical image coupled out by the waveguide sensing module is incident on the field of view of the human eye after diffraction by the thin film grating structure.

2. The optical waveguide system according to claim 1, wherein: The thin film steering layer is an electrically controlled steering layer, and the electrically controlled steering layer comprises a liquid crystal thin film layer and an electrically controlled steering component; The electric control steering assembly comprises a pixel electrode layer and a common electrode layer which are arranged opposite to each other, and the liquid crystal film layer is arranged between the pixel electrode layer and the common electrode layer; The electrically controlled steering component is configured to, after applying the pupil expansion voltage to the pixel electrode layer and the common electrode layer, determine the specific electric field formed between the pixel electrode layer and the common electrode layer, and drive the director of the liquid crystal film layer to deflect to be consistent with the direction of the electric field force corresponding to the specific electric field to form the thin film grating structure.

3. The optical waveguide system according to claim 2, wherein: The electrically controlled steering layer further comprises a glass substrate and a protective layer, and the liquid crystal film layer comprises a liquid crystal layer and two directional control film layers; The glass substrate and the protective layer are arranged opposite to each other with a gap, the liquid crystal layer is arranged between the glass substrate and the protective layer, a side of the glass substrate away from the liquid crystal layer is arranged at the eye-entering side, and the liquid crystal layer is provided with a plurality of liquid crystal molecules arranged in an array; The two orientation control film layers are respectively arranged on both sides of the liquid crystal layer, and are used to give an initial director to each of the liquid crystal molecules; The pixel electrode layer is arranged on a side of one of the orientation regulating film layers close to the protective layer, and the common electrode layer is arranged on a side of the other orientation regulating film layer close to the glass substrate.

4. The optical waveguide system according to claim 1, wherein: The thin film steering layer is a motor driving layer, and the motor driving layer includes a micro motor, a thin film reflecting surface and a supporting structure of the thin film reflecting surface; The film reflective surface is attached to the eye-entry side of the waveguide sensing module, and the support structure is fixedly arranged on the rotating shaft of the micro motor; The motor driving layer is configured to, after receiving the pupil expansion voltage applied by the waveguide sensing module, drive the micro motor to drive the thin film reflective surface to deflect the pointing vector until the light propagation path of the optical image incident on the thin film reflective surface on the horizontal plane is the optical axis spacing, thereby constructing a thin film grating structure.

5. The optical waveguide system according to claim 1, wherein: The waveguide sensing module includes a left-eye waveguide module, a right-eye waveguide module, a left eyeglass frame, a right eyeglass frame, a nose pad, and two temples; The thin film turning layer is attached to the left eye entrance side of the left eye waveguide module and the right eye entrance side of the right eye waveguide module, and the left eye entrance side and the right eye entrance side constitute the eye entrance side of the waveguide sensing module; One side of the nose pad is fixedly connected to the left eyeglass frame, the other side of the nose pad is fixedly connected to the right eyeglass frame, the left-eye waveguide module is embedded in the left eyeglass frame, and the right-eye waveguide module is embedded in the right eyeglass frame; One of the two temples is movably connected to a side of the left eyeglass frame away from the nose pad, and the other of the two temples is movably connected to a side of the right eyeglass frame away from the nose pad.

6. The optical waveguide system according to claim 5, characterized in that The left-eye waveguide module and the right-eye waveguide module are both identical waveguide plates, and a pupil positioning component is disposed on a surface of each waveguide plate adjacent to a human eye; The waveguide plate comprises a coupling-in unit and a coupling-out unit, wherein the coupling-out unit is arranged at a side close to the human eye, and the coupling-in unit is arranged at a side close to the projection light source.

7. A method for driving an optical waveguide system, characterized in that: The driving method of the optical waveguide system is applied to the optical waveguide system according to any one of claims 1 to 6, and the driving method of the optical waveguide system comprises: Acquire the image optical axis of the optical image and the eye optical axis of the human eye through the waveguide sensing module; After determining the optical axis distance of the eye optical axis deviating from the image optical axis, applying a pupil expansion voltage corresponding to the optical axis distance to the thin film steering layer attached to the eye entrance side of the waveguide sensing module, wherein the eye entrance side is an upper surface of a side surface of the waveguide sensing module adjacent to the human eye; After the thin film steering layer is connected to the pupil expansion voltage applied by the waveguide sensing module, the thin film steering layer is driven to deflect the director to form a thin film grating structure, so that the optical image coupled out by the waveguide sensing module is incident on the field of view of the human eye after diffraction by the thin film grating structure.

8. The driving method of the optical waveguide system according to claim 7, characterized in that: The thin film steering layer is the electrically controlled steering layer, and the driving method of the optical waveguide system further comprises: obtaining a pupil expansion voltage corresponding to the optical axis spacing; The step of obtaining the pupil expansion voltage corresponding to the optical axis spacing comprises: The optical axis of the image is taken as the Y axis, the direction in which the axis center of the image optical axis extends horizontally toward the temple is the negative direction of the X axis, and the direction in which the axis center of the image optical axis extends horizontally toward the nose pad is the positive direction of the X axis, to construct an optical axis coordinate system; Detecting whether the optical axis spacing is greater than a preset reference spacing according to the optical axis coordinate system; If the optical axis spacing is greater than the reference spacing, the periodic voltage change value of the optical axis spacing in the positive direction of the X-axis found from a preset periodic voltage query table is used as the pupil expansion voltage corresponding to the optical axis spacing; If the optical axis spacing is smaller than the reference spacing, the periodic voltage change value of the optical axis spacing in the negative direction of the X-axis found in the periodic voltage lookup table is used as the pupil expansion voltage corresponding to the optical axis spacing.

9. A display device, characterized in that: The display device comprises the optical waveguide system according to any one of claims 1 to 6, a memory, a processor, and a driver program of the optical waveguide system stored in the memory and executable on the processor, wherein the processor implements the steps of the driving method of the optical waveguide system according to any one of claims 7 to 8 when executing the driver program of the optical waveguide system.

10. A storage medium, the storage medium being a computer-readable storage medium, characterized in that: The computer-readable storage medium stores a driver program of the optical waveguide system, and when the driver program of the optical waveguide system is executed by the processor, the steps of the driving method of the optical waveguide system according to any one of claims 7 to 8 are implemented.

Images