Eye tracking module and manufacturing method thereof, head mounted display

The transparent conductive film with nanowire lines on the lens addresses the obstruction issue in traditional head-mounted displays, ensuring unobstructed vision and enhanced user experience by allowing high transmittance for visible light.

JP2024542594AInactive Publication Date: 2024-11-15BEIJING 7INVENSUN SCI&TECH CO LTD
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
JP2024531433
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2021-11-26
Filing Date
2022-11-18
Publication Date
2024-11-15
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

The layout of infrared lines in traditional head-mounted displays is limited to the edge of the lens, obstructing the user's field of view and limiting the effectiveness of eye-tracking technology.

Method used

An eye tracking module with a transparent conductive film on the lens, using nanowires to form lines that allow high transmittance for visible light, eliminating the obstruction and enhancing user experience.

Benefits of technology

The transparent conductive film with nanowire lines ensures that the user's field of view is not blocked, improving the effectiveness and user experience by allowing unobstructed vision during augmented or virtual reality applications.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024542594000001_ABST
    Figure 2024542594000001_ABST
Patent Text Reader

Abstract

The present disclosure discloses an eye tracking module and its manufacturing method, and a head mounted display. The eye tracking module includes a lens (10) and a transparent conductive film (11) located in an optical path on one side of the lens (10), the transparent conductive film (11) includes a substrate (12) and a line (13) located on the substrate (12), the substrate (12) includes a transparent material, and the material of the line (13) includes nanowires.
Need to check novelty before this filing date? Find Prior Art

Description

Related Applications

[0001] This disclosure claims priority based on a Chinese patent application filed with the China Patent Office on November 26, 2021, bearing application number 2021114208541 and titled "Eye tracking module and manufacturing method thereof, for head-mounted display," the entire contents of which are incorporated herein by reference. [Technical field]

[0002] The present disclosure relates to wearable technology, and in particular to an eye tracking module and a manufacturing method thereof, and a head mounted display. [Background technology]

[0003] With the development of science and technology, head-mounted displays have been widely applied. Conventional head-mounted displays can be worn on the user's head and can realize different effects such as augmented reality (AR), virtual reality (VR) and mixed reality (MR) by transmitting optical signals to the user's eyes.

[0004] Eye tracking technology can be realized using optical recording methods. The principle of optical recording methods is to record the movement of the subject's eyes using an infrared camera, that is, to obtain an eye image that can reflect the eye movement, and to construct an estimated model of the gaze by extracting eye features from the obtained eye image. Here, the eye features can include the pupil position, pupil shape, iris position, iris shape, eyelid position, eye corner position, light spot position (or Purkinje image), etc. The optical recording method includes the pupil-corneal reflex method. The principle of the pupil-corneal reflex method is to irradiate the eye with a near-infrared light source, photograph the eye with an infrared camera, and photograph the light spot that is the reflection point of the light source on the cornea, thereby obtaining an eye image with a light spot.

[0005] Generally, to realize eye tracking, an infrared illumination system and an image acquisition system are installed on the head-mounted device, where the infrared illumination system generally consists of multiple infrared light sources arranged sequentially and fitted into the head-mounted device, so that the image of the infrared light spot can be acquired any time the eyeball rotates at different angles.

[0006] The lines of an infrared lighting system are opaque, and because opaque lines block the user's field of vision, in current VR / AR the lines can only be placed on the periphery of the lens.

[0007] Of course, the eye tracking device may be a MEMS microelectromechanical system, including, for example, a MEMS infrared scanning reflective mirror, an infrared light source, and an infrared receiver, in addition to the optical recording method, or may be a capacitive sensor that detects eye movement by the capacitance value between the eye and a capacitor plate, or a muscle current detector that detects eye movement in a muscle current signal detection mode by placing electrodes on the bridge of the nose, the forehead, the ears, or the earlobes. Summary of the Invention [Problem to be solved by the invention]

[0008] The embodiments of the present disclosure provide an eye tracking module, a manufacturing method thereof, and a head mounted display that solve the problem of limited layout of lines in a lens and improves the user experience by preventing the lines from blocking the user's field of view. [Means for solving the problem]

[0009] According to a first aspect, the eye tracking module provided by the embodiment of the present disclosure includes: Lenses and a transparent conductive film located in the optical path on one side of the lens; The transparent conductive film includes a substrate and a line disposed on the substrate; The substrate includes a transparent material and the material of the lines includes nanowires.

[0010] Preferably, the width of the conductor in the circuit is 0.01 mm or less.

[0011] Preferably, the substrate includes a PVC film, a PI film, a PF film and a PET film.

[0012] Preferably, the display device further includes at least one infrared lamp located on the side of the transparent conductive film remote from the lens and electrically connected to the line.

[0013] In the second aspect, the manufacturing method of the eye tracking module provided by the embodiment of the present disclosure includes: Providing a substrate; forming a transparent conductive film by printing lines using nanowires on the substrate; and attaching the transparent conductive film to a lens. The substrate includes a transparent material.

[0014] Preferably, the method further includes a step of singulating the transparent conductive film to form a single unit before the step of attaching the transparent conductive film to the lens.

[0015] Preferably, the method further includes a step of shaping the transparent conductive film in accordance with a curvature of the lens before the step of attaching the transparent conductive film to the lens.

[0016] Preferably, the method further includes a step of cutting the transparent conductive film according to a shape and dimensions of the lens before the step of attaching the transparent conductive film to the lens.

[0017] Preferably, before the step of attaching the transparent conductive film to the lens, the method further includes the step of forming at least one infrared lamp on the side of the transparent conductive film where the lines are provided, the infrared lamp being electrically connected to the lines.

[0018] According to a third aspect, a head mounted display provided by an embodiment of the present disclosure includes an eye tracking module as described in the first aspect. Effect of the Invention

[0019] According to an embodiment of the present disclosure, an eye tracking module is provided, which includes a lens and a transparent conductive film. The transparent conductive film includes a substrate and a line. The material of the line includes nanowires, i.e., the nanowire material is used to form the line, so that the line has a high transmittance at least to visible light, and the transparent conductive film has a high transmittance at least to visible light, and the transparent conductive film is placed on the lens, which solves the problem of the layout of the line on the lens being limited. And the line does not block visible light and does not block the user's field of vision, improving the user's experience. [Brief description of the drawings]

[0020] [Figure 1] FIG. 2 is a plan view of one type of eye tracking module circuit provided by an embodiment of the present disclosure. [Diagram 2] FIG. 2 is a side view of the eye tracking module circuit shown in FIG. 1. [Diagram 3] FIG. 2 is a side view of one type of eye tracking module provided by an embodiment of the present disclosure. [Figure 4] 1 is a flowchart of a method for manufacturing an eye tracking module provided by an embodiment of the present disclosure. [Diagram 5] FIG. 2 is a schematic diagram of a manufacturing process for one kind of eye tracking module provided by an embodiment of the present disclosure. [Figure 6] FIG. 2 is a schematic diagram of a manufacturing process for one type of eye tracking module provided by an embodiment of the present disclosure. [Figure 7] FIG. 2 is a schematic diagram of a manufacturing process for one type of eye tracking module provided by an embodiment of the present disclosure. [Figure 8] FIG. 8 is a side view of the eye tracking module shown in FIG. [Figure 9] FIG. 2 is a schematic diagram of a manufacturing process for one type of eye tracking module provided by an embodiment of the present disclosure. [Figure 10] FIG. 10 is a side view of the eye tracking module shown in FIG. [Figure 11] FIG. 2 is a schematic diagram of a manufacturing process for one type of eye tracking module provided by an embodiment of the present disclosure. [Figure 12] FIG. 12 is a side view of the eye tracking module shown in FIG. [Figure 13] 1 is a flowchart of a method for manufacturing another type of eye tracking module provided by an embodiment of the present disclosure. [Figure 14] FIG. 2 is a diagram showing a type of head-mounted display provided by an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0021] The present disclosure will be described in more detail below with reference to the drawings and examples. Note that the specific examples described here are merely for the purpose of interpreting the present disclosure and do not limit the present disclosure. In addition, for the sake of convenience, the drawings show only parts related to the present disclosure, not all of the configurations.

[0022] In current VR / AR, the line can only be placed on the periphery of the lens, and cannot be placed on the lens. The size of the lens of the VR / AR headset increases with the increase of the observation field of view, which limits and affects the layout of the line used in eye tracking technology. That is, the lens is manufactured larger and larger, but the eyes do not become larger. If the line is placed on the periphery of the lens and the infrared lamp is placed on the periphery of the lens, it will affect the effect of eye tracking. If the line is installed on the lens, the opaque line will block the user's view.

[0023] In response to the above problem, an embodiment of the present disclosure provides an eye tracking module including an eye tracking module circuit. FIG. 1 is a plan view of one kind of eye tracking module circuit provided by an embodiment of the present disclosure, and FIG. 2 is a side view of the eye tracking module circuit shown in FIG. 1. Referring to FIG. 1 and FIG. 2, the eye tracking module includes an eye tracking module circuit, and the eye tracking module circuit includes a lens 10 and a transparent conductive film 11. The lens 10 is a light-transmitting medium, and can be made of a material such as glass or plastic. The transparent conductive film 11 is located in the light path on one side of the lens 10, and the light propagating through the lens 10 passes through the transparent conductive film 11. The light propagating through the lens 10 may include at least one of visible light and infrared light, for example. The transparent conductive film 11 includes a substrate 12 and a line 13 located on the substrate 12. The substrate 12 includes a transparent material, which has a high transmittance for at least visible light, and a high transmittance for infrared light, for example, 90%, 95% or 99%. The material of the lines 13 includes nanowires.

[0024] Here, the nanowire is a nanoscale wire. Metal nanowires (e.g., Cu, Ni, Pt, Au, Ag, etc.) are used to manufacture microcircuits depending on the constituent material. In addition to excellent electrical conductivity, they also have excellent light transmittance and bending resistance, so they are gradually replacing the materials of traditional ITO transparent electrodes and can be used to manufacture various optical components that are transparent (semi-transparent) and flexible and bendable. Environmentally friendly conductive inks, which are made by blending nanowires, water-based resins, dispersants, auxiliaries, and solvent water, use nanowire printing pastes with high viscosity and low solid content, and combine them with the printing technology of the corresponding substrate as follows to produce a cured and transparent (semi-transparent) nanowire conductive printing layer, which finally becomes a transparent (semi-transparent) conductive circuit required for eye tracking. Currently, nano silver circuits made of silver materials are widely used.

[0025] 2, for the sake of clarity, the lens 10 and the transparent conductive film 11 are provided with a gap between them. In one embodiment, the transparent conductive film 11 may be fixed to the lens 10. In another embodiment, other optical elements and / or an adhesive layer may be further provided between the lens 10 and the transparent conductive film 11.

[0026] An embodiment of the present disclosure provides an eye tracking module, the eye tracking module including an eye tracking module circuit, the eye tracking module circuit including a lens 10 and a transparent conductive film 11. The transparent conductive film 11 includes a substrate 12 and a line 13. The material of the line 13 includes nanowires, that is, by using nanowire materials to form the line 13, the line 13 has high transmittance at least to visible light, and the transparent conductive film 11 has high transmittance at least to visible light, and by placing the transparent conductive film 11 on the lens 10, the problem of the layout of the line on the lens 10 being limited is solved. And the line 13 does not block visible light and does not block the user's field of vision, improving the user's experience.

[0027] In addition, to achieve complete eye tracking functionality, the eye tracking module may further include components such as an infrared lamp, a main control unit and an image acquisition unit in addition to the eye tracking module circuitry.

[0028] Preferably, the width of the conductor in the line 13 is 0.01 mm or less. The smaller the width of the conductor in the line 13, the weaker the light blocking effect of the conductor in the line 13, and the larger the width of the conductor in the line 13, the stronger the light blocking effect of the conductor in the line 13. In the embodiment of the present disclosure, the width of the conductor in the line 13 is set to 0.01 mm or less, thereby reducing the light blocking effect of the conductor in the line 13, increasing the transmittance of the line 13, and increasing the transmittance of the transparent conductive film 11. It has been verified that 0.01 mm is a width that cannot be observed by the human eye, and if it is larger than this value, it may be observed by the user, affecting the user's experience.

[0029] The distance between adjacent conductors in the line 13 also affects the transmittance of the line 13. Usually, the distance between adjacent conductors in the line 13 needs to be larger than a certain value to prevent the distance between adjacent conductors in the line 13 from being too close and affecting the passage of light.

[0030] Preferably, the substrate 12 includes a PVC film, a PI film, a PF film, and a PET film. Here, the PVC film is a polymeric material whose main component is polyvinyl chloride, and in which one hydrogen atom in polyethylene is replaced with one chlorine atom. The PF film is a polyethylene film made of PF particles. The PF film has moisture resistance and low moisture permeability. The PF film is a type of packaging film with comprehensive performance, and has good transparency, gloss, good airtightness and aroma retention, moderate moisture resistance, and low moisture permeability at low temperatures. The PET film has excellent mechanical properties, and its toughness is the best among all thermoplastics, and its tensile strength and impact strength are much higher than those of general films, and it has high rigidity and excellent dimensional stability, making it suitable for secondary processing such as printing and paper bags. The PI film, also known as a polyimide film, is the best-performing film-based insulating material in the world, and is produced by polycondensing pyromellitic dianhydride (PMDA) and diaminodiphenyl ether (DDE) in a strong polar solvent, casting the film, and then imidizing it. It has excellent high and low temperature resistance, electrical insulation, adhesion, radiation resistance, and solvent resistance, and can be used for a long period of time in the temperature range of -269°C to 280°C, and can reach a high temperature of 400°C in a short period of time. In particular, it is suitable for use as a substrate for flexible printed circuit boards and an electrical insulating material for various high-temperature resistant electrical devices. Here, the PET film, PI film, PF film, and PVC film can be formed by a printing method such as roll-to-roll groove model printing, microgravure printing, or direct printing. The substrate 12 may further include a glass substrate, and the glass substrate can be formed by a printing method such as spray printing, shower printing, roll printing, scratch printing, or direct printing.

[0031] 3 is a side view of one kind of eye tracking module provided by an embodiment of the present disclosure. Referring to FIG. 3, the eye tracking module further includes at least one infrared lamp 14, which is located on the side of the transparent conductive film 11 away from the lens 10 and is electrically connected to the line 13. The line 13 provides an operating voltage and / or an operating current to the infrared lamp 14, thereby driving the infrared lamp 14 to emit infrared light, and further realizing eye tracking. Here, the infrared lamp 14 can be a conventional infrared lamp or an infrared emitter formed by printing. Such an infrared emitter has invisibility, which makes the experience more insensitive for the user.

[0032] Based on a similar inventive concept, an embodiment of the present disclosure further provides a method for manufacturing a type of eye tracking module, where FIG. 4 is a flowchart of a method for manufacturing a type of eye tracking module provided by an embodiment of the present disclosure, FIGS. 5 to 7, 9 and 11 are schematic diagrams of the manufacturing process of a type of eye tracking module provided by an embodiment of the present disclosure, FIG. 8 is a side view of the eye tracking module shown in FIG. 7, FIG. 10 is a side view of the eye tracking module shown in FIG. 9, and FIG. 12 is a side view of the eye tracking module shown in FIG. 11. Referring to FIGS. 1 to 12, the method includes the following steps:

[0033] S101: Provide a substrate 12.

[0034] Here, the substrate 12 includes a transparent material.

[0035] S102: Form a transparent conductive film 11 by printing lines 13 on a substrate 12 using nanowires.

[0036] In this step, for example, the lines 13 can be printed on the substrate 12 by nanowire printing technology, and the lines 13 are in a transparent state after being printed on the substrate 12 with nanowires.

[0037] Here, the nanowire printing technique may include at least one of a screen printing technique, a pad printing technique, a transfer printing technique, and a printing technique.

[0038] S103: The transparent conductive film 11 is attached to the lens 10.

[0039] The embodiment of the present disclosure provides a method for manufacturing an eye tracking module for forming the eye tracking module in the above embodiment. The method includes the steps of providing a substrate 12, printing a line 13 on the substrate 12 using nanowires to form a transparent conductive film 11, and attaching the transparent conductive film 11 to a lens 10. In the embodiment of the present disclosure, the nanowire material is used to form the line 13, so that the line 13 has a high transmittance at least to visible light, and the transparent conductive film 11 has a high transmittance at least to visible light, and the transparent conductive film 11 is placed on the lens 10, which solves the problem of the layout of the line on the lens 10 being limited. And the line 13 does not block visible light and does not block the user's field of vision, improving the user's experience.

[0040] FIG. 13 is a flowchart of another method for manufacturing an eye tracking module provided by an embodiment of the present disclosure, with reference to FIGS. 1 to 13, the method includes the following steps:

[0041] S201: Provide a substrate 12.

[0042] S202: Form a transparent conductive film 11 by printing lines 13 on a substrate 12 using nanowires.

[0043] In this step, for example, the lines 13 can be printed on the substrate 12 in a typesetting manner by nanowire printing technology. After the lines 13 are printed on the substrate 12 using nanowires, multiple lines 13 are formed on the substrate 12. In this way, multiple lines 13 can be simultaneously formed on one substrate 12 in the same process step, which can improve the manufacturing efficiency of the eye tracking module.

[0044] S203: The transparent conductive film 11 is divided into individual pieces to form single pieces.

[0045] In this step, the transparent conductive film 11 formed in step S202 above may be singulated to form a plurality of units, and each unit (i.e., a single transparent conductive film) formed after singulation may include at least one circuit 13. The operation on the transparent conductive film 11 in the subsequent steps may be an operation on the unit.

[0046] S204: The transparent conductive film 11 is shaped according to the curvature of the lens 10.

[0047] As shown in FIG. 8, before molding, the transparent conductive film 11 is planar. The surface of the lens 10 is usually curved (for a spherical lens, the surface of the lens 10 may include a spherical surface, and for an aspherical lens, the surface of the lens 10 may include an aspherical surface). In one embodiment, the planar transparent conductive film 11 is attached to the lens 10, and the transparent conductive film 11 can be deformed by the attachment force during the attachment process. In this step, as shown in FIG. 10, before the transparent conductive film 11 is attached to the lens 10, the transparent conductive film 11 is curved according to the curvature of the lens 10, that is, the transparent conductive film 11 is shaped according to the curvature of the lens 10. In this way, since the shape of the transparent conductive film 11 is matched with the curvature of the lens 10 before the transparent conductive film 11 is attached to the lens 10, there is no need to apply excessive attachment force when attaching the transparent conductive film 11 to the lens 10, and damage to the lines 13 in the transparent conductive film 11 and the lens 10 due to excessive attachment force can be avoided.

[0048] S205: The transparent conductive film 11 is cut according to the shape and dimensions of the lens.

[0049] As shown in Fig. 9, before cutting, the transparent conductive film 11 has a rectangular shape. In order to fit the shape and dimensions of the lens, the transparent conductive film 11 can be cut according to the shape and dimensions of the lens to form a circular transparent conductive film 11 as shown in Fig. 11. Of course, the circular transparent conductive film 11 shown in Fig. 11 is only an example, and if the shape and dimensions of the lens change, the shape of the transparent conductive film 11 formed by cutting will change correspondingly.

[0050] S206: The transparent conductive film 11 is attached to the lens 10.

[0051] In addition to the above-mentioned embodiment, the manufacturing method provided by the embodiment of the present disclosure includes dividing the transparent conductive film 11 into individual pieces to form single pieces, forming the single pieces according to the curvature of the lens 10, cutting the transparent conductive film 11 according to the shape and dimensions of the lens, and then attaching the transparent conductive film 11 to the lens 10. Note that, in other embodiments, one of the above steps S203, S204, and S205 may be omitted, or two of the above steps S203, S204, and S205 may be omitted.

[0052] Preferably, in another embodiment, the manufacturing method of the eye tracking module further includes the step of forming at least one infrared lamp 14 electrically connected to the line 13 on the side of the transparent conductive film 11 where the line 13 is provided before attaching the transparent conductive film 11 to the lens 10. The line 13 provides an operating voltage and / or an operating current to the infrared lamp 14, thereby driving the infrared lamp 14 to emit infrared light, and further realizing eye tracking.

[0053] 14 is a schematic diagram of a head mounted display provided by an embodiment of the present disclosure, referring to Fig. 14, the head mounted display includes a lens 10, a case 22, and a headband 23, and the head mounted display further includes an eye tracking module described in the embodiment of the present disclosure. The head mounted display provided by this embodiment includes the eye tracking module in the above embodiment, and therefore has beneficial effects achievable by the above eye tracking module, that is, it solves the problem that the layout of the circuit in the lens is limited, and realizes that the circuit does not block the user's field of vision, improving the user's experience.

[0054] However, the above is merely a preferred embodiment of the present disclosure and the technical principles applied thereto. As can be understood by those skilled in the art, the present disclosure is not limited to the specific embodiments described herein, and various obvious modifications, rearrangements, mutual combinations and substitutions can be made without departing from the scope of protection of the present disclosure. Therefore, although the present disclosure has been described in detail by the above embodiments, the present disclosure is not limited to only the above embodiments, and may include many other equivalent embodiments without departing from the concept of the present disclosure, and the scope of the present disclosure is determined by the appended claims. [Industrial Applicability]

[0055] The eye tracking module provided by the embodiment of the present disclosure is applicable to a head mounted display, and uses nanowire material to form a line, so that the line has high transmittance at least to visible light, and the transparent conductive film has high transmittance at least to visible light, and the transparent conductive film is provided on the lens 10, which solves the problem of the limited layout of the line on the lens, and the line does not block visible light and does not block the user's field of vision, improving the user's experience.

Claims

1. Lenses and a transparent conductive film located in the optical path on one side of the lens; The transparent conductive film includes a substrate and a line disposed on the substrate; the substrate comprises a transparent material; the material of the line comprises nanowires; Eye tracking module.

2. The width of the conductor in the circuit is 0.01 mm or less; The eye tracking module of claim 1 .

3. The substrate includes a PVC film, a PI film, a PE film, and a PET film; The eye tracking module of claim 1 .

4. and at least one infrared lamp located on a side of the transparent conductive film away from the lens and electrically connected to the line. The eye tracking module of claim 1 .

5. Providing a substrate; forming a transparent conductive film by printing lines using nanowires on the substrate; and attaching the transparent conductive film to a lens. The substrate comprises a transparent material. A manufacturing method for an eye tracking module.

6. Before the step of attaching the transparent conductive film to the lens, The transparent conductive film may further include a step of singulating the transparent conductive film to form a single piece. The method according to claim 5.

7. Before the step of attaching the transparent conductive film to the lens, The method further includes the step of shaping the transparent conductive film according to a curvature of the lens. The method according to claim 5.

8. Before the step of attaching the transparent conductive film to the lens, further comprising a step of cutting the transparent conductive film according to a shape and size of the lens. The method according to claim 5.

9. Before the step of attaching the transparent conductive film to the lens, Further comprising the step of forming at least one infrared lamp electrically connected to the line on the side of the transparent conductive film where the line is provided. The method according to claim 5.

10. A head mounted display comprising an eye tracking module according to any one of claims 1 to 4.

Citation Information

Patent Citations

  • Eyeball-tracking device, VR (Virtual Reality) equipment and AR (Augmented Reality) equipment by use of eyeball-tracking device

    CN106598260A

  • Multi-layer circuit structure of eyeball tracking sensor

    CN211427305U

  • Polarizing film for polarizing lens

    JP2002267841A

  • Patterning of nanowires on surfaces for fabrication of nanoscale electronic devices

    JP2009537978A

  • Flexible conductor for use in contact lenses

    JP2017517762A