Head-mounted device for tracking eyeball and eyeball tracking method

Abstract

The invention provides a head-mounted device for tracking eyeballs and an eyeball tracking method. The head-mounted device comprises a device shell module, a first image acquisition module and a second image acquisition module. The device shell module comprises a first lens frame structure, a second lens frame structure, a first lens structure and a second lens structure. The first image acquisition module comprises a plurality of first image sensors arranged on the first mirror frame structure. The second image acquisition module comprises a plurality of second image sensors arranged on the second mirror frame structure. When a user is configured to selectively wear the head-mounted device, the plurality of first image sensors acquire a first eyeball image of a first eye of the user through a first optical waveguide channel provided by the first lens structure; and a plurality of second image sensors are used for acquiring a second eyeball image of a second eye of the user through a second optical waveguide channel provided by the second lens structure, so that the eyeball position of the user is tracked in a real-time manner.

Description

Technical Field

[0001] The present invention relates to an eye tracking device and an eye tracking method, and in particular to a head mounted device for tracking eyeballs and an eye tracking method using the head mounted device. Background Art

[0002] In the prior art, AR or VR head-mounted devices can provide users with different visual experiences. However, the head-mounted devices in the prior art still have room for improvement. Summary of the invention

[0003] The problem to be improved or solved by the present invention is to provide a head-mounted device for tracking eyeballs and an eye tracking method in view of the shortcomings of the prior art, which can track the eyeball position of the user's left eye and the eyeball position of the right eye in real time.

[0004] In order to improve or solve the above-mentioned problems, one of the technical means adopted by the present invention is to provide a head-mounted device for tracking eyeballs, which includes: a device housing module, a signal control module, a first image acquisition module and a second image acquisition module. The device housing module includes a first frame structure, a second frame structure that cooperates with the first frame structure, a first lens structure carried by the first frame structure and a second lens structure carried by the second frame structure. The signal control module is arranged in the device housing module. The first image acquisition module cooperates with the device housing module and is electrically connected to the signal control module. The second image acquisition module cooperates with the device housing module and is electrically connected to the signal control module. Wherein, the first image acquisition module includes a plurality of first image sensors arranged around a first frame structure, and the second image acquisition module includes a plurality of second image sensors arranged around a second frame structure; wherein, when a user is configured to selectively wear a head-mounted device, the plurality of first image sensors are allowed to be configured through the control of a signal control module to be used for obtaining a first eyeball image of a first eye of the user through a first optical waveguide channel provided by the first lens structure; wherein, when a user is configured to selectively wear a head-mounted device, the plurality of second image sensors are allowed to be configured through the control of a signal control module to be used for obtaining a second eyeball image of a second eye of the user.

[0005] In order to improve or solve the above-mentioned problems, another technical means adopted by the present invention is to provide a head-mounted device for tracking eyeballs, which includes: a device housing module, a signal control module, a first image acquisition module and a second image acquisition module. The device housing module includes a first frame structure, a second frame structure that cooperates with the first frame structure, a first lens structure carried by the first frame structure and a second lens structure carried by the second frame structure. The signal control module is arranged in the device housing module. The first image acquisition module cooperates with the device housing module and is electrically connected to the signal control module. The second image acquisition module cooperates with the device housing module and is electrically connected to the signal control module. Among them, the first image acquisition module includes a plurality of first image sensors arranged on the first frame structure, and the second image acquisition module includes a plurality of second image sensors arranged on the second frame structure.

[0006] In order to improve or solve the above-mentioned problems, another technical means adopted by the present invention is to provide an eye tracking method, which includes: providing a head-mounted device, the head-mounted device includes a device housing module, a signal control module arranged in the device housing module, a first image acquisition module electrically connected to the signal control module, and a second image acquisition module electrically connected to the signal control module; the first image acquisition module transmits through the optical waveguide of the device housing module to obtain a first eye image of the user's first eye; and the second image acquisition module transmits through the optical waveguide of the device housing module to obtain a second eye image of the user's second eye. Wherein, the device housing module includes a first frame structure, a second frame structure cooperating with the first frame structure, a first lens structure carried by the first frame structure, and a second lens structure carried by the second frame structure; wherein, the first image acquisition module includes a plurality of first image sensors arranged around the first frame structure, and the second image acquisition module includes a plurality of second image sensors arranged around the second frame structure; wherein, when the user is configured to selectively wear the head-mounted device, the plurality of first image sensors are allowed to be configured through the control of the signal control module to be used for obtaining a first eyeball image of the user's first eye through a first optical waveguide channel provided by the first lens structure; wherein, when the user is configured to selectively wear the head-mounted device, the plurality of second image sensors are allowed to be configured through the control of the signal control module to be used for obtaining a second eyeball image of the user's second eye through a second optical waveguide channel provided by the second lens structure.

[0007] One of the beneficial effects of the present invention is that a head-mounted device for tracking eyeballs provided by the present invention can use the technical solution of "a first image acquisition module includes multiple first image sensors arranged on a first frame structure" and "a second image acquisition module includes multiple second image sensors arranged on a second frame structure" so that when a user is configured to selectively wear the head-mounted device, the multiple first image sensors can be configured to obtain a first eyeball image of the user's first eye through "a first optical waveguide channel provided by the first lens structure", and the multiple second image sensors can be configured to obtain a second eyeball image of the user's second eye through "a second optical waveguide channel provided by the second lens structure", thereby tracking the eyeball position of the user's left eye and the eyeball position of the right eye in real time.

[0008] One of the beneficial effects of the present invention is that a head-mounted device for tracking eyeballs and an eye-tracking method provided by the present invention can use the technical solutions of "a first image acquisition module transmits through an optical waveguide of a device housing module to acquire a first eye image of a user's first eye" and "a second image acquisition module transmits through an optical waveguide of a device housing module to acquire a second eye image of a user's second eye", so that when a user is configured to selectively wear the head-mounted device, a plurality of first image sensors can be configured to acquire a first eye image of the user's first eye through "a first optical waveguide channel provided by a first lens structure", and a plurality of second image sensors can be configured to acquire a second eye image of the user's second eye through "a second optical waveguide channel provided by a second lens structure", thereby tracking the eye position of the user's left eye and the eye position of the right eye in real time.

[0009] To further understand the features and technical contents of the present invention, please refer to the following detailed description and drawings of the present invention. However, the drawings provided are only for reference and description and are not intended to limit the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Figure 1 This is a functional block diagram of the head-mounted device for tracking eyeballs provided by the present invention.

[0011] Figure 2 A schematic three-dimensional diagram of a head-mounted device for tracking eyeballs provided in the first embodiment of the present invention.

[0012] Figure 3 Another stereoscopic schematic diagram of the head-mounted device for tracking the eyeball provided by the first embodiment of the present invention.

[0013] Figure 4 A schematic cross-sectional diagram of a first portion (a portion applied to the user's right eye area) or a second portion (a portion applied to the user's left eye area) of a head-mounted device for tracking eyeballs provided in the first embodiment of the present invention.

[0014] Figure 5 A schematic cross-sectional combination diagram of a first portion (a portion applied to the user's right eye area) or a second portion (a portion applied to the user's left eye area) of a head-mounted device for tracking eyeballs provided in the first embodiment of the present invention.

[0015] Figure 6 A schematic diagram of a head-mounted device for tracking eyeballs provided in a first embodiment of the present invention acquiring an eyeball image of a user through an external light source.

[0016] Figure 7 A schematic diagram of a head-mounted device for tracking an eyeball provided in a first embodiment of the present invention acquiring an eyeball image of a user through a first projection light beam or a second projection light beam.

[0017] Figure 8 This is a flow chart of the eye tracking method provided by the first embodiment of the present invention.

[0018] Fig. 9 A partial front view of a head-mounted device for tracking eyeballs provided in accordance with a second embodiment of the present invention (when the user's eyeballs move to a first end position).

[0019] Fig.10 A partial front view of a head-mounted device for tracking eyeballs provided in accordance with a second embodiment of the present invention (when the user's eyeballs move to a second end position). DETAILED DESCRIPTION

[0020] The following is an explanation of the implementation methods of the "head-mounted device for tracking eyeballs and eye tracking method" disclosed in the present invention through specific embodiments. Those skilled in the art can understand the advantages and effects of the present invention from the contents disclosed in this specification. The present invention can be implemented or applied through other different specific embodiments, and the details in this specification can also be modified and changed in various ways based on different viewpoints and applications without departing from the concept of the present invention. In addition, it should be stated in advance that the drawings of the present invention are only simple schematic illustrations and are not depicted according to actual sizes. The following embodiments will further explain the relevant technical contents of the present invention in detail, but the disclosed contents are not intended to limit the scope of protection of the present invention. In addition, the term "or" used in this article may include any one or more combinations of the associated listed items depending on the actual situation.

[0021] See also Figures 1 to 10As shown, in a feasible embodiment, the present invention provides a head-mounted device H for tracking eyeballs, which at least includes a device housing module 1, a signal control module 2, a first image acquisition module 3 and a second image acquisition module 4. More specifically, the device housing module 1 includes a first frame structure 11, a second frame structure 12 that cooperates with the first frame structure 11, a first lens structure 13 carried by the first frame structure 11, and a second lens structure 14 carried by the second frame structure 12. The signal control module 2 is disposed in the device housing module 1. The first image acquisition module 3 cooperates with the device housing module 1 and is electrically connected to the signal control module 2, and the first image acquisition module 3 includes a plurality of first image sensors 30 disposed on the first frame structure 11. The second image acquisition module 4 cooperates with the device housing module 1 and is electrically connected to the signal control module 2, and the second image acquisition module 4 includes a plurality of second image sensors 40 disposed on the second frame structure 12. Thereby, when the user is configured to selectively wear the head-mounted device H, multiple first image sensors 30 can be configured through the control of the signal control module 2 to obtain a first eye image M1 of the user's first eye E1 through "a first optical waveguide channel 1300 provided by the first lens structure 13", and multiple second image sensors 40 can be configured through the control of the signal control module 2 to obtain a second eye image M2 of the user's second eye E2 through "a second optical waveguide channel 1400 provided by the second lens structure 14", thereby tracking the eye position of the user's left eye and the eye position of the right eye in real time.

[0022] First embodiment

[0023] See also Figures 1 to 8 As shown, the first embodiment of the present invention provides a head-mounted device H for tracking eyeballs, which at least includes: a device housing module 1, a signal control module 2, a first image acquisition module 3 and a second image acquisition module 4. For example, the head-mounted device H can be glasses, so the device housing module 1 can be a glasses housing module. In a feasible embodiment, the head-mounted device H can also be goggles worn by the user when exercising or working, or swimming goggles, snow goggles, pilot goggles, firefighter goggles, military goggles, medical goggles or any other type of head-mounted device. However, the above example is only one feasible embodiment and is not intended to limit the present invention.

[0024] Furthermore, with Figure 2 , Figure 3 , Figure 4 and Figure 5As shown, when the head mounted device H can be glasses, the device housing module 1 includes a first frame structure 11 (or a right-eye frame structure), a second frame structure 12 (or a left-eye frame structure) that cooperates with the first frame structure 11, a first lens structure 13 (or a right-eye lens structure) carried by the first frame structure 11, and a second lens structure 14 (or a left-eye lens structure) carried by the second frame structure 12. For example, the first frame structure 11 has a first lens accommodation space 111 and a first surrounding groove 112 connected to the first lens accommodation space 111, and the first lens structure 13 can be detachably accommodated in the first lens accommodation space 111 and is limited by the first surrounding groove 112. Furthermore, the second frame structure 12 has a second lens accommodation space 121 and a second surrounding groove 122 connected to the second lens accommodation space 121, and the second lens structure 14 can be detachably accommodated in the second lens accommodation space 121 and is limited by the second surrounding groove 122. In addition, the first lens structure 13 includes a first lens 131 (e.g., a lens with or without a degree), a first outer reflection layer 132 disposed on a first outer surface of the first lens 131 (or a first outer surface facing away from the user), and a first inner reflection layer 133 disposed on a first inner surface of the first lens 131 (or a first inner surface facing the user). In addition, the second lens structure 14 includes a second lens 141 (e.g., a lens with or without a degree), a second outer reflection layer 142 disposed on a second outer surface of the second lens 141 (or a second outer surface facing away from the user), and a second inner reflection layer 143 disposed on a second inner surface of the second lens 141 (or a second inner surface facing the user). However, the above example is only one possible embodiment and is not intended to limit the present invention.

[0025] Furthermore, with Figure 1 , Figure 2 and Figure 5As shown, the signal control module 2 is arranged in the device housing module 1, the first image acquisition module 3 cooperates with the device housing module 1 (for example, the first image acquisition module 3 can be detachably arranged on the device housing module 1) and is electrically connected to the signal control module 2, and the second image acquisition module 4 cooperates with the device housing module 1 (for example, the second image acquisition module 4 can be detachably arranged on the device housing module 1) and is electrically connected to the signal control module 2. For example, the signal control module 2 can adopt a central processing unit (CPU), a digital signal processor (DSP), a microprocessor (MPU), a microcontroller (MCU) or any type of control chip with any type of memory. Furthermore, the first image acquisition module 3 includes a plurality of first image sensors 30 arranged around the first lens frame structure 11, and the plurality of first image sensors 30 can be arranged around the inside or outside of the first surrounding groove 112, and each first image sensor 30 has a first sensing area 300 facing the first lens 131 of the first lens structure 13. In addition, the second image acquisition module 4 includes a plurality of second image sensors 40 disposed around the second lens frame structure 12, and the plurality of second image sensors 40 may be disposed around the inside or outside of the second surrounding groove 122, and each second image sensor 40 has a second sensing area 400 facing the second lens 141 of the second lens structure 14. In addition, the first image sensor 30 and the second image sensor 40 may be a CCD image sensor, a complementary metal oxide semiconductor (CMOS) image sensor, or any type of image sensor. It is worth noting that in a feasible embodiment, the first image acquisition module 3 further includes a first circuit substrate 31 disposed around the inside or outside of the first surrounding groove 112, and the plurality of first image sensors 30 may be sequentially arranged on the first circuit substrate 31 and around the first lens 131 of the first lens structure 13. In addition, the second image acquisition module 4 further includes a second circuit substrate 41 disposed around the inside or outside of the second surrounding groove 122, and the plurality of second image sensors 40 may be sequentially arranged on the second circuit substrate 41 and around the second lens 141 of the second lens structure 14. However, the above example is only one feasible embodiment and is not intended to limit the present invention.

[0026] In this way, cooperate Figure 1 , Figure 5 , Figure 6 and Figure 7As shown, when the user is configured to selectively wear the head-mounted device H, multiple first image sensors 30 can be configured through the control of the signal control module 2 to be used for "through a first optical waveguide channel 1300 (or a first optical transmission channel) provided by the first lens structure 13" to obtain (or acquire) a first eyeball image M1 (or a right eyeball) of the user's first eye E1, and multiple second image sensors 40 can be configured through the control of the signal control module 2 to be used for "through a second optical waveguide channel 1400 (or a second optical transmission channel) provided by the second lens structure 14" to obtain (or acquire) a second eyeball image M2 (or a left eyeball) of the user's second eye E2, thereby tracking the eyeball position of the user's left eye and the eyeball position of the right eye in real time. More specifically, when the plurality of first image sensors 30 are configured to acquire a first eyeball image M1 of the user's first eye E1, "a first eyeball reflected light R1 (or a plurality of first eyeball reflected lights R1) generated by (via) the reflection of the first eye E1" can be projected to the plurality of first image sensors 30 after multiple reflections between the first outer reflection layer 132 and the first inner reflection layer 133 of the first lens structure 13 (or after being transmitted in the first optical waveguide channel 1300). In addition, when the plurality of second image sensors 40 are configured to acquire a second eyeball image M2 of the user's second eye E2, "a second eyeball reflected light R2 generated by (via) the reflection of the second eye E2" can be projected to the plurality of second image sensors 40 after multiple reflections between the second outer reflection layer 142 and the second inner reflection layer 143 of the second lens structure 14 (or after being transmitted in the second optical waveguide channel 1400).

[0027] For example, with Figure 1 , Figure 5 , Figure 6 and Figure 7 As shown, when the plurality of first image sensors 30 can be configured to obtain a first eyeball image M1 of a user's first eye E1, the “external light source S (such as Figure 6 )” or “a first projection beam L1 (or a plurality of first projection beams L1) provided by a plurality of first light-emitting chips P1 of the head mounted device H (for example, a plurality of first light-emitting diode chips or a plurality of first infrared light-emitting diode chips arranged around) (as shown in Figure 7The “external light source S (as shown)” can generate a first eyeball reflected light R1 (or a plurality of first eyeball reflected lights R1) through reflection from the first eye E1, and the first eyeball reflected light R1 can be projected to the plurality of first image sensors 30 after multiple reflections between the first outer reflection layer 132 and the first inner reflection layer 133 of the first lens structure 13 (or after being transmitted in the first optical waveguide channel 1300). In addition, when the plurality of second image sensors 40 can be configured to acquire a second eyeball image M2 of the second eye E2 of the user, the “external light source S (as shown)” can generate a first eyeball reflected light R1 (or a plurality of first eyeball reflected lights R1) through reflection from the first eye E1, and the first eyeball reflected light R1 can be projected to the plurality of first image sensors 30 after multiple reflections between the first outer reflection layer 132 and the first inner reflection layer 133 of the first lens structure 13 (or after being transmitted in the first optical waveguide channel 1300). Figure 6 )” or “a second projection beam L2 (or a plurality of second projection beams L2) provided by a plurality of second light-emitting chips P2 of the head mounted device H (for example, a plurality of second light-emitting diode chips or a plurality of second infrared light-emitting diode chips arranged around) (as shown in FIG. Figure 7 The second eye reflected light R2 (or a plurality of second eye reflected lights R2) can be generated by reflection from the second eye E2. The second eye reflected light R2 can be projected onto the plurality of second image sensors 40 after multiple reflections between the second outer reflection layer 142 and the second inner reflection layer 143 of the second lens structure 14 (or after being transmitted in the second optical waveguide channel 1400).

[0028] Furthermore, with Figure 1 , Figure 6 , Figure 7 and Figure 8 As shown, the first embodiment of the present invention further provides an eye tracking method, which at least includes the following steps: first, Figure 1 and Figure 8 As shown, a head mounted device H is provided, the head mounted device H comprises a device housing module 1, a signal control module 2 disposed in the device housing module 1, a first image acquisition module 3 electrically connected to the signal control module 2, and a second image acquisition module 4 electrically connected to the signal control module 2 (step S100); then, in conjunction with Figure 6 , Figure 7 and Figure 8 As shown, the first image acquisition module 3 (including a plurality of first image sensors 30) can be transmitted through the optical waveguide of the device housing module 1 to acquire a first eyeball image M1 of the user's first eye E1 (step S102); then, in conjunction with Figure 6 , Figure 7 and Figure 8As shown, the second image acquisition module 4 (including a plurality of second image sensors 40) can be transmitted through the optical waveguide of the device housing module 1 to acquire a second eyeball image M2 of the user's second eye E2 (step S104). That is, when the user is configured to selectively wear the head mounted device H, the plurality of first image sensors 30 of the first image acquisition module 3 can be configured to be used for "acquiring the first eyeball image M1 of the user's first eye E1 through a first optical waveguide channel 1300 (or a first optical transmission channel) provided by the first lens structure 13" through the control of the signal control module 2, and the plurality of second image sensors 40 of the second image acquisition module 4 can be configured to be used for "acquiring the second eyeball image M2 of the user's second eye E2 through a second optical waveguide channel 1400 (or a second optical transmission channel) provided by the second lens structure 14" through the control of the signal control module 2, thereby tracking the eyeball position of the user's left eye and the eyeball position of the right eye in real time (step S106).

[0029] Second embodiment

[0030] See also Figure 1 , Fig. 9 and Fig.10 As shown, the second embodiment of the present invention provides a head-mounted device H for tracking eyeballs. Fig. 9 and Figure 2 It can be seen from the comparison that the main difference between the second embodiment of the present invention and the first embodiment is that: in the second embodiment, the multiple first image sensors 30 of the first image acquisition module 3 are at least distinguished into a first middle image sensor 30M, a first left image sensor 30L and a first right image sensor 30R, and the multiple second image sensors 40 of the second image acquisition module 4 are at least distinguished into a second middle image sensor 40M, a second left image sensor 40L and a second right image sensor 40R. In addition, the first image acquisition module 3 can be used to directly acquire the eyeball image of the user's right eye without the first lens structure 13, and the second image acquisition module 4 can be used to directly acquire the eyeball image of the user's left eye without the second lens structure 14.

[0031] Furthermore, with Fig. 9 and Fig.10 As shown, the first middle image sensor 30M can be configured to acquire a middle area image of the first eye E1, the first left image sensor 30L can be configured to acquire a left area image of the first eye E1, and the first right image sensor 30R can be configured to acquire a right area image of the first eye E1. It is worth noting that regardless of whether the user's eyes are located at a first end position (such as Fig. 9) or a second end position (as shown Fig.10 As shown), the signal control module 2 can be configured to process the middle area image acquired by the first middle image sensor 30M, the left area image acquired by the first left image sensor 30L, and the right area image acquired by the first right image sensor 30R, so as to obtain a first eyeball image M1 of the user's first eye E1.

[0032] Furthermore, with Fig. 9 and Fig.10 As shown, the second middle image sensor 40M can be configured to acquire a middle area image of the second eye E2, the second left image sensor 40L can be configured to acquire a left area image of the second eye E2, and the second right image sensor 40R can be configured to acquire a right area image of the second eye E2. It is worth noting that regardless of whether the user's eyes are located at a first end position (such as Fig. 9 ) or a second end position (as shown Fig.10 The signal control module 2 (as shown) can be configured to process the middle area image acquired by the second middle image sensor 40M, the left area image acquired by the second left image sensor 40L, and the right area image acquired by the second right image sensor 40R, so as to obtain a second eyeball image M2 of the user's second eye E2.

[0033] Advantageous Effects of Embodiments

[0034] One of the beneficial effects of the present invention is that a head-mounted device H for tracking eyeballs provided by the present invention can, through the technical solution of "the first image acquisition module 3 includes multiple first image sensors 30 arranged on the first frame structure 11" and "the second image acquisition module 4 includes multiple second image sensors 40 arranged on the second frame structure 12", so that when the user is configured to selectively wear the head-mounted device H, the multiple first image sensors 30 can be configured to obtain a first eyeball image M1 of the user's first eye E1 through "a first optical waveguide channel 1300 provided by the first lens structure 13", and the multiple second image sensors 40 can be configured to obtain a second eyeball image M2 of the user's second eye E2 through "a second optical waveguide channel 1400 provided by the second lens structure 14", thereby tracking the eyeball position of the user's left eye and the eyeball position of the right eye in real time.

[0035] One of the beneficial effects of the present invention is that the head-mounted device H for tracking eyeballs and the eye tracking method provided by the present invention can use the technical scheme of "the first image acquisition module 3 transmits through the optical waveguide of the device housing module 1 to obtain a first eye image M1 of the user's first eye E1" and "the second image acquisition module 4 transmits through the optical waveguide of the device housing module 1 to obtain a second eye image M2 of the user's second eye E2", so that when the user is configured to selectively wear the head-mounted device H, multiple first image sensors 30 can be configured to obtain a first eye image M1 of the user's first eye E1 through "a first optical waveguide channel 1300 provided by the first lens structure 13", and multiple second image sensors 40 can be configured to obtain a second eye image M2 of the user's second eye E2 through "a second optical waveguide channel 1400 provided by the second lens structure 14", thereby tracking the eye position of the user's left eye and the eye position of the right eye in real time.

[0036] The contents disclosed above are only optional feasible embodiments of the present invention, and are not intended to limit the protection scope of the claims of the present invention. Therefore, all equivalent technical changes made using the contents of the present invention description and drawings are included in the protection scope of the claims of the present invention.

Claims

1. A head-mounted device for tracking eyeballs, characterized in that: The head mounted device comprises: A device housing module, the device housing module comprising a first frame structure, a second frame structure cooperating with the first frame structure, a first lens structure carried by the first frame structure, and a second lens structure carried by the second frame structure; a signal control module, the signal control module being disposed in the device housing module; a first image acquisition module, the first image acquisition module cooperates with the device housing module and is electrically connected to the signal control module; and a second image acquisition module, the second image acquisition module cooperates with the device housing module and is electrically connected to the signal control module; Wherein, the first image acquisition module comprises a plurality of first image sensors disposed around the first lens frame structure, and the second image acquisition module comprises a plurality of second image sensors disposed around the second lens frame structure; Wherein, when the user is configured to selectively wear the head mounted device, the plurality of first image sensors are allowed to be configured under the control of the signal control module to be used to obtain a first eyeball image of the user's first eye through a first optical waveguide channel provided by the first lens structure; When the user is configured to selectively wear the head-mounted device, a plurality of the second image sensors are allowed to be configured under the control of the signal control module to obtain a second eye image of the user's second eye through a second optical waveguide channel provided by the second lens structure.

2. The head-mounted device for tracking eyeballs according to claim 1, characterized in that: in, The first frame structure has a first lens accommodating space and a first surrounding groove connected to the first lens accommodating space, and the first lens structure can be detachably accommodated in the first lens accommodating space and is limited by the first surrounding groove; The second frame structure has a second lens accommodating space and a second surrounding groove connected to the second lens accommodating space, and the second lens structure can be detachably accommodated in the second lens accommodating space and is limited by the second surrounding groove; The first lens structure includes a first lens, a first outer reflection layer disposed on a first outer surface of the first lens, and a first inner reflection layer disposed on a first inner surface of the first lens; The second lens structure includes a second lens, a second outer reflection layer disposed on a second outer surface of the second lens, and a second inner reflection layer disposed on a second inner surface of the second lens; Wherein, when the plurality of first image sensors are configured to acquire the first eyeball image of the first eye of the user, a first eyeball reflected light generated by reflection of the first eye is reflected multiple times between the first outer reflection layer and the first inner reflection layer of the first lens structure before being projected to the plurality of first image sensors; Among them, when multiple second image sensors are configured to obtain the second eyeball image of the second eye of the user, a second eyeball reflected light generated by reflection of the second eye is reflected multiple times between the second outer reflection layer and the second inner reflection layer of the second lens structure before being projected onto the multiple second image sensors.

3. The head-mounted device for tracking eyeballs according to claim 1, characterized in that: in, The first frame structure has a first lens accommodating space and a first surrounding groove connected to the first lens accommodating space, and the first lens structure can be detachably accommodated in the first lens accommodating space and is limited by the first surrounding groove; The second frame structure has a second lens accommodating space and a second surrounding groove connected to the second lens accommodating space, and the second lens structure can be detachably accommodated in the second lens accommodating space and is limited by the second surrounding groove; The first lens structure includes a first lens, a first outer reflection layer disposed on a first outer surface of the first lens, and a first inner reflection layer disposed on a first inner surface of the first lens; The second lens structure includes a second lens, a second outer reflection layer disposed on a second outer surface of the second lens, and a second inner reflection layer disposed on a second inner surface of the second lens; Wherein, a plurality of the first image sensors are disposed in a surrounding manner inside or outside the first surrounding groove, and each of the first image sensors has a first sensing area of ​​the first lens facing the first lens structure; Wherein, a plurality of the second image sensors are disposed in a surrounding manner inside or outside the second surrounding groove, and each of the second image sensors has a second sensing area of ​​the second lens facing the second lens structure; Wherein, the first image acquisition module comprises a first circuit substrate disposed around the inside or outside of the first surrounding groove, and a plurality of the first image sensors are sequentially arranged on the first circuit substrate and around the first lens of the first lens structure; The second image acquisition module includes a second circuit substrate disposed around the inside or outside of the second surrounding groove, and a plurality of second image sensors are sequentially arranged on the second circuit substrate and around the second lens of the second lens structure; When the plurality of first image sensors are configured to acquire the first eyeball image of the first eye of the user, a first projection light beam provided by an external light source or the head mounted device is reflected by the first eye to generate a first eyeball reflected light, and the first eyeball reflected light is projected to the plurality of first image sensors after being reflected multiple times between the first outer reflection layer and the first inner reflection layer of the first lens structure; Among them, when multiple second image sensors are configured to obtain the second eyeball image of the second eye of the user, an external light source or a second projection light beam provided by the head-mounted device is reflected by the second eye to generate a second eyeball reflected light, and the second eyeball reflected light is reflected multiple times between the second outer reflection layer and the second inner reflection layer of the second lens structure before being projected onto the multiple second image sensors.

4. A head-mounted device for tracking eyeballs, characterized in that: The head mounted device comprises: A device housing module, the device housing module comprising a first frame structure, a second frame structure cooperating with the first frame structure, a first lens structure carried by the first frame structure, and a second lens structure carried by the second frame structure; a signal control module, the signal control module being disposed in the device housing module; a first image acquisition module, the first image acquisition module cooperates with the device housing module and is electrically connected to the signal control module; and a second image acquisition module, the second image acquisition module cooperates with the device housing module and is electrically connected to the signal control module; Wherein, the first image acquisition module includes a plurality of first image sensors arranged on the first lens frame structure, and the second image acquisition module includes a plurality of second image sensors arranged on the second lens frame structure.

5. The head-mounted device for tracking eyeballs according to claim 4, characterized in that: in, The first frame structure has a first lens accommodating space and a first surrounding groove connected to the first lens accommodating space, and the first lens structure can be detachably accommodated in the first lens accommodating space and is limited by the first surrounding groove; The second frame structure has a second lens accommodating space and a second surrounding groove connected to the second lens accommodating space, and the second lens structure can be detachably accommodated in the second lens accommodating space and is limited by the second surrounding groove; The first lens structure includes a first lens, a first outer reflection layer disposed on a first outer surface of the first lens, and a first inner reflection layer disposed on a first inner surface of the first lens; The second lens structure includes a second lens, a second outer reflection layer disposed on a second outer surface of the second lens, and a second inner reflection layer disposed on a second inner surface of the second lens; Wherein, when the user is configured to selectively wear the head mounted device, the plurality of first image sensors are configured to acquire a first eyeball image of a first eye of the user, and the plurality of second image sensors are configured to acquire a second eyeball image of a second eye of the user; Wherein, when the plurality of first image sensors are configured to acquire the first eyeball image of the first eye of the user, a first eyeball reflected light generated by reflection of the first eye is reflected multiple times between the first outer reflection layer and the first inner reflection layer of the first lens structure before being projected to the plurality of first image sensors; Among them, when multiple second image sensors are configured to obtain the second eyeball image of the second eye of the user, a second eyeball reflected light generated by reflection of the second eye is reflected multiple times between the second outer reflection layer and the second inner reflection layer of the second lens structure before being projected onto the multiple second image sensors.

6. The head-mounted device for tracking eyeballs according to claim 4, characterized in that: in, The first frame structure has a first lens accommodating space and a first surrounding groove connected to the first lens accommodating space, and the first lens structure can be detachably accommodated in the first lens accommodating space and is limited by the first surrounding groove; The second frame structure has a second lens accommodating space and a second surrounding groove connected to the second lens accommodating space, and the second lens structure can be detachably accommodated in the second lens accommodating space and is limited by the second surrounding groove; The first lens structure includes a first lens, a first outer reflection layer disposed on a first outer surface of the first lens, and a first inner reflection layer disposed on a first inner surface of the first lens; The second lens structure includes a second lens, a second outer reflection layer disposed on a second outer surface of the second lens, and a second inner reflection layer disposed on a second inner surface of the second lens; Wherein, a plurality of the first image sensors are disposed in a surrounding manner inside or outside the first surrounding groove, and each of the first image sensors has a first sensing area of ​​the first lens facing the first lens structure; Wherein, a plurality of the second image sensors are disposed in a surrounding manner inside or outside the second surrounding groove, and each of the second image sensors has a second sensing area of ​​the second lens facing the second lens structure; Wherein, the first image acquisition module comprises a first circuit substrate disposed around the inside or outside of the first surrounding groove, and a plurality of the first image sensors are sequentially arranged on the first circuit substrate and around the first lens of the first lens structure; The second image acquisition module includes a second circuit substrate disposed around the inside or outside of the second surrounding groove, and a plurality of second image sensors are sequentially arranged on the second circuit substrate and around the second lens of the second lens structure; Wherein, when the user is configured to selectively wear the head mounted device, the plurality of first image sensors are configured to acquire a first eyeball image of a first eye of the user, and the plurality of second image sensors are configured to acquire a second eyeball image of a second eye of the user; When the plurality of first image sensors are configured to acquire the first eyeball image of the first eye of the user, a first projection light beam provided by an external light source or the head mounted device is reflected by the first eye to generate a first eyeball reflected light, and the first eyeball reflected light is projected to the plurality of first image sensors after being reflected multiple times between the first outer reflection layer and the first inner reflection layer of the first lens structure; Among them, when multiple second image sensors are configured to obtain the second eyeball image of the second eye of the user, an external light source or a second projection light beam provided by the head-mounted device is reflected by the second eye to generate a second eyeball reflected light, and the second eyeball reflected light is reflected multiple times between the second outer reflection layer and the second inner reflection layer of the second lens structure before being projected onto the multiple second image sensors.

7. The head-mounted device for tracking eyeballs according to claim 4, characterized in that: in, When the user is configured to selectively wear the head mounted device, the plurality of first image sensors are configured to acquire a first eyeball image of a first eye of the user, and the plurality of second image sensors are configured to acquire a second eyeball image of a second eye of the user; The plurality of first image sensors of the first image acquisition module are at least divided into a first middle image sensor, a first left image sensor and a first right image sensor, the first middle image sensor is configured to acquire a middle area image of the first eye, the first left image sensor is configured to acquire a left area image of the first eye, and the first right image sensor is configured to acquire a right area image of the first eye; The plurality of second image sensors of the second image acquisition module are at least divided into a second middle image sensor, a second left image sensor and a second right image sensor, the second middle image sensor is configured to acquire a middle area image of the second eye, the second left image sensor is configured to acquire a left area image of the second eye, and the second right image sensor is configured to acquire a right area image of the second eye; The signal control module is configured to process the middle area image acquired by the first middle image sensor, the left area image acquired by the first left image sensor, and the right area image acquired by the first right image sensor, so as to obtain the first eyeball image of the first eye of the user; Wherein, the signal control module is configured to process the middle area image acquired by the second middle image sensor, the left area image acquired by the second left image sensor, and the right area image acquired by the second right image sensor, so as to obtain the second eyeball image of the second eye of the user.

8. An eye tracking method, characterized in that: The eye tracking method comprises: A head-mounted device is provided, the head-mounted device comprising a device housing module, a signal control module disposed in the device housing module, a first image acquisition module electrically connected to the signal control module, and a second image acquisition module electrically connected to the signal control module; The first image acquisition module transmits through the optical waveguide of the device housing module to acquire a first eyeball image of a first eye of the user; and The second image acquisition module transmits through the optical waveguide of the device housing module to acquire a second eyeball image of the second eye of the user; The device housing module includes a first frame structure, a second frame structure cooperating with the first frame structure, a first lens structure carried by the first frame structure, and a second lens structure carried by the second frame structure; Wherein, the first image acquisition module comprises a plurality of first image sensors disposed around the first lens frame structure, and the second image acquisition module comprises a plurality of second image sensors disposed around the second lens frame structure; Wherein, when the user is configured to selectively wear the head mounted device, the plurality of first image sensors are allowed to be configured under the control of the signal control module to be used for acquiring the first eyeball image of the first eye of the user through a first optical waveguide channel provided by the first lens structure; When the user is configured to selectively wear the head-mounted device, a plurality of the second image sensors are allowed to be configured under the control of the signal control module to be used to obtain the second eye image of the second eye of the user through a second optical waveguide channel provided by the second lens structure.

9. The eye tracking method according to claim 8, characterized in that: in, The first frame structure has a first lens accommodating space and a first surrounding groove connected to the first lens accommodating space, and the first lens structure can be detachably accommodated in the first lens accommodating space and is limited by the first surrounding groove; The second frame structure has a second lens accommodating space and a second surrounding groove connected to the second lens accommodating space, and the second lens structure can be detachably accommodated in the second lens accommodating space and is limited by the second surrounding groove; The first lens structure includes a first lens, a first outer reflection layer disposed on a first outer surface of the first lens, and a first inner reflection layer disposed on a first inner surface of the first lens; The second lens structure includes a second lens, a second outer reflection layer disposed on a second outer surface of the second lens, and a second inner reflection layer disposed on a second inner surface of the second lens; Wherein, when the plurality of first image sensors are configured to acquire the first eyeball image of the first eye of the user, a first eyeball reflected light generated by reflection of the first eye is reflected multiple times between the first outer reflection layer and the first inner reflection layer of the first lens structure before being projected to the plurality of first image sensors; Among them, when multiple second image sensors are configured to obtain the second eyeball image of the second eye of the user, a second eyeball reflected light generated by reflection of the second eye is reflected multiple times between the second outer reflection layer and the second inner reflection layer of the second lens structure before being projected onto the multiple second image sensors.

10. The eye tracking method according to claim 8, characterized in that: in, The first frame structure has a first lens accommodating space and a first surrounding groove connected to the first lens accommodating space, and the first lens structure can be detachably accommodated in the first lens accommodating space and is limited by the first surrounding groove; The second frame structure has a second lens accommodating space and a second surrounding groove connected to the second lens accommodating space, and the second lens structure can be detachably accommodated in the second lens accommodating space and is limited by the second surrounding groove; The first lens structure includes a first lens, a first outer reflection layer disposed on a first outer surface of the first lens, and a first inner reflection layer disposed on a first inner surface of the first lens; The second lens structure includes a second lens, a second outer reflection layer disposed on a second outer surface of the second lens, and a second inner reflection layer disposed on a second inner surface of the second lens; Wherein, a plurality of the first image sensors are disposed in a surrounding manner inside or outside the first surrounding groove, and each of the first image sensors has a first sensing area of ​​the first lens facing the first lens structure; Wherein, a plurality of the second image sensors are disposed in a surrounding manner inside or outside the second surrounding groove, and each of the second image sensors has a second sensing area of ​​the second lens facing the second lens structure; Wherein, the first image acquisition module comprises a first circuit substrate disposed around the inside or outside of the first surrounding groove, and a plurality of the first image sensors are sequentially arranged on the first circuit substrate and around the first lens of the first lens structure; The second image acquisition module includes a second circuit substrate disposed around the inside or outside of the second surrounding groove, and a plurality of second image sensors are sequentially arranged on the second circuit substrate and around the second lens of the second lens structure; When the plurality of first image sensors are configured to acquire the first eyeball image of the first eye of the user, a first projection light beam provided by an external light source or the head mounted device is reflected by the first eye to generate a first eyeball reflected light, and the first eyeball reflected light is projected to the plurality of first image sensors after being reflected multiple times between the first outer reflection layer and the first inner reflection layer of the first lens structure; Among them, when multiple second image sensors are configured to obtain the second eyeball image of the second eye of the user, an external light source or a second projection light beam provided by the head-mounted device is reflected by the second eye to generate a second eyeball reflected light, and the second eyeball reflected light is reflected multiple times between the second outer reflection layer and the second inner reflection layer of the second lens structure before being projected onto the multiple second image sensors.

Images