Eye condition tracking and displaying electronic glasses

Abstract

The utility model discloses a pair of eye condition tracking and displaying electronic glasses in the technical field of intelligent wearable equipment. The pair of eye condition tracking and displaying electronic glasses comprises a glasses frame, a focusing camera module arranged on the glasses frame, a mainboard, a catadioptric optical display module and an inner microchip display screen, the device further comprises an eye condition tracking sensor and an outer display screen. The main board, the eye condition tracking sensor and the outer display screen are electrically connected; the eye condition tracking sensor is arranged on the glasses frame and used for shooting eye information of a user and transmitting the eye information to the mainboard, and the mainboard processes the received eye information and then sends the processed eye information to the outer display screen, so that the outer display screen displays a corresponding virtual eye image or a real eye image; eyeball information is collected through the eye condition tracking sensor arranged on the built-in glasses frame and displayed in real time through the outer display screen, the whole face of a wearer can be richer and more visual in cooperation with the electronic glasses, and eye condition feedback is added to the face.

Description

Technical Field

[0001] The utility model relates to the technical field of intelligent wearable devices, in particular to an eye-tracking and displaying electronic glasses. Background Art

[0002] With the gradual development of intelligence, the functions of electronic glasses are becoming increasingly rich. Among them, eye tracking technology is increasingly being applied to electronic glasses. Eye tracking refers to the collection of the state of the human eye for analysis, so as to cooperate with the electronic glasses to provide feedback. For example, the application number is: CN 201410241035.4, and the patent name is: "An eyeball interactive control device". It installs a camera on the side of the nose bridge to collect eyeball status. However, this type of eye tracking electronic glasses currently only uses eye movements as input control data for the electronic glasses. External users cannot understand the user's status in real time after wearing the electronic glasses, and the user's interactivity and feedback with the external environment or people are poor.

[0003] In addition, regarding the eye tracking process, although "An Eye Interaction Control Device" includes an acquisition unit, it itself uses a single-sided display unit. Therefore, there is enough space on its nose bridge for installation, and the current electronic glasses all have an integrated binocular display structure. For example, the application number is: CN202022682319.0, and the patent name is: "Heat Dissipation Component and VR Glasses". This type of highly integrated head-mounted device does not have enough space on the nose bridge to install the camera unit, which can easily interfere with the user's viewing experience. Although there are highly integrated micro-hole camera units on the market, the position of the glasses frame and the small space between the human eyes when worn cannot effectively capture the full eye state. Therefore, the lightness of the electronic glasses frame is often sacrificed to meet the functional requirements of eye tracking.

[0004] Based on this, the present invention designs an eye-tracking display electronic glasses to solve the above problems. Utility Model Content

[0005] The purpose of the present invention is to provide an eye tracking display electronic glasses to solve the problems raised in the above background technology.

[0006] To achieve the above purpose, the present invention provides the following technical solutions:

[0007] A pair of eye-tracking and display electronic glasses, comprising a glasses frame, a focusing camera module arranged on the glasses frame, a main board, a catadioptric optical display module, and an internal microchip display screen; further comprising an eye-tracking sensor and an external display screen; the main board, the eye-tracking sensor, and the external display screen are electrically connected; the eye-tracking sensor is arranged on the glasses frame, and is used to capture the user's eye information and transmit the eye information to the main board, and the main board processes the received eye information and sends it to the external display screen, so that the external display screen displays a corresponding virtual eye image or a real eye image.

[0008] As a further solution of the present invention: the eye tracking sensor is arranged on the glasses frame on both sides of the nose.

[0009] As a further solution of the present invention: mounting holes for mounting eye tracking sensors are respectively provided on both sides of the middle position of the nose bridge of the glasses frame.

[0010] As a further solution of the present invention: the eye tracking sensor is tilted to capture the eyeballs.

[0011] As a further solution of the present invention: the eye tracking sensor captures half of the eyeball image, simulates and generates a full eyeball image for display on an external display screen.

[0012] As a further solution of the present invention: the outer display screen includes one or more structural combinations of rectangle, direction or circle.

[0013] As a further solution of the present invention: the outer display screen has a depth structure.

[0014] As a further solution of the present invention: the depth structure includes one or more combinations of display virtual or depth components.

[0015] As a further solution of the present invention: the depth component includes a driving component for driving the outer display screen to move, and the moving direction includes one or more combinations of forward and backward directions, left and right swings, or up and down flips.

[0016] Compared with the prior art, the beneficial effects of the present invention are:

[0017] Under the premise of realizing an immersive experience displayed inside the glasses frame, the utility model can collect eye information through the eye tracking sensor built into the glasses frame and transmit it to the main board for analysis and processing. The collected information includes the state of the eyeball and the image information of the eye expression is displayed in real time and dynamically through the external display screen. The eye characteristics of the user when using the electronic glasses can be fed back. In combination with the electronic glasses themselves, the wearer's entire face can be made richer and more intuitive. The added eye expression feedback on the face can reduce the problem of the electronic glasses themselves blocking the user's face, making it easier for outsiders to quickly understand the user's state.

[0018] The utility model optimizes the installation position of the eye tracking sensor, which is embedded in the nose bridge, so as not to affect the user's viewing and will not increase the extra volume of the eyeglass frame body;

[0019] The eye tracking sensor captures half of the eyeball image and simulates the full eyeball image to display on the external display screen, which greatly reduces the acquisition difficulty of the eye tracking sensor and can be integrated and installed in a more compact size.

[0020] The depth structure provided by the present invention can make the external display screen have a more three-dimensional and intuitive display effect, can simulate the depth effect of the eye expression, can imitate or even magnify the movement of the eyeball, and improve the dynamic display effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 This is a schematic diagram of the overall structure of the utility model (Example 1);

[0022] Figure 2 for Figure 1 Schematic diagram of a local explosion.

[0023] In the accompanying drawings, the components represented by the reference numerals are as follows:

[0024] Glasses frame 1, focusing camera module 2, main board 3, catadioptric optical display module 4, internal microchip display 5, eye tracking sensor 6, external display 7. DETAILED DESCRIPTION

[0025] See also Figure 1-2 , the utility model provides a technical solution: Example 1

[0026] Eye tracking and display electronic glasses, comprising a glasses frame 1, a focus camera module 2 disposed on the glasses frame 1, a mainboard 3, a catadioptric optical display module 4, and an internal microchip display screen 5; further comprising an eye tracking sensor 6 and an external display screen 7; the mainboard 3, the eye tracking sensor 6, and the external display screen 7 being electrically connected; the eye tracking sensor 6 disposed on the glasses frame 1 is configured to capture eye information of the user and transmit the eye information to the mainboard 3; the mainboard 3 processes the received eye information and transmits the information to the external display screen 7, causing the external display screen 7 to display a corresponding virtual eye image or a real eye image;

[0027] During operation, the focus camera module 2 is used to collect images of the external environment. The main board 3 displays the collected images on the internal microchip display screen 5. The displayed images are transmitted to the user's eyeballs through the reflective optical display module 4, so that the external environment can be viewed in real time. The eye tracking sensor 6 transmits the eye information to the main board 3 for processing in real time, and displays the user's eye features externally through the external display screen 7, completing the overall function of the electronic glasses. On the premise of realizing the immersive experience displayed inside the glasses frame 1, the eye information is collected by the eye tracking sensor 6 on the built-in glasses frame 1 and transmitted to the main board 3 for analysis and processing. The eye status information is collected and the image information of the eye is displayed in real time through the external display screen 7. The eye features of the user using the electronic glasses can be fed back, and the electronic glasses themselves can make the wearer's entire face more rich and intuitive. The increased eye feedback on the face can reduce the problem of the electronic glasses themselves blocking the user's face, making it convenient for outsiders to quickly understand the user's status.

[0028] Wherein, the eye tracking sensor 6 is arranged on the glasses frame 1 on both sides of the nose;

[0029] The present invention optimizes the installation position of the eye tracking sensor 6, which is embedded in the nose bridge position, and will not affect the user's viewing and will not cause the additional volume of the glasses frame 1 to increase.

[0030] Wherein, mounting holes for mounting the eye tracking sensor 6 are respectively opened on both sides of the middle position of the nose bridge of the glasses frame 1;

[0031] The eye tracking sensor 6 captures half of the eyeball image and simulates the full eyeball image to be displayed on the external display screen 7;

[0032] Wherein, the eye tracking sensor 6 is tilted to capture the eyeballs;

[0033] When working, the tilted setting here makes it convenient to shoot the eyeball at a certain angle, so that the eye tracking sensor 6 does not need to be set directly in front of the eyeball, and the setting of shooting half of the image can greatly reduce the area collected by the eye tracking sensor 6. For example, the eye tracking sensor 6 here is set as a micro camera, so the size and power consumption of the micro camera will be greatly reduced, and it is more suitable for installation on the bridge of the nose of the glasses frame 1. Naturally, the installation position here is not limited to the bridge of the nose. According to the actual model of the eye socket, it can be set at a suitable position around the eye socket. However, compared with the common installation method, the size, installation space and number of the micro cameras set here are reduced, which is more conducive to the lightweight and beautiful design of the electronic glasses.

[0034] Wherein, the outer display screen 7 includes one or more structural combinations of rectangle, direction or circle;

[0035] When working, the display screen here is set as needed, such as Figure 1 As shown, the outer display screen 7 is arranged in a circular shape. Example 2

[0036] The difference between this embodiment and embodiment 1 is that:

[0037] Among them, the external display screen 7 has a depth structure, and the depth structure includes one or more combinations of display virtual or depth components. The depth component includes a driving component for driving the external display screen 7 to move, and the moving direction includes one or more combinations of forward and backward directions, left and right swings, or up and down flips.

[0038] During operation, the depth structure is set here mainly to further improve the display effect of the external display screen 7. The human eyeball is not a planar structure, but a depth structure with an arc. The simple way here is to virtually display this depth structure through the display screen. A more realistic way is to combine structural simulation with display virtuality. For example, the external display screen 7 is set to be multi-layered, in which the white of the eye area is set to fit the arc of the eyeball, and the pupil position is set to a lens structure with a telescopic aperture. For another example, the display screen is set to a movable form, and the moving direction here includes one or more combinations of forward and backward directions, left and right swings, or up and down flips. The movement of the eyeball can be directly simulated in a mechanical motion to bring a more intuitive display effect.

Claims

1. Eye tracking display electronic glasses, characterized by: The device comprises a glasses frame, a focus camera module arranged on the glasses frame, a main board, a catadioptric optical display module, and an internal microchip display screen; the device also comprises an eye tracking sensor and an external display screen; the main board, the eye tracking sensor, and the external display screen are electrically connected; The eye tracking sensor is set on the glasses frame, and is used to capture the user's eye information and transmit the eye information to the main board. The main board processes the received eye information and sends it to the external display screen so that the external display screen displays the corresponding virtual eye image or real eye image.

2. The eye tracking and display electronic glasses according to claim 1, characterized in that: The eye tracking sensors are arranged on the eye frames on both sides of the nose.

3. The eye tracking display electronic glasses according to claim 2, characterized in that: Mounting holes for mounting eye tracking sensors are respectively provided on both sides of the middle position of the nose bridge of the eyeglass frame.

4. The eye tracking display electronic glasses according to claim 2, characterized in that: The eye tracking sensor is tilted to capture eyeballs.

5. The eye tracking display electronic glasses according to claim 1, characterized in that: The eye tracking sensor captures an image of half of the eyeball.

6. The eye tracking display electronic glasses according to claim 1, characterized in that: The outer display screen includes one or more structural combinations of rectangle, direction or circle.

7. The eye tracking and display electronic glasses according to any one of claims 1 to 6, characterized in that: The outer display screen has a depth structure.

8. The eye tracking display electronic glasses according to claim 7, characterized in that: The depth structure includes one or more combinations of display virtual or depth components.

9. The eye tracking display electronic glasses according to claim 8, characterized in that: The depth component includes a driving component for driving the outer display screen to move, and the moving direction includes one or more combinations of forward and backward directions, left and right swings, or up and down flips.

Images