Wearable device control method, wearable device and readable storage medium

By scanning the user's eyeball to determine the position of the gaze point and adjusting the display rendering ratio and frequency of the wearable device, the high power consumption problem caused by image rendering calculations in existing devices is solved, and more efficient energy management and longer Working hours.

CN113485546BActive Publication Date: 2025-01-14SHANGHAI GOERTEK TECHNOLOGY DEVELOPMENT CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202110732349.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-06-29
Publication Date
2025-01-14
Estimated Expiration
2041-06-29

AI Technical Summary

Technical Problem

Existing wearable devices such as AR and VR devices require a large amount of image rendering and calculation due to the superposition and anchoring of virtual information, resulting in large power consumption, affecting the working time and energy efficiency of the device.

Method used

By scanning the user's eyeball, the position of the gaze point is determined, and the image rendering ratio and rendering frequency of the display screen are adjusted according to the position of the gaze point to reduce the power consumption of the device.

Benefits of technology

It effectively reduces the power consumption of wearable devices, extends the working time of the device, and improves the energy efficiency and control accuracy of the device.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113485546B_ABST
    Figure CN113485546B_ABST
Patent Text Reader

Abstract

The present invention discloses a control method of a wearable device, a wearable device and a readable storage medium, wherein the control method of the wearable device comprises: scanning the eyeballs of a user to determine the position of the gaze point of the eyeballs; and adjusting at least one of the image rendering ratio and the image rendering frequency of the display screen of the wearable device according to the position of the gaze point. The present invention can reduce the power consumption of the wearable device.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of wearable devices, and in particular to a control method for a wearable device, a wearable device and a readable storage medium. Background Art

[0002] Wearable devices such as AR (Augmented Reality) devices and VR (Virtual Reality) devices can simulate and superimpose physical information (such as vision, sound, taste, touch, etc.) that is difficult to experience within a certain time and space range in the real world through computers and other scientific technologies, and then apply the virtual information to the real world and be perceived by human senses, thereby achieving a sensory experience beyond reality.

[0003] Currently, the superposition and anchoring of virtual information are achieved through spatial perception and image rendering technology. Therefore, a large amount of image rendering calculations are required, which consumes a lot of processor resources and causes high power consumption of wearable devices. Summary of the invention

[0004] The main purpose of the present invention is to provide a control method for a wearable device, a wearable device and a readable storage medium, aiming to reduce the power consumption of the wearable device.

[0005] To achieve the above object, the present invention provides a control method for a wearable device, the control method for the wearable device comprising:

[0006] Scanning the user's eyeballs to determine the position of the gaze point of the eyeballs;

[0007] At least one of an image rendering ratio of a display screen of the wearable device and an image rendering frequency of the display screen is adjusted according to the position of the gaze point.

[0008] In one embodiment, the step of adjusting at least one of an image rendering ratio of a display screen of the wearable device and an image rendering frequency of the display screen according to the position of the gaze point comprises:

[0009] When the position of the gaze point is not located in the display area of ​​the display screen of the wearable device, at least one of an image rendering ratio of the display screen of the wearable device and an image rendering frequency of the display screen is reduced.

[0010] In one embodiment, the step of adjusting at least one of an image rendering ratio of a display screen of the wearable device and an image rendering frequency of the display screen according to the position of the gaze point comprises:

[0011] When the position of the gaze point is located in the display area of ​​the display screen of the wearable device, determining whether the position of the gaze point is located in the focus area of ​​the display screen, wherein the focus area is located in the display area, and the area of ​​the focus area is smaller than the area of ​​the display area;

[0012] When the position of the gaze point is not located in the focus area, at least one of an image rendering ratio of a display screen of the wearable device and an image rendering frequency of the display screen is reduced.

[0013] In one embodiment, the step of adjusting at least one of an image rendering ratio of a display screen of the wearable device and an image rendering frequency of the display screen according to the position of the gaze point comprises:

[0014] When the gaze point is located in a display area of ​​the display screen of the wearable device, acquiring the focal length of the eyeball;

[0015] When the focal length is not within a preset range, at least one of an image rendering ratio of a display screen of the wearable device and an image rendering frequency of the display screen is reduced.

[0016] In one embodiment, the step of reducing the image rendering ratio of the display screen of the wearable device includes:

[0017] Obtaining a first image rendering ratio of a display sub-region where the gaze point is located, wherein the display region is divided into a plurality of display sub-regions;

[0018] Acquire a positional relationship between other display sub-regions in the display region except the display sub-region where the gaze point is located and the display sub-region where the gaze point is located;

[0019] A second image rendering ratio of the other display sub-area is adjusted according to the positional relationship, wherein the second image rendering ratio is smaller than the first image rendering ratio.

[0020] In one embodiment, the step of scanning the user's eyeballs to determine the position of the gaze point of the eyeballs includes:

[0021] Sending a scanning signal to the eyeball through a signal transmitter of the wearable device, and receiving the scanning signal reflected back by the eyeball through a signal receiver;

[0022] Acquiring an emission angle of the scanning signal;

[0023] Determining the gaze angle of the eyeball according to the emission angle of the scanning signal;

[0024] The position of the gaze point of the eyeball is determined according to the gaze angle of the eyeball.

[0025] In one embodiment, the step of determining the gaze angle of the eyeball according to the emission angle of the scanning signal comprises:

[0026] Obtaining the distance between the signal transmitter and the signal receiver;

[0027] Acquiring a transmission distance of the scanning signal;

[0028] The gaze angle of the eyeball is determined according to the emission angle, the distance between the signal transmitter and the signal receiver, and the transmission distance.

[0029] In addition, to achieve the above-mentioned purpose, the present invention also provides a wearable device, which includes a memory, a processor, and a control program for the wearable device stored in the memory and runnable on the processor. When the control program of the wearable device is executed by the processor, the steps of the control method of the wearable device described in any one of the above items are implemented.

[0030] In one embodiment, the wearable device further includes a signal transmitter and a signal receiver, wherein the signal transmitter transmits a scanning signal to an eyeball, and the signal receiver receives the scanning signal reflected back by the eyeball.

[0031] In addition, to achieve the above-mentioned purpose, the present invention also provides a computer-readable storage medium, on which a control program of a wearable device is stored. When the control program of the wearable device is executed by a processor, the steps of the control method of the wearable device described in any one of the above items are implemented.

[0032] The present invention proposes a control method for a wearable device, a wearable device and a readable storage medium, which scans the user's eyeballs to determine the position of the eyeball's gaze point, and adjusts at least one of the image rendering ratio and the image rendering frequency of the display screen of the wearable device according to the position of the gaze point. This solution adjusts at least one of the image rendering ratio and the image rendering frequency of the display screen of the wearable device based on the position of the eyeball's gaze, which can effectively reduce the power consumption of the wearable device. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] Figure 1 Schematic diagram of the hardware architecture of a wearable device according to an embodiment of the present invention;

[0034] Figure 2 is a flow chart of a first embodiment of a control method for a wearable device of the present invention;

[0035] Figure 3 is a flow chart of a second embodiment of a control method for a wearable device of the present invention;

[0036] Figure 4 It is a schematic diagram of the principle of determining the position of the eye's gaze point according to an embodiment of the present invention.

[0037] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0038] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.

[0039] The main solution of the embodiment of the present invention is: scanning the user's eyeballs to determine the position of the eyeball's gaze point; adjusting at least one of the image rendering ratio and the image rendering frequency of the display screen of the wearable device according to the position of the gaze point. This solution adjusts at least one of the image rendering ratio and the image rendering frequency of the display screen of the wearable device based on the position of the eyeball's gaze, which can effectively reduce the power consumption of the wearable device.

[0040] As an implementation solution, refer to Figure 1 , Figure 1 Schematic diagram of the hardware architecture of the wearable device involved in the embodiment of the present invention, such as Figure 1 As shown, the wearable device may include a processor 101, such as a CPU, a memory 102, a communication bus 103, a signal transmitter 104 and a signal receiver 105, wherein the communication bus 103 is used to achieve connection and communication between these components.

[0041] The memory 102 may be a high-speed RAM memory or a stable memory (non-volatile memory), such as a disk memory. Figure 1 As shown, the memory 102 as a computer-readable storage medium may include a control program of the wearable device; and the processor 101 may be used to call the control program of the wearable device stored in the memory 102 and perform the following operations:

[0042] Scanning the user's eyeballs to determine the position of the gaze point of the eyeballs;

[0043] At least one of an image rendering ratio of a display screen of the wearable device and an image rendering frequency of the display screen is adjusted according to the position of the gaze point.

[0044] In one embodiment, the processor 101 may be used to call a control program of the wearable device stored in the memory 102 and perform the following operations:

[0045] When the position of the gaze point is not located in the display area of ​​the display screen of the wearable device, at least one of an image rendering ratio of the display screen of the wearable device and an image rendering frequency of the display screen is reduced.

[0046] In one embodiment, the processor 101 may be used to call a control program of the wearable device stored in the memory 102 and perform the following operations:

[0047] When the position of the gaze point is located in the display area of ​​the display screen of the wearable device, determining whether the position of the gaze point is located in the focus area of ​​the display screen, wherein the focus area is located in the display area, and the area of ​​the focus area is smaller than the area of ​​the display area;

[0048] When the position of the gaze point is not located in the focus area, at least one of an image rendering ratio of a display screen of the wearable device and an image rendering frequency of the display screen is reduced.

[0049] In one embodiment, the processor 101 may be used to call a control program of the wearable device stored in the memory 102 and perform the following operations:

[0050] When the gaze point is located in a display area of ​​the display screen of the wearable device, acquiring the focal length of the eyeball;

[0051] When the focal length is not within a preset range, at least one of an image rendering ratio of a display screen of the wearable device and an image rendering frequency of the display screen is reduced.

[0052] In one embodiment, the processor 101 may be used to call a control program of the wearable device stored in the memory 102 and perform the following operations:

[0053] Obtaining a first image rendering ratio of a display sub-region where the gaze point is located, wherein the display region is divided into a plurality of display sub-regions;

[0054] Acquire a positional relationship between other display sub-regions in the display region except the display sub-region where the gaze point is located and the display sub-region where the gaze point is located;

[0055] A second image rendering ratio of the other display sub-area is adjusted according to the positional relationship, wherein the second image rendering ratio is smaller than the first image rendering ratio.

[0056] In one embodiment, the processor 101 may be used to call a control program of the wearable device stored in the memory 102 and perform the following operations:

[0057] Sending a scanning signal to the eyeball through a signal transmitter of the wearable device, and receiving the scanning signal reflected back by the eyeball through a signal receiver;

[0058] Acquiring an emission angle of the scanning signal;

[0059] Determining the gaze angle of the eyeball according to the emission angle of the scanning signal;

[0060] The position of the gaze point of the eyeball is determined according to the gaze angle of the eyeball.

[0061] In one embodiment, the processor 101 may be used to call a control program of the wearable device stored in the memory 102 and perform the following operations:

[0062] Obtaining the distance between the signal transmitter and the signal receiver;

[0063] Acquiring a transmission distance of the scanning signal;

[0064] The gaze angle of the eyeball is determined according to the emission angle, the distance between the signal transmitter and the signal receiver, and the transmission distance.

[0065] Reference Figure 2 , Figure 2 1 is a flow chart of a first embodiment of a control method for a wearable device of the present invention, wherein the control method for a wearable device comprises:

[0066] Step S10, scanning the user's eyeballs to determine the position of the eyeball's gaze point;

[0067] In this embodiment, the execution subject is a wearable device, wherein the wearable device refers to a portable terminal device that can be directly worn on the user or integrated into the user's clothes or accessories. The wearable device can be an AR / VR device, such as AR / VR glasses, etc. Of course, in other embodiments, the wearable device can also be other portable terminal devices, such as smart watches / smart bracelets, etc., which is not limited in this embodiment.

[0068] In this embodiment, wearable devices such as AR / VR can apply virtual information to the real world so that it can be perceived by human senses and achieve a sensory experience beyond reality. However, since the superposition and anchoring of virtual information require a large amount of image rendering calculations, a large amount of processor resources will be consumed, which will undoubtedly increase the power consumption of wearable devices.

[0069] To address this technical problem, the control method of a wearable device proposed in the present invention is based on eye movement technology. A MEMS (Micro-Electro-Mechanical System) system is built on the wearable device. The position of the user's eye gaze point is determined by scanning the user's eyeballs through MEMS. The image rendering ratio and image rendering frequency of the display screen of the wearable device are adjusted by judging the position of the user's eye gaze point to reduce the image rendering power consumption of the wearable device.

[0070] In this embodiment, the wearable device scans the user's eyes to determine the position of the gaze point, wherein the position of the gaze point refers to the gaze position of the user's eyes on the wearable device display screen, and the position of the gaze point can be the position on the wearable device display screen mapped to the direction of the eye pupil.

[0071] In this embodiment, a signal transmitter and a plurality of signal receivers are provided on the wearable device. The signal transmitter transmits a scanning signal to the eyeball, and the signal receiver receives the scanning signal reflected by the eyeball to complete the scanning of the eyeball and determine the position of the eyeball's gaze point. Among them, the signal transmitter refers to a device that can transmit a scanning signal, for example, the signal transmitter can be a scanner, a scanner or a scanning module, etc.; the scanning signal can be an infrared signal or other non-injurious to the eyes, reflective invisible light signal; the signal receiver refers to a device that can receive a scanning signal, for example, the signal receiver can be a detector, a detector or a detection module, etc. It should be noted that in other embodiments, the signal transmitter, the signal receiver and the scanning signal can be determined according to actual conditions, and this embodiment does not limit this.

[0072] Specifically, the signal transmitter on the wearable device transmits a scanning signal to the eyeball at a preset frequency at a preset time interval, and the signal receiver receives the scanning signal reflected by the eyeball to scan the entire eyeball. The wearable device obtains the scanning signal with the weakest reflection intensity, and determines the position of the eyeball's gaze point based on the scanning signal with the weakest reflection intensity. Among them, the preset duration can be in the range of 2-5ms, and the preset frequency can be in the range of 200-500HZ. Of course, in other embodiments, the preset duration and preset frequency can be set according to actual needs, and this embodiment is not limited to this.

[0073] Step S20: adjusting at least one of an image rendering ratio of a display screen of the wearable device and an image rendering frequency of the display screen according to the position of the gaze point.

[0074] In this embodiment, after the wearable device determines the position of the gaze point of the eyeball, at least one of the image rendering ratio of the display screen of the wearable device and the image rendering frequency of the display screen is adjusted according to the position of the gaze point.

[0075] In one embodiment, when the gaze point is not located in a display area of ​​a display screen of the wearable device, at least one of an image rendering ratio of the display screen of the wearable device and an image rendering frequency of the display screen is reduced. The display area is an area on the display screen of the wearable device, and the area of ​​the display area is equal to or smaller than the area of ​​the display screen.

[0076] Specifically, when the wearable device detects that the position of the gaze point is not located in the display area of ​​the display screen, the image rendering ratio of the display screen can be reduced, the image rendering frequency of the display screen can be reduced, or the image rendering ratio and the image rendering frequency of the display screen can be reduced at the same time. Among them, reducing the image rendering ratio of the display screen can be to obtain a first image rendering ratio of the display sub-area where the gaze point is located, and the display area is divided into multiple display sub-areas; obtain the positional relationship between other display sub-areas in the display area except the display sub-area where the gaze point is located and the display sub-area where the gaze point is located; adjust the second image rendering ratio of other display sub-areas according to the positional relationship, wherein the second image rendering ratio is less than the first image rendering ratio. For example, the first image rendering ratio of the display sub-area where the gaze point is located can be set to 100% rendering, and in other display sub-areas, the farther the display sub-area is from the display sub-area where the gaze point is located, the smaller the second image rendering ratio is, that is, the second image rendering ratios of other display sub-areas decrease in sequence according to their distances from the display sub-area where the gaze point is located; reducing the image rendering frequency of the display screen can be adjusting the image rendering frequency of the display screen from rendering once every 16.6 ms to rendering once every 100 ms. Reducing the image rendering frequency of the display screen can also be achieved by adjusting the image frame rate, for example, adjusting the image frame rate from 60fps to 10fps.

[0077] In this embodiment, when the position of the eye gaze point is not located in the display area of ​​the display screen of the wearable device, it indicates that the user is not viewing the display area. When the user is not viewing the display area, reducing at least one of the image rendering ratio of the display screen of the wearable device and the image rendering frequency of the display screen can reduce the power consumption of the wearable device and increase the working time of the wearable device.

[0078] In one embodiment, when the position of the gaze point is located in the display area of ​​the display screen of the wearable device, it is determined whether the position of the gaze point is located in the focus area of ​​the display screen, wherein the focus area is located in the display area, and the area of ​​the focus area is smaller than the area of ​​the display area; when the position of the gaze point is not located in the focus area, at least one of the image rendering ratio of the display screen of the wearable device and the image rendering frequency of the display screen is reduced. The focus area of ​​the display screen may be an effective area that the eyeball can focus on in the display area, and the effective area that the eyeball can focus on in the display area can be determined by calibrating the eyeball through a preset eye calibration algorithm. Specifically, by installing an eye-tracking camera and an infrared fill light IR-Led on the wearable device, the focusing state of the eyeball and the focusing state of the eye muscle can be identified. Before use, the wearable device guides the user to perform a calibration action through a preset calibration program. According to the program prompts, the user observes the four angles (up, down, left, and right) and the center point position of the display area respectively, and determines the focus area in the display area according to the calibration result; the focus area can also be determined according to the display content of the display area. For example, the focus area can be the foreground area of ​​the display content, and the wearable device can automatically identify the foreground area and background area of ​​the display content in the display area to determine the focus area of ​​the display screen.

[0079] Specifically, when the wearable device detects that the position of the gaze point is located in the display area of ​​the wearable device, it determines whether the position of the gaze point is located in the focus area of ​​the display screen. When it is detected that the position of the gaze point is not located in the focus area of ​​the display screen, the image rendering ratio of the display screen can be reduced, the image rendering frequency of the display screen can be reduced, or the image rendering ratio and the image rendering frequency of the display screen can be reduced at the same time.

[0080] In this embodiment, when the position of the eye's gaze point is not located in the focus area, it indicates that the user is not paying attention to the display content of the display area. By reducing at least one of the image rendering ratio of the display screen of the wearable device and the image rendering frequency of the display screen, the power consumption of the wearable device can be reduced and the working time of the wearable device can be increased.

[0081] In one embodiment, when the position of the gaze point is located in the display area of ​​the display screen of the wearable device, the focal length of the eyeball is obtained; when the focal length is not within the preset range, at least one of the image rendering ratio of the display screen of the wearable device and the image rendering frequency of the display screen is reduced. Among them, the focal length of the eyeball refers to the distance from the eyeball to the imaging focal plane, and the focal length of the eyeball can reflect whether the user can clearly see the display content of the display area or whether the user is distracted when watching the display content in the display area. Generally speaking, when the focal length of the eyeball is within the preset range, it indicates that the user can clearly see the display content of the display area or the user is not distracted when watching the display content in the display area; when the focal length of the eyeball is not within the preset range, it indicates that the user cannot clearly see the display content of the display area or the user is distracted when watching the display content in the display area. The preset range can be (-0.2m, 0.2m). Of course, in other embodiments, the preset range can be determined according to actual conditions, and this embodiment is not limited to this.

[0082] Specifically, when the wearable device detects that the position of the gaze point is located in the display area of ​​the wearable device, the focal length of the eyeball is obtained and it is determined whether the focal length of the eyeball is within a preset range. When the focal length of the eyeball is not within the preset range, the image rendering ratio of the display screen can be reduced, the image rendering frequency of the display screen can be reduced, or the image rendering ratio and the image rendering frequency of the display screen can be reduced at the same time.

[0083] In this embodiment, when the focal length of the eyeball is not within the preset range, it indicates that the user cannot clearly see the displayed content in the display area or the user is distracted when viewing the displayed content in the display area. By reducing at least one of the image rendering ratio of the display screen of the wearable device and the image rendering frequency of the display screen, the power consumption of the wearable device can be reduced and the working time of the wearable device can be increased.

[0084] In the technical solution provided in this embodiment, the user's eyeballs are scanned to determine the position of the eyeball's gaze point, and at least one of the image rendering ratio and the image rendering frequency of the display screen of the wearable device is adjusted according to the position of the gaze point. This solution adjusts at least one of the image rendering ratio and the image rendering frequency of the display screen of the wearable device based on the position of the eyeball's gaze, which can effectively reduce the power consumption of the wearable device.

[0085] Reference Figure 3 , Figure 3 is a flow chart of a second embodiment of a control method for a wearable device of the present invention. Based on the first embodiment, the step S10 includes:

[0086] Step S11, sending a scanning signal to the eyeball through a signal transmitter of the wearable device, and receiving the scanning signal reflected back by the eyeball through a signal receiver;

[0087] In this embodiment, a scanning signal is sent to the eyeball through the signal transmitter of the wearable device, and the scanning signal reflected by the eyeball is received by the signal receiver. Among them, the signal transmitter refers to a device that can transmit a scanning signal, for example, the signal transmitter can be a scanner, a scanner or a scanning module, etc.; the scanning signal can be an infrared signal or an invisible light signal that does not harm the glasses; the signal receiver refers to a device that can receive a scanning signal, for example, the signal receiver can be a detector, a detector or a detection module, etc.; the wearable device includes at least one signal transmitter and multiple signal receivers. It should be noted that in other embodiments, the signal transmitter, the signal receiver and the scanning signal can be determined according to actual conditions, and this embodiment does not limit this.

[0088] Specifically, the signal transmitter on the wearable device transmits a scanning signal to the eyeball at a preset frequency at a preset time interval, and the signal receiver receives the scanning signal reflected by the eyeball to scan the entire eyeball, obtains the scanning signal with the weakest reflection intensity, and determines the position of the eyeball's gaze point based on the scanning signal with the weakest reflection intensity. Among them, the preset duration can range from 2-5ms, and the preset frequency can range from 200-500HZ. Of course, in other embodiments, the preset duration and preset frequency can be set according to actual needs, and this embodiment does not limit this.

[0089] Step S12, obtaining the emission angle of the scanning signal;

[0090] In this embodiment, refer to Figure 4 , Figure 4 1 is a schematic diagram of the principle of determining the position of the eye's gaze point according to an embodiment of the present invention. Figure 4 As shown, the signal transmitter transmits a scanning signal, the scanning signal with the weakest eyeball reflection intensity is received by the signal receiver n, and the wearable device obtains the emission angle of the scanning signal, wherein the emission angle refers to the angle α formed by the ray from the signal transmitter to the eyeball and the ray from the signal transmitter to the signal receiver n.

[0091] Step S13, determining the gaze angle of the eyeball according to the emission angle of the scanning signal;

[0092] In this embodiment, the wearable device determines the gaze angle of the eyeball according to the emission angle of the scanning signal, wherein the gaze angle is the angle β formed by the ray from the eyeball to the signal transmitter and the ray from the eyeball to the signal receiver n.

[0093] Specifically, the wearable device obtains the distance between the signal transmitter and the signal receiver, obtains the transmission distance of the scanning signal, and determines the gaze angle of the eyeball according to the emission angle, the distance between the signal transmitter and the signal receiver, and the transmission distance. Among them, since the positions of the signal transmitter and the signal receiver of the wearable device on the wearable device are known, the distance D between the signal transmitter and the signal receiver of the wearable device is known and can be pre-set or stored; the transmission distance L of the scanning signal can be determined by obtaining the transmission duration of the scanning signal and the transmission rate of the scanning signal. The gaze angle of the eyeball is determined as follows: Assuming that the emission angle α corresponds to a side length of m, then according to the cosine theorem, it can be known that: m^2=D^2+(Lm)^2-2*D*(Lm)*Cosα can be obtained to obtain m, and similarly, β can be obtained, β=arccos((m^2+(Lm)^2) / 2*m*(Lm)).

[0094] Step S14, determining the position of the gaze point of the eyeball according to the gaze angle of the eyeball.

[0095] In this embodiment, after the wearable device obtains the gaze angle of the eyeball, it determines the position of the eyeball's gaze point according to the gaze angle of the eyeball. Specifically, the position of the eyeball's gaze point is determined as follows: According to the cosine theorem: |AF|^2=(Lm)^2+|BF|^2-2*(Lm)*|BF|*Cosβ / 2, |BF|^2=(Lm)^2+|AF|^2-2*(Lm)*|AF|*Cos(180-α-β / 2), the |AF| and |BF| values ​​can be obtained. According to the principle of similar triangles: n / (D+n)=D2 / D1, n / (D+n)=D2 / |x'F|, |x'F| can be obtained, and |y'F| can be obtained by the same token, so the coordinates of point F are (x', y'). Among them, the coordinates of point F are the position of the eyeball's gaze point.

[0096] In the technical solution provided by this embodiment, a scanning signal is sent to the eyeball through the signal transmitter of the wearable device, and the scanning signal reflected by the eyeball is received by the signal receiver, the emission angle of the scanning signal is obtained, the gaze angle of the eyeball is determined according to the emission angle of the scanning signal, and the position of the gaze point of the eyeball is determined according to the gaze angle of the eyeball. This solution can accurately determine the position of the gaze point of the eyeball and improve the control accuracy of the wearable device.

[0097] Based on the above embodiments, the present invention also provides a wearable device, which may include a memory, a processor, and a control program for the wearable device stored in the memory and executable on the processor. When the processor executes the control program for the wearable device, the steps of the control method for the wearable device described in any of the above embodiments are implemented.

[0098] In one embodiment, the wearable device further includes a signal transmitter and a signal receiver. The signal transmitter can transmit a scanning signal to the eyeball, and the signal receiver can receive the scanning signal reflected back by the eyeball.

[0099] Based on the above embodiments, the present invention further provides a computer-readable storage medium on which a control program for a wearable device is stored. When the control program for the wearable device is executed by a processor, the steps of the control method for the wearable device as described in any of the above embodiments are implemented.

[0100] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.

[0101] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

[0102] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes a number of instructions for a terminal device (which can be a smart TV, mobile phone, computer, etc.) to execute the methods described in each embodiment of the present invention.

[0103] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A control method for a wearable device, characterized in that: The control method of the wearable device includes: Sending a scanning signal to the user's eyeball through a signal transmitter of the wearable device, and receiving the scanning signal reflected back by the eyeball through a signal receiver, wherein the scanning signal is a signal with the weakest eyeball reflection intensity; Acquiring an emission angle of the scanning signal; Obtaining the distance between the signal transmitter and the signal receiver; Acquiring a transmission distance of the scanning signal; Determining the gaze angle of the eyeball according to the emission angle, the distance between the signal transmitter and the signal receiver, and the transmission distance; Determining the position of the gaze point of the eyeball according to the gaze angle of the eyeball; Adjusting the image rendering ratio of the display screen of the wearable device and the image rendering frequency of the display screen according to the position of the gaze point; The step of adjusting the image rendering ratio of the display screen of the wearable device and the image rendering frequency of the display screen according to the position of the gaze point comprises: When the position of the gaze point is located in the display area of ​​the display screen of the wearable device, determining whether the position of the gaze point is located in the focus area of ​​the display screen, wherein the focus area is located in the display area, and the area of ​​the focus area is smaller than the area of ​​the display area; When the position of the gaze point is not located in the focus area, the image rendering ratio of the display screen of the wearable device and the image rendering frequency of the display screen are reduced; the display area is divided into multiple display sub-areas, and the second image rendering ratios of other display sub-areas decrease in sequence according to their distances from the display sub-area where the gaze point is located.

2. The control method of the wearable device according to claim 1, characterized in that: The step of adjusting the image rendering ratio of the display screen of the wearable device and the image rendering frequency of the display screen according to the position of the gaze point comprises: When the gaze point is located in a display area of ​​the display screen of the wearable device, acquiring the focal length of the eyeball; When the focal length is not within a preset range, the image rendering ratio of the display screen of the wearable device and the image rendering frequency of the display screen are reduced.

3. The control method of the wearable device according to any one of claims 1 to 2, characterized in that: The step of reducing the image rendering ratio of the display screen of the wearable device comprises: Obtaining a first image rendering ratio of a display sub-region where the gaze point is located, wherein the display region is divided into a plurality of display sub-regions; Acquire a positional relationship between other display sub-regions in the display region except the display sub-region where the gaze point is located and the display sub-region where the gaze point is located; A second image rendering ratio of the other display sub-area is adjusted according to the positional relationship, wherein the second image rendering ratio is smaller than the first image rendering ratio.

4. The control method of the wearable device according to claim 1, characterized in that: The step of adjusting the image rendering ratio of the display screen of the wearable device and the image rendering frequency of the display screen according to the position of the gaze point includes: when the position of the gaze point is not located in the display area of ​​the display screen of the wearable device, reducing the image rendering ratio of the display screen of the wearable device and the image rendering frequency of the display screen.

5. A wearable device, characterized in that: The wearable device includes a memory, a processor, and a control program of the wearable device stored in the memory and executable on the processor. When the control program of the wearable device is executed by the processor, the steps of the control method of the wearable device as described in any one of claims 1 to 4 are implemented.

6. The wearable device according to claim 5, characterized in that: The wearable device also includes a signal transmitter and a signal receiver, the signal transmitter transmits a scanning signal to the eyeball, and the signal receiver receives the scanning signal reflected back by the eyeball.

7. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a control program for the wearable device, and when the control program for the wearable device is executed by the processor, the steps of the control method for the wearable device according to any one of claims 1 to 4 are implemented.

Citation Information

Patent Citations

  • Image rendering method and device

    CN110347265A

  • Image processing method, VR equipment, terminal, display system and computer readable storage medium

    CN111556305A