Intelligent glasses wearing detection method, device and equipment
Patent Information
- Application Number
- HK42026127278
- Authority / Receiving Office
- HK · HK
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2026-08-07
- Publication Date
- 2026-10-09
- Estimated Expiration
- 2046-02-23
Smart Images
Figure 00000000_0000_ABST
Abstract
Description
(19) State Intellectual Property Office (12) Invention Patent Application (10) Application Publication Number (43) Application Publication Date (21) Application Number 202610222074.2 (22) Application Date 2026.02.24 (71) Applicant Shanghai Qianwen Zhilian Artificial Intelligence Technology Co., Ltd. Address Room 407-4, 4th Floor, Building X7, No.8 Longyao Road, Xuhui District, Shanghai 200232 (72) Inventors Qin Linchan, Wang Hongyu, Wang Jingjing (74) Patent Agency Beijing Ruipai Intellectual Property Agency Co., Ltd. 11597 Patent Attorney Liu Feng (51) Int.Cl. G02B 27 / 01 (2006.01) G06F 3 / 01 (2006.01) (54) Invention Title Smart Glasses Wearing Detection Method, Device and Equipment (57) Abstract This application discloses a smart glasses wearing detection method, device and equipment. The method involves acquiring data from a contact sensor; determining whether the data is within a critical wearing threshold range; if so, activating an eye data acquisition device; determining whether someone is wearing smart glasses based on the data acquired by the eye data acquisition device; and then deactivating the eye data acquisition device. This approach implements an event-triggered eye-tracking-assisted wearing detection mechanism, only briefly activating the eye data acquisition device when a blurred wearing state is initially detected by a low-power sensor, avoiding continuous operation. Therefore, it effectively balances high robustness in wearing detection with low device power consumption. Claims 2 pages, Description 10 pages, Drawings 3 pages, CN 122131488 A 2026.06.02 CN 1 22 13 14 88 A 1. A method for detecting the wearing of smart glasses, characterized in that it includes: acquiring data from a contact sensor; determining whether the data from the contact sensor is within a wearing threshold range; if the data from the contact sensor is within the wearing threshold range, activating an eye data acquisition device; determining whether someone is wearing smart glasses based on the acquired eye data; and deactivating the eye data acquisition device. 2. The method according to claim 1, characterized in that it further includes: acquiring a wearing threshold between the contact sensor in two states: not wearing and wearing; and determining the wearing threshold range based on the wearing threshold. 3. The method according to claim 1, characterized in that it further includes: acquiring motion data of the smart glasses; determining whether a smart glasses removal / wearing action has occurred based on the motion data; and activating the eye data acquisition device if the removal / wearing action has occurred. 4. The method according to claim 3, characterized in that acquiring the motion data of the smart glasses includes:The motion data is acquired using an inertial measurement device, the motion data including acceleration and angular velocity; determining whether a glasses-wearing action has occurred based on the motion data includes: determining whether a glasses-wearing action has occurred based on the acceleration and acceleration threshold, and the angular velocity and angular velocity threshold. 5. The method according to claim 1, further comprising: acquiring motion data of smart glasses; determining whether a smart glasses-wearing action has occurred based on the motion data; if the data from the contact sensor is within the wearing threshold range and a glasses-wearing action has occurred, then determining that someone is wearing smart glasses. 6. The method according to claim 1, further comprising: acquiring motion data of smart glasses; determining whether a smart glasses-wearing action has occurred based on the motion data; activating the human eye data acquisition device if the data from the contact sensor is within the wearing threshold range includes: activating the human eye data acquisition device if the data from the contact sensor is within the wearing threshold range and no glasses-wearing action has occurred. 7. The method according to claim 1, wherein the human eye data acquisition device comprises: an eye-tracking camera; the step of determining whether someone is wearing smart glasses based on the acquired human eye data comprises: determining whether someone is wearing smart glasses based on the eye-tracking image acquired by the eye-tracking camera. 8. The method according to claim 1, wherein the human eye data acquisition device comprises: an infrared light source and an infrared signal receiving device; the step of determining whether someone is wearing smart glasses based on the acquired human eye data comprises: determining whether someone is wearing smart glasses based on the infrared reflection signal of the eye received by the infrared signal receiving device. Claims 1 / 2 Page 2 CN 122131488 A 9. The method according to claim 1, wherein the human eye data acquisition device comprises: an eye image acquisition device; the step of determining whether someone is wearing smart glasses based on the acquired human eye data comprises: performing pupil detection or eyelid detection based on the eye image acquired by the eye image acquisition device; if a pupil or eyelid is identified from the eye image, it is determined that someone is wearing smart glasses. 10. The method according to claim 8 or 9, characterized in that it further comprises: if it is determined based on the human eye data that someone is wearing smart glasses, then determining whether the wearer is a real person; if the wearer is a real person, then determining that someone is wearing smart glasses. 11. A method for detecting the wearing of smart glasses, characterized in that it comprises: acquiring motion data of smart glasses; determining, based on the motion data, whether a smart glasses wearing / removing action has occurred; if it is determined that the wearing / removing action has occurred, then activating a human eye data acquisition device; determining, based on the acquired human eye data, whether someone is wearing smart glasses; and deactivating the human eye data acquisition device.12. A smart glasses wearing detection device, characterized in that it comprises: a sensor data acquisition unit for acquiring data from a contact sensor; a first judgment unit for determining whether the data from the contact sensor is within a wearing threshold range; a first activation unit for activating an eye data acquisition device if the data from the contact sensor is within the wearing threshold range; a second judgment unit for determining whether someone is wearing smart glasses based on the acquired eye data; and a shutdown unit for shutting down the eye data acquisition device. 13. A smart glasses wearing detection device, characterized in that it comprises: a glasses motion data acquisition unit for acquiring motion data from smart glasses; a first judgment unit for determining whether a smart glasses wearing / removing action has occurred based on the motion data; an activation unit for activating the eye data acquisition device if the wearing / removing action is determined to have occurred; a second judgment unit for determining whether someone is wearing smart glasses based on the acquired eye data; and a shutdown unit for shutting down the eye data acquisition device. 14. An electronic device, characterized in that it comprises: a processor; and a memory for storing a program implementing the method according to any one of claims 1 to 11, wherein the device is powered on and runs the program of the method through the processor. Claims 2 / 2 Page 3 CN 122131488 A Smart Glasses Wearing Detection Method, Apparatus and Device Technical Field
[0001] This application relates to the technical field of smart wearable devices, specifically to a smart glasses wearing detection method and apparatus, as well as electronic devices. Background Art
[0002] Smart glasses wearing detection refers to determining whether glasses are correctly worn on a person's face. Existing smart glasses mainly rely on capacitive contact sensors to detect wearing, which has the advantage of low power consumption, but is easily affected by differences in user head shape, glasses slippage, sweat or hair interference, leading to misjudgments, such as judging as wearing when not wearing, and recognizing as not wearing when wearing. Some high-end devices use eye-tracking to assist smart glasses wearing detection, which has the advantage of high detection robustness. Currently, the eye-tracking-assisted smart glasses wearing detection method uses an eye-tracking camera to continuously detect the presence of the eyes, that is, to perform wearing detection through a continuously running eye-tracking camera, and turn off the screen (screen off when no eyes) or even put it into standby mode if there is no eye for a period of time.
[0003] However, in the process of implementing this application, the applicant discovered that existing solutions have at least the following problems: continuous operation of the eye-tracking module and the eye-tracking algorithm relying on high frame rate image processing, which leads to high power consumption and is not suitable for lightweight smart glasses with limited batteries. Summary of the Invention
[0004] This application provides a smart glasses wearing detection method to solve the problem in the prior art that it cannot simultaneously achieve low device power consumption and high robustness of wearing detection. This application also provides a smart glasses wearing detection device and an electronic device.
[0005] This application provides a method for detecting the wearing of smart glasses, comprising: acquiring data from a contact sensor; determining whether the data from the contact sensor is within a critical threshold range for wearing; if the data from the contact sensor is within the critical threshold range for wearing, activating an eye data acquisition device; determining whether someone is wearing smart glasses based on the acquired eye data; and deactivating the eye data acquisition device.
[0006] Optionally, it further comprises: acquiring a critical threshold for wearing the contact sensor between two states: not wearing and wearing; and determining the critical threshold range for wearing based on the critical threshold.
[0007] Optionally, it further comprises: acquiring motion data from the smart glasses; determining whether a smart glasses removal / wearing action has occurred based on the motion data; and activating the eye data acquisition device if the removal / wearing action has occurred.
[0008] Optionally, acquiring the motion data of the smart glasses includes: acquiring the motion data through an inertial measurement device, the motion data including: acceleration and angular velocity; determining whether a glasses-wearing action has occurred based on the motion data includes: determining whether a glasses-wearing action has occurred based on the acceleration and acceleration threshold, and the angular velocity and angular velocity threshold.
[0009] Optionally, it further includes: acquiring the motion data of the smart glasses; determining whether a smart glasses-wearing action has occurred based on the motion data; if the data of the contact sensor is within the wearing threshold range and a glasses-wearing action has occurred, then it is determined that someone is wearing the smart glasses.
[0010] Optionally, it further includes: acquiring motion data of smart glasses; determining whether a smart glasses wearing / removing action has occurred based on the motion data; the step of activating the human eye data acquisition device if the data of the contact sensor is within the wearing threshold range includes: activating the human eye data acquisition device if the data of the contact sensor is within the wearing threshold range and no glasses wearing / removing action has occurred.
[0011] Optionally, the human eye data acquisition device includes: an eye-tracking camera; the step of determining whether someone is wearing smart glasses based on the acquired human eye data includes: determining whether someone is wearing smart glasses based on the eye-tracking images acquired by the eye-tracking camera.
[0012] Optionally, the human eye data acquisition device includes: an infrared light source and an infrared signal receiving device; the step of determining whether someone is wearing smart glasses based on the acquired human eye data includes: determining whether someone is wearing smart glasses based on the infrared reflection signal from the eye received by the infrared signal receiving device.
[0013] Optionally, the human eye data acquisition device includes: an eye image acquisition device; the step of determining whether someone is wearing smart glasses based on the acquired human eye data includes: performing pupil detection or eyelid detection based on the eye image acquired by the eye image acquisition device;If a pupil or eyelid is identified from the eye image, it is determined that someone is wearing smart glasses.
[0014] Optionally, it further includes: if it is determined that someone is wearing smart glasses based on the human eye data, it is determined whether the wearer is a real person; if the wearer is a real person, it is determined that someone is wearing smart glasses.
[0015] Optionally, it further includes: if it is determined that someone is wearing smart glasses, it is woken up by the smart glasses.
[0016] Optionally, the step of waking up the smart glasses if it is determined that someone is wearing smart glasses includes: if it is determined that someone is wearing smart glasses, it is detected whether the wearer is a preset user; if the wearer is a preset user, it is woken up by the smart glasses.
[0017] This application provides a smart glasses wearing detection method, including: acquiring motion data of smart glasses; determining whether a smart glasses wearing action has occurred based on the motion data; if it is determined that the wearing action has occurred, activating a human eye data acquisition device; determining whether someone is wearing smart glasses based on the acquired human eye data; and turning off the human eye data acquisition device.
[0018] This application provides a smart glasses wearing detection device, comprising: a sensor data acquisition unit, used to acquire data from a contact sensor; a first judgment unit, used to determine whether the data from the contact sensor is within a wearing threshold range; a first activation unit, used to activate an eye data acquisition device if the data from the contact sensor is within a wearing threshold range; a second judgment unit, used to determine whether someone is wearing smart glasses based on the acquired eye data; and a shutdown unit, used to shut down the eye data acquisition device.
[0019] This application provides a smart glasses wearing detection device, comprising: a glasses motion data acquisition unit, used to acquire motion data from smart glasses; a first judgment unit, used to determine whether a smart glasses wearing / removing action has occurred based on the motion data; an activation unit, used to activate an eye data acquisition device if the wearing / removing action is determined to have occurred; a second judgment unit, used to determine whether someone is wearing smart glasses based on the acquired eye data; and a shutdown unit, used to shut down the eye data acquisition device.
[0020] This application provides an electronic device, including: a processor; and a memory for storing a program for implementing the method described in any of the above-mentioned methods, wherein the device is powered on and the program of the method is executed by the processor.
[0021] This application also provides a computer-readable storage medium storing instructions that, when executed on a computer, cause the computer to perform the various methods described above.
[0022] This application also provides a computer program product including instructions that, when executed on a computer, cause the computer to perform the various methods described above.
[0023] Compared with the prior art, this application has the following advantages:The smart glasses wearing detection method provided in this application acquires data from a contact sensor; determines whether the data from the contact sensor is within the wearing threshold range; if the data from the contact sensor is within the wearing threshold range, activates the human eye data acquisition device; determines whether someone is wearing smart glasses based on the acquired human eye data; and then deactivates the human eye data acquisition device. This approach implements an event-triggered eye-tracking assisted wearing detection mechanism, only briefly activating the human eye data acquisition device when a blurred wearing state is initially detected based on existing low-power sensors, avoiding continuous operation of the human eye data acquisition device. Therefore, it effectively balances high robustness of wearing detection with low device power consumption. Specifically, compared to existing pure contact solutions, the method provided in this application effectively improves the robustness of wearing detection and avoids false wake-ups of smart glasses due to head shape / wearing misalignment. Compared to existing continuous eye-tracking detection, power consumption is reduced by more than 80% (the human eye data acquisition device, such as the eye-tracking module, operates for less than 2 minutes per day). Its ultra-low power design is suitable for smart glasses with TWS-level battery capacity and for scenarios requiring precise wearing perception, such as all-weather AI glasses and AR glasses. Furthermore, this processing method is compatible with existing smart glasses hardware, requiring no additional sensors and reusing existing capacitors, IMUs, and eye-tracking modules in smart glasses.
[0024] The smart glasses wearing detection method provided in this application embodiment acquires motion data of the smart glasses; determines whether a smart glasses wearing action has occurred based on the motion data; if the wearing action is determined to have occurred, the human eye data acquisition device is activated; the collected human eye data is used to determine whether someone is wearing smart glasses; and the human eye data acquisition device is deactivated. This processing method realizes an event-triggered eye-tracking assisted wearing detection mechanism, which only briefly activates the human eye data acquisition device when the wearing action (fuzzy wearing state) is initially detected based on the existing motion data detection device, avoiding continuous operation of the human eye data acquisition device; therefore, it can effectively balance high wear detection robustness and lower device power consumption than the specification page 3 / 10 6 CN 122131488 A.
[0025] FIG1 is a flowchart illustrating an embodiment of the smart glasses wearing detection method provided in this application; FIG2 is a detailed flowchart illustrating an embodiment of the smart glasses wearing detection method provided in this application; FIG3 is yet another detailed flowchart illustrating an embodiment of the smart glasses wearing detection method provided in this application. Detailed Description
[0026] Many specific details are set forth in the following description to provide a thorough understanding of this application. However, this application can be implemented in many other ways different from those described herein, and those skilled in the art can make similar extensions without departing from the spirit of this application; therefore, this application is not limited to the specific embodiments disclosed below.
[0027] This application provides a method and apparatus for detecting the wearing of smart glasses, as well as an electronic device. Various solutions are described in detail below in each embodiment.
[0028] The first embodiment is shown in Figure 1, which is a flowchart of the method for detecting the wearing of smart glasses according to this application. In this embodiment, the method may include the following steps: Step S101: Acquire data from a contact sensor.
[0029] Contact sensors in smart glasses include, but are not limited to: capacitive sensors, resistive touch / pressure sensors, piezoelectric sensors, infrared proximity + contact coincidence sensors, etc.
[0030] In one example, the contact sensor is a capacitive sensor, which can be integrated into the temple of the smart glasses to form a microelectrode. Capacitive sensing technology determines the wearing state by detecting changes in capacitance value generated when the sensor contacts the wearer's skin. When the user wears the glasses, skin contact causes an increase in capacitance value between the electrode and ground; after removal, the capacitance value decreases. The chip can identify the wearing state by continuously monitoring this capacitance change and comparing it with a preset threshold. For example, by using a single chip to simultaneously cover wearing and sliding detection, power consumption can be optimized through the "duration" of capacitance change to achieve low-power operation. In specific implementation, an intermittent wake-up mechanism (such as sampling once every 100ms) can be adopted, and the static power consumption can be as low as 5-10μA to extend the device's battery life.
[0031] Step S103: Determine whether the data of the contact sensor is within the wearing threshold range.
[0032] Step S105: If the data of the contact sensor is within the wearing threshold range, then start the human eye data acquisition device.
[0033] The method of detecting glasses wearing based on the wearing signal from the contact sensor is easily affected by differences in user head shape, glasses slippage, sweat or hair interference, and humidity or temperature / humidity changes may also cause the wearing signal (such as capacitance signal) from the contact sensor to be distorted, thus leading to misjudgment of glasses wearing, such as judging as wearing when not wearing, and recognizing as not wearing when wearing. To improve the accuracy of smart glasses wearing detection, the method provided in this application introduces the concept of a wearing critical threshold range to determine whether the smart glasses wearing signal obtained by the contact sensor is within the wearing critical threshold range. If it is within this range, the smart glasses are considered to be in a blurry wearing state, and the human eye data acquisition device can be activated, thereby realizing an event-triggered human eye data-assisted wearing detection mechanism.
[0034] The wearing critical threshold, also known as the wearing boundary point, refers to the wearing critical signal of the smart glasses' contact sensor between the two states of not wearing and wearing. The wearing critical threshold range refers to the range between the smart glasses' contact sensor signal and the two states of not wearing and wearing, which is affected by individual differences such as user head shape, glasses slippage, sweat or hair interference.The critical signal range of the formation.
[0035] In one example, the method provided by the embodiment of this application may further include the following steps: obtaining the wearing critical threshold between the smart glasses in the two states of not wearing and wearing; determining the wearing critical threshold range according to the wearing critical threshold. In specific implementation, the width of the wearing critical threshold range can be set according to actual needs; the wearing critical threshold range is determined according to the wearing critical threshold and the width.
[0036] Taking a capacitive sensor as an example, the wearing critical threshold range can be a capacitance value range set according to the capacitance value of the “wearing / not wearing” boundary, such as the lower limit of the capacitance value range being 20% lower than the capacitance value of the “wearing / not wearing” boundary, and the upper limit being 20% higher than the capacitance value of the “wearing / not wearing” boundary, that is, the boundary value of the capacitance value range is the capacitance value of the “wearing / not wearing” boundary ±20%.
[0037] Step S107: Determine whether someone is wearing smart glasses based on the collected human eye data.
[0038] This step is based on the human eye data collected by the human eye data acquisition device to detect glasses wearing.
[0039] In one example, the human eye data acquisition device includes: an eye-tracking camera; step S107 can be implemented as follows: based on the eye-tracking image acquired by the eye-tracking camera, determine whether someone is wearing smart glasses. This processing method achieves eye-tracking-assisted wearing detection.
[0040] In one example, the human eye data acquisition device includes: an infrared light source and an infrared signal receiving device; step S107 can be implemented as follows: based on the infrared reflection signal from the eye received by the infrared signal receiving device, determine whether someone is wearing smart glasses. This processing method achieves wearing detection assisted by the infrared reflection signal feature of the eye, and compared to the eye-tracking camera method, it can further reduce device power consumption.
[0041] In one example, the human eye data acquisition device includes: an eye image acquisition device; step S107 can be implemented as follows: based on the eye image acquired by the eye image acquisition device, perform pupil detection or eyelid detection; if a pupil or eyelid is identified from the eye image, it is determined that someone is wearing smart glasses. This processing method achieves eye feature-assisted wearing detection, which can further reduce device power consumption compared to the eye-tracking camera method.
[0042] In one example, step S107 can be implemented as follows: Based on the iris data collected by the human eye data acquisition device, determine whether someone is wearing smart glasses. This processing method achieves eye iris feature-assisted wearing detection, which can further reduce device power consumption compared to the eye-tracking camera method.
[0043] Step S109: Turn off the human eye data acquisition device.
[0044] The method provided in this application embodiment adopts an event-triggered human eye data-assisted wearing detection mechanism, which only applies to...When the existing low-power contact sensor initially detects a blurred wearing state, the human eye data acquisition device is activated "shortly" through steps S105 and S109 to avoid continuous operation of the human eye data acquisition device. Taking an eye-tracking camera as an example, experiments have shown that a short activation time of 200 to 500 milliseconds is sufficient to obtain a wearing detection result with high accuracy through step S107.
[0045] Please refer to Figure 2, which is a flowchart of the smart glasses wearing detection method of this application. In one example, the method provided by the embodiment of this application may further include the following steps: Step S201: Acquire motion data of smart glasses.
[0046] Step S203: Determine whether a smart glasses wearing action has occurred based on the motion data.
[0047] In specific implementation, the motion data can be acquired through an inertial measurement unit (IMU), and the motion data may include acceleration and angular velocity; step S203 can be implemented as follows: determine whether a glasses wearing action has occurred based on the acceleration and acceleration threshold, and the angular velocity and angular velocity threshold. For example, if the acceleration is greater than the acceleration threshold and the angular velocity is greater than the angular velocity threshold, then it is determined that an action of putting on or taking off glasses has occurred. Specification 5 / 10 page 8 CN 122131488 A
[0048] Step S205: If it is determined that the action of putting on or taking off glasses has occurred, then the human eye recognition device is activated.
[0049] The method provided in this application embodiment realizes an event-triggered human eye data-assisted wearing detection mechanism through steps S201 to S205, and steps S107 and S109. When a blurry wearing state is initially detected based on the existing low-power motion detection device, the human eye data acquisition device is activated "shortly" through steps S205 and S109 to avoid continuous operation of the human eye data acquisition device.
[0050] Please refer to Figure 3, which is another specific flowchart of the smart glasses wearing detection method of this application. In one example, the method provided in this application embodiment may also include the following steps: Step S201: Acquire motion data of smart glasses.
[0051] Step S203: Based on the motion data, determine whether a smart glasses wearing / removing action has occurred.
[0052] Step S301: If the data from the contact sensor is within the wearing threshold range and a glasses wearing / removing action has occurred, then it is determined that someone is wearing smart glasses.
[0053] The method provided in this application embodiment, through steps S201, S203, and S301, and steps S101 and S103, enables direct determination that someone is wearing smart glasses when the wearing detection result obtained based on the contact sensor is consistent with the wearing detection result obtained based on the motion data, without activating the human eye data acquisition device; therefore, it can further improve and reduce power consumption and detection efficiency.
[0054] In one example, step S103 can be implemented as follows: if the data from the contact sensor is within the wearing threshold range and no glasses are being put on or taken off, then the human eye data acquisition device is activated. This approach ensures that when the wearing detection result obtained from the contact sensor is inconsistent with the wearing detection result obtained from motion data, the human eye data acquisition device is activated to further perform human eye data-assisted wearing detection, avoiding activation of the human eye data acquisition device only when the wearing signal is within the wearing threshold range; therefore, device power consumption can be further reduced.
[0055] In one example, the method provided in this application embodiment may further include the following steps: if it is determined based on the human eye data that someone is wearing smart glasses, then it is determined whether the wearer is a real person; if the wearer is a real person, then it is determined that someone is wearing smart glasses. This approach ensures that after determining that someone is wearing smart glasses based on the human eye data, it is further determined whether the wearer is a real person. Usually, the eyes of a model or the eyes of a person on a screen do not correspond to a real person; only when the wearer is a real person can it be finally determined that someone is wearing smart glasses; therefore, the accuracy of glasses wearing can be further improved.
[0056] In one example, the method provided in this application embodiment may further include the following steps: if it is determined that someone is wearing smart glasses, then wake up the smart glasses. This processing method ensures that the glasses device is in working state after detecting that someone is wearing glasses.
[0057] In specific implementation, the step of waking up the smart glasses if it is determined that someone is wearing smart glasses can be implemented as follows: if it is determined that someone is wearing smart glasses, then detect whether the wearer is a preset user; if the wearer is a preset user, then wake up the smart glasses. This processing method ensures that the glasses will only be activated when the wearer is a preset user; therefore, it can effectively improve the security of device use.
[0058] In one example, the step of detecting whether the wearer is a preset user can be implemented as follows: obtain the wearer's iris data; determine whether the wearer is a preset user based on the iris data and the preset user's iris data. This processing method ensures that the wearer is detected as a preset user based on the wearer's iris data; therefore, it can effectively improve user recognition efficiency and accuracy.
[0059] In one example, the method provided in this application embodiment may further include the following steps: if it is detected that no one is wearing the smart glasses, then the smart glasses are set to a sleep state or turned off. This processing method ensures that after detecting that no one is wearing the glasses, the glasses are turned off or put into a sleep state; therefore, the power consumption of the glasses can be effectively reduced. Specification 6 / 10 pages 9 CN 122131488 A
[0060] As can be seen from the above embodiments, the smart glasses wearing detection method provided in this application embodiment, this application embodimentThe provided smart glasses wearing detection method acquires data from a contact sensor; determines whether the data from the contact sensor is within the wearing threshold range; if the data from the contact sensor is within the wearing threshold range, then activates the human eye data acquisition device; determines whether someone is wearing smart glasses based on the acquired human eye data; and then deactivates the human eye data acquisition device. This processing method achieves an event-triggered eye-tracking assisted wearing detection mechanism, which only briefly activates the human eye data acquisition device when a blurred wearing state is initially detected based on existing low-power sensors, avoiding continuous operation of the human eye data acquisition device; therefore, it can effectively balance high wearing detection robustness with low device power consumption.
[0061] Second Embodiment In the above embodiments, a smart glasses wearing detection method is provided. Correspondingly, this application also provides a smart glasses wearing detection device. This device corresponds to the embodiments of the above method. Since the device embodiments are basically similar to the method embodiments, the description is relatively simple, and relevant parts can be referred to in the description of the method embodiments. The device embodiments described below are merely illustrative.
[0062] This application further provides a smart glasses wearing detection device, including: a sensor data acquisition unit, a first judgment unit, a human eye data acquisition device activation unit, a second judgment unit, and a human eye data acquisition device deactivation unit.
[0063] Wherein, the sensor data acquisition unit is used to acquire data from a contact sensor; the first judgment unit is used to determine whether the data from the contact sensor is within a wearing threshold range; the first activation unit is used to activate the human eye data acquisition device if the data from the contact sensor is within a wearing threshold range; the second judgment unit is used to determine whether someone is wearing smart glasses based on the acquired human eye data; and the deactivation unit is used to deactivate the human eye data acquisition device.
[0064] In one example, the device may further include: a wearing threshold range determination unit, used to acquire a wearing threshold between the contact sensor in the two states of not wearing and wearing; and to determine the wearing threshold range based on the wearing threshold.
[0065] In one example, the device may further include: a glasses-wearing / removing action recognition unit, used to acquire motion data of the smart glasses; and to determine whether a glasses-wearing / removing action has occurred based on the motion data; and a second activation unit, used to activate the human eye data acquisition device if the glasses-wearing / removing action is determined to have occurred.
[0066] In one example, acquiring the motion data of the smart glasses includes: acquiring the motion data through an inertial measurement device, the motion data including: acceleration and angular velocity; determining whether a glasses-wearing / removing action has occurred based on the motion data includes: determining whether a glasses-wearing / removing action has occurred based on the acceleration and an acceleration threshold, and the angular velocity and an angular velocity threshold.
[0067] In one example, the device may further include: a glasses-wearing action recognition unit, used to acquire motion data of smart glasses; and determine whether a smart glasses-wearing action has occurred based on the motion data; a determination unit, specifically used to determine that someone is wearing smart glasses if the data of the contact sensor is in the wearing threshold range and a glasses-wearing action has occurred.
[0068] In one example, the device may further include: a glasses-wearing action recognition unit, used to acquire motion data of smart glasses; and determine whether a smart glasses-wearing action has occurred based on the motion data; a second determination unit, specifically used to activate the human eye data acquisition device if the data of the contact sensor is in the wearing threshold range and no glasses-wearing action has occurred.
[0069] In one example, the human eye data acquisition device includes: an eye-tracking camera; the determination of whether someone is wearing smart glasses based on the acquired human eye data includes: determining whether someone is wearing smart glasses based on the eye-tracking images acquired by the eye-tracking camera.
[0070] In one example, the human eye data acquisition device includes: an infrared light source and an infrared signal receiving device; the step of determining whether someone is wearing smart glasses based on the acquired human eye data includes: determining whether someone is wearing smart glasses based on the infrared reflection signal of the eye received by the infrared signal receiving device.
[0071] In one example, the human eye data acquisition device includes: an eye image acquisition device; the step of determining whether someone is wearing smart glasses based on the acquired human eye data includes: performing pupil detection or eyelid detection based on the eye image acquired by the eye image acquisition device; if a pupil or eyelid is identified from the eye image, it is determined that someone is wearing smart glasses.
[0072] In one example, the device may further include: a third judgment unit, used to determine whether the wearer is a real person if it is determined based on the human eye data that someone is wearing smart glasses; if the wearer is a real person, it is determined that someone is wearing smart glasses.
[0073] In one example, the device may further include: a glasses wake-up unit, used to wake up the smart glasses if it is determined that someone is wearing smart glasses.
[0074] In one example, the glasses wake-up unit is specifically used to detect whether the wearer is a preset user if it is determined that someone is wearing smart glasses; if the wearer is a preset user, the smart glasses are woken up.
[0075] Third Embodiment In the above embodiments, a smart glasses wearing detection method is provided. Correspondingly, this application also provides a smart glasses wearing detection method. This method corresponds to the embodiments of the above methods, so it is described relatively simply. For relevant details, please refer to the description of the method embodiment one. The method embodiments described below are merely illustrative.
[0076] Another smart glasses wearing detection method provided in this application embodiment includes the following steps: Step 1: Acquire motion data of the smart glasses.
[0077] Step 2: Determine whether a smart glasses wearing action has occurred based on the motion data.
[0078] Step 3: If the wearing action is determined to have occurred, activate the human eye data acquisition device.
[0079] Step 4: Determine whether someone is wearing smart glasses based on the acquired human eye data.
[0080] Step 5: Turn off the human eye data acquisition device.
[0081] As can be seen from the above embodiment, motion data is used to determine whether a smart glasses wearing action has occurred; if the wearing action is determined to have occurred, the human eye data acquisition device is activated; based on the acquired human eye data, it is determined whether someone is wearing smart glasses; and the human eye data acquisition device is turned off. This processing method realizes an event-triggered eye-tracking assistive wearing detection mechanism. The human eye data acquisition device is only activated briefly when the existing motion data detection device initially detects the action of putting on and taking off glasses (fuzzy wearing state), avoiding continuous operation of the human eye data acquisition device. Therefore, it can effectively balance high wear detection robustness and low device power consumption.
[0082] Fourth Embodiment In the above embodiments, a smart glasses wearing detection method is provided. Correspondingly, this application also provides a smart glasses wearing detection device. This device corresponds to the embodiments of the above method. Since the device embodiment is basically similar to the method embodiment, it is described simply. For relevant parts, please refer to the description of the method embodiment. The device embodiment described below is merely illustrative.
[0083] This application further provides a smart glasses wearing detection device, including: a glasses motion data acquisition unit, a first judgment unit, a start unit, a second judgment unit, and a stop unit. The system includes a glasses motion data acquisition unit for acquiring motion data of smart glasses; a first judgment unit for determining whether a smart glasses wearing / removing action has occurred based on the motion data; a start unit for activating a human eye data acquisition device if the wearing / removing action is determined to have occurred; a second judgment unit for determining whether someone is wearing smart glasses based on the acquired human eye data; and a stop unit for stopping the human eye data acquisition device.
[0084] Fifth Embodiment In the above embodiments, a smart glasses wearing detection method is provided. Correspondingly, this application also provides an electronic device. This device corresponds to the embodiments of the above method. Since the device embodiments are basically similar to the method embodiments, they are described simply. For relevant details, please refer to the description of the method embodiments. The device embodiments described below are merely illustrative.
[0085] The electronic device of this embodiment includes: a memory and a processor; the memory is used to store the implementation of smart glasses wearing / removing actions.The device is powered on and runs the above-described smart glasses wearing detection method program through the processor.
[0086] The memory can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, disk or optical disk.
[0087] In specific implementations, the electronic device may also include one or more of the following components: a power supply component, an input / output (I / O) interface, and a communication component. The power supply component provides power to various components of the electronic device. The power supply component may include a power management system, one or more power supplies, and other components associated with generating, managing and distributing power to the electronic device. The I / O interface provides an interface between the processor 503 and peripheral interface modules, which may be a keyboard, click wheel, buttons, etc. The communication component is configured to facilitate wired or wireless communication between the electronic device and user devices (such as smartphones, tablets, etc.).
[0088] Sixth Embodiment This application also provides a computer-readable storage medium. Since the computer-readable storage medium embodiment is basically similar to the method embodiment, it is described simply, and relevant parts can be referred to in the description of the method embodiment. The computer-readable storage medium embodiment described below is merely illustrative.
[0089] In this embodiment, a non-transitory computer-readable storage medium including instructions is provided, such as a memory including instructions, which can be executed by a processor of an electronic device to complete the smart glasses wearing detection method provided by the technical solution of this disclosure. For example, the non-transitory computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.
[0090] It should be noted that the embodiments of this application may involve the use of user data. In practical applications, user-specific personal data can be used in the scheme described herein within the scope permitted by applicable laws and regulations, provided that it complies with the applicable laws and regulations of the country (e.g., the user expressly consents, the user is effectively notified, etc.).
[0091] Although this application discloses preferred embodiments as described above, it is not intended to limit this application. Any person skilled in the art can make possible changes and modifications without departing from the spirit and scope of this application. Therefore, the scope of protection of this application should be determined by the scope defined in the claims of this application.
[0092] In a typical configuration, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory. Specification 9 / 10 pages 12 CN 122131488 A
[0093] Memory may include non-permanent storage in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of computer-readable media.
[0094] 1. Computer-readable media includes permanent and non-permanent, removable and non-removable media that can store information by any method or technology. Information may be computer-readable instructions, data structures, modules of programs or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, magnetic disk storage or other magnetic storage devices or any other non-transfer medium that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media do not include non-transitory computer-readable media, such as modulated data signals and carrier waves.
[0095] 2. Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Moreover, this application can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code. Instruction manual, page 10 / 10, 13 CN 122131488 A, Figure 1; Instruction manual drawing, page 1 / 3, 14 CN 122131488 A, Figure 2; Instruction manual drawing, page 2 / 3, 15 CN 122131488 A, Figure 3; Instruction manual drawing, page 3 / 3, 16 CN 122131488 A, Abstract: This application discloses a method, apparatus, and device for detecting the wearing of smart glasses. The method involves acquiring data from a contact sensor; determining whether the data comes from the contact sensor...sensor is within a critical wearing threshold range; if the data is within this range, activating an eye data acquisition device; determining whether someone is wearing smart glasses based on the data acquired by the eye data acquisition device; and then deactivating the eye data acquisition device. This approach implements an event-triggered eye-tracking assisted wearing detection mechanism, only briefly activating the eye data acquisition device when a blurred wearing state is initially detected based on a low-power sensor, avoiding continuous operation of the eye data acquisition device. Therefore, it effectively balances high robustness in wearing detection with low power consumption of the device.
Claims
1. A method for detecting the wearing of smart glasses, characterized in that, include: Acquire data from contact sensors; Determine whether the data from the contact sensor is within the wear threshold range; If the data from the contact sensor is within the wear threshold range, the human eye data acquisition device is activated. Based on the collected human eye data, it can be determined whether someone is wearing smart glasses; The human eye data acquisition device is turned off.
2. The method according to claim 1, characterized in that, Also includes: Obtain the wearing threshold of the contact sensor between the two states of not wearing and wearing; The wearing critical threshold range is determined based on the wearing critical threshold.
3. The method according to claim 1, characterized in that, Also includes: Acquire motion data from smart glasses; Based on the motion data, determine whether the smart glasses have been put on or taken off. If the removal / wearing action is detected, the human eye data acquisition device is activated.
4. The method according to claim 3, characterized in that, The acquisition of motion data from smart glasses includes: The motion data is acquired using an inertial measurement device, and the motion data includes: acceleration and angular velocity; The step of determining whether a glasses-wearing action has occurred based on the motion data includes: Based on the acceleration and acceleration threshold, as well as the angular velocity and angular velocity threshold, it is determined whether the action of putting on or taking off glasses has occurred.
5. The method according to claim 1, characterized in that, Also includes: Acquire motion data from smart glasses; Based on the motion data, determine whether the smart glasses have been put on or taken off. If the data from the contact sensor is within the wearing threshold range and a glasses-wearing action occurs, it is determined that someone is wearing smart glasses.
6. The method according to claim 1, characterized in that, Also includes: Acquire motion data from smart glasses; Based on the motion data, determine whether the smart glasses have been put on or taken off. If the data from the contact sensor is within the wear threshold range, the eye data acquisition device is activated, including: If the data from the contact sensor is within the wearing threshold range and no glasses are being put on or taken off, the human eye data acquisition device is activated.
7. The method according to claim 1, characterized in that, The human eye data acquisition device includes: an eye-tracking camera; The step of determining whether someone is wearing smart glasses based on collected human eye data includes: Based on the eye-tracking images captured by the eye-tracking camera, it can be determined whether someone is wearing smart glasses.
8. The method according to claim 1, characterized in that, The human eye data acquisition device includes: an infrared light source and an infrared signal receiving device; The step of determining whether someone is wearing smart glasses based on collected human eye data includes: Based on the infrared reflection signal from the eye received by the infrared signal receiving device, it can be determined whether someone is wearing smart glasses.
9. The method according to claim 1, characterized in that, The human eye data acquisition device includes: an eye image acquisition device; The step of determining whether someone is wearing smart glasses based on collected human eye data includes: Based on the eye images acquired by the eye image acquisition device, pupil detection or eyelid detection is performed; If a pupil or eyelid is detected from the eye image, it is determined that someone is wearing smart glasses.
10. The method according to claim 8 or 9, characterized in that, Also includes: If it is determined based on the aforementioned human eye data that someone is wearing smart glasses, then it is determined whether the wearer is a real person; If the wearer is a real person, then it is determined that someone is wearing smart glasses.
11. A method for detecting the wearing of smart glasses, characterized in that, include: Acquire motion data from smart glasses; Based on the motion data, determine whether the smart glasses have been put on or taken off. If the aforementioned removal / wearing action is detected, the human eye data acquisition device is activated; Based on the collected human eye data, it can be determined whether someone is wearing smart glasses; The human eye data acquisition device is turned off.
12. A smart glasses wearing detection device, characterized in that, include: A sensor data acquisition unit is used to acquire data from contact sensors. The first judgment unit is used to determine whether the data of the contact sensor is within the wear threshold range; The first activation unit is used to activate the human eye data acquisition device if the data of the contact sensor is within the wear threshold range. The second judgment unit is used to determine whether someone is wearing smart glasses based on the collected human eye data; The shut-off unit is used to shut down the human eye data acquisition device.
13. A smart glasses wearing detection device, characterized in that, include: The glasses motion data acquisition unit is used to acquire motion data from the smart glasses. The first judgment unit is used to determine whether the action of putting on or taking off smart glasses has occurred based on the motion data; The activation unit is used to activate the human eye data acquisition device if the removal / wearing action is determined to have occurred. The second judgment unit is used to determine whether someone is wearing smart glasses based on the collected human eye data; The shut-off unit is used to shut down the human eye data acquisition device.
14. An electronic device, characterized in that, include: processor; as well as A memory for storing a program for implementing the method according to any one of claims 1 to 11, wherein the device is powered on and the program for running the method is executed by the processor.