A control device and control method of intelligent equipment
By using a motion detection unit and a vibration detection unit in the intelligent device control device, combined with a controller and a communication module, the precise recognition of the user's facial movements and the control of the intelligent device are achieved, and the problems of inaccurate and inhumane control in the prior art are solved, and the user experience is improved.
Patent Information
- Application Number
- CN201810346043.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2018-04-18
- Publication Date
- 2025-03-11
- Estimated Expiration
- 2038-04-18
AI Technical Summary
The prior art is difficult to achieve accurate acquisition of user facial motion instructions, resulting in inaccurate and inhumane control of smart devices.
The sensing module including a motion detection unit and a vibration detection unit is adopted to sense the mandible motion information through the motion detection unit, and the vibration detection unit senses the tooth strike vibration signal. Combined with the controller and the communication module, it realizes accurate identification of the user's facial movements and control of the intelligent device.
It realizes accurate recognition of user facial movements, reduces misjudgment, improves the accuracy and humanization of smart device control, and greatly improves the user experience.
Smart Images

Figure CN108509048B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of electronic equipment, and in particular to a peripheral device capable of controlling intelligent equipment. Background Art
[0002] In order to conveniently control the numerous types and quantities of "artificial intelligence devices", or "intelligent objects", and make them serve humans, various intelligent device entry terminals have emerged, using the most natural human interaction method to control the various intelligent devices concentrated in the "entrance".
[0003] For example, voice control entry terminals represented by smart speakers use natural voice interaction to interact with voice operating systems (DUEROS, etc.) or voice assistants (Siri, Bixby, etc.), and control smart TVs, smart air conditioners, smart lights, sweeping robots, etc. However, when turning on voice services, physical buttons are required to activate (such as Bixby); or touch the earphone screen or shell with your hands (double-click the AirPods shell to activate Siri); or insert earphones (Baidu Voice); or release your hands and just say a wake-up word. Chinese generally has four characters, and before entering the voice interaction link, you need to say "Xiao Ai Tongxue" or "Tmall Genie" before you can say the command. These methods are not humane and inconvenient.
[0004] There are also methods in the prior art to control smart devices through teeth clicking, such as CN201110050659-"Ear Canal Control Device", CN02159261-"A Method and Device for Inputting Control Signals", CN201110050659 "Ear Canal Control Device" and other public documents. Most of the above public documents use one or two types of sensors (such as vibration or pressure) to detect the vibration or pressure generated by the teeth clicking action; the sensor is only configured in a single part of the human body (such as the external auditory canal), with poor accuracy, and it is difficult for the device to determine whether the current teeth clicking is the user chewing or a command issued by the user, so there will be cases of misjudgment. Summary of the invention
[0005] The technical problem to be solved by the present invention is to realize a device that can accurately obtain the user's facial movement instructions and send a control signal to a smart device.
[0006] In order to achieve the above-mentioned purpose, the technical solution adopted by the present invention is: a control device for a smart device, the device includes a sensing module for sensing the facial movements of a user, a controller for obtaining signals from the sensing module, and a communication module connected to the controller and sending user instructions to the smart device, the sensing module includes a motion detection unit for sensing local facial displacement information of the user, and a vibration detection unit for sensing vibration signals of the user's teeth clicking.
[0007] The motion detection unit is provided with at least one pressure sensor or displacement sensor that contacts the skin at the temporomandibular joint of the user's face, and the vibration detection unit is a vibration sensor that contacts the user's head and is used to sense the user's teeth tapping signal.
[0008] The motion detection unit includes a small magnet implanted or closely attached to the skin of the user's face at the temporomandibular joint, and a Hall element fixed outside the small magnet to sense its position change. The vibration detection unit is a vibration sensor device that contacts the user's head and is used to sense the user's teeth tapping signal.
[0009] The motion detection unit also includes an earplug placed on the front wall of the external auditory canal, and a pressure sensor device fixed on the earplug.
[0010] The vibration detection unit is fixed near the skin of the temporomandibular joint of the user's face, or is fixed in the front wall of the user's external auditory canal through an earplug.
[0011] The motion detection unit and the vibration detection unit are fixed on the user's head through a fixing device, and the fixing device includes earphones, helmets, hats, glasses frames, headbands, or implanted elements fixed at the facial signal collection position in an implanted manner.
[0012] The smart device is a signal adapter, a smart headset, smart glasses, a smart phone, a smart speaker, a vehicle-mounted device, a smart wearable device, a smart home system or a partial unit in a smart home system, a smart medical device, a smart toy, a computer, a smart sports equipment, a smart robot or a smart weapon.
[0013] Control method based on the control device of the smart device:
[0014] 1) In the initial state, some sensors in the sensing module obtain the user's facial movement information in real time;
[0015] 2) When the acquired user's facial motion information successfully matches the pre-stored startup information, the control device of the smart device is awakened, and all sensors of the sensing module begin to acquire the user's facial motion information in real time;
[0016] 3) When the acquired user's facial movement information successfully matches the pre-stored instruction information, the control device sends the corresponding instruction to the smart device;
[0017] 4) If the user's facial movement information that successfully matches the pre-stored instruction information is not obtained within the set time, or the pre-stored instruction information that successfully matches the user's facial movement information is in the initial state, return to the initial state.
[0018] The facial movement information includes the skin movement direction, movement distance, movement times, interval time, and dwell time information of the mandibular bone collected by the movement detection unit, and the tooth tapping vibration intensity, vibration frequency, and vibration times collected by the vibration detection unit.
[0019] Based on the security protection method of the control method, when the user's facial movement information obtained by the motion detection unit and the vibration detection unit successfully matches the pre-stored hiding or restricting part of the APP instruction information, the controller sends a hiding or restricting preset APP signal to the smart device through the communication module. After the smart device receives the signal, it hides the pre-set APP to be hidden on the desktop, and / or restricts some permissions and functions of the APP.
[0020] The present invention is a human-computer interaction device and method for issuing instructions to smart devices using facial movements. Through at least two types of sensors, the changes in mandibular movement caused by facial movements are collected at at least one position, user instructions are identified and determined, and combined with voice assistants, screen assistants, etc., the smart device can feel instructions in more dimensions (voice, action, touch). The method follows the most natural interaction form of humans, reduces people's cognitive load, and enhances the capabilities of human sensory channels and action channels. The device is more suitable for humans, making the control of smart devices simpler, faster, more accurate, and more secretive, greatly improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0021] The following is a brief description of the contents expressed in each figure in the specification of the present invention:
[0022] Figure 1 It is the principle diagram of the control device of the intelligent device;
[0023] Figure 2 It is the working principle diagram of the control device of the intelligent device;
[0024] Figure 3 A flow chart of a control method for a control device of an intelligent device;
[0025] Figure 4 This is a schematic diagram of a control device for an intelligent device in Example 1;
[0026] Figure 5 This is a schematic diagram of a control device for an intelligent device according to Example 2;
[0027] Figure 6 This is the working principle of the Hall element. DETAILED DESCRIPTION
[0028] The present invention detects various movement changes around the temporomandibular joint (outside the tragus) caused by human facial movements, or / and the squeezing deformation of the external auditory canal due to the movement of the mandible, as well as different vibrations of the skull through a motion detection unit and a vibration detection unit, and identifies predefined behavioral actions of the facial movements to replace other human-machine interaction methods to output predefined control signals. The motion detection unit and the vibration detection unit cooperate with each other to accurately identify the predefined facial behaviors of the user.
[0029] Regarding the selection of the fixed position of the motion detection unit, the principle is that the changes in mandibular movement caused by human facial movements are formed through the coordination of the masticatory muscles, ligaments, temporomandibular joints, etc. in the human head.
[0030] The temporomandibular joint is mainly composed of the articular surface of the temporal bone, the condylar process of the mandible, the articular disc between the two, the joint capsule around the joint, and the joint ligaments (temporomandibular ligament, sphenomandibular ligament, stylomandibular ligament). It is the only left-right joint in the human body that can rotate and slide, and is one of the most complex joints in the human body. That is, the temporomandibular joint is located in front of the tragus.
[0031] The muscles of mastication include the masseter, temporalis, medial pterygoid, and lateral pterygoid. The masseter, temporalis, and medial pterygoid muscles lift the mandible upward; the temporalis muscles pull the mandible backward; the medial pterygoid, lateral pterygoid, and masseter muscles pull the mandible forward. The temporalis, medial pterygoid, and lateral pterygoid muscles move the mandible left and right.
[0032] The movement of the mandibular head in the mandible and the movement of most of the masticatory muscles can be clearly detected on the outside of the tragus. Skull vibration can also be detected. The movement of the back of the mandibular head can also be detected on the front wall of the external auditory canal. For example, when clicking teeth, the mandible is lifted up, the back of the mandibular head presses the external auditory canal upward, and the front wall of the external auditory canal produces different deformations.
[0033] For example, in the action of tapping the right teeth twice, the skeletal movement can be decomposed into: pulling down the mandible → moving the mandible to the right → lifting the mandible → impact of upper and lower teeth → pulling down the mandible → lifting the mandible → impact of upper and lower teeth.
[0034] Muscle movement can be decomposed into: movement of the jaw depressor muscles → movement of the temporalis muscle, medial pterygoid muscle and lateral pterygoid muscle → movement of the masseter muscle, temporalis muscle and medial pterygoid muscle → movement of the jaw depressor muscles → movement of the temporalis muscle, medial pterygoid muscle and lateral pterygoid muscle.
[0035] On the outside of the tragus, it causes: mandible lowering → skin bulging on the right and slight concavity on the left → mandible rising → skull vibration → mandible lowering → mandible rising → skull vibration.
[0036] Caused in the external auditory canal: the lower end of the front wall of the external auditory canal drops slightly downward → the front wall of the right external auditory canal moves slightly to the right, and at the same time the front wall of the left external auditory canal moves slightly to the right → the lower end of the front wall is squeezed up by the mandible → the skull vibrates → the lower end of the front wall of the external auditory canal drops slightly downward → the lower end of the front wall is squeezed up by the mandible → the skull vibrates.
[0037] The present invention fixes a motion detection unit on the outside of the user's tragus and / or the front wall of the external auditory canal, and fixes a vibration detection unit for sensing the sound of teeth tapping on the user's face, and transmits the collected signals to the controller, which performs calculations based on these data and compares them with the pre-stored instruction table, that is, comprehensively identifies the changes in mandibular movement caused by the user's facial movements, parses the predefined instructions corresponding to the predefined human facial movements, and outputs the instructions; the output instructions are sent to the smart device through the communication module. Through the dual recognition of the motion detection unit and the vibration detection unit, the problems of inaccurate recognition and high error rate of single-position collection and single-type sensor recognition in the prior art are solved.
[0038] There are two embodiments for fixing the positions of the motion detection unit and the vibration detection unit:
[0039] Embodiment 1, as Figure 4 The control device of the contact-type smart device shown in the figure has a sensing module that contacts or is in close contact with the skin of the temporomandibular joint (outside the tragus) of the human face. Generally, one group is provided on one side, and includes a motion detection unit, in which there is a sensing component or / and a sensor of at least one displacement or / and pressure sensor; a vibration detection unit, in which there is a sensing component or / and a sensor of a vibration sensor;
[0040] During work, the user taps his teeth twice in succession, causing the skin around the temporomandibular joint (outside the tragus) to move in different directions and distances, pressures of different sizes, and vibrations of the skull in different ways; the vibration sensor in the vibration detection unit receives the vibration of the user's teeth; one or more pressure sensors in the motion detection unit detect the changes in the squeezing force of the mandibular movement; one or more displacement sensors in the motion detection unit detect the displacement of the mandibular movement.
[0041] Based on these data, the controller calculates that the user's mandible has made two up and down movements and generated two strong vibrations. The user's action is comprehensively identified as: tapping the teeth twice in a row. The command corresponding to the predefined action is parsed and output; the communication module transmits the command to the smart device. After receiving the command, the smart device executes the corresponding command.
[0042] Embodiment 2, as Figure 5In the control device of the contactless smart device shown, the motion detection unit in the sensing module is provided with at least one small magnet (permanent magnet) implanted or closely attached to the skin of the temporomandibular joint (outside the tragus) of the human face, and the magnetic field strength of the small magnet matches the Hall element. The permanent magnet is very small and can be attached or implanted on the skin like a decal, which is beautiful and convenient. A Hall element is arranged on the small magnet outside the skin to measure the relative displacement change between the Hall element and the small magnet. In addition, the motion detection unit is also provided with at least one pressure sensor or / and a pressure detection unit arranged at the earphone inlet end, and the earphone inlet end is made of elastic material so as to transmit the squeezing force of the mandibular movement to the pressure sensor; the vibration detection unit is a vibration sensor arranged at the earphone inlet end or in the earphone body.
[0043] The user moves to the left with a large amplitude and taps his teeth once, which causes the skin around the temporomandibular joint (outside the tragus) to move in different directions and distances, different amounts of pressure, and different vibrations of the skull;
[0044] The small magnet on the skin moves to the left with the mandible, and the Hall electromotive force generated by the Hall element changes. When the small magnet moves to the nearest point, the magnetic field strength B at the external Hall element reaches the maximum value, and the Hall electromotive force U H The maximum value is also reached. Thus, the amplitude of the leftward movement is measured. One or more pressure sensors placed in the ear in the movement detection unit are used to detect the change in the squeezing force of the external auditory canal due to the movement of the mandible; the vibration sensor in the vibration detection unit monitors the vibration of the user's teeth.
[0045] Based on these data, the controller calculates that the user's mandible has made one maximum leftward movement, one up-and-down movement, and one vibration. The controller recognizes that the user's action is: moving to the left with a large amplitude and tapping the teeth once. The controller analyzes the instruction corresponding to the predefined action and outputs the instruction; the communication module transmits the instruction to the smart device to execute the command.
[0046] The above-mentioned pressure sensors include but are not limited to: resistance strain gauge pressure sensors, semiconductor strain gauge pressure sensors, piezoresistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, optical fiber pressure sensors, diffused silicon pressure sensors, piezoelectric pressure sensors, strain gauge pressure sensors, sapphire pressure sensors, ceramic pressure sensors, etc.
[0047] The above-mentioned vibration sensors include but are not limited to: accelerometers, force sensors, impedance heads, impact hammers, speed probes, vibration calibrators, etc.
[0048] The above-mentioned displacement sensors include but are not limited to: inductive displacement sensors, capacitive displacement sensors, photoelectric displacement sensors, ultrasonic displacement sensors, Hall displacement sensors, Hall switches, magnetoresistive displacement sensors, optical fiber displacement sensors, optical triangulation position sensors, digital displacement sensors, etc.
[0049] The above-mentioned smart devices include but are not limited to: signal adapters, smart headphones, smart glasses, smart phones, smart speakers, vehicle-mounted equipment, smart wearables, smart home systems or partial units in smart home systems, smart medical equipment, smart toys, computers, smart sports equipment, smart robots or smart weapons; among them, the signal adapter is a signal converter, similar to an external wireless network card in USB form, an external wireless Bluetooth device in USB form (the connection form is not limited to USB), which is used to connect to the smart device and establish a wireless communication relationship with the control device.
[0050] The connection methods of the above communication modules include but are not limited to: Bluetooth, WiFi, NFC, lineout, Nb-iot, LoRa, ZigBee, and infrared communication technology.
[0051] The above-mentioned motion detection unit and vibration detection unit are fixed on the user's head through a fixing device, and the fixing device includes but is not limited to: headphones, helmets, hats, glasses frames or headbands, or implanted elements fixed at the facial signal collection position in an implanted manner.
[0052] like Figure 3 As shown, the method of controlling smart devices:
[0053] A) After the device is turned on, it is in the initial state. Some sensors in the device's sensing module are turned on, and others are turned off. This can reduce the device's computing power and energy consumption;
[0054] B) In the initial state, some sensors that are currently turned on obtain the user's facial movement information in real time;
[0055] C) The device is preset with facial action information (named as action X) of turning on all sensors in the sensing module. When the facial action information of the user collected by some of the turned-on sensors successfully matches action X, all sensors of the sensing module are turned on. For example, all sensors are turned on at this time to provide all functions of "facial action control". This solves the problems of high computational complexity and high energy consumption caused by turning on all sensors in the prior art, while eliminating interference from other actions, greatly reducing the error rate;
[0056] D) At this time, the sensing module can sense more accurate and detailed facial action information, and compare (match) the acquired facial action information with the pre-stored action instructions one by one. If there is a pre-stored action instruction that matches the acquired facial action information, the operation instruction corresponding to the pre-stored action instruction is sent to the smart device or / and software;
[0057] E) The smart device executes the operation corresponding to the operation instruction and gives feedback to the user;
[0058] F) If the user's facial movement information that successfully matches the pre-stored instruction information is not obtained within the set time, or the pre-stored instruction information that successfully matches the user's facial movement information is in the initial state, then return to A). In this way, under reasonable conditions, it can return to A), continue to maintain a low power consumption state, and will not affect user use.
[0059] Embodiment 1, wherein the method of "detecting and identifying the mandibular movement generated by human facial movements" can be to sense and detect the movement characteristics of the mandibular movement through a motion detection unit and a vibration detection unit. Such as the movement direction, movement distance, number of movements, interval time, dwell time generated by the mandibular movement, and the vibration intensity, vibration interval time and number of vibrations generated after the teeth are forced to vibrate through skull conduction. Redundant processing is performed by two different sensors at the same position, which solves the problem of inaccurate recognition and high error rate of detection by a single type of sensor in the prior art.
[0060] Embodiment 2, wherein the method of "detecting and identifying mandibular movement caused by human facial movement" can also be through a motion detection unit, a unit that senses and detects the movement characteristics of mandibular movement. Such as the movement direction, movement distance, number of movements, interval time, dwell time generated by mandibular movement, and the vibration intensity, vibration interval time and number of vibrations caused by the forced vibration of teeth conducted by the skull. At the same time, another vibration detection unit is placed on the outside of the human auricle or / and the front wall of the external auditory canal to obtain the extrusion signal. Acquiring signals through sensors at two different positions solves the problems of inaccurate recognition and high error rate of single-position collection in the prior art.
[0061] Most of the existing technologies detect in the external auditory canal. The above analysis and experiments prove that it is difficult to ensure that the position of the earphones and the inner wall of the external auditory canal does not move when the user wears and uses the earphones, so the sensor data will produce many variables. Therefore, when detecting a position in the external auditory canal, there are high requirements for the accuracy and installation position of the sensor, and the amount of calculation is increased, which greatly affects the accuracy of mandibular movement recognition, especially the recognition of the left and right directions.
[0062] The above control method also includes a control method that can be combined or configured with other software programs. For example, facial movements can be used to easily turn on (wake up) or off, or to limit the operation of software (programs) in various smart devices. For example, teeth-clicking movements can be used instead of wake-up words to wake up the voice assistants in mobile phones and smart speakers, solving the problem of having to keep saying the wake-up word "Xiao Ai" in current technology.
[0063] The definition of the user's facial movements (pre-stored movement instructions) can be defined according to the needs of the smart device to be used in conjunction, and each movement instruction has a corresponding smart device execution signal.
[0064] like Figure 2 As shown, the user's facial movements can be collected by sensors to generate the mandibular movement state generated by the human facial movements, including a motion detection unit that monitors various movement changes around the temporomandibular joint caused by the mandibular movement, and / or the compression deformation of the external auditory canal; a vibration detection unit that monitors different types of skull vibrations, and the data obtained include the movement direction, movement distance, number of movements, interval time, dwell time, vibration intensity, vibration interval time, and number of vibrations of the mandible.
[0065] For the above control methods, at least one predefined action is set as a security protection method for the smart device or software (such as named "security switch"). In case of emergency, the "security switches" of the smart device or software at various levels can be secretly turned on.
[0066] Take the mobile phone as an example. For example, if a bad guy kidnaps you and asks you to transfer all your money to your accomplice's card through mobile banking, your life will be threatened. You must not adopt Apple's solution (before handing over your phone, press and hold the power and volume buttons at the same time to disable FaceID). You can only cooperate with unlocking your phone with your face and hand over all control of your phone and APP, otherwise your life will be in danger. However, this system can secretly control smart devices or software to start security functions. For example, if you do the predefined action of "clicking your teeth once, pausing, and then clicking your teeth three times", the mobile phone security switch will be turned on. The connected smart phone will enter the "safe mode" according to the settings, automatically operate, such as hiding some APPs, limiting the consumption limit of Alipay, etc., and send the location and alarm at the same time. Only partial control is handed over, which gives criminals a taste of the sweetness while buying time for the police to rescue themselves. This avoids a large amount of property loss and privacy leakage. It solves the lack of such security protection methods in the prior art.
[0067] Since the user's face, voice, fingerprint, etc. are the unlocking keys of smart devices, when the user is held hostage by criminals, he will be forced to unlock or operate the smart device, causing property loss. With this device, the user can turn on the security switch through an extremely concealed and simple teeth-clicking action, which criminals cannot prevent or even find difficult to detect. Therefore, criminals who use kidnapping as a means of making money will only bring trouble to themselves, thus completely dispelling their evil thoughts and eliminating the potential safety hazards that threaten the lives of users.
[0068] The present invention is described above by way of example in conjunction with the accompanying drawings. It is obvious that the specific implementation of the present invention is not limited to the above-mentioned method. As long as various non-substantial improvements are made using the method concept and technical solution of the present invention, or the concept and technical solution of the present invention are directly applied to other occasions without improvement, they are all within the protection scope of the present invention.
Claims
1. A control device for a smart device, comprising a sensing module for sensing a user's facial movements, a controller for acquiring a signal from the sensing module, and a communication module connected to the controller and sending a user's command to the smart device, characterized in that: The sensing module includes a motion detection unit for sensing local displacement information of the user's face, and a vibration detection unit for sensing a vibration signal of the user's teeth clicking; The sensing module contacts or is in close contact with the skin outside the tragus of the temporomandibular joint of the human face, the motion detection unit is provided with at least one pressure sensor or displacement sensor that contacts the skin at the temporomandibular joint of the user's face, and the vibration detection unit is a vibration sensor that contacts the user's head and is used to sense the user's teeth tapping signal; The motion detection unit and the vibration detection unit jointly sense and detect the motion characteristics of the mandibular movement to perform command recognition; or; The motion detection unit in the sensing module is provided with an implant or close to the outer side of the tragus of the temporomandibular joint of the human face, the motion detection unit includes a small magnet implanted or close to the skin of the temporomandibular joint of the user's face, and a Hall element fixed outside the small magnet to sense the position change thereof, the vibration detection unit is a vibration sensor device that contacts the user's head and is used to sense the user's teeth tapping signal, the motion detection unit also includes an earplug placed on the front wall of the external auditory canal, and a pressure sensor device fixed on the earplug; The motion detection unit senses and detects the motion characteristics of the mandibular movement, and the vibration detection unit obtains the squeezing signal to perform command recognition.
2. The control device for smart devices according to claim 1, characterized in that: The vibration detection unit is fixed near the skin of the temporomandibular joint of the user's face, or is fixed in the front wall of the user's external auditory canal through an earplug.
3. The control device for smart devices according to claim 2, characterized in that: The motion detection unit and the vibration detection unit are fixed on the user's head through a fixing device, and the fixing device includes earphones, helmets, hats, glasses frames, headbands, or implanted elements fixed at the facial signal collection position in an implanted manner.
4. The control device for smart devices according to claim 1 or 3, characterized in that: The smart device is a signal adapter, a smart headset, smart glasses, a smart phone, a smart speaker, a vehicle-mounted device, a smart wearable device, a smart home system or a partial unit in a smart home system, a smart medical device, a smart toy, a computer, a smart sports equipment, a smart robot or a smart weapon.
5. A control method based on the control device of the smart device according to claim 1, characterized in that: 1) In the initial state, some sensors in the sensing module obtain the user's facial movement information in real time; 2) When the acquired user's facial motion information successfully matches the pre-stored startup information, the control device of the smart device is awakened, and all sensors of the sensing module begin to acquire the user's facial motion information in real time; 3) When the acquired user's facial movement information successfully matches the pre-stored instruction information, the control device sends the corresponding instruction to the smart device; 4) If the user's facial action information that successfully matches the pre-stored instruction information is not obtained within the set time, or the pre-stored instruction information that successfully matches the user's facial action information is in the initial state, return to the initial state.
6. The control method according to claim 5, characterized in that: The facial movement information includes the skin movement direction, movement distance, movement times, interval time, and dwell time information of the mandibular bone collected by the movement detection unit, and the tooth tapping vibration intensity, vibration frequency, and vibration times collected by the vibration detection unit.
7. A safety protection method based on the control method according to claim 5 or 6, characterized in that: When the user's facial movement information obtained by the motion detection unit and the vibration detection unit successfully matches the pre-stored command information for hiding or restricting part of the APP, the controller sends a signal to hide or restrict the preset APP to the smart device through the communication module. After receiving the signal, the smart device will hide the pre-set APP to be hidden on the desktop, or / and restrict some permissions and functions of the APP.
Citation Information
Patent Citations
Method and device for inputing control signal
CN1512490A
Auditory canal control device
CN102185963A
Application program hiding method applied to touch screen terminal and touch screen terminal
CN103984885A
Control device of smart machine
CN208459971U