Control device and method

Abstract

To enable easy hands-free operation in situations where the target device cannot be operated manually. [Solution] The molar clenching control system (1000) comprises a wearable device (100) worn by the user on their head and a smartphone 200 carried by the user. The smartphone 200 includes a control device (210). The control device (210) comprises a detection unit (211) that detects the clenching motion of the teeth, an analysis unit (212) that performs analysis processing on the detected clenching motion, and an operation control unit (213) that controls operations on the target device (220) based on the analysis processing.

Description

Technical Field

[0001] The present disclosure relates to a control device and method.

Background Art

[0002] In recent years, smartphones have become highly functional, and various functions can be realized by contact operations such as touching the screen of a touch panel with a finger or the like. Further, Patent Document 1 discloses a technique for detecting changes in the movement of the muscles of the head and tilting of the head and outputting an operation signal according to the detection result.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Here, it is dangerous to operate a smartphone by hand while cycling or running. Further, it is difficult to operate a smartphone by hand when making a call by pressing the smartphone against the cheek. Therefore, there is a need for a technique for hands-free operation of a target device such as a smartphone.

[0005] An object of the present disclosure is to provide a control device and method for easily realizing hands-free operation in view of the above problems.

Means for Solving the Problems

[0006] The control device according to the present disclosure includes a detection unit that detects a biting operation, an analysis unit that performs analysis processing on the detected biting operation, and an operation control unit that controls an operation on a target device based on the analysis processing.

[0007] The control method according to this disclosure includes a detection step in which a computer detects a tooth clenching motion, an analysis step in which it performs an analysis process on the detected tooth clenching motion, and an operation control step in which it controls an operation on a target device based on the analysis process. [Effects of the Invention]

[0008] This disclosure makes it possible to easily achieve hands-free operation. [Brief explanation of the drawing]

[0009] [Figure 1] This block diagram shows the configuration of a molar clenching control system including a control device according to Embodiment 1. [Figure 2] This chart shows the flow of the control method according to Embodiment 1. [Figure 3] This flowchart shows the flow of the control method according to Embodiment 2. [Figure 4] This is a flowchart showing the flow of the control method according to Embodiment 3. [Figure 5] This block diagram shows the configuration of a molar clenching control system including a control device according to Embodiment 4. [Figure 6] This flowchart shows the flow of the control method according to Embodiment 4. [Figure 7] This block diagram shows the configuration of a molar clenching control system including a control device according to Embodiment 5. [Figure 8] This chart shows the flow of the control method according to Embodiment 5. [Figure 9] This block diagram shows the configuration of a molar clenching control system including a control device according to Embodiment 6. [Modes for carrying out the invention]

[0010] In the following, specific embodiments of this disclosure will be described in detail with reference to the drawings. In each drawing, the same elements are denoted by the same reference numerals, and redundant explanations will be omitted where necessary for clarity.

[0011] (Embodiment 1) Figure 1 is a block diagram showing the configuration of a molar clenching control system 1000 including a control device according to Embodiment 1. The molar clenching control system 1000 comprises a wearable device 100 and a smartphone 200. The molar clenching control system 1000 is an information system for controlling the operation of a target device in the smartphone 200 by a user U wearing the wearable device 100 on their head and clenching their molars. For example, the user U is riding a bicycle or running and is carrying a smartphone 200, but is in a situation where it is difficult to operate it by hand. Here, when a person, including the user U, clenches their molars, the "masseter muscle" near the cheek and the "temporalis muscle" in the temporal region move in conjunction. The wearable device 100 is a device worn on the user U's head such that a detection sensor 103, described later, contacts the user U in a position where it can detect the movement of either the masseter muscle or the temporalis muscle, or both the masseter muscle and the temporalis muscle.

[0012] The wearable device 100 is connected to the smartphone 200 wirelessly or via a wired connection. The wearable device 100 is a wearable terminal capable of detecting the movement of at least one of the user U's masseter muscle or temporalis muscle, and is preferably a device capable of communicating with the smartphone 200. For example, the wearable device 100 may be a device incorporated into a headset, hairband, hat, headgear, helmet, etc. Here, the wearable device 100 in Figure 1 shows an example of a wireless communication type headset.

[0013] The wearable device 100 includes a microphone 101, earphones 102, a detection sensor 103, and a communication unit 104. The microphone 101 acquires the user U's speech and voice tone as sound data and outputs the acquired sound data to the smartphone 200 via the communication unit 104. Here, the sound data is uncompressed or compressed audio data in an audio file format such as WAV (Waveform Audio Format) or AIFF (Audio Interchange File Format). However, the audio file format is not limited to these. The earphones 102 are worn in the user U's ears and output the sound data received from the smartphone 200 via the communication unit 104.

[0014] The detection sensor 103 is an electromyograph (EMG) sensor capable of detecting the movement of at least one of the user U's masseter muscle or temporalis muscle as an electrical physical quantity. In other words, the detection sensor 103 detects that user U is clenching their teeth based on the movement of at least one of the masseter muscle or temporalis muscle. When the detection sensor 103 detects the movement of the masseter muscle or temporalis muscle, it outputs a message to the smartphone 200 via the communication unit 104 indicating that teeth clenching has been detected. At this time, the detection sensor 103 may also output information such as whether the molars being clenched were left or right, the degree of clenching, the duration of clenching, and the time of detection of clenching, along with the message indicating detection.

[0015] The communication unit 104 is an interface circuit that performs communication between the wearable device 100 and the outside world. For example, the communication unit 104 communicates with the smartphone 200 by short-range wireless communication or other wireless communication, or by wired communication. The short-range wireless communication method may include, but is not limited to, Bluetooth®. The communication unit 104 may be implemented by a general-purpose or dedicated circuit implemented in a semiconductor device, for example. Alternatively, the communication unit 104 may be implemented by a combination of the above-mentioned circuit that performs communication and software that controls the communication processing.

[0016] The smartphone 200 is a wirelessly communicable information processing terminal carried by the user U, and includes a control device and a target device according to this embodiment. The smartphone 200 includes a communication unit 201, an input / output unit 202, a storage unit 203, and a control unit 204. The communication unit 201 is an interface circuit that performs communication between the smartphone 200 and the outside. For example, the communication unit 201 communicates with the wearable device 100 by short-range wireless communication or other wireless communication, or by wired communication. Note that the short-range wireless communication method shall be the method corresponding to the wearable device 100. Also, the communication unit 201 communicates via an external communication network by a mobile phone line network or Wi-Fi (registered trademark), etc.

[0017] The input / output unit 202 is an input / output device that receives input from the user U and outputs to the user U. The input / output unit 202 includes a touch panel having a display device and an electrostatic sensor, a microphone, a speaker, etc. The display device displays the information instructed from the control unit 204. The display device is, for example, a screen such as a liquid crystal display or an organic EL (Organic Electro-Luminescence) display. The electrostatic sensor has detection electrodes embedded in the screen, and detects the charged potential from the current due to the induced charge generated when a finger or the like touches the screen. That is, the electrostatic sensor detects an operation on the screen from the user U and outputs the detection position and the like to the control unit 204. Also, the input / output unit 202 may include hardware that controls the output volume, such as a button for increasing the volume of the speaker and a button for decreasing it. Also, the above buttons may be realized by software.

[0018] The storage unit 203 includes, for example, a non-volatile storage device such as a hard disk or a flash memory, and a memory such as a RAM (Random Access Memory), that is, a volatile storage device. The storage unit 203 stores a computer program and various data for operating the smartphone 200. Examples of the program include an operation control application program in which the processing of the control method according to the present embodiment is implemented, and a target application program that is the target of operation control by the first application program. Note that the storage unit 203 may include a basic program of the smartphone 200.

[0019] The control unit 204 is a control device that controls each component of the smartphone 200. The control unit 204 is, for example, a processor such as a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an FPGA (Field-Programmable Gate Array), or a quantum processor (quantum computer control chip). For example, the control unit 204 causes the memory to read various programs from the storage unit 203 and executes the programs. Thereby, the control unit 204 realizes the functions of the operation control application unit 210 and the target application unit 220. Note that a part or all of the operation control application unit 210 including the detection unit 211, the analysis unit 212, and the operation control unit 213 and the target application unit 220 described later may be realized by general-purpose or dedicated circuits realized by hardware different from the control unit 204, for example, a semiconductor device.

[0020] The operation control application unit 210 is an example of a control device according to this embodiment. The target application unit 220 is an example of a target device that is the target of operation control according to this embodiment. In other words, the smartphone 200 according to this embodiment represents a case in which the control device and the target device are included in the same hardware. However, the technology according to this disclosure is also applicable to cases in which the control device and the target device are different hardware. For example, the target device may be a device for controlling the turning on or off of a bicycle's taillight.

[0021] The operation control application unit 210 comprises a detection unit 211, an analysis unit 212, and an operation control unit 213. The detection unit 211 detects the teeth-clenching motion of user U, who is the wearer of the wearable device 100. Specifically, the detection unit 211 detects that user U has clenched their teeth by receiving notification information when the detection sensor 103 of the wearable device 100 detects movement of at least one of user U's masseter muscle or temporalis muscle. The notification information includes at least information indicating that teeth clenching has been detected, as described above. Furthermore, the notification information may also include information indicating the distinction between the left and right molars that were clenched, the degree of clenching, the duration of clenching, the time of detection of clenching, etc., as described above.

[0022] The analysis unit 212 performs analysis on the teeth-clenching motion detected by the detection unit 211. Here, the analysis unit 212 performs predetermined analysis on the notification information and determines that at least "User U has clenched their teeth" as the analysis result. Specifically, the detection sensor 103 measures electrical and physical quantities generated by the activity of the masseter and temporalis muscles. The analysis unit 212 analyzes whether teeth have been clenched based on the electrical and physical quantities measured by the detection sensor 103 and determines the analysis result. For example, the analysis unit 212 analyzes whether teeth have been clenched if the measured electrical and physical quantities are above a predetermined value. Furthermore, the analysis unit 212 performs predetermined analysis on the notification information and may determine the distinction between the left and right molars that were clenched, the degree of clenching, the duration of clenching, the time of detection of clenching, etc., as analysis results. The analysis result may also be called teeth-clenching information. The teeth-clenching information may also be called analysis information regarding the teeth-clenching of User U's left and right molars. Therefore, the analysis unit 212 may analyze the clenching motion detected by the detection unit 211 as clenching information. In other words, the analysis unit 212 may generate clenching information by analyzing the clenching motion detected by the detection unit 211. Alternatively, the analysis unit 212 may perform analysis processing on multiple clenching motions detected by the detection unit 211 over a certain period and generate clenching information as a comprehensive analysis result.

[0023] The operation control unit 213 controls operations on the target application unit 220 based on the analysis processing performed by the analysis unit 212. The operation control unit 213 outputs operation signals or operation instructions to the target application unit 220 to substitute for user U's operations on the touch panel or buttons of the input / output unit 202. The operation control unit 213 may output operation signals, etc., corresponding to the analysis results from the analysis processing. In other words, the types of operation signals, etc., may be predetermined according to the content of the analysis results. Alternatively, the operation control unit 213 may output predetermined operation signals, etc., to the target application unit 220 as a trigger when the analysis processing is performed by the analysis unit 212. Alternatively, the operation control unit 213 may perform operation control on the target application unit 220 via other processing according to the content of the analysis results or the trigger.

[0024] Figure 2 is a flowchart showing the flow of the control method according to Embodiment 1. First, the detection unit 211 detects the user U's teeth clenching motion (S11). Specifically, user U, who carries a smartphone 200 and wears a wearable device 100 on their head, clenches their molars while cycling or running. In this case, the detection sensor 103 detects the movement of user U's masseter muscle or temporalis muscle and transmits notification information, including that teeth clenching has been detected, to the smartphone 200 via the communication unit 104. In response, the detection unit 211 of the smartphone 200 detects user U's teeth clenching motion based on the notification information received from the wearable device 100.

[0025] Next, the analysis unit 212 performs the analysis process on the detected biting action (S12). Subsequently, the operation control unit 213 controls the operation of the target device, i.e., the target application unit 220, based on the analysis process (S13). As a result, the target application unit 220 performs processing in accordance with the operation control by the operation control unit 213.

[0026] Therefore, this embodiment makes it possible to easily achieve hands-free operation in situations where user U cannot operate the target device by hand. The wearable device 100 according to this embodiment is applicable to various devices. For example, the wearable device 100 may be applied to an "over-ear" type headset that covers part of the temples along with the ears. The wearable device 100 may also be applied to a hairband. In that case, the operation control unit 213 may enable hands-free operation of user U during exercise in response to sensing results of teeth clenching motion caused by the hairband. Similarly, the wearable device 100 may be applied to a jogging cap. The wearable device 100 may also be applied by embedding the detection sensor 103 in a police officer's cap. In that case, the operation control application unit 210 may perform hands-free operation of the radio, which is the target application unit 220, in response to the police officer's teeth clenching motion. The wearable device 100 may also be applied by embedding the detection sensor 103 in the helmet of a police officer riding a traffic enforcement motorcycle, so-called "white bike". In that case, the operation control application unit 210 may initiate camera recording or perform hands-free operation of the radio in response to the police officer's teeth-clenching motion. The wearable device 100 may also be applied to a headgear.

[0027] (Embodiment 2) The control device according to this second embodiment controls the target device by different operations depending on whether the teeth being clenched are on the right or left side. Specifically, detection sensors 103, which are electromyography sensors, are attached near the masseter muscles on the right and left sides, or near the temporalis muscles on the right and left sides. Based on the electrical and physical quantities of the detection sensors 103 attached on the right and left sides, the system analyzes whether the teeth are being clenched on the right and left sides and provides an analysis result. For example, the analysis unit 212 analyzes that the teeth are being clenched on the right side if the electrical and physical quantity of the detection sensor 103 attached near the masseter muscle on the right side is greater than or equal to a predetermined value. For example, the analysis unit 212 analyzes that the teeth are being clenched on the left side if the electrical and physical quantity of the detection sensor 103 attached near the masseter muscle on the left side is greater than or equal to a predetermined value. For example, the analysis unit 212 analyzes that the teeth are being clenched on the right and left sides if the electrical and physical quantities of each detection sensor 103 attached near the masseter muscles on the right and left sides are greater than or equal to a predetermined value. In other words, the result of the analysis process indicates whether the clenching action is on the right or left side of the teeth. The operation control unit 213 controls a first operation on the target device when the clenching motion indicates the right side of the teeth. On the other hand, the operation control unit 213 controls a second operation on the target device when the clenching motion indicates the left side of the teeth. This makes it easy to switch between multiple hands-free operations. In this second embodiment, the operation control unit is more concrete than in the first embodiment. Therefore, the configuration of the molar clenching control system according to this second embodiment is the same as that in Figure 1, and redundant illustrations and explanations will be omitted as appropriate below.

[0028] Figure 3 is a flowchart showing the flow of the control method according to Embodiment 2. First, the detection unit 211 performs processing, similar to step S11 in Figure 2. Then, the analysis unit 212 analyzes the detected clenching action to determine whether the clenched teeth are on the left or right side (S121). Specifically, the analysis unit 212 analyzes the notification information received from the detection sensor 103 to determine whether the clenched molars are on the left or right side. Then, the operation control unit 213 determines whether the detected clenching action is on the right or left side of the teeth (S122). Specifically, the operation control unit 213 determines whether the analysis result in step S121 indicates that the molars clenched by user U are on the left or right side. If it is determined in step S122 that the clenching action is on the right side of the teeth, the operation control unit 213 controls the first operation on the target device, i.e., the target application unit 220 (S131). On the other hand, if step S122 determines that the clenching action indicates the left side of the teeth, the operation control unit 213 controls a second operation on the target device (S132).

[0029] Here, the first operation and the second operation are different operations. For example, the first operation is to increase the volume output to the earphones from the current volume, and the second operation is to decrease the volume output to the earphones from the current volume. For example, suppose user U is listening to music being played on the target application unit 220 of smartphone 200 using the earphones 102 of wearable device 100. And suppose user U is unable to operate smartphone 200 with their hands, for example, while riding a bicycle. In this case, user U can increase the volume of the music being played by clenching their right molars. On the other hand, user U can decrease the volume of the music being played by clenching their left molars. Note that the first and second operations may be reversed. Also, the examples of the first and second operations are not limited to these. In this way, by using the control device according to this embodiment 2, user U can easily switch between multiple hands-free operations. Furthermore, this embodiment 2 can also achieve the same effects as the embodiment 1 described above.

[0030] (Embodiment 3) The control device according to this third embodiment modifies the clenching operation control for the target device based on the time difference between clenching the left and right teeth. That is, the result of the analysis process shows the time difference between the clenching motion on the right and left sides of the teeth. The operation control unit 213 controls a first operation on the target device when the time difference is less than a threshold. On the other hand, the operation control unit 213 controls a second operation on the target device when the time difference is greater than or equal to the threshold. This makes it easy to use multiple hands-free operations depending on different clenching method conditions than those of the second embodiment. In this third embodiment, the operation control unit is more concrete than that of the first embodiment. Therefore, the configuration of the molar clenching control system according to this third embodiment is the same as that of Figure 1, and redundant illustrations and explanations will be omitted as appropriate below.

[0031] Figure 4 is a flowchart showing the flow of the control method according to Embodiment 3. First, the detection unit 211 detects multiple teeth clenching actions by user U (S111). Specifically, user U clenches one molar on the left or right side, and then clenches the other molar. In this case, the detection sensor 103 detects the movement of the masseter muscle or temporalis muscle on either the left or right side each time user U clenches either the left or right molar. The detection sensor 103 may include the distinction between the left and right molars that were clenched and the time of detection of the clenching in the notification information for each detection. The detection sensor 103 then transmits the notification information to the smartphone 200 via the communication unit 104 each time it detects. In response, the detection unit 211 of the smartphone 200 detects user U's teeth clenching action based on the notification information received from the wearable device 100.

[0032] For example, if user U clenches their left molars and then their right molars, the detection sensor 103 transmits first notification information including that the clenched molars were on the left side and a first detection time, and then transmits second notification information including that the clenched molars were on the right side and a second detection time. The detection unit 211 then detects the clenching action upon receiving the first notification information and outputs the first notification information to the analysis unit 212. Subsequently, the detection unit 211 detects the clenching action upon receiving the second notification information and outputs the second notification information to the analysis unit 212. Alternatively, the detection unit 211 may detect multiple clenching actions upon receiving the first and second notification information and output the first and second notification information together to the analysis unit 212. Alternatively, if the detection sensor 103 detects multiple movements of the masseter or temporalis muscle within a certain period of time, it may send notification information to the smartphone 200 summarizing the distinction between the left and right molars that were clenched and the time of detection of the clenching in each detection. In this case, the detection unit 211 may detect multiple tooth clenching movements from the information contained in the received notification information and output the notification information to the analysis unit 212. Note that the order in which the molars are clenched (left and right) is not limited to this.

[0033] Then, the analysis unit 212 analyzes the difference in clenching time between the left and right teeth from the clenching motion detected in step S111 (S123). Specifically, the analysis unit 212 analyzes from the first and second notification information received from the detection sensor 103 whether the clenched molars are on the left or right side, and calculates the difference in detection times included in each notification information as the clenching time difference. In the above example, the analysis unit 212 extracts from the first notification information that the clenched molars are on the left side and the first detection time. The analysis unit 212 also extracts from the second notification information that the clenched molars are on the right side and the second detection time. In other words, the analysis unit 212 analyzes that the clenched teeth are different on the left and right sides in the first and second notification information. In that case, the analysis unit 212 calculates the difference between the first detection time and the second detection time as the clenching time difference.

[0034] Subsequently, the operation control unit 213 determines whether the difference in clenching time between the left and right sides is less than a threshold (S124). If it is determined in step S124 that the difference in clenching time is less than a threshold, the operation control unit 213 controls a first operation on the target device, i.e., the target application unit 220 (S131). On the other hand, if it is determined in step S124 that the difference in clenching time is greater than or equal to a threshold, the operation control unit 213 controls a second operation on the target device (S132). Therefore, this embodiment 3 can also achieve the same effects as embodiments 1 and 2 described above.

[0035] For example, suppose user U is riding a bicycle with a smartphone 200 fixed near the center of the handlebars, with the screen visible. The target application unit 220 displays a map image on the screen, such as the current location. In this case, user U cannot zoom in or out on the map image on the screen because they are riding a bicycle. Therefore, suppose user U clenches their left molars, and then their right molars, while riding the bicycle. Here, for example, suppose the threshold is 1 second, the first operation is to zoom in on the map, and the second operation is to zoom out the map. If the difference in clenching time between user U is less than the threshold, say 0.5 seconds, the operation control unit 213 controls the target application unit 220 to zoom in on the map. On the other hand, if the difference in clenching time between user U is greater than the threshold, say 2 seconds, the operation control unit 213 controls the target application unit 220 to zoom out the map. This allows user U to easily perform different controls on the target application unit 220 hands-free by adjusting the interval between clenching the left and right molars. Note that the order of clenching the left and right teeth, the threshold, and the first and second operations are merely examples.

[0036] Alternatively, instead of the difference in clenching time between the left and right sides, the length of the duration of continuous clenching of the teeth may be used. In this case, the detection sensor 103 may include the duration of clenching in either the left or right molar in the notification information. Alternatively, the detection sensor 103 may periodically detect clenching and, if clenching of teeth on the same side is detected consecutively, assume that teeth on the same side are continuously being clenched and include the duration in the notification information. Alternatively, the detection sensor 103 may periodically detect clenching and, as described above, transmit notification information including the distinction between left and right and the detection time each time it is detected. In this case, the detection unit 211 periodically detects clenching. The analysis unit 212 analyzes the notification information continuously received by the detection unit 211 and, if it indicates that teeth on the same side have been continuously clenched, it may calculate the difference in detection times included in each notification as the duration of continuous clenching of teeth on the same side. The operation control unit 213 then determines whether the duration is less than a threshold and controls either the first or second operation according to the determination result.

[0037] Alternatively, the difference in clenching time between the left and right sides may be combined with the length of time the teeth are clenched. In this case, a first threshold value for the clenching time difference and a second threshold value for the duration of clenching may be used. For example, the operation control unit 213 can control the operation using four different patterns based on the relationship between the clenching time difference and the first threshold value, and the relationship between the duration of clenching and the second threshold value.

[0038] Alternatively, the operation may be controlled by using either the first or second operation depending on the order in which the teeth are clenched (left and right). Furthermore, the order in which the teeth are clenched (left and right) may be combined with the difference in clenching time between the left and right teeth and the length of the duration of clenching. In this case, the operation control unit 213 can control the operation by using eight different patterns of operations based on the relationship between the difference in clenching time and the first threshold, the relationship between the duration of clenching and the second threshold, and the order in which the teeth are clenched (left and right).

[0039] (Embodiment 4) The control device according to this fourth embodiment modifies the clenching operation control based on the speed of the control device. Figure 5 is a block diagram showing the configuration of the molar clenching control system 1000a, which includes the control device according to the fourth embodiment. The molar clenching control system 1000a is the same as Figure 1 above, but with the smartphone 200 replaced by the smartphone 200a. In the following, redundant illustrations and explanations will be omitted as appropriate.

[0040] Smartphone 200a is a modified version of smartphone 200 in which the operation control application unit 210 and operation control unit 213 are replaced by operation control application unit 210a and operation control unit 213a, and a first acquisition unit 214 and a speed measurement unit 205 are added. The speed measurement unit 205 measures the speed at which smartphone 200 is moving. The speed measurement unit 205 may be, for example, a speed sensor or an acceleration sensor. Also, if smartphone 200a is mounted on a bicycle or the like, the speed measurement unit 205 can be said to measure the speed at which the bicycle or the like is moving. The speed measurement unit 205 may measure the speed periodically or at predetermined triggers. The speed measurement unit 205 may also store the measured speed and measurement time in association with each other in the storage unit 203. The speed measurement unit 205 may be implemented as a general-purpose or dedicated circuit implemented by a semiconductor device that can communicate wirelessly or wired with the speedometer. Alternatively, the speed measurement unit 205 may be implemented by a combination of the above-mentioned circuit and software that controls the speed measurement process.

[0041] The first acquisition unit 214 acquires the speed at which the smartphone 200, including the control device, is moving from the speed measurement unit 205 or the storage unit 203. The first acquisition unit 214 shall acquire the speed from the speed measurement unit 205 at least during the analysis processing by the analysis unit 212. The first acquisition unit 214 may also acquire the speed from the speed measurement unit 205 periodically or at predetermined triggers.

[0042] The operation control unit 213a controls a first operation on the target device if the speed is less than a threshold during the analysis processing by the analysis unit 212. On the other hand, the operation control unit 213a controls a second operation on the target device if the speed is greater than or equal to a threshold during the analysis processing by the analysis unit 212. Here, "during the analysis processing by the analysis unit 212" may refer to the timing when the analysis unit 212 performs analysis processing on the clenching motion. Alternatively, "during the analysis processing by the analysis unit 212" may refer to after the analysis results have been generated by the analysis processing. Alternatively, "during the analysis processing by the analysis unit 212" may refer to the time when the clenching motion is detected by the detection unit 211. In other words, the operation control unit 213a may determine whether the speed is less than a threshold when the clenching motion is detected.

[0043] Figure 6 is a flowchart showing the flow of the control method according to Embodiment 4. First, the detection unit 211 and the analysis unit 212 perform processing in the same manner as in steps S11 and S12 of Figure 2 above. Then, the first acquisition unit 214 acquires the speed at which the control device, i.e., the smartphone 200a including the operation control application unit 210, is moving from the speed measurement unit 205, etc. (S125). Then, the operation control unit 213a determines whether the speed acquired in step S125 is less than a threshold (S126). If it is determined in step S126 that the speed is less than a threshold, the operation control unit 213a controls a first operation on the target device, i.e., the target application unit 220 (S131). On the other hand, if it is determined in step S126 that the speed is greater than or equal to the threshold, the operation control unit 213a controls a second operation on the target device (S132).

[0044] For example, suppose user U is listening to music being played on the target application unit 220 of smartphone 200a using the earphones 102 of wearable device 100 while riding a bicycle or running. Therefore, user U has difficulty operating the smartphone 200a. The first operation is to skip the currently playing song to the next song, and the second operation is to launch a specific application. In this case, if user U clenches their right or left molars while stopped, such as at a traffic light, step S126 determines that the speed is below a threshold. Therefore, the operation control unit 213a controls the target application unit 220 that plays the music to skip the currently playing song to the next song. On the other hand, if user U clenches their right or left molars while riding a bicycle, step S126 determines that the speed is above a threshold. Therefore, the operation control unit 213a controls the target application unit 220 that plays the music to launch a specific application.

[0045] Alternatively, the first operation is to skip the currently playing song to the next song, and the second operation is to stop the currently playing song. The speed threshold is set to 20 km / h. In this case, if user U stops riding the bicycle at a traffic light, that is, when the speed is 0 km / h and clenches their right or left molars, the speed is less than the threshold, so the operation control unit 213a controls the target application unit 220 that plays the music to skip the currently playing song to the next song. On the other hand, if user U is riding the bicycle at a speed of 40 km / h and clenches their right or left molars, the speed is greater than or equal to the threshold, so the operation control unit 213a controls the target application unit 220 that plays the music to stop the currently playing song.

[0046] In this way, user U can control the operation of the target device by performing a teeth-clenching motion and using appropriate operations based on the speed of the device. Furthermore, the operation control unit 213a may use multiple patterns of operation to control the user based on the difference between the left and right teeth being clenched in Embodiment 2, the difference in clenching time between the left and right teeth in Embodiment 3, the length of the duration of continuous teeth clenching, or the order of the left and right teeth being clenched, in combination with the speed of the device. Therefore, Embodiment 4 can also achieve the same effects as Embodiments 1 to 3 described above.

[0047] (Embodiment 5) The control device according to this embodiment 5 modifies the clenching operation control based on the position information of the control device. Figure 7 is a block diagram showing the configuration of the molar clenching control system 1000b, which includes the control device according to embodiment 5. The molar clenching control system 1000b is the same as Figure 1 above, but with the smartphone 200 replaced by the smartphone 200b. In the following, redundant illustrations and explanations will be omitted as appropriate.

[0048] Smartphone 200b is a modified version of smartphone 200 in which the operation control application unit 210 and operation control unit 213 are replaced by the operation control application unit 210b and operation control unit 213b, and a second acquisition unit 215 and a location information measurement unit 206 are added. The location information measurement unit 206 acquires the current location information of smartphone 200b using wireless communication functionality and stores the acquired location information and acquisition time in association with each other in the storage unit 203. The location information measurement unit 206 is a device that acquires the current location information of smartphone 200b, and a circuit or software that controls the device. The location information measurement unit 206 acquires location information periodically or at predetermined triggers. Location information includes, but is not limited to, GPS (Global Positioning System) information.

[0049] The second acquisition unit 215 acquires location information of the smartphone 200b, including the control device, from the location information measurement unit 206 or the storage unit 203. The second acquisition unit 215 shall acquire location information from the location information measurement unit 206 at least during the analysis processing by the analysis unit 212. The second acquisition unit 215 may also acquire location information from the location information measurement unit 206 periodically or at predetermined triggers.

[0050] The operation control unit 213b controls a first operation on the target device when the position information is within a predetermined area during the analysis processing by the analysis unit 212. On the other hand, the operation control unit 213b controls a second operation on the target device when the position information is outside the predetermined area during the analysis processing by the analysis unit 212. Here, "during the analysis processing by the analysis unit 212" is the same as in Embodiment 4 above. The operation control unit 213b may also determine whether the position information is within the predetermined area when a clamping operation is detected.

[0051] Figure 8 is a flowchart showing the flow of the control method according to Embodiment 5. First, the detection unit 211 and the analysis unit 212 perform processing in the same manner as in steps S11 and S12 of Figure 2 above. Then, the second acquisition unit 215 acquires location information of the smartphone 200b, including the control device, i.e., the operation control application unit 210, from the location information measurement unit 206, etc. (S127). Then, the operation control unit 213b determines whether the location information acquired in step S127 is within a predetermined area (S128). If it is determined in step S128 that the location information is within the predetermined area, the operation control unit 213b controls a first operation on the target device, i.e., the target application unit 220 (S131). On the other hand, if it is determined in step S128 that the location information is outside the predetermined area, the operation control unit 213b controls a second operation on the target device (S132).

[0052] For example, suppose a predetermined area is defined as a tunnel, and a bicycle is equipped with a taillight. In this case, the target application unit 220 is capable of operations such as playing and stopping music, as well as turning the bicycle's taillight on or off. User U is listening to music being played on the target application unit 220 of smartphone 200a through the earphones 102 of the attached device 100 while riding the bicycle. Therefore, it is difficult for user U to operate smartphone 200b. The first operation is to turn on the bicycle's taillight, and the second operation is to skip the currently playing music to the next music. At this time, if user U clenches their teeth while riding the bicycle and the location information is within the area including the tunnel, the operation control unit 213b controls the target application unit 220 to turn on the bicycle's taillight. On the other hand, if user U clenches their teeth while riding a bicycle and the location information is outside the area including the tunnel, the operation control unit 213b controls the target application unit 220 to skip the currently playing song to the next song. Alternatively, if the second operation is to turn off the bicycle's taillight, and the location information is outside the area including the tunnel, the operation control unit 213b may control the target application unit 220 to turn off the bicycle's taillight.

[0053] Alternatively, a predetermined area may be defined as an intersection, with the first operation being to reduce the volume output to the earphones from the current volume, and the second operation being to increase the volume output to the earphones from the current volume. In this case, if user U clenches their teeth while riding a bicycle and their location information is within the area including the intersection, the operation control unit 213b controls the target application unit 220 to reduce the volume output to the earphones from the current volume. On the other hand, if user U clenches their teeth while riding a bicycle and their location information is outside the area including the intersection, the operation control unit 213b controls the target application unit 220 to increase the volume output to the earphones from the current volume.

[0054] In this way, user U can control the operation of the target device by performing a teeth-clenching motion and using appropriate operations based on the position information of the device. Furthermore, the operation control unit 213b may use multiple patterns of operation to control the user based on the combination of the difference between the left and right teeth being clenched in Embodiment 2, the difference in clenching time between the left and right teeth in Embodiment 3, the length of the duration of continuous teeth clenching, or the order of the left and right teeth being clenched, and the position information of the device. The smartphone 200b may also be equipped with the first acquisition unit 214 and speed measurement unit 205 of Embodiment 4. The operation control unit 213b may also have the functions of the operation control unit 213a of Embodiment 4. In these cases, the operation control unit 213b may use multiple patterns of operation to control the user based on the combination of the speed and position information of the device. Therefore, Embodiment 5 can also achieve the same effects as Embodiments 1 to 4 described above.

[0055] (Embodiment 6) The control device according to this embodiment 6 is built into a wearable device, and the device to be controlled is a smartphone or the like. Figure 9 is a block diagram showing the configuration of the molar clenching control system 2000 including the control device according to embodiment 6. The molar clenching control system 2000 comprises a wearable device 100c and a smartphone 200c. The wearable device 100c is the wearable device 100 of Figure 1 with a storage unit 105 and a control unit 106 added. The smartphone 200c is the smartphone 200 of Figure 1 with the operation control application unit 210 removed. In the following, redundant illustrations and explanations will be omitted as appropriate.

[0056] The storage unit 105 includes, for example, a non-volatile storage device such as flash memory and a memory such as RAM, i.e., a volatile storage device. The storage unit 105 stores computer programs and various data for operating the wearable device 100c. The program includes, for example, an operation control application program that implements the processing of the control method according to this embodiment. The storage unit 105 may also include the basic program of the wearable device 100c.

[0057] The control unit 106 is a control device that controls each component of the mounting device 100c. The control unit 106 may be, for example, a processor equivalent to the control unit 204. For example, the control unit 106 loads various programs from the storage unit 105 into memory and executes the programs. In this way, the control unit 106 realizes the functions of the operation control application unit 110. Note that some or all of the operation control application unit 110, including the detection unit 111, analysis unit 112, and operation control unit 113, which will be described later, may be realized by hardware other than the control unit 106, for example, by a general-purpose or dedicated circuit implemented in a semiconductor device.

[0058] The operation control application unit 110 is an example of a control device according to this embodiment. The smartphone 200c, which includes the target application unit 220, is an example of a target device that is the target of operation control according to this embodiment. In other words, this embodiment shows a case where the control device and the target device are different hardware. Furthermore, the target device may be a device for controlling the turning on or off of a bicycle's taillight.

[0059] The operation control application unit 110 comprises a detection unit 111, an analysis unit 112, and an operation control unit 113. Each of the detection unit 111, analysis unit 112, and operation control unit 113 has the same functions as the detection unit 211, analysis unit 212, and operation control unit 213 in Figure 1. However, the detection unit 111 detects the user U's teeth clenching action by acquiring notification information from the detection sensor 103. The operation control unit 113 controls operations on the target application unit 220 via the communication unit 104 based on the analysis processing by the analysis unit 112.

[0060] Furthermore, the control method according to this embodiment is the same as that shown in Figure 2. The operation control application unit 110 may also have the same functions as those of Embodiments 2 or 3. The mounting device 100c may also have the same configuration and functions as those of Embodiments 4 or 5. Therefore, this Embodiment 6 can also achieve the same effects as Embodiments 1 to 5 described above.

[0061] (Other embodiments) Generally, when making a phone call on a smartphone, users often hold the phone against one of their cheeks, with the top of the phone near their ear and the bottom near their mouth. If they want to perform any operation on the smartphone during a call, they need to touch the screen. However, in the aforementioned phone-making position, the user cannot see the screen to perform the operation. Therefore, to perform an operation during a call, the user has to move the phone away from their face, interrupting the call. Smartphones often have several buttons on the side. Therefore, users can use these buttons to operate the phone without moving it away from their face while on a call. However, these buttons are generally assigned only to functions such as volume control, making it difficult for users to perform operations other than their assigned functions while continuing a call.

[0062] Therefore, the technology disclosed herein may be applied to the detection of teeth clenching motion using the electrostatic sensor of a touch panel while making a call on a smartphone. That is, when the touch panel of a smartphone is in close contact with the user's cheek while the user is making a call, the electrostatic sensor of the touch panel can detect the teeth clenching motion, which is caused by the movement of the muscles in the cheek area touching the smartphone's touch panel. Thus, even if user U is not wearing the wearable device 100 as shown in Figure 1 on their head, the same functions as in embodiments 1 to 5 can be realized by detecting the teeth clenching motion with the electrostatic sensor.

[0063] Specifically, the operation control application unit 210 turns on the electrostatic sensor of the input / output unit 202 while user U is making a call on their smartphone 200. When the electrostatic sensor detects user U clenching their molars during the call, it outputs notification information to the detection unit 211. Subsequently, the detection unit 211, analysis unit 212, and operation control unit 213 perform processing in the same manner as in the above embodiment.

[0064] For example, by setting the operation to be controlled to a pre-configured arbitrary operation, user U can perform the operation hands-free by clenching either their left or right molars during a call. Furthermore, for example, the first operation could be the start of recording, and the second operation could be the switch operation for incoming call waiting. In this case, user U can start recording during a call by clenching their right molars. On the other hand, user U can switch to incoming call waiting during a call by clenching their left molars. In this way, by repurposing the electrostatic sensor of the smartphone's touch panel to detect teeth clenching, the technology described in this disclosure can be realized by adding software that implements the above control method without adding a sensor device. Therefore, the cost of introducing the technology described in this disclosure can be reduced, and it can be easily implemented. In addition, since the screen naturally comes into contact with the cheek during a smartphone call, the technology described in this disclosure can be implemented without imposing any special burden on the user, such as forcing them to perform special operations or hold the phone in a specific way.

[0065] Although the above embodiments were described as hardware configurations, the invention is not limited thereto. This disclosure can also be implemented by having the CPU execute computer programs to perform any desired processing.

[0066] In the examples described above, the program includes a set of instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more of the functions described in the embodiments. The program may be stored on a non-temporary computer-readable medium or a physical storage medium. Examples, but not limited to, include random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technologies, CD-ROM, digital versatile disc (DVD), Blu-ray® disc or other optical disc storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage devices. The program may be transmitted over a temporary computer-readable medium or a communication medium. Examples, but not limited to, include temporary computer-readable medium or a communication medium that includes electrically, optically, acoustically or otherwise propagating signals.

[0067] Although the present disclosure has been described above with reference to embodiments, the present disclosure is not limited to the embodiments described above. Various modifications to the structure and details of the present disclosure are possible, as can be understood by those skilled in the art within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0068] Each drawing is merely illustrative to illustrate one or more embodiments. Each drawing may be associated with one or more other embodiments rather than with only one specific embodiment. As those skilled in the art will understand, various features or steps described with reference to any one drawing can be combined with features or steps shown in one or more other drawings, for example, to create embodiments not explicitly shown or described. Not all features or steps shown in any one drawing to illustrate an exemplary embodiment are necessarily required, and some features or steps may be omitted. The order of steps shown in any of the drawings may be changed as appropriate. [Explanation of Symbols]

[0069] 1000 Back Tooth Clenching Control System U User 100 Wearable Devices 101 Mike 102 Earphones 103 Detection Sensor 104 Communications Department 200 Smartphones 201 Communications Department 202 Input / output section 203 Storage section 204 Control Unit 110, 210 Operation Control Application Unit 111, 211 Detection Unit 112, 212 Analysis Department 113, 213 Operation Control Unit 220 Target Application Section

Claims

1. A detection unit that detects the clenching motion of teeth, An analysis unit performs analysis on the detected biting motion, An operation control unit that controls operations on the target device based on the analysis process, A control device equipped with the following features.

2. The results of the analysis process indicate whether the clenching action is on the right or left side of the tooth. The operation control unit, When the clenching action indicates the right side of the teeth, the first operation on the target device is controlled. When the clenching action indicates the left side of the teeth, control the second operation on the target device. The control device according to claim 1.

3. The results of the analysis process show the time difference between the right and left sides of the tooth during the clenching motion. The operation control unit, If the aforementioned time difference is smaller than the threshold, the first operation on the target device is controlled. If the time difference is greater than or equal to the threshold, control the second operation on the target device. The control device according to claim 1.

4. The control device further comprises a first acquisition unit for acquiring the speed at which it moves, The operation control unit, during the analysis process, If the speed is less than the threshold, the first operation on the target device is controlled. If the speed is equal to or greater than the threshold, control the second operation on the target device. The control device according to claim 1.

5. The device further comprises a second acquisition unit for acquiring position information of the control device, The operation control unit, during the analysis process, If the position information is within a predetermined area, the first operation on the target device is controlled. If the position information is outside the predetermined area, control the second operation on the target device. The control device according to claim 1 or 4.

6. Computers A detection step for detecting teeth clenching motion, The analysis step involves performing an analysis on the detected clenching motion, An operation control step that controls operations on the target device based on the analysis process, A control method that performs this action.

Images