Wearable device, input reception system, input reception method, and program

Abstract

This invention provides a wearable device, an input reception system, an input reception method, and a program that can prevent user errors even while driving. [Solution] The wearable terminal 2 includes a first processor which comprises a sensor unit 210 that outputs a signal corresponding to a user twisting their forearm while grasping a rod-shaped object with their fingers, an action determination unit 241 that acquires the signal output by the sensor unit 210 and determines whether the user has performed a forearm twisting motion based on the acquired signal, and a processing execution unit 242 that executes processing based on the twisting motion determined by the action determination unit 241.

Description

Technical Field

[0004] ,

[0006] , , , , , ,

[0005] , , ,

[0003] , ، , ,

[0001] The present invention relates to a wearable terminal, an input reception system, an input reception method, and a program.

Background Art

[0002] Patent Document 1 describes a wrist-worn device that detects wrist gestures (e.g., flexion or extension). The gesture is detected using a sensor within a wristband or behind a face member of the wrist-worn device. A specific gesture is identified from a library based on analysis of the sensor signal. The function activated by the gesture can be executed on the wrist-worn device or on another device communicating with the wrist-worn device.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] The wrist-worn device described in Cited Document 1 detects wrist gestures, but there is a problem that in a situation where the hand cannot be released from the handle for safety, such as when driving a vehicle such as a motorcycle, a gesture that allows the wrist to move freely cannot be used.

[0005] The present invention has been made in view of the above problems, and an object thereof is to provide a wearable terminal, an input reception system, an input reception method, and a program that can use a specific operation as a gesture input operation even when the user is driving.

Means for Solving the Problems

[0006] To achieve the above objective, one embodiment of the wearable terminal according to the present invention is: A sensor unit that outputs a signal corresponding to the user's twisting motion of the forearm while grasping a rod-shaped object with their fingers, The system includes a first processor which includes: an action determination unit that acquires a signal output by the sensor unit and determines whether the user has performed a twisting motion of the forearm based on the acquired signal; and a processing execution unit that executes a process based on the twisting motion determined by the action determination unit. It is characterized by the following: [Effects of the Invention]

[0007] According to the present invention, it is possible to provide a wearable terminal, an input reception system, an input reception method, and a program that enable users to use specific actions as gesture input actions even while driving. [Brief explanation of the drawing]

[0008] [Figure 1] A block diagram showing the configuration of the input reception system according to Embodiment 1. [Figure 2] A diagram showing a wearable device according to Embodiment 1, worn on the user's wrist. [Figure 3] This figure shows a user wearing the wearable device of Embodiment 1 performing a twisting motion of their forearm. [Figure 4] A diagram showing a message displayed on the second interface of the communication terminal in Embodiment 1. [Figure 5] A flowchart of the input reception process performed by the wearable terminal of Embodiment 1. [Figure 6] A flowchart of the execution decision process performed by the wearable terminal of Embodiment 2. [Modes for carrying out the invention]

[0009] (Embodiment 1) The input reception system 1 according to Embodiment 1 will be described with reference to the drawings. In the drawings, the same or corresponding parts are denoted by the same reference numerals. The input reception system 1 according to Embodiment 1 is a system that is attached to a user who is driving a motorcycle and performs processing according to the user's actions.

[0010] Figure 1 is a block diagram showing the configuration of the input reception system 1 according to Embodiment 1. As shown in Figure 1, the input reception system 1 comprises a wearable terminal 2 and a communication terminal 3.

[0011] The wearable terminal 2 is a terminal device worn on the user's wrist that communicates with the communication terminal 3 according to the user's actions. The wearable terminal 2 comprises a sensor unit 210, a first communication unit 220, a first interface unit 230, a first control unit 240, and a first storage unit 250. The wearable terminal 2 may include, but is not limited to, a wristwatch or a smartwatch.

[0012] Figure 2 shows a wearable terminal 2 worn on a user's wrist. As shown in Figure 2, the wearable terminal 2 comprises a housing 260 that houses a sensor unit 210, a first communication unit 220, and a first control unit 240, and a band 270 connected to the housing 260 that can be wrapped around the user's wrist to secure the housing 260. When the wearable terminal 2 is worn on the user's wrist, the direction parallel to the user's forearm is described as the x-axis direction, the direction perpendicular to the x-axis direction and parallel to the plane containing the user's palm is described as the y-axis direction, and the direction perpendicular to the plane containing the user's palm is described as the z-axis direction.

[0013] Returning to Figure 1, the sensor unit 210 includes a gyro sensor that measures the angular velocity of the wearable terminal 2. The sensor unit 210 transmits a signal indicating the measured angular velocity value to the first control unit 240.

[0014] The first communication unit 220 includes a communication device that communicates with the communication terminal 3 via a second communication unit 320 described later. The first communication unit 220 includes, for example, a wireless communication interface and communicates using BLE (Bluetooth (registered trademark) Low Energy), but is not limited thereto.

[0015] The first interface unit 230 is a user interface including buttons and switches. The first interface unit 230 receives an instruction from the user including turning on / off the power of the wearable terminal 2 and starting or ending the reception processing of input by an operation, and transmits a signal indicating the received instruction to the first control unit 240.

[0016] The first control unit 240 is connected to the sensor unit 210, the first communication unit 220, and the first interface unit 230 via a bus, and includes a processor that executes a program stored in the first storage unit 250 to perform processing. The first control unit 240 includes an operation determination unit 241 and a processing execution unit 242. The first control unit 240 may include, for example, a CPU (Central Processing Unit), but is not limited thereto.

[0017] When the first interface unit 230 receives an input indicating the start of reception of an input by the user's operation, the operation determination unit 241 acquires a signal indicating the value of the angular velocity measured from the sensor unit 210. The operation determination unit 241 determines the operation performed by the user based on the signal indicating the value of the angular velocity acquired from the sensor unit 210. For example, when acquiring a signal indicating that the angular velocity about the x-axis has been measured from the sensor unit 210, the operation determination unit 241 determines that the user has performed an operation of twisting the forearm. Further, the operation determination unit 241 determines the direction, number of times, and interval of the operation in which the user twists the forearm.

[0018] FIG. 3 is a diagram showing a state in which a user wearing the wearable terminal 2 performs an operation of twisting the forearm, and the left hand of the user wearing the wearable terminal 2 is illustrated from the tip side. As shown in FIG. 3, when the user performs an operation of twisting the forearm as indicated by the arrow, the sensor unit 210 measures a change in the angular velocity about the x-axis, and the motion determination unit 241 determines that the user has performed an operation of twisting the forearm based on the signal acquired from the sensor unit 210.

[0019] Returning to FIG. 1, the processing execution unit 242 acquires a signal regarding the user's motion determined by the motion determination unit 241, and based on the correspondence between the user's motion stored in the first storage unit 250 and the processing executed by the processing execution unit 242, executes the processing corresponding to the user's motion determined by the motion determination unit 241. The processing execution unit 242 can execute, for example, a process of causing the communication terminal 3 to select a message, a process of determining or canceling a selection, a process of causing the communication terminal 3 to transmit a selected message to another terminal, and a process of causing the communication terminal 3 to transmit a read receipt of a received message to another terminal. In other words, the processing execution unit 242 can execute a process of transmitting information corresponding to the user's motion determined by the motion determination unit 241 to the communication terminal 3. The processing execution unit 242 can execute a process of storing the time when the motion was performed in the first storage unit 250. The processing executed by the processing execution unit 242 is not limited to these.

[0020] The first storage unit 250 includes a storage device that stores a program executed by the first control unit 240 and the correspondence between the user's motion and the processing executed by the processing execution unit 242. The first storage unit 250 may include a RAM (Random Access Memory), a flash memory, an EPROM (Erasable Programmable ROM), or an EEPROM (Electrically Erasable Programmable ROM), but is not limited thereto.

[0021] Communication terminal 3 is a terminal device capable of communicating with other communication terminals. Wearable terminal 2 comprises a position sensor 310, a second communication unit 320, a second interface unit 330, a second control unit 340, a second storage unit 350, and a third communication unit 360. Communication terminal 3 may include, but is not limited to, a mobile phone, a smartphone, or a tablet.

[0022] The position sensor 310 includes a sensor for measuring the position of the communication terminal 3. The position sensor 310 transmits a signal indicating the measured position of the communication terminal 3 to the second control unit 340. The position sensor 310 may include, but is not limited to, a GPS receiver that measures position using GPS (Global Positioning System).

[0023] The second communication unit 320 includes a communication device that communicates with the wearable terminal 2 via the first communication unit 220. The second communication unit 320 includes, for example, a wireless communication interface and communicates using BLE, but is not limited to this.

[0024] The second interface unit 330 is a user interface that includes buttons, switches, display devices, and a touch panel. The second interface unit 330 receives instructions from the user, including turning the power of the communication terminal 3 on and off, and transmits a signal indicating the received instruction to the second control unit 340.

[0025] The second control unit 340 is connected to the position sensor 310, the second communication unit 320, and the second interface unit 330 via a bus, and is a circuit that executes and processes a program stored in the second storage unit 350. The second control unit 340 may, but is not limited to, a CPU.

[0026] When the second control unit 340 receives information (instructions) from the wearable terminal 2 via the second interface unit 330, it performs processing based on the transmitted information. For example, if it receives an instruction from the wearable terminal 2 to select a message, it selects a message according to the instruction and controls the second interface unit 330 to display the selected message to the user. The second control unit 340 selects a message from among multiple messages stored in the second storage unit 350, such as messages containing standard phrases like "Increase / decrease pace," "Shall we take a break?", "You've got a flat tire," "You're running low on gas," and "Yes / No."

[0027] Figure 4 shows the messages displayed on the second interface unit 330 of the communication terminal 3. As shown in Figure 4, the second control unit 340 controls the second interface unit 330 to display multiple messages stored in the second storage unit 350, in accordance with instructions transmitted from the wearable terminal 2. The second control unit 340 also performs the process of selecting one or more of the displayed messages and transmitting the selected messages to other terminals, in accordance with instructions transmitted from the wearable terminal 2.

[0028] Returning to Figure 1, when the second control unit 340 receives an instruction from the wearable terminal 2 to send a selected message to another terminal, it controls the third communication unit 360 to send the selected message to the other terminal in accordance with the instruction.

[0029] The second control unit 340 may acquire a signal indicating the position of the communication terminal 3 from the position sensor 310 and store it in the second storage unit 350 in association with the time the position signal was acquired (second time). In this way, the second control unit 340 stores the movement path of the communication terminal 3, i.e., the user's movement path, in the second storage unit 350. When the processing execution unit 242 of the wearable terminal 2 executes a process to store the time when the user performed an action in the first storage unit 250, the second control unit 340 may acquire the time when the user performed an action (first time) stored in the first storage unit 250, compare the acquired first time with the second time stored in the second storage unit 350 and the position of the communication terminal 3 at the second time to identify the user's position at the first time, i.e., the position where the user performed an action, and store it in the second storage unit 350. The second control unit 340 may also present the user with location-related information, including place names, buildings, shops, scenery, and events at the identified location.

[0030] When the processing unit 242 of the wearable terminal 2 executes a process to store the time when the user performed an action in the first storage unit 250, the second control unit 340 may obtain the first time stored in the first storage unit 250, compare it with the video data or audio data recorded while the user's input was being received, identify the video or audio recorded at the first time, and present it to the user. The video data or audio data may be recorded by the communication terminal 3, or it may be recorded by another device and transferred to the communication terminal 3.

[0031] The second storage unit 350 includes a storage device that stores programs executed by the second control unit 340, candidate messages to be sent to other terminals, and the user's travel path. The second storage unit 350 may include, but is not limited to, RAM, flash memory, EPROM, or EEPROM.

[0032] The third communication unit 360 includes a communication device that communicates with other terminal devices or other equipment, including base stations. The third communication unit 360 includes, for example, a wireless communication interface and communicates using a mobile communication system, but is not limited to this.

[0033] Figure 5 is a flowchart of the input reception process performed by the wearable terminal 2 of Embodiment 1. The input reception process will be explained with reference to the flowchart in Figure 5. Here, the motion determination unit 241 is described as determining whether the user has performed a twisting motion of the forearm, but this is just one example, and the motion determination unit 241 can determine any user motion that can be determined based on the values ​​measured by the sensor unit 210.

[0034] When the input acceptance process starts, the operation determination unit 241 acquires a signal from the sensor unit 210 indicating the value of the angular velocity measured by the sensor unit 210 (step S101).

[0035] When a signal indicating the angular velocity value is obtained, the motion determination unit 241 determines whether the user has performed a twisting motion of the forearm based on the signal indicating the angular velocity value obtained from the sensor unit 210 (step S102). If it is determined that the user has not performed a twisting motion of the forearm (step S102: NO), the process returns to step S101.

[0036] If the system determines that the user has performed a twisting motion of the forearm (step S102: YES), the motion determination unit 241 determines the direction, number of times, and interval of the twisting motion of the user's forearm (step S103).

[0037] When the motion determination unit 241 determines the direction, number of times, and interval at which the user twists their forearm, the processing execution unit 242 executes the processing corresponding to the direction, number of times, and interval at which the user twists their forearm, as determined by the motion determination unit 241, based on the correspondence between user actions and processing stored in the first storage unit 250 (step S104).

[0038] When the processing execution unit 242 executes the processing, the operation determination unit 241 determines whether the first interface unit 230 has received an input indicating the end of the input reception process (step S105). If it is determined that the input has not been received (step S105: NO), the process returns to step S101. If it is determined that the input has been received (step S105: YES), the input reception process ends.

[0039] By having the above configuration and performing input reception processing, the input reception system 1 according to Embodiment 1 can execute processing using the result of determining whether a specific gesture is present, even when the user is driving. In particular, even in situations where both hands cannot be taken off the handlebars for safety reasons, such as when driving a motorcycle, the action of twisting the forearm while holding the handlebars (while gripping a rod-shaped object) can be used as a gesture input action. Furthermore, by using the action of twisting the forearm while holding the handlebars as a gesture input action, even in situations where the arm or wrist is frequently moved while driving a vehicle, including a motorcycle, it is possible to suppress the misidentification of driving actions other than the above-mentioned forearm twisting action as a gesture input action, thereby preventing erroneous input.

[0040] The input reception system 1 according to Embodiment 1 can accurately detect user actions by distinguishing them from driving operations by detecting actions that are easily distinguishable from actions normally used in driving a mobile vehicle operated by a user, particularly two-wheeled vehicles including motorcycles and bicycles.

[0041] The input reception system 1 according to Embodiment 1 detects actions that do not interfere with the driving operation of the mobile vehicle being driven by the user, thereby enabling the user to easily and safely perform input even while the mobile vehicle is in motion.

[0042] Attempting to communicate by voice while riding requires a dedicated earphone and microphone attached to the helmet, and wind noise can make communication difficult. The input reception system 1 according to Embodiment 1 can enable non-voice communication by detecting and processing the user's actions and facilitating communication with other terminals.

[0043] (Embodiment 2) The input reception system 1 according to Embodiment 2 will be described with reference to the drawings. The input reception system 1 according to Embodiment 2 determines whether or not to execute a process based on the user's status.

[0044] The sensor unit 210 of Embodiment 2 includes a speed sensor for measuring the speed of the wearable terminal 2, an acceleration sensor for detecting acceleration, a position sensor for measuring position, or an impact sensor for detecting applied impact. The sensor unit 210 transmits a signal indicating the value of the measured physical quantity to the first control unit 240.

[0045] When the processing execution unit 242 obtains a signal indicating the user's action as determined by the action determination unit 241, it obtains a signal from the sensor unit 210 indicating the value of a physical quantity measured by the sensor unit 210, and based on the obtained signal, it determines whether the wearable terminal 2 is moving, that is, whether the user wearing the wearable terminal 2 is moving (driving). If it determines that the user is not moving, the processing execution unit 242 executes the process in the same manner as in Embodiment 1. If it determines that the user is moving, the processing execution unit 242 stops (prohibits) the execution of the process.

[0046] The processing execution unit 242 may execute processes stored in the first storage unit 250 even if the user is on the move. For example, the process of sending a message from the communication terminal 3 to another terminal informing the user of a flat tire, accident, or running out of fuel may be executed even if the user is on the move.

[0047] The processing execution unit 242 may perform processing when it obtains a detection result indicating a user accident, including the detection of a sudden deceleration by the acceleration sensor of the sensor unit 210 or the detection of an impact by the impact sensor. For example, when it obtains a detection result indicating a user accident, it may perform processing to send a message from the communication terminal 3 to another terminal informing them that an accident has occurred, and to notify the police, fire department, or insurance company.

[0048] Figure 6 is a flowchart of the execution decision process performed by the wearable terminal 2 of Embodiment 2. The execution decision process will be described with reference to the flowchart in Figure 6. The execution decision process may be performed between steps S103 and S104 of the flowchart in Figure 5.

[0049] When the execution decision process is started, the processing execution unit 242 acquires a signal from the sensor unit 210 (step S201).

[0050] Upon receiving a signal, the processing unit 242 determines whether the user is moving based on the received signal (step S202). If it determines that the user is not moving (step S202: NO), the process proceeds to step S204, which will be described later.

[0051] If it is determined that the user is on the move (step S202: YES), the processing execution unit 242 determines whether the processing should be performed even if the user is on the move (step S203).

[0052] If the process should be executed even if the user is on the move (step S203: YES), the process execution unit 242 determines to execute the process (step S204) and terminates the execution determination process.

[0053] If the process does not need to be executed even if the user is on the move (step S203: NO), the process execution unit 242 determines to stop the execution of the process (step S205) and terminates the execution determination process.

[0054] By having the above configuration and performing input reception processing and execution decision processing, the input reception system 1 according to Embodiment 2 achieves the same effects as the input reception system 1 according to Embodiment 1.

[0055] The input reception system 1 according to Embodiment 2 executes processing only when it determines that the user is not driving, thereby preventing the user from attempting to input by motion while driving and encouraging the user to input by motion more safely.

[0056] The input reception system 1 according to Embodiment 2 executes some processing even when the user is on the move, so that, for example, in the event of a problem, it can quickly transmit the information to another terminal and contact the user's companions, thereby enabling safer travel.

[0057] The input reception system 1 according to Embodiment 2 executes processing when it detects a user accident, allowing for rapid notification in the event of, for example, a traffic accident, thereby providing greater protection to the user.

[0058] (modified version) Although embodiments of the present invention have been described above, these embodiments are merely examples, and the scope of application of the present invention is not limited thereto. In other words, the embodiments of the present invention can be applied in various ways, and all embodiments fall within the scope of the present invention.

[0059] The sensor unit 210 includes a gyro sensor for measuring the angular velocity of the wearable terminal 2, but is not limited to this. It may also include any sensor that can detect user movements and output signals corresponding to those movements.

[0060] The motion determination unit 241 determines whether the user has performed a forearm twisting motion and determines the direction, number of times, and interval of the forearm twisting motion, but is not limited to this. It may also determine other actions that the user can perform while gripping a rod-shaped object, including the handlebars of a two-wheeled vehicle, with their fingers, such as the user clenching a fist or bending their wrist. It is desirable that the actions performed by the user have little impact on driving, but is not limited to this.

[0061] The sensor unit 210 in Embodiment 2 includes, but is not limited to, a speed sensor, an acceleration sensor, a position sensor, or an impact sensor. It may also include any sensor that outputs a signal capable of determining whether the user is moving or not.

[0062] Furthermore, while it is possible to provide terminals pre-configured to realize the functions according to the present invention, existing terminals can also be made to function as terminals according to the present invention by applying a program. That is, by applying a program to realize the functions of the terminals exemplified in the embodiments and modifications, the existing terminals can be made to function as terminals according to the present invention by being executed by the CPU or the like that controls them.

[0063] Furthermore, the method of applying such a program is arbitrary. The program can be stored and applied on a computer-readable storage medium such as a flexible disk, CD (Compact Disc)-ROM, DVD (Digital Versatile Disc)-ROM, or memory card. In addition, the program can be superimposed on a carrier wave and applied via a communication medium such as the Internet. For example, the program can be posted and distributed on a bulletin board system (BBS) on a communication network. The program can then be launched and executed under the control of the OS (Operating System), just like any other application program, to perform the above-mentioned processing.

[0064] Although preferred embodiments of the present invention have been described above, the present invention is not limited to these specific embodiments, and the present invention includes the invention described in the claims and its equivalents. [Explanation of Symbols]

[0065] 1...Input reception system, 2...Wearable terminal, 3...Communication terminal, 210...Sensor unit, 220...First communication unit, 230...First interface unit, 240...First control unit, 241...Motion determination unit, 242...Processing execution unit, 250...First storage unit, 260...Housing, 270...Band, 310...Position sensor, 320...Second communication unit, 330...Second interface unit, 340...Second control unit, 350...Second storage unit, 360...Third communication unit.

Claims

1. A sensor unit that outputs a signal corresponding to the user's twisting motion of the forearm while grasping a rod-shaped object with their fingers, The system includes a first processor which includes: an action determination unit that acquires a signal output by the sensor unit and determines whether the user has performed a twisting motion of the forearm based on the acquired signal; and a processing execution unit that executes a process based on the twisting motion determined by the action determination unit. Wearable devices.

2. The sensor unit outputs a signal that can determine whether the user is moving. The processing execution unit acquires the signal output by the sensor unit, and if it determines based on the acquired signal that the user is not moving, it identifies a process based on the twisting motion determined by the motion determination unit, and allows the execution of the identified process. The wearable device according to claim 1.

3. The sensor unit outputs a signal that can determine whether the user is moving or not. If the processing execution unit determines that the user is moving based on the signal output by the sensor unit, it identifies a process based on the twisting motion determined by the motion determination unit, and prohibits the execution of the identified process. The wearable device according to claim 2.

4. The processing execution unit, when it determines that the user is moving based on the signal output by the sensor unit, and when it determines that the processing identified based on the twisting motion determined by the motion determination unit is a predetermined processing, permits the execution of the predetermined processing. The wearable device according to claim 2.

5. The aforementioned rod-shaped object is the steering wheel of the vehicle. A wearable device according to any one of claims 1 to 4.

6. The aforementioned rod-shaped object is the handlebar of a two-wheeled vehicle. A wearable device according to any one of claims 1 to 4.

7. The first communication unit communicates with the communication terminal via the second communication unit, A sensor unit that outputs a signal corresponding to the user's twisting motion of the forearm while grasping a rod-shaped object with their fingers, The first processor includes: an action determination unit that acquires the signal output by the sensor unit and determines whether the user performed a twisting motion of the forearm based on the signal; and a processing execution unit that performs a process to transmit information corresponding to the action determination unit's determination that the twisting motion was performed to the communication terminal via the first communication unit. Wearable devices and The second communication unit communicates with the wearable terminal via the first communication unit, The system includes a second processor that, when it determines that it has received the information from the wearable terminal via the second communication unit, executes processing based on the information, Equipped with a communication terminal, Input reception system.

8. When the second processor determines that it has received the information, it executes a process to select a message or a process to send a message. The input reception system according to claim 7.

9. The aforementioned communication terminal further includes a position sensor that acquires a signal indicating the location of the communication terminal, The aforementioned information includes information of a first time when the operation determination unit determined that the twisting operation was performed. The second processor records a position signal acquired by the position sensor in association with information of a second time when the signal was acquired, and performs a process to store the first time information and the position signal in association with each other based on the first time information, the position signal, and the second time information received from the wearable terminal via the second communication unit. The input reception system according to claim 7.

10. The system outputs a signal corresponding to the user's twisting motion of the forearm while grasping a rod-shaped object with their fingers. Based on the output signal, it is determined whether the user performed a twisting motion of the forearm. The process is executed based on the determined twisting motion. Input submission method.

11. On the computer, The sensor unit, which outputs a signal corresponding to the user's twisting motion of the forearm while grasping a rod-shaped object with their fingers, acquires the output signal. Based on the acquired signal, determine whether the user performed a twisting motion of the forearm. The system executes a process based on the determined twisting motion. program.

Images