Operation command control device, operation command control method, and operation command control program

Abstract

An operation command control device according to one aspect of the present invention is provided with a detection unit, a duration switching unit, and an operation command output unit. The detection unit uses a plurality of sensors to perform movement detection with respect to a plurality of body parts of a user including a plurality of first body parts associated with a plurality of operation commands and a second body part different from the plurality of first body parts. The duration switching unit, when it is detected that the second body part has moved, switches a duration. The operation command output unit, when it is detected that any one of the plurality of first body parts has moved, outputs an operation command associated with a first body part for which movement has been detected only for the duration.

Description

Operation command control device, operation command control method, and operation command control program

[0001] The present invention relates to an operation interface for people with severe physical disabilities.

[0002] For people with severe physical disabilities, such as those with amyotrophic lateral sclerosis (ALS), it is difficult to use common operating interfaces such as keyboards and joysticks. For this reason, operating interfaces that utilize the fine movements of parts of the body that still have muscle strength, such as the neck and fingertips, are used.

[0003] For example, Patent Document 1 discloses a mechanism that measures myoelectric potentials using a surface electromyographic sensor attached to a body part including muscles, detects the movement of the body part when the measured value of the myoelectric potential exceeds a predetermined threshold, and performs operation by inputting an operation command corresponding to the body part.

[0004] By utilizing this type of operation, it is expected that complex operations such as controlling virtual avatars and games can be performed in addition to text input.

[0005] Japanese Patent Application Publication No. 2015-2939

[0006] Operating a virtual avatar or game requires complex operations that switch between continuous and discrete command inputs, which poses the following challenges for people with severe physical disabilities:

[0007] When using the mechanism disclosed in Patent Document 1 in which an operation command is sent when a movement is detected, the target user's muscle strength and muscle endurance are extremely reduced, making it difficult for them to perform operations that require continuous command input (in this case, maintaining force).

[0008] In addition, to reduce the burden on the user, a method could be considered in which continuous command input is performed when a single motion is detected and the input is stopped when another motion is detected, but this makes it difficult to perform detailed operations that require discrete command input.

[0009] The present invention aims to provide a technology for an operation interface for people with severe physical disabilities that can reduce the burden on users while also allowing them to perform complex operations.

[0010] An operation command control device according to one aspect of the present invention includes a detection unit, a duration switching unit, and an operation command output unit. The detection unit uses multiple sensors to detect motions of multiple body parts of a user, including multiple first body parts associated with multiple operation commands and a second body part different from the multiple first body parts. The duration switching unit switches the duration when it detects that the second body part has moved. The operation command output unit outputs an operation command associated with the first body part whose motion has been detected for the duration when it detects that any of the multiple first body parts has moved.

[0011] According to the present invention, it is possible to provide a technology for an operation interface for people with severe physical disabilities that can reduce the burden on users while also allowing them to perform complex operations.

[0012] Fig. 1 is a block diagram showing the functional configuration of an operation command control system according to a first embodiment. Fig. 2 is a block diagram showing the hardware configuration of the operation command control system according to the first embodiment. Fig. 3 is a flowchart showing an operation command control method according to the first embodiment. Fig. 4 is a block diagram showing the functional configuration of an operation command control system according to a second embodiment. Fig. 5 is a block diagram showing the hardware configuration of the operation command control system according to the second embodiment. Fig. 6 is a flowchart showing an operation command control method according to the second embodiment.

[0013] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0014] The embodiments relate to a technology for controlling the duration of an operation command input in an operation interface for people with severe physical disabilities. The duration indicates the length of time for outputting an operation command corresponding to a single input action when a user operates a device using a biosensor or a button. For example, in a game in which a character is moved by pressing a button, when the user presses the button once, the operation command for moving the character continues for the duration. As a result, the character moves for the duration. The embodiments provide a technology for controlling the duration of an operation command input for a single action detection. This technology enables both reduction of the user's burden and complex operations.

[0015] In the first embodiment, the duration of an operation command input corresponding to one detected movement is determined using the movement of at least one of a plurality of body parts used for inputting an operation command as a trigger, thereby enabling the user to control the duration.

[0016] A user performs operations using multiple body parts of the user's own body. In a first embodiment, the multiple body parts used to operate a device include at least one body part for inputting an operation command and at least one body part for switching durations. The body part for inputting an operation command refers to a body part used to input an operation command, and the body part for switching durations refers to a body part used to switch durations. In this embodiment, the multiple body parts used to operate a device include multiple body parts for inputting an operation command and one body part for switching durations. Which of the multiple body parts is assigned to the body part for switching durations is determined in advance. Furthermore, multiple different operation commands are assigned in advance to each of the multiple body parts for inputting operation commands. The user can input the operation command assigned to the body part for inputting an operation command by moving the body part for inputting an operation command, and can switch the duration by moving the body part for switching durations.

[0017] Fig. 1 shows an example of the functional configuration of an operation command control system 10 according to the first embodiment. As shown in Fig. 1, the operation command control system 10 includes a motion information measurement unit 11, a motion information processing unit 12, a detection reference database (DB) 13, a motion detection unit 14, a duration database (DB) 15, a duration switching unit 16, an operation command output unit 17, and an operation command display unit 18.

[0018] The motion information measurement unit 11 measures motion information based on the motions of multiple body parts of the user using multiple sensors, where each sensor is used to measure motion information based on the motion of one body part.

[0019] The motion information processing unit 12 performs signal processing on each piece of measured motion information. For example, the motion information processing unit 12 calculates, for each sensor, an index representing the motion state of the body part corresponding to the sensor from the measured motion information.

[0020] The detection criteria DB 13 stores multiple detection criteria associated with each of multiple sensors (multiple body parts). The detection criteria are set in advance. The detection criteria may be customized for a user. For example, the detection criteria may be determined based on motion information measured when the user moves each body part. For example, the detection criteria may include a threshold value for an index representing the motion state of the body part.

[0021] The motion detection unit 14 refers to the detection criteria DB 13 and performs motion detection for multiple body parts of the user based on the signal-processed motion information. Motion detection for body parts refers to the process of detecting whether or not a body part has moved. Specifically, for each sensor, if the measured motion information satisfies the detection criteria, the motion detection unit 14 recognizes that the body part corresponding to that sensor has moved, and if the measured motion information does not satisfy the detection criteria, the motion detection unit 14 recognizes that the body part corresponding to that sensor has not moved. For example, for each sensor, the motion detection unit 14 compares a threshold associated with that sensor with an index obtained by the motion information processing unit 12. If the index exceeds the threshold, the motion detection unit 14 recognizes that the body part corresponding to that sensor has moved, and if the index is equal to or less than the threshold, the motion detection unit 14 recognizes that the body part corresponding to that sensor has not moved.

[0022] The duration DB 15 stores at least two predetermined duration values, for example, a small value of about 100 milliseconds to facilitate discrete command input, and a large value of about 2 seconds to facilitate continuous command input.

[0023] When the motion detection unit 14 detects that the body part for duration switching has moved, the duration switching unit 16 switches the duration by referring to the duration DB 15. For example, the duration switching unit 16 switches the duration in order according to the values ​​stored in the duration DB 15. When the duration DB 15 has three values ​​W １ , W ２ , W ３ and the duration is the value W １ When the motion detection unit 14 detects that the body part for duration switching has moved, the duration switching unit 16 sets the duration to the value W １ From the value W ２ If the movement detection unit 14 detects again that the body part for duration switching has moved thereafter, the duration switching unit 16 switches the duration to the value W ２ From the value W ３If the movement detection unit 14 detects again that the body part for duration switching has moved thereafter, the duration switching unit 16 switches the duration to the value W ３ From the value W １ Switch to.

[0024] When the movement detection unit 14 detects that the body part for inputting the operation command has moved, the operation command output unit 17 outputs the operation command associated with the body part for inputting the operation command for the duration set by the duration switching unit 16. A plurality of operation commands may be stored in an operation command database (DB) (not shown) in association with a plurality of body parts for inputting the operation command.

[0025] The operation command display unit 18 reflects the operation command output from the operation command output unit 17. For example, the operation command display unit 18 performs processing according to the operation command and displays video data.

[0026] The above-mentioned motion information measurement unit 11, motion information processing unit 12, detection criteria DB 13, motion detection unit 14, duration DB 15, duration switching unit 16, and operation command output unit 17 constitute an operation command control device 19 corresponding to an operation interface that outputs operation commands corresponding to user input operations.

[0027] Fig. 2 schematically shows an example of implementation of the operation command control system 10 shown in Fig. 1. As shown in Fig. 2, the operation command control system 10 includes a plurality of electromyographic sensors 21, a personal computer (PC) 22, an operation target device 23, and a display device 24. The electromyographic sensors 21 correspond to the motion information measuring unit 11 shown in Fig. 1, the PC 22 corresponds to the motion information processing unit 12, detection reference DB 13, motion detection unit 14, duration DB 15, duration switching unit 16, and operation command output unit 17 shown in Fig. 1, and the combination of the operation target device 23 and the display device 24 corresponds to the operation command display unit 18 shown in Fig. 1.

[0028] 2, the body part is a body part including a muscle, and an electromyographic sensor 21 is used for measurement. The electromyographic sensor 21 is attached to a body surface portion facing the muscle to be measured, and measures the myoelectric potential of the muscle. The electromyographic sensor 21 outputs a measurement signal indicating the measured value of the myoelectric potential of the muscle to be measured.

[0029] The PC 22 includes a central processing unit (CPU) 221 , a random access memory (RAM) 222 , a storage device 223 , and an input / output interface 224 .

[0030] The CPU 221 is an example of a processor. The RAM 222 is a volatile memory used as a working area for the CPU 221. The storage device 223 is a non-volatile memory such as a hard disk drive (HDD) or a solid state drive (SSD). The storage device 223 stores various programs, such as an operation command control program, and various data. When executed by the CPU 221, the operation command control program causes the CPU 221 to perform a series of processes described below regarding the motion information processing unit 12, the motion detection unit 14, the duration switching unit 16, and the operation command output unit 17. In other words, the CPU 221 is configured to function as the motion information processing unit 12, the motion detection unit 14, the duration switching unit 16, and the operation command output unit 17. The operation command control program may be software created using Python or the like. The storage device 223 functions as the detection criteria DB 13 and the duration DB 15.

[0031] The input / output interface 224 is an interface for communicating with an external device. The electromyographic sensors 21 and the operation target device 23 are connected to the input / output interface 224. The CPU 221 receives measurement signals from the electromyographic sensors 21 via the input / output interface 224. The CPU 221 transmits operation commands to the operation target device 23 via the input / output interface 224 in response to input operations by the user.

[0032] The operation target device 23 may be, for example, a game console or a PC. The operation target device 23 receives operation commands from the PC 22 and performs processing according to the received operation commands. For example, in a game in which a character is controlled, operation commands may include moving upward, moving downward, moving right, moving left, and jumping. Note that if precise operations such as moving right or left are always required (i.e., if duration control is not necessary), a design that does not apply duration control to such operation commands is also possible.

[0033] The display device 24 is, for example, a liquid crystal display device, and displays the video data output from the operation target device 23.

[0034] Programs such as the operation command control program may be provided to the PC 22 in a state where they are stored on a computer-readable recording medium. In this case, the PC 22 is equipped with a drive for reading data from the recording medium and acquires the program from the recording medium. Examples of recording media include magnetic disks, optical disks (CD-ROM, CD-R, DVD-ROM, DVD-R, etc.), magneto-optical disks (MO, etc.), and semiconductor memories. The program may also be distributed via a communications network. Specifically, the program may be stored on a server on the communications network, and the PC 22 may download the program from the server.

[0035] Fig. 3 shows an example of the procedure of the operation command control process according to the first embodiment. The control command control process shown in Fig. 3 is executed by the operation command control device 19 shown in Fig. 1. Here, it is assumed that the motion information measurement unit 11 is implemented by the electromyography sensor 21, as in the implementation example shown in Fig. 2.

[0036] 3, the motion information measurement unit 11 measures the myoelectric potential of each of the user's multiple muscles using the multiple myoelectric sensors 21. The measurements are performed continuously, and each myoelectric sensor sequentially outputs the measurement value of the myoelectric potential of the corresponding muscle.

[0037] When the predetermined time T has elapsed (Step S32; Yes), the flow proceeds to Step S33. Measurements over the predetermined time T provide time-series data of myoelectric potential over the predetermined time T for each electromyographic sensor. The time-series data of myoelectric potential over the predetermined time T, i.e., the time-series data of myoelectric potential extracted within a time window of the predetermined time T, includes a plurality of measurement values. In Step S33, the motion information processing unit 12 calculates the root mean square (RMS) of the measurement values ​​from the time-series data of myoelectric potential over the predetermined time T for each electromyographic sensor. It is desirable to set the predetermined time T to a short value, such as 100 to 200 milliseconds, in order to improve responsiveness to operations. The RMS of the measurement values ​​represents the amount of muscle activity.

[0038] Thereafter, the process is repeated as many times as the number of EMG sensors. The order of the repeated processes is determined in advance. Here, the EMG sensor refers to the EMG sensor to be processed, and the muscle refers to the muscle (body part) corresponding to the EMG sensor to be processed.

[0039] In step S34, the motion detection unit 14 compares the RMS value obtained for the myoelectric sensor in step S33 with a threshold associated with the myoelectric sensor stored in the detection reference DB 13. If the RMS value is equal to or less than the threshold (step S34; No), the motion detection unit 14 recognizes that the muscle is not moving, and moves on to the next myoelectric sensor for processing.

[0040] If the RMS value exceeds the threshold value (step S34; Yes), the movement detection unit 14 recognizes that a muscle has moved, that is, detects muscle movement, and the flow proceeds to step S35.

[0041] If the muscle whose movement is detected is a muscle for duration switching (step S35; Yes), the flow proceeds to step S36. In step S36, the duration switching unit 16 switches the duration W by referring to the duration DB 15. For example, if the duration DB 15 has two values ​​W １ , W ２ is stored, and the duration W is now the value W １ In this case, the duration switching unit 16 sets the duration W to the value W １ From the value W ２ Switch to.

[0042] If the muscle whose movement has been detected is a muscle for inputting an operation command (step S35; No), the flow proceeds to step S37. In step S37, the operation command output unit 17 outputs an operation command associated with the muscle whose movement has been detected to the operation command display unit 18 for the currently set duration W. The operation command display unit 18 performs processing according to the operation command received from the operation command output unit 17.

[0043] When the repeated process is completed for all of the myoelectric sensors 21, the series of processes shown in Fig. 3 ends. Then, the series of processes shown in Fig. 3 is executed again. In this manner, the series of processes shown in Fig. 3 is repeated at a cycle of a predetermined time T.

[0044] As described above, the operation command control system 10 uses multiple sensors to detect motions of multiple body parts of the user, including body parts for inputting operation commands and body parts for duration switching. When the operation command control system 10 detects that a body part for duration switching has moved, it switches the duration between multiple values ​​prepared in advance. When the operation command control system 10 detects that one of the body parts for inputting operation commands has moved, it outputs an operation command associated with the body part for inputting operation commands whose motion was detected for the set duration.

[0045] In the above configuration, the duration of the operation command input is controlled in response to the user's movement of a specific body part. In other words, the user can control the duration of the operation command input. As a result, it is possible to reduce the burden on the user and perform complex operations at the same time. This will lead to people with severe physical disabilities actively participating in various communities via the network.

[0046] Second Embodiment In the second embodiment, the duration of an operation command input corresponding to one motion detection is controlled in accordance with the situation, such as the progress of a game. The second embodiment can be applied to cases where the situation, such as the progress of a game, can be acquired sequentially. For example, when the distance between the character and the target in the game is large, the duration is increased, and when the character is approaching the target, the duration is decreased.

[0047] In the second embodiment, only the parts and operations that are different from the first embodiment will be described, and detailed descriptions of the parts and operations that are the same as those in the first embodiment will be omitted. In the second embodiment, unlike the first embodiment, no body part is set for duration switching. A plurality of different operation commands are assigned in advance to each of a plurality of body parts used to operate a device.

[0048] Fig. 4 shows an example of the functional configuration of an operation command control system 40 according to the second embodiment. In Fig. 4, the same components as those shown in Fig. 1 are denoted by the same reference numerals, and the description thereof will be omitted as appropriate.

[0049] 4, the operation command control system 40 includes a motion information measurement unit 11, a motion information processing unit 12, a detection criterion DB 13, a motion detection unit 14, a situation acquisition unit 41, a duration determination unit 42, an operation command output unit 17, and an operation command display unit 18. The motion information measurement unit 11, the motion information processing unit 12, the detection criterion DB 13, the motion detection unit 14, the situation acquisition unit 41, the duration determination unit 42, and the operation command output unit 17 constitute an operation command control device 49 corresponding to the operation interface.

[0050] The motion information measurement unit 11 uses multiple sensors to measure motion information based on the motions of multiple body parts of the user. The motion information processing unit 12 performs signal processing on each piece of measured motion information. The motion detection unit 14 refers to the detection standard DB 13 and detects the motions of the multiple body parts of the user based on the signal-processed motion information.

[0051] The situation acquisition unit 41 acquires situation parameters based on the situation of an object that the user operates. The object that the user operates may be content such as a game. The situation parameters are information that indicates the situation of the object that the user operates. For example, in the case where a user operates one character in a soccer game, the situation parameter may be, for example, the distance between the ball and the character.

[0052] The duration determination unit 42 determines the duration from the situation parameters acquired by the situation acquisition unit 41. For example, the duration determination unit 42 lengthens the duration in proportion to an increase in the situation parameters. A duration determination model that inputs the situation parameters and outputs a duration according to the situation is created in advance, and the duration determination unit 42 inputs the situation parameters acquired by the situation acquisition unit 41 into the duration determination model and sets the duration to the value output from the duration determination model. For example, the range of the situation parameters is set to have a minimum value of 0 and a maximum value of the image width, and the minimum value of the duration is set to 100 milliseconds and a maximum value of 2 seconds. The duration determination unit 42 notifies the operation command output unit 17 of the determined duration value.

[0053] The duration can also be set for each operation command. For example, when the proportional control described above is performed, a different proportional coefficient may be used for each operation command. Alternatively, a duration determination model may be prepared for each operation command.

[0054] When the movement detection unit 14 detects that a body part has moved, the operation command output unit 17 outputs an operation command associated with this body part for a duration W preset by the duration determination unit 42. The operation command display unit 18 reflects the operation command output from the operation command output unit 17.

[0055] Fig. 5 shows a schematic implementation example of the operation command control system 40 shown in Fig. 4. In Fig. 5, the same components as those shown in Fig. 2 are denoted by the same reference numerals, and the description thereof will be omitted as appropriate.

[0056] As shown in Fig. 5, the operation command control system 40 includes a plurality of electromyographic sensors 21, a personal computer (PC) 22, an operation target device 23, a display device 24, and a capture board 51. The PC 22 includes a CPU 221, a RAM 222, a storage device 223, and an input / output interface 224. The electromyographic sensors 21 correspond to the motion information measurement unit 11 shown in Fig. 1, the PC 22 corresponds to the motion information processing unit 12, the detection reference DB 13, the motion detection unit 14, the duration DB 15, the duration determination unit 42, and the operation command output unit 17 shown in Fig. 4, the combination of the PC 22 and the capture board 51 corresponds to the situation acquisition unit 41 shown in Fig. 4, and the combination of the operation target device 23 and the display device 24 corresponds to the operation command display unit 18 shown in Fig. 4.

[0057] In the implementation example shown in FIG. 5 , the operation target device 23 is connected to the PC 22 and the display device 24 via a capture board 51. The capture board 51 receives video data from the operation target device 23 and transmits the received video data to the PC 22 and the display device 24. In the PC 22, a CPU 221 executing an operation command control program calculates a situation parameter from the video data received from the capture board 51. In an example in which the situation parameter is the distance between the ball and the character, the CPU 221, for example, uses a video brightness measurement function to identify coordinates indicating the brightness specific to the ball and the character marker, and calculates the distance between these two coordinates to obtain the distance between the ball and the character. The CPU 221 inputs the situation parameter obtained by calculation into a duration determination model and obtains the value output from the duration determination model as the duration.

[0058] Fig. 6 shows an example of the procedure of the operation command control process according to the second embodiment. The control command control process shown in Fig. 6 is executed by the operation command control device 49 shown in Fig. 4. Here, as in the implementation example shown in Fig. 5, the motion information measurement unit 11 is assumed to be implemented by the electromyography sensor 21. In Fig. 6, the same processes as those shown in Fig. 3 are denoted by the same reference numerals, and detailed description thereof will be omitted.

[0059] 6, the motion information measurement unit 11 measures the myoelectric potential of each of the user's muscles using the multiple myoelectric sensors 21. When a predetermined time T has elapsed (step S32; Yes), the flow proceeds to step S33. In step S33, the motion information processing unit 12 calculates the root mean square (RMS) of the measured value for each myoelectric sensor from the time-series data of the myoelectric potential over the predetermined time T.

[0060] In step S61, the duration determination unit 42 determines the duration W of the operation command input based on the situation of the target that the user is operating. For example, the situation acquisition unit 41 extracts a frame image from the video data at a point when a predetermined time T has elapsed, and calculates situation parameters from the extracted frame image. The duration determination unit 42 inputs the situation parameters obtained by the situation acquisition unit 41 into a duration determination model, and adopts the value output from the duration determination model as the duration.

[0061] 6, the process shown in step S61 is executed after the process shown in step S33. The process shown in step S61 may be executed at another timing.

[0062] Thereafter, the process is repeated as many times as the number of EMG sensors. The order of the process is determined in advance.

[0063] In step S34, the motion detection unit 14 compares the RMS value obtained for the myoelectric sensor in step S33 with a threshold associated with the myoelectric sensor stored in the detection reference DB 13. If the RMS value is equal to or less than the threshold (step S34; No), the motion detection unit 14 recognizes that the muscle is not moving, and moves on to the next myoelectric sensor for processing.

[0064] If the RMS value exceeds the threshold value (Step S34; Yes), the movement detection unit 14 recognizes that the muscle has moved, and the flow proceeds to Step S37. In Step S37, the operation command output unit 17 outputs an operation command associated with the muscle whose movement has been detected, for the currently set duration W, to the operation command display unit 18. The operation command display unit 18 performs processing according to the operation command received from the operation command output unit 17.

[0065] As described above, the operation command control system 40 acquires parameters based on the situation of the content to be operated by the user, and determines the duration according to the situation from the acquired parameters. Then, when the operation command control system 40 detects the movement of any body part, it outputs the operation command corresponding to that body part for the determined duration.

[0066] With the above configuration, the duration of the operation command input is controlled according to the situation of the object the user is operating. As a result, it is possible to reduce the burden on the user while also enabling complex operations. This will lead to people with severe physical disabilities being able to actively participate in various communities via the network.

[0067] (Modifications) In the above-described embodiment, an electromyographic sensor is used to detect the movement of each body part of the user. However, other types of sensors may be used as long as they can detect the movement of each body part of the user. Multiple types of sensors may also be used in combination. For example, it is conceivable to use a button-operated operation device, a pressure device, an eye-gaze input device, etc. in addition to the electromyographic sensor, depending on the physical condition of the user.

[0068] For specific operation commands that are only used for fine operations, the duration may not be controlled as described above, and a predetermined duration may be maintained.

[0069] The processes executed by the situation acquisition unit 41 and the duration determination unit 42 in the second embodiment can be changed depending on the application. For example, in a musical performance, a model can be created that acquires a trigger at a time that marks a boundary between musical developments, such as the verse and chorus, and outputs a duration according to the melody of the music.

[0070] The input command control described in the above-described embodiment is not limited to game operations, but can also be applied to basic information device operations, avatar operations in a virtual space, and musical performances such as DJing and playing musical instruments. Furthermore, the objects of operation are not limited to objects in a virtual space, but may also be objects in a real space, such as remote robot operation or customer service.

[0071] The present invention is not limited to the above-described embodiments, and various modifications can be made in the implementation stage without departing from the spirit of the invention. Furthermore, the embodiments may be implemented in appropriate combinations, in which case the combined effects can be obtained. Furthermore, the above-described embodiments include various inventions, and various inventions can be extracted by combining selected components from the disclosed components. For example, if the problem can be solved and the effects can be obtained even if some components are removed from all the components shown in the embodiments, the configuration from which these components are removed can be extracted as an invention.

[0072] DESCRIPTION OF SYMBOLS 10... Operation command control system 11... Motion information measurement unit 12... Motion information processing unit 13... Detection standard database 14... Motion detection unit 15... Duration database 16... Duration switching unit 17... Operation command output unit 18... Operation command display unit 19... Operation command control device 21... Myoelectric sensor 22... Personal computer 23... Operation target device 24... Display device 40... Operation command control system 41... Status acquisition unit 42... Duration determination unit 49... Operation command control device 51... Capture board 221... CPU 222... RAM 223... Storage device 224... Input / output interface

Claims

1. An operation command control device comprising: a detection unit that uses multiple sensors to detect motions of multiple body parts of a user, including multiple first body parts associated with multiple operation commands and a second body part different from the multiple first body parts; a duration switching unit that switches the duration when it is detected that the second body part has moved; and an operation command output unit that, when it is detected that any of the multiple first body parts has moved, outputs an operation command associated with the first body part whose motion has been detected for the duration.

2. An operation command control method executed by a computer, comprising: using a plurality of sensors to detect motions of a plurality of body parts of a user, including a plurality of first body parts associated with a plurality of operation commands and a second body part different from the plurality of first body parts; switching a duration when it is detected that the second body part has moved; and outputting an operation command associated with the first body part whose motion has been detected for the duration when it is detected that any of the plurality of first body parts has moved.

3. An operation command control device comprising: a detection unit that uses multiple sensors to detect movements of multiple body parts of a user associated with multiple operation commands; a situation acquisition unit that acquires situation information indicating the situation of the target of the operation performed by the user; a control time determination unit that determines a duration based on the acquired situation information; and an operation command output unit that, when movement of any of the multiple body parts is detected, outputs an operation command associated with the body part whose movement was detected for the determined duration.

4. An operation command control program for causing a computer to function as each unit of the operation command control device according to claim 1 or 3.

Images