Operation control device, operation control method and program

Abstract

To provide an operation control apparatus capable of executing an appropriate brain wave command without the influence of irrelevant stimuli, an operation control method, and a program.SOLUTION: An operation control apparatus 10 includes: a brain wave acquisition unit (brain information acquisition unit) 11 for acquiring brain information of a user; a determination unit 21 which determines whether the brain information acquired by the brain wave acquisition unit 11 is brain information corresponding to a first command and a second command which are different from each other; a display control unit 17 and a display unit 18 configured to present information which reminds of the second command; and an execution unit 22 which executes processing corresponding to the first command when the determination unit 21 determines acquisition of brain information corresponding to the first command and brain information corresponding to the second command.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an operation control device, an operation control method, and a program. [Background technology]

[0002] In recent years, the technology for measuring brain information has been developed, and a brain-machine interface (BMI), which is an interface that directly connects the brain and machines, has become a reality. For example, one such technology is described in Patent Document 1. Patent Document 1 discloses a technology that obtains a plurality of steady-state visual evoked response potential signals from a user when the user receives a stimulus, and supplies a system command signal. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2013-117957 A Summary of the Invention [Problem to be solved by the invention]

[0004] In conventional BMIs, when an unrelated stimulus is received when executing an EEG command, there is a risk that the stimulus will appear in the EEG and be executed. For example, if you think "move forward" to a robot, and the command is to make the robot move forward, if someone nearby says "move forward," the brain will automatically recall the word "move forward" and issue the command. Also, when operating a robot while watching its movements, if the robot moving forward is displayed on a monitor, the operator's brain will automatically recall the word "move forward," and the command will be issued automatically.

[0005] The present invention has been made in view of the above, and has an object to make it possible to execute appropriate electroencephalogram commands without being influenced by irrelevant stimuli. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems and achieve the object, the operation control device of the present invention includes a brain information acquisition unit that acquires brain information of a user, a determination unit that determines whether the brain information acquired by the brain information acquisition unit is brain information corresponding to two different first commands and second commands, an information presentation unit that presents information that evokes the second command, and an execution unit that executes a process corresponding to the first command when the determination unit determines that it has acquired brain information corresponding to the first command and brain information corresponding to the second command.

[0007] The operation control method of the present invention includes the steps of acquiring brain information of a user, determining whether the acquired brain information corresponds to two different first commands and second commands, presenting information that evokes the second command, and executing a process corresponding to the first command when it is determined that brain information corresponding to the first command and brain information corresponding to the second command have been acquired.

[0008] The program of the present invention causes a computer to execute the steps of acquiring brain information of a user, determining whether the acquired brain information corresponds to two different first commands and second commands, presenting information that evokes the second command, and executing processing corresponding to the first command when it is determined that brain information corresponding to the first command and brain information corresponding to the second command have been acquired. Effect of the Invention

[0009] According to the present invention, it is possible to effectively execute an appropriate electroencephalogram command without being influenced by irrelevant stimuli. [Brief description of the drawings]

[0010] [Figure 1]FIG. 1 is a block diagram showing an example of the configuration of an operation control device according to this embodiment. [Diagram 2] FIG. 2 is a flowchart showing the overall process flow in the operation control device according to this embodiment. [Diagram 3] FIG. 3 is a flowchart showing the flow of the indirect execution mode process in the operation control device according to this embodiment. [Figure 4] FIG. 4 is a flowchart showing the flow of processing of an abstract image in the operation control device according to this embodiment. [Diagram 5] FIG. 5 is a flowchart showing the flow of processing for updating an abstract image in the operation control device according to this embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An operation control device, an operation control method, and a program according to the present invention will be described in detail below with reference to the accompanying drawings. Note that the present invention is not limited to the following embodiments.

[0012] [Operation control device] FIG. 1 is a block diagram showing an example of the configuration of an operation control device according to this embodiment.

[0013] 1, in this embodiment, the operation control device 10 controls the operation of an operation target object 50 based on the brain information of a user. The operation control device 10 includes an electroencephalogram acquiring section (brain information acquiring section) 11, an electroencephalogram decoder 12, a command buffer 13, a password buffer 14, a storage section 15, a processing section 16, a display control section 17, a display section 18, and a communication section 19.

[0014] The operation object 50 is, for example, a robot, but is not limited to a robot and may be any device that operates through communication. Although not shown, the operation object 50 is provided with a drive device, a control device that controls the drive device, and a communication unit that can receive control signals, etc. When the communication unit of the operation object 50 receives a control signal, the control device drives the drive device to operate the robot.

[0015] The brainwave acquiring unit 11 can be worn on the head of the user. The brainwave decoder 12, the processing unit 16, the display control unit 17, the display unit 18, and the communication unit 19 may be worn by the user, or may be placed at a predetermined position without being worn. In addition, the brainwave acquiring unit 11, the brainwave decoder 12, the processing unit 16, the display control unit 17, the display unit 18, and the communication unit 19 may be provided integrally or separately.

[0016] The brainwave acquiring unit 11 acquires brain waves, which are brain information of the user. The brainwave acquiring unit 11 has, for example, an electric sensor (for example, an electrode) that detects brain waves generated from a weak current flowing through the neural network of the brain. The brainwave acquiring unit 11 detects the potential (electrical signal) of a weak current when the user receives an external stimulus or based on the user's thoughts such as thoughts. Note that the brain information acquiring unit is not limited to the brainwave acquiring unit 11. The brain information acquiring unit may acquire, for example, the blood flow rate due to brain activity, which is the user's brain information, by, for example, near-infrared light measurement. The brainwave acquiring unit 11 is connected to the brainwave decoder 12 and transmits brain waves, which are brain information acquired from the user, to the brainwave decoder 12.

[0017] The electroencephalogram decoder 12 restores the user's electrical electroencephalogram signals acquired by the electroencephalogram acquisition unit 11 into the user's thought information. In this case, the relationship between the multiple electrical electroencephalogram signals of the user and the user's thought information is linked in advance. In this case, the relationship between the electrical electroencephalogram signals and the user's thought information is linked using machine learning such as deep learning.

[0018] The command buffer 13 temporarily stores the first command determined by the determination unit 21 based on the user's thought information. The first command is a command for operating the operation target 50, such as "forward", "backward", "stop", "accelerate", "decelerate", "turn right", "turn left", etc. In this case, the relationship between the first command and the operation of the operation target 50 is linked in advance. The command buffer 13 is capable of transmitting and receiving various data to and from the processing unit 16.

[0019] The first command is not limited to a concept indicating an instructed action, and may be one to which a numerical value or the like is added to complement the concept indicating the instructed action. For example, the electroencephalogram decoder 103 may restore the user's thought information based on the electrical signal acquired by the electroencephalogram acquisition unit 11, detect the intensity of the electroencephalogram as a decimal number from 0 to 1, and add the intensity (numerical value) to the user's thought information to set the first command. In this case, the numerical value of the first command is a count of the maximum torque output of the drive device provided on the operation target object 50.

[0020] The password buffer 14 temporarily stores a password, which is a second command determined by the determination unit 21 based on the user's thought information. The password, which is the second command, is a command for deciding to execute the first command. The password is composed of one or a combination of multiple symbols that constitute the password. The password buffer 14 is capable of transmitting and receiving various data to and from the processing unit 16.

[0021] The storage unit 15 stores a plurality of first commands and a plurality of second commands. The storage unit 15 may also store learning data obtained by machine learning the association between the electrical signal of the user's brainwaves and thought information. The second command is composed of a plurality of symbols constituting a password. The storage unit 15 is capable of transmitting and receiving various data to and from the processing unit 16. The processing unit 16 sets or updates the password by combining one or more of the plurality of symbols stored in the storage unit 15. The password may be a common password that is common to different first commands, or may be a plurality of individual passwords that are different for each different first command.

[0022] The second command, the password, is an abstract image. Because a password is made up of one or more symbols, the symbols are also abstract images. Abstract images include symbols such as "△", "□", and "×", colors such as "red", "blue", and "black", numbers such as "0", "1", and "2", or objects and scenery. For this reason, the second command, the password, is set to, for example, "△" + "red" + "9".

[0023] The command buffer 13 and the password buffer 14 are, for example, recording units such as semiconductor memory elements, such as a random access memory (RAM) or a flash memory, included in the processing unit 16. The storage unit 15 is configured with a memory card, a solid state drive (SSD), an external storage device, or the like.

[0024] The processing unit 16 can switch between a direct execution mode and an indirect execution mode. The direct execution mode is a mode in which, when a first command for operating the operation object 50 is input to the processing unit 16, the processing unit 16 executes the first command. On the other hand, the indirect execution mode is a mode in which, when a first command and a second command for operating the operation object 50 are input to the processing unit 16, the processing unit 16 executes the first command.

[0025] The processing unit 16 is an arithmetic processing device (control device) constituted by, for example, a CPU (Central Processing Unit) and the like. The processing unit 16 loads a stored program into memory and executes instructions contained in the program. The processing unit 16 includes an internal memory (not shown), which is used for temporary storage of data in the processing unit 16, and the like. The processing unit 16 has a determination unit 21 and an execution unit 22 as functions. The processing unit 16 also transmits the processing result to the display control unit 17 and the communication unit 19.

[0026] The determination unit 21 determines whether or not the user's thought information acquired by the electroencephalogram acquisition unit 11 and restored by the electroencephalogram decoder 12 is an electroencephalogram corresponding to two different first and second commands (passwords).

[0027] Specifically, the determination unit 21 compares the user's thought information restored by the electroencephalogram decoder 12 with the first command stored in the memory unit 15. At this time, when the user's thought information matches the first command, the determination unit 21 determines that the user's thought information is the first command. At this time, the determination unit 21 stores the command determined to be the first command in the command buffer 13. On the other hand, when the user's thought information does not match the first command, the determination unit 21 determines that the user's thought information is not the first command. At this time, the determination unit 21 does not store the command determined to not be the first command in the command buffer 13. The determination unit 21 determines whether the user's thought information restored by the electroencephalogram decoder 12 matches the first command even if it is not a perfect match, as long as it can be determined that the user's thought information means the first command.

[0028] Furthermore, the determination unit 21 compares the user's thought information restored by the electroencephalogram decoder 12 with the password stored in the memory unit 15. At this time, when the user's thought information matches a password or a symbol constituting a password, the determination unit 21 determines that the user's thought information is a password or a symbol constituting a password. When the determination unit 21 determines that the user's thought information is a password or a symbol, the determination unit 21 stores the password or symbol in the password buffer 14. On the other hand, when the user's thought information does not match the stored password or a symbol constituting a password, the determination unit 21 determines that the user's thought information is not a password or a symbol constituting a password. When the determination unit 21 determines that the user's thought information is not a password or a symbol, the determination unit 21 does not store the password or symbol in the password buffer 14.

[0029] The execution unit 22 executes a process corresponding to the first command when the determination unit 21 determines that it has acquired electroencephalogram information corresponding to the first command and electroencephalograms corresponding to the password. Specifically, when the execution unit 22 determines that the user's thought information first acquired by the determination unit 21 is the first command and determines that the user's thought information second acquired by the determination unit 21 is a password, the execution unit 22 executes a process corresponding to the first command.

[0030] However, when a preset waiting time, for example, 3 seconds, has elapsed since the determination unit 21 determined that the first command has been acquired, the execution unit 22 cancels the acquired first command. Furthermore, when the processing unit 16 acquires a cancel command as the user's thought after the determination unit 21 determined that the first command has been acquired, the execution unit 22 cancels the acquired first command. The cancel command is preset, and is stored in the storage unit 15 in advance in association with the relationship between the electrical signal of the user's electroencephalogram and the user's thought information (cancel command).

[0031] Therefore, when the direct execution mode is selected, if the judgment unit 21 judges that the user's thought information is the first command, the execution unit 22 executes the first command without judging whether a second command has been input. On the other hand, when the indirect execution mode is selected, if the judgment unit 21 judges that the user's thought information is the first command, the execution unit 22 does not yet execute the first command. In other words, after the judgment unit 21 judges that the first user's thought information is the first command, the execution unit 22 executes the first command when it judges that the next user's thought information is the second command (password).

[0032] The display control unit 17 and the display unit 18 function as an information presenting unit that presents various information. When the determination unit 21 determines that an electroencephalogram corresponding to the first command has been acquired, the display control unit 17 and the display unit 18 present information that reminds the user of the password. In this embodiment, the information presenting unit presents information that reminds the user of the password using visual information, but is not limited to this. For example, the information presenting unit may present information that reminds the user of the password using audio information. In this case, the information presenting unit is composed of, for example, an audio output control unit and a speaker.

[0033] The display control unit 17 is connected to the display unit 18. The display control unit 17 transmits the processing result transmitted from the processing unit 16 to the display unit 18 to display it. The display control unit 17 causes the display unit 18 to display the operation state of the operation control device 10, which is the processing result of the processing unit 16, and thought instructions for the user.

[0034] The processing unit 16 controls the display control unit 17 to display necessary information on the display unit 18. The processing unit 16 controls the display control unit 17 to display an instruction to evoke a symbol (abstract image) of the password as the second command to the user on the display unit 18. Since the symbol is an abstract image, the display unit 18 may display the abstract image itself, or may display an image or language that evokes the abstract image.

[0035] The display unit 18 displays the operating state of the operation control device 10 and thought instructions for the user transmitted from the display control unit 17. The display unit 18 presents necessary information to the user. The display unit 18 is a display including, for example, a liquid crystal display (LCD: Liquid Crystal Display) or an organic EL (Organic Electro-Luminescence) display.

[0036] The communication unit 19 is capable of wireless communication with the operation target 50. The communication unit 19 transmits processing information processed by the processing unit 16 to the operation target 50. Specifically, when the determination unit 21 determines that an electroencephalogram corresponding to the first command and an electroencephalogram corresponding to the password have been acquired, the execution unit 22 generates a control signal corresponding to the processing of the first command and transmits it to the communication unit 19. The communication unit 19 transmits the control signal corresponding to the processing of the first command to the operation target 50. By receiving the first command transmitted by the communication unit 19, the operation target 50 operates in response to the processing of the first command.

[0037] [Operation control method] Here, a description will be given of an operation control method by the operation control device 10. Fig. 2 is a flowchart showing the overall process flow in the operation control device according to this embodiment.

[0038] As shown in FIG. 1 and FIG. 2, in step S11, the processing unit 16 judges whether the user's thought information acquired by the electroencephalogram acquiring unit 11 and restored by the electroencephalogram decoder 12 is a mode switching command. Here, when the processing unit 16 judges that the user's thought information is a mode switching command (Yes), the processing unit 16 switches the mode in step S12. That is, if the current mode is the direct execution mode, the processing unit 16 switches the mode to the indirect execution mode, and if the current mode is the indirect execution mode, the processing unit 16 switches the mode to the direct execution mode. At this time, the processing unit 16 controls the display control unit 17 to display to the user on the display unit 18 that the mode has been switched. For example, when the current mode is the direct execution mode, the display control unit 17 displays on the display unit 18 the processing content such as "Switched to direct execution mode", and when the current mode is the indirect execution mode, the display control unit 17 displays on the display unit 18 the processing content such as "Switched to indirect execution mode", to inform the user that the mode has been switched. Then, in step S13, the command buffer 13 and the password buffer 14 are cleared, and the routine is exited.

[0039] On the other hand, if the processing unit 16 determines in step S11 that the user's thought information is not a mode switching command (No), then in step S14 it determines whether or not the direct execution mode is currently selected. If the processing unit 16 determines that the direct execution mode is currently selected (Yes), then in step S15 the judgment unit 21 determines whether or not the user's thought information acquired by the brain wave acquisition unit 11 and restored by the brain wave decoder 12 is a brain wave corresponding to the first command. If the judgment unit 21 determines that the user's thought information is not the first command (No), then it exits this routine.

[0040] On the other hand, if the determination unit 21 determines in step S15 that the user's thought information is the first command (Yes), then in step S16 the execution unit 22 executes a process corresponding to the first command. That is, the execution unit 22 transmits a control signal corresponding to the process of the first command to the operation target 50 via the communication unit 19, and operates the operation target 50. At this time, the processing unit 16 controls the display control unit 17 to display to the user on the display unit 18 that the first command has been executed. The display control unit 17 displays a message indicating that the first command has been executed, such as "Acceleration command has been executed," on the display unit 18.

[0041] When the processing unit 16 determines in step S14 that the direct execution mode is not currently selected (No), the processing unit 16 executes the process of the indirect execution mode in step S17. The process shown in Fig. 2 is executed repeatedly during the period in which the operation of the operation target object 50 is controlled by the operation control device 10.

[0042] The indirect execution mode process will be described below. Fig. 3 is a flowchart showing the flow of the indirect execution mode process in the operation control device according to this embodiment.

[0043] As shown in FIG. 1 and FIG. 3, in step S21, the determination unit 21 determines whether the user's thought information acquired by the electroencephalogram acquisition unit 11 and restored by the electroencephalogram decoder 12 is an electroencephalogram corresponding to the first command. Here, when the determination unit 21 determines that the user's thought information is the first command (Yes), in step S22, the determined first command is stored in the command buffer 13. At this time, the processing unit 16 may control the display control unit 17 to display to the user that the first command has been stored on the display unit 18. The display control unit 17 displays a message storing the first command, such as "Acceleration command has been stored," on the display unit 18. Then, in step S23, the password buffer 14 is cleared.

[0044] On the other hand, if the judgment unit 21 judges in step S21 that the user's thought information is not the first command (No), then in step S24, it judges whether or not the first command is stored in the command buffer 13. Here, if the judgment unit 21 judges that the first command is stored in the command buffer 13 (Yes), then in step S25, the judgment unit 21 executes abstract image processing.

[0045] The abstract image processing will be described below. Fig. 4 is a flowchart showing the flow of abstract image processing in the operation control device according to this embodiment.

[0046] 1 and 4, in step S31, the processing unit 16 controls the display control unit 17 to display an instruction for the user to imagine a symbol (abstract image) of a password as a second command on the display unit 18. The display control unit 17 displays, for example, an image corresponding to the abstract image on the display unit 18.

[0047] In step S32, the judgment unit 21 judges whether or not the user's thought information acquired by the electroencephalogram acquisition unit 11 and restored by the electroencephalogram decoder 12 is an electroencephalogram corresponding to the password (abstract image). If the judgment unit 21 judges that the user's thought information is not a password (abstract image) (No), it exits this routine.

[0048] On the other hand, if the judgment unit 21 judges that the user's thought information is a password symbol (Yes), in step S33, the judged symbol is stored as a single abstract image in the password buffer 14. On the other hand, if the judgment unit 21 judges that the user's thought information is not a password symbol (No), the judgment unit 21 exits this routine.

[0049] In step S34, the determination unit 21 compares the abstract image stored in the password buffer 14 with the password composed of the abstract image stored in the memory unit 15 to determine whether or not they match. If the determination unit 21 determines that the abstract image stored in the password buffer 14 does not match the password composed of the abstract image stored in the memory unit 15 (No), in step S39, the processing unit 16 controls the display control unit 17 to display to the user on the display unit 18 that the passwords do not match.

[0050] On the other hand, if the determination unit 21 determines in step S34 that the abstract image stored in the password buffer 14 matches the password composed of the abstract image stored in the storage unit 15 (Yes), the execution unit 22 executes processing corresponding to the first command stored in the command buffer 13 in step S35. That is, the execution unit 22 transmits a control signal corresponding to the processing of the first command to the operation target 50 via the communication unit 19, and operates the operation target 50. At this time, the processing unit 16 controls the display control unit 17 to display to the user on the display unit 18 that the first command has been executed. The display control unit 17 displays a message indicating that the first command has been executed, such as "Acceleration command has been executed," on the display unit 18.

[0051] In step S36, the processing section 16 executes an abstract image update process to update the password. The abstract image update process will be described later. Then, in step S37, the command buffer 13 is cleared, and in step S38, the password buffer 14 is cleared.

[0052] The abstract image update process will be described below. Fig. 5 is a flowchart showing the flow of the abstract image update process in the operation control device according to this embodiment.

[0053] When a process of comparing a password (abstract image) recalled by the user with a preset password (abstract image) is executed repeatedly, the user will memorize the preset password (abstract image). Then, the meaning of inputting a password that indicates the intention to execute the operation content corresponding to the first command becomes weak. In other words, the user will execute the first command without much thought. Therefore, when a predetermined condition is established, the processing unit 16 executes an abstract image update process to update and change the password.

[0054] 1 and 5, in step S41, the processing unit 16 determines whether or not a predetermined condition set in advance for updating a password is satisfied. If the processing unit determines that the predetermined condition is not satisfied (No), the processing unit exits this routine. On the other hand, if the processing unit determines that the predetermined condition is satisfied (Yes), the processing unit updates the password by adding a symbol of an abstract image required for the current password in step S42.

[0055] The specified conditions for updating and changing the password include, for example, when the number of times the first command is executed exceeds a predetermined number of times, when the intensity of the brain waves processed by the brain wave decoder 12 exceeds a predetermined amount, and when a process for adding a required abstract image is input via an input means such as an brain wave.

[0056] In the above embodiment, the first command and the second command (password) are detected in time series, but the present invention is not limited to this configuration. For example, the first command and the second command (password) may be detected simultaneously. That is, the process of steps S21 to S23 in FIG. 3 and the process of steps S31 to S34 in FIG. 4 may be executed in parallel.

[0057] [effect] In this embodiment, the device includes an electroencephalogram acquisition unit (brain information acquisition unit) 11 that acquires brain information of the user, a determination unit 21 that determines whether the brain information acquired by the electroencephalogram acquisition unit 11 is brain information corresponding to two different first and second commands, a display control unit 17 and a display unit 18 as an information presentation unit that presents information reminiscent of the second command, and an execution unit 22 that executes processing corresponding to the first command when the determination unit 21 determines that it has acquired brain information corresponding to the first command and brain information corresponding to the second command.

[0058] Therefore, when brain information corresponding to the first command and brain information corresponding to the second command are acquired, a process corresponding to the first command is executed to operate the operation target 50. That is, even if brain information corresponding to the first command indicating the operation content is acquired, the process corresponding to the first command is not executed unless brain information corresponding to the second command indicating the intention to execute the operation content is acquired. Therefore, the content and execution timing of the first command are more safely and accurately activated, and an appropriate brainwave command can be executed without being influenced by unrelated stimuli.

[0059] In the present embodiment, the display control unit 17 and the display unit 18 as information presenting units present information that reminds the user of the second command, thereby enabling the user to recall the second command. Therefore, the user does not need to remember the second command and can appropriately execute the first command.

[0060] In this embodiment, the first command is a command that indicates the operation content for operating the operation object 50, and the second command is an abstract image that indicates the intention to execute the operation content of the operation object 50. Therefore, by acquiring brain information corresponding to the second command, the user can confirm the intention to execute the operation content of the operation object 50, and an appropriate brain wave command can be executed.

[0061] In this embodiment, the determination unit 21 can set a second command and notify the user by the display control unit 17 and the display unit 18 as information presenting units, and can change the second command when a preset update condition is met. Therefore, if the same second command is used for a long period of time, the user will memorize the second command, and it becomes less meaningful to confirm the user's intention to execute the operation content corresponding to the first command. However, by changing the second command, it is possible to appropriately confirm the user's intention to execute the operation content.

[0062] The operation control device 10 according to the present invention has been described above, but the operation control device 10 may be embodied in various different forms other than the above-described embodiment.

[0063] Each component of the illustrated operation control device 10 is a functional concept, and does not necessarily have to be physically configured as illustrated. In other words, the specific form of each device is not limited to that shown in the figure, and all or part of the device may be functionally or physically distributed or integrated in any unit depending on the processing load and usage status of each device.

[0064] The configuration of the operation control device 10 is realized, for example, as software, by a program loaded into a memory. In the above embodiment, the functional blocks are described as being realized by the cooperation of these hardware and software. In other words, these functional blocks can be realized in various forms by only hardware, only software, or a combination of both.

[0065] The above-mentioned components include those that a person skilled in the art can easily imagine and those that are substantially the same. Furthermore, the above-mentioned configurations can be appropriately combined. Furthermore, various omissions, substitutions, or modifications of the configurations are possible without departing from the scope of the present invention. [Explanation of symbols]

[0066] 10 Operation control device 11. Brain wave acquisition unit (brain information acquisition unit) 12 Brainwave Decoder 13 Command Buffer 14 Password Buffer 15 Storage section 16 Processing section 17 Display control unit (information presentation unit) 18 Display section (information presentation section) 19 Communications Department 50 Operational Objects

Claims

1. A brain information acquisition unit that acquires brain information of a user; The brain information acquired by the brain information acquisition unit is classified into two different first and second commands. A determination unit that determines whether the brain information corresponds to the brain information; an information presenting unit that presents information that reminds the user of the second command; After the determination unit acquires brain information corresponding to the first command, and executing a process corresponding to the first command when it is determined that brain information corresponding to the first command has been acquired. With Equipped with the determination unit sets the second command, notifies the user of the second command by the information presentation unit, and changes the second command when a preset update condition is met. Operation control device.

2. the first command is a command representing an operation content for operating an operation object, and the second command is an abstract image representing an intention to execute the operation content of the operation object. The operating control device according to claim 1 .

3. the determination unit causes the information presentation unit to present information evoking the second command when brain information corresponding to the first command is acquired; The operating control device according to claim 1 .

4. The determination unit changes the second command when a condition for determining that the user has memorized the second command corresponding to the first command is satisfied as the update condition. The operating control device according to claim 1 .

5. acquiring brain information of a user; determining whether the acquired brain information corresponds to two different first and second commands; presenting information evoking the second command; after acquiring brain information corresponding to the first command, executing a process corresponding to the first command when it is determined that brain information corresponding to the second command has been acquired; setting the second command and notifying a user of the second command, and changing the second command when a preset update condition is met; An operation control method comprising:

6. acquiring brain information of a user; determining whether the acquired brain information corresponds to two different first and second commands; presenting information evoking the second command; after acquiring brain information corresponding to the first command, executing a process corresponding to the first command when it is determined that brain information corresponding to the second command has been acquired; setting the second command and notifying a user of the second command, and changing the second command when a preset update condition is met; A program that causes a computer to execute the following.

Images