Information processing device and information processing method

Abstract

To provide a method for preventing a trouble even if a user cannot make normal determination due to a body condition or the like in a biological information processing device.SOLUTION: An information processing device has a processor. The processor acquires biological information showing a user's condition when the user gives an instruction, limits the instruction in the case that the user cannot make normal determination on the basis of the biological information, and accepts the instruction in the case that the user can make the normal determination on the basis of the biological information.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an information processing device and an information processing method. [Background technology]

[0002] Patent Document 1 describes a personal authentication device that, in addition to verifying the identity of a user through existing biometric authentication, detects when the user is forced to perform an unauthorized operation.

[0003] Patent Document 2 describes a health management system that grasps the mental and physical conditions of the human body and manages the health of the human body.

[0004] Patent document 3 describes an authentication method for determining whether a service user is a legitimate user by acquiring the ID of the service user, acquiring the biometric information of the service user, and comparing the acquired biometric information with registered biometric information indicated by the acquired ID. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2005-293209 A [Patent Document 2] JP 2014-018234 A [Patent Document 3] JP 2005-148982 A Summary of the Invention [Problem to be solved by the invention]

[0006] However, there are cases where a person is unable to make correct decisions due to physical condition or other reasons.

[0007] An object of the present invention is to prevent instructions given by a user from being executed depending on the state of the user. [Means for solving the problem]

[0008] The invention according to claim 1 has a processor, the processor acquiring biometric information indicating a state of the user when an instruction is given by the user, and restricting the instruction when the user is in a state where he / she is unable to make a normal decision based on the biometric information, and accepting the instruction when the user is in a state where he / she is able to make a normal decision based on the biometric information, and when the instruction is restricted: A message prompting the user to act on behalf of the instruction or a message requesting the user to act on behalf of the instruction, Biological information that indicates normal judgment is measured other User Transmitted to the terminal device used by The present invention is an information processing device.

[0009] The invention according to claim 2 is characterized in that, when the cause of the state in which the user is unable to make a correct decision is illness, the processor restricts the acceptance of all instructions, and when the cause of the state in which the user is unable to make a correct decision is other than illness, Pre-determined content instructions of Restrict acceptance and accepting an instruction other than the predetermined content. The information processing device according to claim 1.

[0010] The invention according to claim 3 is the information processing device according to claim 1 or 2, wherein the biological information is an electroencephalogram.

[0011] The invention according to claim 4 includes a step of acquiring biometric information indicating a state of the user when the user gives an instruction, a step of restricting the instruction when the user is in a state where the user cannot make a normal decision based on the biometric information, and If the user is in a state where he or she can make a normal decision based on the received command, the instruction is accepted. If the instruction is restricted, A message prompting the user to act on behalf of the instruction or a message requesting the user to act on behalf of the instruction, Biological information that indicates normal judgment is measured other User Transmitted to the terminal device used by and a step of causing the information processing method to Effect of the Invention

[0012] According to the invention as set forth in claims 1, 2 and 4, it is possible to prevent an instruction given by a user from being executed depending on the state of the user. [Brief description of the drawings]

[0013] [Figure 1] 1 is a block diagram showing a configuration of an information processing system according to an embodiment of the present invention. [Diagram 2] 1 is a block diagram showing a configuration of an information processing device according to an embodiment of the present invention. [Diagram 3] FIG. 13 illustrates a management table. [Figure 4] FIG. 13 illustrates a management table. [Diagram 5] FIG. [Figure 6] FIG. 2 is a diagram showing a schematic diagram of a user, a robot, etc. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] An information processing system according to this embodiment will be described with reference to Fig. 1. Fig. 1 shows an example of the configuration of the information processing system according to this embodiment.

[0015] The information processing system according to this embodiment includes an information processing device 10, one or more biological information measuring devices 12, one or more devices 14, and one or more service providing devices 16. The number of devices shown in Fig. 1 is merely an example. The information processing system may include devices (e.g., devices such as servers) other than the devices shown in Fig. 1. Note that the devices 14 and the service providing devices 16 do not have to be included in the information processing system.

[0016] Each device included in the information processing system is configured to communicate with other devices. The communication may be wired communication using a cable, or wireless communication. That is, each device may be physically connected to other devices by a cable and transmit and receive information to each other, or may transmit and receive information to each other by wireless communication. For example, short-range wireless communication or Wi-Fi (registered trademark) is used as wireless communication. Wireless communication of other standards may also be used. For example, short-range wireless communication is Bluetooth (registered trademark), RFID (Radio Frequency Identifier), NFC, etc. Each device may communicate with other devices via a communication path such as a LAN (Local Area Network) or the Internet.

[0017] The information processing device 10 is, for example, a personal computer (hereinafter referred to as "PC"), a tablet PC, a smartphone, a mobile phone, or other devices (for example, a server, etc.). The information processing device 10 may be a terminal device that a user can carry (for example, a tablet PC, a smartphone, a mobile phone, etc.), or may be a device that is installed on a table or the like and used. The information processing device 10 may be a smart speaker having a communication function, a microphone, and a speaker. The information processing device 10 may be installed indoors (for example, a floor, ceiling, or table of a room) or outdoors. The information processing device 10 may also be a mobile device (for example, a self-propelled device).

[0018] The biological information measuring device 12 is a device configured to measure biological information of a user. For example, the biological information measuring device 12 has various sensors, electrodes, etc., and measures biological information of a user. When multiple biological information measuring devices 12 are used, each biological information measuring device 12 may measure different types of biological information. Some or all of the multiple biological information measuring devices 12 may measure the same type of biological information. Furthermore, the biological information measuring device 12 may be configured to measure one type of biological information, or may be configured to measure multiple types of biological information.

[0019] The vital information measuring device 12 transmits the measured vital information to the information processing device 10. The vital information measuring device 12 may transmit the vital information to the information processing device 10 every time the vital information is measured, may store the vital information and transmit the vital information to the information processing device 10 at predetermined time intervals, or may transmit the vital information to the information processing device 10 at a timing designated by a user. In addition, the vital information measuring device 12 may receive vital information measured by another vital information measuring device 12 from the other vital information measuring device 12, and transmit the vital information measured by the vital information measuring device 12 and the vital information measured by the other vital information measuring device 12 to the information processing device 10.

[0020] The vital information measuring device 12 may analyze vital information measured by itself or another vital information measuring device 12, and transmit information indicating the result of the analysis to the information processing device 10. The vital information measuring device 12 may include a processor and a storage device, and the processor may analyze the vital information. The analysis may be performed by the information processing device 10, the device 14, the service providing device 16, or another device.

[0021] The biological information measuring device 12 may include a battery and be driven by power supplied from the battery, or may be driven by power supplied from another device (such as the information processing device 10).

[0022] The biological information measuring device 12 may be installed on a user. For example, the biological information measuring device 12 may be a wearable device that is worn by a user to measure biological information. To give a specific example, the biological information measuring device 12 may be a device worn on the user's head (for example, the forehead, etc.), a hearable device worn on the user's ear (for example, earphones, headphones, etc.), a device worn on the user's arm, hand, wrist, finger, etc. (for example, a watch-type device such as a smart watch, etc.), a device worn around the user's neck, a device worn on the user's torso (for example, the abdomen, chest, etc.), or a device worn on the user's lower limbs (for example, the thighs, lower legs, knees, feet, ankles, etc.). The biological information measuring device 12 may be a health tool or the like worn on the user's arm, hand, torso, or lower limbs. The biological information measuring device 12 may be worn on other parts of the body. In addition, the biological information measuring device 12 may be worn on each of a plurality of parts of the body.

[0023] Biometric information is various physiological information and anatomical information emitted from a living user. The concept of biological information includes, for example, information indicating brain activity (for example, brain waves, cerebral blood flow, brain magnetic field signals, etc.), information indicating pulse rate, myoelectric information such as myoelectric waveform, information on saliva (for example, information indicating saliva volume), information indicating pulse wave, information indicating blood pressure, information indicating blood flow, information indicating pulse, information indicating heart rate, information indicating electrocardiogram waveform, information indicating eye movement, information indicating body temperature, information indicating sweat amount, information indicating gaze, voice information, and information indicating user movement. Information specified by a biomarker may also be used as biological information. These are merely examples of biological information, and other physiological information and anatomical information may also be used as biological information. The biological information measuring device 12 may measure one of these biological information, or may measure multiple biological information.

[0024] The concept of bioinformation also includes bioelectric potential information that indicates an electric potential measured from a living organism. The concept of bioelectric potential information includes, for example, an electroencephalogram that is a measurement result of a microcurrent generated with brain activity, an electrocardiogram that is a measurement result of a microcurrent generated with heartbeat, an electromyogram that is a measurement result of a microcurrent generated with muscle activity, and a skin potential that is a measurement result of a microcurrent generated on the skin. These are merely examples of bioelectric potential information, and other bioelectric potential information may also be used.

[0025] The information processing device 10 receives biometric information from the biometric information measuring device 12, and performs the following operations: analyzing the biometric information, storing the biometric information, outputting the biometric information, storing information indicating the analysis result of the biometric information, and outputting information indicating the analysis result of the biometric information. Of course, the analysis of the biometric information may be performed by the biometric information measuring device 12, the device 14, the service providing device 16, or other devices. Outputting the biometric information means, for example, displaying the biometric information or outputting the biometric information as audio information. Outputting information indicating the analysis result of the biometric information means, for example, displaying information indicating the analysis result or outputting the analysis result as audio information. The information processing device 10 may transmit the biometric information or information indicating the analysis result to another device.

[0026] The information processing device 10 may include one or more biological information measuring devices 12. That is, one or more biological information measuring devices 12 may be incorporated into the information processing device 10 to configure one device. The entire information processing device 10 including one or more biological information measuring devices 12 may be worn by a user to measure biological information. That is, the information processing device 10 may be a wearable device. For example, the information processing device 10 may be a device worn on the user's head (e.g., forehead, etc.), a hearable device worn on the user's ear (e.g., earphones, headphones, etc.), a device worn on the user's arm, hand, wrist, finger, etc. (e.g., a watch-type device such as a smart watch), a device hung around the user's neck, a device worn on the user's torso (e.g., abdomen, chest, etc.), or a device worn on the user's lower limbs (e.g., thighs, lower legs, knees, feet, ankles, etc.). The information processing device 10 may be a health tool worn on the user's hand, torso, or lower limbs. The information processing device 10 may be attached to a part other than these.

[0027] Of course, the information processing device 10 and the biological information measuring device 12 may be separate devices. For example, the information processing device 10 may be a smart speaker, and the biological information measuring device 12 may be a wearable device worn by a user.

[0028] The device 14 is, for example, a PC, a tablet PC, a smartphone, a mobile phone, a robot (for example, a humanoid robot, a non-human animal-type robot, a cleaning robot, and other robots), a display device such as a projector or a liquid crystal display, a recording device, a playback device, a photographing device such as a camera, a refrigerator, a rice cooker, a microwave oven, a coffee maker, a vacuum cleaner, a washing machine, an air conditioner, a lighting device, a health appliance, a clock, a surveillance camera, an automobile, a two-wheeled vehicle, an aircraft (for example, an unmanned aerial vehicle (for example, a drone)), a game machine, a gas range, a warm water washing toilet seat, a ventilation fan, a doorbell, a front door monitor, an elevator, a door, a window, or various sensing devices (for example, a temperature sensor, a humidity sensor, a voltage sensor, a current sensor, etc.). The category of the concept of the device 14 may include devices in general. For example, information devices, video devices, audio devices, and other devices may also be included in the category of the device 14 according to this embodiment.

[0029] The device 14 includes, for example, a communication device that is a communication interface, a storage device that stores data, and a processor that controls the operation of the device 14. The device 14 may include a user interface. The device 14 may transmit device identification information for identifying the device 14 to the information processing device 10. The device identification information is, for example, the ID, name, model number, or address (e.g., MAC address, IP address, etc.) of the device 14.

[0030] The service providing device 16 is a device configured to provide various services. The services are, for example, Web services. The Web services are, for example, services that provide applications on a network such as the Internet, and other services. For example, Web mail, SNS (social networking service), services that provide videos and music on the Internet, services that sell and reserve products on the Internet, search services on the Internet, services that provide information on the Internet, and services that provide payment methods on the Internet are examples of Web services. Of course, services other than these may be provided by the service providing device 16.

[0031] The service providing device 16 includes, for example, a communication device that is a communication interface, a storage device that stores data, and a processor that controls the operation of the service providing device 16. The service providing device 16 may have a user interface. For example, when the processor of the service providing device 16 receives a request for the provision of a service, it provides the service in response to the request.

[0032] The configuration of the information processing device 10 will be described in detail below with reference to Fig. 2. Fig. 2 shows an example of the configuration of the information processing device 10.

[0033] The information processing device 10 includes, for example, a communication device 18, a UI 20, a storage device 22, and a processor 24. The information processing device 10 may include components other than these.

[0034] The communication device 18 is a communication interface and has a function of transmitting data to other devices and a function of receiving data transmitted from other devices. The communication device 18 may have a wireless communication function or a wired communication function. The communication device 18 may communicate with other devices by using, for example, short-distance wireless communication, or may communicate with other devices via a communication path such as a LAN or the Internet. For example, the communication device 18 receives biological information transmitted from the biological information measuring device 12. The communication device 18 may transmit control information for controlling the operation of the biological information measuring device 12 to the biological information measuring device 12. The communication device 18 may also transmit control information for controlling the operation of the device 14 to the device 14 and receive information transmitted from the device 14. The communication device 18 may also transmit information indicating a request for provision of a Web service to the service providing device 16 and receive information related to the Web service from the service providing device 16.

[0035] The UI20 is a user interface and includes at least one of a display device and an operation device. The display device is a liquid crystal display, an EL display, or the like. The operation device is a keyboard, an input key, an operation panel, or the like. The UI20 may be a UI such as a touch panel that combines a display device and an operation device. The UI20 may also include a microphone, or a speaker that emits sound.

[0036] The storage device 22 is a device that configures one or more storage areas for storing data. The storage device 22 is, for example, a hard disk drive, various types of memory (e.g., RAM, DRAM, ROM, etc.), other storage devices (e.g., optical disks, etc.), or a combination thereof. One or more storage devices 22 are included in the information processing device 10.

[0037] Management information is stored in the storage device 22. The management information is information for estimating a user's condition based on biometric information measured from the user. For example, reference biometric information, status information indicating the user's condition, and reception restriction information are associated with each other in advance and registered in the management information.

[0038] The reference biometric information is biometric information that is assumed to be generated from a user having a state indicated by the status information linked to the reference biometric information. For example, the reference biometric information is determined by statistical processing, and is biometric information that is assumed to be generally generated from a user having a state indicated by the status information linked to the reference biometric information.

[0039] For example, the state of a user is the mental state of the user. The reference biometric information linked to state information indicating the mental state of the user can be said to be biometric information indicating the mental state of the user. The state of a user may be a state other than the mental state of the user (e.g., emotion, physical state, etc.). For example, the state information is information indicating whether the user can make a correct decision when giving a certain instruction.

[0040] The reception restriction information is information indicating whether or not to restrict reception of instructions given by a user. Whether or not to restrict reception of instructions is determined depending on the state of the user.

[0041] When a user is not in a state where he / she can make a normal decision, the acceptance of instructions given by the user is restricted. For example, when the status information is information indicating that the user is not in a state where he / she can make a normal decision, the acceptance restriction information linked to the status information is information indicating that the acceptance of instructions given by the user is restricted.

[0042] When the user is in a state where the user can make normal decisions, the acceptance of instructions given by the user is not restricted. For example, when the status information is information indicating that the user is in a state where the user can make normal decisions, the acceptance restriction information linked to the status information is information indicating that the acceptance of instructions given by the user is not restricted.

[0043] The instruction given by the user is, for example, an instruction for payment, an instruction for deciding on a contract, an instruction for some other decision or judgment, etc. The instruction given by the user may be an instruction for the device 14 or the service providing device 16. The instruction for the device 14 is, for example, an instruction for operating the device 14. The instruction for operating the device 14 may include the operation content of the device 14. The instruction for the service providing device 16 is, for example, an instruction for using a service provided by the service providing device 16. To explain by giving a specific example, the instruction for the service providing device 16 is an instruction for payment to use a service provided by the service providing device 16, an instruction for purchasing a product, an instruction for purchasing a service, an instruction for logging in or authentication to use a service provided by the service providing device 16, an instruction for membership registration, an instruction for withdrawal, or other instructions other than these. The instruction given by the user is not limited to these, and may be an instruction for some decision or judgment.

[0044] For example, the user may give instructions to the information processing device 10 by operating the UI 20, may give instructions to the information processing device 10 by voice, or may give instructions to the information processing device 10 by using biometric information.

[0045] The user's instruction may be input to the device 14, the service providing device 16, etc., via the information processing device 10 or without via the information processing device 10.

[0046] Furthermore, the user's instructions may be input to a terminal device (for example, a PC, a notebook PC, a smartphone, or a mobile phone) used by the user.

[0047] For each user, the reference biometric information, the status information, and the reception restriction information may be associated with each other and registered in the management information.

[0048] The processor 24 is configured to acquire biometric information of a user when the user gives an instruction, and to limit acceptance of the instruction according to a state indicated by the biometric information.

[0049] When the user's biometric information is measured by the biometric information measuring device 12, the biometric information is transmitted from the biometric information measuring device 12 to the information processing device 10, and the processor 24 acquires the biometric information transmitted from the biometric information measuring device 12. The processor 24 may continuously acquire the user's biometric information even if no instruction is given by the user, may acquire the user's biometric information measured at the time when the instruction is given by the user, may acquire the user's biometric information measured in a period before and after the time when the instruction is given by the user, or may acquire the user's biometric information measured in a period before or after the time when the instruction is given by the user. The periods before and after, the previous period, and the subsequent period are each a predetermined period and may be changed by the user, etc.

[0050] The processor 24 acquires the biometric information of the user from the biometric information measuring device 12 when the user gives an instruction, and limits acceptance of the instruction according to the state indicated by the biometric information.

[0051] More specifically, the processor 24 compares the biometric information of the user with each reference biometric information registered in the management information, and searches for reference biometric information whose difference from the biometric information is within an allowable range. The processor 24 estimates the state indicated by the state information linked to the searched reference biometric information as the state of the user. The processor 24 restricts the acceptance of an instruction given by the user, or does not restrict the acceptance of the instruction, according to the acceptance restriction information linked to the state information. That is, the processor 24 estimates whether the state of the user when the user gives an instruction is a state in which the user can make a normal judgment, based on the biometric information of the user when the user gives an instruction. Then, when the user is in a state in which the user cannot make a normal judgment, the processor 24 restricts the acceptance of the instruction, and when the user is in a state in which the user can make a normal judgment, does not restrict the acceptance of the instruction. The allowable range is determined in advance. The allowable range may be determined for each user. The allowable range may be changed by the user, etc.

[0052] Restricting the acceptance of instructions may mean, for example, not accepting instructions, prohibiting the user from inputting instructions, accepting instructions but disabling the acceptance of the instructions, or accepting instructions but not performing processing, operation, or control in accordance with the instructions.

[0053] For example, if the instruction is an instruction for payment or contract conclusion, processor 24 may not accept the instruction, may accept the instruction but invalidate the instruction, or may accept the instruction but not make the payment or contract in accordance with the instruction.

[0054] Furthermore, if the instruction is directed to device 14, processor 24 may not accept the instruction, may accept the instruction but disable the instruction, or may accept the instruction but not operate device 14 in accordance with the instruction.

[0055] In addition, if the instruction is an instruction for the service providing device 16, the processor 24 may not accept the instruction, may accept the instruction but invalidate the instruction, or may accept the instruction but not transmit information indicating the instruction to the service providing device 16.

[0056] Restricting the acceptance of instructions may mean restricting the acceptance of all instructions, or may mean restricting the acceptance of some instructions but not restricting the acceptance of other instructions.

[0057] The processor 24 may change the content of the restriction on the reception of instructions depending on the state of the user. For example, the content of the restriction is determined depending on the degree of the state in which the user is unable to make a normal decision, and reception restriction information indicating the content of the restriction is linked to the state information and registered in the management information. For example, the processor 24 may restrict the reception of all instructions when the user is in a state in which the user is unable to make a normal decision due to an illness such as epilepsy or depression, and may restrict the reception of only some instructions when the user is in a state in which the user is unable to make a normal decision due to a cause other than the illness. The some instructions may be determined in advance or by the user.

[0058] In addition, when multiple reference biometric information are searched for, the difference between the reference biometric information of the user and the reference biometric information falls within the acceptable range, the processor 24 identifies, from the multiple reference biometric information, the reference biometric information that has the smallest difference from the biometric information of the user.

[0059] The reference biometric information may be information indicating a characteristic component of the biometric information. In this case, the processor 24 may extract a characteristic component from the user's biometric information and search for reference biometric information having a component whose difference from the extracted component is within an allowable range. For example, when an electroencephalogram is used as the biometric information, the processor 24 may extract a characteristic component from the measured electroencephalogram and analyze the component to infer the operation content represented by the electroencephalogram.

[0060] In addition, in order to analyze the user's brain activity (e.g., brain waves, etc.), a fast Fourier transform (FFT), a wavelet transform (WT), a time frequency distribution (TFD), an eigenvector method (EM), an auto regressive method (ARM), etc. may be used.

[0061] The biometric information of the user when the instruction is given by the user may be biometric information of the user measured at the time when the instruction is given by the user, or may be biometric information of the user measured in a period before and after the time when the instruction is given by the user, or may be biometric information of the user measured in a period before or after the time when the instruction is given by the user. The periods before and after, the previous period, and the subsequent period are each a predetermined period, and may be changed by the user, etc.

[0062] For example, when it is estimated that the user is in a state where he or she cannot make a normal decision based on the user's biological information measured during a period before the user gives an instruction, the processor 24 restricts the reception of the instruction. In this case, the processor 24 may not receive the instruction, may prohibit the input of the instruction, may receive the instruction but invalidate the reception of the instruction, or may receive the instruction but not perform processing, operation, or control according to the instruction.

[0063] If it is estimated based on the user's biometric information measured at the time or for a period thereafter when the user gives an instruction that the user is in a state in which the user is unable to make normal judgments, the processor 24 may accept the instruction but invalidate the acceptance of the instruction, or may accept the instruction but not perform any processing, operation or control in accordance with the instruction.

[0064] Moreover, the processor 24 is configured to control the operation of each unit of the information processing device 10. The processor 24 may include a memory.

[0065] The processing by the processor 24 may be executed by a device other than the information processing device 10 (for example, the device 14, the service providing device 16, or other devices). Information indicating the result of the processing may be transmitted to the information processing device 10 and displayed on the display device of the UI 20 or output as audio information.

[0066] For example, the device 14 or the service providing device 16 may limit the reception of an instruction given by a user. For example, when an instruction to the device 14 is given by a user, the processor 24 estimates whether or not the user is in a state where he or she can make a normal judgment based on the biometric information of the user, and transmits information indicating the result of the estimation and information indicating the instruction to the device 14 to which the instruction was given. The device 14 limits the reception of the instruction according to the result of the estimation. When the user is in a state where he or she can make a normal judgment, the device 14 does not limit the reception of the instruction, and when the user is in a state where he or she cannot make a normal judgment, the device 14 limits the reception of the instruction. Similarly, when an instruction is given to the service providing device 16, the service providing device 16 may limit the reception of the instruction given by the user.

[0067] The processor 24 may also transmit the biometric information before analysis to the device 14 or the service providing device 16, and the device 14 or the service providing device 16 may estimate whether the user is in a state where he or she can make normal decisions based on the biometric information, and limit the acceptance of the instruction depending on the result of the estimation. In this case, the management information is stored in the device 14 or the service providing device 16.

[0068] Furthermore, a user's instruction may be input to a terminal device (e.g., a PC, a notebook PC, a smartphone, or a mobile phone) used by the user, and a determination as to whether or not to restrict reception of the instruction may be made by the information processing device 10, the device 14, the service providing device 16, or another device. If it is not determined that reception of the instruction is to be restricted, the instruction is accepted by the terminal device, and information indicating the instruction is transmitted to the device 14, the service providing device 16, or another device via the information processing device 10 or without the information processing device 10. If it is determined that reception of the instruction is to be restricted, the terminal device may restrict reception of the instruction, the information processing device 10 may restrict reception of the instruction, or the device 14, the service providing device 16, or another device may restrict reception of the instruction.

[0069] A specific example of the management information will be described below.

[0070] 3 shows an example of a management table, which is an example of management information. The data of the management table is stored in the storage device 22. The data of the management table may not be stored in the storage device 22, but may be stored in a device other than the information processing device 10 (for example, a device such as the device 14, the service providing device 16, or a server).

[0071] In the management table, an ID, a reference electroencephalogram, status information, and reception restriction information are linked to each other.

[0072] The ID is information for managing the information registered in the management table.

[0073] The reference electroencephalogram is an example of reference bioinformation. Here, an electroencephalogram is used as an example of reference bioinformation, but bioinformation other than an electroencephalogram may be used as the reference bioinformation. The reference electroencephalogram is, for example, an electroencephalogram determined by statistical processing and assumed to be generally generated by a user having a state indicated by the state information linked to the reference electroencephalogram. The reference electroencephalogram may be an electroencephalogram in a specific frequency band, or an electroencephalogram including signals in multiple frequency bands.

[0074] The state information is information indicating whether or not the user is in a state in which he or she can make normal judgments. The state information may be information indicating whether or not the user can make normal judgments on all matters, or may be information indicating whether or not the user can make normal judgments on a specific matter.

[0075] The acceptance restriction information is information indicating whether or not to restrict acceptance of instructions given by a user.

[0076] For example, the state information linked to the reference electroencephalogram of ID "1" indicates that the user's mental state is healthy and that the user is in a state where he or she can make normal decisions. Therefore, the reference electroencephalogram and state information of ID "1" are linked to acceptance restriction information indicating that acceptance of instructions is not restricted.

[0077] The status information linked to the reference electroencephalogram of ID "2" indicates that the user's mental state is slightly unwell, but the user is in a state where he or she can make decisions about transactions. Therefore, the reference electroencephalogram and status information of ID "2" are linked to acceptance restriction information indicating that acceptance of transaction instructions is not restricted, but acceptance of instructions other than transaction instructions is restricted.

[0078] The status information linked to the reference electroencephalogram of ID "3" indicates that the user's mental state is unsound and the user is in a state where he or she is unable to make normal decisions. Therefore, the reference electroencephalogram and the status information of ID "3" are linked to reception restriction information indicating that reception of instructions is restricted.

[0079] For example, if an electroencephalogram (EEG) measured from a user giving instructions falls within an acceptable range of difference from the reference electroencephalogram (EEG) of ID "1", the processor 24 presumes that the user is healthy and does not restrict the acceptance of instructions given by the user.

[0080] The processor 24 may also calculate a similarity between the electroencephalogram measured from the user and the reference electroencephalogram, and determine whether the similarity is equal to or greater than a threshold. The threshold is a value corresponding to an allowable range. If the similarity between the electroencephalogram measured from the user and the reference electroencephalogram is equal to or greater than the threshold, the processor 24 determines that the electroencephalogram measured from the user and the reference electroencephalogram are similar. In other words, the processor 24 determines that the difference between the electroencephalogram measured from the user and the reference electroencephalogram is within an allowable range. If an electroencephalogram is measured from the user whose similarity with the reference electroencephalogram of ID "1" is equal to or greater than a threshold, the processor 24 does not restrict the acceptance of instructions given by the user.

[0081] Note that the device 14 or the service providing device 16 may determine whether or not to limit the acceptance of instructions given by the user based on the management table shown in FIG. 3, and may limit the acceptance of the instructions.

[0082] For each user, the reference biometric information, the status information, and the reception restriction information may be associated with each other and registered in the management table. For example, biometric information measured from a user may be registered in the management table as the reference biometric information of the user.

[0083] Fig. 4 shows an example of a management table in which specific reference biometric information of each user is registered. In the management table shown in Fig. 4, an ID, user information, a reference electroencephalogram which is an example of reference biometric information, status information, and reception restriction information are linked together. The user information is information for identifying a user (e.g., a user name, a user ID, etc.).

[0084] The reference electroencephalogram linked to the user information is an electroencephalogram measured from the user indicated by the user information when the user has a state indicated by the state information linked to the reference electroencephalogram. For example, the electroencephalogram of the user is measured in advance for each user and for each state, and each measured electroencephalogram is registered in the management table as a reference electroencephalogram.

[0085] For example, when user A is in a healthy mental state and can make a normal decision, the user A's brain waves are measured, and the measured brain waves are linked to the user information of user A and status information indicating the status of "being in a healthy mental state and being able to make a normal decision" and registered in the management table. In this case, the user information and the status information are linked to reception restriction information indicating the content of "not restricting reception of instructions." These registrations may be performed by the information processing device 10 or by another device. In the example shown in FIG. 4, these pieces of information are registered as information of ID "1." The same applies to other status information and information about other users.

[0086] The registration process may be repeated multiple times, and the average of the multiple electroencephalograms thus measured may be registered as the reference electroencephalogram.

[0087] For example, when user A is logged in to the information processing device 10, if an electroencephalogram is measured from user A and the difference from the reference electroencephalogram of ID "1" falls within an allowable range, the processor 24 estimates that user A is healthy and in a state where he or she can make normal decisions. In this case, the processor 24 does not restrict the acceptance of instructions given by user A.

[0088] When an electroencephalogram measured from user A includes a difference from the reference electroencephalogram of ID "2" within an allowable range, processor 24 estimates that the user is in a slightly unwell state but is in a state where he or she can make a decision on a transaction. In this case, processor 24 does not restrict the acceptance of transaction instructions, but restricts the acceptance of instructions other than transaction instructions.

[0089] When an electroencephalogram is measured from user A, the difference from the reference electroencephalogram of ID "3" being within the allowable range, processor 24 estimates that the user is in an unhealthy state and is unable to make normal decisions. In this case, processor 24 restricts the acceptance of instructions given by the user.

[0090] As for users other than user A, the information of each user is registered in the management table in the same manner as for user A.

[0091] The processes performed in the information processing system according to this embodiment will be described in more detail below.

[0092] When the acceptance of an instruction given by a user is restricted, the processor 24 may output information indicating that the acceptance of the instruction is restricted. For example, the processor 24 may display the information on the display device of the UI 20, may emit the information as audio information from a speaker, or may transmit the information to a terminal device used by the user and display the information on the terminal device. To explain this by taking a specific example, when the processor 24 does not accept an instruction given by a user, it outputs information indicating that the instruction is not accepted.

[0093] Fig. 5 shows an example of displaying information indicating that reception of instructions is restricted. Fig. 5 shows a screen 26. For example, the screen 26 may be a screen displayed on a display device of the UI 20, or may be a screen displayed on a display device of a terminal device used by a user.

[0094] A message is displayed on the screen 26. The message indicates that the user is not in a state where he or she can make a normal judgment and that the reception of instructions will be restricted. This message can also be said to be a warning indicating that the reception of instructions will be restricted. For example, if it is determined that the user is unable to make a normal judgment due to poor physical condition, illness, or the like, the warning is displayed. The message may be displayed on the screen 26, or may be output as sound from a speaker without being displayed on the screen 26.

[0095] The message shown in FIG. 5 may be displayed when the user actually gives an instruction using the UI 20 or his / her own terminal device, or may be displayed when the user's state is estimated based on the user's biometric information regardless of whether the user actually gives an instruction, or may be displayed when the user gives an instruction. The user gives an instruction, for example, when making a payment, when concluding a contract, or when it is necessary to make a decision other than those. As a specific example, in a situation where a product is purchased at a shopping site on the Internet, the message may be displayed before instructing the purchase of the product, or after instructing the purchase of the product and before instructing the final payment. In addition, the message may be displayed when the user accesses the shopping site, or may be displayed when the user logs in to the shopping site. Taking a shopping site as an example, the acceptance of instructions given by the user is restricted, so that it is possible to prevent the user from purchasing products or services that are not necessarily necessary for the user. In addition, the user can recognize whether or not he / she can make a normal decision regarding the purchase of products or services.

[0096] In addition, if the user is under mental pressure due to reasons other than poor physical condition or illness, such as being pressured by a salesperson, a message indicating that the user is unable to make proper decisions may be displayed or the message may be spoken aloud.

[0097] When the acceptance of an instruction given by a user is not restricted, the processor 24 may output information indicating that the acceptance of the instruction is not restricted. For example, the processor 24 may cause the information to be displayed on a display device of the UI 20, may cause the information to be emitted as audio information from a speaker, or may transmit the information to a terminal device used by the user and cause the terminal device to display the information.

[0098] Taking instructions regarding transactions such as settlement and contract conclusion as an example, a transaction such as settlement and contract conclusion that is conducted without restrictions on the reception of instructions can be said to be a transaction such as settlement and contract conclusion that is conducted in a state where the parties can make normal judgments. If a transaction such as settlement and contract conclusion is conducted when the parties are normal, it is presumed that the transaction is concluded normally. For example, a transaction is concluded when both the buyer and seller of a product or service can make normal judgments. It can be said that whether or not the reception of instructions is restricted reflects the reliability of the transaction. In other words, a transaction such as settlement and contract conclusion that is conducted without restrictions on the reception of instructions is presumed to be a transaction that is concluded normally. It may also be determined whether or not the buyer of a product is in a state where he or she can make normal judgments at the time of receiving the product. If the buyer is normal at the time of settlement and is normal at the time of receiving the product, the buyer may not refuse to receive the product.

[0099] When the acceptance of an instruction given by a user is restricted (for example, when an instruction is not accepted), the processor 24 may notify status information indicating the status of the user to at least one of other users and devices such as a robot. The device may be the device 14 shown in Fig. 1, a robot for assisting the user, a device for performing some kind of work, or a terminal device used by the user.

[0100] FIG. 6 shows an example of the notification. Biometric information of the user 28 is measured, and the biological information is transmitted to the robot 30. The robot 30 is a device including the information processing device 10, and estimates whether the user 28 is in a state where he or she can make normal decisions based on the biological information, and restricts the reception of instructions given by the user 28 according to the result of the estimation. When the reception of instructions given by the user 28 is restricted, the processor 24 included in the robot 30 notifies the surrounding user 32 and the robot 34 of status information indicating the status of the user 28. The user 32 and the robot 34 may be, for example, a user or device detected by a sensor or the like provided in the robot 30, or a user or device registered in advance in the robot 30 as a notification destination of the status information. The processor 24 may emit a sound indicating the status from a speaker, may display an image indicating the status on a display device of the UI 20, or may transmit the status information indicating the status to a terminal device used by the user 32 and the robot 34. In this way, the user 32 and the robot 34 who receive the notification can recognize that the user 28 is not in a state where he or she can make normal decisions.

[0101] When the reception of an instruction given by a user is not restricted (for example, when an instruction is accepted), the processor 24 may notify at least one of other users and devices such as a robot of status information indicating the status of the user. To explain using the example shown in FIG. 6, the processor 24 included in the robot 30 notifies the user 32 and the robot 34 of status information indicating the status of the user 28. The method of notification may be the same as the method of notification when the reception of an instruction is restricted. The user 32 and the robot 34 that receive the notification can recognize that the user 28 is in a state where they can make normal decisions. For example, the user 32 and the robot 34 may perform work or communicate when the user 28 is in a state where they can make normal decisions.

[0102] It should be noted that the robot 30 does not need to include the information processing device 10. In this case, the biometric information is transmitted to the information processing device 10 via the robot 30, and the information processing device 10 estimates whether the user is in a state where he or she can make normal decisions. Information indicating the result of the estimation is transmitted from the information processing device 10 to the robot 30. The robot 30 notifies the user 32 and the robot 34 of status information indicating the user's status according to the result of the estimation.

[0103] The robot 30 may store history information indicating interactions with the user 28 and notify the user 28 of the history information. For example, the robot 30 may notify the user 28 of the state or a change in state of the user 28, or may notify the user 28 that the robot has been given authority to limit the reception of instructions.

[0104] The processor 24 may limit the acceptance of an instruction given by a user according to the history of the user's behavior and the state of the user. For example, behavior history information indicating the user's behavior history is stored in the information processing device 10 or another device (e.g., a server, etc.) for each user. The behavior history information may be stored in the robot 30 shown in FIG. 6. The behavior history is, for example, a history of purchasing products and services, a history of meals, a history of exercise, a history of movement, etc. For example, the robot 30 may detect the user's behavior and store the behavior history information indicating the history of the behavior. Of course, the behavior history information may be stored in the information processing device 10, the robot 30, or another device by an operation by the user. The user's behavior may be detected by a device other than the robot 30.

[0105] For example, based on the user's purchase history, it is determined whether the user has a wasteful habit. The determination may be made by the processor 24 or by a device other than the information processing device 10. For example, when it is estimated based on the biometric information of a user with a wasteful habit that the user is in a state in which the user is unable to make normal decisions, the processor 24 restricts the acceptance of instructions given by the user. For example, the processor 24 restricts the acceptance of instructions to purchase products or services, but does not restrict the acceptance of other instructions.

[0106] Furthermore, based on the user's eating history, it is determined whether the user has symptoms of bulimia. This determination may be made by the processor 24, or may be made by a device other than the information processing device 10. For example, when it is estimated based on the biological information of a user with symptoms of bulimia that the user is not in a state where he or she can make normal decisions, the processor 24 restricts the acceptance of instructions given by the user. For example, the processor 24 restricts the acceptance of instructions to purchase or order food and drink (e.g., food, provisions, dishes, etc.).

[0107] When the reception of an instruction given by a user is restricted, the processor 24 may suspend the execution of the instruction given by the user. For example, when it is estimated based on the biometric information of the user that the user is unhealthy and not in a state where the user can make a normal judgment, the processor 24 suspends the execution of the instruction given by the user. In this case, the processor 24 stores information indicating the content of the instruction given by the user in the storage device 22 or another device. Then, when the reception of the instruction given by the user is no longer restricted, the processor 24 outputs a notification urging the user to execute the suspended instruction. For example, when it is estimated based on the biometric information of the user that the user is healthy and in a state where the user can make a normal judgment, the processor 24 outputs a notification urging the user to execute the suspended instruction. For example, the processor 24 may display information urging the user to execute the suspended instruction on the display device of the UI 20, may transmit the information to a terminal device used by the user and display the information on the terminal device, or may emit a sound representing the information from a speaker.

[0108] To explain this with a specific example, if a payment instruction is given when the user is in poor physical condition, the processor 24 reserves the payment instruction. After that, when the user's physical condition improves, the processor 24 outputs a notification urging the user to execute the payment.

[0109] When the acceptance of an instruction given by a user is restricted, the processor 24 may output a notification to another user who is capable of giving instructions on behalf of the user, urging the user to give the instruction instead. That is, the processor 24 outputs a notification to another user who is capable of giving instructions on behalf of the user whose acceptance of instructions is restricted, urging the user to give the instruction. For example, when it is estimated based on the biometric information of a user that the user is unhealthy and not in a state where the user can make a normal judgment, the processor 24 outputs a notification to another user who is capable of giving the instruction on behalf of the user, urging the user to give the instruction on behalf of the user.

[0110] The other user who can substitute instructions is a user whose acceptance of instructions is not restricted. For example, the other user who can substitute instructions is a user whose biological information indicating a sound mental state is measured. In other words, the other user who can substitute instructions is a user who is presumed to be able to make a normal judgment. For example, the biological information of the other user is measured by the biological information measuring device 12, and the biological information of the other user is transmitted from the biological information measuring device 12 to the information processing device 10. The processor 24 estimates the state of the other user based on the biological information of the other user. When there are multiple other users who are in a sound mental state and can make a normal judgment, the processor 24 may output a notification to the other user who is presumed to be the most normal, prompting the other user to substitute instructions.

[0111] Outputting a notification to prompt a user to perform an instruction on behalf of another user includes, for example, transmitting a message prompting the user to perform an instruction on behalf of another user or a message requesting the user to perform the instruction on behalf of another user, emitting a voice representing the message from a speaker, or displaying the message on a display device of the UI 20. The other user who receives the message may give an instruction on behalf of the user whose instruction acceptance is restricted. For example, the other user may give an instruction to settle a purchase of a product, to conclude a contract, or give other instructions on behalf of the user whose instruction acceptance is restricted. The other user may give the instruction that the user whose instruction acceptance is restricted is about to give at the request of the user whose instruction acceptance is restricted.

[0112] The processor 24 may store, for each user, biometric information measured from the user when an instruction is given by the user, which indicates that the user is healthy, in the storage device 22. That is, the processor 24 may store, in the storage device 22 or another device, biometric information measured when the user is healthy. Such biometric information may be measured multiple times, and the multiple pieces of biometric information or an average of the multiple pieces of biometric information may be stored in the storage device 22 or another device as biometric information measured when the user is healthy.

[0113] Then, for each user, if the biometric information of the user at the time when the instruction is given is within a similarity range of the biometric information stored in the storage device 22 or another device, the processor 24 accepts the instruction without restricting the acceptance of the instruction. For example, if the difference between the biometric information measured from the user at the time when the instruction is given and the biometric information of the user stored in the storage device 22 or another device is within an allowable range, the biometric information measured from the user at the time when the instruction is given is biometric information that is within the similarity range of the biometric information of the user stored in the storage device 22 or another device.

[0114] Although the healthy state (for example, normal or good state) may differ depending on the user, by storing the biometric information of each user in a healthy state, it is possible to limit the acceptance of instructions by taking such differences into consideration. It is also possible to prevent instructions from being given by impersonating another person.

[0115] When the biometric information of a user who gives an instruction is not measured, the processor 24 may restrict the reception of the instruction. For example, when the biometric information of a user is not measured, the processor 24 does not receive an instruction given by the user. In this way, it is possible to prevent an instruction from being given by a user whose biometric information is not measured.

[0116] In each of the above embodiments, the term "processor" refers to a processor in a broad sense, and includes general-purpose processors (e.g., CPU: Central Processing Unit, etc.) and dedicated processors (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, programmable logic device, etc.). Furthermore, the operation of the processor in each of the above embodiments may not only be performed by one processor, but may also be performed by multiple processors located at physically separate locations working together. Furthermore, the order of each operation of the processor is not limited to the order described in each of the above embodiments, and may be changed as appropriate. [Explanation of symbols]

[0117] 10 information processing device, 12 vital sign measuring device, 14 equipment, 16 service providing device, 24 processor.

Claims

1. A processor is included. The processor, acquiring biometric information indicative of a state of the user at the time when an instruction is given by the user; If the user is unable to make a normal decision based on the biological information, the instruction is restricted; If the user is in a state where he or she can make a normal decision based on the biological information, the instruction is accepted; When the instruction is restricted, a message prompting the other user to perform the instruction or a message requesting the other user to perform the instruction is transmitted to a terminal device used by the other user, the terminal device being used by the other user and having biological information measured that indicates that the other user can perform a normal judgment. Information processing device.

2. The processor, If the cause of the state in which the user is unable to make a normal decision is an illness, restricting the acceptance of all instructions; If the cause of the state in which the user is unable to make a normal judgment is something other than an illness, restricting the acceptance of instructions having predetermined contents and accepting instructions having contents other than the predetermined contents.

2. The information processing device according to claim 1.

3. The biological information is an electroencephalogram.

3. The information processing device according to claim 1 or 2.

4. acquiring biometric information indicative of a state of the user when an instruction is given by the user; restricting the instruction when the user is unable to make a normal decision based on the biological information; accepting the instruction when the user is in a state where he or she can make a normal decision based on the biological information; When the instruction is restricted, a message prompting the user to perform the instruction on his / her behalf or a message requesting the user to perform the instruction on his / her behalf is transmitted to a terminal device used by another user, the terminal device being used by the other user and having biological information measured that indicates that the user is capable of making a normal judgment. An information processing method comprising:

Images