Security system, security method and program
The system uses electroencephalogram-based consciousness assessment to enhance patrol accuracy by correlating guard states with sensor data, improving security system efficiency.
Patent Information
- Application Number
- JP2022025860
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-02-22
- Publication Date
- 2026-02-06
- Estimated Expiration
- 2042-02-22
AI Technical Summary
Conventional security systems struggle to accurately assess patrol accuracy of guards due to reliance on human consciousness, which varies and is not location-specific.
A security system that utilizes biological signals, such as electroencephalograms, to determine the state of consciousness of guards and correlates this with sensor data to identify areas of decreased patrol accuracy, providing real-time feedback and guidance.
Enhances patrol accuracy by identifying and addressing decreased concentration levels in specific areas, ensuring comprehensive security coverage.
Smart Images

Figure 0007811862000001 
Figure 0007811862000002 
Figure 0007811862000003
Abstract
Description
[Technical Field]
[0001] The present invention relates to a security system, a security method, and a program. [Background technology]
[0002] Conventionally, security systems have been commonly used in which a security terminal installed in a space to be guarded, such as an individual building, detects the presence of a person or an abnormality, such as the outbreak of a fire, and notifies a security company or the like of the occurrence of the abnormality. In such security systems, when the homeowner or the like is absent, such as at night or on a holiday, or when an abnormality is notified, a security guard or other patrol officer patrols the building on behalf of the homeowner or the like to check the situation, etc. In such cases, the accuracy of the patrol officer's patrol work (hereinafter referred to as "patrol accuracy") depends on the patrol officer's state of consciousness, such as their concentration level and emotional state, so it is important to understand the patrol officer's state of consciousness.
[0003] As a technique for grasping the state of consciousness of a worker performing some kind of work, a technique has been disclosed in which the worker's electroencephalogram (EEG) is analyzed to determine the occurrence rate of the alpha wave component of the EEG, thereby determining the worker's judgment and thinking ability (for example, Patent Document 1). Also disclosed is a technique in which information on the worker's eye movement and EEG signals are acquired, a correlation value between the worker's attention amount and the EEG signal is found, and the worker's attention state is estimated from the correlation value (for example, Patent Document 2). [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Japanese Patent Application Publication No. 2-193645 [Patent Document 2] Japanese Patent Application Laid-Open No. 2013-244116 Summary of the Invention [Problem to be solved by the invention]
[0005] The above-mentioned conventional technology can determine whether the work accuracy has decreased due to a decrease in the consciousness state by estimating the worker's state of concentration, emotion, etc. However, since the patrol personnel checks the situation while moving around the building, the above-mentioned conventional technology has the problem of being unable to fully grasp the location where the patrol accuracy has decreased.
[0006] The present invention has been made in consideration of the above, and aims to provide a security system, security method, and program that can efficiently maintain patrol accuracy by correlating the patrol accuracy of patrol personnel with the detection results of sensors. [Means for solving the problem]
[0007] In order to solve the above-mentioned problems and achieve the object, the present invention is characterized by comprising a first acquisition unit that acquires a biological signal related to a patrolman from a measuring device that detects the biological signal; a second acquisition unit that, when the patrolman is detected by one or more sensors installed in a guarded space that is to be patrolled by the patrolman, acquires security information that includes at least information about the sensor that detected the patrolman; a calculation unit that calculates predetermined features from the biological signal acquired by the first acquisition unit; an analysis unit that analyzes the patrolman's state of consciousness based on the features calculated by the calculation unit; an accuracy determination unit that determines the patrolman's patrol accuracy based on the analysis result by the analysis unit; and a generation unit that generates operation history information that associates at least the information of the sensor indicated by the security information with the determination result of the patrol accuracy by the accuracy determination unit. [Effects of the Invention]
[0008] According to the present invention, it is possible to contribute to maintaining the accuracy of patrol by identifying areas where the accuracy of patrol by patrol members has decreased. [Brief explanation of the drawings]
[0009] [Figure 1]FIG. 1 is a diagram illustrating an example of the overall configuration of a security system according to an embodiment. [Figure 2] FIG. 2 is a diagram showing an example of a state of consciousness determined from an electroencephalogram. [Figure 3] FIG. 3 is a diagram showing an example of feedback based on the analysis results. [Figure 4] FIG. 4 is a diagram illustrating an example of a hardware configuration of an information terminal according to an embodiment. [Figure 5] FIG. 5 is a diagram illustrating an example of a hardware configuration of a management server according to an embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of a functional block configuration of the security system according to the embodiment. [Figure 7] FIG. 7 is a diagram for explaining how the concentration level is determined from an electroencephalogram. [Figure 8] FIG. 8 is a diagram illustrating the distribution of consciousness states based on the emotion analysis results. [Figure 9] FIG. 9 is a diagram showing an example of a waveform of a myoelectric potential during eye movement. [Figure 10] FIG. 10 is a diagram illustrating an example of a consciousness state based on a result of determining the navigation accuracy of the information terminal according to the embodiment. [Figure 11] FIG. 11 is a diagram illustrating an example of a security target space. [Figure 12] FIG. 12 is a diagram illustrating an example of operation history information. [Figure 13] FIG. 13 is a flowchart showing an example of the flow of patrol work when the security system according to the embodiment is used. [Figure 14] FIG. 14 is a flowchart illustrating an example of the flow of the accuracy determination process of the security system according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0010] Below, embodiments of a security system, a security method, and a program according to the present invention will be described in detail with reference to the drawings. Furthermore, the present invention is not limited to the following embodiments, and the components in the following embodiments include those that would be easily conceived by a person skilled in the art, those that are substantially the same, and those that are within the scope of what is called equivalents. Furthermore, various omissions, substitutions, modifications, and combinations of the components can be made without departing from the spirit of the following embodiments.
[0011] (Overall configuration of security system) Fig. 1 is a diagram showing an example of the overall configuration of a security system according to an embodiment. Fig. 2 is a diagram showing an example of a state of consciousness determined from an electroencephalogram, where the horizontal axis represents time and eight waves represent electroencephalogram waveforms. Fig. 3 is a diagram showing an example of feedback based on the analysis results. An overview of the overall configuration and operation of security system 1 according to this embodiment will be described with reference to Figs. 1 to 3.
[0012] The security system 1 shown in FIG. 1 is a system that determines the patrol accuracy of each area in the security target space STS by analyzing biological signals such as electroencephalograms acquired from a patrolperson patrolling the security target space STS and feeds back the determination result to the patrolperson. As shown in FIG. 1, the security system 1 includes an information terminal 10 carried by the patrolperson and a management server 20 (host device) at a monitoring center. The patrolperson patrols the security target space STS while wearing a helmet H equipped with an electroencephalograph (EEG) E. The electroencephalograph E is a measuring device that measures the neural activity state of the brain by detecting weak electrical signals (brain waves) emitted from the human brain using multiple electrodes. Note that the electroencephalograph E is not limited to being built into the helmet H, but may be any device that can be worn or carried in a manner that allows the patrolperson's brain waves to be detected. Furthermore, the measuring device for measuring the biosignals of the patrolman is not limited to the electroencephalograph E, but may also be a magnetoencephalogram (MEG) or a brain activity sensor that uses near-infrared light to measure changes in blood flow in brain tissue.
[0013] Furthermore, various sensors such as motion sensors, cameras, and door sensors, as well as a security terminal ST having a communication device (not shown), are installed at various locations in the guarded space STS, making it possible to detect in which areas of the guarded space STS a person or the like is present. At least one sensor is installed in the guarded space STS. When a sensor detects a person or the like, the communication device transmits detection information including identification information indicating the installation location of the sensor to a management server 20 in the monitoring center via a network N. The person or the like may be, for example, a patrol person. The network N is, for example, a network such as a LAN (Local Area Network) or the Internet that complies with protocols such as TCP (Transmission Control Protocol) / IP (Internet Protocol). The network N may include not only wired lines but also wireless lines.
[0014] The information terminal 10 is an information processing device such as a smartphone or tablet terminal that wirelessly receives brain waves measured by an electroencephalograph E in a helmet H worn by the patrolman, determines the patrolman's state of consciousness through various analyses of the brain waves, and judges the accuracy of the patrol work.
[0015] For example, the information terminal 10 wirelessly receives brain waves as shown in FIG. 2(a) from an electroencephalograph E and performs various analyses on the brain waves to determine the patrolman's state of consciousness, such as "concentration," "drowsiness," "apathy," "distraction," or "fear," as shown in FIG. 2(b). The information terminal 10 then determines the accuracy of the patrolman's patrol work based on the determined state of consciousness and executes feedback processing based on the determination result. For example, as shown in FIG. 3, if the information terminal 10 determines that the patrolman's state of consciousness is "drowsiness" or the like and the patrolman's patrol accuracy has decreased, the information terminal 10 issues an instruction to improve the patrolman's state of consciousness by vibrating a vibrator, or the like, as feedback processing. Furthermore, as shown in FIG. 3, if the information terminal 10 determines that the patrolman's state of consciousness is "distraction," and the patrolman's patrol accuracy has decreased, the information terminal 10 extracts the area that was patrolled with decreased patrol accuracy and instructs the patrolman to patrol the area again, as feedback processing. 3, if the patrolman's state of consciousness is "fear", the information terminal 10 determines that the patrolman has encountered some kind of dangerous situation and sends an emergency report to the management server 20 of the monitoring center. Note that when the information terminal 10 receives the electroencephalograms from the electroencephalograph E, the reception is not limited to wireless reception, and may be wired reception.
[0016] The management server 20 is a server device that receives detection information from a security terminal ST installed in the guarded space STS via a network N, and transmits security information including the detection information and the time the detection information was acquired to the information terminal 10 via the network N.
[0017] Details of the configuration and operation of the information terminal 10 and management server 20 will be described later. Note that, in Fig. 1, the security system 1 includes the information terminal 10 and the management server 20, but this is not limited to this, and it is also possible to realize the system without including the management server 20 if the information terminal 10 is configured to directly receive detection information from the security terminal ST.
[0018] (Hardware configuration of information terminal) 4 is a diagram showing an example of the hardware configuration of an information terminal according to the embodiment, with reference to which the hardware configuration of information terminal 10 according to the embodiment will be described.
[0019] As shown in FIG. 4, the information terminal 10 includes a CPU (Central Processing Unit) 401, a ROM (Read Only Memory) 402, a RAM (Random Access Memory) 403, an EEPROM (Electrically Erasable Programmable Read Only Memory) 404, a long-distance communication circuit 410, an antenna 410a, a short-distance communication circuit 411, an antenna 411a, a microphone 412, a speaker 413, an audio input / output I / F 414, a display 415, a vibrator 417, and a touch panel 418.
[0020] The CPU 401 is a computing device that controls the overall operation of the information terminal 10. The ROM 402 is a non-volatile storage device that stores programs such as IPL used to drive the CPU 401. The RAM 403 is a volatile storage device used as a work area for the CPU 401. The EEPROM 404 is a non-volatile storage device that stores programs and various data.
[0021] The long-distance communication circuit 410 is a communication circuit that performs wireless communication with other devices via a network N through an antenna 410a in accordance with standards such as Wi-Fi (registered trademark).
[0022] The short-distance communication circuit 411 is a communication circuit that performs short-distance wireless communication with other devices via an antenna 411a in accordance with standards such as NFC (Near Field Communication) or Bluetooth (registered trademark).
[0023] The microphone 412 is a built-in sound collecting device that converts sound into an electrical signal. The speaker 413 is a built-in acoustic device that converts the electrical signal into physical vibrations and outputs sound such as music or voice. The sound input / output I / F 414 is an interface that processes input and output of sound signals between the microphone 412 and the speaker 413 under the control of the CPU 401.
[0024] The display 415 is a display device such as a liquid crystal display or an organic EL (Electro-Luminescence) display that displays various icons and the like.
[0025] The vibrator 417 is a device that generates physical vibrations under the control of the CPU 401 .
[0026] The touch panel 418 is an input device that allows the user to perform various functions of the information terminal 10 by touching the display 415 .
[0027] The above-mentioned CPU 401, ROM 402, RAM 403, EEPROM 404, long-distance communication circuit 410, short-distance communication circuit 411, sound input / output I / F 414, display 415, vibrator 417 and touch panel 418 are connected to each other so that they can communicate with each other via bus lines 409 such as an address bus and a data bus.
[0028] The hardware configuration of the information terminal 10 shown in FIG. 4 is an example, and it is not necessary for the information terminal 10 to include all of the components, and other components may also be included.
[0029] (Management server hardware configuration) 5 is a diagram showing an example of the hardware configuration of the management server according to the embodiment, and the hardware configuration of the management server 20 according to the embodiment will be described with reference to FIG.
[0030] As shown in FIG. 5, the management server 20 includes a CPU 501 , a ROM 502 , a RAM 503 , an auxiliary storage device 505 , a network I / F 508 , a display 509 , a keyboard 511 , and a mouse 512 .
[0031] The CPU 501 is a computing device that controls the overall operation of the management server 20. The ROM 502 is a non-volatile storage device that stores programs for the management server 20. The RAM 503 is a volatile storage device that is used as a work area for the CPU 501.
[0032] The auxiliary storage device 505 is a storage device such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive) that stores various data, programs, and the like.
[0033] The network I / F 508 is an interface for communicating data with external devices such as the security terminal ST and the information terminal 10 via the network N. The network I / F 508 is, for example, a NIC (Network Interface Card) that is compatible with Ethernet (registered trademark) and capable of communication compliant with TCP / IP or the like.
[0034] The display 509 is a display device configured by a liquid crystal or organic EL display, etc., that displays various information such as a cursor, a menu, a window, characters, or an image.
[0035] The keyboard 511 is an input device for selecting letters, numbers, and various instructions, moving the cursor, etc. The mouse 512 is an input device for selecting and executing various instructions, selecting a processing target, moving the cursor, etc.
[0036] The above-mentioned CPU 501, ROM 502, RAM 503, auxiliary storage device 505, network I / F 508, display 509, keyboard 511, and mouse 512 are communicably connected to one another by a bus line 510 such as an address bus and a data bus.
[0037] The hardware configuration of the management server 20 shown in FIG. 5 is an example, and it is not necessary to include all of the components shown in FIG. 5, or other components may be included.
[0038] (Configuration and operation of security system functional blocks) FIG. 6 is a diagram showing an example of the configuration of functional blocks of a security system according to an embodiment. FIG. 7 is a diagram explaining how concentration levels are determined from electroencephalograms, with the horizontal axis representing time and two waveforms representing alpha and beta electroencephalogram waveforms, respectively. FIG. 8 is a diagram explaining the distribution of consciousness states based on the results of emotion analysis. FIG. 9 is a diagram showing an example of the waveform of myoelectric potential during eye movement. FIG. 10 is a diagram showing an example of a consciousness state based on the results of patrol accuracy determination of an information terminal according to an embodiment. FIG. 11 is a diagram showing an example of a space to be guarded. FIG. 12 is a diagram showing an example of operation history information. The configuration and operation of functional blocks of security system 1 according to this embodiment will be described with reference to FIGS. 6 to 12.
[0039] As shown in FIG. 6, the information terminal 10 has a biological signal acquisition unit 101 (first acquisition unit), a feature calculation unit 102 (calculation unit), a concentration analysis unit 103 (an example of an analysis unit), an emotion analysis unit 104 (an example of an analysis unit), an eye movement analysis unit 105 (an example of an analysis unit), a patrol accuracy determination unit 106 (accuracy determination unit), a security information acquisition unit 107 (second acquisition unit), an operation history generation unit 108 (generation unit), an accuracy degradation area extraction unit 109 (extraction unit), a feedback processing unit 110, a memory unit 111, and an input unit 112.
[0040] The biological signal acquisition unit 101 is a functional unit that acquires biological signals such as brain waves of the patrolman measured by an electroencephalograph E built into a helmet H worn by the patrolman via a short-range communication circuit 411. The biological signal acquisition unit 101 outputs the acquired biological signals such as brain waves to the feature calculation unit 102.
[0041] The feature calculation unit 102 is a functional unit that calculates predetermined feature amounts from biosignals such as electroencephalograms acquired by the biosignal acquisition unit 101. Examples of the predetermined feature amounts include the frequency of electroencephalograms, myoelectric potentials, frequency characteristics obtained by FFT (Fast Fourier Transformation), and frequency components including time information obtained by wavelet transformation. Furthermore, the waveform information of electroencephalograms themselves may be used as the feature amount. The feature calculation unit 102 outputs the calculated feature amounts to the concentration analysis unit 103, the emotion analysis unit 104, and the eye movement analysis unit 105.
[0042] The concentration level analysis unit 103 is a functional unit that determines the concentration level of the tourer by analyzing the frequency components of the electroencephalograms as the features received from the feature calculation unit 102. For example, as shown in Fig. 7, the concentration level analysis unit 103 compares the intensity of alpha waves in the frequency components of 8 to 13 [Hz] with the intensity of beta waves in the frequency components of 14 to 30 [Hz], and determines that the concentration level is a "concentrated state" if the intensity of beta waves is higher than that of alpha waves, and determines that the concentration level is a "distracted state (relaxed state)" if the intensity of alpha waves is higher than that of beta waves. The concentration level analysis unit 103 outputs the determined concentration level to the tour accuracy determination unit 106.
[0043] The emotion analysis unit 104 is a functional unit that determines arousal and valence by analyzing the features received from the feature calculation unit 102. Here, arousal indicates a numerical value that represents the level of consciousness, and is expressed as a numerical value between -1 (low level of consciousness) and +1 (high level of consciousness). Valence indicates a numerical value that represents the level of emotion, and is expressed as a numerical value between -1 (negative emotion) and +1 (positive emotion).
[0044] As shown in Fig. 8, the emotional state of the patrolman can be understood by plotting the arousal level and the emotional level determined by the emotion analysis unit 104, with the arousal level on the vertical axis and the emotional level on the horizontal axis. For example, as shown in Fig. 8, an emotional region AR1 with a high arousal level and a low emotional level can be understood to be an emotional state indicating "strong fear," and an emotional region AR2 with a low arousal level and an emotional level close to 0 can be understood to be an emotional state indicating "lethargy."
[0045] The emotion analysis unit 104 outputs the determined arousal level and emotion level to the navigation accuracy determination unit 106 .
[0046] The eye movement analysis unit 105 is a functional unit that determines the state of the patrol person's eye movement by analyzing the myoelectric potential (EMG) as a feature acquired from the feature calculation unit 102. For example, the eye movement analysis unit 105 can grasp the degree of visual confirmation by the patrol person by measuring the number of eye movements per unit time as the state of eye movement. When a patrol person looks at various places, the number of eye movements increases because the patrol person changes their viewpoint vigorously. For example, as shown in FIG. 9, by analyzing the waveforms of myoelectric potential obtained from electrodes of multiple channels (Ch1 to Ch4 in FIG. 9), it is possible to grasp the rightward, leftward, upward, downward, blinking, and the like of the eyeballs. Note that the myoelectric potential is determined from electroencephalograms by the feature calculation unit 102, but this is not limited thereto and may be obtained directly from electrodes of an electromyograph placed around the neck or eyes. The eye movement analysis unit 105 outputs the determined state of eye movement to the patrol accuracy determination unit 106.
[0047] The patrol accuracy determination unit 106 is a functional unit that determines the patrol member's state of consciousness based on the concentration level determined by the concentration level analysis unit 103, the arousal level and emotional level determined by the emotion analysis unit 104, and the state of eye movement determined by the eye movement analysis unit 105, and comprehensively determines the patrol member's patrol accuracy based on the determined state of consciousness. Here, the state of consciousness refers to the patrol member's overall state of consciousness, which indicates the patrol member's state of concentration, emotional state, etc. Note that the concentration level, arousal level, emotional level, and state of eye movement described above can also be considered to indicate the state of consciousness, and the concentration level analysis unit 103, emotional level analysis unit 104, and eye movement analysis unit 105 can be said to analyze the patrol member's state of consciousness. For example, the patrol accuracy determination unit 106 determines that the patrol member's patrol accuracy is high if the patrol member has a high level of concentration, moderate emotional states of anxiety and fear, and frequent eye movement. On the other hand, the tour accuracy determination unit 106 determines that the tour accuracy of the visitor is low if the concentration level is low, the emotional state is low in arousal level and the emotional level is inappropriate, or there is little eye movement.
[0048] 10, the cycling accuracy determination unit 106 may determine the cycling accuracy by categorizing the consciousness state into, for example, "apathy," "distracted," "fear," "drowsiness," "normal," etc. The cycling accuracy determination unit 106 outputs the determination result of the cycling accuracy to the operation history generation unit 108 and the feedback processing unit 110. Note that the determination result of the cycling accuracy in this case may include the time when the determination was made by the cycling accuracy determination unit 106.
[0049] Note that the information terminal 10 is not limited to being provided with all of the analysis functions of the concentration analysis unit 103, emotion analysis unit 104, and eye movement analysis unit 105 described above, and may have at least one of the concentration analysis unit 103, emotion analysis unit 104, and eye movement analysis unit 105, as long as a certain degree of accuracy can be obtained as a result of the determination of the navigation accuracy by the navigation accuracy determination unit 106.
[0050] The security information acquisition unit 107 is a functional unit that acquires security information from the management server 20 via the long-distance communication circuit 410. The security information is information that includes identification information indicating the installation location of the sensor that detected the patrolman, among the various sensors that make up the security terminal ST arranged in the security target space STS, and the time of detection, and is information that indicates that the patrolman was detected by that sensor. As described above, various sensors that make up the security terminal ST, such as human sensors, cameras, or door sensors, are installed in various locations in the security target space STS, and it is possible to detect in which area within the security target space STS a person or the like is present.
[0051] For example, in the example of the guarded space STS shown in FIG. 11, the security terminals ST include a door sensor ST-D1 that detects the opening and closing of the entrance door of the guarded space STS to detect the presence of a person near the entrance door, door sensors ST-D2 and ST-D3 installed on the doors of each room, and ST-D4 installed on the exit door. These door sensors ST-D1 to ST-D4 indirectly detect patrollers by detecting the opening and closing of the doors. Furthermore, security terminals ST include motion sensors ST-M1 and ST-M2 that detect patrollers, and cameras ST-C1 and ST-C2 that detect patrollers by capturing images, installed in various locations and rooms of the guarded space STS. For example, when camera ST-C1 detects a patroller based on the captured image, it transmits detection information indicating the detection to the management server 20 of the monitoring center via a communication device constituting the security terminal ST. The detection information may include, for example, identification information indicating the installation location of the sensor that detected the patroller. As will be described later, the security information is information based on the detection information.
[0052] The security information acquisition unit 107 outputs the acquired security information to the operation history generation unit 108.
[0053] The operation history generating unit 108 is a functional unit that generates operation history information based on the result of the patrol accuracy determination by the patrol accuracy determining unit 106 and the security information acquired by the security information acquiring unit 107 .
[0054] Specifically, the operation history generation unit 108 compares the time included in the patrol accuracy determination result with the time included in the security information, and generates operation history information by using the patrol accuracy determination result and security information that match (or are deemed to match) the time (detection time shown in FIG. 12 ), the identification information included in the security information (sensor shown in FIG. 12 ), and the patrol accuracy determination result (patrol accuracy result shown in FIG. 12 ). The patrol accuracy result shown in FIG. 12 categorizes the patrol person's state of consciousness. The operation history information shown in FIG. 12 associates, for example, the detection time "03:52:10," the identification information "DDD," and the patrol accuracy result "apathetic." This allows the patrol person to recognize that they were detected by the sensor installed at the position indicated by the identification information "DDD" at the time "03:52:10," and that they were patrolling in a state of "apathetic."
[0055] Then, the operation history generating unit 108 stores the generated operation history information in the storage unit 111. Note that the operation history generating unit 108 may output the generated operation history information directly to the accuracy reduction area extracting unit 109.
[0056] The accuracy-decreasing area extraction unit 109 is a functional unit that references the operation history information stored in the memory unit 111 and extracts areas in the guarded space STS where patrol accuracy is low, i.e., areas where patrol accuracy has decreased and is abnormal, based on the patrol accuracy determination result (patrol accuracy result) of the operation history information. For example, in the example of operation history information shown in FIG. 12, the accuracy-decreasing area extraction unit 109 extracts, as areas with low patrol accuracy, the area around the installation location of a sensor whose patrol accuracy result is "drowsy" and whose identification information is "AAA," and the area around the installation location of a sensor whose patrol accuracy result is "lethargy" and whose identification information is "DDD." Note that the accuracy-decreasing area extraction unit 109 is not limited to referencing the operation history information stored in the memory unit 111, but may also directly receive and use the operation history information generated by the operation history generation unit 108. The accuracy-decreasing area extraction unit 109 outputs information on the extracted areas to the feedback processing unit 110.
[0057] The feedback processing unit 110 is a functional unit that executes predetermined feedback processing based on the result of the determination of the touring accuracy by the touring accuracy determination unit 106 and information on areas with low touring accuracy extracted by the accuracy-decreasing area extraction unit 109. It is desirable that this feedback processing by the feedback processing unit 110 be executed in real time. For example, as feedback processing, the feedback processing unit 110 displays information on areas with low touring accuracy extracted by the accuracy-decreasing area extraction unit 109 on the display 415. This makes it possible to encourage the visitor to visit the areas with low touring accuracy again.
[0058] Furthermore, when the result of the determination of the patrol accuracy by the patrol accuracy determination unit 106 is, for example, "drowsiness," the feedback processing unit 110 may provide a feedback process to instruct the patrol member to improve their state of consciousness by vibrating a vibrator 417 (an example of an output device). This can encourage the patrol member to improve their state of consciousness, such as drowsiness. Depending on the situation, the instruction to improve their state of consciousness may be displayed on a display 415 (an example of an output device) or output as an audio message from a speaker 413 (an example of an output device). Furthermore, when the result of the determination of the patrol accuracy by the patrol accuracy determination unit 106 is, for example, "fear" (an example of a predetermined state of consciousness), the feedback processing unit 110 may determine that the patrol member has encountered a dangerous situation and may send an emergency call to the management server 20 of the monitoring center via the long-distance communication circuit 410. This can improve the possibility of avoiding danger to the patrol member or can call for additional help in the situation.
[0059] The storage unit 111 is a functional unit that stores various information such as the operation history information generated by the operation history generation unit 108. Note that the information stored in the storage unit 111 is not limited to the operation history information, and the storage unit 111 may store information generated or acquired by each of the above-mentioned functional units (for example, information on the results of analysis by the concentration analysis unit 103, emotion analysis unit 104, and eye movement analysis unit 105, etc.). The storage unit 111 is realized by the RAM 403 or EEPROM 404 shown in FIG. 4.
[0060] The input unit 112 is a functional unit that accepts operational input to the information terminal 10. For example, when a patrol person starts patrolling the security target space STS, the patrol person may input this information via the input unit 112, and this information may be transmitted to the management server 20 via the long-distance communication circuit 410. The input unit 112 is realized by the touch panel 418 shown in FIG. 4.
[0061] The above-mentioned biosignal acquisition unit 101, feature calculation unit 102, concentration analysis unit 103, emotion analysis unit 104, eye movement analysis unit 105, patrol accuracy determination unit 106, security information acquisition unit 107, action history generation unit 108, accuracy degradation area extraction unit 109, and feedback processing unit 110 are realized by executing a program by the CPU 401 shown in Fig. 4. Note that the program may be a native application directly installed in the information terminal 10, or may be a web application running on a web browser. Furthermore, at least some of these functional units may be realized by hardware circuits such as an FPGA (Field-Programmable Gate Array) or an ASIC (Application Specific Integrated Circuit).
[0062] Furthermore, the functions of each functional unit of the information terminal 10 shown in Fig. 6 are conceptually shown, and the configuration is not limited to this. For example, the multiple functional units shown as independent functional units in the information terminal 10 shown in Fig. 6 may be configured as a single functional unit. On the other hand, the function of one functional unit in the information terminal 10 shown in Fig. 6 may be divided into multiple functional units, and configured as multiple functional units.
[0063] As shown in FIG. 6, the management server 20 includes a detection information acquisition unit 201, a security information transmission unit 202, and a storage unit 203.
[0064] The detection information acquisition unit 201 is a functional unit that acquires, via the network N and the network I / F 508, detection information indicating that the presence of a human or the like has been detected from a security terminal ST installed in the security space STS. The detection information may include, for example, identification information of the sensor that performed the detection. This detection information makes it possible to recognize in real time which area of the security space STS the patrol person is in. The detection information acquisition unit 201 outputs the acquired detection information to the security information transmission unit 202. The detection information acquisition unit 201 may also store the acquired detection information in the storage unit 203.
[0065] Security information transmission unit 202 is a functional unit that generates security information including the identification information of the sensor included in the detection information acquired by detection information acquisition unit 201 and the time at which detection information acquisition unit 201 acquired the detection information, and transmits the security information to information terminal 10 via network I / F 508. Note that the detection information may include the time at which security terminal ST made the detection, and security information transmission unit 202 may include the time included in the detection information in the security information. Security information transmission unit 202 may also generate security information using detection information stored in memory unit 203.
[0066] The storage unit 203 is a functional unit that stores (accumulates) the detection information acquired by, for example, the detection information acquisition unit 201. The storage unit 203 is realized by the auxiliary storage device 505 shown in FIG.
[0067] The detection information acquisition unit 201 and the security information transmission unit 202 are realized by executing a program by the CPU 501 shown in Fig. 5. Furthermore, at least some of these functional units may be realized by a hardware circuit such as an FPGA or an ASIC.
[0068] Furthermore, the functional units of the management server 20 shown in Fig. 6 are conceptual representations of functions, and are not limited to such a configuration. For example, the multiple functional units illustrated as independent functional units in the management server 20 shown in Fig. 6 may be configured as a single functional unit. On the other hand, the function of a single functional unit in the management server 20 shown in Fig. 6 may be divided into multiple units and configured as multiple functional units.
[0069] (Flow of patrol work by patrol personnel) 13 is a flow chart showing an example of the flow of patrol work when the security system according to the embodiment is used. The flow of patrol work by a patrolman will be described with reference to FIG.
[0070] First, a patrolman wearing a helmet H with an electroencephalograph E built in and carrying an information terminal 10 arrives at a security target space STS, which is a site to be patrolled (step S11). Biological signals such as brain waves of the patrolman wearing the helmet are acquired by the information terminal 10 through short-range wireless communication.
[0071] The patrol person then operates the input unit 112 of the information terminal 10 to input a command to start patrol, which causes the command to be transmitted to the management server 20 via the long-distance communication circuit 410, thereby starting patrol of the security target space STS (step S12). As part of the patrol work, the patrol person first inspects the perimeter of the security target space STS (step S13). After inspecting the perimeter, the patrol person enters the security target space STS (step S14). At this time, for example, in the case of the security target space STS shown in FIG. 11, when the entrance door is opened and the patrol person enters the security target space STS, the door sensor ST-D1 detects that the entrance door is open and transmits detection information indicating the detection to the management server 20. The management server 20 then receives the detection information and is able to recognize that the patrol person has entered the security target space STS.
[0072] The patrol then proceeds to inspect the interior of the security target space STS (step S15). The information terminal 10 then analyzes biological signals such as brain waves acquired from the patrol member patrolling the security target space STS, and acquires detection information from sensors installed at various locations in the security target space STS, while determining the patrol accuracy of each area in the security target space STS, and executes an accuracy determination process that feeds back the determination result to the patrol member (step S16). The flow of the accuracy determination process by the security system 1 will be described in detail later with reference to FIG.
[0073] Then, when the patrol finishes patrolling the inside of the security target space STS (step S17), the patrol leaves the security target space STS (step S18). At this time, in the case of the security target space STS shown in FIG. 11 for example, when the patrol opens the exit door and leaves the security target space STS, the door sensor ST-D4 detects that the exit door is open and transmits detection information indicating this detection to the management server 20. The patrol also inputs an instruction to end the patrol via the input unit 112 of the information terminal 10, thereby transmitting this information to the management server 20 via the long-distance communication circuit 410.
[0074] The patrol work is carried out by the patrol personnel through the flow of steps S11 to S18 described above.
[0075] (Accuracy assessment process flow) Fig. 14 is a flowchart showing an example of the flow of accuracy determination processing in the security system according to the embodiment. The flow of accuracy determination processing by the security system 1 according to the present embodiment will be described with reference to Fig. 14. The accuracy determination processing shown in Fig. 14 corresponds to the processing of step S16 shown in Fig. 13.
[0076] <Step S161> When a patrol person starts patrolling the guarded space STS, the biosignal acquisition unit 101 of the information terminal 10 starts acquiring biosignals such as the patrol person's brain waves measured by the electroencephalograph E built into the helmet H worn by the patrol person via the short-range communication circuit 411. The timing at which the biosignal acquisition unit 101 starts acquiring biosignals may be, for example, the timing when the patrol person sends a notice to start patrol to the management server 20, the timing when the information terminal 10 receives a response from the management server 20 after sending a notice to start patrol, or the timing when a detection signal from the door sensor ST-D1 is sent to the management server 20 upon entry into the guarded space STS and security information based on the detection signal is received by the information terminal 10.
[0077] Also, at this timing, the security information acquisition unit 107 of the information terminal 10 starts acquiring security information from the management server 20 via the long-distance communication circuit 410. Specifically, when various sensors installed in the guarded space STS detect a patrol person, detection information including identification information indicating the installation location of the sensor is transmitted to the management server 20 via the network N. The detection information acquisition unit 201 of the management server 20 acquires the detection information from the security terminal ST via the network N and the network I / F 508, and outputs it to the security information transmission unit 202. The security information transmission unit 202 generates security information including identification information indicating the installation location of the sensor included in the detection information acquired by the detection information acquisition unit 201 and the time when the detection information acquisition unit 201 acquired the detection information, and transmits the security information to the information terminal 10 via the network I / F 508. This enables the security information acquisition unit 107 of the information terminal 10 to acquire security information. Then, the security information acquisition unit 107 outputs the acquired security information to the operation history generation unit 108.
[0078] Then, the process proceeds to step S162.
[0079] <Step S162> The feature amount calculation unit 102 of the information terminal 10 calculates a predetermined feature amount from the biosignal such as an electroencephalogram acquired by the biosignal acquisition unit 101. Then, the feature amount calculation unit 102 outputs the calculated feature amount to the concentration analysis unit 103, the emotion analysis unit 104, and the eye movement analysis unit 105. Then, the process proceeds to steps S163 to S165. That is, the processes of steps S163 to S165 are executed in parallel.
[0080] <Step S163> The concentration level analysis unit 103 of the information terminal 10 determines the concentration level of the tourer by analyzing the frequency components of the electroencephalograms as the features received from the feature calculation unit 102. For example, the concentration level analysis unit 103 compares the intensities of alpha waves and beta waves in the frequency components, and determines the concentration level to indicate a state of concentration if the intensity of beta waves is higher than that of alpha waves, and determines the concentration level to indicate a state of distraction (relaxation) if the intensity of alpha waves is higher than that of beta waves. The concentration level analysis unit 103 outputs the determined concentration level to the tour accuracy determination unit 106. Then, the process proceeds to step S166.
[0081] <Step S164> The emotion analysis unit 104 of the information terminal 10 determines the level of arousal and the level of emotion by analyzing the feature amounts received from the feature amount calculation unit 102. The emotion analysis unit 104 outputs the determined level of arousal and the level of emotion to the navigation accuracy determination unit 106. Then, the process proceeds to step S166.
[0082] <Step S165> The eye movement analysis unit 105 of the information terminal 10 determines the state of the eye movement of the visitor by analyzing the myoelectric potential as the feature acquired from the feature calculation unit 102. For example, the eye movement analysis unit 105 can grasp the degree of visual confirmation by the visitor by measuring the number of eye movements per unit time as the state of eye movement. The eye movement analysis unit 105 outputs the determined state of eye movement to the visit accuracy determination unit 106. Then, the process proceeds to step S166.
[0083] <Step S166> The navigation accuracy determination unit 106 of the information terminal 10 determines the visitor's state of consciousness based on the concentration level determined by the concentration level analysis unit 103, the arousal level and emotional level determined by the emotional analysis unit 104, and the state of eye movement determined by the eye movement analysis unit 105, and comprehensively determines the visitor's navigation accuracy based on the state of consciousness. For example, the navigation accuracy determination unit 106 determines that the visitor's navigation accuracy is high if the visitor has a high concentration level, exhibits moderate anxiety and fear as an emotional state, and exhibits frequent eye movement. On the other hand, the navigation accuracy determination unit 106 determines that the visitor's navigation accuracy is low if the visitor has a low concentration level, exhibits low arousal as an emotional state with an inappropriate emotional level, or exhibits few eye movements. The navigation accuracy determination unit 106 may also determine the navigation accuracy by categorizing the state of consciousness, such as "apathy," "distracted," "fear," "drowsiness," and "normal." The cycling accuracy determination unit 106 outputs the determination result of the cycling accuracy to the operation history generation unit 108 and the feedback processing unit 110. Then, the process proceeds to step S167.
[0084] <Step S167> Then, the operation history generating unit 108 of the information terminal 10 generates operation history information based on the result of the determination of the patrol accuracy by the patrol accuracy determining unit 106 and the security information acquired by the security information acquiring unit 107.
[0085] Specifically, the operation history generation unit 108 compares the time included in the patrol accuracy determination result with the time included in the security information, and generates operation history information by using the patrol accuracy determination result and security information that match (or can be deemed to match) to associate the time (detection time), the identification information included in the security information, and the patrol accuracy determination result (patrol accuracy result).
[0086] Then, the operation history generating unit 108 stores the generated operation history information in the storage unit 111. Then, the process proceeds to step S168.
[0087] <Step S168> The accuracy-decreasing area extraction unit 109 of the information terminal 10 refers to the operation history information stored in the storage unit 111, and extracts areas in the guarded space STS where patrol accuracy is low based on the determination result of the patrol accuracy of the operation history information (patrol accuracy result). For example, in the example of operation history information shown in FIG. 12, the accuracy-decreasing area extraction unit 109 extracts, as areas where patrol accuracy is low, the area around the installation location of the sensor where the patrol accuracy result is "drowsiness" and where the identification information is "AAA", and the area around the installation location of the sensor where the patrol accuracy result is "lethargy" and where the identification information is "DDD". The accuracy-decreasing area extraction unit 109 outputs information on the extracted areas to the feedback processing unit 110. Then, the process proceeds to step S169.
[0088] <Step S169> The feedback processing unit 110 of the information terminal 10 executes a predetermined feedback process based on the result of the determination of the navigation accuracy by the navigation accuracy determination unit 106 and information on the area with low navigation accuracy extracted by the accuracy-degraded area extraction unit 109. For example, as the feedback process, the feedback processing unit 110 displays information on the area with low navigation accuracy extracted by the accuracy-degraded area extraction unit 109 on the display 415. Furthermore, when the determination result of the navigation accuracy by the navigation accuracy determination unit 106 is, for example, "drowsiness," the feedback processing unit 110 may issue an instruction to improve the state of consciousness by vibrating the vibrator 417. Depending on the situation, the instruction to improve the state of consciousness may be displayed on the display 415 or output as a voice from the speaker 413. Furthermore, when the determination result of the navigation accuracy by the navigation accuracy determination unit 106 is, for example, "fear," the feedback processing unit 110 may determine that a dangerous situation has been encountered and may issue an emergency call to the management server 20 of the monitoring center via the long-distance communication circuit 410.
[0089] The above flow of steps S161 to S169 executes the accuracy determination process by the security system 1. This accuracy determination process by the security system 1 is repeatedly executed from the start to the end of the patrol work of the patrol person in the security target space STS.
[0090] As described above, in the security system 1 according to this embodiment, the biosignal acquisition unit 101 acquires biosignals from an electroencephalograph E that detects biosignals related to a patrolman, the security information acquisition unit 107 acquires security information including at least information (identification information, etc.) related to the sensor that detected the patrolman when the patrolman is detected by one or more security terminals ST installed in the guarded space STS that is to be patrolled by the patrolman, the feature calculation unit 102 calculates predetermined feature amounts from the biosignals acquired by the biosignal acquisition unit 101, and at least one of the concentration analysis unit 103, the emotion analysis unit 104 and the eye movement analysis unit 105 analyzes the state of consciousness of the patrolman based on the feature amount calculated by the feature calculation unit 102, the patrol accuracy determination unit 106 determines the patrol accuracy of the patrolman based on the analysis results, and the operation history generation unit 108 generates operation history information that associates at least the sensor information (identification information, etc.) indicated by the security information with the determination result of the patrol accuracy by the patrol accuracy determination unit 106. In this way, by generating operation history information that associates the patrol accuracy of the patrol person with the detection results of the sensor, it is possible to efficiently maintain the patrol accuracy.
[0091] Furthermore, in the security system 1 according to the present embodiment, the accuracy-decreased area extraction unit 109 extracts areas in the security target space STS where patrol accuracy has decreased and is therefore abnormal, based on the operation history information. In this way, by extracting areas from the security target space STS where patrol accuracy has decreased and it has been determined that the areas are abnormal, the patrol person can be notified of the areas and encouraged to patrol again.
[0092] Furthermore, in the security system 1 according to this embodiment, the feedback processing unit 110 displays information about the areas extracted by the accuracy-decreasing area extraction unit 109 on the display 415. This allows the patrol person to recognize areas where patrol accuracy has decreased, and by patrolling the area again, patrol accuracy can be efficiently maintained.
[0093] Furthermore, in the security system 1 according to this embodiment, if the patrol accuracy determination result from the patrol accuracy determination unit 106 indicates that the patrol accuracy is low and abnormal, the feedback processing unit 110 outputs instructions to improve the patrol person's state of consciousness to an output device such as the display 415, vibrator 417, or speaker 413. This allows the patrol person's state of consciousness to improve, and patrol accuracy can be efficiently maintained.
[0094] Furthermore, in the security system 1 according to this embodiment, if the patrol accuracy determination result by the patrol accuracy determination unit 106 indicates a predetermined state of consciousness (fear, etc.), the feedback processing unit 110 sends an emergency report to the management server 20. This makes it possible to improve the possibility of avoiding danger to the patrol person, or to call new helpers for the situation, etc.
[0095] In security system 1 according to the present embodiment, the identification information indicates the installation location of the sensor, but allocation information assigned to each sensor may also be used as the identification information and transmitted from security terminal ST to management server 20. In this case, management server 20 stores in advance a plan view of the security target space in which the installation location of each sensor is recorded, and upon receiving detection information from security terminal ST, transmits security information including the identification information (assignment information) and the plan view of the security target space to information terminal 10. Information terminal 10 that receives this security information generates operation history information using the allocation information as identification information, and displays on display 415 the allocation information (identification information when patrol accuracy was low) and the plan view of the security target space included in the security information, allowing the patrol person to confirm the installation location of the sensor corresponding to the allocation information and recognize that patrol accuracy around that sensor has decreased.
[0096] Furthermore, the management server 20 may store in advance the location where each sensor is installed for each piece of allocation information. In this case, the management server 20 determines the installation location of the corresponding sensor based on the received identification information, and includes the determined installation location information as identification information in the security information and transmits it. This allows the information terminal 10 to generate operation history information based on the security information.
[0097] (Variation) A security system 1 according to a modification of the above-described embodiment will be described, focusing on the differences from the security system 1 according to the above-described embodiment. In the above-described embodiment, all functions constituting the accuracy determination process, except for the function of receiving detection information from the security terminal ST and transmitting the security information to the information terminal 10, were described as operations realized by the information terminal 10. In this modification, the analysis process by the concentration analysis unit 103, the emotion analysis unit 104, and the eye movement analysis unit 105, and the determination process of the patrol accuracy by the patrol accuracy determination unit 106 will be described as operations realized by a learning model generated by machine learning. The overall configuration of the security system 1 according to this modification, and the hardware configurations of the information terminal 10 and the management server 20 are the same as those described in the above-described embodiment.
[0098] In the security system according to the modification, some functions are replaced by processing using a learning model based on machine learning. The configuration and operation of the security system 1 according to this modification will be described.
[0099] The management server 20 has the same functions as the concentration analysis unit 103, emotion analysis unit 104, eye movement analysis unit 105, and tour accuracy determination unit 106. The management server 20 acquires biosignals, such as electroencephalograms, from the tourer in advance, and creates teacher data based on feature quantities calculated from the biosignals, using the determination results of the tour accuracy determined by the concentration analysis unit, emotion analysis unit, eye movement analysis unit, and tour accuracy determination unit as labels. The management server 20 then generates a learning model through machine learning (supervised learning) based on the teacher data. That is, the learning model is a model generated using the feature quantities of the biosignals as explanatory variables and the determination results of the tour accuracy as objective variables. In this case, well-known algorithms such as SVM (Support Vector Machine), Random Forest, decision tree, neural network, and GBDT (Gradient Boosting Decision Tree) can be used as the machine learning algorithm.
[0100] Although the feature quantities of biosignals such as electroencephalograms are used as explanatory variables, the present invention is not limited to this, and a learning model may be generated using the biosignals themselves as explanatory variables. Furthermore, the learning model is not limited to being generated by the management server 20, and a learning model generated by an external device may be operated on the management server 20.
[0101] The management server 20 then receives, via the network N, the feature amounts calculated by the feature amount calculation unit 102 from the biosignals acquired by the biosignal acquisition unit 101 in the information terminal 10, inputs the feature amounts as sample data into the learning model, and acquires the determination result of the patrol accuracy as an output. The management server 20 then transmits the acquired determination result of the patrol accuracy to the information terminal 10 via the network N. The operation history generation unit 108 of the information terminal 10 then generates operation history information using the received determination result of the patrol accuracy and security information separately received from the management server 20. Other operations are the same as those of the security system 1 according to the above-described embodiment.
[0102] That is, the functions of the concentration analysis unit 103, emotion analysis unit 104, eye movement analysis unit 105, and patrol accuracy determination unit 106 of the information terminal 10 according to the above-described embodiment are replaced by a learning model operated on the management server 20. This achieves the same effects as those achieved by the security system 1 according to the above-described embodiment, and also reduces the processing load on the information terminal 10 by replacing some of the functions of the information terminal 10 with the learning model of the management server 20. Furthermore, by improving the accuracy of the learning process for constructing the above-described learning model, the accuracy of the patrol accuracy determination process can be improved.
[0103] Although the functions of the concentration analysis unit 103, emotion analysis unit 104, eye movement analysis unit 105, and patrol accuracy determination unit 106 of the information terminal 10 are replaced by the management server 20 using a learning model based on machine learning, this is not limited to this. For example, by replacing only the concentration analysis unit 103, emotion analysis unit 104, and eye movement analysis unit 105 with the learning model of the management server 20, the concentration level, arousal level, emotion level, and eye movement state can be output using the learning model, and the patrol accuracy determination can be performed by the information terminal 10. Furthermore, this is not limited to using a learning model, and some of the functions of the information terminal 10 may simply be replaced by the management server 20. Furthermore, the functions of the management server 20, i.e., the functions of the detection information acquisition unit 201 and the security information transmission unit 202, can also be replaced by the information terminal 10.
[0104] In the above-described embodiments and modifications, when at least one of the functional units of the information terminal 10 and the management server 20 is realized by executing a program, the program is provided by being pre-installed in a ROM or the like. In the above-described embodiments and modifications, the programs executed by the information terminal 10 and the management server 20 may be provided by being recorded in an installable or executable file format on a computer-readable recording medium such as a CD-ROM (Compact Disc Read Only Memory), a flexible disk (FD), a CD-R (Compact Disk-Recordable), or a DVD (Digital Versatile Disc). In the above-described embodiments and modifications, the programs executed by the information terminal 10 and the management server 20 may be provided by being stored on a computer connected to a network such as the Internet and downloaded via the network. In the above-described embodiments and modifications, the programs executed by the information terminal 10 and the management server 20 may be provided or distributed via a network such as the Internet. Furthermore, in the above-described embodiments and variations, the programs executed by the information terminal 10 and the management server 20 are modularly structured to include at least one of the above-described functional units, and in terms of actual hardware, the CPU 401, CPU 501 reads and executes the programs from the above-described storage devices (e.g., ROM 402, EEPROM 404, auxiliary storage device 505, etc.), thereby loading and generating the above-described functional units onto the main storage device (RAM 403, RAM 503). [Explanation of symbols]
[0105] 1. Security System 10 Information terminals 20 Management Server 101 Biosignal acquisition unit 102 Feature calculation unit 103 Concentration Analysis Department 104 Emotion Analysis Department 105 Eye Movement Analysis Department 106 Cyclic accuracy judgment unit 107 Security Information Acquisition Department 108 Operation history generation unit 109 Accuracy reduction area extraction part 110 Feedback processing section 111 Storage section 112 Input section 201 Detection information acquisition unit 202 Security Information Transmission Department 203 Storage section 401 CPU 402 ROM 403 RAM 404 EEPROM 405 Imaging unit 406 Imaging I / F 407 Acceleration and orientation sensor 408 GPS receiver 409 Bus Line 410 Telecommunications circuit 410a antenna 411 Near field communication circuit 411a antenna 412 Mike 413 Speaker 414 Sound input / output I / F 415 Display 416 External device connection I / F 417 Vibrator 418 Touch Panel 501 CPU 502 ROM 503 RAM 505 Auxiliary storage 508 Network I / F 509 Display 510 Bus Line 511 keyboard 512 Mouse AR1, AR2 emotional domain E. Electroencephalograph H helmet N Network ST Security Terminal STS Guarded Space ST-C1, ST-C2 cameras ST-M1, ST-M2 Human Sensors ST-D1, ST-D2, ST-D3 door sensors
Claims
1. a first acquisition unit that acquires a biological signal related to the visitor from a measurement device that detects the biological signal; a second acquisition unit that acquires security information including at least information about the sensor that detected the patrol person when the patrol person is detected by one or more sensors installed in a security target space that is the target of patrol by the patrol person; a calculation unit that calculates a predetermined feature amount from the biological signal acquired by the first acquisition unit; an analysis unit that analyzes the state of consciousness of the patrolman based on the feature amount calculated by the calculation unit; an accuracy determination unit that determines the patrol accuracy of the patrol person based on the analysis result by the analysis unit; a generating unit that generates operation history information that associates at least the information of the sensor indicated by the security information with the determination result of the patrol accuracy by the accuracy determining unit; A security system equipped with
2. The security system according to claim 1 , further comprising an extraction unit that extracts areas in the security target space where the patrol accuracy is not normal based on the operation history information.
3. The security system according to claim 2 , further comprising a feedback processing unit that displays the information about the area extracted by the extraction unit on a display device.
4. The security system according to claim 3 , wherein the feedback processing unit causes an output device to output instructions to improve the patrol person's state of consciousness when the accuracy determination unit determines that the patrol accuracy is not normal.
5. 5. The security system according to claim 3, wherein the feedback processing unit issues an emergency call to a higher-level device when the result of the determination of the patrol accuracy by the accuracy determination unit indicates a predetermined consciousness state.
6. The security system of any one of claims 1 to 5, wherein the analysis unit includes at least one of a concentration analysis unit that determines the concentration level of the patrolman by analyzing the feature amount, an emotion analysis unit that determines the alertness and emotional level of the patrolman by analyzing the feature amount, and an eye movement analysis unit that determines the state of eye movement of the patrolman by analyzing the myoelectric potential as the feature amount.
7. a first acquisition step of acquiring a biological signal related to the visitor from a measurement device that detects the biological signal; a second acquisition step of acquiring security information including at least information about the sensor that detected the patrol person when the patrol person is detected by one or more sensors installed in the security target space that is the target of patrol by the patrol person; a calculation step of calculating a predetermined feature amount from the acquired biological signal; an analysis step of analyzing the state of consciousness of the visitor based on the calculated feature amount; an accuracy determination step of determining the patrol accuracy of the patrol person based on the result of the analysis; a generating step of generating operation history information that associates at least the information of the sensor indicated by the security information with the determination result of the patrol accuracy; A security method having the above.
8. On the computer, a first acquisition step of acquiring a biological signal related to the visitor from a measurement device that detects the biological signal; a second acquisition step of acquiring security information including at least information about the sensor that detected the patrol person when the patrol person is detected by one or more sensors installed in the security target space that is the target of patrol by the patrol person; a calculation step of calculating a predetermined feature amount from the acquired biological signal; an analysis step of analyzing the state of consciousness of the visitor based on the calculated feature amount; an accuracy determination step of determining the patrol accuracy of the patrol person based on the result of the analysis; a generating step of generating operation history information that associates at least the information of the sensor indicated by the security information with the determination result of the patrol accuracy; A program to execute.
Citation Information
Patent Citations
Alarm device
CN112133055A
Working condition monitoring device
JP1990193645A
Alertness assessment device and method
JP2013244116A
Electronic apparatus and method
JP2017050803A
Information processing method, information processing device, and program
JP2017185072A