Information processing device, information processing system, crisis management method and program

Abstract

To provide an information processing device that can reliably store information that enhances objectivity along with recorded information such as image information and audio information, even in the event of an emergency. [Solution] A user terminal 2 as an information processing device includes an emergency processing unit 31 that, upon acquiring emergency information indicating an emergency situation for the user, initiates an emergency mode in which recorded information including at least one of image information and audio information, as well as at least one of situation information indicating information about the user and their surroundings, and an emergency information transmission unit 32 that continues to transmit the recorded information and situation information to a pre-registered destination until the emergency mode is released.

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing system, a crisis management method, and a program. [Background technology]

[0002] Conventionally, there has been known a technique for capturing images of an emergency situation such as an accident with a camera and using the captured video as objective evidence. For example, Patent Document 1 and Patent Document 2 describe this type of technique.

[0003] Patent Document 1 relates to a cyclical recording system in which captured video is constantly recorded and new video data is sequentially overwritten on old video data. In the cyclical recording system of Patent Document 1, when the occurrence of a problem is detected based on a change in the subject's heart rate, video data of a predetermined time period before and after the occurrence of the problem is selected and protected from being deleted by overwriting.

[0004] Patent document 2 describes a system that includes a reception function that receives first audio information of a recording instruction and second audio information different from the first audio information, a recording function that records image data showing an image captured by an imaging means mounted on a vehicle into a recording means based on the results of voice recognition of the first audio information, and a processing function that performs processing other than recording based on the results of voice recognition of the second audio information. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Publication No. 2023-67508 [Patent Document 2] Japanese Patent Publication No. 2023-151512 Summary of the Invention [Problem to be solved by the invention]

[0006] In recent years, there has been an increase in emergency situations where people must deal with threatening individuals, and some cases have been reported in which people have fallen into serious physical and mental situations. When such an emergency occurs, it is possible to use a smartphone with video and audio recording capabilities to leave objective evidence. However, it can be difficult to activate a smartphone's video and audio recording functions when you are emotionally upset. Even if you manage to activate the smartphone, it is possible that a threatening individual may steal the smartphone and erase the recorded information, such as images and audio. Furthermore, in the event of a dispute, it is preferable to obtain objective evidence other than recorded information.

[0007] The present invention has been made in consideration of the above circumstances, and aims to provide an information processing device, an information processing system, a crisis management method, and a program that can reliably store information that enhances objectivity along with recorded information such as image information and audio information, even in the event of an emergency. [Means for solving the problem]

[0008] In order to achieve the above object, one aspect of the present invention is an information processing device that includes an emergency processing unit that, when emergency information indicating a user's emergency situation is acquired, initiates an emergency mode to acquire recorded information including at least one of image information and audio information, as well as at least one of situation information indicating the user's physical condition and information about the user's surroundings, and an emergency information transmission unit that continues to transmit the recorded information and the situation information to a pre-registered destination until the emergency mode is released.

[0009] Another aspect of the present invention is an information processing system including the information processing device and an information storage device that stores at least the record information and the situation information transmitted from the information processing device. Another aspect of the present invention is a crisis management method executed by a computer, the crisis management method including: an emergency processing step of, when emergency information indicating an emergency situation of a user is acquired, initiating an emergency mode to acquire recorded information including at least one of image information and audio information, as well as at least one of situation information indicating the physical condition of the user and information about the user's surroundings; and an emergency information transmission step of continuing to transmit the recorded information and the situation information to a pre-registered destination until the emergency mode is released.

[0010] Another aspect of the present invention is a program for causing a computer to execute an emergency processing step of starting an emergency mode, when emergency information indicating a user's emergency situation is acquired, in which recorded information including at least one of image information and audio information is acquired, as well as at least one of situation information indicating the user's physical condition and information about the user's surroundings, and an emergency information transmission step of continuing to transmit the recorded information and the situation information to a pre-registered destination until the emergency mode is released. [Effects of the Invention]

[0011] According to the present invention, it is possible to provide an information processing device, an information processing system, a crisis management method, and a program that can reliably store information that enhances objectivity along with recorded information such as image information and audio information, even in the event of an emergency. [Brief explanation of the drawings]

[0012] [Figure 1] 1 is a diagram illustrating a crisis management system to which a user terminal is applied as an information processing device according to an embodiment of the present invention. [Figure 2] FIG. 2 is a block diagram showing the hardware configuration of a user terminal according to the present embodiment. [Figure 3] FIG. 2 is a functional block diagram showing an example of the functional configuration of a user terminal according to the present embodiment. [Figure 4] FIG. 10 is a diagram illustrating an example of a screen displayed on a user terminal after an application is started. [Figure 5] 10A and 10B are diagrams illustrating the process of acquiring record information and status information by a user terminal and a wearable terminal when emergency mode is executed. [Figure 6] FIG. 10 is a diagram showing an example of a screen displayed on a user terminal and a wearable terminal when transitioning to crisis level 2. [Figure 7] FIG. 10 is a diagram showing an example of a screen displayed on a user terminal and a wearable terminal when the crisis level is shifted to 3. [Figure 8] 10 is a flowchart showing an example of the flow of a crisis response process by a user terminal according to the present embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0013] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An information processing device, an information processing system, a crisis management method, and a program according to an embodiment of the present invention will be described below with reference to the accompanying drawings.

[0014] <System configuration> First, the overall system configuration will be described. Fig. 1 is a diagram showing a crisis management system (information processing system) 100 to which a user terminal 2 is applied as an information processing device according to one embodiment of the present invention. The crisis management system 100 includes a server 1, a user terminal 2, and an authority terminal 3.

[0015] The server 1 is connected to each of the user terminal 2 and the authority terminal 3 via a communication network N such as the Internet. The server 1 transmits and receives various types of information related to crisis management to each of the user terminal 2 and the authority terminal 3. The server 1 is one of the pre-registered destinations (information storage devices) that stores at least record information and status information (described later) sent from the user terminal 2.

[0016] The user terminal 2 is a portable computer used by a user who uses the crisis management system 100. When an event harmful to the user occurs, the user uses the user terminal 2 to respond to the crisis. Harmful events include, for example, situations where the user has to deal with a thug or a malicious complainer, situations where the user is falsely accused of sexual harassment, or situations where the user is in physical danger, and are events that the user recognizes as a crisis or a state with a high probability of progressing to a crisis. Harmful events also include, for example, events in which the user recognizes that the user is in crisis due to an illness such as a seizure.

[0017] The user terminal 2 is configured by a mobile computer such as a smartphone or a tablet. The user terminal 2 may exchange various information with the server 1 using a pre-installed program, or may exchange various information through a web browser.

[0018] The user terminal 2 has, for example, a telephone function for making audio and video calls, a photo taking function, a video taking function, a voice recording function, a video playback function, an audio playback function, an SOS function for sending SOS notifications to the police or fire department, a collision accident detection function, a GPS location detection function, a voice operation function, a face recognition function, a barometer function, a gyro (3-axis) function, an acceleration sensor, a proximity sensor, an ambient light sensor, and a communication function. The communication function performs communication via MicroSIM, eSIM, Wi-Fi (registered trademark), Bluetooth (registered trademark), etc. By utilizing some or all of these functions, the user terminal 2 acquires recorded information such as image information and audio information, the user's condition including information about the user's surrounding environment, and situational information including physical changes inflicted on the user by the assailant and information about the assailant.

[0019] The user terminal 2 is also paired via wireless communication with a wearable terminal 4 worn by the user. The wearable terminal 4 may be, for example, a smartwatch worn on the user's wrist, eyeglass-shaped smart glasses, or a ring-shaped device worn on the user's finger. The wearable terminal 4 has, for example, an SOS function for sending an SOS call to the police or fire department, a collision detection function, a fall detection function, a GPS location detection function, a blood oxygen concentration detection function, an electrocardiogram function, a heart rate detection function for detecting high or low heart rates, a heart rate detection function for detecting a decline in cardiopulmonary function, and a skin temperature detection function for detecting skin temperature using a sensor. The wearable terminal 4 uses some or all of these functions to acquire status information indicating the user's condition, such as the user's own biometric information, and outputs the information to the user terminal 2.

[0020] Furthermore, the user terminal 2 may acquire image information or audio information via the wearable terminal 4. In this embodiment, an example in which the user terminal 2 and the wearable terminal 4 are used together will be described, but the present invention is not limited to this. Although the use of the information acquired by the wearable terminal 4 is limited, the user terminal 2 may be used alone as an information processing device.

[0021] The authorized person terminal 3 is a computer used by an authorized person who has been registered in advance by the user. Like the server 1, the authorized person terminal 3 is one of the pre-registered destinations (information storage devices) that stores at least the record information and situation information transmitted from the user terminal 2. The authorized person is someone who supports the user's crisis management, such as a legal advisor, a security service officer, a family member, or a voluntary guardian. The authorized person terminal 3 may be configured as a smartphone, tablet, personal computer, or the like. The authorized person terminal 3 may exchange various information with the server 1 using a pre-installed program, or may exchange various information via a web browser.

[0022] <Hardware configuration> Next, an example of hardware constituting the user terminal 2 will be described. Fig. 2 is a block diagram showing the hardware configuration of the user terminal 2 according to this embodiment. The user terminal 2 includes a CPU (Central Processing Unit) 11 as a processor, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a bus 14, an input / output interface 15, an output unit 16, an input unit 17, a storage unit 18, a communication unit 19, a drive 20, an imaging unit 22, and an audio recording unit 23.

[0023] The CPU 11 executes various processes in accordance with programs recorded in the ROM 12 or programs loaded from the storage unit 18 into the RAM 13. The RAM 13 also stores data and the like required for the CPU 11 to execute various processes. The CPU 11, the ROM 12, and the RAM 13 are interconnected via a bus 14. An input / output interface 15 is also connected to this bus 14.

[0024] The input / output interface 15 is connected to an output unit 16, an input unit 17, a storage unit 18, a communication unit 19, a drive 20, an imaging unit 22, and a sound recording unit 23. The output unit 16 is composed of a display, a speaker, etc., and outputs various information as images and sounds. The input unit 17 is composed of a touch panel display and physical buttons, and allows various information to be input. Note that the touch panel display functions as both an input unit and an output unit, but here the functions of the output unit 16 and the input unit 17 will be described as separate functions.

[0025] The storage unit 18 is configured with a hard disk, a DRAM (Dynamic Random Access Memory), an SSD (Solid State Drive), etc., and stores various data. The communication unit 19 communicates with other devices via a communication network N including the Internet.

[0026] Removable media 21, such as a magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, is appropriately attached to the drive 20. Programs read from the removable media 21 by the drive 20 are installed in the storage unit 18 as needed. The removable media 21 can also store various data stored in the storage unit 18 in the same way as the storage unit 18.

[0027] The imaging unit 22 is a camera that acquires (captures) image information such as video and still images using an image sensor. In this embodiment, an example will be described in which video information is acquired as image information, but the image information may also be still image information. When still image information is acquired as image information, the still image information may be acquired intermittently, or may be acquired when the crisis level increases. Note that still image information can also be acquired from video information, so still image information may be extracted from the video information at predetermined time intervals or when a specific word (described later) is used as a trigger and saved. The recording unit 23 is a microphone that acquires audio as audio information.

[0028] The hardware configuration described here is merely an example. The authorized person terminal 3 in FIG. 1 is a smartphone, tablet, or personal computer having the same configuration as the hardware configuration shown in FIG. 2. The server 1 in FIG. 1 also has basically the same hardware configuration as that shown in FIG. 2, and the input unit is configured with a keyboard, mouse, etc. Note that the computer described in this embodiment, including the user terminal 2, may have a configuration that is the same as the configuration in FIG. 2, or may have a different configuration. Furthermore, the computer may be configured with two or more computers.

[0029] <Functional configuration> Next, a description will be given of the functional configuration of the user terminal 2. Fig. 3 is a functional block diagram showing an example of the functional configuration of the user terminal 2 according to this embodiment.

[0030] 3, the user terminal 2 includes an emergency processing unit 31, an emergency information transmission unit 32, a level change unit 33, a notification processing unit 34, and a cancellation processing unit 35 as functional units that execute crisis management on a processor (CPU 11). In this embodiment, the processing of each functional unit is executed by an application program installed in the user terminal 2.

[0031] When emergency processing unit 31 acquires emergency information indicating an emergency situation of the user, it transitions user terminal 2 to emergency mode. The process of acquiring emergency information indicating an emergency situation of the user will be described with reference to Fig. 4 .

[0032] FIG. 4 is a diagram showing an example of a screen displayed on the user terminal 2 after the application is launched. When a user faces a person who is causing harm and recognizes that an emergency situation has occurred, the user selects an icon labeled "Defense System" from among the applications displayed on the output unit 16 of the user terminal 2 by tapping or the like. As shown in FIG. 4, when the defense system icon is tapped, a start button 51 for issuing an instruction to start emergency mode is displayed on the output unit 16. In this example, a text message reading "Do you want to start reporting and collecting information?" is displayed together with the start button 51. When the start button 51 is tapped while the screen shown in FIG. 4 is displayed, the emergency processing unit 31 starts emergency mode.

[0033] The start button 51 is a button on the screen displayed on the touch panel display, but the button may also be a button that is physically pressed. For example, in the case where the user terminal 2 of this embodiment is provided with a mechanical physical button 61 for operating the volume during normal operation, the emergency mode may be started in the emergency processing unit 31 when the physical button 61 is operated while the screen of Fig. 4 is displayed.

[0034] Next, the emergency mode will be described. While the emergency mode is being executed, the emergency processing unit 31 acquires recorded information including video information or audio information, and also acquires situation information indicating information about the user himself or the user's surroundings. Furthermore, once the emergency mode is executed, the user terminal 2 cannot be powered off or restarted until the emergency mode is released.

[0035] Fig. 5 is a diagram illustrating the process of acquiring recorded information and situation information by the user terminal 2 and the wearable terminal 4 when the emergency mode is executed. Fig. 5 shows emergency mode screens, which transition when the start button 51 or the physical button 61 is operated, on each of the user terminal 2 and the wearable terminal 4. The wearable terminal 4 in this example includes a touch panel display 71 that serves as both an input unit and an output unit.

[0036] When the emergency mode is activated, it can be estimated that the user is in a crisis level 1 state, which indicates anxiety, danger, abnormality, or a pathological situation. The emergency mode (crisis level 1) screen displayed on the output unit 16 of the user terminal 2 displays the text "Only the administrator can stop this system," the current crisis level 1, and a crisis level up button 52. When the screen shown in FIG. 5 is displayed, only the crisis level up button 52 is active on the display screen of the user terminal 2, and other operations, including powering off, are not possible. The emergency mode screen displayed on the touch panel display 71 of the wearable terminal 4 displays the current crisis level 1 and the crisis level up button 72.

[0037] In the process of acquiring recorded information, the emergency processing unit 31 of the user terminal 2 activates the imaging unit 22 of the user terminal 2 to acquire video information, and activates the recording unit 23 to acquire audio information.

[0038] In the process of acquiring situation information, the user terminal 2 acquires the time when the emergency mode was activated and the user's own location information using the GPS function. Furthermore, if the user terminal 2 can acquire information via Wi-Fi (registered trademark) or Bluetooth (registered trademark) from a device carried by an assailant who is trying to harm the user, it may acquire situation information such as the nickname and device name registered on this device.

[0039] The user terminal 2 also acquires the user's biological information as situation information via the paired wearable terminal 4. As described above, the biological information is acquired by the blood oxygen concentration detection function, electrocardiogram function, heart rate detection function, heart rate detection function, skin temperature detection function, and the like that the wearable terminal 4 has.

[0040] If the wearable device 4 has a function to independently use a communication network N such as the Internet, the device may be configured to transmit status information directly to the server 1 or the authorized device 3 without going through the user device 2. This allows for redundancy in data transmission.

[0041] The emergency information transmission unit 32 activates the communication unit 19 and performs a notification process to notify a pre-registered emergency call destination that the user is in an emergency via the communication network N, and also continues to transmit record information and status information to the pre-registered destination. Here, the pre-registered emergency call destination is, for example, the police, an authorized person (e.g., a legal advisor), etc. Note that, in the emergency information transmission unit 32, continuing to transmit information to the destination includes not only continuous transmission of information but also intermittent transmission of information. For example, the emergency information transmission unit 32 may stop transmission when the communication environment of the user terminal 2 deteriorates and automatically resume transmission when the communication environment improves. Furthermore, when the remaining battery power of the user terminal 2 is low, information may be transmitted intermittently to the destination. In other words, the transmission of information from the user terminal 2 to the destination may be continuous or intermittent.

[0042] In the reporting process, an email is sent to a pre-registered emergency call destination or an automated telephone call is made. In the telephone call process, an automated voice call is made to the police, authorized persons, etc. registered in the server 1. Note that, although this embodiment shows an example in which a report is made to the police, authorized persons, etc. at emergency mode crisis level 1, it may also be made at emergency mode crisis level 2 or later.

[0043] A specific example of the notification process will be described. For example, the emergency information transmission unit 32 sends a voice message to the registered contacts with the highest priority. The voice message may be sent via internet or telephone line. In this case, assuming that the user is unable to speak, the emergency information transmission unit 32 automatically reads out the voice. For example, an automated voice message such as "This is.... The phone number is.... I am currently in a very dangerous situation and cannot answer the phone. Due to an emergency, I am requesting immediate assistance and rescue through this automated emergency request system. My current location is latitude... longitude.... Repeat." may be repeated multiple times (e.g., three times). After the first emergency call destination is completed, a similar call is sent to the next emergency call destination in order of priority. In addition to the call, an email requesting emergency assistance with the same content as the voice message is automatically sent. This notification process may also request the dispatch of police based on location information obtained through the GPS function.

[0044] The emergency information transmission unit 32 transmits the record information and the status information in real time to a destination registered in advance. The pre-registered destination may be the server 1 or the authority terminal 3. In this embodiment, the fact that the user is in an emergency is notified to the authority terminal 3 via the server 1, and the record information and the status information are stored in the server 1. The record information and the status information may be transmitted from the user terminal 2 to the authority terminal 3 without going through the server 1, or may be transferred from the server 1 to the authority terminal 3 in the form of being downloaded.

[0045] The level change unit 33 determines the degree of the emergency state based on the user's operation, state information, etc., and changes the crisis level of the emergency mode based on the determination result. In this embodiment, when the emergency mode is executed and crisis level 1 is set, and the user touches the crisis level up button 52 displayed on the user terminal 2 or the crisis level up button 72 on the wearable terminal 4, the level change unit 33 determines that the user is in an increased state of fear and performs processing to change the crisis level from 1 to 2. The increased state of fear is, for example, a situation in which the user is warned of harm, is told in a loud voice, or has an increased heart rate, etc. Note that the system may be configured to transition to crisis level 2 when the physical button 61 is operated while crisis level 1 is executed.

[0046] 6 is a diagram showing an example of a screen displayed on the user terminal 2 and the wearable terminal 4 when the crisis level changes to 2. The emergency mode crisis level 2 screen displayed on the output unit 16 of the user terminal 2 displays the text "Only the administrator can stop this system," the current crisis level 2, a crisis level up button 53, and a crisis level down button 54. The crisis level up button 53 is displayed larger than the crisis level down button 54, making it easier for the user to see even in an emergency, allowing for more reliable touch operation. On the display screen of the user terminal 2, only the crisis level up button 53 and the crisis level down button 54 are active.

[0047] The emergency mode crisis level 2 screen displayed on the touch panel display 71 of the wearable device 4 shows the current crisis level 2, a crisis level up button 73, and a crisis level down button 74. The crisis level up button 73 is displayed larger than the crisis level down button 74, so that the user can easily see it even in an emergency, allowing for more reliable touch operation.

[0048] When the user touches the crisis level up button 53 or the crisis level up button 73 after the crisis level has shifted to 2, the level change unit 33 determines that the user is in a state where they are subject to hints of violence or the like, physical contact, or the use of physical force, and performs processing to shift the crisis level from 2 to 3. On the other hand, when the user touches the crisis level down button 54 or the crisis level down button 74 after the crisis level has shifted to 2, the level change unit 33 performs processing to shift the crisis level from 2 to 1. When the crisis level returns from 2 to 1, the acquisition and transmission of the record information and the situation information may be continued, or the acquisition and transmission of the record information and the situation information may be stopped.

[0049] 7 is a diagram showing an example of a screen displayed on the user terminal 2 and the wearable terminal 4 when the crisis level is shifted to 3. As shown in FIG. 7, the emergency mode crisis level 3 screen displayed on the output unit 16 of the user terminal 2 displays the text "Only the administrator can stop this system," the current crisis level 3, and a crisis level down button 55. On the display screen of the user terminal 2, only the crisis level down button 55 is active. On the emergency mode crisis level 3 screen displayed on the touch panel display 71 of the wearable terminal 4, the current crisis level 3 and the crisis level down button 75 are displayed. When the user touches the crisis level down button 55 or the crisis level down button 75 while the crisis level has shifted to 3, the level change unit 33 performs processing to shift the crisis level from 3 to 2.

[0050] 6 and 7 may be performed by operating the physical button 61. For example, the user terminal 2 may be configured so that the crisis level increases when the user presses the physical button 61 to instruct volume up, and decreases when the user presses the physical button 62 to instruct volume down. The crisis level may also be changed by a combination of operating the screen of the user terminal 2 and operating the physical button. For example, the user terminal 2 may be configured so that the crisis level increases when the user touches the crisis level up button 53, and decreases when the user presses the physical button 62. The user terminal 2 may also be configured so that the crisis level increases when the user presses the physical button 61, and decreases when the user touches the crisis level down button 54.

[0051] Next, the notification processing unit 34 will be described. The notification processing unit 34 performs output processing to output voice messages such as "This entire conversation is being recorded," "All information is being forwarded to your legal advisor," and "To cancel this, your legal advisor must authenticate you." to the speaker of the output unit 16. The notification processing unit 34 performs voice output processing according to the crisis level.

[0052] Note that instead of performing audio output processing according to the crisis level, the notification processing unit 34 may perform output processing to output an image (text) of an audio message on the display of the output unit 16. In this case, the user can inform the other party that information including the surrounding situation is being recorded and stored by showing the screen of the user terminal 2 on which the message is displayed to the other party. In this case, the user may not only show the other party the screen of the user terminal 2, but also verbally inform the other party that information including the surrounding situation is being recorded and stored. Also, both audio output processing and image output processing may be performed.

[0053] In this embodiment, the notification processing unit 34 does not perform output processing when the crisis level is 1, and performs audio output processing when the crisis level is 2 or higher. As a result, when it seems that the user is being led into a fraud or the like, an application on the user terminal 2 can be started without the other party knowing, and information can be continued to be sent to an authorized third party such as a legal advisor without generating an audio message when the crisis level is 1.

[0054] As shown in Fig. 6, when the crisis level shifts from 1 to 2, the notification processing unit 34 performs output processing to notify those around at a normal volume that information is being recorded and stored. For example, a message saying "This system is recording and storing information, including the surrounding situation," is output by voice. By letting the assailant know that their actions are being recorded, the assailant can be deterred.

[0055] As shown in FIG. 7 , when the crisis level changes from 2 to 3, the notification processor 34 performs an output process to notify those around you at a louder volume than normal that information is being recorded and stored. The notification processor 34 may also perform a process to change the voice message in accordance with the change in crisis level. For example, at crisis level 3, a voice message such as "All information and activities in the vicinity are being recorded. Your legal counsel has already been contacted and has called the police. All information, including location information, voice information, and your device information supplemented via Bluetooth (registered trademark), is being shared in real time. Note that administrative authority for this smartphone has been transferred to your legal counsel, and recording will continue until the lawyer arrives and physically deauthorizes this smartphone. Repeat..." may be output.

[0056] Next, we will explain the cancellation processing unit 35. When the cancellation processing unit 35 acquires a stop condition for stopping the emergency mode, it stops the emergency mode, stops the acquisition and transmission of recorded information and status information, and stops the output process for outputting audio.

[0057] The cancellation processing unit 35 of this embodiment performs processing to cancel emergency mode when it receives a cancellation instruction from the authorized person terminal 3 for which authority has been set in advance or a cancellation operation set in the user terminal 2. The cancellation instruction may be sent directly from the authorized person terminal 3 to the user terminal 2, or may be sent via the server 1. In this way, only authorized persons can cancel emergency mode. The cancellation operation is, for example, input of a cancellation key such as a security code or password that only the user or authorized person knows, or input of a hidden command.

[0058] <Processing flow> Next, we will explain the flow of the crisis response processing (emergency mode processing) executed on the user terminal 2. Fig. 8 is a flowchart showing an example of the flow of the crisis response processing by the user terminal 2 according to this embodiment. The flowchart in Fig. 8 starts when the defense system application is launched on the user terminal 2.

[0059] In step S1, the emergency processing unit 31 determines whether or not the user has performed an operation to start the emergency mode. In this embodiment, if the start button 51 or the physical button 61 shown in Fig. 4 is operated by the user while the application is running (if a two-action operation is performed), the emergency processing unit 31 proceeds to step S2 (step S1; Yes). If the start button 51 or the physical button 61 shown in Fig. 4 is not operated by the user, but an operation to return to the home screen or the like is performed, the emergency processing unit 31 ends the processing (step S1; No).

[0060] In step S2, the emergency processing unit 31 starts an emergency mode in which the user terminal 2 and the wearable terminal 4 are used to perform processing to acquire recorded information including video information and audio information, and situation information indicating information about the user and the user's surroundings.

[0061] In step S3, the emergency information transmission unit 32 executes a notification process to notify the authorized person that an emergency has occurred to the user, and starts a process to transmit the recorded information and status information acquired using the user terminal 2 and the wearable terminal 4 to the authorized person terminal 3.

[0062] In step S4, the level change unit 33 determines whether or not the level of the emergency has been changed. In this embodiment, the level change unit 33 determines that the level of the emergency has been changed when the crisis level up button 52, the crisis level up button 53, the crisis level down button 54, the crisis level down button 55, or the like is operated on the user terminal 2, and switches the display on the user terminal 2 according to the crisis level and proceeds to step S5 (step S4; Yes). If the operation to change the crisis level has not been performed on the user terminal 2, the level change unit 33 proceeds to step S7 (step S4; No).

[0063] In step S5, the notification processing unit 34 determines whether the changed crisis level is equal to or greater than 2. If the crisis level is equal to or greater than 2, the notification processing unit 34 proceeds to step S6 (step S5; Yes), and if the crisis level is less than 2, the notification processing unit 34 proceeds to step S7 (step S5; No).

[0064] In step S6, since the crisis level is 2 or higher, the notification processing unit 34 performs output processing according to the crisis level. As described above, the notification processing unit 34 performs output processing at a normal output level (volume) at crisis level 2, and performs output processing at an output level higher than normal at crisis level 3. After the processing of step S6, the process proceeds to step S7.

[0065] In step S7, the cancellation processing unit 35 determines whether or not an instruction to cancel the emergency mode has been received. In this embodiment, if the cancellation processing unit 35 has not received a cancellation instruction from the authority from the authority terminal 3 via the server 1, the process returns to step S4 (step S7; No). If the cancellation processing unit 35 receives a cancellation instruction, the cancellation processing unit 35 stops the emergency mode and ends the process (step S7; Yes).

[0066] The processing described in FIG. 8 may be initiated by a user operation in a situation where it is recognized that the user is in danger of being harmed by a third party such as an assailant, or may be initiated by a user operation in a situation where it is recognized that the user is in danger of being involved in a disaster or is in a physical crisis due to an illness such as a seizure.

[0067] As described above, the user terminal 2 as an information processing device of this embodiment includes an emergency processing unit 31 that, upon acquiring emergency information indicating an emergency situation for the user, starts an emergency mode in which at least one of situation information indicating information about the user himself or herself and his or her surroundings is acquired in addition to recorded information including at least one of video information and audio information, and an emergency information transmitting unit 32 that continues to transmit the recorded information and situation information to a pre-registered destination until the emergency mode is released.

[0068] This allows users to save not only video and audio recordings, but also their own physical information and information indicating the surrounding situation obtained via Wi-Fi (registered trademark) or Bluetooth (registered trademark) to a pre-registered destination. By saving not only recorded video and audio information but also situational information indicating the surrounding situation, more objective circumstantial evidence can be secured. In addition, the saved recorded information and situational information can be used to prove one's innocence or as material for counterattacking the other party, preventing victimized users from being put in an unfavorable position due to a lack of evidence.

[0069] Furthermore, even if the user terminal 2 breaks down or is destroyed by an assailant, the destination can be referenced to check the status information in addition to the recorded information. That is, since the video information and audio information are stored on the server 1 or the authorized terminal 3 secured outside the location where the emergency call was made, they cannot be deleted or erased even by the user terminal 2 that made the emergency call, so the recorded information and status information can be reliably saved even if the user terminal 2 is stolen.

[0070] Furthermore, by analyzing the recorded information and situational information stored in the server 1 and the authorized terminal 3, it is possible to use the information as evidence of various mental and physical pain, situations, and harshness experienced by the user. For example, by combining recorded video and audio information with situational information acquired by fall detection, gyro, acceleration detection, etc., it is possible to provide objective evidence that the user was subjected to verbal abuse and violence, causing a sudden fall. Furthermore, if a user is being threatened by verbal abuse, the audio information, as well as the heart rate, electrocardiogram, irregular pulse, and blood oxygen level information from the smartwatch, can be used as circumstantial evidence that the victim is in a harsh situation.

[0071] In this embodiment, the user terminal 2 further includes a cancellation processing unit 35 that cancels the emergency mode when a stop instruction is received from an authorized person who has pre-registered authority.

[0072] This ensures that the recorded information and status information can continue to be stored externally until a third party confirms that the user's safety has been ensured. Even if the user terminal 2 is stolen by an assailant, the emergency mode will not be cancelled by the assailant, and the recorded information and status information can continue to be stored.

[0073] In this embodiment, the user terminal 2 further includes a notification processing unit 34 that executes output processing to output, by voice or image, that the emergency mode has been started.

[0074] This allows the user to notify those around them that the record information and situation information are being acquired, and they can be expected to respond to the user's emergency. Also, when the user is dealing with an assailant, the user can avoid the emergency situation from escalating further by informing the assailant that the record information and situation information are being acquired.

[0075] In this embodiment, the user terminal 2 further includes a level change unit 33 that, upon receiving notification that the level of the emergency situation has changed while in emergency mode, changes the output level of the output process in accordance with the changed level of the emergency situation.

[0076] This allows the user to raise the output level when the emergency situation is serious, thereby widely publicizing the occurrence of a serious emergency. Also, by outputting audio or images at a high output level according to the level of the emergency, it is possible to prevent the escalation of violent behavior.

[0077] Furthermore, when the level change unit 33 of this embodiment receives a user operation to lower the level of emergency when the level of emergency is high, it changes the level of emergency to a lower level.

[0078] As a result, when the user's situation changes and the risk level decreases, the output process can be performed at an output level according to the decreased risk level through the user's operation.

[0079] In addition, in this embodiment, the emergency processing unit 31 acquires emergency information when the user operates a button that instructs the system to start emergency mode after the application that executes the emergency processing unit 31 and the emergency information transmission unit 32 is launched.

[0080] This allows users to activate emergency mode with a simple two-action operation: launching an application and then operating a button. In addition, because the activation of emergency mode requires the action of launching an application, it is possible to prevent users from accidentally activating emergency mode during normal operation. In the crisis management system 100 described above, various situations are considered as events that are harmful to the user. For example, even if a store salesperson uses security cameras to record the store, they cannot immediately alert the other party that they are recording the situation, and this does not currently serve as an effective deterrent against malicious customer harassment. Furthermore, even if security cameras are installed, they may not always be recording, meaning that information may not be recorded at critical times. Even if security cameras are always recording, depending on the camera's location and orientation, they may not be able to capture dangerous situations involving users. However, with a smartphone (user terminal 2), users are likely to always carry their device with them and its battery is properly charged, allowing users to immediately alert the other party that they are recording the situation and reliably record dangerous situations involving users. Furthermore, by installing an application program on their personal smartphone, users can launch the application at their own discretion. This has the advantage that information recording and reporting can be initiated at the discretion of the store salesperson who directly interacts with customers, rather than the company (organization) recording the information. Furthermore, field salespeople may encounter criminal acts such as harassment and assault when making individual visits or engaging in one-on-one customer service in a closed conference room. Female salespeople are particularly at risk of sexual harassment and assault when engaging in one-on-one interactions with customers in situations where no one else is around. Specifically, there have been reported cases of female salespeople in charge of real estate viewings being sexually assaulted in closed or enclosed spaces such as "uninhabited buildings or rooms." However, even in such situations, installing an application on a user's own smartphone, which the user carries with them at all times and can access and operate quickly and easily, and then instantly launching the application program when the user senses danger, can immediately share the user's physically dangerous situation with others and notify and warn the perpetrator that "inappropriate situations are being monitored." This can be expected to deter or prevent the situation from worsening.In this way, the crisis management system 100 of this embodiment can more appropriately deal with various events that are considered harmful to the user.

[0081] <Transformation> Although one embodiment of the present invention has been described above, the present invention is not limited to the above-described embodiment, and modifications, improvements, etc. within the scope of achieving the object of the present invention are included in the present invention.

[0082] For example, the emergency processing unit 31 may analyze the utterance of a specific word (keyword) by voice recognition, and automatically start acquiring video information or audio information when the specific word is used as a trigger. For example, a word such as "I'll kill you" uttered by a thug or "I'm arrested" when falsely accused can serve as a trigger. The emergency processing unit 31 may also be activated when the user utters a trigger word such as "I'm scared" or "Help me."

[0083] In addition, the emergency information transmission unit 32 may use short-range wireless communication such as WiFi (registered trademark) or Bluetooth (registered trademark) to transmit messages requesting rescue to surrounding terminals or messages requesting the provision of images and audio captured by surrounding terminals, and may acquire recorded information and status information from surrounding terminals.

[0084] Furthermore, the level change unit 33 may analyze by voice recognition whether the voice information acquired by the recording unit 23 of the user terminal 2 contains a specific word (keyword), and change the crisis level using the specific word as a trigger. The specific word may be, for example, a violent word or an intimidating word. Furthermore, the level change unit 33 may analyze the voice level contained in the voice information acquired by the recording unit 23 of the user terminal 2, and change the crisis level using, for example, a state in which the voice level is equal to or greater than a set value for a predetermined period of time or a state in which the voice level is less than a set value as a trigger.

[0085] Furthermore, the risk level may be changed only by an authorized person who operates the authorized person terminal 3. Examples of authorized persons include a legal advisor, a security service officer, a family member, a voluntary guardian, etc., and only one of these authorized persons (for example, a legal advisor) may be allowed to change the risk level, or multiple authorized persons may be allowed to change the risk level. When multiple authorized persons are allowed to change the risk level, the risk level may be changed at the discretion of one authorized person, or may be changed only when all authorized persons agree.

[0086] In addition, the alarm processing unit 34 may perform notification processing when the crisis level has progressed and the user experiences an abnormal drop in heart rate or blood pressure due to fainting, falling or injury from violence, or when the acceleration detection function and gyro function cause abnormal movement that places a load of several to several tens of Gs on the user, or when the user does not move for several minutes.

[0087] Furthermore, the cancellation processing unit 35 may be configured so that once the emergency mode is activated, the emergency mode cannot be cancelled by operating the user terminal 2, and the emergency mode can only be cancelled by a cancellation instruction from an authority terminal 3 for which authority has been set in advance.

[0088] Furthermore, if the notification processing unit 34 detects that the user terminal 2 has been destroyed by the assailant after disclosing the recorded information and the recorded situation information to the assailant through various information such as the gyro function, acceleration detection function, and communication interruption of the user terminal 2, the server 1 may issue an emergency alert and notify the police and other relevant parties of a request for assistance along with the last recorded location information from the server 1.

[0089] Furthermore, when the user terminal 2 communicates using Wi-Fi (registered trademark), it may be configured to acquire, as situation information, network radio waves emitted by people who were in the vicinity of the emergency caller at the time of the emergency call and at the time of movement. By subsequently querying information about Wi-Fi (registered trademark), it can be used as evidence that the user was in the vicinity of the emergency caller.

[0090] Furthermore, the server 1 is configured to acquire recorded information and voice information via the communication network N, but may also be configured to store voice information via a telephone line. Furthermore, the crisis management system (information processing system) 100 may be configured to include at least the user terminal 2, and the server 1 or the authorized person terminal 3.

[0091] Furthermore, in the above embodiment, an emergency situation caused by a person such as a thug has been described as an example, but the emergency situation may also be, for example, a disaster, an injury, a physical attack, etc. that occurs to the user. In this case, the authorized person terminal 3 may notify a medical institution or the like that the user is in danger, or the server 1 or the authorized person terminal 3 may transmit information such as an evacuation route and contact details of the medical institution to the user terminal 2.

[0092] Furthermore, the above-described series of processes can be executed by hardware or software. In other words, the above-described functional configuration is merely an example and is not particularly limited. That is, it is sufficient for the user terminal 2 to be equipped with the function to execute the above-described series of processes as a whole, and the type of functional block used to realize this function is not particularly limited to the above example. Furthermore, the location of the functional block is not particularly limited and may be arbitrary. For example, the functional block of the user terminal 2 may be transferred to another device such as the server 1. Conversely, the functional block of another device may be transferred to the server. Furthermore, one functional block may be configured as a single piece of hardware, a single piece of software, or a combination thereof.

[0093] When a series of processes is executed by software, the programs constituting the software are installed onto a computer or the like from a network or a recording medium. The computer may be a computer incorporated into dedicated hardware. The computer may also be a computer capable of executing various functions by installing various programs, such as a server, a general-purpose smartphone, or a personal computer.

[0094] The recording medium containing such a program may be configured as not only a removable medium (not shown) that is distributed separately from the device main body in order to provide the program, but also a recording medium that is provided in a state that it is pre-installed in the device main body, etc. Since the program can be distributed via a network, the recording medium may be installed in or accessible to a computer that is connected or connectable to the network.

[0095] In this specification, the steps describing the program recorded on the recording medium include not only processes that are performed in chronological order, but also processes that are not necessarily performed in chronological order but are performed in parallel or individually. Also, in this specification, the term "system" means an overall device composed of multiple devices or multiple means, etc. [Explanation of symbols]

[0096] 1 server 2. User terminal 3. Authorized User Terminal 31 Emergency Department 32 Emergency Information Transmission Unit 33 Level change section 34 Notification processing section 35 Cancellation processing section 100 Crisis Management System

Claims

1. an emergency processing unit that, when acquiring emergency information indicating an emergency situation of a user, starts an emergency mode to acquire recorded information including at least one of image information and audio information, as well as at least one of situation information indicating a physical condition of the user and information about the user's surroundings; an emergency information transmitting unit that continues to transmit the record information and the status information to a pre-registered destination until the emergency mode is released; Equipped with Information processing device.

2. the emergency information transmission unit continues to transmit the record information and the situation information to a pre-registered destination, and notifies a pre-registered emergency contact that the user is in an emergency. The information processing device according to claim 1 .

3. a cancellation processing unit that cancels the emergency mode when a stop instruction is received from a pre-registered authorized person, The information processing device according to claim 1 .

4. a notification processing unit that executes output processing to output information indicating that the emergency mode has been started by at least one of sound and image; The information processing device according to claim 1 .

5. a level change unit that, when it is determined that the level of the emergency situation has changed during the emergency mode, changes the output level of the output processing in accordance with the changed level of the emergency situation; The information processing device according to claim 4 .

6. The level change unit When the level of the emergency situation is high and an operation by the user to lower the level of emergency is accepted, the level of the emergency situation is lowered. The information processing device according to claim 5 .

7. the emergency processing unit acquires the emergency information when a button for issuing an instruction to start the emergency mode is operated by the user. The information processing device according to claim 1 .

8. An information processing device according to any one of claims 1 to 7; an information storage device that stores at least the record information and the status information transmitted from the information processing device; Equipped with Information processing system.

9. A crisis management method executed by a computer, comprising: an emergency processing step of starting an emergency mode to acquire, when emergency information indicating an emergency situation of a user is acquired, at least one of recorded information including at least one of image information and audio information, and at least one of situation information indicating a physical condition of the user and information about the user's surroundings; an emergency information transmitting step of continuing to transmit the record information and the status information to a pre-registered destination until the emergency mode is released; Including, Crisis management methods.

10. an emergency processing step of starting an emergency mode to acquire, when emergency information indicating an emergency situation of a user is acquired, at least one of recorded information including at least one of image information and audio information, and at least one of situation information indicating a physical condition of the user and information about the user's surroundings; an emergency information transmitting step of continuing to transmit the record information and the status information to a pre-registered destination until the emergency mode is released; A program for executing the above on a computer.

Images