Information processing device, alarm system, and information processing method

Abstract

To provide an information processing device, an alarm activation system and an information processing method capable of improving security at the time of communication with an external device which is the alarm activation destination when abnormality occurs in a resident or the like.SOLUTION: Disclosed are an information processing device 11 and an information processing device 38 associated with one or a plurality of sensors 28 in an alarm activation system. The information processing device includes: an acquisition part which acquires an encryption key for performing communication with an external device 20 which is the alarm activation destination due to detection that at least any one of one or the plurality of sensors 28 has the abnormality in the subject; a communication part which performs at least any one of voice communication and video communication with the external device 20 by using the encryption key; and an input / output part which performs at least any one of input / output of the voice and input of the video.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an information processing device, an alarm system, and an information processing method. [Background technology]

[0002] There are still many cases of acute illnesses and accidents that occur at home. In recent years, as the population has aged and the number of people living alone has increased, responding to accidents and acute illnesses that occur at home has become increasingly important.

[0003] For example, Patent Document 1 describes a building in which sensors are installed in the living space where residents live, and when the sensors detect a preset abnormal state, a notification is sent to prompt the residents to check their safety. Patent Document 2 describes a body movement signal processing device capable of detecting the body movement of a subject in a bathroom. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2015-26146 A (Published on February 5, 2015) [Patent Document 2] Patent No. 6537701 (published on September 8, 2017) Summary of the Invention [Problem to be solved by the invention]

[0005] In the conventional techniques described above, there is room for improving security when communicating with an external device that is the destination of a report when an abnormality occurs to a resident or the like.

[0006] An aspect of the present invention aims to improve security when communicating with an external device that is to be the destination of a notification when an abnormality occurs in a resident or the like. [Means for solving the problem]

[0007] In order to solve the above problem, an information processing device according to an embodiment of the present invention is an information processing device associated with one or more sensors, and includes an acquisition unit that acquires an encryption key for communication with an external device that is a destination of an alert when at least one of the one or more sensors detects an abnormality in an object, a communication unit that performs at least one of audio communication and video communication with the external device using the encryption key, and an input / output unit that performs at least one of audio input / output and video input. According to the above configuration, the information processing device and the external device are connected by a communication process using the encryption key. This can improve security when communicating with the external device that is a destination of an alert when an abnormality occurs in a resident or the like.

[0008] In the information processing device according to an aspect of the present invention, the communication unit may communicate with the external device via a relay server that relays communication between the information processing device and the external device using WebRTC. According to the above configuration, a connection between the information processing device and the external device can be realized by encrypted communication using WebRTC via the relay server.

[0009] In the information processing device according to an aspect of the present invention, the input / output unit may disable at least one of audio input or output, or video input, in response to an instruction transmitted from the external device. According to the above configuration, it is possible to block unnecessary information from among audio or video output from the information processing device in order to properly conduct a call or the like.

[0010] In the information processing device according to an aspect of the present invention, a warning unit may be further provided that outputs a warning in response to an abnormality detected by the sensor. According to the above configuration, it is possible to notify the surroundings of an abnormality occurring in the target by a warning.

[0011] In order to solve the above problems, an alarm system according to one aspect of the present invention includes one or more sensors that non-contactly sense at least one of the heartbeat and respiration of a subject, and one or more information processing devices associated with the one or more sensors, and the information processing device includes an acquisition unit that acquires an encryption key for communicating with an external device that is an alarm destination when at least one of the one or more sensors detects an abnormality in the subject, a communication unit that uses the encryption key to perform at least one of audio communication and video communication with the external device, and an input / output unit that performs at least one of audio input / output and video input. According to the above configuration, an alarm system that can improve security when an alarm is issued to an external device that an abnormality has occurred in a resident or the like can be realized.

[0012] In order to solve the above problems, an information processing method according to one aspect of the present invention is an information processing method executed by an information processing device associated with one or more sensors, and includes an acquisition step of acquiring an encryption key for communication with an external device that is a destination of an alert when at least one of the one or more sensors detects an abnormality in an object, a communication step of performing at least one of audio communication and video communication with the external device using the encryption key, and an input / output step of performing at least one of audio input / output and video input. According to the above configuration, the same effect as the above-mentioned information processing device is achieved.

[0013] The information processing device according to each aspect of the present invention may be realized by a computer. In this case, the control program of the alarm system that realizes the alarm system on a computer by causing the computer to operate as each part (software element) of the information processing device, and the computer-readable recording medium on which it is recorded, also fall within the scope of the present invention. Effect of the Invention

[0014] According to one aspect of the present invention, when an abnormality occurs in a resident or the like, security can be improved when communicating with an external device that is to be the destination of a notification. [Brief description of the drawings]

[0015] [Figure 1] FIG. 1 is an example of a functional block diagram showing an overall overview including an alarm system. [Diagram 2] FIG. 2 is a functional block diagram of a communication device; [Diagram 3] 1 is an example of a sequence diagram showing an overall flow of processing in an alarm system or the like. [Figure 4] 1 is an example of a sequence diagram showing an overall flow of processing in an alarm system or the like. [Diagram 5] 1 is a diagram showing an example of a connection between a communication device, a photographing device, and a reception management device; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0016] [Embodiment] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. Note that the embodiment described below is subject to various technically preferable limitations for carrying out the present invention, but the scope of the present invention is not limited to the following embodiment and illustrated examples.

[0017] [Overview] First, an overview of an alarm system 1 according to this embodiment will be described with reference to Fig. 1. Fig. 1 is a functional block diagram showing an overview including the alarm system 1. As shown in Fig. 1, the alarm system 1 is a system for checking whether there is any abnormality in the heart rate, etc., of a resident 15, etc., in a lockable space section 10, and, if there is an abnormality, for example, issuing a report to that effect to a reception management device (external device) 20 operated by an operator to confirm the safety and request an emergency medical aid. Hereinafter, a person who is the subject of safety confirmation by the alarm system 1, or a person who may be the subject, may also be referred to as a subject.

[0018] [Specific examples of lockable spaces] The lockable space 10 is not limited to buildings that are fixed, such as a residence, a dormitory, an apartment building, or a facility, but also includes vehicles that are not fixed, such as passenger ships and sleeper trains. Furthermore, the lockable space 10 is not limited to buildings that are isolated from the outside air.

[0019] The above-mentioned residences are not limited to detached houses for single households, but also include non-compartmental buildings such as two-family homes where multiple households have locking control for each household, and housing for the elderly with service facilities. Dormitories are not limited to a system where each room is not locked and the entire building is locked, but include buildings where each room other than the common areas is locked individually. Apartment complexes are not limited to rooms that are private areas of compartmentalized buildings such as apartments and condominiums, but also include attached buildings that can be locked. Condominiums include a system where each room is locked and controlled individually, as well as a system where the entire condominium is locked.

[0020] Facilities include accommodation facilities such as hotels, inns, and private lodgings, welfare and care facilities such as nursing homes and day care centers, medical facilities such as hospitals and clinics, education and childcare facilities such as schools, kindergartens, nursery schools, daycare centers and after-school programs, commercial facilities such as offices, theaters, cafe complexes, and karaoke boxes, exhibition facilities such as art galleries and museums, public facilities such as community centers and children's centers, sports stadiums such as gymnasiums and martial arts halls, as well as public washrooms, warehouses, factories, garages, etc.

[0021] Vehicles include automobiles such as private cars, buses, and taxis, trains such as regular cars and sleeper cars, aircraft such as airplanes and helicopters, ships such as regular ships, accommodation ships, and submarines, and spacecraft such as space stations and rocket transport vehicles.

[0022] For example, if the lockable space 10 is a residence or an apartment building, the target person 15 corresponds to a resident or his / her family, a temporary visitor, etc. If the lockable space 10 is a facility, the target person 15 is not limited to an employee but also corresponds to a visitor, etc.

[0023] In the following, the alarm system 1 will be described as being installed in a home, but as mentioned above, part or all of the system may be installed in a facility such as a hospital or in any other space.

[0024] 1, the alarm system 1 includes one or more communication devices (information processing device, speaker microphone) 11, one or more sensors (sensor edges) 28, a management device (management unit, edge system) 26, a key management unit 36, and an image capture device (information processing device) 38, which are associated with each other. Each communication device 11 corresponds to one or more sensors 28 in the vicinity. However, one sensor 28 may correspond to multiple communication devices 11.

[0025] Fig. 2 is a functional block diagram of the communication device 11. The communication device 11 is a device for performing voice communication with the reception management device 20, and as shown in Fig. 2, includes a control unit 12, a storage unit 21, a communication unit 22, an alarm unit 23, and an input / output unit 24. In addition, each communication device 11 operates in conjunction with each other, and can synchronize information stored in the storage unit 21, for example. It is desirable to provide each communication device in a position somewhat apart from each other, such as in a different room.

[0026] The control unit 12 is a control device that controls the entire communication device 11 , and also functions as the acquisition unit 13 .

[0027] When at least one of one or more sensors 28 detects that an abnormality has occurred in the target, the acquisition unit 13 acquires an encryption key for communicating with the reception management device 20, which is the destination of the alert, from the infrastructure server 42 via the management device 26.

[0028] The memory unit 21 is a storage device that stores various information, and at least temporarily stores, for example, the encryption key acquired by the acquisition unit 13. The communication unit 22 is an interface that performs communication processing with an external device, and performs at least one of audio communication and video communication with the reception management device 20 using, for example, the encryption key. The communication unit 22 may be configured to be connected to a relay device (relay server) 40 via a router (not shown) or the like.

[0029] The alarm unit 23 outputs an alarm based on the control of the management device 26 via the control unit 12. The alarm unit 23 may be realized as, for example, a buzzer or an LED, and may be configured to output an alarm by alarm sound or light. Alternatively, the alarm unit 23 may be configured to output an alarm according to an abnormality detected by the sensor 28. For example, the alarm unit 23 may be configured to output a louder sound or stronger light as the degree of the abnormality of the subject becomes greater.

[0030] The input / output unit 24 inputs and outputs audio. The input / output unit 24 may also input video. The input / output unit 24 may be realized as a microphone and speaker that input and output audio in audio communication with the reception management device 20, or a camera that captures video to be transmitted to the reception management device 20.

[0031] Furthermore, the communication device 11 is not limited to a configuration in which it is installed at a specific position in the space 10. For example, a part or all of the communication device 11 may be configured to be realized as a mobile terminal such as a smartphone or tablet that is not fixed to a specific position. Furthermore, the communication device 11 may be configured to be able to add functions such as WiFi (registered trademark) and an AI speaker by, for example, expanding the built-in software.

[0032] In addition, as described later, one or more communication devices 11 are connected via a relay device 40 to a reception management device 20, which is the destination of an alert, when the detection result of at least one of one or more sensors 28 indicates that an abnormality has occurred in the target.

[0033] The sensor 28 senses at least one of the heart rate and the respiration of a subject within the detection range of the lockable space portion 10 in a non-contact manner, and measures at least one of the heart rate and the respiration rate of the subject.

[0034] Furthermore, the sensor 28 judges whether or not an abnormality has occurred in the target by referring to its own sensing result. However, the above judgment may be performed by another device independent of the sensor 28, or by the management device 26. Furthermore, the sensor 28 may be configured to include a range sensor or the like, calculate the height of the target based on the detection result, and judge the presence or absence of an abnormality according to a standard according to the identified person.

[0035] In another embodiment, the vital data measured by the sensor 28 is not limited to the heart rate or respiration, and may be configured to measure other vital data such as body temperature or sweat rate. Also, as described later, the subject measured by the sensor 28 is not limited to a person. The sensor 28 may be configured to include a plurality of types of sensors, such as a pyroelectric sensor (infrared array sensor), an FMCW radar (Frequency Modulated Continuous Wave radar), a Doppler sensor, a temperature sensor, or a chemical sensor. For example, as shown in FIG. 1, the position of the subject may be detected by a pyroelectric sensor, and the heart rate or respiration rate may be measured by a Doppler sensor.

[0036] The management device 26 is a device realized as a personal computer or the like, and controls each device in the alert system 1, and transmits and receives information to and from the infrastructure server 42, etc. For example, when the management device 26 acquires information from the sensor 28 indicating that an abnormality has occurred in an object, it transmits to the infrastructure server 42 the above information, information indicating the reception management device 20 to which it is connected, and information indicating the alert system 1 itself, which is the source of the alert, or each device included in the alert system 1, etc.

[0037] The management device 26 or another device not shown may be configured to determine the operating status of each component of the alarm system 1, such as the sensor 28, the communication device 11, the image capturing device 38, etc., and record the determination result. When at least a part of each component of the alarm system 1 is not operating due to a malfunction or the like, information indicating this may be transmitted from the alarm system 1 to the reception management device 20, or may be presented to the subject via the communication device 11 or the like.

[0038] The key management unit 36 ​​responds to instructions sent from the reception management device 20 and controls the opening and closing of an electronic lock provided at the entrance of the lockable space portion 10 .

[0039] The photographing device 38 is a device provided so as to be able to photograph the vicinity of the entrance outside the space portion 10. The configuration of the photographing device 38 is similar to that of the communication device 11 shown in Fig. 2, and therefore a redundant description will not be repeated.

[0040] The input / output unit 24 of the photographing device 38 is realized as a camera that photographs the image to be transmitted to the reception management device 20, and inputs the image to the photographing device 38. In addition, the input / output unit 24 of the photographing device 38 may be provided with a microphone and a speaker that input and output sound. The acquisition unit 13 of the photographing device 38 acquires an encryption key for communicating with the reception management device 20, which is the destination of the alert, from the infrastructure server 42 via the management device 26, when at least one of the one or more sensors 28 detects that an abnormality has occurred in the target. Note that the number of photographing devices 38 provided in the alert system 1 is not limited to one, and for example, one or more photographing devices 38 may be provided near each of one or more entrances / exits.

[0041] From another perspective, the information processing device of the present disclosure realized as the communication device 11 or the photographing device 38 can be said to be an information processing device associated with one or more sensors 28, and includes an acquisition unit 13 that acquires an encryption key for communicating with the reception management device 20, which is the destination of an alert, when at least one of the one or more sensors 28 detects that an abnormality has occurred in the target, a communication unit 22 that performs at least one of audio communication and video communication with the reception management device 20 using the encryption key, and an input / output unit 24 that performs at least one of audio input / output and video input.

[0042] Next, a description will be given of devices and the like that are not included in the alarm system 1 in Fig. 1. The infrastructure server 42 is a server arranged on a cloud, and stores, for example, information on the target person who uses the alarm system 1, information indicating each device connected via the relay device 40, or encryption keys for each device to communicate, or information for generating encryption keys, etc.

[0043] When the infrastructure server 42 receives information indicating that an abnormality has occurred in the target from the management device 26, the infrastructure server 42 transmits the information and information indicating the source of the report to the reception management device 20. The infrastructure server 42 also transmits an encryption key for communication via the relay device 40 and other information necessary for communication to the management device 26 and the reception management device 20. Here, the information necessary for the communication is, for example, information indicating the connection destination of communication via the relay device 40, an ID number for identifying the connection itself, etc.

[0044] The reception management device 20 is a device to which a report is sent when an abnormality occurs with a target person. The reception management device 20 is realized, for example, as a terminal device operated by an operator. The reception management device 20 may be operated by an operator, but may also replace part or all of the operator's work with machine learning such as AI. Since data related to reception handled by an operator contains a large amount of information, it is also useful to generate judgment information using machine learning such as AI.

[0045] The specific method for the data analysis and judgment information generation process by the reception management device 20 is not limited to this embodiment, and for example, any one of the following machine learning methods or a combination of them can be used.

[0046] Support Vector Machine (SVM) Clustering Inductive Logic Programming (ILP) · Genetic Algorithm (GP: Genetic Programming) ·Bayesian Network (BN) Neural Network (NN) When using a neural network, it is advisable to process the input sensing data in advance for input to the neural network. For such processing, in addition to one-dimensional or multi-dimensional arrangement of data, a method such as data augmentation can be used.

[0047] In addition, when using a neural network, a convolutional neural network (CNN) including a convolution process may be used, or a recurrent neural network (RNN) including a recursive process may be used. More specifically, when using a CNN, a convolutional layer that performs a convolution operation may be provided as one or more layers included in the neural network, and a filter operation (product-sum operation) may be performed on input data input to the layer. In addition, when performing a filter operation, a process such as padding may be used in combination, or an appropriately set stride width may be adopted.

[0048] Furthermore, as the neural network, a multi-layer or ultra-multi-layer neural network having several tens to several thousands of layers may be used.

[0049] Furthermore, the machine learning used in the data processing may be supervised learning or unsupervised learning.

[0050] The programs and / or data used in data processing are preferably stored in the device that executes the machine learning method itself, but may also be stored in an external storage means.

[0051] In the alarm system 1 according to this embodiment, when a subject 15 using the lockable space portion 10 collapses in the lockable space portion 10 and becomes in an abnormal state, the reception management device 20 or the operator checks the subject's safety, and if the subject's safety cannot be confirmed, an ambulance is requested, and after confirming that it is ambulance personnel 35 who have arrived at the lockable space portion 10, the lock installed in the lockable space portion 10 is unlocked. This makes it possible to safely, reliably, and quickly respond to any abnormality in the subject 15 using the lockable space portion 10.

[0052] In addition, it may be possible to determine whether the subject 15 using the lockable space 10 is in a prone state, and if so, whether there are any abnormalities in the heart rate, respiratory rate, etc., or it may be possible to determine whether the subject 15 is in a prone state, but not from a significant difference from normal in the heart rate, respiratory rate, etc.

[0053] When the reception management device 20 receives information indicating that an abnormality has occurred in the target from the infrastructure server 42, the reception management device 20 communicates with each communication device 11 and the image capture device 38 via the relay device 40 using information such as an encryption key required for communication. In addition, the reception management device 20 may be configured to be able to acquire information indicating the measurement results of the sensor 28 in real time, for example, via the management device 26, the communication device 11, and the relay device 40, while the reception management device 20 is communicating with the target via the relay device 40.

[0054] The relay device 40 is a server that relays communication between each of the communication devices 11 and the photographing device 38 and the reception management device 20 by communication using WebRTC (Web Real-Time Communication) or the like. The communication method in the communication relayed by the relay device 40 is not limited to a specific method, and may be a communication method using WebRTC as described above, or may be a method using RTMP (Real Time Message Protocol) or SIP (Session Initiation Protocol). For example, when P2P (Peer to Peer) using WebRTC is used as the communication configuration, the relay server is realized as a signaling server or an authentication server for establishing P2P communication between each device. When WebRTC or the like is used in the communication, the communication configuration is not limited to P2P, and may be an MCU (Multipoint Control Unit) or an SFU (Selective Forwarding Unit), or the like.

[0055] [Processing flow in the reporting system] Next, the flow of processing in the alert system 1 will be described with reference to Fig. 3 and Fig. 4. Fig. 3 and Fig. 4 are sequence diagrams showing the flow of the entire processing in the alert system 1 etc. Following the processing shown in Fig. 3, the processing shown in Fig. 4 is executed.

[0056] First, the sensor 28 determines whether or not a subject has been detected within the detection range (S101). If the sensor 28 detects a subject (YES in S101), the sensor 28 measures the subject's heart rate or respiratory rate (S102). If the sensor 28 does not detect a subject (NO in S101), the process of waiting for the sensor 28 to detect a subject continues.

[0057] Next, the sensor 28 refers to its own detection result and judges whether or not the subject has an abnormality (S103). When the sensor 28 judges that an abnormality has occurred in the subject (YES in S103), the alert system 1 issues an alert (S104). That is, as described above, information indicating that an abnormality has occurred in the subject is output from the sensor 28 to the management device 26, and the management device 26 transmits the above information, information indicating the reception management device 20 to be connected, and information indicating the source of the alert, etc. to the base server 42. Also, for example, in step S104, the alarm unit 23 of the communication device 11 may output an alarm for a predetermined time, for example, by an alarm sound or light, based on the control of the management device 26. Also, when the subject's physical condition recovers after the above alarm is output, the configuration may be such that an instruction to cancel the alarm and the alert can be given to the management device 26 or the communication device 11 via a mobile terminal such as a smartphone held by the subject himself / herself.

[0058] Moreover, if the sensor 28 determines that no abnormality has occurred in the subject (NO in S103), the process from step S101 is repeated.

[0059] Next, the infrastructure server 42 authenticates the management device 26, and then transmits an encryption key for communicating via the relay device 40 and other information necessary for communication to the management device 26. Also, the infrastructure server 42 authenticates the reception management device 20, and then transmits information indicating that an abnormality has occurred in the target, information indicating the source of the report, an encryption key for communicating via the relay device 40, and other information necessary for communication to the reception management device 20 (S105).

[0060] In addition, in step S105, the base server 42 may separately transmit information indicating that an abnormality has occurred in the subject to one or more terminal devices, such as a smartphone held by the subject's family member or the like, that have been registered in advance.

[0061] Next, the communication device 11, the photographing device 38, and the reception management device 20, which have acquired information necessary for communication such as an encryption key via the management device 26, each access the relay device 40 and communicate via the relay device 40 (S106, acquisition step, communication step, input / output step). Here, at least voice communication is performed between the reception management device 20 and the communication device 11, and at least video communication is performed between the reception management device 20 and the photographing device 38, in which a photographed image is transmitted from the photographing device 38 to the reception management device 20.

[0062] As described above, in the processing in the alarm system 1 etc., an information processing method is executed by an information processing device (communication device 11, photographing device 38) associated with one or more sensors 28, and includes an acquisition step of acquiring an encryption key for communicating with the reception management device 20, which is the destination of the alarm, when at least one of the one or more sensors 28 detects that an abnormality has occurred in the target, a communication step of performing at least one of audio communication and video communication with the reception management device 20 using the encryption key, and an input / output step of performing at least one of audio input / output and video input.

[0063] Next, the reception management device (operator) 20 calls the target person by calling the communication device 11 to confirm the target person's safety (S107). Here, the reception management device 20 may enable voice input by at least one of the communication devices 11 to which the target person is responding by referring to the response to the call or the real-time measurement result by the sensor 28, and transmit an instruction to the communication device 11 via, for example, the relay device 40 to disable voice input by the other communication devices 11. By each communication device 11 operating according to the above instruction, unnecessary voices that become noise among the voices transmitted to the reception management device 20 can be blocked, and the call voice can be made clearer.

[0064] Fig. 5 is a diagram showing an example of connections between the communication devices 11 (11a to 11c, ...), the photographing devices 38, and the reception management device 20. However, in Fig. 5, the illustration of the relay device 40 is omitted. In addition, the numbers of the communication devices 11 and the photographing devices 38 are not limited to the configuration shown in Fig. 5.

[0065] 5 shows an example of a case where the reception management device 20 transmits an instruction to the communication devices 11b and 11c to disable audio input to the input / output unit 24 (microphone). In the example of Fig. 5, audio from the reception management device 20 is output from the input / output unit 24 (speaker) of the communication devices 11a to 11c and the photographing device 38, while the reception management device 20 outputs the audio input to the input / output unit 24 of the communication device 11a, and the video and audio input to the input / output unit 24 of the photographing device 38.

[0066] In a broader embodiment, the input / output unit 24 of the communication device 11 or the photographing device 38 may disable at least one of audio input or output, or video input, in response to an instruction transmitted from the reception management device 20. In this way, basically, each audio and video is transmitted to the reception management device 20, but the reception management device 20 can select and block unnecessary audio or video input or output in order to properly conduct a call or the like.

[0067] The alarm system may further be capable of switching the communication device 11 or the image capture device 38 to disable at least one of the audio input or output or the video input in response to an instruction sent from the reception management device 20. This allows the reception management device 20 to suitably switch the input and output of each device at any time even if the target person moves after connection. This also contributes to the reception management device 20 quickly grasping the fact that the alarm is a false alarm when it is issued.

[0068] When the reception management device 20 checks the safety of the subject and determines that the subject is safe and normal (YES in S108), the process shown in the sequence diagrams of Figs. 3 and 4 ends, and the reception management device 20 waits for the next report from the report system 1. When the reception management device 20 determines that the subject is safe and normal (NO in S108), the reception management device 20 ends the call and issues an emergency call to the fire department 30 (S109). Then, when the emergency personnel 35 from the fire department 30 arrives at the lockable space 10 used by the subject 15 (S110), the call button is pressed and the visitor is photographed by the photographing device 38 installed in the lockable space 10. Then, the photographed image is transmitted to the reception management device 20 via the relay device 40. The reception management device 20 checks whether it is the ambulance crew 35 who has arrived at the lockable space portion 10 by checking the image captured by the photographing device 38 (S111, arrival information presentation step). The transmission of the image captured by the photographing device 38 to the reception management device 20 may be started from when the communication device 11 issues a report.

[0069] If it is confirmed that the person is an ambulance technician 35 (YES in S111), the reception management device 20 transmits an instruction to unlock the door of the lockable space portion 10 to the key management unit 36 ​​via, for example, the infrastructure server 42 and the management device 26 (S112). The key management unit 36 ​​that has received the unlock instruction from the reception management device 20 controls the electronic lock to unlock the door of the lockable space portion 10 (S113, unlocking step).

[0070] This allows emergency personnel 35 to be sent to the subject promptly if something unusual occurs to the subject.

[0071] An example of the overall process flow in the alarm system 1 etc. has been described above. Note that the control to unlock the electronic lock from the reception management device 20 may be configured to be possible only for a predetermined time after the alarm is generated in S104. Also, when the reception management device 20 confirms that the ambulance crew 35 has carried the target person out of the space section 10 from the entrance / exit, it is desirable for the reception management device 20 to instruct the key management unit 36 ​​to lock the door of the space section 10 that can be locked.

[0072] Furthermore, the use of the alarm system 1 is not limited to checking the safety of a subject, and it can also be used, for example, as a crime prevention system that issues an alarm when an intruder enters a home or the like. For example, in a configuration in which the alarm system 1 is used as the crime prevention system, the reception management device 20, which has received information from the communication device 11 indicating that an intruder has been detected in the spatial portion 10, may issue an alarm to a security company or the police, etc., if there is no response from the resident to the call corresponding to the processing of step S107. Furthermore, the alarm system 1 can also be used to issue an alarm when a fire, gas leak, or the like occurs. In other words, the subject for which the alarm system 1 judges an abnormality is not limited to a person.

[0073] Furthermore, the process of disabling at least one of the voice input or output, or the video input, by the input / output unit 24 of some of the communication devices 11 or the photographing device 38 is not limited to the aspect based on the instruction transmitted from the reception management device 20 as described above. For example, the alarm system 1 may enable the voice input by the communication device 11 corresponding to the sensor 28 that detected the occurrence of an abnormality in the target, and disable the voice input of the other communication devices 11. Furthermore, the communication device 11 for which the voice input is enabled or disabled may be automatically switched according to, for example, the movement of the target.

[0074] With the above configuration, the alarm system 1 can automatically enable audio input and output of a communication device 11 located near a sensor 28 that detects an abnormality, and automatically enable only audio output for other communication devices 11.

[0075] Furthermore, when an abnormality occurs in the target, a report from the management device 26 to the reception management device 20 may be sent via, for example, a mobile terminal, in addition to the infrastructure server 42. As an example, when the infrastructure server 42 receives information indicating that an abnormality has occurred in the target from the management device 26, the mobile terminal may receive each piece of information and transmit it to the reception management device 20. Furthermore, in the above configuration, when the reception management device 20 acquires each piece of information, it accesses the relay device 40 to acquire information necessary for communication, such as an encryption key.

[0076] 〔summary〕 The information processing device (11, 38) according to aspect 1 of the present invention is an information processing device associated with one or more sensors (28), and is configured to include an acquisition unit (13) that acquires an encryption key for communicating with an external device (20) that is to be notified when at least one of the one or more sensors detects that an abnormality has occurred in an object, a communication unit (22) that performs at least one of audio communication and video communication with the external device using the encryption key, and an input / output unit (24) that performs at least one of audio input / output and video input.

[0077] An information processing device according to aspect 2 of the present invention may be configured in the above-mentioned aspect 1 such that the communication unit communicates with the external device via a relay server (40) that relays communication between the information processing device and the external device using WebRTC.

[0078] An information processing device according to aspect 3 of the present invention may be configured in accordance with aspect 1 or 2 above, such that the input / output unit disables at least one of audio input or output, or video input in response to an instruction transmitted from the external device.

[0079] The information processing device according to a fourth aspect of the present invention may be configured in any one of the first to third aspects, further comprising an alarm unit (23) that outputs an alarm according to an abnormality detected by the sensor.

[0080] The alarm system (1) according to aspect 5 of the present invention comprises one or more sensors (28) for non-contact sensing of at least one of the heart rate and breathing of a subject, and one or more information processing devices (11, 38) associated with the one or more sensors, and the information processing device comprises an acquisition unit (13) for acquiring an encryption key for communicating with an external device that is to be the destination of an alarm when at least one of the one or more sensors detects that an abnormality has occurred in the subject, a communication unit (22) for performing at least one of audio communication and video communication with the external device using the encryption key, and an input / output unit (24) for performing at least one of audio input / output and video input.

[0081] The information processing method according to aspect 6 of the present invention is an information processing method executed by an information processing device (11, 38) associated with one or more sensors (28), and includes an acquisition step of acquiring an encryption key for communicating with an external device (20) that is to be notified when at least one of the one or more sensors detects that an abnormality has occurred in an object, a communication step of using the encryption key to perform at least one of audio communication and video communication with the external device, and an input / output step of performing at least one of audio input / output and video input.

[0082] [Software implementation example] The control block included in the alarm system 1 (particularly the acquisition unit 13 of the control unit 12) may be realized by a logic circuit (hardware) formed in an integrated circuit (IC chip) or the like, or may be realized by software.

[0083] In the latter case, the alarm system 1 includes a computer that executes instructions of a program, which is software that realizes each function. The computer includes, for example, one or more processors, and a computer-readable recording medium that stores the program. The object of the present invention is achieved by the processor reading the program from the recording medium and executing it in the computer. The processor may be, for example, a CPU (Central Processing Unit). The recording medium may be a "non-transient tangible medium," such as a ROM (Read Only Memory), tape, disk, card, semiconductor memory, programmable logic circuit, or the like. The system may further include a RAM (Random Access Memory) that expands the program. The program may be supplied to the computer via any transmission medium (such as a communication network or broadcast waves) that can transmit the program. One aspect of the present invention may also be realized in the form of a data signal embedded in a carrier wave, in which the program is embodied by electronic transmission.

[0084] The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention. [Explanation of symbols]

[0085] 1. Alarm system 11 Communication device (information processing device, speaker microphone) 12 Control section 13 Acquisition Department 20 Reception management device (external device, operator) 21 Memory section 22 Communications Department 23 Alarm section 24 Input / output section 26 Management device (management unit, edge system) 28 Sensor (sensor edge) 36 Key Management Department 38 Imaging device (information processing device) 40 Relay device (relay server) 42 Infrastructure Server

Claims

1. An information processing device that functions as a communication device associated with one or more sensors, an acquisition unit that acquires an encryption key for communicating with an external device that is a destination of an alert when at least one of the one or more sensors detects that an abnormality has occurred in the target; a communication unit that performs at least audio communication among audio communication and video communication with the external device using the encryption key; an input / output unit that inputs / outputs at least audio among audio input / output and video input; Equipped with The input / output unit includes: When none of the one or more sensors detects the target, the voice input is disabled while the voice output is enabled.

23. An information processing apparatus comprising:

2. The communication unit is The information processing device communicates with the external device via a relay server that relays communication between the information processing device and the external device using WebRTC.

2. The information processing apparatus according to claim 1,

3. The input / output unit includes: In response to an instruction transmitted from the external device, at least one of audio input or output and video input is disabled.

3. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.

4. The system further includes an alarm unit that outputs an alarm of a scale corresponding to the degree of the abnormality detected by the sensor.

4. The information processing apparatus according to claim 1, wherein the information processing apparatus further comprises: a first input section;

5. The present invention includes one or more sensors that non-contactly sense at least one of a heartbeat and a respiration of a subject, and one or more information processing devices that function as communication devices associated with the one or more sensors, Each of the information processing devices includes: an acquisition unit that acquires an encryption key for communicating with an external device that is a destination of an alert when at least one of the one or more sensors detects that an abnormality has occurred in the target; a communication unit that performs at least audio communication among audio communication and video communication with the external device using the encryption key; an input / output unit that performs at least audio input / output among audio input / output and video input, and that disables audio input while keeping audio output enabled when none of the one or more sensors associated with the device itself detects the target; An alarm system comprising:

6. An information processing method executed by an information processing device functioning as a communication device associated with one or more sensors, comprising: an acquisition step of acquiring an encryption key for communicating with an external device that is a destination of an alert, when at least one of the one or more sensors detects that an abnormality has occurred in the target; a communication step of performing at least audio communication among audio communication and video communication with the external device using the encryption key; an input / output step of performing at least audio input / output among audio input / output and video input; Including, In the input / output step, When none of the one or more sensors detects the target, the voice input is disabled while the voice output is enabled.

23. An information processing method comprising:

Images