Information processing device, information processing method and non-temporary storage medium

Abstract

The present disclosure provides an information processing device, an information processing method, and a non-temporary storage medium capable of issuing a warning to a person who is more likely to encounter danger in a dangerous place. In the information processing device, a control unit obtains information indicating the dangerous place, obtains the state of a person having a predetermined positional relationship with the dangerous place, and determines whether the state of the person is a state in which the person is more likely to encounter danger among multiple states that the person may encounter in the dangerous place. In addition, when it is determined that the state of the person is a state in which the person is more likely to encounter danger, the control unit causes the output unit to output information indicating a warning.

Description

Technical Field

[0001] The present disclosure relates to an information processing device, an information processing method, and a non-transitory storage medium. Background Art

[0002] There has long been a technology that detects contact with foreign matter based on the displacement of a skirt guard, and a vibration generator provided on the skirt guard panel responds to this and vibrates the panel to warn the passenger by generating vibrations from the foot, thereby causing the foot (shoe) to move back (for example, Patent Document 1).

[0003] Prior Art Literature

[0004] Patent Literature

[0005] Patent Document 1: Japanese Patent Application Laid-Open No. 10-87254 Summary of the invention

[0006] Problems to be solved by the invention

[0007] An object of the present disclosure is to provide an information processing device, an information processing method, and a non-transitory storage medium capable of issuing a warning to a person who is likely to encounter danger in a dangerous place.

[0008] Methods for solving problems

[0009] One method of the present disclosure is an information processing device, which includes a control unit, which performs the following processing, namely: judging whether the state of a person having a predetermined positional relationship with a dangerous place is a state in which the person is more likely to encounter danger among multiple states that the person may encounter in the dangerous place, and, when it is judged that the state of the person is the state in which the person is more likely to encounter danger, causing an output unit to output information indicating a warning.

[0010] The embodiment of the present disclosure may include at least one of an information processing method, an information processing system, a program, and a recording medium recording the program, which have the same features as those of the information processing device.

[0011] Effects of the Invention

[0012] According to the present disclosure, it is possible to issue a warning to a person who is highly likely to encounter danger in a dangerous place. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 The following is a configuration example of an information processing system according to an embodiment of the present invention.

[0014] Figure 2 This is a diagram illustrating hazardous locations.

[0015] Figure 3 This shows an example of the server configuration.

[0016] Figure 4 This figure shows an example of the data structure of a dangerous location management table.

[0017] Figure 5 This is an example of the data structure of a management table showing people.

[0018] Figure 6 This section shows an example of the structure of a terminal.

[0019] Figure 7 A sequence diagram showing an example of how the information processing system operates.

[0020] Figure 8 A sequence diagram showing an example of how the information processing system operates.

[0021] Fig. 9 This is a flowchart showing an example of processing by the server.

[0022] Fig.10 Shows a modified example of the information processing system.

[0023] Fig.11 It is a sequence diagram showing an operation example of the information processing system involved in the modification example. DETAILED DESCRIPTION

[0024] An information processing device according to an embodiment includes a control unit.

[0025] (1) The control unit is a control unit that determines whether the state of a person having a predetermined positional relationship with a dangerous place is a state in which the person is likely to encounter danger among a plurality of states that the person may encounter in the dangerous place.

[0026] (2) When the control unit determines that the person is in a state with a high possibility of being in danger, the control unit causes the output unit to output information indicating a warning.

[0027] According to the information processing device, when a person who has a predetermined positional relationship with a dangerous place is in a state where there is a high possibility of encountering danger in the dangerous place, a warning is issued. Thus, although not currently in a dangerous place, a person who is likely to encounter danger if he goes to the dangerous place can be stopped from moving to the dangerous place, or made to detour, or treated in a cautious manner.

[0028] A state in which the possibility of encountering danger in a dangerous place is high refers to a state in which the possibility of encountering danger in a dangerous place is compared among multiple states that a person may encounter in a dangerous place, and the possibility is higher than that in any state. For example, as a state (action state or movement mode) of a person moving on an icy road, there may be a walking state, a running state, and a bicycle state. Among these states, the running state and the bicycle state are states in which the possibility of encountering the danger of "slipping" is higher than the walking state.

[0029] Hereinafter, an information processing device, an information processing method, and a program according to the embodiment will be described with reference to the drawings. The configuration of the embodiment is an example, and the present disclosure is not limited to the configuration of the embodiment.

[0030] System Structure

[0031] Figure 1 FIG. 1 is a schematic diagram of an information processing system according to an embodiment of the present invention. Figure 1 In the information processing system, a system is used to warn people who are more likely to encounter danger in a dangerous place. Figure 1 In the example, the information processing system includes a network 1, a server 20 connected to the network 1, a camera 3, a camera 3A, a speaker 4, and a terminal 30.

[0032] The network 1 is, for example, a public communication network such as the Internet, and can adopt a WAN (Wide Area Network) or other communication networks. The network 1 may also include a cellular network such as LTE (Long Term Evolution) and 5G, or a wireless network (wireless path) such as a wireless LAN (Local Area Network: including Wi-Fi) and BLE.

[0033] The server 20 is an example of an "information processing device". The server 20 receives images (videos) captured by the cameras 3 and 3A, and detects (determines) the dangerous place 10 based on the captured images. However, the detection of the dangerous place 10 may be performed using, for example, a sensor other than the camera 3 or 3A.

[0034] Cameras 3 and 3A, for example, capture the movement path of a person. The movement path can be indoors or outdoors. In addition, outdoors can be in a city or in the suburbs. The movement path outdoors can be a road or a passage in a land. In this embodiment, cameras 3 and 3A capture scenes in the city, and capture the movement path of the person in the scene in the city in the captured image.

[0035] Camera 3 is a fixed camera installed in the city. On the other hand, camera 3A is mounted on a vehicle 50 ( Figure 2 ) on a vehicle. One of the cameras 3 and 3A can be omitted. In addition, the number of each camera 3 and 3A can be set to an appropriate number of one or more than two. In addition, the cameras 3 and 3A can also be capable of changing the shooting range (field of view) by rotating to the left and right and moving up and down. In addition, the cameras 3 and 3A can also have a zoom function.

[0036] The dangerous place 10 is a place where the possibility of encountering danger increases for a person in a certain state. The dangerous place 10 may be a place in a state of permanent danger, or a place where the state changes due to the occurrence of events such as weather or human activities, or a place where the safety of human movement is temporarily reduced until the state returns to the original state. Although the dangerous place 10 is, for example, a place in the movement path of a person, it may also be outside the movement path. A place where the safety of movement is temporarily reduced may also be a place where, for example, the safety of movement is reduced compared to before the occurrence of the event due to the occurrence of an event in the movement path of a person.

[0037] Places where safety is temporarily reduced include places where the road surface of the moving path is frozen or flooded due to events such as snowfall, flooding, or bursting of water pipes. In addition, places where safety is temporarily reduced include places where a recess or level difference is temporarily formed on the moving path due to events such as replacement of gutter covers or road construction such as paving. Alternatively, places where safety is temporarily reduced include places where obstacles are placed on the moving path (places where the event of obstacle placement occurs). Obstacles include construction equipment such as road cones, vehicles parked or stopped due to unloading or accidents, and emergency vehicles.

[0038] In addition, the places where safety is temporarily reduced include construction or cleaning sites of the moving path or structures facing the moving path. For example, it is a place where a recess is formed on the ground due to excavation of the road surface caused by the construction of water pipes or gas pipes. Or it is a moving path below the place where high-rise construction in the structure facing the moving path is carried out. High-rise construction includes, for example, construction on the electric pole facing the moving path (road) and cleaning of windows or walls of high-rise buildings facing the road.

[0039] In addition, the places where the safety is temporarily reduced include places where the passage aids set on the moving path are damaged or removed. Passage aids refer to handrails, guardrails, blind paths, etc. that assist the movement of the elderly or disabled. In addition, the places where the safety is temporarily reduced include places where the visual confirmation of the corner mirror is reduced, that is, places where the visual confirmation of the corner mirror is reduced due to changes in the setting angle caused by accidents or the mirror surface is covered by the growth of plants, etc.

[0040] The server 20 detects the dangerous place 10 based on the image captured by the camera 3 or 3A. In addition, the server 20 detects the person 11 having a predetermined positional relationship with the dangerous place 10. Figure 1 In the example shown, the person 11 existing within the circle 15 of a predetermined radius centered on the position of the dangerous place 10 (i.e., the person 11 existing within a predetermined geographical range when viewed from the dangerous place 10) is detected. However, in addition to the images captured by the cameras 3 and 3A, the person 11 may be detected by sensors installed in the city or sensors possessed by the person 11. Alternatively, the person 11 may be detected by visual confirmation of the captured images.

[0041] The server 20 determines whether the state of the person 11 is a state in which the person 11 is more likely to encounter danger in the dangerous place 10 based on the information indicating the state of the person 11. For example, when the person 11 is riding a bicycle or an electric bicycle, etc., and is moving at a faster speed than walking, the person 11 is more likely to fall when passing through a place with icy roads. Therefore, when the place with icy roads is a dangerous place 10, it is determined that the person 11 on the bicycle is in a state in which the possibility of encountering danger is higher. When it is determined that the person 11 is in a state in which the possibility of encountering danger is higher, the server 20 outputs information indicating a warning. The information indicating a warning is output to the speaker 4. For example, an alarm sound is broadcast from the speaker 4.

[0042] Alternatively, the speaker 4 may broadcast information indicating the dangerous place 10 (e.g., the intersection ahead), the dangerous state (e.g., the road surface is icy), or the state of a person who is likely to encounter danger (e.g., the state of riding a bicycle or a bicycle). The number of speakers 4 and the installation location can be set appropriately. A large display may be used instead of the speaker 4 or together with the speaker 4, and the warning information may be displayed on the display.

[0043] Information indicating a warning may also be sent to the terminal 30. For example, at least one of information indicating the dangerous place 10, information indicating a dangerous state, and information indicating a state of a person who is likely to encounter danger may be sent. The information may also be displayed on the display 35 ( Figure 4 ) on. In addition, the warning information can also be conveyed by at least one of the output of sound or light from the terminal 30 and the vibration of the terminal 30.

[0044] Hazardous Location Description

[0045] Figure 2 This is a diagram illustrating hazardous locations. Figure 2 1 shows an example of an image captured by the camera 3. The camera 3 captures an image (video) centered at an intersection where roads 12A and 12B intersect with roads 13A and 13B. The roads 12A, 12B, 13A, and 13B are examples of movement paths for people to move (pass).

[0046] exist Figure 2 In the example shown, there is a place where the road surface is frozen from road 13A to the intersection (iced place 10a), and a bicycle or electric bicycle may fall when turning right from road 12A to road 13A. In addition, there is an obstacle 10b (such as an accident car) parked on the roadside of road 13B. When pedestrians avoid obstacle 10b and pass through, they will step significantly beyond road 13B. In addition, wall construction is being carried out at a high place of a high-rise building 17 (an example of a structure) facing road 12B (construction site 10c is shown in the figure). Therefore, people passing under construction site 10c may be hit by falling objects. Iced place 10a, obstacle 10b, and construction site 10c each belong to dangerous place 10. Then, the server 20 broadcasts a warning from the speaker 4 to the persons 11a, 11b, 11c located around each of the icing site 10a, the obstacle 10b, and the construction site 10c (i.e., having a predetermined positional relationship with the dangerous site), thereby informing the person 11a, 11b, 11c of the high possibility of encountering danger. In addition, information indicating a warning is sent to the terminal 30 for the person 11A registered in the terminal 30. The device for informing is not limited to the speaker 4, but may also be a display (display device).

[0047] Server Structure

[0048] Figure 3 : shows a configuration example of the server 20. The server 20 can be configured using a general-purpose information processing device (computer) such as a personal computer (PC) or a workstation, or a dedicated information processing device such as a server machine. The server 20 has a communication function and can be connected to the network 1 by wire or wirelessly.

[0049] The server 20 includes a processor 21 as a processing unit or a control unit (controller), a storage device 22, a communication interface 23 (communication IF 23), an input device 24, and a display 25, which are interconnected via a bus 26. The server 20 may be a single information processing device or a collection of two or more information processing devices (cloud).

[0050] The storage device 22 includes a main storage device and an auxiliary storage device. The main storage device is used as a storage area for programs and data, a program expansion area, a program working area, a buffer area for communication data, etc. The main storage device is composed of a RAM (Random Access Memory) or a combination of RAM and ROM (Read Only Memory). The auxiliary storage device is used as a storage area for data and programs. As an auxiliary storage device, for example, non-volatile storage media such as a hard disk, a Solid State Drive (SSD), a flash memory, and an EEPROM (Electrically Erasable Programmable Read-Only Memory) can be used.

[0051] The communication IF23 is a circuit for implementing communication processing. For example, the communication IF23 is a network interface card (NIC). In addition, the communication IF23 can be a circuit for implementing wireless communication (LTE, wireless LAN (Wi-Fi) etc.), or a NIC and a wireless communication circuit.

[0052] The input device 24 includes keys, buttons, a pointing device, a touch panel, etc., and is used for inputting information. The display 25 is, for example, a liquid crystal display, etc., and displays information and data.

[0053] The processor 21 is, for example, a CPU (Central Processing Unit) etc. The processor 21 executes various programs stored in the storage device 22 to perform various processes.

[0054] For example, the processor 21 obtains the images captured by the cameras 3 and 3A, and detects the dangerous place 10 from the images captured by the cameras 3 and 3A. The processor 21 can detect the dangerous place 10 from the images captured by the cameras 3 and 3A by matching with the images captured in the normal state (images in which safety is ensured) and by judgment processing using machine learning or deep learning. However, the operator may detect (determine) the dangerous place 10 by referring to the captured images displayed on the display 25, and may set the dangerous place 10 in the server 20 using the input device 24. In addition, the processor 21 may detect the dangerous place 10 using devices (sensors, etc.) other than the cameras 3 and 3A.

[0055] The processor 21 of the server 20 detects the person 11 having a predetermined positional relationship with the dangerous place 10. For example, the person 11 in the image captured by the camera 3 or 3A can be detected using face recognition technology. For example, the person 11 existing in a predetermined geographical range (e.g., Figure 1 The person 11 within the circle 15) is detected.

[0056] At this time, the distance between the position of the dangerous place 10 and the position of the person 11 can also be calculated based on the prediction of the camera (captured image), and the person 11 outside the circle 15 can be excluded. In addition, the detection of the person 11 can also be implemented using methods other than face recognition. In addition, the detection of the person 11 can also be implemented using sensors other than the camera 3 and 3A. The sensor can be set in the city or held or worn by the person 11.

[0057] In addition, the predetermined positional relationship may also be a situation where the position of the dangerous place 10 and the position of the person 11 are less than a predetermined distance. In addition, the processor 21 measures the distance between the position of the dangerous place 10 and the position of the person according to the prediction of the camera 3 or 3A, for example, among the people captured in the image captured by the camera 3 or 3A, thereby being able to detect the person 11 less than the predetermined distance.

[0058] In addition, in the present embodiment, a configuration may be adopted in which the person 11 registers the terminal 30 on the server 20 and periodically reports the location of the terminal 30 detected by the terminal 30 to the server 20. In this case, the processor 21 may, for example, Figure 1 In the illustrated example, the person 11A holding the terminal 30 whose position is within the circle 15 is detected.

[0059] Furthermore, the processor 21 determines whether the person 11 is in a state where the possibility of encountering danger in the dangerous place 10 is high, based on the state of the person 11 having a predetermined positional relationship with the dangerous place 10 .

[0060] The state of the person 11 includes a state indicating a change in the position relative to the dangerous place 10. For example, the state of the person 11 includes at least one of a state facing the dangerous place 10, a state going to the dangerous place 10, a state approaching the dangerous place 10, a state moving away from the dangerous place 10, and a state moving in a direction different from the direction in which the dangerous place 10 exists.

[0061] For example, the state of the person 11 includes a state related to the moving method. For example, it includes at least one of the state in which the person 11 is walking, running, riding a bicycle or an electric bicycle, leaning on a cane, pushing a walker, and riding an electric cart. In addition, the state of the person 11 includes a state related to the moving speed, such as at least one of the state in which the moving speed exceeds a threshold value and the state in which the moving speed is lower than a threshold value.

[0062] Furthermore, the state of the person 11 includes a state indicating whether or not there is equipment or tools that can avoid or reduce the possibility of encountering danger in the dangerous place 10. The equipment or tools include, for example, a helmet, boots, gloves, and goggles.

[0063] The state of the person 11 is determined by the processor 21 performing image recognition of the captured image to infer the state of the person 11. When the state of the person 11 is consistent with the dangerous state of the dangerous place 10 and is a state of a person with a high possibility of encountering danger, the processor 21 determines that the person 11 is in a state with a high possibility of encountering danger in the dangerous place 10.

[0064] Figure 4 An example of the data structure of the management table showing the dangerous place 10 is shown below. Figure 5 An example of the data structure of the management table of the person 11 is shown. The management table of the dangerous place 10 has a record (entry) prepared for each dangerous place. Figure 4 In the illustrated example, an example is shown in which dangerous places A to E are detected as the dangerous place 10 and five corresponding entries are registered in the management table.

[0065] The entry stores the following information: information identifying the camera 3 or 3A that captured the image of the detection source of the dangerous place 10, information indicating the location of the detected dangerous place 10, the state of danger, information indicating the expected danger (dangerous item), the state of one or more people associated with the dangerous state (human states 1 to 3), and human attributes. Figure 4In the example shown, dangerous places A to C are detected from the image captured by camera 3, which is fixed camera #1, and dangerous place D is detected from the image captured by camera 3, which is fixed camera #2 different from fixed camera #1. In addition, dangerous place E is detected from the image captured by camera 3A, which is vehicle-mounted camera #1.

[0066] As the location information of the dangerous place, for example, the value of converting the coordinates on the captured image into the geographical plane coordinates is stored. The dangerous state, the expected danger, and the information group indicating the association with the human state are pre-stored in the storage device 22 (however, the server 20 can also obtain it from the network 1 as needed).

[0067] When the processor 21 detects a dangerous place 10 or a dangerous state based on the captured image, it reads the corresponding dangerous state, the expected danger, and the associated information group indicating the state of a person, and registers it in the corresponding entry of the management table. At this time, if there are multiple states of people associated with the dangerous state, all states are read. Figure 4 In the example shown, the status of up to three persons is associated with a dangerous status.

[0068] For human states 1, 2, and 3, AND (logical AND) or OR (logical OR) can be used. Figure 4 In the example shown, the state 1 of the person is ANDed with the states 2 and 3 of the person, and the state 2 of the person is ORed with the states 3 of the person.

[0069] For example, for the dangerous state "icy road surface", an association is established with "falling" as an anticipated danger (dangerous item), and it is set (defined) that a person 11 having state 1 "approaching", state 2 "high moving speed (exceeding a threshold)" and state 3 "bicycle" is in a state with a high possibility of encountering danger in the dangerous place 10.

[0070] In addition, in this embodiment, as an optional item, the combination of information indicating the dangerous state, dangerous event, and state of a person further includes information indicating the attributes of the person. Figure 4 In the example shown, the attribute of the person represents an elderly person or a disabled person.

[0071] Figure 5 The management table shown is prepared for each hazardous location. Figure 5 express Figure 4The management table shown is registered with a person 11 having a predetermined positional relationship with a dangerous place A. The management table has a record (entry) prepared for each person 11, and the entry contains the identification information of the person 11, information indicating the presence or absence of a terminal 30 possessed by the person 11, the position of the terminal 30, information indicating one or more states of the person 11, and information indicating the attributes of the person.

[0072] The storage device 22 stores information about a person who has registered the terminal 30. The information about the person includes personal information of the person (name and contact information, etc.), identification information of the terminal 30 (intrinsic information of the terminal 30 and a network address), attributes of the person (elderly or disabled), and location information of the terminal 30 reported regularly. For a person who has registered the terminal 30, in the corresponding entry, the information indicating the registration of the terminal 30, the location of the terminal 30, and the attributes are registered (transferred) in the management table of the person 11.

[0073] Information indicating the states of one or more persons 11 detected from a captured image or the like is registered as states 1 to 3. As for the states of the persons 11, one or more states corresponding to the dangerous state of the dangerous place 10 are detected and registered.

[0074] Processor 21 compares the status of the person registered in the entry of the dangerous place 10 with the status of the person in the management table of person 11 corresponding to the entry of the dangerous place 10, and judges whether the person is in a state with a high possibility of encountering danger based on whether person 11 is in a state that is judged to have a high possibility of encountering danger when moving toward the dangerous place 10.

[0075] Furthermore, when it is determined that the person is in a state where there is a high possibility of encountering danger, the processor 21 controls the communication IF 23 as an output unit to output (send) information indicating a warning to a predetermined speaker 4 (for example, the speaker 4 closest to the dangerous place 10). The information indicating a warning can include information indicating a dangerous state and information indicating the state of the person who is likely to encounter danger.

[0076] Terminal structure

[0077] Figure 6The following is a configuration example of the terminal 30. The terminal 30 is a mobile terminal (mobile terminal: a terminal with portability) having a wireless communication function. The mobile terminal is, for example, a smart phone, a tablet terminal, a notebook-type personal computer (PC), a Personal Digital Assistant (PDA) or a wearable computer. However, when registering the terminal 30 in the server 20, the terminal used may be the terminal 30 or a mobile terminal or a fixed terminal other than the terminal 30.

[0078] The terminal 30 includes a processor 31, a storage device 32, a communication interface (communication IF) 33, an input device 34, a display 35, and a GPS receiver 36. The processor 31, the storage device 32, the communication IF 33, the input device 34, and the display 35 can be the same as the processor 21, the storage device 22, the communication IF 23, the input device 24, and the display 25 described above. However, depending on the use and purpose of use, a device with different performance from that used in the server 20 can be used.

[0079] The processor 31 performs various processes by executing various programs stored in the storage device 32. For example, the processor 31 performs a process of sending registration information including personal information of a person, identification information of the terminal 30, and attributes of a person (elderly or disabled) to the server 20, and performs a process of registering the terminal 30 (registration information) in the server 20.

[0080] In addition, the processor 31 implements control to regularly or periodically report (transmit) the location information of the terminal 30 detected by the GPS receiver 36 to the server 20. In addition, the processor 31 implements processing for displaying the information indicating the warning received from the server 20 on the display 35 or broadcasting it from the speaker provided in the terminal 30.

[0081] In addition, as each processor 21 and processor 31, both multiple CPUs and multi-core CPUs can be applied. At least a part of the processing implemented by the CPU can also be implemented by a processor other than the CPU such as a DSP (Digital Signal Processor) or a GPU (Graphical Processing Unit). In addition, at least a part of the processing implemented by the CPU can also be performed by a dedicated or general-purpose integrated circuit such as an ASIC (Application Specific Integrated Circuit) and an FPGA (Field Programmable Gate Array), or a combination of a processor and an integrated circuit. The combination is, for example, called a microcontroller (MCU), a SoC (System-on-a-chip), a system LSI, a chipset, etc.

[0082] Work Example

[0083] An operation example of the information processing system will be described below. Figure 7 as well as Figure 8 This is a sequence diagram showing an example of how the information processing system works. Figure 7 In the embodiment of the present invention, a terminal 30 of a certain person transmits registration information to the server 20 according to the operation of the person (step S1). The server 20 stores the registration information in the storage device 22, thereby registering the terminal 30 in the server 20.

[0084] The server 20 receives the images captured by the cameras 3 and 3A via the network 1 (steps S2 and S2A). The server 20 detects the dangerous place 10 based on the captured images and generates a management table of the dangerous place 10 ( Figure 4 )(Step S3).

[0085] The server 20 determines whether there is an elderly person or a disabled person who has a predetermined positional relationship with the dangerous place 10. That is, the server 20 determines whether the person 11A whose terminal 30 and attribute (elderly person or disabled person) have been registered in the server 20 is included in the people who have a predetermined positional relationship with the dangerous place 10 (step S4).

[0086] When the person 11A is not included (S4: No), the server 20 detects the person 11 having a predetermined positional relationship with the dangerous place 10 and the state of the person 11, and generates a management table of the state of the person 11 ( Figure 5 )(Step S5).

[0087] When the server 20 determines that the person 11 is in a state with a high possibility of encountering danger in the dangerous place 10 based on the management table (entry) of the dangerous place 10 and the status of the person registered in the management table of the status of the person 11 (step S6 is "yes"), it outputs (sends) a warning message to the speaker 4 (step S7).

[0088] Figure 8 The case where the server 20 determines in step S4 that the person 11A with the registered terminal 30 and the attribute (elderly or disabled) is in a predetermined positional relationship with the dangerous place 10 (S4 is yes) is described. In this case, the server 20 outputs (sends) information indicating a warning to the terminal 30 of the person 11A (step S4A). Then, the processing of steps S5 to S7 is implemented. Therefore, the warning for the person 11A is sent to the terminal 30, and the warning for the person 11 is sent to the speaker 4.

[0089] Fig. 9 It is a flowchart showing a processing example of the processor 21 of the server 20. Fig. 9 Representation and Figure 7 as well as Figure 8 Different Operation Examples In step S001 , the processor 21 receives images captured by the cameras 3 and 3A.

[0090] In step S002, the processor 21 detects the dangerous place 10 based on the captured image and generates a management table for the dangerous place 10. In step S003, the processor 21 detects the dangerous place 10 having a predetermined position relationship with the dangerous place 10 (for example, Figure 1 The detection of the person 11A can be performed by using face recognition of the captured image. The detection of the person 11A can also be performed by using the location information of the terminal 30 received by the server 20 from the terminal 30.

[0091] In step S004, processor 21 obtains information indicating the attributes of a person, and determines whether the person has a predetermined attribute. That is, processor 21 obtains the registration information of terminal 30 and attribute (elderly or disabled) stored in storage device 22, and determines whether the person having a predetermined positional relationship is included in person 11A whose terminal 30 and attribute (elderly or disabled) are registered in server 20. At this time, if it is determined that person 11A registered as an elderly or disabled person is included, the process proceeds to step S008, and if not, the process proceeds to step S005.

[0092] In the case where the processing advances from step S004 to step S008, the processing from steps S005 to S007 is skipped. Figure 8The operation example shown is different. The processor 21 controls the communication IF 23 to send a warning message to the terminal 30 of the person 11A. That is, the communication IF 23 (output unit) sends the warning message regardless of the state of the person (regardless of the state of the person). This is to remind the elderly or disabled person 11A to pay attention, thereby improving the safety of movement. The warning message may also include information indicating the state of danger in a dangerous place and information indicating the state of a person who is more likely to encounter danger.

[0093] In addition, in step S008, the processor 21 also outputs information indicating an alarm to the speaker 4 corresponding to the dangerous place 10. This is to send repeated warnings to the passing person 11A to improve safety. Figure 8 The working examples shown are different.

[0094] When the process proceeds to step S005 , processor 21 detects the state of person 11 by image recognition or image analysis of the captured image, and registers the state of person 11 in the management table of person 11 .

[0095] Processor 21 determines based on the state of the person whether the person is in a state with a high possibility of encountering danger in dangerous place 10. That is, processor 21 selects a person (entry) in a predetermined order (eg, registration order) from the management table of person 11 (step S006).

[0096] The processor 21 determines whether the state of the person 11 registered in the selected entry matches the state determined as a state with a high possibility of encountering danger in the entry of the management table of the dangerous place 10 (step S007). In step S007, if it is determined to be a state with a high possibility of encountering danger, the processing proceeds to step S008, and if not, the processing returns to step S006. If the processing proceeds from step S007 to step S008, a warning is output (sent) to the speaker 4 corresponding to the dangerous place 10.

[0097] Several examples are given for the processing of step S007. For example, the following case is assumed, that is, as Figure 4 Dangerous place A (corresponding to Figure 2 The person 11 to be compared with the entry of the icing place 10a) is involved in the person 11, and the persons Y1, Y2 and Y3 ( Figure 5 ), and the processing of step S007 is implemented in the order of person Y2→person Y3→person Y1.

[0098] Regarding hazardous location A, Figure 5Person Y2 is far from the dangerous place A. Therefore, in step S007, it is determined that the person is not in a state where there is a high possibility of encountering danger at the dangerous place 10, and no warning is issued. Figure 5 Person Y3 is moving in a direction different from the dangerous place A. In this case, in step S007, it is also determined that the person Y3 is not in a state with a high possibility of encountering danger at the dangerous place 10, and no warning is issued.

[0099] In contrast, Figure 5 Person Y1 is approaching the dangerous place A. Moreover, person Y1 is riding a bicycle. Figure 4 The state 3 of the entry of the dangerous place A shown matches. Therefore, in step S007, it is determined that the person Y1 is in a state with a high possibility of encountering danger in the dangerous place 10, and a warning is issued.

[0100] Here, unlike the above, it is assumed that the processing of step S007 is performed in the order of person Y1 → person Y2 → person Y3. In the processing of step S007 involving person Y1, if it is determined that person Y1 is in a state with a high possibility of encountering danger at the dangerous place 10, the judgment of step S003 for persons Y2 and Y3 is not performed. This is because by notifying the warning using the speaker 4, the warning sound or the voice of the information related to the warning is broadcast in a certain area, so that the persons Y1, Y2 and Y3 can each hear the warning.

[0101] In addition, regarding the dangerous place A, when the state of the person 11 is in a state where the moving speed exceeds the threshold, the processor 21 determines that the person 11 is in a state where the possibility of encountering danger is high. The moving speed can be obtained, for example, based on the time difference between the frames of the image captured by the camera 3 or 3A and the moving distance of the person 11. In addition, when the terminal 30 is registered in the server 20 but the attribute is not registered, the moving speed can also be obtained based on the change amount of the position information of the terminal 30 and the time required for the change.

[0102] In addition, Figure 4 The processing of step S007 in each of the dangerous places B, C, D and E shown in FIG. Figure 2The dangerous state of dangerous place B is that high-rise construction is in progress, and there is a possibility that objects will fall on people's heads (encountering danger). In this embodiment, when person 11 is in a state close to dangerous place B and is not wearing a helmet, processor 21 determines that the possibility of encountering danger in dangerous place B is higher than that of wearing a helmet. In this way, processor 21 (control unit) determines that person 11 is in a state with a high possibility of encountering danger when he is in the construction site 10c and does not have equipment that can avoid encountering danger, and issues a warning. After receiving the warning, person 11 can deal with the danger by bypassing dangerous place B or wearing a helmet.

[0103] In addition, the hazardous location C is equivalent to Figure 2 The dangerous situation is that there is an obstacle 10b on the moving path (road 13B), and the rider is forced to move to avoid the obstacle 10b. At this time, if the rider does not notice the obstacle 10b and rides at a speed that would be the case without the obstacle, there is a possibility that the rider will hit the obstacle 10b or enter the lane side beyond the necessary limit and collide with a vehicle traveling on the road 13B. In addition, the obstacle 10b reduces the visual confirmation of the front, so the rider may notice the oncoming vehicle at a relatively late time.

[0104] In addition, in the case of a person whose moving speed is slower than that of a healthy person, such as a disabled person or an elderly person, the time for crossing into the lane and moving will be longer, so the possibility of contact with a vehicle traveling on the lane becomes higher and more dangerous. Therefore, with respect to the dangerous place C (obstacle 10b), the state of approaching the dangerous place C and the moving speed exceeding the threshold value (first threshold value) or the state of the moving speed being lower than the threshold value (second threshold value) is set in the following manner. That is, the processor 21 determines that the state exceeding the first threshold value and the state below the second threshold value are states in which the possibility of encountering danger at the dangerous place is higher than the state moving at a speed less than the first threshold value and above the second threshold value, and issues a warning. Thus, a person in a state in which the moving speed exceeds the threshold value can avoid danger by slowing down the speed and driving cautiously. In addition, for a person in a state in which the moving speed is lower than the threshold value, a detour is prompted by issuing a warning. Information prompting a detour may also be included in the warning.

[0105] In addition, the dangerous place D is a place where the corner mirror is blocked by the branches and leaves of plants, making it difficult to visually confirm the movement of vehicles or bicycles. In this embodiment, a person approaching the dangerous place D is warned regardless of his / her moving speed to enter the intersection with caution.

[0106] In addition, the dangerous place E is a place where a handrail (guardrail: an example of a passage aid) provided between a lane and a sidewalk is broken (damaged) due to an accident, thereby becoming an obstacle to movement for a person who normally walks holding the handrail. In addition, there are also places where the handrail cannot serve as a sufficient guardrail for vehicles coming from the lane due to damage.

[0107] In this case, if the person is close to the dangerous place E and the moving speed is lower than the threshold, or is using a cane, it is determined that the person is in a state with a high possibility of encountering danger at the dangerous place E, and a warning is issued. By issuing a warning, it is expected that the use of the moving path can be restricted until the handrail is repaired.

[0108] Effects of implementation methods

[0109] According to the above-described embodiment, the server 20 is provided with a processor 21 (control unit), and the processor 21 determines whether the person 11 is more likely to encounter danger at the dangerous place 10 based on the state of the person 11 having a predetermined positional relationship with the dangerous place 10. In addition, the server 20 is provided with a communication IF23 (output unit), and the communication IF23 outputs information indicating a warning when it is determined that the person 11 is in a state with a high possibility of encountering danger. Thus, it is possible to issue a warning to a person who is more likely to encounter danger at a dangerous place before arriving at the dangerous place. The person who receives the warning can stop approaching the dangerous place, or take a detour, or act cautiously.

[0110] Furthermore, according to the embodiment, when safety decreases compared to normal times (before the occurrence of the event) due to a change in state caused by events such as ice formation, obstacle placement, construction, and equipment damage in a person's moving path, a warning can be issued to a person who is more likely to encounter danger due to the change. This can reduce the possibility of a person encountering unexpected danger without knowing the change.

[0111] Change Example

[0112] Fig.10 as well as Fig.11 FIG. 2 is a diagram showing a modified example of the embodiment. Fig.10 As shown, the network 1 is provided with a sensor 5 for detecting the state of a person 11 having a predetermined positional relationship with a dangerous place 10. The sensor 5 is, for example, a radar speed meter for measuring the moving speed of an object, and sends the moving speed of the person to a server 20 (see Fig.11 Step S4B). The moving speed can be used to determine whether the moving speed of the person exceeds a threshold or whether the moving speed of the person is lower than a threshold.

[0113] In addition, although the dangerous place 10 is detected based on the image captured by the camera 3 or 3A in the embodiment, the dangerous place 10 may be detected using sensors 5 other than the camera 3 and 3A. In this case, for example, one or more temperature sensors that measure the road surface temperature are used as the sensors 5. An area where the temperature measured by the temperature sensor is below the freezing point and can be determined as a freezing temperature can be set as the dangerous place 10. By using such one or more temperature sensors as the sensors 5 Figure 2 That is, the server 20 receives the measured temperature (measurement result) of the sensor 5 (each temperature sensor) via the network 1, and the processor 21 obtains the measurement result of each temperature sensor, thereby determining the area that can be judged as the road surface icing according to the measurement result of each temperature sensor, and then the determined road surface area can be detected as the dangerous place 10a.

[0114] other

[0115] The above-described embodiment is merely an example, and the present disclosure can be implemented with appropriate changes without departing from the gist of the disclosure.

[0116] Furthermore, a process described in a manner implemented by one device may be shared and executed by multiple devices. Alternatively, a process described in a manner implemented by different devices may be executed by one device. In a computer system, the hardware structure (server structure) used to implement each function can be flexibly changed.

[0117] The present disclosure can also be implemented in the following manner, that is, a computer program with the functions described in the above-mentioned embodiments is provided to a computer, and the program is read and executed by one or more processors possessed by the computer. Such a computer program can be provided to the computer via a non-temporary computer-readable storage medium that can be connected to the system bus of the computer, or it can be provided to the computer via a network. Non-temporary computer-readable storage media are, for example, disks (including floppy disks (registered trademarks) and hard disk drives (HDDs)), optical disks (including CD-ROMs, DVDs, and Blu-ray disks, etc.) and any other types of disks. In addition, non-temporary computer-readable storage media include read-only memory (ROM), random access memory (RAM), EPROM, EEPROM, magnetic cards, flash memory, optical cards, and any type of medium suitable for storing electronic commands.

[0118] Explanation of symbols

[0119] 1…Network;

[0120] 20…Server;

[0121] 30…Terminal;

[0122] 10…Hazardous places;

[0123] 21, 31…processor;

[0124] 22, 32… storage device;

[0125] 23, 33…communication interface;

[0126] 24, 34… input device;

[0127] 25, 35…display.

Claims

1. An information processing device, comprising: Communication interface; A storage device storing the status of one or more persons associated with the dangerous status; Control unit, wherein The control unit performs the following processing, namely: It is determined whether the state of a person having a predetermined positional relationship with a dangerous place is a state in which the person is more likely to encounter danger among a plurality of states that the person may encounter in the dangerous place, and When it is determined that the state of the person is in the state with a high possibility of encountering the danger, the output unit is caused to output information indicating a warning, The dangerous place is a place where the safety of movement is reduced compared with before the occurrence of the event due to the occurrence of an event in the movement path of the person. The control unit acquires an image captured by a camera and detects the dangerous place from the image captured by the camera through a determination process using matching with an image in a case where safety is ensured. The information indicating the warning includes information indicating the state of danger in the dangerous place and information indicating the state of a person who is likely to encounter danger. The persons include a first person who does not possess a terminal for communicating with the communication interface via a network, and a second person who is registered on the terminal and possesses the terminal, The control unit performs the following processing, namely: Using face recognition of the captured image to detect the first person, using the location information of the terminal to detect the second person, obtaining the registration information of the attributes of the terminal and the second person stored in the storage device, and determining whether the persons having the predetermined positional relationship include the second person who is an elderly person or a disabled person, When it is determined that the second person is included, information indicating a warning is output to the terminal, and information indicating an alarm is also output to a speaker corresponding to the dangerous place, If it is determined that the second person is not included, the state of the first person is detected by image recognition or image analysis of the captured image, and the state of the first person is registered in the management table of the first person. By selecting entries from the management table in a predetermined order, it is determined whether the state of the first person matches the state determined to be highly likely to encounter danger registered in the entry, When it is determined that there is a high possibility of encountering danger, a warning is output to a speaker corresponding to the dangerous place.

2. The information processing device according to claim 1, wherein: The image captured by the camera is an image obtained by capturing scenes in the city.

3. The information processing device according to claim 1, wherein: The dangerous places include places where the road surface of the moving path is frozen or flooded, places where depressions or height differences are formed on the moving path, places where obstacles are placed on the moving path, places where the moving path or structures facing the moving path are being constructed or cleaned, places where traffic aids installed on the moving path are damaged or removed, and at least one of the places where the visual confirmation of the corner mirror is reduced.

4. The information processing device according to claim 1, wherein: The control unit determines that the person is in a state with a high possibility of encountering the danger when the moving speed of the person exceeds a threshold value.

5. The information processing device according to claim 1, wherein: The control unit determines that the person is in a state with a high possibility of encountering the danger when the moving speed of the person is lower than a threshold value.

6. The information processing device according to claim 1, wherein: The control unit determines that the person is in a state with a high possibility of encountering the danger when the person does not have equipment that can avoid encountering the danger in the dangerous place.

7. An information processing method comprising processing performed by an information processing device, The information processing device comprises: Communication interface; a storage device storing the status of one or more persons associated with the dangerous status, The processing is as follows, namely: determining whether a state of a person having a predetermined positional relationship with a dangerous place is a state with a high probability of encountering danger among a plurality of states that the person may encounter in the dangerous place; outputting information indicating a warning when it is determined that the state of the person is a state with a high possibility of encountering the danger; The information indicating the warning includes information indicating the state of danger in the dangerous place and information indicating the state of a person who is likely to encounter danger; The persons include a first person who does not possess a terminal for communicating with the communication interface via a network, and a second person who is registered on the terminal and possesses the terminal; detecting the first person using facial recognition of the captured image; detecting the second person using the location information of the terminal; obtaining the registration information of the attributes of the terminal and the second person stored in the storage device, and determining whether the persons having the predetermined positional relationship include the second person who is an elderly person or a disabled person; When it is determined that the second person is included, outputting information indicating a warning to the terminal, and also outputting information indicating an alarm to a speaker corresponding to the dangerous place; If it is determined that the second person is not included, detecting the state of the first person by image recognition or image analysis of the captured image, and registering the state of the first person in a management table of the first person; By selecting entries from the management table in a predetermined order, determining whether the state of the first person matches the state determined to be registered in the entry with a high possibility of encountering danger; When it is determined that there is a high possibility of encountering danger, a warning is output to a speaker corresponding to the dangerous place.

8. The information processing method according to claim 7, wherein: The information processing device determines that the person is in a state with a high possibility of encountering the danger when the moving speed of the person exceeds a threshold value or when the moving speed of the person is less than a threshold value.

9. The information processing method according to claim 7, wherein: The information processing device determines that the person is in a state with a high possibility of encountering the danger when the person does not have equipment that can avoid encountering the danger in the dangerous place.

10. A non-transitory storage medium storing a program for causing a computer of an information processing device to execute the following process: determining whether a state of a person having a predetermined positional relationship with a dangerous place is a state in which the person has a high probability of encountering danger among a plurality of states that the person may encounter in the dangerous place; outputting information indicating a warning when it is determined that the state of the person is a state with a high possibility of encountering the danger; The information indicating the warning includes information indicating the state of danger in the dangerous place and information indicating the state of a person who is likely to encounter danger; The persons include a first person who does not possess a terminal for communicating with the communication interface via a network, and a second person who is registered on the terminal and possesses the terminal; detecting the first person using facial recognition of the captured image; detecting the second person using the location information of the terminal; obtaining the registration information of the attributes of the terminal and the second person stored in the storage device, and determining whether the persons having the predetermined positional relationship include the second person who is an elderly person or a disabled person; When it is determined that the second person is included, outputting information indicating a warning to the terminal, and also outputting information indicating an alarm to a speaker corresponding to the dangerous place; If it is determined that the second person is not included, detecting the state of the first person by image recognition or image analysis of the captured image, and registering the state of the first person in a management table of the first person; By selecting entries from the management table in a predetermined order, determining whether the state of the first person matches the state determined to be registered in the entry with a high possibility of encountering danger; When it is determined that there is a high possibility of encountering danger, a warning is output to a speaker corresponding to the dangerous place.

Images