Information processing apparatus and information processing system

What is AI technical title?
AI technical title is built by Patsnap AI team. It summarizes the technical point description of the patent document.
The information processing device prioritizes image review by identifying and estimating high-risk areas post-event, reducing effort and ensuring critical images are not overlooked.

JP2026020763APending Publication Date: 2026-02-10TOSHIBA LIGHTING & TECHNOLOGY CORP

View PDF 1 Cites 0 Cited by

Patent Information

Application Number: JP2024122297
Authority / Receiving Office: JP · JP
Patent Type: Applications
Current Assignee / Owner
Filing Date: 2024-07-29
Publication Date: 2026-02-10

AI Technical Summary

Technical Problem

Existing systems require significant time and effort to check images captured by cameras during events like earthquakes, as they transmit all images without prioritization.

Method used

An information processing device with a detection unit to identify events, an estimation unit to prioritize image capture ranges based on change and occupancy, and a provision unit to provide content indicating these priorities, allowing focused review of high-priority areas.

Benefits of technology

Reduces the effort required to check images by prioritizing areas likely to have personal injury or property damage, preventing important images from being buried in large volumes of data.

✦ Generated by Eureka AI based on patent content.

Smart Images

Figure 2026020763000001_ABST

Patent Text Reader

Abstract

To reduce time and effort accompanying confirmation of an image photographed by a camera when an event occurs.SOLUTION: An information processing apparatus includes a detection unit, an estimation unit, and a provision unit. The detection unit detects a predetermined event that has occurred in an environment in which the camera is installed. The estimation unit estimates a priority of confirmation in a photographing range of the camera on the basis of an image photographed by the camera when the predetermined event is detected by the detection unit. The provision unit provides a content indicating the priority estimated by the estimation unit.SELECTED DRAWING: Figure 3

Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to an information processing device and an information processing system. [Background technology]

[0002] Conventionally, there are known techniques for grasping the damage situation when a predetermined event occurs. One such technique is to extract images from a video camera device capturing the damage situation in response to an earthquake early warning and send them to a mobile terminal device. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2009-243945 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the above-mentioned technology has a problem in that it takes time and effort to check the images captured by the camera.

[0005] For example, the above-mentioned technology merely transmits images captured by a video camera device, and it is necessary to check the entire image captured by the camera.

[0006] The present application has been made in view of the above, and aims to reduce the effort involved in checking images captured by a camera when an event occurs. [Means for solving the problem]

[0007] The information processing device of this embodiment is characterized by having a detection unit that detects a specified event that occurs in an environment in which a camera is installed, an estimation unit that, when the specified event is detected by the detection unit, estimates a confirmation priority within the camera's shooting range based on an image captured by the camera, and a provision unit that provides content that indicates the priority estimated by the estimation unit. [Effects of the Invention]

[0008] According to the present invention, it is possible to reduce the effort involved in checking images captured by a camera when an event occurs. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram illustrating an example of an information processing system 1 according to an embodiment. [Figure 2] FIG. 2 is a diagram illustrating an example of content according to the embodiment. [Figure 3] FIG. 3 is a diagram showing an example of the configuration of the information processing device 10 according to the embodiment. [Figure 4] FIG. 4 is a diagram showing an example of the imaging device information database 31 according to the embodiment. [Figure 5] FIG. 5 is a diagram showing an example of the setting database 32 according to the embodiment. [Figure 6] FIG. 6 is a flowchart illustrating an example of a procedure for information processing according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, a detailed description will be given of an information processing device and an information processing system according to the present application (hereinafter referred to as an "embodiment") with reference to the drawings. Note that the information processing device and the information processing system according to the present application are not limited to the embodiment. Furthermore, the same components in the following embodiments are denoted by the same reference numerals, and duplicated descriptions will be omitted.

[0011] The information processing device 10 according to the embodiment described below includes a detection unit 41, an estimation unit 42, and a provision unit 43. The detection unit 41 detects a predetermined event that occurs in an environment in which a camera (image capture device 100) is installed. When the detection unit 41 detects a predetermined event, the estimation unit 42 estimates a confirmation priority within the capture range of the image capture device 100 based on an image captured by the image capture device 100. The provision unit 43 provides content indicating the priority estimated by the estimation unit 42.

[0012] Furthermore, the detection unit 41 according to the embodiment described below detects a predetermined event that occurs in an environment where multiple image capture devices 100 are installed. When the detection unit 41 detects a predetermined event, the estimation unit 42 estimates a confirmation priority in the capture range of each of the multiple image capture devices 100 based on images captured by each of the multiple image capture devices 100. The provision unit 43 provides content indicating the multiple priorities estimated by the estimation unit 42.

[0013] Furthermore, the estimation unit 42 according to the embodiment described below estimates the priority for each time region captured by the image capturing device 100.

[0014] Furthermore, the estimation unit 42 in the embodiment described below estimates a higher priority the greater the amount of change between an object photographed by the image capture device 100 before a specified event occurs and the object photographed by the image capture device 100 after the specified event occurs.

[0015] Furthermore, the estimation unit 42 according to the embodiment described below estimates that the greater the number of people present in the shooting range before a predetermined event occurs, the higher the priority.

[0016] In addition, the estimation unit 42 of the embodiment described below estimates a higher priority when the number of people present in the shooting range before a specified event occurs satisfies a specified condition than when the number does not satisfy the specified condition.

[0017] Furthermore, the estimation unit 42 according to the embodiment described below estimates a higher priority when a person is present in the shooting range before a specified event occurs than when no person is present in the shooting range.

[0018] Furthermore, the estimation unit 42 of the embodiment described below estimates a higher priority when the state of a person present in the shooting range after a specified event occurs satisfies a specified condition than when the state of the person does not satisfy the specified condition.

[0019] Furthermore, the estimation unit 42 according to the embodiment described below estimates that if a specified phenomenon occurs in the shooting range after a specified event has occurred, the priority will be higher than if the specified phenomenon had not occurred.

[0020] Furthermore, in the embodiment described below, if a predetermined phenomenon set by the content provider occurs within the shooting range after a predetermined event has occurred, the estimation unit 42 estimates the priority to be higher than if the predetermined event had not occurred.

[0021] Furthermore, the estimation unit 42 in the embodiment described below estimates a higher priority for a larger area of the shooting range in which a difference has occurred after a specified event has occurred compared to before the specified event has occurred.

[0022] Moreover, the providing unit 43 according to the embodiment described below further provides content indicating identification information for identifying the image capturing device 100.

[0023] In addition, the providing unit 43 in the embodiment described below further provides content showing images captured by the photographing device 100 before a specified event occurs and images captured by the photographing device 100 after the specified event occurs.

[0024] In addition, the providing unit 43 according to the embodiment described below further provides content indicating the range of the shooting range in which a difference has occurred after a specified event has occurred compared to the range before the specified event occurred.

[0025] Moreover, the providing unit 43 according to the embodiment described below further provides content indicating text information relating to a predetermined phenomenon that occurred in the shooting range after the predetermined event occurred.

[0026] In addition, the providing unit 43 in the embodiment described below further provides content indicating the amount of change between an object photographed by the photographing device 100 before a specified event occurs and the object photographed by the photographing device 100 after the specified event occurs.

[0027] Moreover, the providing unit 43 according to the embodiment described below further provides content indicating the number of people present in the shooting range.

[0028] Moreover, the providing unit 43 according to the embodiment described below further provides content showing a current image of the imaging range captured by the imaging device 100.

[0029] Furthermore, the detection unit 41 according to the embodiment described below detects a predetermined event based on an image captured by the image capturing device 100.

[0030] Moreover, an information processing system according to an embodiment described below includes a server device (information processing device 10) and an image capturing device 100. The information processing system also includes a detection unit 41, an estimation unit 42, and a provision unit 43. The detection unit 41 detects a predetermined event that occurs in the environment in which the image capturing device 100 is installed. When the detection unit 41 detects a predetermined event, the estimation unit 42 estimates a confirmation priority within the image capturing range of the image capturing device 100 based on an image captured by the image capturing device 100. The provision unit 43 provides content indicating the priority estimated by the estimation unit 42.

[0031] [Embodiment] (An example of an information processing system) An example of an information processing system 1 will be described using Fig. 1. Fig. 1 is a diagram showing an example of the information processing system 1 according to an embodiment. In the example shown in Fig. 1, the information processing system 1 includes an information processing device 10, an image capturing device 100, and an administrator terminal 200. The information processing device 10, the image capturing device 100, and the administrator terminal 200 are communicably connected via a predetermined communication network (not shown, for example, the Internet) in a wired or wireless manner. Note that the information processing system 1 shown in Fig. 1 may include a plurality of information processing devices 10, a plurality of image capturing devices 100, and a plurality of administrator terminals 200.

[0032] 1 is an example of an information processing device according to the present application. For example, the information processing device 10 is an information processing device (computer) that functions as a so-called cloud server. For example, the information processing device 10 manages, in a storage unit of the device itself, information about the environment (space) in which the image capturing device 100 is installed, information about the location where the image capturing device 100 is installed in the environment, and information about images captured by the image capturing device 100.

[0033] The image capturing device 100 shown in FIG. 1 is, for example, a visible light camera that captures an image of the space in which the image capturing device is installed (for example, a work space such as a factory). For example, the image capturing device 100 captures an image within the image capturing range (angle of view) of the image capturing device. Note that the image capturing device 100 may also be, for example, a visible light camera that operates integrally with a lighting device installed in the space (for example, a lighting device fixed to the ceiling or wall surface within the space).

[0034] The administrator terminal 200 shown in FIG. 1 is a device having a function of displaying information provided from the information processing device 10, the image capturing device 100, etc. For example, the administrator terminal 200 is an information processing device (computer) used by an administrator of a space in which the image capturing device 100 is installed. For example, the administrator terminal 200 is a mobile terminal device that can communicate with any information processing device 10, image capturing device 100, etc. via a predetermined network. FIG. 1 shows a case in which the administrator terminal 200 is a notebook PC (Personal Computer). Note that the administrator terminal 200 may not only be a notebook PC, but also a smart device such as a smartphone or tablet, or a computer such as a desktop PC.

[0035] The information processing performed by the information processing device 10 will be described below with reference to FIG. 1. In the following description, it is assumed that the administrator terminal 200 is used by an administrator (administrator M1) identified by an administrator ID "MID#1." In the following description, the administrator terminal 200 may be considered to be the same as the administrator M1. In other words, in the following description, the administrator M1 may also be read as the administrator terminal 200.

[0036] In the following description, it is assumed that workers U1 to UN (N is any natural number) are performing predetermined work in space #1. In the following description, workers U1 to UN will be referred to as worker U when there is no need to distinguish between them.

[0037] In the following description, it is assumed that image capturing devices 100-1 to 100-N (N is any natural number) are installed in space #1. In the following description, image capturing devices 100-1 to 100-N will be referred to as image capturing device 100 when there is no need to distinguish between them.

[0038] First, the image capturing device 100 captures images (moving images) of the space #1 (step S1). For example, the image capturing device 100 always captures images within its own capture range during the time period when the worker U is working in the space #1.

[0039] For example, the image capturing device 100-1 captures an image of its own image capturing range #1 (step S1-1). As a specific example, the image capturing device 100-1 captures an image including a worker U1 performing work in the image capturing range #1 and an object (e.g., equipment such as a shelf or machine) #1 installed in the image capturing range #1 (i.e., an image including a person and the object).

[0040] Also, for example, the image capturing device 100-2 captures an image of its own image capturing range #2 (step S1-2). As a specific example, the image capturing device 100-2 captures an image including workers U2 to U4 performing work in the image capturing range #2 and an item #2 placed in the image capturing range #2 (i.e., an image including people and an item).

[0041] Also, for example, the image capturing device 100-3 captures an image of its own image capturing range #3 (step S1-3). As a specific example, the image capturing device 100-3 captures an image including an item #3 placed in the image capturing range #3 (i.e., an image including only the item, without including a person).

[0042] Next, the information processing device 10 acquires the images captured by the image capturing device 100 (step S2). For example, the information processing device 10 continues to acquire the images captured by the image capturing device 100 as long as the image capturing device 100 continues capturing images.

[0043] Next, the information processing device 10 detects the occurrence of a predetermined event in space #1 (step S3). For example, in the example of FIG. 1, the information processing device 10 detects the occurrence of an earthquake (e.g., an earthquake of seismic intensity 3 or higher). In such a case, the information processing device 10 detects the occurrence of an earthquake based on the image captured by the image capturing device 100.

[0044] As a specific example, the information processing device 10 detects the occurrence of an earthquake by detecting the shaking of the image capturing device 100 from the image captured by the image capturing device 100 using any image analysis technology.

[0045] The information processing device 10 may detect the occurrence of an earthquake based on an image captured by a representative image capturing device 100 among the image capturing devices 100. Furthermore, when the information processing device 10 detects shaking caused by an earthquake in an image capturing device 100 that is equal to or greater than a predetermined threshold among the image capturing devices 100, the information processing device 10 may detect (determine) that an earthquake has occurred in space #1.

[0046] The processes in step S1-3 do not have to be performed in the order described above, and may be performed simultaneously.

[0047] Here, it is assumed that the information processing device 10 detects the occurrence of an earthquake in space #1. In such a case, the information processing device 10 estimates the priority of checking each imaging range captured by each imaging device 100 (for example, whether there is personal injury or property damage, etc.) based on the images captured by each imaging device 100 (step S4). For example, the information processing device 10 uses any image analysis technology to detect (determine) differences between each imaging range before and after the occurrence of an earthquake (in other words, before the shaking caused by the earthquake occurs and after the shaking caused by the earthquake has subsided) from the images captured by each imaging device 100, and estimates the priority of checking each imaging range (in other words, the priority of each imaging device 100 capturing each imaging range) based on the detected differences.

[0048] To give a specific example, the greater the amount of change (for example, the amount of movement indicating how many centimeters the object moved after the earthquake) between an object (for example, worker U or an object) photographed by the image capturing device 100 before the earthquake and the object photographed by the image capturing device 100 after the earthquake, the higher the priority of checking the photographed range photographed by the image capturing device 100 is estimated to be. In other words, the greater the movement of an object photographed by the image capturing device 100 before the earthquake due to the earthquake (i.e., the higher the possibility of personal injury or property damage), the higher the priority of checking the photographed range photographed by the image capturing device 100 is estimated to be.

[0049] Furthermore, the information processing device 10 estimates that the priority of a captured image range is higher the larger the range that has changed after the earthquake compared to before the earthquake (in other words, the range that does not match before and after the earthquake). In other words, the information processing device 10 estimates that the greater the impact of the earthquake on the captured image range of the image capturing device 100 (i.e., the higher the possibility of personal injury or property damage), the higher the priority of checking that captured image range.

[0050] The information processing device 10 may estimate the position and state of an object using various known object detection techniques, and determine the amount of change in the object and the range in which a difference has occurred based on the estimation result.

[0051] Furthermore, the information processing device 10 estimates that the greater the number of people present in the imaging range before the earthquake occurred (in other words, the number of people included in images captured by the image capturing device 100 before the earthquake occurred), the higher the priority of confirmation for that imaging range. In other words, the greater the number of people present in the imaging range of the image capturing device 100 and the greater the possibility of human casualties due to the earthquake, the higher the priority of confirmation for that imaging range. For example, the number of people present before the earthquake occurred (i.e., the number of workers U under normal circumstances) was three in imaging range #2 and zero in imaging range #3. Therefore, the information processing device 10 estimates that the priority of confirmation for imaging range #2 is higher than that for imaging range #3.

[0052] Here, if there are multiple people in the shooting range before the earthquake occurs, even if one of them is injured in the earthquake, other people can provide first aid or other assistance. On the other hand, if there is only one person in the shooting range, even if that person is injured in the earthquake, that person may not be able to receive first aid or other assistance promptly. Therefore, the information processing device 10 estimates that the confirmation priority of shooting range #1, where there was only one person in the shooting range before the earthquake, is higher than that of shooting ranges #2 and #3.

[0053] Even if there are multiple people in the shooting range before the earthquake occurs, if the number of people is too large (for example, 20 or more), it is possible that if one person is injured in the earthquake, the other people may not notice. Therefore, the information processing device 10 may estimate the number of people in the shooting range before the earthquake to be higher when the number is equal to or greater than a predetermined threshold than when the number is less than the predetermined threshold.

[0054] Furthermore, if there is no person in the image capture range before an earthquake occurs, it is considered that no human damage will occur. Therefore, the information processing device 10 estimates that the priority of checking image capture ranges #1 and #2, in which people exist before an earthquake, is higher than that of image capture range #3, in which no people exist before an earthquake occurs.

[0055] The information processing device 10 may use various types of person detection means to determine the number of people present within the shooting range.

[0056] Furthermore, when the state of a person present in the image capturing range satisfies a predetermined condition after an earthquake occurs, the information processing device 10 estimates that the priority of checking the image capturing range is higher than when the predetermined condition is not satisfied. For example, when a person has fallen in the image capturing range (in other words, when it is estimated that a person is injured) or when people are crowded together (in other words, when it is estimated that rescue is being given to an injured person), the information processing device 10 estimates that the priority of checking the image capturing range is higher.

[0057] The information processing device 10 may store a question asking whether the state of the person satisfies a predetermined condition, and may use a visual question answering (VQA) technique to cause an AI (artificial intelligence) to determine whether the state of the person satisfies the predetermined condition based on the stored question and the captured image. The information processing device 10 may also estimate the state of the worker U using various known skeletal detection techniques, and determine whether the state of the person satisfies the predetermined condition based on the estimated state. In addition to these, the information processing device 10 may use various other arbitrary means to determine whether the state of the person satisfies the predetermined condition.

[0058] Furthermore, when a predetermined event occurs in the image capturing range after an earthquake occurs, the information processing device 10 estimates a higher priority for checking the image capturing range than when the event does not occur. For example, when an event arbitrarily set by the manager M1 of space #1 or the like, such as an industrial accident, a near miss, or an event that would not occur in normal space #1 (for example, objects scattered on a green belt), occurs, the information processing device 10 estimates a higher priority for checking the image capturing range than when the event does not occur.

[0059] The information processing device 10 may store a question asking whether a predetermined event has occurred, and may use VQA technology to cause an AI to determine whether the predetermined event has occurred based on the stored question and the captured image. The information processing device 10 may also use various known skeletal detection technologies to estimate the state of the worker U and determine whether the predetermined event has occurred based on the estimated state. The information processing device 10 may also use various known object detection technologies to estimate the position and state of an object and determine whether the predetermined event has occurred based on the estimation result. In addition to these, the information processing device 10 may use various arbitrary means to determine whether the predetermined event has occurred.

[0060] Next, in response to the occurrence of an earthquake, the information processing device 10 provides the administrator terminal 200 with content indicating the priority of each image capture area (or each image capture device 100) (step S5). For example, the information processing device 10 provides content indicating the priority of each image capture area as well as identification information for identifying each image capture device 100 (for example, the ID, URL (Uniform Resource Locator), or name of the image capture device 100 of the image capture area). Furthermore, for example, the information processing device 10 provides content in which information about each image capture area (for example, identification information about the image capture device 100 that captured the image capture area, and images of the image capture area before and after the earthquake) is arranged in order based on the priority. Furthermore, for example, the information processing device 10 extracts image capture areas with a priority equal to or higher than a predetermined threshold from the image capture areas, and provides content indicating information about each extracted image capture area.

[0061] In addition, the information processing device 10 may further provide content showing images captured by the photographing device 100 before the earthquake occurred (for example, images taken up to a predetermined period (for example, 30 minutes) from the time the earthquake occurred) and images captured by the photographing device 100 after the earthquake occurred (for example, images taken up to a predetermined period after the time the earthquake occurred).

[0062] Furthermore, the information processing device 10 may further provide content that shows a range of the captured image that has changed after the earthquake compared to before the earthquake. For example, the information processing device 10 provides content that shows an image of the captured image before the earthquake, in which the range that has changed after the earthquake is highlighted. The information processing device 10 also provides content that shows an image of the captured image after the earthquake, in which the range that has changed from before the earthquake is highlighted.

[0063] Furthermore, if a predetermined event occurs within the photographed area after an earthquake occurs, the information processing device 10 may provide content showing text information related to the event. For example, the information processing device 10 provides content showing text information related to the event along with an image captured by the photographing device 100 before the earthquake and an image captured by the photographing device 100 after the earthquake. The information processing device 10 may provide content showing an image captured by the photographing device 100 before the earthquake, in which the area in which the predetermined event occurred is highlighted. The information processing device 10 may also provide content showing an image captured by the photographing device 100 after the earthquake, in which the area in which the predetermined event occurred is highlighted. The information processing device 10 may also use various person detection means to recognize people present within the photographed area and provide content showing people related to the predetermined event that occurred (for example, people who were present within a predetermined area from the location where the predetermined event occurred).

[0064] Furthermore, the information processing device 10 may further provide content indicating the amount of change between an object photographed by the image capturing device 100 before an earthquake occurs and the object photographed by the image capturing device 100 after the earthquake occurs. For example, the information processing device 10 provides content indicating the amount of change between an object before and after the earthquake, along with an image photographed by the image capturing device 100 before an earthquake occurs and an image photographed by the image capturing device 100 after the earthquake occurs.

[0065] Furthermore, the information processing device 10 may further provide content indicating the number of people present within the shooting range. For example, the information processing device 10 may provide content indicating the number of people present within the shooting range before an earthquake occurs. Note that, if the status of a person present within the shooting range changes after an earthquake occurs, the information processing device 10 may provide content indicating text information regarding the changed status of the person. Furthermore, the information processing device 10 may use various types of person detection means to recognize a person present within the shooting range (for example, a person whose status has changed) and provide content indicating the recognized person.

[0066] Furthermore, the information processing device 10 may further provide content showing the current image of each imaging range captured by each imaging device 100.

[0067] Here, the content provided by the information processing device 10 to the administrator terminal 200 will be described with reference to Fig. 2. Fig. 2 is a diagram showing an example of content according to the embodiment.

[0068] As shown in FIG. 2 , the administrator terminal 200 displays content C1 including an area AR1 displaying information about the camera devices 100 installed in space #1 whose confirmation priority in the image capture range is equal to or higher than a first threshold; an area AR2 displaying information about the camera devices 100 whose confirmation priority in the image capture range is less than the first threshold and equal to or higher than a second threshold; and an area AR3 displaying information about the camera devices 100 whose confirmation priority in the image capture range is less than the second threshold. In other words, the administrator terminal 200 displays information about the camera devices 100 that are estimated to have a very high possibility of causing personal injury or property damage in the image capture range and therefore require urgent confirmation of images of the image capture range in the event of an earthquake in the area AR1. The administrator terminal 200 also displays information about the camera devices 100 that are estimated to have a high possibility of causing personal injury or property damage in the image capture range and therefore require confirmation of images of the image capture range in the event of an earthquake in the area AR2. In addition, the administrator terminal 200 displays in area AR3 information about the imaging device 100 that is estimated to be safe and has an extremely low possibility of personal injury or property damage occurring within the imaging range, and therefore does not require checking images of the imaging range in the event of an earthquake.

[0069] As a specific example, the administrator terminal 200 displays, as information related to the image capturing device 100, the image captured by the image capturing device 100, the camera name (the name of the image capturing device 100), the date and time the image was captured, the amount of change in the background (for example, the amount of change in items placed in the image capturing range), the number of people (number of people) present in the image capturing range before the earthquake occurred, and the priority of confirmation in the image capturing range (confirmation priority).

[0070] Conventionally, camera systems installed in a specific environment only collect and transmit images when an earthquake occurs. In environments where hundreds of cameras are installed, such as factories and warehouses, the volume of images generated when an earthquake occurs can be enormous, making reviewing them time-consuming. In such cases, important images, such as images from cameras capturing the environment where injuries occurred, may be buried among the vast amount of other images.

[0071] Therefore, when an event such as an earthquake occurs, the information processing device 10 according to the embodiment estimates the priority of checking whether or not there is personal injury or property damage for each shooting range, and provides content indicating the estimated priority. As a result, the information processing device 10 according to the embodiment can prioritize checking images that are likely to have caused personal injury or property damage, without having to check all images captured by cameras installed in the environment where the event occurred. In other words, the information processing device 10 according to the embodiment can reduce the effort required to check images captured by cameras when an event occurs. Furthermore, the information processing device 10 according to the embodiment can prevent important images from being buried in a huge number of other images.

[0072] (Other embodiments) The above-described embodiment is merely an example, and the information processing device 10 may perform various processes using various information. In this regard, examples will be listed below.

[0073] [Regarding designated events] The predetermined event is not limited to an earthquake, but may be, for example, a fire. In such a case, the information processing device 10 may detect the occurrence of a fire based on an image captured by the image capturing device 100, or may detect the occurrence of a fire based on information detected by a predetermined sensor (for example, a fire alarm) installed in space #1.

[0074] In other words, the predetermined event may be any event that has an overall effect on the environment in which the image capturing device 100 is installed.

[0075] [Event detection] 1, if an object placed in space #1 is prone to vibration, it may not be possible to accurately detect the occurrence of an earthquake using the above-described method of detecting the occurrence of an earthquake based on the shaking of the image capture device 100. Therefore, the information processing device 10 may detect the occurrence of an earthquake by receiving information about the occurrence of an earthquake (for example, an emergency earthquake warning).

[0076] [Regarding priority estimation] In the example of FIG. 1, the information processing device 10 may estimate the confirmation priority for each imaging range based on rules arbitrarily set by, for example, an administrator M1 of space #1. For example, when an earthquake occurs, the information processing device 10 receives information about an event that the administrator M1 desires to detect (hereinafter, may be referred to as a "desired event"), inputs the received information and a prompt into an AI such as a Generative Pre-trained Transformer (GPT), and sets rules to be used for estimating the priority. To cite a specific example, the information processing device 10 inputs a prompt that instructs the AI to output a question for detecting the desired event from an image in a VQA based on information about the desired event. Then, the information processing device 10 uses the VQA and the output question to detect (determine) whether the desired event has occurred from the image of the imaging range, and if the desired event has occurred, estimates the priority of the imaging range to be higher than if the desired event has not occurred.

[0077] [Regarding the imaging device 100] 1, the number of image capture devices 100 installed in space #1 may be one. In such a case, the information processing device 10 may estimate the priority of confirmation within the image capture range of the image capture device 100 for each time region captured by the image capture device 100.

[0078] For example, the information processing device 10 estimates the priority of confirmation for the shooting range of each time domain based on images of the shooting range in the time domain from the time when the earthquake occurred until a predetermined period before, images of the shooting range in the time domain from the time when the earthquake occurred until a predetermined period after, and images of the shooting range in other time domains. Then, the information processing device 10 provides the administrator terminal 200 with content indicating the priority of confirmation for the shooting range of each time domain.

[0079] [Response to the event that occurred] 1, the information processing device 10 may further provide content indicating whether or not an appropriate response has been taken by a worker U or the like in response to the event (earthquake) that has occurred. For example, the information processing device 10 determines, based on an image captured by the image capturing device 100, whether or not an appropriate response to the earthquake (for example, stopping the operation of a machine) has been taken within the capture range of the image capturing device 100, and provides content indicating the determination result.

[0080] Furthermore, the information processing device 10 may determine whether or not an appropriate response has been made to a predetermined event (for example, a work-related accident or a near miss) that has occurred due to an earthquake, and provide content indicating the determination result.

[0081] The information processing device 10 may store a question asking whether an appropriate response was made in response to an earthquake or a predetermined event caused by the earthquake, and may use VQA technology to cause an AI to determine whether an appropriate response was made based on the stored question and the captured image. The information processing device 10 may also estimate the state of the worker U using various known skeletal detection technologies and determine whether an appropriate response was made based on the estimated state. In addition to these, the information processing device 10 may use various other arbitrary means to determine whether an appropriate response was made.

[0082] [Regarding priority estimation based on the event that occurred] 1, the information processing device 10 may estimate the priority of confirmation within the image capture range using different settings (rules) depending on the scale of the event that has occurred and the type of event. For example, the information processing device 10 estimates the priority of confirmation within the image capture range using different settings when an earthquake with a seismic intensity of 3 or more but less than 5 occurs in space #1 and when an earthquake with a seismic intensity of 5 or more occurs. Furthermore, the information processing device 10 estimates the priority of confirmation within the image capture range using different settings when an earthquake occurs in space #1 and when a fire occurs.

[0083] [Regarding specified events] 1, the information processing device 10 estimates the priority of checking in the image capture range depending on whether an event such as a work-related accident or a near miss has occurred, but the predetermined event is not limited to this example. For example, the information processing device 10 may estimate the priority of checking in the image capture range depending on whether any abnormality (in other words, an abnormality) has occurred in the image capture range.

[0084] To cite a specific example, the information processing device 10 trains a model (AI) with images showing the state of the normal shooting range captured by the image capturing device 100. For example, the information processing device 10 trains the model so that when an image showing the state of the normal shooting range is input, the model outputs information indicating that the state is normal. When an earthquake occurs, the information processing device 10 inputs an image of the shooting range after the earthquake to the model, and if information indicating that the state is normal is not output (in other words, if some abnormality occurs after the earthquake), the information processing device 10 estimates the priority of the shooting range to be higher than if information indicating that the state is normal is output.

[0085] [About content provision] 1, the information processing device 10 may provide the content indicating the priority of each shooting range via a web browser of the administrator terminal 200, a predetermined application installed on the administrator terminal 200, email, etc. Furthermore, if the administrator terminal 200 is, for example, a smartphone, the information processing device 10 may provide the content indicating the priority of each shooting range via SMS (Short Message Service).

[0086] (An example of information processing device 10) Next, the configuration of the information processing device 10 will be described with reference to Fig. 3. Fig. 3 is a diagram showing an example of the configuration of the information processing device 10 according to an embodiment. As shown in Fig. 3, the information processing device 10 has a communication unit 20, a storage unit 30, and a control unit 40.

[0087] [Regarding the communication unit 20] The communication unit 20 is realized by, for example, a network interface card (NIC), etc. The communication unit 20 transmits and receives information to and from the image capturing device 100, the administrator terminal 200, etc. via a communication network such as Ethernet (registered trademark) or a wireless LAN.

[0088] [Regarding the storage unit 30] The storage unit 30 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, or a storage device such as a hard disk or an optical disk. As shown in FIG. 3 , the storage unit 30 has an imaging device information database 31 and a setting database 32.

[0089] [About the imaging device information database 31] The camera device information database 31 stores various types of information related to the camera device 100. An example of the information stored in the camera device information database 31 will now be described with reference to Fig. 4. Fig. 4 is a diagram showing an example of the camera device information database 31 according to the embodiment. In the example of Fig. 4, the camera device information database 31 has items such as "camera device ID," "space ID," "camera shooting range information," "image ID," "camera shooting date and time," and "image information."

[0090] "Photographing device ID" indicates identification information for identifying the photographing device 100. "Space ID" indicates identification information for identifying the space (environment) in which the photographing device 100 is installed. "Photographing range information" indicates information related to the photographing range of the photographing device 100, and stores, for example, information indicating the range (area) within the space in which the photographing device 100 is installed. "Image ID" indicates identification information for identifying an image photographed by the photographing device 100. "Photographing date and time" indicates the date and time when the image was photographed by the photographing device 100. "Image information" indicates an image photographed by the photographing device 100.

[0091] That is, Figure 4 shows an example in which a camera 100 identified by a camera ID "CID#1" is installed in a space identified by a space ID "SID#1", the camera range information of the camera 100 is "camera range information #1", the shooting date and time of an image identified by an image ID "PID#1" captured by the camera 100 is "shooting date and time #1", and the image information indicating the image is "image information #1".

[0092] [About setting database 32] The setting database 32 stores various information indicating settings (rules) for estimating the confirmation priority in the shooting range. An example of information stored in the setting database 32 will now be described with reference to Fig. 5. Fig. 5 is a diagram showing an example of the setting database 32 according to the embodiment. In the example of Fig. 5, the setting database 32 has items such as "setting ID," "event information," and "setting information."

[0093] "Setting ID" indicates identification information for identifying a setting. "Event information" indicates an event associated with a setting. "Setting information" indicates a setting used to estimate the priority of checking the shooting range.

[0094] That is, FIG. 5 shows an example in which a setting identified by a setting ID "TID#1" is associated with event information "event information #1", and the setting information indicating the setting is "setting information #1".

[0095] [Regarding the control unit 40] The control unit 40 is a controller, and is realized, for example, by a CPU (Central Processing Unit) or an MPU (Micro Processing Unit) executing various programs stored in a storage device inside the information processing device 10 using RAM as a work area. The control unit 40 is also a controller, and is realized, for example, by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). As shown in FIG. 3 , the control unit 40 according to the embodiment has a detection unit 41, an estimation unit 42, and a provision unit 43, and realizes or executes the functions and actions of information processing described below.

[0096] [Regarding the detection unit 41] The detection unit 41 detects a predetermined event that occurs in the environment where the image capturing device 100 is installed. For example, in the example of Fig. 1, the detection unit 41 refers to the storage unit 30 (e.g., the image capturing device information database 31) and detects the occurrence of a predetermined event in the space #1 where the image capturing device 100 is installed.

[0097] Furthermore, the detection unit 41 may detect a predetermined event that occurs in an environment where multiple image capture devices 100 are installed. For example, in the example of Fig. 1, the detection unit 41 detects the occurrence of a predetermined event in space #1 where multiple image capture devices 100 are installed.

[0098] Furthermore, the detection unit 41 may detect a predetermined event based on an image captured by the image capturing device 100. For example, in the example of FIG. 1, the detection unit 41 detects the occurrence of an earthquake based on an image captured by the image capturing device 100.

[0099] [Regarding the estimation unit 42] When a predetermined event is detected by the detection unit 41, the estimation unit 42 estimates the priority of confirmation in the shooting range of the camera device 100 based on the image captured by the camera device 100. For example, in the example of FIG. 1 , the estimation unit 42 refers to the storage unit 30 (e.g., the camera device information database 31 and the setting database 32), and when the occurrence of an earthquake is detected in space #1, estimates the priority of confirmation in the shooting range captured by the camera device 100 based on the image captured by the camera device 100.

[0100] Furthermore, when a predetermined event is detected by the detection unit 41, the estimation unit 42 may estimate the confirmation priority for the imaging range of each of the plurality of imaging devices 100 based on the images captured by each of the plurality of imaging devices 100. For example, in the example of FIG. 1 , the estimation unit 42 estimates the confirmation priority for each imaging range captured by each imaging device 100 based on the images captured by each imaging device 100.

[0101] Furthermore, the estimation unit 42 may estimate the priority for each time domain captured by the image capturing device 100. For example, in the example of Fig. 1, the estimation unit 42 estimates the priority of confirmation of the captured image range in each time domain based on an image of the captured image range in the time domain from the time when the earthquake occurred until a predetermined period before, an image of the captured image range in the time domain from the time when the earthquake occurred until a predetermined period after, and an image of the captured image range in other time domains.

[0102] Furthermore, the estimation unit 42 may estimate a higher priority as the amount of change between an object photographed by the image capture device 100 before a predetermined event occurs and the object photographed by the image capture device 100 after the predetermined event occurs. For example, in the example of Fig. 1, the estimation unit 42 estimates a higher priority for checking the photographed range photographed by the image capture device 100 as the amount of change between an object photographed by the image capture device 100 before an earthquake occurs and the object photographed by the image capture device 100 after the earthquake occurs.

[0103] Furthermore, the estimation unit 42 may estimate a higher priority as the number of people present in the image capture range before a predetermined event occurs. For example, in the example of Fig. 1, the estimation unit 42 estimates a higher priority for checking the image capture range as the number of people present in the image capture range before an earthquake occurs.

[0104] Furthermore, the estimation unit 42 may estimate a higher priority when the number of people present in the image capture area before a predetermined event occurs satisfies a predetermined condition than when the number does not satisfy the predetermined condition. For example, in the example of Fig. 1, the estimation unit 42 estimates that the confirmation priority of image capture area #1, where only one person was present before the earthquake occurred, is higher than that of image capture areas #2 and #3.

[0105] Furthermore, the estimation unit 42 may estimate a higher priority when a person is present in the shooting range before a predetermined event occurs than when no person is present in the shooting range. For example, in the example of Fig. 1, the estimation unit 42 estimates a higher priority for checking shooting ranges #1 and #2, in which a person is present before an earthquake occurs, than for shooting range #3, in which no person is present before an earthquake occurs.

[0106] Furthermore, the estimation unit 42 may estimate a higher priority when the state of a person present in the shooting range after a predetermined event has occurred satisfies a predetermined condition than when the state of the person does not satisfy the predetermined condition. For example, in the example of Fig. 1, the estimation unit 42 estimates a higher priority for checking the shooting range when the state of a person present in the shooting range satisfies a predetermined condition after an earthquake has occurred than when the state does not satisfy the predetermined condition.

[0107] Furthermore, the estimation unit 42 may estimate a higher priority when a predetermined phenomenon occurs in the imaging range after a predetermined event occurs, compared to when the predetermined phenomenon does not occur. For example, in the example of Fig. 1, when a predetermined phenomenon occurs in the imaging range after an earthquake occurs, the estimation unit 42 estimates a higher priority for checking the imaging range than when the phenomenon does not occur.

[0108] Furthermore, if a predetermined phenomenon set by the content provider occurs in the shooting range after a predetermined event occurs, the estimation unit 42 may estimate the priority to be higher than when the predetermined event does not occur. For example, in the example of Fig. 1, if an event arbitrarily set by the administrator M1 or the like occurs, the estimation unit 42 estimates the priority of checking the shooting range to be higher than when the event does not occur.

[0109] Furthermore, the estimation unit 42 may estimate a higher priority for a larger range of the image capturing range in which a difference has occurred after a predetermined event has occurred compared to before the occurrence of the predetermined event. For example, in the example of Fig. 1, the estimation unit 42 estimates a higher priority for a larger range of the image capturing range in which a difference has occurred after an earthquake has occurred compared to before the earthquake.

[0110] [About the provision section 43] The providing unit 43 may provide content indicating the priority estimated by the estimating unit 42. For example, in the example of Fig. 1, the estimating unit 42 provides content indicating the priority of the shooting range to the administrator terminal 200 in response to the occurrence of an earthquake.

[0111] Furthermore, the providing unit 43 may provide content indicating a plurality of priorities estimated by the estimating unit 42. For example, in the example of Fig. 1, the providing unit 43 provides content indicating a priority for each shooting range in response to the occurrence of an earthquake.

[0112] Furthermore, the providing unit 43 may further provide content indicating identification information for identifying the image capturing devices 100. For example, in the example of Fig. 1, the providing unit 43 provides content indicating identification information for identifying each image capturing device 100 together with the priority of each image capturing range.

[0113] Furthermore, the providing unit 43 may further provide content showing an image captured by the image capturing device 100 before a predetermined event occurs and an image captured by the image capturing device 100 after the predetermined event occurs. For example, in the example of Fig. 1, the providing unit 43 provides content showing an image captured by the image capturing device 100 before an earthquake occurs and an image captured by the image capturing device 100 after the earthquake occurs.

[0114] Furthermore, the providing unit 43 may further provide content indicating a range within the photographed range in which a difference has occurred after a predetermined event has occurred compared to before the predetermined event occurred. For example, in the example of FIG. 1, the providing unit 43 provides content indicating an image of the photographed range before an earthquake has occurred, in which a range in which a difference has occurred after the earthquake has occurred is highlighted. The providing unit 43 also provides content indicating an image of the photographed range after an earthquake has occurred, in which a range in which a difference has occurred from before the earthquake has occurred is highlighted.

[0115] Furthermore, the providing unit 43 may further provide content indicating text information regarding a predetermined phenomenon that occurred in the photographing range after the predetermined event occurred. For example, in the example of Fig. 1, the providing unit 43 provides content indicating text information regarding the event that occurred together with images captured by the photographing device 100 before the earthquake occurred and images captured by the photographing device 100 after the earthquake occurred.

[0116] Furthermore, the providing unit 43 may further provide content indicating the amount of change between an object photographed by the camera device 100 before a predetermined event occurs and the object photographed by the camera device 100 after the predetermined event occurs. For example, in the example of Fig. 1, the providing unit 43 provides content indicating the amount of change between the object before and after the earthquake, together with an image photographed by the camera device 100 before the earthquake occurs and an image photographed by the camera device 100 after the earthquake occurs.

[0117] Furthermore, the providing unit 43 may further provide content indicating the number of people present in the shooting range. For example, in the example of Fig. 1, the providing unit 43 provides content indicating the number of people present in the shooting range before the earthquake occurred.

[0118] Furthermore, the providing unit 43 may further provide content showing current images of the shooting range captured by the image capturing device 100. For example, in the example of FIG. 1 , the providing unit 43 provides content showing current images of each shooting range captured by each image capturing device 100.

[0119] (Processing flow of information processing device 10) Next, the flow of processing of the information processing device 10 according to the embodiment will be described with reference to Fig. 6. Fig. 6 is a flowchart showing an example of the procedure of information processing according to the embodiment.

[0120] 6, the information processing device 10 acquires an image captured by a camera (image capturing device 100) (step S101). Subsequently, the information processing device 10 determines whether a predetermined event has been detected in the environment in which the camera is installed (step S102). If the predetermined event has not been detected (step S102; No), the information processing device 10 continues to acquire images captured by the camera.

[0121] On the other hand, if a predetermined event is detected (step S102; Yes), the information processing device 10 estimates the priority of confirmation in the camera's shooting range based on the image captured by the camera (step S103). Subsequently, the information processing device 10 provides content indicating the priority of confirmation in the camera's shooting range (step S104), and ends the process.

[0122] (Variation) The above-described embodiment is merely an example, and various modifications and applications are possible.

[0123] [Regarding processing mode] Of the processes described in the above embodiments, all or part of the processes described as being performed automatically can be performed manually, and conversely, all or part of the processes described as being performed manually can be performed automatically using known methods. In addition, the information, including the processing procedures, specific names, various data, and parameters shown in the above text and drawings, can be changed as desired unless otherwise specified. For example, the various information shown in each drawing is not limited to the information shown in the drawings.

[0124] Furthermore, the components of each device shown in the figure are conceptual functional components and do not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit depending on various loads, usage conditions, etc.

[0125] Furthermore, the above-described embodiments can be combined as appropriate within the scope of not causing any contradiction in the processing content. [Explanation of symbols]

[0126] 10. Information processing equipment 20 Communications Department 30 Storage section 31 Imaging equipment information database 32 Configuration Database 40 Control Unit 41 Detection unit 42 Estimation part 43 Providing Department 100 Imaging device 200 Administrator terminal

Claims

1. a detection unit that detects a predetermined event that occurs in an environment where the camera is installed; an estimation unit that, when the predetermined event is detected by the detection unit, estimates a confirmation priority in a photographing range of the camera based on an image photographed by the camera; a providing unit that provides content indicating the priority estimated by the estimating unit; An information processing device comprising:

2. The detection unit Detecting the predetermined event occurring in an environment where a plurality of the cameras are installed; The estimation unit When the predetermined event is detected by the detection unit, a confirmation priority in the photographing range of each of the plurality of cameras is estimated based on images photographed by each of the plurality of cameras. The providing unit providing the content indicating the plurality of priorities estimated by the estimation unit; 2. The information processing apparatus according to claim 1, wherein:

3. The estimation unit The priority is estimated for each time region photographed by the camera.

2. The information processing apparatus according to claim 1, wherein:

4. The estimation unit The greater the amount of change between an object photographed by the camera before the predetermined event occurs and the object photographed by the camera after the predetermined event occurs, the higher the estimated priority is.