Information processing device, control method thereof, and program

Abstract

To enable easy discover of an abnormality in a monitoring system.SOLUTION: An information processing device 10 which can be communicated with a photographing device 31 for photographing a video image formed by a plurality of frame images, comprises a control part 11 that controls a photographing device 31 so that a constant photographing range is photographed in accordance with a predetermined circulation schedule, edits a recorded video image as a video image photographed by the photographing device 31 until a second circulation schedule as a next circulation schedule of the first circulation schedule is started from termination of the first circulation schedule and acquires an edition video image to be generated, acquires a live video image as an image photographed by the photographing device 31 in accordance with the second circulation schedule, and displays the live video image and the edition video image to a display part 25.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device, a control method thereof, and a program. [Background technology]

[0002] To simulate security guard patrols using surveillance cameras, there is known a monitoring system that performs "camera patrols" (also called "video patrols" or "preset patrols"), in which multiple cameras are switched between to capture images, or the same camera is switched between pre-set values ​​for the camera's angle of view and orientation (the camera's angle of view and orientation are set as values ​​indicating PTZ (pan / tilt / zoom) for example). Patent Document 1 describes a monitoring system that controls such automatic patrols by surveillance cameras in combination with other sensors. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2010-103773 Summary of the Invention [Problem to be solved by the invention]

[0004] However, conventional surveillance systems only present images captured by automatic camera patrols at the time of the incident, and users must carefully examine only the images and information presented at that time to check for any abnormalities. As a result, conventional surveillance systems are unable to grasp events that have occurred between the previous patrol and the current patrol, and there is room for improvement in the possibility of detecting abnormalities at the location being photographed.

[0005] Therefore, an object of the present disclosure is to make it possible to more easily discover abnormalities in a monitoring system. [Means for solving the problem]

[0006] An information processing device according to some embodiments includes: (1) An information processing device capable of communicating with a photographing device that photographs a video consisting of a plurality of frame images, controlling the photographing device so as to photograph a fixed photographing range in accordance with a preset patrol schedule; acquiring edited video generated by editing recorded video, which is video captured by the image capture device during the period from the end of the first cyclic schedule to the start of the second cyclic schedule, which is the cyclic schedule subsequent to the first cyclic schedule; acquiring live video images captured by the image capturing device according to the second patrol schedule; displaying the live video and the edited video on a display unit; It has a control unit.

[0007] In this way, the information processing device displays, in addition to live video, edited video of recorded video from the end of the first tour schedule to the start of the second tour schedule. Therefore, a user such as a monitor can detect not only current abnormalities occurring at the monitored location, but also abnormalities that have occurred at the monitored location since the check in the previous tour schedule up to the start of the current tour schedule. Furthermore, even if there is a difference between the live video from the current tour and the live video from the previous tour, the user can understand the cause and circumstances of the difference from the edited video and determine whether the difference indicates an abnormality or not. Therefore, the information processing device makes it easier to detect abnormalities in a surveillance system.

[0008] In one embodiment, (2) In the information processing device of (1), The control unit may acquire, as the edited video, either a video generated by fast-forwarding the recorded video at a constant speed over the period from the end of the first cyclic schedule to the start of the second cyclic schedule, or a video generated by continuously playing back video of a portion of the recorded video in which motion is detected.

[0009] In this way, the information processing device acquires and displays, as edited video, video generated by fast-forwarding the recorded video at a constant speed, or video obtained by continuously playing back video of portions of the recorded video where movement has been detected. Therefore, the user can check the current video while referring to the edited video and video that requires particular attention and that was taken between the end of the first cyclic schedule and the start of the second cyclic schedule, and can more easily find abnormalities.

[0010] In one embodiment, (3) In the information processing device of (1), capable of communicating with a detection device that detects the occurrence of a predetermined event; The control unit acquiring information including the occurrence time and type of each of the events detected by the detection device during the period from the end of the first cyclic schedule to the start of the second cyclic schedule; The display unit may further display a list image that includes a list of the occurrence times and types of the events detected by the detection device between the end of the first circular schedule and the start of the second circular schedule.

[0011] In this way, the information processing device displays, together with the live video and the edited video, a list image that includes a list display of the occurrence time and type of each event detected between the end of the first circular schedule and the start of the second circular schedule. Therefore, the user can check the current live video while recognizing the time and type of the event, and can more easily find any abnormalities that have occurred between the previous circular schedule and the present.

[0012] In one embodiment, (4) In the information processing device of (3), The control unit may acquire, as the edited video, video in which portions of the recorded video corresponding to occurrence times of the events detected by the detection device are continuously played back.

[0013] In this way, the information processing device acquires and displays, as an edited image, a video in which the portion of the recorded video corresponding to the time of the event is continuously played back, so that the user can refer to the edited video corresponding to the detected event and check in more detail the abnormality caused by the event that occurred.

[0014] In one embodiment, (5) In the information processing device of (4), The control unit may highlight the event corresponding to the edited video displayed on the display unit in the list image.

[0015] In this way, the information processing device highlights the event corresponding to the edited video currently being displayed in the list image, so that the user can more easily recognize the event corresponding to the edited video currently being displayed.

[0016] In one embodiment, (6) In the information processing device of (5), The control unit may further cause the display unit to display an image indicating a correspondence between the event highlighted in the list image and the edited video.

[0017] In this way, when the information processing device simultaneously displays the live video, the edited image, and the list image, it also displays an image indicating the correspondence between the highlighted event in the list image and the edited video, allowing the user to more easily recognize the correspondence between the content of the edited video being displayed and the detected event.

[0018] In one embodiment, (7) In any one of the information processing devices (3) to (6), capable of communicating with a measurement device that measures a predetermined physical quantity; The control unit acquiring information indicating a temporal transition of the physical quantity measured by the measurement device during a period from the end of the first cyclic schedule to the start of the second cyclic schedule; The display unit may further display a graph showing a temporal change in the physical quantity measured by the measurement device from the end of the first cyclic schedule to the start of the second cyclic schedule.

[0019] In this way, the information processing device displays a graph of the physical quantity measured between the end of the first cyclic schedule and the start of the second cyclic schedule, together with the live video, edited video, and list image. Therefore, if there is an abnormal change in the physical quantity, the user can recognize this by comparing it with the edited video and list image, and check the current live video. Therefore, the user can more easily find the abnormality.

[0020] In one embodiment, (8) In the information processing device of (7), The control unit determining, as the event, that the physical quantity measured by the measurement device satisfies a predetermined condition; The display unit may further display an event image indicating the occurrence of the determined event at a position on the graph corresponding to the time at which the event was determined and the physical quantity.

[0021] In this way, the information processing device displays an event image indicating the occurrence of an event at a position on the graph corresponding to the time and physical quantity at which the event was determined, allowing the user to easily recognize the time and physical quantity at which the event occurred on the graph.

[0022] In one embodiment, (9) In the information processing device of (8), The control unit The display unit may further display, as the list image, an image further including an indication of the occurrence time and type of each event determined based on the physical quantity.

[0023] In this way, the information processing device displays events determined based on the measured physical quantities in the list image, so that the user can check not only events detected by the detection device but also events determined based on the physical quantities in the list image.

[0024] In one embodiment, (10) In the information processing device of (9), The control unit may further cause the display unit to display an image indicating a correspondence between the event image and an indication in the list image of the event indicated by the event image.

[0025] In this way, when the information processing device simultaneously displays live video, edited video, an event list image, and a physical quantity graph, it also displays an image indicating the correspondence between the event image on the graph and the display of that event in the list image, allowing the user to more easily recognize the correspondence between the physical quantity graph and the event displayed in the list image.

[0026] In one embodiment, (11) In any one of the information processing devices (1) to (10), The control unit may further cause the display unit to display an image indicating a temporal position of the edited video currently being displayed on the display unit.

[0027] In this way, the information processing device displays the temporal position of the edited video being displayed, so the user can easily check the time of the edited video being displayed.

[0028] A control method for an information processing device according to some embodiments includes: (12) A control method for an information processing device capable of communicating with a photographing device that photographs a video consisting of a plurality of frame images, comprising: a control unit of the information processing device, controlling the photographing device to photograph a fixed photographing range in accordance with a preset patrol schedule; acquiring edited video generated by editing recorded video that is video captured by the image capture device during the period from the end of the first cyclic schedule to the start of the second cyclic schedule that is the next cyclic schedule after the first cyclic schedule; acquiring live video images captured by the image capture device according to the second cyclic schedule; displaying the live video and the edited video on a display unit; Includes:

[0029] In this way, the information processing device displays, in addition to live video, edited video of recorded video from the end of the first tour schedule to the start of the second tour schedule. Therefore, a user such as a monitor can detect not only current abnormalities occurring at the monitored location, but also abnormalities that have occurred at the monitored location since the check in the previous tour schedule up to the start of the current tour schedule. Furthermore, even if there is a difference between the live video from the current tour and the live video from the previous tour, the user can understand the cause and circumstances of the difference from the edited video and determine whether the difference indicates an abnormality or not. Therefore, the information processing device makes it easier to detect abnormalities in a surveillance system.

[0030] In some embodiments, the program (13) To the computer, Controlling the image capturing device so as to capture a video consisting of a plurality of frame images within a certain image capturing range in accordance with a preset patrol schedule; acquiring edited video generated by editing recorded video that is video captured by the image capture device during the period from the end of the first cyclic schedule to the start of the second cyclic schedule that is the next cyclic schedule after the first cyclic schedule; acquiring live video images captured by the image capturing device according to the second cyclic schedule; displaying the live video and the edited video on a display unit; Execute an operation including:

[0031] In this way, the computer running the program displays, in addition to the live video, edited video of the recorded video from the end of the first patrol schedule to the start of the second patrol schedule. Therefore, a user such as a monitor can detect not only current abnormalities occurring at the monitored location, but also abnormalities that have occurred at the monitored location since the check in the previous patrol schedule up to the start of the current patrol schedule. Furthermore, even if there is a difference between the live video from the current patrol and the live video from the previous patrol, the user can understand the cause and circumstances of the difference from the edited video and determine whether the difference indicates an abnormality or not. Therefore, the information processing device makes it easier to detect abnormalities in the surveillance system. [Effects of the Invention]

[0032] According to an embodiment of the present disclosure, it becomes possible to more easily discover abnormalities in a monitoring system. [Brief explanation of the drawings]

[0033] [Figure 1] FIG. 1 is a diagram illustrating an example of a functional configuration of a monitoring system according to an embodiment. [Figure 2] FIG. 2 is a diagram illustrating an example of a hardware configuration of a server device in FIG. [Figure 3] FIG. 2 is a diagram illustrating an example of a hardware configuration of the client device in FIG. [Figure 4] 10 is a flowchart illustrating an example of an operation of the monitoring system according to an embodiment. [Figure 5] FIG. 10 is a diagram illustrating an example of a screen displayed on a client device. [Figure 6] FIG. 6 is a diagram showing an example of a screen displayed in the area of ​​FIG. 5. [Figure 7] FIG. 6 is a diagram showing an example of a screen displayed in the area of ​​FIG. 5. [Figure 8] FIG. 10 is a diagram illustrating an example of a screen displayed on a client device. [Figure 9]FIG. 10 is a diagram illustrating an example of a screen displayed on a client device. [Figure 10] FIG. 10 is a diagram illustrating an example of a report document generated by the monitoring system. DETAILED DESCRIPTION OF THE INVENTION

[0034] <Comparative Example> The monitoring system according to the comparative example (claim 1 of patent document 1) is a video cyclic monitoring system that switches and outputs a plurality of video signals input from the outside based on the state of a plurality of sensor detection signals input from the outside, and includes a video input means having a plurality of video signal input units that input the plurality of video signals respectively, a storage means that stores a cyclic sequence that indicates whether each of the input plurality of video signals is a switching target, a switching control means that switches the plurality of video signal input units according to the cyclic sequence to select one of the video signal input units, and a video signal output means that outputs the video signal input to the selected video signal input unit to the outside. This video cyclic surveillance system is characterized by comprising: detection signal input means for inputting a plurality of sensor detection signals; sensor state management means having a management table that associates the plurality of sensor detection signals with the plurality of video signals and classifying the states of the plurality of sensor detection signals into detection states or non-detection states; and cyclic sequence management means that updates the cyclic sequence based on the management table so that video signal input units that input video signals corresponding to sensor detection signals classified as detection states are subject to switching, and video signal input units that input video signals corresponding to sensor detection signals classified as non-detection states are not subject to switching.

[0035] However, the monitoring system according to the comparative example only presents images captured by the cameras during automatic patrol, and the user has to carefully examine the images presented during the automatic patrol to check for any abnormalities. Therefore, the conventional monitoring system can only check for the presence or absence of abnormalities at the time of the patrol.

[0036] Therefore, the present disclosure provides a monitoring system that allows users to understand any abnormal situations that occur during a patrol by displaying edited footage of recorded footage from the time between the previous patrol and the current patrol, or events that occurred during that time, or measured values ​​of physical quantities from sensors.

[0037] <Embodiment> Hereinafter, an embodiment of the present disclosure will be described with reference to the drawings. In each drawing, parts having the same configuration or function are denoted by the same reference numerals. In the description of this embodiment, duplicated descriptions of the same parts may be omitted or simplified as appropriate.

[0038] (Monitoring system) 1 is a diagram showing an example of the functional configuration of a monitoring system 1 according to an embodiment. The monitoring system 1 monitors a building, facility, outdoors, or the like (hereinafter referred to as a "target facility") that is a monitoring target. The monitoring system 1 includes a server device 10, a client device 20, a camera 31, a microphone 32, and sensors 33 (331, ..., 33n). The server device 10 and the client device 20 are communicably connected to a network 50, which may include, for example, the Internet, an intranet, a mobile communication network, or the like.

[0039] The server device 10 as an information processing device according to this embodiment is a device that acquires video and signals from the camera 31, microphone 32, and sensors 33 (331,...,33n), performs necessary signal processing, and then provides the video and signals to the client device 20. The server device 10 is connected to the camera 31, microphone 32, and sensors 33 (331,...,33n). The server device 10 has functional elements of a signal processing unit 101 and a communication control unit 102. The signal processing unit 101 controls the operation of the camera 31, microphone 32, and sensors 33 (331,...,33n) and receives video and signals from these devices. The communication control unit 102 performs communication control to provide the video and signals that have undergone signal processing to the client device 20. In this embodiment, the server device 10 is installed within the target facility together with the camera 31, microphone 32, and sensor 33 (331, ..., 33n), but it may also be installed outside the target facility and communicate with the camera 31, microphone 32, and sensor 33 (331, ..., 33n) via the network 50.

[0040] The client device 20 is a device operated by a user such as a security officer. The client device 20 receives and displays images and signals from the server device 10. The client device 20 can communicate with the server device 10 via a network 50. The client device 20 has functional elements including a patrol control unit 201, a display control unit 202, and a communication control unit 203. The patrol control unit 201 generates control signals for the camera 31, microphone 32, and sensors 33 (331, ..., 33n) to automatically patrol the target facility according to a predetermined procedure. The display control unit 202 controls the display for the user in response to communication with the server device 10. The communication control unit 203 transmits control signals for the camera 31, etc. generated by the patrol control unit 201 to the server device 10, and receives images and signals that have been signal-processed in the server device 10 from the server device 10. In this embodiment, an example will be described in which the monitoring system 1 includes one client device 20, but the number of client devices 20 is arbitrary.

[0041] The camera 31, which serves as an imaging device according to this embodiment, is installed within the target facility and captures images of the target facility to obtain video (moving images) consisting of multiple frame images. The camera 31 is, for example, a PTZ camera, but the shape and function of the camera 31 are optional. In this embodiment, an example in which the surveillance system 1 includes one camera 31 will be described, but the number of cameras 31 is optional.

[0042] The microphone 32 is installed within the target facility and captures audio signals generated within the target facility. In this embodiment, an example will be described in which the monitoring system 1 includes one microphone 32, but the number of microphones 32 is arbitrary.

[0043] The sensors 33 (331,...,33n) detect the occurrence of various events in the target facility and measure physical quantities related to the events. Hereinafter, the sensors 331,...,33n may be collectively referred to as "sensors 33." The sensors 33 may be, for example, a door opening / closing sensor, a human presence sensor, an intrusion detection sensor, a fire sensor (fire alarm), a smoke sensor (smoke detector), a temperature sensor, a humidity sensor, a CO2 (carbon dioxide) concentration sensor, an illuminance sensor, or a traffic volume sensor, but are not limited to these. In this embodiment, an example will be described in which the number of sensors 33 (331,...,33n) included in the monitoring system 1 is n (n: 2 or more), but the number of sensors 33 is arbitrary.

[0044] The server device 10 controls the cameras 31 so that they automatically perform camera patrols within the target facility periodically (for example, once to several times a day) according to a predetermined procedure. The time required for one camera patrol may be, for example, several minutes to several tens of minutes, similar to the time required for a security guard's rounds, or it may be longer. When multiple cameras 31 are present, one camera patrol may be performed by the multiple cameras 31 working together to take a series of images. Even when a camera patrol is not being performed, the cameras 31 may continue to take images by sequentially switching the angle of view, direction, etc. by controlling the PTZ value. The microphone 32 and sensor 33 may operate so as to always detect signals, regardless of whether a camera patrol is being performed or not.

[0045] In this configuration, when the monitoring system 1 performs a camera patrol, it not only displays footage captured by the camera 31 but also displays images for checking events that occurred between the end of the previous patrol and the start of the current patrol. Specifically, for example, the monitoring system 1 may display live footage of the current situation at each location during the automatic patrol, captured by the camera 31, along with edited footage of recorded footage of the camera 31 at the location between the previous patrol and the current patrol, edited by fast-forwarding, for example. Furthermore, for example, the monitoring system 1 may simultaneously display an event history for the location generated by a sensor 33, such as a door sensor or a motion sensor, as well as images containing graphs of measurements of physical quantities, such as temperature, humidity, and CO2 concentration, taken by the sensor 33. This configuration allows the user to easily grasp the situation at the location between the previous patrol and the current patrol and easily recognize any abnormalities that may have occurred. Furthermore, the user can recognize problems from events that have occurred at the location since the previous patrol and, based on the results, adjust the checkpoints when checking the current footage. Therefore, the monitoring system 1 can prevent the user from overlooking problems hidden in the current video. In this way, by displaying edited video of video from the previous patrol and images of information acquired by the sensor 33 in addition to the video captured during the current patrol, it becomes easier to discover and prevent abnormalities that are difficult to deal with by security guards on patrol.

[0046] Furthermore, the monitoring system 1 may automatically generate a report (including electronic document data) that includes the results of the patrol, video information from the previous patrol to the current patrol, event history, graphs of numerical information on physical quantities, etc. This allows the user of the monitoring system 1 to easily obtain a report document of the patrol results, including events that occurred during the patrol.

[0047] (Server device) Fig. 2 is a diagram showing an example of the hardware configuration of the server device 10 in Fig. 1. The server device 10 is one or more computer devices that can communicate with each other. The server device 10 is realized by, for example, a general-purpose computer such as a PC (Personal Computer) or a WS (Workstation), but may also be realized by an FPGA (Field Programmable Gate Array) or the like. As shown in Fig. 2, the server device 10 includes a control unit 11, a storage unit 12, and a communication unit 13.

[0048] The control unit 11 includes one or more processors. In one embodiment, the "processor" may be, but is not limited to, a general-purpose processor or a dedicated processor specialized for a specific process. The control unit 11 is communicably connected to each component of the server device 10 and controls the operation of the entire server device 10.

[0049] The storage unit 12 includes any storage module, such as a hard disk drive (HDD), a solid state drive (SSD), a read-only memory (ROM), and a random access memory (RAM). The storage unit 12 may function as, for example, a main storage device, an auxiliary storage device, or a cache memory. The storage unit 12 stores any information used in the operation of the server device 10. For example, the storage unit 12 may store a system program (operating system), an application program, and various information received by the communication unit 13. The storage unit 12 is not limited to being built into the server device 10, and may be an external database or an external storage module.

[0050] The communication unit 13 includes any communication module that can communicate with other devices such as the camera 31, the microphone 32, the sensor 33, and the client device 20 using any communication technology. The communication unit 13 may further include a communication control module for controlling communication with other devices, and a storage module for storing communication data such as identification information required for communication with other devices.

[0051] The signal processing unit 101 and the communication control unit 102, which are functional elements of the server device 10, can be realized by executing a computer program (program) according to this embodiment on a processor included in the control unit 11. That is, each functional element of the server device 10 can be realized by software. The computer program causes a computer to execute processing of steps included in the operation of the server device 10, thereby causing the computer to realize functions corresponding to the processing of each step. That is, the computer program is a program for causing a computer to function as the server device 10 according to this embodiment. The computer program may be recorded on a computer-readable recording medium. Programs include information used for processing by an electronic computer that is equivalent to a program. For example, data that is not a direct instruction to a computer but has properties that define computer processing falls under the category of "something equivalent to a program."

[0052] Some or all of the functions of the server device 10 may be realized by a dedicated circuit included in the control unit 11. That is, some or all of the functions of the server device 10 may be realized by hardware. Furthermore, the server device 10 may be realized by a single computer device, or may be realized by the cooperation of multiple computer devices.

[0053] (Client device) Fig. 3 is a diagram showing an example of the hardware configuration of the client device 20 in Fig. 1. The client device 20 is one or more computer devices that can communicate with each other. The client device 20 is realized by, for example, a general-purpose computer such as a PC or a tablet terminal, but may also be realized by an FPGA or the like. As shown in Fig. 3, the client device 20 includes a control unit 21, a storage unit 22, a communication unit 23, an input unit 24, and an output unit 25.

[0054] The hardware configurations of the control unit 21, the storage unit 22, and the communication unit 23 are realized in the same manner as the control unit 11, the storage unit 12, and the communication unit 13 of the server device 10, and therefore detailed description thereof will be omitted.

[0055] The input unit 24 includes one or more input interfaces that accept a user's input operation and acquire input information based on the user's operation. For example, the input unit 24 may be, but is not limited to, a physical key, a capacitance key, a pointing device, a touch screen integrated with the display of the output unit 25, or a microphone that accepts voice input.

[0056] The output unit 25 includes one or more output interfaces that output information to the user and notify the user. For example, the output unit 25 is, but is not limited to, a display that outputs information as an image or a speaker that outputs information as sound. Such a display may be, for example, a liquid crystal panel display or an organic EL (Electro Luminescence) display. At least one of the input unit 24 and the output unit 25 may be configured integrally with the client device 20 or may be provided separately.

[0057] Similar to the server device 10, the functional elements of the client device 20, namely, the cyclic control unit 201, the display control unit 202, and the communication control unit 203, can be realized by executing the program according to this embodiment on a processor included in the control unit 21.

[0058] (sensor) The sensor 33 may include a detection device that detects the occurrence of a predetermined event and a measurement device that measures a predetermined physical quantity. The predetermined event detected by the detection device is an event that is related to an incident that requires attention from the viewpoint of security or crime prevention during camera patrol. For example, the detection device may be a door opening / closing sensor, a human presence sensor, an intrusion detection sensor, a fire sensor, or a smoke sensor. The measurement device may be, for example, a temperature sensor, a humidity sensor, a CO2 concentration sensor, an illuminance sensor, or a traffic volume sensor. The detection device may detect, as an event, a physical quantity such as temperature, humidity, CO2 concentration, illuminance, or traffic volume measured by the measurement device becoming greater than or smaller than a predetermined threshold.

[0059] The "door opening / closing sensor" is, for example, a sensor that detects the opening / closing of a door installed at the entrance of a building or at the entrance of a room, etc. The door opening / closing sensor may be configured as, for example, a switch attached to the door and mechanically linked to the open / closed state of the door. The door opening / closing sensor may output a signal indicating the opening / closing state of the door to the server device 10.

[0060] A "human presence sensor" is a sensor that detects whether or not a person is present in a specific location. The human presence sensor may be configured, for example, as an infrared sensor that detects infrared rays emitted by a person. The human presence sensor may output a signal indicating the presence or absence of a person to the server device 10. Since the human presence sensor detects continuously for a certain period of time, once a human is detected, as long as the detected state continues, the detected content may be transmitted to the server device 10 at regular intervals.

[0061] An "intrusion detection sensor" is a sensor that detects the intrusion of a person or other obstacle into a specific location. The intrusion detection sensor may be configured, for example, as a sensor that detects the passage of an obstacle between an infrared emitting device and an infrared receiving device, or as a sensor that detects the vibration pattern when window glass is broken. When the intrusion detection sensor detects the intrusion of an obstacle, it may output a signal indicating this to the server device 10. The door opening / closing sensor, human presence sensor, and intrusion detection sensor may be realized by a motion sensor that detects the movement of some object in the monitored area.

[0062] The "fire sensor" is a sensor that detects the occurrence of a fire. The fire sensor may be configured, for example, as a smoke sensor that detects smoke or a heat sensor that detects heat. When the fire sensor detects a fire, it may output a signal indicating that a fire has occurred to the server device 10 as a detection result. When the smoke sensor detects smoke, it may output a signal indicating that a fire has occurred to the server device 10.

[0063] A "temperature sensor" is a sensor that detects the temperature of a specific object. The temperature sensor may be configured as, for example, a thermocouple sensor or a sensor that utilizes a change in the resistance value of an object due to temperature (e.g., a thermistor). The temperature sensor may output a signal indicating the numerical value of the detected temperature to the server device 10.

[0064] The "humidity sensor" is a sensor that detects the humidity in a target space. The humidity sensor may be configured as, for example, a resistive sensor or a capacitive sensor. The humidity sensor may output a signal indicating the value of the detected humidity to the server device 10.

[0065] The "CO2 concentration sensor" is a sensor that detects the concentration of CO2 in a target space. The CO2 concentration sensor may be configured as, for example, an NDIR (Non Dispersive Infrared) type sensor that utilizes the infrared absorbing properties of CO2. The CO2 concentration sensor may output a signal indicating the numerical value of the detected CO2 concentration to the server device 10.

[0066] The "illuminance sensor" is a sensor that detects the illuminance of an object. The illuminance sensor may be configured as a sensor that measures the intensity of light received by, for example, a photodiode or a phototransistor. The illuminance sensor may output a signal indicating the numerical value of the detected illuminance to the server device 10.

[0067] A "traffic volume sensor" is a sensor that counts the number of people, vehicles, etc. passing by. A traffic volume sensor may be realized, for example, by an infrared sensor that detects the passage of a person, vehicle, etc. between an infrared transmitter and a receiver by blocking infrared rays. For example, traffic volume may be detected by installing a pair of infrared sensors and identifying the direction of traffic based on which infrared ray is blocked first.

[0068] In this way, the sensor 33 transmits information such as the type and time of the detected event, the measured value of the physical quantity, etc. to the server device 10 in response to the detection of an event and the measurement of the physical quantity.

[0069] The above-described door opening / closing sensor, human presence sensor, intrusion detection sensor, fire sensor, smoke sensor, temperature sensor, humidity sensor, CO2 concentration sensor, illuminance sensor, and traffic volume sensor are examples of the sensor 33, and the sensor 33 may be a device that detects other information. Furthermore, the configurations of the above-described door opening / closing sensor, human presence sensor, intrusion detection sensor, fire sensor, smoke sensor, temperature sensor, humidity sensor, CO2 concentration sensor, illuminance sensor, and traffic volume sensor are examples, and the sensor may be configured using other types of sensors.

[0070] (Monitoring system operation) Fig. 4 is a flowchart showing an example of the operation of the monitoring system 1 according to an embodiment. The operation of the monitoring system 1 described with reference to Fig. 4 may correspond to one method of controlling an information processing device. The operation of each step in Fig. 4 may be performed based on the control of the control unit 11 of the server device 10. Each of the following steps is performed for each patrol schedule of the monitoring system 1.

[0071] In step S1, the control unit 11 controls the camera 31 (photographing device) to photograph a certain photographing range in accordance with a predetermined patrol schedule.

[0072] In step S2, the control unit 11 acquires, as live video, the video captured by the camera 31 in accordance with the current patrol schedule in step S1.

[0073] In step S3, the control unit 11 causes the display unit to display the video acquired in step S2 as live video. Specifically, the control unit 11 may transmit the video acquired in step S2 to the client device 20 and cause the video to be displayed on the display (display unit) of the output unit 25 of the client device 20.

[0074] The control unit 11 may execute the processes of steps S1 to S3 and steps S4 to S8 in parallel, or may execute the processes of steps S4 to S8 before the processes of steps S1 to S3.

[0075] In step S4, the control unit 11 acquires edited video of the video shot between the previous cyclic schedule (first cyclic schedule) and the current cyclic schedule (second cyclic schedule). The edited video is video generated by editing recorded video, which is video shot by the camera 31 between the end of the previous cyclic schedule and the start of the current cyclic schedule. For example, the control unit 11 may acquire as edited video a video generated by fast-forwarding the recorded video from the previous cyclic schedule to the current cyclic schedule at a constant speed. Other examples of edited video will be described later in the description of step S8.

[0076] In step S5, the control unit 11 acquires events detected by the microphone 32 or the sensor 33 during the period from the previous visiting schedule to the current visiting schedule. For example, the control unit 11 may acquire information including the occurrence time (date and time), type, priority, location, etc. of each of the detected events.

[0077] In step S6, the control unit 11 acquires physical quantities measured by the microphone 32 or the sensor 33 during the period from the previous visiting schedule to the current visiting schedule. For example, the control unit 11 may acquire information indicating the temporal progression of the measured physical quantities.

[0078] In step S7, the control unit 11 determines the correspondence between the edited video, the event, and the physical quantity acquired in steps S4 to S7. For example, the control unit 11 may determine the correspondence between these based on the time when the event was detected, etc.

[0079] In step S8, the control unit 11 causes the display unit to display the edited video, the list of detected events, and the graph of the physical quantities in association with each other. Specifically, the control unit 11 may transmit the edited video, the list of detected events, and the graph of the physical quantities to the client device 20, and cause them to be displayed on the display (display unit) of the output unit 25 of the client device 20.

[0080] 5 is a diagram showing an example of a screen 70 displayed on the client device 20. The screen 70 includes areas 71-74.

[0081] Area 71 is an area for displaying live video, which is video captured during the current tour schedule. When control unit 11 receives video captured by camera 31, it may transmit the video to client device 20 in order and display the video on output unit 25 in real time.

[0082] Area 72 is an area for displaying edited video of the video shot by camera 31 from the end of the previous tour schedule to the start of the current tour schedule. For example, control unit 11 may display, as edited video, in area 72, a simple fast-forwarded video (e.g., a time-lapse image) of recorded video, which is video shot from the end of the previous tour schedule to the start of the current tour schedule. Alternatively, control unit 11 may analyze the recorded video shot from the end of the previous tour schedule to the start of the current tour schedule, extract video of a time range in which some kind of movement occurred within the entire screen, and connect the extracted videos to display, as edited video, in area 72.

[0083] Alternatively, for example, the control unit 11 may analyze the recorded video captured between the end of the previous patrol schedule and the start of the current patrol schedule, extract video within a time range in which some movement occurred in a specific part of the screen, and display the extracted video in area 72 as an edited video. This processing can be performed in a similar manner to, for example, VMS (Video Management System) software that processes surveillance camera video and controls recording. Specifically, for example, the control unit 11 may divide the recorded video into a grid and detect that there was movement in a specific area if there is a difference between adjacent frames in the grid corresponding to that specific area. When the control unit 11 detects movement in such a grid, it may store information such as the time when the movement was detected as meta information in the recorded file. The control unit 11 may identify the time when the movement was detected by referring to the meta information, extract video captured within a certain time range before and after that time, and display the extracted video in area 72 as an edited video.

[0084] In this way, the control unit 11 displays, in addition to the live video, edited video of the recorded video from the end of the previous patrol schedule to the current patrol schedule. Therefore, a user such as a monitor can quickly check not only the current abnormality occurring at the monitored location, but also any abnormalities that have occurred at the monitored location since the check in the previous patrol schedule up to the current patrol schedule. Furthermore, even if there is a difference between the live video of the current patrol and the live video of the previous patrol, the user can understand the cause and circumstances of the difference from the edited video and determine whether the difference indicates an abnormality or not. Therefore, the control unit 11 makes it easier to detect abnormalities in the surveillance system.

[0085] Furthermore, the control unit 11 acquires and displays, as edited video, video generated by fast-forwarding the recorded video at a constant speed, or video obtained by continuously playing back video of portions of the recorded video where movement has been detected. Therefore, the user can check the current video by referring to the edited video and video that requires particular attention that was taken after the previous tour schedule ended and before the current tour schedule started, and can more easily find abnormalities.

[0086] Alternatively, for example, the control unit 11 may extract recorded video that was shot within a certain time range before and after the occurrence time of the event acquired in step S5, and connect the extracted videos together to display in the area 72. Alternatively, for example, the control unit 11 may connect video of a time range in which there was movement on the entire screen or a specific part of the recorded video, and video before and after the occurrence time of the event, etc., as edited video in the area 72. Alternatively, for example, the control unit 11 may connect frame images of the recorded video at the occurrence time of the event and display them as edited video in the area 72.

[0087] In this way, the control unit 11 acquires and displays, as an edited image, a video in which the portion of the recorded video corresponding to the time when the event occurred is continuously played back, so that the user can refer to the edited video corresponding to the detected event and check in more detail the abnormality caused by the event that occurred.

[0088] 5, the control unit 11 displays an image 721 indicating the temporal position of the edited video being displayed. The image 721 indicates the temporal position of the edited video being played back using an indicator 722 on a time bar. This allows the user to easily check the time of the edited video being displayed.

[0089] Area 73 is an area that displays a list of events detected by microphone 32 or sensor 33 between the previous patrol schedule and the current patrol schedule. FIG. 6 is a diagram showing an example of a screen displayed in area 73 of FIG. 5. Area 73 displays a list of events that occurred between "XX month XX day 12:00 to 17:00." In FIG. 6, "event status" indicates whether a response to the detected event is required and whether it has been confirmed. "Occurrence time" indicates the time when the event was detected. "Priority" indicates the priority with which the event should be responded to. "Event type" indicates the type of sensor 33 that detected the event. "Contractor" indicates the contractor of the monitoring service (e.g., the manager of the target facility, etc.). "Location" indicates the location where the event was detected.

[0090] For example, if a door sensor, a motion sensor, an intrusion detection sensor, a fire sensor, or the like detects an event, the facility manager or the like may immediately notify the server device 10 or output an alarm sound in response to the event detection, and the facility manager or the like may respond to the event. When such an event detection response is made, the control unit 11 may display in the "event status" that the response has been completed. By displaying the detection of such an event even if the response has been completed, the user can perform patrols while keeping in mind the occurrence of important events such as intrusions and fires during the patrol schedule. Furthermore, the control unit 11 displays the occurrence time, event type, etc. of events that were not treated as problematic, in addition to events that were clearly problematic, as shown in FIG. 6 . This allows the user to easily determine whether the event was actually problematic by checking the video displayed in area 71 on the patrol schedule while paying attention to the event detected during patrol.

[0091] The control unit 11 displays the detected events in order of "occurrence time," but may also sort and display them according to selection of other items such as "priority" or "event type." The control unit 11 may also display the detected events in order of "occurrence time" for each sensor 33. The control unit 11 may also display event information by adjusting color, font, etc. according to the type of sensor 33 that detected the event.

[0092] In this way, the control unit 11 displays, together with the live video and edited video, a list image that includes a list display of the occurrence time and type of each event detected between the end of the previous tour schedule and the start of the current tour schedule. Therefore, the user can check the current live video while recognizing the time and type of the event, and can more easily find any abnormalities that have occurred between the previous tour schedule and the present.

[0093] Furthermore, physical quantities such as temperature, humidity, CO2 concentration, illuminance, or traffic volume measured by the sensor 33 are displayed as graphs in the area 74. The control unit 11 may also display, as events, in a list in the area 73, any physical quantities that exceed or fall below a predetermined threshold. For example, the control unit 11 may display, as events, any physical quantities that exceed a certain temperature, any CO2 concentration, any number of people or vehicles passing per unit time, any number of people staying, or any other physical quantities. Alternatively, the control unit 11 may display, as events in the area 73, any physical quantities whose change range exceeds a predetermined threshold. This allows the user to easily recognize physical quantities that require particular attention.

[0094] In this way, the control unit 11 displays events determined based on the measured physical quantities in the list image, so that the user can check not only events detected by the detection device but also events determined based on the physical quantities in the list image.

[0095] The control unit 11 may also analyze the video recorded by the camera 31 between the end of the previous patrol schedule and the start of the current patrol schedule to detect the presence of a person, object, or the like and specific occurrences as events. The control unit 11 may display a list of information about these events in the area 73. Specifically, the control unit 11 may use a known machine learning technique to detect, for example, the appearance of a person, equipment, animal, vehicle, special vehicle, or material in the video as an event. Specifically, for example, the control unit 11 may define a specific area within the screen and, when a person, vehicle, or the like is recognized as having entered that area, detect an event that an intrusion into that area has occurred. Alternatively, for example, the control unit 11 may use a known machine learning technique to detect specific acts by a person, such as a person falling, violence, or theft. When the control unit 11 analyzes the video recorded by the camera 31 between the end of the previous patrol schedule and the start of the current patrol schedule to detect an event, the control unit 11 may use information detected by the microphone 32 and the sensor 33 in addition to information about the video.

[0096] The control unit 11 may also analyze sounds acquired by the microphone 32 from the end of the previous patrol schedule to the start of the current patrol schedule, detect them as events, and display a list of the detected events in the area 73. For example, the control unit 11 may detect events by analyzing sounds collected by the microphone 32 installed at each patrol location or the built-in microphone of the camera 31 using known machine learning techniques. For example, the control unit 11 may detect, as events, human shouts (screams, shouts, etc.), human footsteps (walking, running, etc.), conversations with a tone that may indicate violent acts such as fighting, or impact sounds. Alternatively, the control unit 11 may extract, for example, sounds of hitting or breaking objects, strange sounds made by devices operating in the location, vehicle collisions, sudden braking, horns, car crashes, animal cries, animal footsteps, etc., and detect them as events. When the control unit 11 recognizes these sounds, it may display a list of the sounds in the area 73, indicating the type of sound, such as shouts, footsteps, or violent acts.

[0097] Area 74 is an area for displaying graphs showing the temporal changes in physical quantities measured by microphone 32 or sensor 33 from the previous patrol schedule to the current patrol schedule. Fig. 7 is a diagram showing an example of a screen displayed in area 74 in Fig. 5. Fig. 7 shows an example of graph 741 showing the temporal changes in temperature and graph 742 showing the temporal changes in noise level.

[0098] The control unit 11 may analyze not only the temporal transition of the physical quantity measured by the sensor 33 but also the video recorded by the camera 31 and display the temporal transition of the detected quantity based on the analysis results in the area 74. For example, the control unit 11 may use a known machine learning technique to analyze the video captured by the camera 31 from the end of the previous patrol schedule to the start of the current patrol schedule and detect people, vehicles, etc. in the video. Based on such detection results, the control unit 11 may obtain the temporal transition of the number of people passing through, the number of vehicles passing through, the number of people staying, the number of vehicles staying, etc. at a specific location. Specifically, for example, the control unit 11 may detect the passage of a person or vehicle based on the fact that a detected person or vehicle has passed through a line set on the screen and the direction of passage, etc. Alternatively, the control unit 11 may detect the number of people staying and the number of vehicles staying in a certain area by, for example, calculating the number of people, vehicles, etc. present in the area or calculating the difference in the amount of inflow and outflow at the entrance and exit of the area. The control unit 11 may display in the area 74 a graph showing the temporal change of the amount thus obtained.

[0099] In this way, the surveillance system 1 simultaneously displays, on the screen displaying the video from the camera 31 viewed by the user during automatic patrol, edited video of the video captured by the camera 31 from the previous patrol to the timing of the current patrol, a history of events detected by the sensor 33, and a graph based on numerical data continuously measured by the sensor 33. Therefore, with the surveillance system 1, if there is an abnormal change in a physical quantity, the user can recognize it by comparing the edited video and the list image and check the current live video. Furthermore, since the user can recognize points to pay attention to during patrol, it becomes possible to easily perform monitoring with a higher level of security. Therefore, the user can more easily detect abnormalities.

[0100] The control unit 11 may display images displayed in the areas 72 to 74 based on the same event in association with each other. Figures 8 and 9 are diagrams showing examples of screens displayed on the client device 20.

[0101] FIG. 8 illustrates a display of a list of events in area 73 in association with edited video in area 72, based on an event in which a human presence sensor detects a person. As described above, when sensor 33 detects a specific event, control unit 11 may generate edited video by extracting video captured by camera 31 within a certain time range including the time the event was detected. Therefore, when playing back edited video in area 72, control unit 11 may display, using image 751, a correspondence between the edited video and corresponding event information 731 listed in area 73 while displaying portions before and after the event. Control unit 11 may highlight the corresponding event information 731 listed in area 73, for example, by changing the color or font size. When displaying edited video corresponding to event information 731 in area 72, control unit 11 may highlight the entire event information 731 by, for example, surrounding it with a frame. Furthermore, when event information 731 is selected by a user in area 73, control unit 11 may display the corresponding edited video in area 72 together with image 751.

[0102] In this way, the control unit 11 highlights the event corresponding to the edited video being displayed in the list image (for example, information 731), so the user can more easily recognize the event corresponding to the edited video being displayed. Furthermore, when simultaneously displaying the live video, the edited image, and the list image, the control unit 11 further displays an image (for example, image 751, image 752 described below) indicating the correspondence between the event highlighted in the list image and the edited video. Therefore, the user can more easily recognize the correspondence between the content of the edited video being displayed and the detected event.

[0103] FIG. 9 shows how, based on the detection of sound by microphone 32 at a level higher than a certain threshold, edited video related to the event in area 72, event information listed in area 73, and a graph displayed in area 74 are displayed in association with each other. In the example of FIG. 9, noise exceeding a certain sound level is detected as an event at approximately 16:11. In area 74, a point corresponding to the event is indicated by image 747 as an event image in noise level graph 743. An event image is an image indicating the occurrence of an event on a graph. In the example of FIG. 9, image 747 is a star, but the event image may be an image having any shape other than a star. For example, the event image may be an arrow, a predetermined mark, a design (such as an icon), or text. In area 73, information 731 about the event is highlighted. In area 72, video at the time of the event is displayed. The control unit 11 has images 752 and 753 showing the correspondence between the edited video in the area 72, the event information 731 in the area 73, and the image 747 showing the peak of the graph 743 in the area 74.

[0104] In this way, the control unit 11 determines that an event has occurred when the measured physical quantity satisfies a predetermined condition, and displays an event image (e.g., image 747) indicating the occurrence of the event at a position on the graph corresponding to the time and physical quantity at which the event was determined. Therefore, the user can easily recognize the time and physical quantity at which the event occurred on the graph. Here, the control unit 11 may determine that an event has occurred by determining that the predetermined condition has been satisfied when the measured value of the physical quantity or the amount of change in the measured value exceeds a predetermined threshold. Alternatively, for a measured value of a physical quantity or an amount of change in the measured value that exhibits regularity due to time, day of the week, season, or the like, a tolerable range of deviation from the regular periodic change may be defined in advance. In this case, the control unit 11 may determine that an event has occurred when a deviation exceeding the range occurs. Furthermore, when simultaneously displaying live video, edited video, an event list image, and a graph of the physical quantity, the control unit 11 further displays an image (e.g., image 753) indicating the correspondence between the event image (e.g., image 747) on the graph and the display in the event list image. Therefore, the user can more easily recognize the correspondence between the graph of the physical quantity and the events displayed in the list image.

[0105] Returning to the description of Fig. 4, in step S9, the control unit 11 determines whether or not to create a report (report document). For example, the control unit 11 may determine to create a report when the user of the client device 20 instructs to create a report. If the control unit 11 determines to create a report (YES in step S9), the control unit 11 proceeds to step S10, and if not (NO in step S9), the control unit 11 ends the processing of the flowchart.

[0106] In step S10, the control unit 11 accepts input of comments to be written in the report from the user. For example, a text input screen may be displayed and the input of comments may be accepted via the input screen.

[0107] In step S11, the control unit 11 displays a preview screen of the report. The control unit 11 may create the preview screen of the report based on the images of the areas 71 to 74 displayed on the screen 70 and the comments input in step S10.

[0108] FIG. 10 is a diagram showing an example of a preview screen of a report document generated by the monitoring system 1. As shown in FIG. In FIG. 10 , a report preview screen 80 includes areas 81 to 85. Area 81 displays a representative image included in the video captured by camera 31. Area 82 displays an image captured by camera 31 when an event is detected. Area 83 displays an image showing a list of events. Area 84 displays a graph showing temporal changes in physical quantities. Area 85 displays comments entered by the user. In the example of FIG. 10 , the comment entered reads, "A suspicious person entered the premises of XX Building at around 4:00 PM on XX / XX, and at around 4:11 PM broke a locked window next to the entrance on the first floor of the building and entered the entrance. When entering the entrance through the window, the suspicious person came into contact with a vase displayed in the entrance area and damaged the vase." The user checks this preview screen 80 and determines whether to output the report shown on the preview screen 80.

[0109] In the process of creating a report, the control unit 11 may accept from the user selection of content to be included in the report, for example, video recorded after the patrol, sensor measurement values, events, etc. For example, the control unit 11 may accept editing of content to be displayed in the report through operations on areas 81 to 85 on the preview screen 80.

[0110] In step S12, the control unit 11 determines whether to output a report. For example, the control unit 11 may determine whether to output a report based on whether the user has instructed the control unit 11 to output a report. If the control unit 11 determines that the report will be output (YES in step S12), the control unit 11 proceeds to step S13, and if the control unit 11 determines that the report will not be output (NO in step S12), the control unit 11 proceeds to step S10 to further accept editing of the comment, etc.

[0111] In step S13, the control unit 11 outputs the report confirmed by the user on the preview screen 80. For example, the control unit 11 may output the report as a file in a specific format such as PDF (Portable Document Format), or may output the report printed on a recording medium from a printer. After completing the process of step S13, the control unit 11 ends the process of the flowchart.

[0112] As described above, the server device 10 is an information processing device capable of communicating with the camera 31 that captures video. The server device 10 controls the camera 31 to capture a certain shooting range according to a preset cyclic schedule. The server device 10 acquires edited video of recorded video captured in the shooting range between the end of a first cyclic schedule (previous cyclic schedule) and the start of a second cyclic schedule (current cyclic schedule), which is the cyclic schedule following the first cyclic schedule. The server device 10 acquires live video, which is video of the shooting range captured by the camera 31 according to the second cyclic schedule. The server device 10 displays the live video and edited video on the output unit 25 (display unit) of the client device 20.

[0113] Therefore, the user can view the live video while checking the edited video from the end of the first patrol schedule to the start of the second patrol schedule. Therefore, the user can quickly detect not only current abnormalities occurring at the monitored location, but also abnormalities that have occurred at the monitored location since the check in the previous patrol schedule up to the current patrol schedule. Furthermore, even if there are differences between the live video from the current patrol and the live video from the previous patrol, the user can understand the cause and circumstances of the difference through the edited video and determine whether the difference indicates an abnormality or not. For example, the user can identify areas where people or objects have moved or entered or exited since the previous patrol, and then focus on checking for any leftover items or intentionally installed listening devices during the current patrol, thereby increasing the probability of detecting them.

[0114] In addition, the server device 10 displays a list of detected events and graphs of measured physical quantities along with the live video and edited video. Therefore, if the user detects a discrepancy between environmental changes such as temperature, humidity, noise level, and CO2 concentration and factors related to environmental changes such as an increase in the number of people during the target time period, the user can focus their check on that location. This further prevents security oversights. Furthermore, the user can compare, for example, video captured during a previous patrol with video captured during the current patrol. If there is a difference between the two, the user can determine whether the difference indicates an abnormal situation or whether the difference is a reasonable result of something that happened between the previous patrol and the current patrol, thereby improving the accuracy of determining whether something is abnormal or normal.

[0115] In this way, when the surveillance system 1 displays images to the user during a camera 31 patrol, in addition to the current image captured by the camera 31, it also simultaneously displays images captured between the previous patrol and the current patrol, a fast-forwarded image of images captured by the sensor 33, a history of events detected by the sensor 33, and numerical data output by the sensor 33. This allows the user to perform more advanced security surveillance.

[0116] The present disclosure is not limited to the above-described embodiments. For example, multiple blocks shown in the block diagrams may be integrated, or one block may be divided. Multiple steps shown in the flowcharts may be executed in parallel or in a different order depending on the processing capabilities of the device executing each step, or as needed, instead of being executed in chronological order as described. Other modifications are possible without departing from the spirit of the present disclosure. [Explanation of symbols]

[0117] 1. Surveillance System 10 Server device 11 Control section 12 Storage section 13 Communications Department 101 Signal processing section 102 Communication control unit 20 Client Device 21 Control section 22 Memory section 23 Communications Department 24 Input section 25 Output section 201 Patrol Control Unit 202 Display control unit 203 Communication Control Unit 31 Camera 32. Mike 33 Sensors 70 screens 71~74 Display area

Claims

1. An information processing device capable of communicating with a photographing device that photographs a video consisting of a plurality of frame images, controlling the photographing device so as to photograph a fixed photographing range in accordance with a preset patrol schedule; acquiring edited video generated by editing recorded video that is video captured by the image capture device during the period from the end of the first cyclic schedule to the start of the second cyclic schedule, which is the next cyclic schedule; acquiring live video images captured by the image capturing device according to the second cyclic schedule; displaying the live video and the edited video on a display unit; A control unit is provided, The control unit acquiring, as the edited video, at least one of a first video in which a video of a portion in which a movement is detected in the recorded video is continuously played back, and a second video in which a portion of the recorded video corresponding to a predetermined event occurrence time detected by a detection device between the end of the first cyclic schedule and the start of the second cyclic schedule is continuously played back; acquiring information including the occurrence time and type of each of the events detected by the detection device during the period from the end of the first cyclic schedule to the start of the second cyclic schedule, and further displaying a list image on the display unit that is an image including a list display of the occurrence times and types; Information processing device.

2. The information processing device according to claim 1 , wherein, when the second video is displayed on the display unit as the edited video, the control unit highlights the event corresponding to the edited video in the list image.

3. The information processing device according to claim 2 , wherein the control unit further causes the display unit to display an image indicating a correspondence between the event highlighted in the list image and the edited video.

4. An information processing device capable of communicating with a measurement device that measures a predetermined physical quantity, The control unit acquiring information indicating a temporal transition of the physical quantity measured by the measurement device during a period from the end of the first cyclic schedule to the start of the second cyclic schedule; further displaying on the display unit a graph showing a temporal transition of the physical quantity measured by the measuring device during the period from the end of the first cyclic schedule to the start of the second cyclic schedule; The information processing device according to claim 1 .

5. The control unit determining, as the event, that the physical quantity measured by the measurement device satisfies a predetermined condition; further displaying, on the display unit, an event image indicating the occurrence of the determined event at a position on the graph corresponding to the time at which the event was determined and the physical quantity; The information processing device according to claim 4 .

6. The control unit further displaying, as the list image, an image further including an indication of an occurrence time and a type of each event determined based on the physical quantity on the display unit; The information processing device according to claim 5 .

7. The information processing device according to claim 6 , wherein the control unit further causes the display unit to display an image indicating a correspondence between the event image and an indication in the list image of the event indicated by the event image.

8. The information processing device according to claim 1 , wherein the control unit further causes the display unit to display an image indicating a temporal position of the edited video currently being displayed on the display unit.

9. A control method for an information processing device capable of communicating with a photographing device that photographs a video consisting of a plurality of frame images, comprising: a control unit of the information processing device, controlling the photographing device to photograph a fixed photographing range in accordance with a preset patrol schedule; acquiring edited video generated by editing recorded video that is video captured by the image capture device during the period from the end of the first cyclic schedule to the start of the second cyclic schedule, which is the next cyclic schedule; acquiring live video images captured by the image capture device according to the second cyclic schedule; displaying the live video and the edited video on a display unit; Including, The control unit acquiring, as the edited video, at least one of a first video in which a video of a portion in which a movement is detected in the recorded video is continuously played back, and a second video in which a portion of the recorded video corresponding to a predetermined event occurrence time detected by a detection device between the end of the first cyclic schedule and the start of the second cyclic schedule is continuously played back; acquiring information including the occurrence time and type of each of the events detected by the detection device during the period from the end of the first cyclic schedule to the start of the second cyclic schedule, and further displaying a list image on the display unit that is an image including a list display of the occurrence times and types; A method for controlling an information processing device.

10. On the computer, Controlling the image capturing device so as to capture a video consisting of a plurality of frame images within a certain image capturing range in accordance with a preset patrol schedule; acquiring edited video generated by editing recorded video that is video captured by the image capturing device during the period from the end of the first cyclic schedule to the start of the second cyclic schedule that is the next cyclic schedule; acquiring live video images captured by the image capturing device according to the second cyclic schedule; displaying the live video and the edited video on a display unit; An operation including: acquiring, as the edited video, at least one of a first video in which a video of a portion in which a movement is detected in the recorded video is continuously played back, and a second video in which a portion of the recorded video corresponding to a time when a predetermined event occurs, which is detected by a detection device between the end of the first cyclic schedule and the start of the second cyclic schedule, is continuously played back; acquiring information including the occurrence time and type of each of the events detected by the detection device during the period from the end of the first cyclic schedule to the start of the second cyclic schedule, and further displaying a list image on the display unit that is an image including a list display of the occurrence times and types; A program that performs an action including:

Images