Information processing device, communication control method, and program

Abstract

To make it possible to transmit information requested by an information processing device from a terminal device to the information processing device, even when an amount of communication per transmission of information transmitted from the terminal device fluctuates, when the information processing device and a plurality of terminal devices perform communication using wireless communication.SOLUTION: An information processing device 100 identifies a state of a target object, derives priority of information on the target object to be acquired in a next communication cycle based on the identified state of the target object, and determines order of priority of the information on the target object to be acquired in the next communication cycle based on the priority.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an information processing device, a communication control method, and a program, and is particularly suitable for use in communication between an information processing device and a plurality of terminal devices using wireless communication. [Background technology]

[0002] In a system in which an information processing device and a plurality of terminal devices communicate using wireless communication, if the information processing device and the plurality of terminal devices communicate in the same communication cycle, the information processing device may not be able to perform predetermined communication with all of the plurality of terminal devices. Therefore, Patent Document 1 discloses a technique for controlling communication between a plurality of detection devices that detect environmental information and the information processing device. In Patent Document 1, the information processing device stores in a storage unit the communication conditions of wireless communication, the number of detection devices that communicate, and the frequency at which each detection device transmits environmental information. Based on the information stored in the storage unit, the information processing device calculates the time interval at which each detection device transmits environmental information, transmits the calculated time interval to each detection device, and requests each detection device to change the time interval at which it transmits environmental information. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2017-73633 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, the technology described in Patent Document 1 is based on the premise that the communication volume of environmental information transmitted from the detection device to the information processing device per transmission is fixed. Therefore, in the technology described in Patent Document 1, if the communication volume (data volume) of information transmitted from the terminal device per transmission varies, there is a risk that the information processing device and the multiple detection devices will not be able to perform the specified communication. Thus, in the conventional technology, when the information processing device and the multiple terminal devices perform wireless communication, if the communication volume of information transmitted from the terminal devices per transmission varies, there is a risk that the terminal devices will not be able to transmit information requested by the information processing device.

[0005] The present invention has been made in consideration of the above-mentioned problems, and aims to enable information requested by an information processing device to be transmitted from a terminal device to the information processing device when the information processing device and multiple terminal devices communicate using wireless communication, even when the amount of information transmitted from the terminal device per communication varies. [Means for solving the problem]

[0006] The information processing device of the present invention is an information processing device that communicates with a plurality of terminal devices using wireless communication, and is characterized in having an acquisition means that requests the terminal device to acquire object information including information about the object and acquires the object information, an identification means that identifies the state of the object contained in the object information acquired by the acquisition means, a derivation means that derives a priority of the object information to be acquired by the acquisition means in the next communication cycle based on the state of the object identified by the identification means, and a determination means that determines the priority order of the object information to be acquired by the acquisition means in the next communication cycle based on the priority derived by the derivation means.

[0007] The communication control method of the present invention is a communication control method in an information processing device that communicates with a plurality of terminal devices using wireless communication, and is characterized in having an acquisition process that requests the terminal device to acquire object information including information about the object and acquires the object information, an identification process that identifies the state of the object contained in the object information acquired by the acquisition process, a derivation process that derives a priority of the object information to be acquired by the acquisition process in the next communication cycle based on the state of the object identified by the identification process, and a determination process that determines the priority order of the object information to be acquired by the acquisition process in the next communication cycle based on the priority derived by the derivation process.

[0008] The program of the present invention causes a computer to function as each of the means of the information processing device. Effect of the Invention

[0009] According to the present invention, when an information processing device and multiple terminal devices communicate using wireless communication, information requested by the information processing device can be transmitted from the terminal devices to the information processing device even if the amount of information transmitted from the terminal devices per communication varies. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram illustrating an example of a configuration of a wireless communication system. [Diagram 2] FIG. 2 is a diagram illustrating an example of a predetermined object. [Diagram 3] FIG. 2 is a diagram illustrating an example of a functional configuration of an information processing device. [Figure 4-1] 11 is a flowchart illustrating an example of a communication control method. [Figure 4-2] This is a flowchart continuing from Figure 4-1. [Figure 4-3] This is a flowchart continuing from Figure 4-2. [Figure 4-4] This is a flowchart continuing from Figure 4-3. [Figure 4-5]This is a flowchart continuing from Figure 4-4. [Diagram 5] FIG. 4 is a diagram illustrating an example of a configuration of an image capture time database. [Figure 6] FIG. 2 is a diagram illustrating an example of a configuration of an image history database. [Figure 7] FIG. 13 is a diagram illustrating an example of a configuration of a parameter database for deriving a residual margin. [Figure 8] FIG. 11 is a diagram for explaining an example of a method for deriving a residual margin. [Figure 9] FIG. 2 is a diagram showing an example of a configuration of a deposition database. [Figure 10] FIG. 13 shows an example of the contents of the image transmission list at the time of the processing in step S435. [Figure 11] FIG. 13 shows an example of the contents of the image transmission list at the time of the processing in step S444. [Figure 12] FIG. 13 shows an example of the contents of the image transmission list at the time of the processing in step S447. [Figure 13] FIG. 13 is a diagram showing an example of the contents of the image transmission list at the time of the processing in step S455. [Figure 14] FIG. 13 shows an example of the contents of the image transmission list at the time of the processing in step S458. [Figure 15] FIG. 13 is a diagram showing an example of the contents of the image transmission list at the time of the processing in step S435 in the case where the list includes a record whose wait flag value is "1". [Figure 16] FIG. 13 is a diagram showing an example of the contents of the image transmission list at the time of the processing in step S444 in the case where the list includes a record whose wait flag value is "1". [Figure 17] FIG. 13 is a diagram showing an example of the contents of the image transmission list at the time of the processing in step S447 in the case where the list includes a record whose wait flag value is "1". [Figure 18] FIG. 13 is a diagram showing an example of the contents of the image transmission list at the time of the processing in step S458 in the case where the list includes a record whose wait flag value is "1". DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. <Wireless communication system configuration> FIG. 1 is a diagram illustrating an example of a configuration of a wireless communication system. 1, the wireless communication system includes an information processing device 100, wireless repeaters 110a, 110b, . . . , 110n, terminal devices 120a1-120an, 120b1-120bn, . . . , 120n1-120nn, gateway devices 130a, 130b, . . . , 130n, and a wired network 140.

[0012] The terminal devices 120a1 to 120an perform wireless communication with the wireless repeater 110a. Similarly, the terminal devices 120b1 to 120bn, . . . , 120n1 to 120nn perform wireless communication with the wireless repeaters 110b, . . . , 110n, respectively. The wireless repeater 110a performs wireless communication with the gateway device 130a. Similarly, the wireless repeaters 110b, . . . , 110n perform wireless communication with the gateway devices 130b, . . . , 130n, respectively. The information processing device 100 and the gateway devices 130a, 130b, . . . , 130n are connected to each other via a wired network 140 so that they can communicate with each other. The information processing device 100 performs wired communication with the gateway devices 130a, 130b, . . . , 130n. In addition, the information processing device 100 and the gateway devices 130a, 130b, ..., 130n do not necessarily need to be connected to each other by a wired network, and may be connected to each other so that they can communicate with each other via a wireless communication network of a frequency band that has no communication time constraints.

[0013] In this embodiment, communication between the information processing device 100 and the terminal devices 120a1 to 120an, 120b1 to 120bn, . . . , 120n1 to 120nn is performed via wireless repeaters 110a, 110b, . . . , 110n and gateway devices 130a, 130b, . . . , 130n. The terminal devices 120a1-120an, 120b1-120bn, ..., 120n1-120nn acquire captured images including a specified object, and transmit imaging information including the captured images to the information processing device 100 via the wireless repeaters 110a, 110b, ..., 110n and the gateway devices 130a, 130b, ..., 130n in response to a request from the information processing device 100.

[0014] 2 is a diagram for explaining an example of a predetermined object. In this embodiment, the predetermined object is explained by taking as an example a case where the predetermined object is deposits 210a-210b (such as ore fall) that accumulate on the ground when an object being transported by a belt conveyor 200 falls from the belt conveyor 200 in a steelworks. When the deposits 210a-210b become high and come into contact with the underside of the belt of the belt conveyor 200, wear of the belt is accelerated. Therefore, it is necessary to remove the deposits 210a-210b before such a state occurs.

[0015] However, in a steelworks, many belt conveyors 200 are scattered over a wide area. Therefore, if an operator frequently checks the state of the deposits that have fallen from each belt conveyor 200 by making rounds, the workload increases significantly. In this embodiment, the information processing device 100 acquires captured images of the deposits that have fallen from each belt conveyor 200 from the terminal devices 120a1-120an, 120b1-120bn, . . . , 120n1-120nn. Then, based on the captured images of the deposits that have fallen from each belt conveyor 200, the state of the deposits is checked. Whether the state of the deposits that have fallen from each belt conveyor 200 is such that the deposits need to be removed may be determined by an operator or automatically by the information processing device 100 based on the captured images displayed on the information processing device 100. In the following description, the piles that have fallen from each belt conveyor 200 and accumulated (for example, the piles 210a to 210b shown in FIG. 2) will be referred to simply as piles as necessary.

[0016] If all communications between the information processing device 100 and the terminal devices 120a1-120an, 120b1-120bn, ..., 120n1-120nn are performed by wired communications, the workload due to laying communication cables and the like will be large. In addition, the workload and costs for reconfiguring the facilities when adding or removing terminal devices will be large. Therefore, in this embodiment, part of the communications between the information processing device 100 and the terminal devices 120a1-120an, 120b1-120bn, ..., 120n1-120nn are performed by wireless communications.

[0017] As described above, a large number of belt conveyors 200 are scattered over a wide area in a steelworks. Therefore, in this embodiment, the 920 MHz band is used as the frequency band used for wireless communication. This is because wireless communication in the 920 MHz band allows transmission with low power, has a relatively long transmission distance, and has high diffraction of radio waves. However, depending on the location of the terminal devices 120a1-120an, 120b1-120bn, ..., 120n1-120nn (belt conveyors 200), there are cases where the information processing device 100 and the terminal devices 120a1-120an, 120b1-120bn, ..., 120n1-120nn cannot directly communicate with each other even with wireless communication in the 920 MHz band. Therefore, in this embodiment, communication between the information processing device 100 and the terminal devices 120a1-120an, 120b1-120bn, ..., 120n1-120nn is performed via the wireless repeaters 110a, 110b, ..., 110n and the gateway devices 130a, 130b, ..., 130n. In this manner, communication between the information processing device 100 and the terminal devices 120a1-120an, 120b1-120bn, ..., 120n1-120nn can be reliably performed.

[0018] The wireless repeaters 110a, 110b, ..., 110n can be realized by the same device. Also, the wireless repeaters 110a, 110b, ..., 110n themselves can be realized by known wireless repeaters, so detailed explanations thereof will be omitted here. Also, the gateway devices 130a, 130b, ..., 130n can be realized by the same device. Also, the gateway devices 130a, 130b, ..., 130n themselves can be realized by known gateway devices, so detailed explanations thereof will be omitted here.

[0019] As described above, the terminal devices 120a1-120an, 120b1-120bn, ..., 120n1-120nn acquire captured images of the deposits, and transmit imaging information including the captured images to the information processing device 100 via the wireless repeaters 110a, 110b, ..., 110n and the gateway devices 130a, 130b, ..., 130n in response to a request from the information processing device 100. Note that the number of terminal devices (the number of terminal devices 120a1-120an, the number of terminal devices 120b1-120bn, ..., the number of terminal devices 120n1-120nn) that perform wireless communication with one wireless repeater may be the same or different.

[0020] In this embodiment, the terminal devices 120a1 to 120an, 120b1 to 120bn, . . . , 120n1 to 120nn each include a control device, a monitoring camera, a wireless communication device, a solar panel, and a storage battery. The power generated by the solar panels is stored in a storage battery. The control device, the surveillance camera, and the wireless communication device operate on the power stored in the storage battery. The control device has, for example, a CPU, ROM, RAM, HDD, and various interfaces, and controls the operation of the surveillance camera and wireless communication device.

[0021] The control device instructs the monitoring camera to capture an image based on an instruction from the information processing device 100. The control device may, for example, use a timer in the control device to instruct the monitoring camera to capture an image independently of an instruction from the information processing device 100 at a predetermined time. The monitoring camera automatically captures a digital still image as a captured image of the deposit based on the instruction. The imaging range of each monitoring camera includes an area below the belt conveyor 200 to be inspected that is assumed to be an area where deposits are deposited. It is assumed that the imaging range of each monitoring camera is fixed. In this embodiment, for the sake of simplicity, as shown in FIG. 2, the area below the head (area near the most upstream) of the belt conveyor 200 (area where deposits 210a are deposited) and the area below the tail (area near the most downstream) of the belt conveyor 200 (area where deposits 210b are deposited) are assumed to be areas where deposits are deposited. However, areas below other areas of the belt conveyor 200 may also be areas where deposits are expected to accumulate.

[0022] In this embodiment, an example will be described in which an image is captured by a surveillance camera once every hour during a time period preset in the control device (a time period from the start time to the end time of the imaging time database 500 described later). Although capturing still images is preferable because it reduces data volume and power consumption, the images captured by the surveillance camera are not limited to still images and may be moving images. The terminal devices 120a1 to 120an, 120b1 to 120bn, . . . , 120n1 to 120nn can be realized by the same device.

[0023] The control device stores the captured image captured by the surveillance camera in a storage medium. At this time, the control device stores in the storage medium, together with the captured image, information including information (camera ID) that uniquely identifies the surveillance camera (terminal device) that captured the captured image, information that identifies the capture date and time, image size, and resolution as attribute information of the captured image. In this way, the imaging information includes the captured image and attribute information of the captured image. Note that the resolution is preset for the surveillance camera.

[0024] As described above, in this embodiment, the 920 MHz band is used as the frequency band for wireless communication. In wireless communication in the 920 MHz band, the communication time per hour for one device is limited to 360 seconds. Therefore, for example, the wireless repeater 110a can communicate with the gateway device 130a for up to 360 seconds per hour. Similarly, the wireless repeaters 110b, . . . , 110n can communicate with the gateway devices 130b, . . . , 130n for up to 360 seconds per hour.

[0025] In this manner, in this embodiment, the communication time per predetermined time period of the wireless repeaters 110a, 110b, . . . , 110n, the terminal devices 120a1-120an, 120b1-120bn, . . . , 120n1-120nn, and the gateway devices 130a, 130b, . . . , 130n is predefined. In such a case, the information processing device 100 may not be able to acquire the imaging information acquired by all the terminal devices 120a1-120an, 120b1-120bn, . . . , 120n1-120nn. In that case, the information processing device 100 may not be able to acquire the imaging information of the deposit in a state in which removal is required. Therefore, in this embodiment, in order to prevent the information processing device 100 from being unable to acquire the imaging information of the deposit in a state in which removal is required, the information processing device 100 is configured as follows.

[0026] <Configuration of information processing device 100> Fig. 3 is a diagram showing an example of a functional configuration of the information processing device 100. Figs. 4-1 to 4-5 are flowcharts explaining an example of a communication control method performed using the information processing device 100. An example of the functions of the information processing device 100 will be described with reference to the flowcharts of Figs. 4-1 to 4-5. The hardware of the information processing device 100 is realized by using, for example, a device having a CPU, a ROM, a RAM, an HDD, and various hardware, or dedicated hardware.

[0027] <<Processing when there are no records with the wait flag value "1">> The information processing device 100 performs the following process each time a communication cycle arrives. First, an example of the process of the information processing device 100 will be described when imaging information to be acquired from a terminal device is not yet acquired (when there is no record with a standby flag value of "1" to be described later) at the time when a communication cycle arrives. In step S411 in Fig. 4-1, the acquisition unit 301 waits until a predetermined timing according to the communication cycle occurs. In this embodiment, the communication cycle is one hour, and the predetermined timing is every hour. Therefore, the process according to the flowcharts in Figs. 4-1 to 4-5 is executed every hour.

[0028] Next, in step S412, the acquisition unit 301 acquires the current time. Next, in step S413, the acquisition unit 301 determines whether the current time is within the range of the imaging time. In this embodiment, an example will be described in which the imaging time range is set in advance for each of the terminal devices 120a1-120an, 120b1-120bn, ..., 120n1-120nn (for each monitoring camera).

[0029] 5 is a diagram showing an example of the configuration of the image capture time database 500. The image capture time database 500 stores the range of image capture times for each monitoring camera (each terminal device). In FIG. 5, the camera ID is information (ID) that uniquely identifies a surveillance camera (terminal device). The imaging area is information that indicates the imaging area of ​​the surveillance camera identified by the camera ID. "No.1BC Head" indicates that the imaging area is the area below the head of the belt conveyor numbered No.1. "No.1BC Tail" indicates that the imaging area is the area below the tail of the belt conveyor numbered No.1. The start time indicates the start time of the imaging time range. The end time indicates the end time of the imaging time range. The imaging time database 500 is created before the flowcharts of FIGS. 4-1 to 4-5 start.

[0030] If it is determined in step S413 that there is no surveillance camera whose current time falls within the range of the imaging time, the process proceeds to step S417, which will be described later. On the other hand, if there is a surveillance camera whose current time falls within the range of the imaging time, the process proceeds to step S414. When the process proceeds to step S414, the acquisition unit 301 requests a terminal device that generates imaging information determined to be acquired by the next cycle determination unit 305 described later to acquire the imaging information. The terminal device that receives the request to acquire imaging information transmits the imaging information to the information processing device 100. The imaging information transmitted from the terminal device is received by the information processing device 100 via the wireless repeater 110a, 110b, . . . or 110n that wirelessly communicates with the terminal device, the gateway device 130a, 130b, . . . or 130n that wirelessly communicates with the wireless repeater, and the wired network 140. The imaging information requested to be acquired in step S414 (imaging information determined to be acquired by the next cycle determination unit 305) will be described later with reference to the flowchart of FIG. 4-5.

[0031] Next, in step S415, the acquisition unit 301 acquires the imaging information transmitted from the terminal device. As described above, the imaging information includes a captured image and attribute information of the captured image (such as information specifying a camera ID, a capture date and time, an image size, and a resolution). Next, in step S416, the acquisition unit 301 stores the attribute information of the captured image included in the imaging information acquired in step S415 in the image history database. Then, the process proceeds to step S421 in FIG.

[0032] FIG. 6 is a diagram showing an example of the configuration of the image history database 600. As shown in FIG. In FIG. 6, an image history database 600 is created for each camera ID (surveillance camera). The image history database 600 stores the camera ID, image capture date and time, resolution, sunlight conditions, and image size in association with each other. The sunlight conditions are the sunlight conditions at the installation location of the camera ID (surveillance camera) at the image capture date and time. The sunlight conditions can be acquired, for example, from a weather information website. The sunlight conditions may be expressed, for example, in hours of sunlight per hour. The sunlight conditions may also be included in the imaging information. The resolution may also be expressed, for example, in the number of pixels.

[0033] As described above, if the result of the determination in step S413 is that there is no surveillance camera whose current time falls within the range of the imaging time, the process proceeds to step S417. When the process proceeds to step S417, the acquisition unit 301 determines whether or not there is any unacquired imaging information among the imaging information determined to be acquired by the next cycle determination unit 305 described later. If the result of this determination is that there is no unacquired imaging information among the imaging information determined to be acquired by the next cycle determination unit 305 described later, the process proceeds to step S421 in FIG. 4-2 without performing the processes in steps S414 to S416. This is to prepare for a case where the process in step S421 and subsequent steps in FIG. 4-2 has not been performed on the imaging information acquired in step S415 of the past communication cycle due to, for example, an unintended shutdown of the information processing device 100.

[0034] On the other hand, if there is any unacquired imaging information among the imaging information determined to be acquired by the next cycle determination unit 305 described later, the process proceeds to the above-mentioned step S414. Then, after the processes of steps S414 to S416 are executed as described above, the process proceeds to step S421 in FIG. 4-2. When the process proceeds to step S421, the state identifying unit 302 selects one piece of imaging information that has not been selected in the process of the flowchart in FIG. 4-2, from among the imaging information acquired in step S415 in FIG. 4-1. Next, in step S422, the state identifying section 302 acquires the camera ID included in the imaging information selected in step S421.

[0035] Next, in step S423, the state specifying unit 302 acquires color information of the deposition start point from the captured image included in the imaging information selected in step S421. Fig. 7 is a diagram showing an example of the configuration of a parameter database 700 for deriving a residual margin. Fig. 8 is a diagram explaining an example of a method for deriving a residual margin. In FIG. 7, a residual margin deriving parameter database 700 stores a camera ID and a deposition start point and a limit position, which are residual margin deriving parameters, in association with each other. In this embodiment, the imaging area is imaged by each monitoring camera to obtain the image in advance, and the deposition start point and limit position set for the obtained image are stored in the residual margin derivation parameter database 700 before the flowcharts of Figures 4-1 to 4-5 start.

[0036] For example, assume that a captured image 800 as shown in FIG. 8 has been acquired. The operator sets the position where deposition of deposits (mineral fall) begins in the captured image 800 as a deposition start point 810. The operator also sets the left end position 821 and the right end position 822 as limit positions in the captured image 800. When the deposits have reached a virtual line 830 connecting the left end position 821 and the right end position 822, it is deemed that the state of the deposits is such that removal of the deposits is required. In FIG. 7, for example, for an image captured by a surveillance camera with a camera ID of "001", the operator sets xy coordinates (x b1 ,y b1 ) is set, and the x and y coordinates (x ul1 ,y ul1 ) is set, and the x and y coordinates (xur1 ,y ur1 ) is set.

[0037] As described above, in this embodiment, in step S423, the state identifying unit 302 acquires the x and y coordinates of the deposition start point corresponding to the camera ID included in the imaging information selected in step S421 from the residual margin derivation parameter database 700. The state identifying unit 302 acquires color information of the deposition start point (the x and y coordinates) from the captured image included in the imaging information selected in step S421.

[0038] Next, in step S424, the condition specifying unit 302 derives the shape of the deposit based on the color information of the deposition start point acquired in step S423 and color information of its surroundings in the captured image included in the imaging information selected in step S421. The condition specifying unit 302 recognizes, for example, a closed region including the deposition start point acquired in step S423, which is made up of pixels having a value indicated by color information whose difference from the value indicated by the color information of the deposition start point is within a predetermined range, as a deposit, and derives the contour of the deposit as the shape of the deposit.

[0039] Next, in step S425, the state identification unit 302 derives the height of the deposit from the shape of the deposit derived in step S424. In this embodiment, the height of the deposit is a value obtained by subtracting the y coordinate of the deposit start point from the maximum value of the y coordinate indicating the shape of the deposit derived in step S424.

[0040] Next, in step S426, the condition identifying unit 302 acquires the x and y coordinates of the left and right end positions of the limit position corresponding to the camera ID included in the imaging information selected in step S421 from the residual margin deriving parameter database 700. The condition identifying unit 302 derives the residual margin based on the height of the deposit derived in step S425 and the (x and y coordinates of) the left and right end positions of the limit position acquired from the residual margin deriving parameter database 700. The residual margin is expressed as a percentage by dividing the height from the deposit to the limit position by the height of the limit position. In this embodiment, the height from the deposit to the limit position and the height of the limit position are expressed as follows:

[0041] In FIG. 8, position 840 is assumed to be the position where the y coordinate indicating the shape of the deposit derived in step S424 is the maximum value. The height h2 of the limit position is determined by subtracting the y coordinate of the deposition start point 810 from the y coordinate (y coordinate of position 850) that is paired with the x coordinate of position 840 (the x coordinate that is paired with the maximum value of the y coordinate indicating the shape of the deposit derived in step S424) of the virtual line 830 connecting the left end position 821 and the right end position 822 of the limit position. Also, as described above, the height h1 of the deposit is determined by subtracting the y coordinate of the deposition start point 810 from the maximum value of the y coordinate indicating the shape of the deposit derived in step S424 (y coordinate of position 840). The height from the deposit to the limit position is the value obtained by subtracting the height h1 of the deposit from the height h2 of the limit position. Therefore, the residual margin is expressed as (h2-h1)÷h2×100. As described above, in step S426, the condition specifying unit 302 derives the remaining margin for the deposit shown in the captured image included in the imaging information selected in step S421.

[0042] Next, in step S427, the state specifying unit 302 stores information indicating the remaining margin derived in step S426 in the deposition database. FIG. 9 is a diagram showing an example of the configuration of the deposition database 900. As shown in FIG. In FIG. 9, the accumulation database 900 stores a camera ID, a residual margin, and an imaging time of a captured image from which the residual margin is derived, in association with each other. In the example shown in FIG. 9, the current value indicates the latest residual margin, and the time shown next to the current value indicates the imaging time of the captured image from which the residual margin is derived. The previous value indicates the residual margin one time before (derived in step S426), and the time shown next to the previous value indicates the imaging time of the captured image from which the residual margin is derived. The value before last indicates the residual margin two times before (derived in step S426), and the time shown next to the value before last indicates the imaging time of the captured image from which the residual margin is derived. In this way, the accumulation database 900 stores three residual margin histories for each camera ID.

[0043] Next, in step S428, the state identification unit 302 judges whether or not there is any imaging information that has not been selected in the process of the flowchart in FIG. 4-2 among the imaging information acquired in step S415 in FIG. 4-1. If it is determined that there is any imaging information that has not been selected in the process of the flowchart in FIG. 4-2 among the imaging information acquired in step S415 in FIG. 4-1, the process returns to step S421. Then, the processes of steps S421 to S428 are repeatedly executed until there is no imaging information that has not been selected in the process of the flowchart in FIG. 4-2 among the imaging information acquired in step S415 in FIG. 4-1. When there is no imaging information that has not been subjected to the process of the flowchart in FIG. 4-2 among the imaging information acquired in step S415 in FIG. 4-1 as described above, the process proceeds to step S431 in FIG. 4-3.

[0044] When the process proceeds to step S431, the priority derivation unit 303 selects one piece of imaging information that has not been selected in the process of the flowchart in FIG. 4-3, from the imaging information acquired in step S415 in FIG. 4-1. Next, in step S432, the priority derivation unit 303 determines whether it is possible to derive the deposition rate for the deposit shown in the captured image included in the imaging information selected in step S431 based on the deposition database 900. The deposition rate is the amount of change in the remaining margin per unit time (1 hour). In this embodiment, the deposition rate is calculated by subtracting the current value of the remaining margin from the most recent past value of the remaining margin, and dividing the result by the time (in hours) from the imaging time of the captured image from which the most recent past value of the remaining margin is derived to the imaging time of the captured image from which the current value of the remaining margin is derived. For example, in FIG. 9, the deposition rate for the deposit shown in the captured image captured by the monitoring camera with the camera ID "001" is derived as follows. The current value of the remaining margin is 40%. The most recent past value of the remaining margin is 45% of the previous value. The imaging time of the captured image from which the current value of the remaining margin is derived is 15:00. The capture time of the captured image from which the most recent past value of the remaining margin is derived is 14:00. The time from the capture time of the captured image from which the most recent past value of the remaining margin is derived to the capture time of the captured image from which the current value of the remaining margin is derived is 1 hour. Therefore, the accumulation rate is (45-40)÷1=5% / hr.

[0045] As described above, the deposition database 900 stores the history of the remaining margin for three times. Therefore, for example, if only the current value is stored in the deposition database 900, there is no past remaining margin, and the priority derivation unit 303 cannot derive the deposition rate. Therefore, in step S432, the priority derivation unit 303 determines, based on the deposition database 900, whether or not it is possible to derive the deposition rate for the deposit shown in the captured image included in the imaging information selected in step S431.

[0046] If it is determined in step S432 that it is not possible to derive the deposition rate for the deposit shown in the captured image included in the imaging information selected in step S431, steps S433 to S435 are omitted and the process proceeds to step S436, which will be described later. On the other hand, if it is possible to derive the deposition rate for the deposit shown in the captured image included in the imaging information selected in step S431, the process proceeds to step S433. When the process proceeds to step S433, the priority derivation unit 303 derives the deposition rate for the deposit shown in the captured image included in the imaging information selected in step S431.

[0047] Next, in step S434, the priority derivation unit 303 derives the accumulation limit time for the deposit shown in the captured image included in the imaging information selected in step S431. The accumulation limit time is the (approximate) time required for the deposit to reach the limit position. In this embodiment, the accumulation limit time is the current value of the remaining margin for the deposit shown in the captured image included in the imaging information selected in step S431 divided by the accumulation rate for the deposit. For example, in FIG. 9, the remaining margin for the deposit shown in the captured image captured by the surveillance camera with the camera ID "001" is 40%, and the accumulation rate is 5% / hr. Therefore, the accumulation limit time for the deposit shown in the captured image captured by the surveillance camera with the camera ID "001" is 8 (=40÷5) hours.

[0048] Next, in step S435, the priority derivation unit 303 stores in the image transmission list the camera ID included in the imaging information selected in step S431, the imaging area of ​​the surveillance camera identified by the camera ID, the remaining margin for the deposit shown in the imaging image included in the imaging information, the imaging time of the imaging image (the time of the current communication cycle), the accumulation rate derived from the remaining margin, and the accumulation limit time derived from the remaining margin and the accumulation rate. Note that in this embodiment, for simplicity of explanation, it is assumed that the imaging time of the imaging image and the time of the communication cycle are synchronized. FIG. 10 is a diagram showing an example of the contents of the image transmission list 1000 at the time of the processing in step S435. 10, an image transmission list 1000 is created for each wireless repeater. The repeater ID is information (ID) that uniquely identifies the wireless repeater. The important facility flag is a flag that is set to "1" in the record corresponding to the camera ID if the imaging area of ​​the surveillance camera identified by the camera ID is a particularly important area, and is set to "0" in the record corresponding to the camera ID if the imaging area is not an important area. The important facility flag is set before the flowcharts of FIGS. 4-1 to 4-5 start, for example, based on an operator's operation on the user interface of the information processing device 100.

[0049] The standby flag is a flag that is set to "1" for records corresponding to imaging information that was not determined to be acquired by the next cycle determination unit 305 described later in a past communication cycle, and is set to "0" for records corresponding to captured images included in imaging information that has not yet been processed (processing according to the flowchart in Fig. 4-5) by the next cycle determination unit 305 and the comparison unit 306 described later. In Fig. 10, the value of the standby flag is "0" because the processing according to the flowchart in Fig. 4-5 has not yet been performed for the captured image (imaging information) captured at 15:00. In addition, since the expected size and expected communication time are derived by the communication time prediction unit 304 (processing in steps S441 to S445 in the flowchart in FIG. 4-4), which will be described later, they are not derived at the end of the flowchart in FIG. 4-3. For this reason, the columns for expected size and expected communication time are blank in FIG. 10.

[0050] When the storage in the image transmission list 1000 is completed in step S435 as described above, the process proceeds to step S436. When the process proceeds to step S436, the priority derivation unit 303 judges whether or not there is any imaging information that has not been selected in the process of the flowchart in FIG. 4-3 among the imaging information acquired in step S415 in FIG. 4-1. If the result of this judgment is that there is any imaging information that has not been selected in the process of the flowchart in FIG. 4-3 among the imaging information acquired in step S415 in FIG. 4-1, the process returns to step S431. Then, the processes of steps S431 to S436 are repeatedly executed until there is no imaging information that has not been selected in the process of the flowchart in FIG. 4-3 among the imaging information acquired in step S415 in FIG. 4-1 as described above. When there is no imaging information that has not been subjected to the process of the flowchart in FIG. 4-3 among the imaging information acquired in step S415 in FIG. 4-1 as described above, the process proceeds to step S441 in FIG. 4-4.

[0051] When the process proceeds to step S441, the communication time prediction unit 304 selects one piece of imaging information that has not been selected in the process of the flowchart in FIG. 4-4, from the imaging information acquired in step S415 in FIG. 4-1. Next, in step S442, the communication time prediction unit 304 derives the size of the imaging information selected in step S441. In the following description, the size of the imaging information derived in the process of step S442 will be referred to as the predicted size as necessary. In this embodiment, the communication time prediction unit 304 selects a record from the image history database 600 corresponding to the camera ID included in the imaging information selected in step S441 that is closest to the time of imaging date and time included in the imaging information and the sunlight conditions at the imaging date and time. As described above, the sunlight conditions at the imaging date and time may be obtained from a weather information website or may be included in the attribute information of the imaging information.

[0052] Then, communication time prediction unit 304 derives the size (estimated size) of the imaging information selected in step S441 based on the image size in the record selected from image history database 600 corresponding to the camera ID included in the imaging information selected in step S441. For example, communication time prediction unit 304 derives as the estimated size a value obtained by adding a preset value to the image size in the record selected from image history database 600 corresponding to the camera ID included in the imaging information selected in step S441.

[0053] Next, in step S443, the communication time prediction unit 304 derives the communication time of the imaging information selected in step S441 based on the predicted size and communication speed derived in step S442. In the following description, the communication time of the imaging information derived in the process of step S443 will be referred to as the predicted communication time as necessary. In this embodiment, the communication speed is assumed to be determined in advance. Therefore, the communication time prediction unit 304 derives the value obtained by dividing the predicted size derived in step S442 by the communication speed as the predicted communication time.

[0054] Next, in step S444, the communication time prediction section 304 stores the predicted size and predicted communication time for the imaging information selected in step S441 in the record corresponding to that imaging information in the image transmission list. Fig. 11 is a diagram showing an example of the contents of the image transmission list 1100 at the time of the processing of step S444. In the image transmission lists shown in Fig. 11 to Fig. 14, it is assumed that the time of the current communication cycle is 15:00 and the time of the next communication cycle is 16:00.

[0055] An image transmission list 1100 shown in Fig. 11 is obtained by storing (adding) an expected size and an expected communication time to the image transmission list 1000 shown in Fig. 10. Note that in the record of the camera ID "004" in the image transmission list 1100 shown in Fig. 11, "25kb or 200kb" is shown as the expected size and "20s or 160s" is shown as the expected communication time in order to select and explain one of two cases, where the expected size and expected communication time are 25kb and 20 seconds, and where the expected size and expected communication time are 200kb and 160 seconds, in the explanation that follows. In reality, one value is stored in each of the fields for expected size and expected communication time.

[0056] Next, in step S445, the communication time prediction unit 304 judges whether or not there is any imaging information that has not been selected in the process of the flowchart in FIG. 4-4 among the imaging information acquired in step S415 in FIG. 4-1. If there is any imaging information that has not been selected in the process of the flowchart in FIG. 4-4 among the imaging information acquired in step S415 in FIG. 4-1 as a result of this judgment, the process returns to step S441. Then, the processes of steps S441 to S445 are repeatedly executed until there is no imaging information that has not been selected in the process of the flowchart in FIG. 4-4 among the imaging information acquired in step S415 in FIG. 4-1 as described above. When there is no imaging information that has not been subjected to the process of the flowchart in FIG. 4-4 among the imaging information acquired in step S415 in FIG. 4-1 as described above, the process proceeds to step S446.

[0057] When the process proceeds to step S446, the next period determination unit 305 selects one of the wireless repeaters 110a, 110b, . . . , 110n having a repeater ID that has not been selected in the process of the flowchart in FIG. 4-4. Next, in step S447, the next cycle determination unit 305 sorts the records of the image transmission list for the repeater ID selected in step S446, in which the estimated size and estimated communication time have been stored in the processing of step S444, according to predetermined rules based on the values ​​of the accumulation limit time, important equipment flag, and standby flag.

[0058] In this embodiment, when the values ​​of the important equipment flag and the standby flag are all "0", the records in the image transmission list are sorted so that the record with the shorter accumulation limit time is ranked higher. Also, when there is a record with the important equipment flag set to "1", that record is ranked higher regardless of the values ​​of the accumulation limit time and standby flag. When there are multiple records with the important equipment flag set to "1", for example, the record with the shorter accumulation limit time is ranked higher. As mentioned above, the description here is given assuming that the values ​​of the standby flag are all "0".

[0059] Fig. 12 is a diagram showing an example of the contents of the image transmission list 1100 at the time of the processing of step S447. The image transmission list 1200 shown in Fig. 12 is obtained by sorting the records of the image transmission list 1100 shown in Fig. 11 according to a predetermined rule based on the values ​​of the accumulation limit time, the important equipment flag, and the standby flag. When the records of the image transmission list 1100 shown in FIG. 11 are sorted in order from shortest accumulation limit time, the order is the record with camera ID "003", the record with camera ID "001", the record with camera ID "002", and the record with camera ID "004". However, the value of the important equipment flag of the record with camera ID "001" is "1". Therefore, the records of the image transmission list 1100 shown in FIG. 11 are sorted in the order of the record with camera ID "001", the record with camera ID "003", the record with camera ID "002", and the record with camera ID "004". As a result, the image transmission list 1200 shown in FIG. 12 is obtained from the image transmission list 1100 shown in FIG. 11.

[0060] Next, in step S448, the next period determination unit 305 determines whether or not there is a repeater ID of a wireless repeater that has not been selected in the processing of the flowchart of FIG. 4-4 among the wireless repeaters 110a, 110b, . . . , 110n. If the result of this determination is that there is a repeater ID of a wireless repeater that has not been selected in the processing of the flowchart of FIG. 4-4 among the wireless repeaters 110a, 110b, . . . , 110n, the processing returns to step S446. Then, the processing of steps S446 to S448 is repeatedly executed until there is no repeater ID of a wireless repeater that has not been selected in the processing of the flowchart of FIG. 4-4 among the wireless repeaters 110a, 110b, . . . , 110n. When there is no repeater ID of a wireless repeater that has not been selected in the processing of the flowchart of FIG. 4-4 among the wireless repeaters 110a, 110b, . . . , 110n, the processing proceeds to step S451 in FIG. 4-5.

[0061] When the process proceeds to step S451, the comparison unit 306 selects one of the wireless repeaters 110a, 110b, . . . , 110n having a repeater ID that has not been selected in the process of the flowchart in FIG. 4-5. Next, in step S452, the comparison unit 306 derives the sum of the estimated communication times of the records having the wait flag value of "0" in the image transmission list of the repeater ID selected in step S451, the records being sorted in step S447 of FIG. 4-4. In the image transmission list 1200 of FIG. 12, if the estimated communication time of the camera ID "004" is 20 seconds, the sum of the estimated communication times of the records having the wait flag value of "0" in the image transmission list 1200 is 260 seconds. Also, in the image transmission list 1200 of FIG. 12, if the estimated communication time of the camera ID "004" is 160 seconds, the sum of the estimated communication times of the records having the wait flag value of "0" in the image transmission list 1200 is 400 seconds.

[0062] Next, in step S453, the comparison unit 306 determines whether the sum of the expected communication times of the records in the image transmission list selected in step S451 whose standby flags have a value of "0" is less than 360 seconds. As described above, in wireless communication in the 920 MHz band, which is the frequency band used for wireless communication in this embodiment, the communication time per hour in one device is limited to 360 seconds. Therefore, if the communication time in one wireless repeater exceeds 360 seconds, the communication is not completed in that wireless repeater. For this reason, the determination in step S453 is performed.

[0063] In addition, one gateway device 130a, 130b, ..., 130n is communicably connected to one wireless repeater 110a, 110b, ..., 110n, and multiple terminal devices 120a1-120an, 120b1-120bn, ..., 120n1-120nn are communicably connected to one wireless repeater 110a, 110b, ..., 110n. Therefore, if the communication time in the wireless repeaters 110a, 110b, ..., 110n does not exceed 360 seconds, the communication time in the terminal devices 120a1-120an, 120b1-120bn, ..., 120n1-120nn and the gateway devices 130a, 130b, ..., 130n does not exceed 360 seconds.

[0064] In step S453, the comparison unit 306 may determine whether the sum of the predicted communication times of the records in the image transmission list whose standby flags have a value of "0" is 360 seconds or less. In the determination in step S453, instead of 360 seconds, which is an example of the predetermined value, a time obtained by adding a predetermined time to 360 seconds may be used as the predetermined value.

[0065] If it is determined in step S453 that the sum of the estimated communication times of the records in the image transmission list selected in step S451 whose standby flags have a value of "0" is not less than 360 seconds, the process proceeds to step S457, which will be described later. On the other hand, if the sum of the estimated communication times of the records in the image transmission list selected in step S451 whose standby flags have a value of "0" is less than 360 seconds, the process proceeds to step S454. In the image transmission list 1200 of FIG. 12, if the estimated communication time of the camera ID "004" is 20 seconds, the sum of the estimated communication times of the records in the image transmission list 1200 whose standby flags have a value of "0" is 260 seconds, so the process proceeds to step S454. On the other hand, in the image transmission list 1200 of FIG. 12, if the estimated communication time of the camera ID "004" is 160 seconds, the sum of the estimated communication times of the records in the image transmission list 1200 whose standby flags have a value of "0" is 400 seconds, so the process proceeds to step S457, which will be described later.

[0066] When the process proceeds to step S454, the next cycle determination unit 305 determines imaging information to be acquired by the acquisition unit 301 in the next communication cycle from the wireless repeater specified by the repeater ID selected in step S451. In the process of step S454, the next cycle determination unit 305 determines all imaging information corresponding to the record in which the standby flag value in the image transmission list selected in step S451 is "0" and which is to be acquired in the next communication cycle, as imaging information to be acquired by the acquisition unit 301 in the next communication cycle. In the image transmission list 1200 shown in Fig. 12, when the expected communication time of the camera ID "004" is 20 seconds, imaging information including images captured by the surveillance cameras with the camera IDs "001", "002", "003", and "004" in the next communication cycle is determined as imaging information to be acquired by the acquisition unit 301 in the next communication cycle from the wireless repeater with the repeater ID "001". As described above, the time of the current communication cycle is 15:00 in the image transmission list 1200. A record in the image transmission list 1200 with the time "15:00" means a record related to imaging information to be acquired at 16:00, which is the time of the next communication cycle.

[0067] Next, in step S455, the next cycle determination unit 305 updates the image transmission list of the repeater ID selected in step S451. In the process of step S455, the next cycle determination unit 305 deletes the record corresponding to the imaging information determined in step S454. Fig. 13 is a diagram showing an example of the contents of the image transmission list 1300 at the time of the processing of step S455. As described above, in the image transmission list 1200 shown in Fig. 12, imaging information including images captured in the current communication cycle by the surveillance cameras with camera IDs "001", "002", "003", and "004" is determined as imaging information to be acquired by the acquisition unit 301 in the next communication cycle. Therefore, as in the image transmission list 1300 shown in Fig. 13, records corresponding to these imaging information (all records) are deleted.

[0068] Next, in step S456, the next period determination unit 305 judges whether or not there is a repeater ID of a wireless repeater that has not been selected in the processing of the flowchart of FIG. 4-5 among the wireless repeaters 110a, 110b, . . . , 110n. If there is a repeater ID of a wireless repeater that has not been selected in the processing of the flowchart of FIG. 4-5 among the wireless repeaters 110a, 110b, . . . , 110n as a result of this judgment, the processing returns to step S451. Then, the processing of steps S451 to S458 is repeatedly executed until there is no repeater ID of a wireless repeater that has not been selected in the processing of the flowchart of FIG. 4-5 among the wireless repeaters 110a, 110b, . . . , 110n. When there is no repeater ID of a wireless repeater that has not been selected in the processing of the flowchart of FIG. 4-5 among the wireless repeaters 110a, 110b, . . . , 110n as described above, the processing according to the flowcharts of FIG. 4-1 to FIG. 4-5 is terminated.

[0069] As described above, if it is determined in step S453 that the sum of the estimated communication times of the records in the image transmission list selected in step S451 whose wait flags have a value of "0" is not less than 360 seconds, the process proceeds to step S457. When the process proceeds to step S457, the next cycle determination unit 305 determines imaging information to be acquired by the acquisition unit 301 in the next communication cycle from the wireless repeater identified by the repeater ID selected in step S451. In the process of step S457, the next cycle determination unit 305 selects records from the image transmission list selected in step S451 in ascending order so that the sum of the estimated communication times is less than 360 seconds, and determines the imaging information corresponding to the selected record as the imaging information to be acquired by the acquisition unit 301 in the next communication cycle. 12, when the expected communication time for the camera ID "004" is 160 seconds, imaging information including captured images captured by the surveillance cameras with camera IDs "001", "002", and "003" in the next communication cycle is determined as imaging information to be acquired by the acquisition unit 301 in the next communication cycle from the wireless repeater with repeater ID "001". In this case, imaging information including captured images captured by the surveillance camera with camera ID "004" in the next communication cycle is not determined as imaging information to be acquired by the acquisition unit 301 in the next communication cycle.

[0070] Next, in step S458, the next cycle determination unit 305 updates the image transmission list for the repeater ID selected in step S451. In the process of step S458, the next cycle determination unit 305 deletes the records corresponding to the imaging information determined in step S457, and changes the value of the standby flag of the records corresponding to the imaging information not determined in step S457, whose standby flag value is "0", to "1".

[0071] Fig. 14 is a diagram showing an example of the contents of the image transmission list 1400 at the time of the process of step S458. As described above, in the image transmission list 1200 shown in Fig. 12, imaging information including captured images captured in the next communication cycle by the monitoring cameras with camera IDs "001", "002", and "003" is determined as imaging information to be acquired by the acquisition unit 301 in the next communication cycle. Therefore, as shown in the image transmission list 1400 shown in Fig. 14, all records corresponding to these imaging information are deleted. On the other hand, imaging information including captured images captured in the next communication cycle by the monitoring camera with camera ID "004" is not determined as imaging information to be acquired by the acquisition unit 301 in the next communication cycle. Therefore, as shown in the image transmission list 1400 shown in Fig. 14, the record corresponding to the imaging information is not deleted, and the value of the standby flag of the record is changed to "1". The process then proceeds to step S456 described above.

[0072] Incidentally, when the flowchart of FIG. 4-1 is executed for the first time, before the flowchart of FIG. 4-1 starts, if the imaging information to be acquired by the acquisition unit 301 in the next communication cycle has not been determined by the next cycle determination unit 305, the imaging information can be acquired, for example, as follows. First, the communication time prediction unit 304 derives the predicted size and predicted communication time for each camera ID. Then, the next cycle determination unit 305 selects the terminal device according to a predetermined rule (for example, so that the number of selected terminal devices is as large as possible) so that the sum of predicted communication times of the terminal devices performing wireless communication with a wireless repeater identified by one repeater ID becomes as large as possible within a range of less than 360 seconds. Then, the next cycle determination unit 305 determines the imaging information acquired by the selected terminal device (monitoring camera) in the next communication cycle as the imaging information to be acquired by the acquisition unit 301 in the next communication cycle. In addition, at this time, the next cycle determination unit 305 may preferentially determine that the imaging information acquired in the next communication cycle by the surveillance camera identified by the camera ID whose important equipment flag value is "1" is to be the imaging information to be acquired by the acquisition unit 301 in the next communication cycle.

[0073] Alternatively, instead of doing as described above, the next cycle determination unit 305 may determine that the imaging information to be acquired in the next communication cycle by a terminal device (surveillance camera) preset in the information processing device 100 is the imaging information to be acquired by the acquisition unit 301 in the next communication cycle. If the imaging information to be acquired by the acquisition unit 301 in the next communication cycle has not been determined by the next cycle determination unit 305 before the flowchart of Figure 4-1 starts, the imaging information to be acquired by the acquisition unit 301 in the next communication cycle is determined as described above, and then the processing according to the flowchart of Figure 4-1 is executed. The above is an example of the process when a record with a wait flag value of "1" does not exist in the image transmission list.

[0074] <<Processing when a record with the wait flag value "1" exists>> If a record with a standby flag value of "1" exists, in the next communication cycle, the record with the standby flag value of "1" remains in the image transmission list. In this case, in step S435, the priority derivation unit 303 stores, in a record above the record with the standby flag value of "1", the camera ID included in the imaging information selected in step S431, the imaging area of ​​the monitoring camera specified by the camera ID, the remaining margin for the deposit shown in the captured image included in the imaging information, the imaging time of the captured image (the time of the current communication cycle), the deposition rate derived from the remaining margin, and the deposition limit time derived from the remaining margin and the deposition rate.

[0075] Furthermore, imaging information is not acquired in the next communication cycle from a terminal device having a surveillance camera identified by the camera ID of a record in which the value of the standby flag is "1". Therefore, the remaining margin, accumulation rate, and accumulation limit time are not derived for the camera ID of a record in which the value of the standby flag is "1". Therefore, in this embodiment, the priority derivation unit 303 stores, as a record for the camera ID of a record in which the value of the standby flag is "1", a record in which the camera ID, the imaging area of ​​the surveillance camera identified by the camera ID, and the time of the current communication cycle are set, in a record higher than the record in which the value of the standby flag is "1".

[0076] FIG. 15 is a diagram showing an example of the contents of the image transmission list 1500 at the time of the process of step S435 in the case where the image transmission list 1500 includes a record with a standby flag value of "1". In the image transmission lists shown in FIGS. 15 to 18, the time of the current communication cycle is assumed to be 16:00. As shown in FIG. 15, in step S435, a record including a remaining margin derived from imaging information including an image captured by a monitoring camera in the current communication cycle, an accumulation rate derived from the remaining margin, and an accumulation limit time derived from the remaining margin and the accumulation rate is stored as a record in the current communication cycle with camera IDs of "001", "002", and "003". In addition, a record not including a remaining margin, an accumulation rate, and an accumulation limit time is stored as a record in the current communication cycle with camera ID "004" as a record in the current communication cycle with camera ID "004".

[0077] Then, in step S444, the communication time prediction unit 304 stores the predicted size and predicted communication time for the imaging information selected in step S441 in the record corresponding to the imaging information in the image transmission list. Fig. 16 is a diagram showing an example of the contents of the image transmission list 1600 at the time of the processing of step S444 when the list includes a record whose wait flag value is "1". The predicted size and predicted communication time can be derived using information in the image history database 600 without using the remaining margin, accumulation rate, and accumulation limit time. Therefore, in the image transmission list 1600 shown in Fig. 16, the predicted size and predicted communication time are also stored for the record in the current communication cycle whose camera ID is "004".

[0078] Fig. 17 is a diagram showing an example of the contents of the image transmission list 1700 at the time of the processing of step S447 when the list includes a record whose standby flag value is "1". As described above, when there is a record whose important equipment flag is "1", that record is made a higher-ranked record regardless of the accumulation limit time and standby flag values. Therefore, in step S447, the next cycle determination unit 305 sorts the records in the image transmission list 1600 shown in Fig. 16 into an image transmission list 1700 shown in Fig. 17.

[0079] In the image transmission list 1700 shown in FIG. 17, if the expected communication time for camera ID "004" is 20 seconds, in step S453, the comparison unit 306 determines that the sum of the expected communication times for records in the image transmission list selected in step S451 whose wait flag value is "0" is less than 360 seconds. In this case, in step S454, the next cycle determination unit 305 determines imaging information including images captured in the next communication cycle by the surveillance cameras with camera IDs "001", "002", "003", and "004", as the imaging information to be acquired by the acquisition unit 301 in the next communication cycle from the wireless repeater with repeater ID "001".

[0080] The next cycle determination unit 305 also selects records whose wait flags are "1" according to a predetermined rule (e.g., in order from earliest to latest) so that the sum of the estimated communication time of the records whose wait flags are "0" in the image transmission list selected in step S451 and the estimated communication time of the records whose wait flags are "1" is as large as possible within a range of less than 360 seconds. The next cycle determination unit 305 then determines the imaging information corresponding to the selected records as the imaging information to be acquired by the acquisition unit 301 in the next communication cycle.

[0081] 17, imaging information including an image captured in the current communication cycle by a surveillance camera with a camera ID of "004" is also determined as imaging information to be acquired by acquisition unit 301 in the next communication cycle from a wireless repeater with a repeater ID of "001." As described above, the time of the current communication cycle is 16:00 in image transmission list 1700. A record in image transmission list 1700 with a time of "16:00" means a record related to imaging information to be acquired at 17:00, which is the time of the next communication cycle.

[0082] Then, in step S455, next cycle determination unit 305 deletes the record corresponding to the imaging information determined in step S454. In the example shown in Fig. 17 described above (an example in which the expected communication time for camera ID "004" is 20 seconds), imaging information corresponding to all records in image transmission list 1700 with repeater ID "001" is determined as imaging information to be acquired by acquisition unit 301 in the next communication cycle, so all records in image transmission list 1700 are deleted, and the updated image transmission list becomes image transmission list 1300 shown in Fig. 13.

[0083] As described above, there are cases where all of the imaging information of records whose standby flags have a value of "1" cannot be acquired in the next communication cycle. For example, in the image transmission list 1700 shown in Fig. 17, when the expected communication time of the camera ID "004" is 160 seconds, in step S453, the comparison unit 306 determines that the sum of the expected communication times of the records whose standby flags have a value of "0" in the image transmission list selected in step S451 is not less than 360 seconds. Then, as described above, in step S457, the next cycle determination unit 305 selects records from the image transmission list selected in step S451, starting from the top record, so that the sum of the expected communication times of the selected records is less than 360 seconds, and determines the imaging information corresponding to the selected record as the imaging information to be acquired by the acquisition unit 301 in the next communication cycle.

[0084] In the example shown in FIG. 17, the sum of the expected communication times of the camera IDs "001", "002", "003", and "004" at the time "16:00" is 400 seconds. Therefore, the next cycle determination unit 305 determines the imaging information including the captured image captured by the monitoring cameras with the camera IDs "001", "002", and "003" in the next communication cycle as the imaging information to be acquired by the acquisition unit 301 in the next communication cycle from the wireless repeater with the repeater ID "001". In this case, the imaging information including the captured image captured by the monitoring camera with the camera ID "004" in the next communication cycle is not determined as the imaging information to be acquired by the acquisition unit 301 in the next communication cycle. Furthermore, the imaging information including the captured image captured by the monitoring camera with the camera ID "004" in the current communication cycle is not determined as the imaging information to be acquired by the acquisition unit 301 in the next communication cycle. As described above, in the image transmission list 1700, the time of the current communication cycle is set to 16:00. A record with a time of "16:00" in the image transmission list 1700 means a record related to imaging information to be acquired at 17:00, which is the time of the next communication cycle, and a record with a time of "15:00" in the image transmission list 1700 means a record related to imaging information to be acquired at 16:00, which is the time of the current communication cycle.

[0085] Then, in step S458, the next cycle determination unit 305 deletes the record corresponding to the imaging information determined in step S454. In the example shown in FIG. 17 (an example in which the expected communication time for the camera ID "004" is 160 seconds), the imaging information corresponding to the records with the camera IDs "001", "002", and "003" in the image transmission list 1700 with the repeater ID "001" is determined as the imaging information to be acquired by the acquisition unit 301 in the next communication cycle, so only the record is deleted from the image transmission list 1700, and the other records with the camera ID "004" are not deleted. In addition, the value of the standby flag for the record with the camera ID "004" and the time "16:00" is changed to "1". Therefore, the image transmission list at the time of the processing in step S458 becomes the image transmission list 1800 shown in FIG. 18.

[0086] As described above, the imaging information corresponding to the record with the camera ID "004" and the time "15:00" in the image transmission list 1800 is not determined as the imaging information to be acquired in the next communication cycle over a plurality (two) communication cycles. Therefore, in this embodiment, in step S447 of FIG. 4-4, the next cycle determination unit 305 sorts the records corresponding to the imaging information that is not determined as the imaging information to be acquired in the next communication cycle over a predetermined number of communication cycles so that they become records higher than the records sorted based on the accumulation limit time limit. For example, when the predetermined number is "2", in step S447, the next cycle determination unit 305 sorts the record with the camera ID "004" and the time "15:00" in the image transmission list 1800 so that they become the top record or the record next to the record with the important equipment flag "1".

[0087] Alternatively, instead of doing this, among the records having the same camera ID as the camera ID corresponding to the imaging information that has not been determined as the imaging information to be acquired in the next communication cycle over a predetermined number of communication cycles, the record having the latest time may be sorted to be determined as the imaging information to be acquired in the next communication cycle. In this case, in the example shown in Fig. 18, in step S447, the next cycle determination unit 305 sorts the records so that the record having the camera ID "004" and the time "16:00" is the top record or the record next to the record having the important facility flag "1", rather than the record having the camera ID "004" and the time "15:00".

[0088] <Summary> As described above, in this embodiment, the information processing device 100 specifies the height of the deposit, which is an example of the state of the deposit, derives the deposit limit time, which is an example of the priority of the imaging information to be acquired in the next communication cycle, based on the specified height of the deposit, and determines the priority of the imaging information to be acquired in the next communication cycle based on the deposit limit time limit. Therefore, when the information processing device 100 and the multiple terminal devices 120a1-120an, 120b1-120bn, ..., 120n1-120nn communicate using wireless communication, even if the communication amount of information transmitted from the terminal devices varies per communication, the terminal devices can transmit information requested by the information processing device 100 to the information processing device 100.

[0089] In the present embodiment, the information processing device 100 selects imaging information to be acquired in the next communication cycle based on the priority order of the imaging information to be acquired in the next communication cycle. Therefore, the information requested by the information processing device 100 can be transmitted (as reliably as possible) from the terminal device to the information processing device 100 without reducing the size of the captured image.

[0090] In the present embodiment, the information processing device 100 derives an expected communication time of the imaging information, and selects imaging information to be acquired in the next communication cycle based on the expected communication time of the imaging information and the priority of the imaging information to be acquired in the next communication cycle. Therefore, it is possible to prevent the communication time from becoming long.

[0091] In the present embodiment, the information processing device 100 derives the size of imaging information under environmental conditions similar to the past imaging environment based on the imaging environment of the captured image (for example, sunlight conditions), as a predicted size, and derives a predicted communication time of the imaging information based on the predicted size and the wireless communication speed. Therefore, it is possible to prevent the predicted communication time from being significantly different from the actual communication time.

[0092] In addition, in this embodiment, the information processing device 100 temporarily stores information on imaging information that has not been determined as imaging information to be acquired in the next communication cycle in a storage medium, and when the sum (integrated value) of the predicted communication time of the imaging information falls below the time (360 seconds) specified as the communication time in one wireless repeater, further determines imaging information to be acquired in the next communication cycle from among the imaging information identified from the temporarily stored information. Therefore, the information processing device 100 can acquire more imaging information in one communication cycle.

[0093] In addition, in this embodiment, when there is imaging information that has not been determined as imaging information to be acquired in the next communication cycle over a predetermined number of consecutive communication cycles, the information processing device 100 prioritizes the imaging information acquired from the terminal device that acquired the imaging information higher than the priority based on the accumulation limit time limit, thereby making it possible to prevent a period during which imaging information is not acquired from a specific terminal device from becoming too long.

[0094] In addition, in this embodiment, the information processing device 100 prioritizes the imaging information acquired from the terminal device corresponding to the record in which the important equipment flag value is set to "1" higher than the priority based on the accumulation limit time limit, thereby increasing the frequency of acquiring the imaging image of the imaging area to be checked.

[0095] In the present embodiment, the information processing device 100 extracts imaging information in descending order of priority so that the sum (accumulated value) of the predicted communication times of the imaging information is equal to the time (360 seconds) specified as the communication time in one wireless repeater. Therefore, it is possible to prevent the communication time from exceeding the time specified as the communication time in one wireless repeater.

[0096] Moreover, in this embodiment, the information processing device 100 acquires a captured image of the piled up material below the belt conveyor 200. Therefore, the height of the piled up material imaged in the terminal devices 120a1-120an, 120b1-120bn, ..., 120n1-120nn can be managed and monitored on the information processing device 100 side. Therefore, for example, the information processing device 100 side can determine whether or not the state of the piled up material that has fallen from each belt conveyor 200 is such that the piled up material needs to be removed (without patrolling each belt conveyor 200).

[0097] In the present embodiment, the information processing device 100 requests acquisition of imaging information and acquires the imaging information via the wireless repeaters 110a, 110b, ..., 110n. Therefore, the information processing device 100 can acquire imaging information from terminal devices scattered over a wider range.

[0098] (Modification) <First Modification> In this embodiment, the information processing device 100 selects imaging information to be acquired in the next communication cycle based on the priority order of the imaging information to be acquired in the next communication cycle. However, this is not necessarily required. For example, in step S457, the next cycle determination unit 305 may determine the size of imaging information so that the size of imaging information corresponding to at least one record is smaller than the size of the original imaging information (for example, the compression rate of the captured image is larger than that of the original captured image) based on the order of the records sorted in step S447. For example, the next cycle determination unit 305 may reduce the size of imaging information corresponding to the record at a lower level (for example, increase the compression rate of the captured image). At this time, the next cycle determination unit 305 may not reduce the size of imaging information corresponding to a higher level record (for example, a record with a value of the important equipment flag of "1"). In this way, the next cycle determination unit 305 can reduce the amount of imaging information that is not determined as imaging information to be acquired by the acquisition unit 301 in the next communication cycle. In this case, the acquisition unit 301 requests acquisition of imaging information of the determined size.

[0099] Furthermore, the next cycle determination unit 305 can determine the size of the imaging information so that the sum of the predicted communication times of all the records in the image transmission list selected in step S451 is less than 360 seconds. In this way, it is possible to eliminate imaging information that is not determined by the next cycle determination unit 305 as imaging information to be acquired by the acquisition unit 301 in the next communication cycle. In this case, in step S458, all the records are deleted, similarly to step S455.

[0100] <Second Modification> In this embodiment, the priority of the imaging information is described as an example in which the accumulation limit time is used. However, the priority of the imaging information is not limited to the accumulation limit time. For example, instead of the accumulation limit time, the accumulation rate may be used as the priority of the imaging information. In this case, in step S447, the next cycle determination unit 305 sorts the records in the image transmission list so that the record with the faster accumulation rate is ranked higher.

[0101] <Third Modification> In the present embodiment, the information processing device 100 acquires color information of the deposition start point and derives the shape of the deposit to derive the height of the deposit (see steps S423 to S425 in FIG. 4-2). However, the method of deriving the height of the deposit is not limited to this method, and can be realized using known techniques such as image processing and / or artificial intelligence (AI).

[0102] <Fourth modified example> In this embodiment, the predetermined object is described as an example of a pile of material accumulated below the belt conveyor 200. However, the predetermined object is not limited to this. For example, the predetermined object may be raw materials, semi-finished products, or finished products in a factory that need to be inspected to see if they are in a predetermined state.

[0103] <Fifth modified example> In the present embodiment, the case where the 920 MHz band is used as the frequency band for wireless communication is described as an example. However, the frequency band for wireless communication is not limited to the 920 MHz band. However, if a frequency band in which the communication time per given time in one device is predetermined is used, it is possible to transmit information requested by the information processing device 100 from the terminal device to the information processing device 100 (as reliably as possible) within such a communication time constraint.

[0104] <Sixth Modification> In this embodiment, the object is a monitored object, and the object is image information, which is an example of monitored object information, as an example. However, the object is not limited to the monitored object. For example, the object information, which is information of the object, may include sound information indicating the sound of the facility or equipment and may not include an image. Also, the object information may include sound information of the facility or equipment in addition to the captured image of the facility or equipment. In this case, the terminal device has a recorder that records the sound instead of or in addition to the monitoring camera. Also, for example, based on the result of comparing the frequency or sound pressure level of the sound with a reference value, it is possible to identify whether the state of the object is normal or abnormal, or the degree of abnormality of the state of the object.

[0105] <Other Modifications> The above-described embodiment of the present invention can be realized by a computer executing a program. A computer-readable recording medium on which the program is recorded and a computer program product such as the program can also be applied as an embodiment of the present invention. Examples of the recording medium that can be used include a flexible disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a magnetic tape, a non-volatile memory card, and a ROM. Furthermore, the above-described embodiments of the present invention are merely examples of the implementation of the present invention, and the technical scope of the present invention should not be interpreted as being limited by these. In other words, the present invention can be implemented in various forms without departing from its technical concept or main features. [Explanation of symbols]

[0106] 100: information processing device, 120a1 to 120an, 120b1 to 120bn, 120n1 to 120nn: terminal devices, 130a, 130b, 130n: gateway devices, 140: wired network, 200: belt conveyor, 210a to 210b: piles, 301: acquisition unit, 302: state identification unit, 303: priority derivation unit, 304: communication time prediction unit, 305: next cycle determination unit, 306: comparison unit

Claims

1. An information processing device that communicates with a plurality of terminal devices using wireless communication, an acquisition means for requesting the terminal device to acquire object information including information on the object and acquiring the object information; An identification means for identifying a state of the object included in the object information acquired by the acquisition means; a derivation means for deriving a priority of the object information to be acquired by the acquisition means in a next communication cycle based on the state of the object identified by the identification means; a determination means for determining a priority order of the object information to be acquired by the acquisition means in a next communication cycle based on the priority derived by the derivation means.

2. The determination means determines the object information to be acquired by the acquisition means in the next communication cycle based on a priority order of the object information to be acquired by the acquisition means in the next communication cycle; 2 . The information processing apparatus according to claim 1 , wherein the acquisition means acquires the object information by requesting the terminal device, which is to be the acquisition destination of the object information determined by the determination means, to acquire the object information.

3. a prediction unit for predicting a time required for performing the wireless communication in a next communication cycle based on an environment of an area in which the object exists, The information processing device according to claim 2, characterized in that the determination means determines the object information to be acquired by the acquisition means in the next communication cycle based on the priority of the object information to be acquired by the acquisition means in the next communication cycle and the time predicted by the prediction means.

4. The information processing device according to claim 3, characterized in that the prediction means predicts the size of the object information that the acquisition means will acquire from the terminal device in the next communication cycle based on the environment of the area in which the object is located, and predicts the time required to perform the wireless communication in the next communication cycle based on the predicted size of the object information and the speed of the wireless communication.

5. a comparison means for comparing an integrated value of the time predicted by the prediction means for a predetermined number of the terminal devices with a predetermined value, The information processing device described in claim 3 or 4, characterized in that the determination means temporarily stores information regarding the object information that has not been determined by the determination means as the object information to be acquired by the acquisition means in the next communication cycle in a storage medium, and when the comparison by the comparison means shows that the integrated value of the time predicted by the prediction means for a predetermined number of the terminal devices falls below a predetermined value, the determination means further determines the object information to be acquired by the acquisition means in the next communication cycle from among the object information identified from the information stored in the storage medium.

6. a prediction means for predicting a time required for performing the wireless communication in a next communication cycle based on an environment of an area in which the target object exists; a comparison means for comparing the integrated value of the time predicted by the prediction means for a predetermined number of the terminal devices with a predetermined value, when the comparison result by the comparison means indicates that the integrated value of the time predicted by the prediction means for a predetermined number of the terminal devices falls below a predetermined value, the determination means determines a size of the object information to be acquired by the acquisition means in the next communication cycle based on a priority order of the object information to be acquired by the acquisition means in the next communication cycle; 2 . The information processing apparatus according to claim 1 , wherein the acquisition means acquires the object information by requesting the plurality of terminal devices to acquire the object information of the size determined by the determination means.

7. The information processing device described in any one of claims 1 to 6, characterized in that when there is object information that has not been determined as object information to be acquired by the acquisition means in the next communication cycle over a predetermined number of consecutive communication cycles, the determination means increases the priority of the object information acquired from the terminal device from which the object information was acquired, higher than the priority of the object information based on the state of the object identified by the identification means.

8. The information processing device described in any one of claims 1 to 7, characterized in that the determination means sets the priority of the object information acquired from a specified terminal device by the acquisition means to be higher than the priority of the object information based on the state of the object identified by the identification means.

9. a prediction unit for predicting a time required for performing the wireless communication in a next communication cycle based on an environment of an area in which the object exists, The information processing device according to any one of claims 1 to 8, characterized in that the determination means extracts the terminal devices in order of the terminal device with the highest priority until the accumulated value of the time predicted by the prediction means satisfies a predetermined condition, and determines the extracted terminal device as the terminal device from which the acquisition means will acquire the object information in the next communication cycle.

10. 10. The information processing device according to claim 1, wherein a communication time per given period between the information processing device and a device that performs wireless communication with the information processing device is determined in advance.

11. The object is a monitored object, 11. The information processing apparatus according to claim 1, wherein the object information is monitoring target information.

12. The information processing apparatus according to claim 11 , wherein the monitoring target information includes a captured image of the monitoring target.

13. 13. The information processing apparatus according to claim 11, wherein the state of the object to be monitored is the height of a deposit.

14. 14. The information processing apparatus according to claim 13, wherein the deriving means derives, as the information indicating the priority, a time required for the height of the pile to reach a predetermined height, or an amount of change in the height of the pile per unit time.

15. The information processing device according to any one of claims 1 to 14, characterized in that the acquisition means requests acquisition of the object information and acquires the object information via a repeater that relays between the information processing device and the terminal device.

16. A communication control method in an information processing device that communicates with a plurality of terminal devices using wireless communication, comprising: an acquisition step of requesting the terminal device to acquire object information including information on the object, and acquiring the object information; a specification step of specifying a state of the object included in the object information acquired by the acquisition step; a derivation step of deriving a priority of the object information to be acquired by the acquisition step in a next communication cycle based on the state of the object identified by the identification step; A communication control method comprising: a determination step of determining a priority order for the object information to be acquired by the acquisition step in a next communication cycle based on the priority derived by the derivation step.

17. A program for causing a computer to function as each of the means of the information processing device according to any one of claims 1 to 15.

Images