On-site environment monitoring device, on-site environment monitoring system, and on-site environment monitoring method

Abstract

To provide an on-site environment monitoring device capable of monitoring, in real time, changes in an on-site environment using a simple mechanism, an on-site environment monitoring system, and an on-site environment monitoring method.SOLUTION: In an on-site environment monitoring system, an on-site environment monitoring device 1A is configured to: preliminarily evaluate an on-site environment and store changes in an image of an area serving as a monitoring object as a model; acquire image data of each area to be monitored of the on-site environment from an imaging system 2A via a network 4, which is a wireless or wired communication network such as the Internet or a dedicated line, with security considerations, and analyze the changes in the image; evaluate changes in the on-site environment in the area to be monitored on the basis of the analysis results; and notify an operation management system 3A of the evaluation results via the network 4.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an on-site environment monitoring device, an on-site environment monitoring system, and an on-site environment monitoring method.

Background Art

[0002] Conventionally, in order to detect changes in the on-site environment indoors and outdoors, such as in factories and roads, after constructing a 3D model of the on-site environment, a method has been used in which the reflection, diffraction, and transmission of radio waves in the on-site environment are traced to calculate the electric field strength.

[0003] In addition, a method has been proposed to create a radio wave propagation simulation model by recognizing the surface structure and texture of objects such as structures existing in a communication area by deep learning and automatically assigning the dielectric constant of the object with high accuracy (Patent Document 1).

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] When adopting the method of radio wave propagation simulation as in the prior art, there is a problem that not only large-scale analysis equipment is required to analyze the electromagnetic wave intensity and the like, but also a great deal of time, labor, and cost are required for the analysis.

[0006] Also, for example, when constructing a 3D model of a site environment, every time the site environment changes, it is necessary to reconstruct the 3D model, and it is difficult to detect changes in the site environment in real time. For this reason, when the site environment is a transportation facility, for example, a public road, even if the site environment changes due to traffic congestion of vehicles, it is impossible to notify the vehicles of congestion avoidance in real time, and there are problems such as being involved in traffic congestion. Also, when the site environment is a factory, even if there are problems in seamless cooperation of work among workers or between workers and robots, the problems cannot be detected in real time, resulting in problems such as delays in work.

[0007] The present invention has been made in view of such a background, and an object thereof is to provide a site environment monitoring device, a site environment monitoring system, and a site environment monitoring method capable of monitoring changes in a site environment in real time with a simple mechanism.

Means for Solving the Problems

[0008] In order to solve the above-described problems and achieve the above object, an embodiment of the present invention is a site environment monitoring device that is connected to an imaging system that photographs a site and monitors the site environment, and divides the site environment into areas, and stores, in association, models corresponding to one or a plurality of types of changes in the site environment assumed in advance for each area in a storage unit, an image analysis unit that inputs and analyzes image data for each area from the imaging system, a model selection unit that refers to the models stored in the storage unit and selects a model based on the analysis result of the image analysis unit for each area, and an evaluation unit that evaluates changes in the site environment in the area corresponding to the model based on the model selected by the model selection unit.

[0009] In addition, another embodiment of the present invention is a on-site environment monitoring system for monitoring the on-site environment, which includes an imaging system that divides the on-site environment into areas and takes pictures for each area, and an on-site environment monitoring device that evaluates changes in the on-site environment based on the image data obtained by the imaging system. The on-site environment monitoring device includes a storage unit that stores, in association with each other, models corresponding to one or more types of assumed changes in the on-site environment for each area; a communication unit that communicates with the imaging system; an image analysis unit that inputs and analyzes the image data for each area from the imaging system via the communication unit; a model selection unit that refers to the models stored in the storage unit and selects a model based on the analysis result of the image analysis unit for each area; an evaluation unit that evaluates changes in the on-site environment in the area corresponding to the selected model based on the selected model; and a notification unit that is connected to a management system for managing each area and notifies the management system of the evaluation result of the evaluation unit.

[0010] In addition, another embodiment of the present invention is a method for monitoring the on-site environment of a system for monitoring the on-site environment. The system includes an imaging system that divides the on-site environment into areas and takes pictures for each area, and an on-site environment monitoring device that is connected to a management system for managing each area, has a memory, and evaluates changes in the on-site environment based on the image data obtained by the imaging system. In the on-site environment monitoring device, the method includes a first step of storing, in the memory in association with each other, models corresponding to one or more types of assumed changes in the on-site environment for each area; a second step of the imaging system acquiring the image data for each area; a third step of the on-site environment monitoring device inputting and analyzing the image data from the imaging system, referring to the models stored in the memory, selecting a model based on the analysis result for each area, and evaluating changes in the on-site environment in the area corresponding to the selected model based on the selected model; and a fourth step of notifying the management system of the evaluation result obtained in the third step.

Advantages of the Invention

[0011] According to the present invention, it is possible to monitor changes in the on-site environment in real time with a simple mechanism.

Brief Description of the Drawings

[0012]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Modes for Carrying Out the Invention

[0013] Hereinafter, embodiments of the present invention will be described with reference to the drawings. Note that the following description and drawings are merely examples for explaining the present invention, and for the sake of clarity of explanation, appropriate omissions and simplifications have been made. In addition, the present invention can be implemented in various other forms. Also, unless otherwise particularly limited, each component may be in a single or plural number.

[0014] In the embodiments described below, the field of transportation including mobility and the like will be described as an example.

[0015] First, the overall configuration will be described with reference to FIGS. 1 and 2. FIG. 1 is a configuration diagram showing a configuration example of a site environment monitoring system according to the present embodiment, and FIG. 2 is a configuration diagram showing a hardware configuration example of a site environment monitoring device according to the present embodiment.

[0016] A site environment monitoring system showing the field of transportation as an example, as shown in FIG. 1 for example, connects a site environment monitoring device 1A, an imaging system 2A, an operation management system 3A, etc. via a network 4 to detect changes in the site environment in real time and realize appropriate operation management of a vehicle which is a moving body. Here, the network 4 is a wireless or wired communication network such as the Internet or a dedicated line, and has a mechanism considering security.

[0017] The site environment monitoring device 1A is composed of, for example, as shown in FIG. 1, a communication unit 11, a 3D space generation unit 12, a pre-evaluation unit 13, a storage unit 14, an image analysis unit 15, a model selection unit 16, an evaluation unit 17, a management unit 18, a notification unit 19, etc.

[0018] The communication unit 11 is connected to the network 4 and is in charge of communication of information, images, data, etc. between the site environment monitoring device 1A and other systems. The 3D space generation unit 12 includes a 3D modeling unit 12A that acquires data of a preset site environment (area to be monitored) and generates a 3D environment model, a radio wave propagation analysis simulator 12B that uses the ray tracing method to simulate radio wave propagation considering objects such as buildings and terrain, and the like.

[0019] Here, regarding the hardware part of the radio wave propagation analysis simulator 12B, for example, when applying radio wave analysis, LiDAR and cameras are used for on-site sensing to acquire data such as point clouds. A 3D model of the site is generated based on the acquired data. This radio wave propagation analysis simulation technology is also an area simulation method using a wireless digital twin (cyberspace), and since the wireless communication network is also an element, its illustration and description are omitted.

[0020] The pre-evaluation unit 13 evaluates the monitoring target area based on the results of the radio wave propagation analysis simulator 12B and generates an evaluation table in which a model of an image corresponding to changes in the on-site environment is patterned. The storage unit 14 stores the evaluation table generated by the pre-evaluation unit 13.

[0021] The image analysis unit 15 performs image analysis based on the video received from the imaging system 2A via the communication unit 11 and detects environmental changes in real time. The model selection unit 16 selects the corresponding model from the above evaluation table based on the analysis result of the image analysis unit 15, and the evaluation unit 17 evaluates the specific situation of the environmental change from the selected model. Examples of the evaluation here include what kind of obstacles have occurred in which area under what circumstances.

[0022] The management unit 18 generates an evaluation result to be provided to the operation management system 3A and outputs it to the notification unit 19. The evaluation result here is information such as a proposal to detour a bus scheduled to pass through an area where traffic congestion has occurred on a public road. The notification unit 19 notifies the operation management system 3A of the evaluation result output from the management unit 18 via the network 4.

[0023] Next, the hardware configuration of this embodiment will be described with reference to FIG. 2. As shown in FIG. 2, for example, the on-site environment monitoring device 1A includes a CPU 101 that controls the entire device, a memory 103 that stores a program 102 related to the processing according to this embodiment (including the processing in FIGS. 3 and 6) for the CPU 101 to execute and stores various data during execution, an operation device 104 including a keyboard and a display device, an external storage device 105 that is a memory for registering and managing various data in the form of a table or the like, a communication IF 106 connected to the network 4 to control communication with external devices (such as the imaging system 2A and the operation management system 3A), and a bus 107 connected to each unit in the device to control communication of data, signals, etc. inside the device.

[0024] Next, the pre-evaluation of the on-site environment will be described with reference to FIGS. 3, 4, and 5. FIG. 3 is a flowchart for explaining an operation example of the pre-evaluation according to this embodiment, FIG. 4 is an explanatory diagram for explaining the pre-evaluation according to this embodiment, and FIG. 5 is a table diagram for explaining an evaluation table showing the relationship between the model and the area according to this embodiment. Note that the operations are to be executed by the program 102 in FIG. 2.

[0025] When performing the pre-evaluation, first, conditions for area selection are set (step S301). Examples of such conditions include the bus operation route, around the station, and tourist route, but it is not limited thereto, and the conditions required by public institutions, operators, etc. that operate the operation management system 3A are also conditions necessary for area selection.

[0026] After setting the conditions in this way, an environment model is generated by the 3D modeling unit 12A for 3D conversion of the selected area (step S302), and a radio wave propagation simulation is performed by the radio wave propagation analysis simulator 12B (step S303).

[0027] Suppose that radio wave propagation analysis simulation is performed on one area selected in step S301. As a result, for example, as shown in FIG. 4, an area without an obstacle blocking radio waves results in an image ARA0 shown by, for example, a 3D heat map, and an area with an obstacle blocking radio waves results in an image ARA1 (e.g., a 3D heat map) shown by arrow MV11 or an image ARA2 (e.g., a 3D heat map) shown by arrow MV21. That is, when an obstacle occurs, a difference will occur between the simulation result and the state without an obstacle.

[0028] Therefore, in image ARA1, as shown by the enlarged image ARAL1 indicated by arrow MV12 in the image MTR1 within the dashed line frame, it is possible to confirm traffic congestion where a passenger car is an obstacle on the road. Similarly, in image ARA2, traffic congestion of a bus can be confirmed as shown by the enlarged image ARAL2 indicated by arrow MV22 in the image MTR2 within the same area as in image ARA1, within the dashed line frame. The differences in the obstacle situations (such as passenger cars and buses) in images ARA1 and 2 are often due to factors such as season, time of day, demonstration, and event. Examples of events include road races, festivals, concerts, etc. that use the road, and there is an influence due to the flow of people rather than moving objects, such as the occurrence of congestion in one-way traffic control. In this way, pinpoint areas that block radio waves are analyzed based on the results of the radio wave propagation simulation (step S304), and the areas that block radio waves obtained from this analysis are selected as the monitoring target areas (step S305).

[0029] The processing from step S303 to step S305 above is performed for all areas selected in step S301 (NO route in step S306). When all monitoring target areas have been selected, the processing proceeds to step S307 (YES route in step S306).

[0030] Then, in step S307, pre-evaluation is performed for each monitoring target area by the pre-evaluation unit 13, and the evaluation table 501 shown in FIG. 5 is stored in the storage unit 14. In this evaluation table 501, if the area of the dashed frame MTR is defined as the monitoring target area 1 based on the analysis result of step S304, in the case of the image ARA0, two types of model attributes are prepared: a passenger car model (corresponding to image ARA1) and a large bus / truck model (corresponding to image ARA2).

[0031] In the case of the monitoring target area 1, as an example considering the impact on the area, that is, the deterioration of communication quality, for the passenger car model, the impact level on QoE (Quality of Experience) is set to "1", and for the large bus / truck model, the impact level on QoE is set to "2". Here, it is assumed that the greater the difference in the impact level, the greater the impact on the radio wave intensity.

[0032] In this embodiment, the impact of the obstacle is determined based on the image acquired from the imaging system 2A, and the impact level indicating the degree of the impact is replaced by the degree of the impact on the radio wave intensity.

[0033] Regarding the monitoring target area 2 as well, when the passenger car model and the large bus / truck model are set as the model attributes, also as an example considering the impact on the area, for the passenger car model, the impact level on QoE is set to "1", and for the large bus / truck model, the impact level on QoE is set to "3". In this way, the impact level corresponding to the model attribute is set for each monitoring target area.

[0034] Next, the monitoring operation of the on-site environment will be described with reference to FIGS. 6, 7, and 8. FIG. 6 is a flowchart for explaining the monitoring operation of the on-site environment according to this embodiment, and FIG. 7 is an explanatory diagram for explaining the method of extracting the change in the on-site environment according to this embodiment. It should be noted that the operation is executed by the program 102 in FIG. 2.

[0035] In FIG. 6, the cooperation of the processes of the imaging system 2A, the on-site environment monitoring device 1A, and the operation management system 3A is shown. When the operation management system 3A starts the operation management for the assigned site (step S6301), it enters a state of receiving the evaluation result from the on-site environment monitoring device 1A as a notification (step S6302).

[0036] The on-site environment monitoring device 1A extracts the monitoring target area with reference to the evaluation table 501 stored in the storage unit 14, and instructs the imaging system 2A to capture images of the monitoring target area (step S6201).

[0037] The imaging system 2A receives the information of the monitoring target area from the on-site environment monitoring device 1A, and starts capturing images from cameras 201 to 250 for each area (step S6101). Further, the imaging system 2A transmits the image data acquired by the capturing to the on-site environment monitoring device 1A (step S6102), and continues to transmit the image data in step S6102 until the capturing is completed (NO route in step S6103). Note that the end of the capturing may be instructed by the on-site environment monitoring device 1A, or may be based on an external instruction or operator operation due to maintenance or other circumstances.

[0038] The on-site environment monitoring device 1A inputs the image data for each monitoring target area from the imaging system 2A, and performs analysis in the image analysis unit 15 (step S6202). Here, the model selection unit 16 determines whether there is a change in the on-site environment based on the analysis result of the image analysis unit 15. Specifically, it is determined whether an obstacle equivalent to a passenger car or a large bus / truck is detected in the height direction from the road surface of the area based on the image data of the corresponding area. As a result, if an obstacle is detected, the process proceeds to step S6203, and if no detection is made, the reception of the image data is repeated and the above process is performed.

[0039] In step S6203, the model selection unit 16 determines the model attribute, and determines whether it is a passenger car model or a large bus / truck according to the height of the detected obstacle. For example, if it is determined that the monitoring target area 1 is the "2" shown in FIG. 5 and is a large bus / truck model, as shown in FIG. 7, the image MTR3 within the broken line frame of the image ARA3 input in step S6202 indicates the enlarged image ARAL3 shown by the arrow MV13. That is, the enlarged image ARAL3 is in the same situation as the enlarged image ARAL2 in FIG. 4, and the monitoring target area 1 is determined to be in a state where a large bus / truck is an obstacle and the road is congested.

[0040] As a result, in the evaluation unit 17, the evaluation table 501 is referred to and the evaluation result of impact level 1 is obtained (step S6204). When the evaluation result is obtained in step S6204, information such as the evaluation result is notified to the operation management system 3A by the notification unit 19 under the instruction of the management unit 18, and the monitoring process for one monitoring target area ends (step S6205).

[0041] The above monitoring process is performed for all monitoring target areas, but it returns to step S6202 (the NO route of step S6206) until an operation or instruction to end the monitoring process itself is received, and the same process is repeatedly executed.

[0042] In step S6202, it is necessary to avoid determining congestion with an overly long time interval, and continuous determination of congestion is made at a predetermined time interval (for example, within 1 hour, 10 minutes, 30 minutes, 1 hour, etc.). Note that this time interval, that is, the time granularity, is arbitrarily set according to the conditions that cause obstacles (model attributes, seasons, time zones, events, etc.).

[0043] Of course, in addition to the above time granularity, the determination of traffic jams may also be made based on the continuity of failures. That is, it may be determined whether the determination of the same model continues for a preset 10 minutes. Also in this case, due to the real-time issue, it is necessary to avoid taking too long to make a determination, and it shall be arbitrarily set according to the failure conditions (model attributes, seasons, time zones, events, etc.).

[0044] When the operation management system 3A receives a notification from the on-site environment monitoring device 1A (step S6302), it executes operation management according to the notification content, that is, the evaluation result (step S6303). For example, if the impact level is 2, there are measures such as rerouting the bus route for operation management. The processes of steps S6302 and S6303 are repeatedly executed at the end a (NO route in step S6304).

[0045] In this embodiment, for the sake of explanation, as shown in FIGS. 4 and 7, the monitored areas were imaged as ARA1, 2, and 3. However, the present invention is not limited to this, and it goes without saying that the images MTR1, 2, and 3 within the broken line frames may be defined as the monitored areas. In this case, if the images obtained by the camera shooting of the imaging system 2A are in the areas of images ARA1, 2, and 3, the areas of images MTR1, 2, and 3 within the broken line frames can be defined by coordinates within that area to obtain image data. Also, only the areas of images MTR1, 2, and 3 within the broken line frames may be obtained as image data by the camera itself.

[0046] As described above, according to this embodiment, it is possible to monitor changes in the on-site environment in real time with a simple mechanism. Not only limited to roads, even if replaced by railways, the dynamics of trains, which are one of the people and moving objects in each area, and the performance fluctuations of communication infrastructure can be grasped, and it is expected to be reflected in safe railway operations. Therefore, it is possible to grasp the running status of each area in real time and prevent disruptions to the train schedule based on the impact of accidents, etc. in advance. Of course, it is also possible to realize control of boarding and alighting and ensure safety through traffic flow analysis during congestion in the commuting hours.

[0047] In the above-described embodiment, the field of transportation including mobility and the like has been described as an example, and it is expected to grasp the dynamics of people and autonomous mobility in each area, extract behavior patterns, and reflect them in rapid mobility operations. The present invention is not limited to the field of transportation, but can also be applied to fields such as factories, warehouses, and stores. Thus, the same configuration as that of the above-described embodiment may be applied to fields other than transportation.

[0048] In particular, in a manufacturing factory, seamless cooperation with an automation system and reflection in operations are expected according to the proficiency and work efficiency of workers and laborers. Also, in a store, grasping customer attributes, behavior logs, etc., extracting behavior patterns, and making a quick response and recommendation to customers are expected. In each field, adjustment of time granularity and variation of models are required, and preparation of data based on a suitable pre-evaluation is necessary.

[0049] Therefore, first, a modified example 1 focusing on work management will be described with reference to FIG. 8. FIG. 8 is a configuration diagram for explaining modified example 1 according to the present embodiment. In this modified example 1, since the on-site environment monitoring device 1B and the imaging system 2B have the same configurations and functions as those of the above-described embodiment, the description thereof will be omitted.

[0050] Regarding the imaging system 2B, since the monitoring target area is, for example, a factory, the configuration and operation are the same as those of the above-described embodiment except that the camera arrangement is different. Regarding the on-site environment monitoring device 1B, as work monitoring, processes such as determining in real time the presence or absence of work stagnation based on the image data obtained by photographing the work flow by the imaging system 2B are executed, and the result is linked to the evaluation and notified to the work management system 3B. As a result, in the work management system 3B, seamless cooperation between workers and robots and utilization in operations become possible.

[0051] Furthermore, a modified example 2 focusing on customer management will be described with reference to FIG. 9. FIG. 9 is a configuration diagram for explaining the modified example 2 according to the present embodiment. In this modified example 2, since the on-site environment monitoring device 1C and the imaging system 2C have the same configurations and functions as those in the above-described embodiment, the description thereof will be omitted.

[0052] Regarding the imaging system 2C, since the monitoring target area is, for example, a commercial facility (such as a store), the configuration and operation are the same as those in the above-described embodiment except that the camera arrangement is different. Regarding the on-site environment monitoring device 1C, as monitoring of customer trends, processes such as analyzing the customer's movement route in real time based on the image data obtained by photographing the customer's behavior by the imaging system 2C are executed, and the results are linked to the evaluation and notified to the customer management system 3C. As a result, in the customer management system 3C, it becomes possible to utilize the customer's movement route for product display and product proposal for sales promotion.

[0053] In the above-described embodiment, an on-site environment monitoring system combining an on-site environment monitoring device and an imaging system was given as an example, but the present invention is not limited to this. A plurality of on-site environment monitoring systems may be connected via a network to monitor the whole, and data communication may be performed mutually between the on-site environment monitoring systems, so that it is possible to virtually expand to areas other than the on-site environment that can be acquired by one on-site environment monitoring system and share the evaluation.

[0054] Also, in each of the above-described embodiments, the number of cameras of the imaging system 20 is taken as an example of 50, but the number may be arbitrarily adjusted according to the number of areas to be monitored and the monitoring content.

[0055] Also, in each of the above-described embodiments, a mechanism for model determination through camera images was described as an example, but if it does not become a large-scale facility, data acquisition by optical sensors such as infrared rays and ultrasonic waves may be applied in addition to images (image data).

[0056] In addition, regarding the on-site environment monitoring system according to each of the above-described embodiments, an example of the configuration is that the imaging system, the on-site environment monitoring device, and each management system are connected by a network such as the Internet or a LAN. However, the present invention is not limited to this, and a configuration may be adopted in which they are directly connected by a communication line such as a bus without going through a public line or a dedicated line.

[0057] In the above-described embodiment, as an example, the imaging system uses a monocular camera to perform distance measurement and recognize the height of a moving object from an image, and does not recognize the type of the moving object itself (objects such as passenger cars, buses, and trucks). However, the type of the moving object itself may be recognized to realize support for smoothly performing operation management through more detailed analysis and evaluation.

[0058] Also, needless to say, if the configuration does not become complicated, a stereo camera such as an SGM (Semi Global Matching) method or an SAD (Sum of Absolute Difference) method capable of distance measurement may be applied instead of the monocular camera.

[0059] In the above-described embodiment, the imaging system uses a monocular camera to perform distance measurement and recognize the height of a moving object from an image, and does not recognize the moving direction of the moving object. However, the moving direction of the moving object may be recognized to realize support for smoothly performing operation management through more detailed analysis and evaluation. In this case, the moving direction will be given as an attribute.

[0060] In the above-described embodiment, in the field of transportation, the imaging system uses a monocular camera to recognize the height of a vehicle as a moving object from an image, and does not recognize a person. However, a person may also be recognized to support smoothly performing operation management through more detailed evaluation. In this case, since a person will be given as an attribute, it is possible to handle events such as a pedestrian paradise, a festival, and a sports event. Of course, if traffic regulations can be acquired as information, it is possible to further analyze and evaluate the situation of the on-site environment in detail.

[0061] In addition, each of the above-described configurations, functional units, processing units, processing means, etc. may be implemented in hardware by designing part or all of them, for example, by using an integrated circuit. Further, each of the above-described configurations, functions, etc. may be implemented in software by a processor interpreting and executing a program for realizing each function. Information such as programs, tables, and files for realizing each function can be stored in a recording device such as a memory, a hard disk, an SSD (Solid State Drive), a recording medium such as an IC card, an SD card, or a DVD.

[0062] Furthermore, the arrangement forms of the various functional units, various processing units, and various databases of the information collection system 10 described above are merely examples. The arrangement forms of the various functional units, various processing units, and various databases can be changed to an optimal arrangement form from the viewpoints of the performance of the hardware and software provided in these devices, processing efficiency, communication efficiency, etc.

[0063] Also, the configuration (such as a schema) of the database for storing the various data described above can be flexibly changed from the viewpoints of efficient use of resources, improvement of processing efficiency, improvement of access efficiency, improvement of search efficiency, etc.

Description of Reference Numerals

[0064] 1A On-site environment monitoring device 1B On-site environment monitoring device 1C On-site environment monitoring device 2A Imaging system 2B Imaging system 2C Imaging system 3A Operation management system 3B Work management system 3C Customer management system 11 Communication unit 12 3D space generation unit 12A 3D modeling unit 12B Radio wave propagation analysis simulator 13 Pre-evaluation unit 14 Storage unit 15 Image analysis unit 16 Model Selection Unit 17 Evaluation Unit 18 Management Unit 19 Notification Unit 101 CPU 102 Program 103 Memory 104 Operating Device 105 External Storage Device 106 Communication IF 107 Bus 201 Camera 202 Camera 250 Camera 501 Evaluation Table

Claims

1. A site environment monitoring device that is connected to an imaging system for photographing a site and monitors the site environment, a storage unit that divides the site environment into areas and stores, in association with each area, a model corresponding to one or more types of assumed changes in the site environment in advance; an image analysis unit that inputs and analyzes image data for each area from the imaging system; a model selection unit that refers to the models stored in the storage unit and selects a model based on the analysis result of the image analysis unit for each area; an evaluation unit that evaluates changes in the site environment in the area corresponding to the model based on the model selected by the model selection unit; A site environment monitoring device, characterized by comprising the above.

2. The site environment monitoring device according to claim 1, wherein the evaluation unit evaluates changes in the site environment according to a predetermined time granularity.

3. The site environment monitoring device according to claim 2, wherein the evaluation unit prepares the predetermined time granularity for each model stored in the storage unit.

4. The site environment monitoring device according to claim 3, wherein the change in the site environment is the operation mode of a moving body for each area, and the evaluation unit evaluates the operation mode of the moving body for each area from the change in the image in the height direction based on the image data input from the imaging system.

5. The site environment monitoring device according to claim 1, further comprising a communication unit connected to an external device, and a notification unit that notifies the evaluation result of the evaluation unit to an external device related to the corresponding area via the communication unit.

6. The site environment monitoring device according to claim 1, wherein the storage unit divides the site environment into areas and stores, in association with each area and for each time period, a model corresponding to one or more types of assumed changes in the site environment in advance.

7. The site environment monitoring device according to claim 1, further comprising a radio wave propagation analysis simulator, and each area is an area set as a monitoring target based on the analysis result of the radio wave propagation analysis simulator performed on the site environment.

8. The on-site environment monitoring device according to claim 7, further comprising a pre-evaluation unit that determines an area to be set as a monitoring target based on the radio wave intensity level based on the analysis result. The on-site environment monitoring device is characterized by this.

9. In the on-site environment monitoring device according to claim 1, wherein the on-site environment is a transportation facility, and further comprising a management unit that performs operation management of a moving body based on the evaluation result of the evaluation unit. The on-site environment monitoring device is characterized by this.

10. In the on-site environment monitoring device according to claim 1, wherein the on-site environment is a building such as a factory or a warehouse, and further comprising a management unit that performs work management based on the evaluation result of the evaluation unit. The on-site environment monitoring device is characterized by this.

11. In the on-site environment monitoring device according to claim 1, wherein the on-site environment is a commercial facility, and further comprising a management unit that manages customer behavior based on the evaluation result of the evaluation unit. The on-site environment monitoring device is characterized by this.

12. An on-site environment monitoring system for monitoring an on-site environment, An imaging system that divides the on-site environment into areas and takes pictures for each area, and An on-site environment monitoring device that evaluates changes in the on-site environment based on the image data acquired by the imaging system, Comprising The on-site environment monitoring device is A storage unit that stores, in association with each other, models corresponding to one or more types of assumed changes in the on-site environment for each area, A communication unit that communicates with the imaging system, An image analysis unit that inputs and analyzes the image data for each area from the imaging system via the communication unit, A model selection unit that refers to the models stored in the storage unit and selects a model based on the analysis result of the image analysis unit for each area, An evaluation unit that evaluates changes in the on-site environment in the area corresponding to the model based on the model selected by the model selection unit, Connected to a management system that manages each area, and a notification unit that notifies the management system of the evaluation result of the evaluation unit, The on-site environment monitoring system is characterized by having this.

13. In the on-site environment monitoring system according to claim 12, wherein the on-site environment monitoring device further comprises a radio wave propagation analysis simulator, and each area is an area set as a monitoring target based on the result of a radio wave propagation analysis simulation performed on the on-site environment. The on-site environment monitoring system is characterized by this.

14. The on-site environment monitoring system according to claim 13, further comprising a pre-evaluation unit that determines an area to be set as the monitoring target based on the radio field intensity level.

15. An on-site environment monitoring method for a system that monitors an on-site environment, wherein the system divides the on-site environment into areas and has an imaging system that takes images for each area, is connected to a management system that manages each area, has a memory, and an on-site environment monitoring device that evaluates changes in the on-site environment based on image data acquired by the imaging system, and includes in the on-site environment monitoring device, a first step of associating and storing in the memory a model corresponding to each of one or more types of assumed changes in the on-site environment for each area; in the imaging system, a second step of acquiring image data for each area; in the on-site environment monitoring device, inputting and analyzing the image data from the imaging system, selecting a model based on the analysis result for each area with reference to the models stored in the memory, and evaluating changes in the on-site environment in the area corresponding to the selected model based on the selected model; a fourth step of notifying the management system of the evaluation result obtained in the third step; An on-site environment monitoring method characterized by including the above steps.

Images