Image monitoring device and method

Abstract

To utilize video data of a monitoring camera installed in a car so as to identify and / or eliminate an abnormal state specific to an elevator.SOLUTION: A video monitoring device detects an action of an elevator passenger from video data of a monitoring camera installed in an elevator car and identifies an elevator abnormal state and / or elevator control corresponding to the detected action of the passenger from data indicating a plurality of actions of passengers and elevator abnormal states and / or the elevator control estimated for each of the plurality of actions of passengers. The detected passenger action includes the stumbling or bending / stretching motion when a passenger gets on the car or the stumbling or bending / stretching motion when a passenger gets off the car. The identified elevator abnormal state is a state in which the car is positioned at a position lower / higher than a correct position. The identified elevator control is the control for raising / lowering the car such that the car is positioned at the correct position.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention generally relates to the analysis of camera images of elevators.

Background Art

[0002] An elevator is a mechanical structure, and technologies for monitoring elevator abnormalities are provided.

[0003] On the other hand, as elevator equipment, it has become common to install a monitoring camera (typically a security camera) inside the car. Also, technologies for detecting specific abnormal states from the actions of a person being photographed using camera images have been invented in various fields. According to Patent Document 1, when the time during which the line of sight of an ATM user is directed toward a teller call button from the image of a camera provided in an automated teller machine (ATM) becomes equal to or longer than a predetermined time, a situation where the call button is malfunctioning and cannot be called is detected, and control for notifying a teller of the call is performed.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] If the technology described in Patent Document 1 can be applied to an elevator, there is a possibility of detecting an abnormality in the destination floor button inside the car.

[0006] However, even if the technology described in Patent Document 1 can be applied to an elevator, it is not possible to detect abnormal states specific to an elevator.

[0007] The present invention is to utilize the video data of a monitoring camera provided in a car for identifying abnormal states specific to an elevator.

Means for Solving the Problems

[0008] A video surveillance device receives video data of a surveillance camera provided in an elevator car and detects the actions of elevator passengers from the video data. The video surveillance device identifies an elevator abnormal state and / or elevator control corresponding to the detected passenger action from abnormal identification data, which is data representing a plurality of passenger actions and the elevator abnormal state and / or elevator control estimated for each of the plurality of passenger actions, and outputs a notification and / or command representing the identified elevator abnormal state and / or elevator control. The detected passenger action is a stumble or flexion / extension when a passenger gets on the car or when a passenger gets off the car. The identified elevator abnormal state is a state where the car is at a position lower or higher than the correct position. The identified elevator control is a control to raise or lower the car to adjust it to the correct position.

Advantages of the Invention

[0009] According to the present invention, the video data of the surveillance camera provided in the car can be utilized for identifying and / or eliminating an abnormal state peculiar to the elevator.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5A

Figure 5B

Figure 6

Figure 7

Embodiments for Carrying Out the Invention

[0011] In the following description, the "interface device" may be one or more communication interface devices. The one or more communication interface devices may be one or more of the same type of communication interface devices or two or more different types of communication interface devices.

[0012] Also, in the following description, the "memory" is one or more memory devices and may typically be a main memory device. At least one of the memory devices in the memory may be a volatile memory device or a non-volatile memory device.

[0013] Also, in the following description, the "permanent storage device" may be one or more permanent storage devices which are an example of one or more storage devices. The permanent storage device may typically be a non-volatile storage device (e.g., an auxiliary storage device), and specifically, for example, an HDD (Hard Disk Drive), an SSD (Solid State Drive), an NVME (Non-Volatile Memory Express) drive, or an SCM (Storage Class Memory).

[0014] Also, in the following description, the "storage device" may be at least the permanent storage device of the memory and the permanent storage device.

[0015] Also, in the following description, the "processor" may be one or more processor devices. At least one processor device may typically be a microprocessor device such as a CPU (Central Processing Unit), but may also be other types of processor devices such as a GPU (Graphics Processing Unit). At least one processor device may be single-core or multi-core. At least one processor device may be a processor core. At least one processor device may be a circuit that is an aggregate of gate arrays by a hardware description language that performs part or all of the processing (for example, a processor device in a broad sense such as an FPGA (Field-Programmable Gate Array), a CPLD (Complex Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit)).

[0016] Also, in the following description, the function may be described in terms of the expression "yyy section", but the function may be realized by one or more computer programs being executed by a processor, or may be realized by one or more hardware circuits (for example, an FPGA or an ASIC), or may be realized by a combination thereof. When the function is realized by a program being executed by a processor, since the defined processing is performed while appropriately using a storage device and / or an interface device, etc., the function may be regarded as at least part of the processor. The processing described with the function as the subject may also be the processing performed by the processor or a device having the processor. The program may be installed from a program source. The program source may be, for example, a program distribution computer or a computer-readable storage medium (for example, a non-transitory storage medium). The description of each function is an example, and a plurality of functions may be grouped into one function, or one function may be divided into a plurality of functions.

[0017] In the following description, the data from which an output can be obtained for an input may be described using an expression such as "xxxDB" (where "DB" is an abbreviation for database). However, the data may be of any structure (e.g., structured data or unstructured data), and may also be a learning model such as a neural network, a genetic algorithm, or a random forest that generates an output for the input. Therefore, "xxxDB" can be referred to as "xxx data". Further, in the following description, the configuration of the DB is an example, and one DB may be divided into two or more DBs, or all or part of two or more DBs may be one DB.

[0018] Hereinafter, several embodiments of the present invention will be described in detail with reference to the drawings. [First Embodiment]

[0019] FIG. 1 is a schematic explanatory diagram of an entire system including a video surveillance device according to a first embodiment of the present invention.

[0020] The car 1 is provided with a security camera 2 and a video surveillance device 3.

[0021] The security camera 2 is provided inside the car 1 and is photographing the passengers 4 who board the car 1. In this specification, the "passengers" include not only the users who are in the car 1 but also the users who board the car 1 and the users who get off the car 1.

[0022] The video surveillance device 3 has a function of detecting the actions (which may be called action patterns) of the passengers 4 by analyzing the video data of the video photographed by the security camera 2. The method of detecting actions may be, for example, a method of detecting the outline of a person by a known technique and measuring and determining the amount of movement of each part, or a method of learning and determining actions using deep learning.

[0023] The car 1 is controlled to move up and down by an elevator control panel 5, and the video surveillance device 3 is connected to the elevator control panel 5.

[0024] The elevator control panel 5 can not only perform the up and down control of the car 1, but also electrically acquire the states of sensors or switches of various safety devices. The remote monitoring device 6 connected to the elevator control panel 5 electrically acquires the states of various sensors or switches from the elevator control panel 5 and is connected to an external monitoring center 8 via a remote monitoring network 7 (for example, a telephone line or an Internet line). When the remote monitoring device 6 determines that the elevator is in an abnormal state by various sensors or switches, etc., it notifies the monitoring center 8 of the abnormal content and causes the maintenance worker to make an emergency dispatch instruction or implement an inspection plan.

[0025] When the video monitoring device 3 detects a specific action of the passenger 4, it has a function of identifying the abnormal state of the elevator corresponding to the action and giving an abnormal notification, etc. to a specific elevator control or an external monitoring center 8. When performing elevator control, abnormal notification, etc., the video monitoring device 3 is connected to the elevator control panel 5.

[0026] With the above configuration, due to the abnormal state of the elevator associated with a specific action of the passenger 4, the video monitoring device 3 notifies the elevator control panel 5 of the abnormal state and commands the elevator control of the car 1. Also, at the same time, the video monitoring device 3 commands the remote monitoring device 6 to notify the monitoring center via the elevator control panel 5. Thereby, by promoting elevator control, emergency dispatch instruction and / or inspection plan in accordance with the abnormal state of the elevator, early countermeasures become possible. In this figure, when the passenger 4 gets off the car 1 and exits to the landing 9, the floor of the car 1 is lower than that of the landing 9 and a step is generated, and the passenger 4 is in a state of tripping. In this example, the video monitoring device 3 detects the tripping action when the passenger 4 gets off the car, identifies the abnormal state in which a step is generated in the low state of the car 1, and the elevator control panel 5 performs a leveling operation of the car 1 in the upward direction. Also, the remote monitoring device 6 notifies the monitoring center 8 of the abnormal content of the step generation, and the monitoring center 8 gives an emergency dispatch instruction or an inspection plan. Other actions of the passenger 4 and elevator abnormal states will be described later with reference to FIG. 3.

[0027] In this embodiment, the video surveillance device 3 is a device including an interface device, a storage device, and a processor connected thereto, but the functions realized by the device may also be used.

[0028] FIG. 2 is a block diagram showing a configuration example of the video surveillance device 3 according to the first embodiment.

[0029] According to this figure, the video surveillance device 3 has an interface device 201, a storage device 202, and a processor 203 connected thereto.

[0030] Video data is received from the security camera 2 via the interface device 201, and a notification and / or command based on the result of the analysis of the video data is output.

[0031] The storage device 202 stores data and programs. Examples of the data include an abnormality identification DB 32 and an element arrangement DB 39. The abnormality identification DB 32 is an example of abnormality identification data and is a DB representing a plurality of passenger operations and the elevator abnormal states and / or elevator controls estimated for each of the plurality of passenger operations. The element arrangement DB 39 is a DB that detects the positions of one or more elements including the buttons in the car 1 and represents the one or more elements and the positions detected for each of the one or more elements.

[0032] The video analysis unit 31 is realized when the processor 203 executes a program. The video analysis unit 31 analyzes the video data of the security camera 2, detects the actions of the passengers 4, identifies the elevator abnormal states and / or elevator controls associated with the actions from the abnormality identification DB 32, and transmits abnormality notifications and / or commands to the elevator control panel 5 and the remote monitoring device 6. The video analysis unit 31 includes a reception unit 251, an analysis unit 252, and an output unit 253. These functions 251 to 253 will be described later.

[0033] FIG. 3 is a flowchart showing an example of the processing flow according to the first embodiment. This processing may be performed periodically.

[0034] The receiving unit 251 receives the video data of the security camera 2. The analysis unit 252 determines whether the video data is the video data before the start of the elevator operation (for example, the first video data after the start of the video monitoring device 3) (an example of determining whether there is an element arrangement DB 39) (step S1). If the determination result in step S1 is true (step S1: YES), the analysis unit 252 detects the positions of one or more elements including the buttons in the car 1 from the video data, constructs an element arrangement DB 39 representing the one or more elements and the detected positions for each of the one or more elements, and stores the element arrangement DB 39 in the storage device 202. In an embodiment where the element arrangement DB 39 is prepared in advance, or in an embodiment where the element arrangement DB 39 is not required, steps S1 and S2 may be omitted. In other words, steps S1 and S2 may be adopted in the fourth embodiment described later, and may not be adopted in the first embodiment.

[0035] After the start of the elevator operation, the receiving unit 251 receives the video data of the situation inside the car 1 taken by the security camera 2, and the analysis unit 252 monitors the actions of the passengers 4 in the video data (step S3). Specifically, the analysis unit 252 detects the actions of the passengers 4 from the start of boarding to the getting off by analyzing the video data (step S31), and determines whether the detected actions correspond to any of the passenger actions represented by the abnormality identification DB 32 (step S32). The monitoring in step S3 is performed for each passenger shown in the video data.

[0036] When a passenger operation corresponding to any of the passenger operations represented by the abnormality identification DB 32 is detected (step S32: YES), the analysis unit 252 identifies the elevator abnormal state and elevator control associated with the detected passenger operation, and the output unit 253 transmits an elevator control command associated with the identified elevator abnormal state to the elevator control panel 5 (step S5). In response to this command, the elevator control panel 5 controls the car 1. In the example shown in FIG. 1, the control is leveling operation control in the upward direction of the car 1. Also, the abnormal state of the elevator is notified from the elevator control panel 5 to the monitoring center 8 through the remote monitoring device 6, and an emergency dispatch or a notice of an inspection plan may be implemented as necessary.

[0037] FIG. 4 is a diagram showing a configuration example of the abnormality identification DB 32 according to the first embodiment.

[0038] The abnormality identification DB 32 represents a plurality of passenger operations and the elevator abnormal state and elevator control estimated for each of the plurality of passenger operations. In the present embodiment, both the elevator abnormal state and the elevator control are associated with each passenger operation, but for at least one passenger operation, either the elevator abnormal state or the elevator control may be associated.

[0039] Based on the above description, especially with reference to FIG. 4, the following description can be made. Also, the following description may include supplementary explanations of the above description or explanations of modified examples.

[0040] The image monitoring device 3 includes a receiving unit 251, an analysis unit 252, and an output unit 253. The receiving unit 251 receives video data from a security camera 2 (an example of a monitoring camera) provided in the elevator car 1. The analysis unit 252 detects the actions of the elevator passengers 4 from the video data, and identifies, from an abnormality identification DB 32 (an example of abnormality identification data) representing a plurality of passenger actions and the elevator abnormal states and / or elevator controls estimated for each of the plurality of passenger actions, the elevator abnormal state and / or elevator control corresponding to the detected passenger action. The output unit 253 outputs a notification and / or command representing the identified elevator abnormal state and / or elevator control. The elevator control associated with the passenger action is control for eliminating the elevator abnormal state (estimated from the passenger action) associated with the passenger action.

[0041] The detected passenger actions are stumbles or flexions when the passenger 4 gets on the car 1, or stumbles or flexions when the passenger 4 gets off the car 1. The identified elevator abnormal state is a so-called out-of-level state where the car 1 is at a position lower or higher than the correct position (typically, a state where the floor surface of the car 1 is lower or higher than the floor surface of the landing 9). The identified elevator control is control for raising or lowering the car 1 to align it with the correct position.

[0042] For example, when the detected passenger action is not only a stumble when the passenger 4 gets on but also a sudden flexion when getting off, the analysis unit 252 determines that the floor surface of the car 1 is higher than the floor surface of the landing 9. That is, this passenger action is associated with an elevator abnormal state where a step has formed in the upward direction in the elevator car 1. Since the floor surface of the car 1 is higher than the floor surface of the landing 9, the elevator control is a floor leveling operation in the downward direction.

[0043] Further, for example, when the detected passenger movement is not only the movement of passenger 4 tripping when getting off the elevator, but also the movement of suddenly stretching and bending when getting on the elevator, the analysis unit 252 determines that the floor surface of the car 1 is lower than the floor surface of the landing 9. That is, this passenger movement is associated with an abnormal elevator state in which a step is formed in the lower direction of the elevator car 1. Since the floor surface of the car 1 is lower than the floor surface of the landing 9, the elevator control is a leveling operation in the upward direction.

[0044] Further, for example, when the detected passenger movement is the movement of looking back during the boarding or alighting of passenger 4, the analysis unit 252 determines that there is a step in the car 1.

[0045] As described above, according to the present embodiment, there is a connection between passenger movements peculiar to elevators, such as tripping and / or stretching during boarding and / or alighting, and an abnormal state peculiar to elevators called "level deviation" (and / or elevator control for eliminating the abnormal state). By utilizing the video data of the security camera 2 provided in the car 1, the abnormal elevator state can be identified and / or eliminated.

[0046] In step S31, for example, when determining whether the car 1 is low or high, in addition to the passenger movement, for example, whether the threshold of the landing 9 (the floor surface, sill, etc. at the door installation position on the landing 9 side) at that time is shown in the video data may be used as a determination material. For example, when the security camera 2 is provided at the upper rear of the car 1, the analysis unit 252 may determine that the floor surface of the landing 9 is higher than the floor surface of the car 1 if the threshold of the landing 9 is shown in the video data, and determine that the floor surface of the landing 9 is lower than the floor surface of the car 1 if the threshold of the landing 9 is not shown in the video data. That is, it is determined here which is higher, and a leveling operation may be performed in the upward or downward direction by elevator control. That is, either of the following (X) and (Y) can be adopted. As a result, an improvement in the accuracy of identifying the abnormal elevator state is expected (note that the video data used for determining whether the threshold of the landing 9 is shown in the video data may be the video data when the car door is open). (X) In the case of the following (x1) and (x2), the specified elevator abnormal state is a state where the car is at a position lower than the correct position, and / or the specified elevator control is a control to raise the car in order to align the car to the correct position. (x1) The analysis unit 252 detected the threshold of the landing 9 from the video data of the car 1. (x2) The detected passenger movement is the flexion when passenger 4 gets on the car 1, or the stumble when passenger 4 gets off the car 1. (Y) In the case of the following (y1) and (y2), the specified elevator abnormal state is a state where the car is at a position higher than the correct position, and / or the specified elevator control is a control to lower the car in order to align the car to the correct position. (y1) The analysis unit 252 did not detect the threshold of the landing 9 from the video data of the car 1 (for example, it was detected that the threshold of the landing 9 was hidden by the floor of the car 1). (y2) The detected passenger movement is the stumble when passenger 4 gets on the car 1, or the flexion when passenger 4 gets off the car 1.

[0047] As described above, the abnormality specification DB32 is a database that associates the movement (movement pattern) of passenger 4 with the abnormal state of the elevator and the elevator control necessary for coping (resolving) it, and the associated data is not limited to this.

[0048] Also, although not shown in the figure, it is not always necessary to detect the movement of passengers only from the video data by the security camera 2. For example, regarding the stumble when passenger 4 gets off the car in the present embodiment, the change in the load value of the load sensor of the car 1 may be used. In this way, the movement of passenger 4 may be detected by combining the video data of the security camera 2 and the sensor data. Thereby, an improvement in the detection accuracy of passenger movement is expected. [Second Embodiment]

[0049] A second embodiment will be described. In doing so, differences from the first embodiment will be mainly described, and descriptions of commonalities with the first embodiment will be omitted or simplified (this also applies to the third, fourth, and fifth embodiments).

[0050] FIG. 5A is a block diagram showing a configuration example of an entire system including a video surveillance device (video surveillance device integrated with a remote surveillance device) according to the second embodiment.

[0051] In the first embodiment, the video surveillance device 3 was located between the security camera 2 and the elevator control panel 5, but this is not the limit, and it may be further integrated with other devices. For example, as shown in the figure, the video surveillance device 3 may be integrated with the remote surveillance device 6 and be the video surveillance device 33. The video surveillance device 33 may have an interface device 501, a storage device 502, and a processor 503 connected thereto. It may communicate with the elevator control panel 5 and the monitoring center 8 via the interface device 501. Programs and data (for example, the abnormality identification DB 32 and the element arrangement DB 39) may be stored in the storage device 502. By executing the program on the processor 503, the remote monitoring unit 36 and the video analysis unit 31 may be realized. The remote monitoring unit 36 has the functions of the remote monitoring device 6 in the first embodiment. Also, the video analysis unit 31 and the abnormality identification DB 32 (and the element arrangement DB 39) may be the same as in the first embodiment (the element arrangement DB 39 may be omitted).

[0052] The security camera 2 and the elevator control panel 5 installed in the car 1 may be the assets of the elevator owner, and the video surveillance device 3 and the remote surveillance device 6 may mainly be the assets of the elevator maintenance company. For this reason, according to this embodiment, it is possible to connect the assets of the maintenance company without unnecessarily changing the configuration within the asset range of the elevator owner, and the same implementation as in the first embodiment becomes possible. [Third Embodiment]

[0053] FIG. 5B is a block diagram showing a configuration example of an entire system including a video surveillance device (video surveillance device relocated to a network connection destination) according to the third embodiment.

[0054] The video surveillance device 3 does not necessarily have to be installed as a device near the elevator that conducts video surveillance. It may be a video surveillance device 34 whose function is transferred onto the network of the remote surveillance network 7 (for example, on the cloud) connected by the remote surveillance device 6. Only video data is transmitted from the remote surveillance device 6 to the video surveillance device 34 via the remote surveillance network 7, and the video surveillance device 34 returns the abnormal content and control commands of the elevator as the analysis result of the video to the elevator control panel 5 via the remote surveillance device 6.

[0055] According to this embodiment, it is not necessary to install the device of the video surveillance device 3 in each building where the elevator is installed. Since only the video surveillance device 34 that is commonly used with other buildings needs to be installed and maintained on the network, the overall cost can be reduced.

[0056] Note that the system configuration of the video surveillance device 3 is not limited to the embodiments shown in FIGS. 5A and 5B. For example, its function may be provided in a monitoring center, etc. [Fourth Embodiment]

[0057] FIG. 6 is a diagram showing a configuration example of the abnormality identification DB 32 according to the fourth embodiment.

[0058] In the first embodiment, the elevator control (floor alignment operation) was shown in association with the abnormal content of the elevator according to the operation of the passenger 4. However, the elevator control may be a control in a broad sense (elevator-related control) such as only an emergency dispatch instruction or inspection plan for the operator. For example, according to No. 4 in FIG. 6, even if a passenger operation that the passenger 4 touches the side plate is detected and an abnormal state of the elevator such as a scratch or dent on the side plate is identified, it is difficult to immediately respond and improve by the elevator operation control. Therefore, the elevator control may be an elevator-related control (or the control may be unnecessary), and only an abnormal notification to the monitoring center 8, an emergency dispatch instruction for the operator, or an inspection plan may be implemented.

[0059] Regarding the abnormal state of the elevator where elevator control shown in this figure is not performed, there is no requirement that elevator control must not be performed, and some kind of control may be performed.

[0060] In this embodiment, before the start of elevator operation, the analysis unit 252 detects the positions of one or more elements including the buttons in the car 1 from the video data of the security camera 2, and constructs and stores an element arrangement DB 39 (an example of element arrangement data) representing the one or more elements and the positions detected for each of the one or more elements. Some of the passenger actions represented by the abnormality identification DB 32 may be looking at the first element (for example, the ceiling) specified based on the element arrangement DB 39 (for example, looking for a certain period of time or more), and / or touching the second element (for example, a button or a side plate) specified based on the element arrangement DB 39 (for example, touching for a certain period of time or more). In this way, in addition to identifying and / or eliminating the elevator abnormal state, the video data of the security camera 2 can be utilized for constructing the element arrangement DB 39 that is referred to for identifying the elevator abnormal state that does not require elevator control (typically, elevator operation control) (identifying the elements that the passenger 4 is looking at or touching). For example, since the button lights up, the analysis unit 252 can detect the lit element shown in the video as a button. In this way, in order to improve the detection accuracy of the elements, reference data representing the characteristics on the video is prepared for each element to be detected, and the analysis unit 252 may construct the element arrangement DB 39 based on the video data and the reference data. [Fifth Embodiment]

[0061] FIG. 7 is a diagram showing some examples of the camera positions according to the fifth embodiment.

[0062] In the first embodiment, the security camera 2 was installed at the upper rear of the car 1, and the imaging range was directed in the door direction. This is shown as an example of an optimal installation position of the security camera 2 for capturing the actions of the passenger 4 when getting off the elevator.

[0063] In the fifth embodiment, the installation position of the security camera 2 is not limited to the upper rear part of the car 1. For example, according to No. 1 in FIG. 7, by detecting the operation of the passenger 4 staring at the push button, the abnormality of the celli of the push button or the lamp failure in the button is detected. In order to detect the operation of this passenger 4, it is necessary to capture the line of sight of the passenger 4. Therefore, the optimal position for installing the security camera 2 is to capture the front of the passenger 4 as the imaging range from the side of the push button in front of the car 1.

[0064] As described above, in the present invention, the installation position of the security camera 2 is not limited to the upper rear part of the car 1, and it is applicable to the security camera 2 installed at any position.

[0065] As described above, several embodiments have been described, but these are examples for explaining the present invention, and the scope of the present invention is not intended to be limited only to these embodiments. The present invention can be implemented in various other forms. For example, a stumble or flexion / extension associated with an elevator abnormal state may be detected from the video data when it is detected that the position of one or more predetermined parts of the passenger 4 has changed in a specific direction within a certain time.

Explanation of Reference Numerals

[0066] 1 ··· car, 2 ··· security camera, 3 ··· video monitoring device, 4 ··· passenger

Claims

1. A receiving unit that receives video data of a monitoring camera provided in an elevator car; An analysis unit that detects the actions of the passengers of the elevator from the video data, and from abnormal identification data that is data representing a plurality of passenger actions and an elevator abnormal state and / or elevator control estimated for each of the plurality of passenger actions, identifies the elevator abnormal state and / or elevator control corresponding to the detected passenger actions; An output unit that outputs a notification and / or command representing the identified elevator abnormal state and / or elevator control; Comprising; The detected passenger actions are a stumble or flexion when the passenger boards the car, or a stumble or flexion when the passenger gets off the car; The identified elevator abnormal state is a state where the car is at a position lower or higher than the correct position; The identified elevator control is a control to raise or lower the car to align the car with the correct position; A video monitoring device.

2. In the cases of the following (x1) and (x2), the identified elevator abnormal state is a state where the car is at a position lower than the correct position, and / or the identified elevator control is a control to raise the car to align the car with the correct position; (x1) The analysis unit detected a landing sill from the video data of the car; (x2) The detected passenger action is a flexion when the passenger boards the car, or a stumble when the passenger gets off the car; The video monitoring device according to Claim 1.

3. In the cases of the following (y1) and (y2), the identified elevator abnormal state is a state where the car is at a position higher than the correct position, and / or the identified elevator control is a control to lower the car to align the car with the correct position; (y1) The analysis unit did not detect a landing sill from the video data of the car; (y2) The detected passenger action is a stumble when the passenger boards the car, or a flexion when the passenger gets off the car; The video monitoring device according to Claim 1.

4. Before the operation of the elevator starts, the analysis unit detects the positions of one or more elements including the buttons in the car from the video data of the monitoring camera, and stores element arrangement data which is data representing the one or more elements and the positions detected for each of the one or more elements. Some of the passenger operations represented by the abnormality identification data are looking at a first element specified based on the element arrangement data and / or touching a second element specified based on the element arrangement data. The elevator control corresponding to some of the passenger operations is elevator-related control such as manual operation by an operator or creation of an inspection plan. The video monitoring device according to claim 1.

5. A computer receives video data of a monitoring camera provided in an elevator car. The computer detects the operations of the passengers in the elevator from the video data. The computer identifies an elevator abnormal state and / or elevator control corresponding to the detected passenger operation from abnormal identification data which is data representing a plurality of passenger operations and an elevator abnormal state and / or elevator control estimated for each of the plurality of passenger operations. The computer outputs a notification and / or command representing the identified elevator abnormal state and / or elevator control. The detected passenger operation is a stumble or flexion when the passenger gets into the car or when the passenger gets out of the car. The identified elevator abnormal state is a state where the car is at a position lower or higher than the correct position. The identified elevator control is control to raise or lower the car to align the car with the correct position. Video monitoring method.

Images