Elevator control system and elevator control method

Abstract

To improve elevator operation efficiency and reduce waiting times for users waiting on other floors. [Solution] An elevator control system 1 comprises a camera 3 that photographs the elevator hall, a control device 6 that controls the operation of the elevator, including the raising and lowering of the elevator car, based on the registration of a hall call and destination floor, and an image analysis device 5 that analyzes images taken by the camera 3. After a hall call is registered, if the image analysis device 5 detects the presence of a user under observation in the elevator hall and the movement of the user under observation by other means from the image of the elevator hall taken by the camera 3 located on the floor where the hall call was registered, it notifies the control device 6 of a hall call cancellation request, and the control device 6 receives the hall call cancellation request from the image analysis device 5 and cancels the hall call.

Description

[Technical Field]

[0001] The present invention relates to an elevator control system and an elevator control method. [Background Art]

[0002] When the waiting time for an elevator is long, a user may not be able to wait for the arrival of the elevator and choose to move between floors by other means such as stairs or an escalator. Since the elevator call is not canceled, the elevator will move and stop at a floor where no user is present, resulting in a decrease in operation efficiency. In addition, waiting time occurs for other users waiting at other floors, which reduces the convenience and comfort for users.

[0003] On the other hand, in recent years, an increasing number of elevators are equipped with security cameras for crime prevention purposes, and systems that use these security cameras to improve the operation efficiency and comfort of elevators have been proposed. For example, in the technology described in Patent Document 1, learning data is created from images to estimate whether or not a subject will board the elevator, and the operation of the elevator is controlled based on the estimation result, thereby improving operation efficiency. [Prior Art Documents] [Patent Documents]

[0004] [Patent Document 1] Japanese Unexamined Patent Publication No. 2021-80077 [Summary of the Invention] [Problem to be Solved by the Invention]

[0005] However, in the invention described in Patent Document 1, when a user leaves the elevator hall, for example by choosing to move between floors by another means such as stairs or an escalator, there are problems such as reduced operation efficiency and increased waiting time for users at other floors.

[0006] Furthermore, the invention described in Patent Document 1 has the problem that, because it acquires an image when the elevator arrives at the destination floor and determines whether the person is getting on, the elevator call cannot be canceled while the elevator is moving.

[0007] Given the above situation, there was a demand for improving the efficiency of elevator operation and reducing waiting times for users waiting on other floors. [Means for solving the problem]

[0008] To solve the above problems, an elevator control system according to one aspect of the present invention is an elevator control system comprising: a camera that photographs the elevator hall; a control device that controls the operation of the elevator, including the raising and lowering of the elevator car, based on the registration of the hall call and destination floor; and an image analysis device that analyzes the images captured by the camera. After a hall call is registered, the image analysis device detects the presence of a user under observation in the elevator hall and the user's movement by other means from images of the elevator hall taken by a camera located on the floor where the hall call was registered. In such cases, the device notifies the control unit of a hall call cancellation request. The control unit receives the hall call cancellation request from the image analysis device and cancels the hall call. [Effects of the Invention]

[0009] According to at least one aspect of the present invention, by canceling a hall call when the conditions for cancellation are met, even if the hall call has been registered, it is possible to improve the operational efficiency of the elevator and reduce the waiting time for users waiting on other floors. Other issues, configurations, and effects not mentioned above will be clarified by the following description of embodiments for carrying out the invention. [Brief explanation of the drawing]

[0010] [Figure 1] This is a schematic diagram showing an example configuration of an elevator control system according to the first embodiment of the present invention. [Figure 2]This is a block diagram showing an example of the hardware configuration of a computer included in an image analysis device and elevator control device according to a first embodiment of the present invention. [Figure 3] This is a block diagram showing an example configuration of an image analysis device according to the first embodiment of the present invention. [Figure 4] This is a block diagram showing an example configuration of an elevator control device according to the first embodiment of the present invention. [Figure 5] This is a conceptual diagram showing an example of a person's movement in the elevator hall that triggers a cancellation in the hall call cancellation process according to the first embodiment of the present invention. [Figure 6] This is a conceptual diagram showing an example (1) of a person's actions in the elevator hall 2 that do not fall under the conditions for cancellation in the hall call cancellation processing according to the first embodiment of the present invention. [Figure 7] This is a conceptual diagram showing an example (2) of a person's actions in an elevator hall that do not fall under the conditions for cancellation in the hall call cancellation processing according to the first embodiment of the present invention. [Figure 8] This flowchart shows an example of the procedure for hall call cancellation processing by an image analysis device according to the first embodiment of the present invention. [Figure 9] This is a block diagram showing an example configuration of an image analysis device according to a second embodiment of the present invention. [Figure 10] This is a conceptual diagram illustrating an example of a person's movement within an elevator hall, according to a second embodiment of the present invention. [Figure 11] This flowchart shows an example of the procedure for Hall call cancellation processing by an image analysis device according to a second embodiment of the present invention. [Modes for carrying out the invention]

[0011] Hereinafter, examples of embodiments for carrying out the present invention (hereinafter referred to as "embodiments") will be described with reference to the attached drawings. In the present specification and the accompanying drawings, common components or similar components are assigned the same reference numerals, and duplicate descriptions are omitted. Further, when there are a plurality of identical or similar components, the same reference numeral may be added with different suffixes in the description. The number of each component may be singular or plural unless otherwise specified.

[0012] <First Embodiment> (1-1) Configuration of elevator control system according to the first embodiment First, an elevator control system according to a first embodiment of the present invention will be described. FIG. 1 is a schematic diagram showing a configuration example of an elevator control system according to the first embodiment. The elevator control system 1 shown in FIG. 1 includes a camera 3 installed in an elevator hall 2, a car 4, an image analysis device 5 connected to the same network as the camera 3 and the car 4, and an elevator control device 6. In the elevator hall 2, a call button 7 for issuing a hall call is installed near the elevator landing.

[0013] The camera 3 is a general-purpose imaging device installed in the elevator hall 2. The camera 3 captures images of the state of the elevator hall 2 and transmits video data obtained by the imaging to the image analysis device 5. The installation location of the camera 3 is not limited to the location shown in FIG. 1 as long as it is a location where the position and behavior of a user of the elevator hall 2 and the call button 7 can be imaged. The same applies to other drawings. A camera mounted on a moving body such as a guide robot may be used as the camera 3.

[0014] The image analysis device 5 is a computer device having a function of notifying the elevator control device 6 of a hall call cancellation request based on the video of the elevator hall 2 captured by the camera 3.

[0015] The elevator control device 6 (an example of a control device) is a control device that performs operation control of the entire elevator including control of the car 4.

[0016] The following describes the hardware configuration of the computers in the image analysis device 5 and the elevator control device 6, with reference to Figure 2. Figure 2 is a block diagram showing an example of a computer hardware configuration. The computer 40 shown in Figure 2 is an example of hardware used as a computer.

[0017] Computer 40 includes a CPU (Central Processing Unit) 41, ROM (Read Only Memory) 42, and RAM (Random Access Memory) 43 connected to a system bus. Furthermore, computer 40 includes a display device 44, an input device 45, non-volatile storage 46, and a network interface 47. The CPU 41, ROM 42, and RAM 43 are examples of control units.

[0018] The CPU 41 reads the software program code from the ROM 42, loads it into the RAM 43, and executes it. Variables and parameters generated during the CPU 41's calculation process are temporarily written to the RAM 43, and these variables and parameters are read out by the CPU 41 as needed. By executing the program code read from the ROM 42, the CPU 41 realizes the functions of each functional block that realizes the functions of the image analysis device 5 (Figure 3 described later) and the elevator control device 6 (Figure 4 described later). However, other processors such as an MPU (Micro Processing Unit) may be used instead of the CPU 41.

[0019] Non-volatile storage 46 is an example of a recording medium that can store data used by a program or data obtained by executing a program. The OS (Operating System) or programs executed by the CPU 41 may be recorded on the non-volatile storage 46. Examples of non-volatile storage 46 include HDDs (Hard Disk Drives), SSDs (Solid State Drives), optical discs that utilize light or magnetism, or semiconductor memory cards.

[0020] For example, the multiple storage compartments (Figure 3) of the image analysis device 5 are configured using non-volatile storage 46. Similarly, the multiple storage compartments (Figure 4) of the elevator control device 6 are configured using non-volatile storage 46.

[0021] The display device 44 is a monitor such as a liquid crystal display, and displays a GUI (Graphical User Interface) screen or the results of calculations performed by the CPU 41. The input device 45 generates input signals in response to user operations and outputs them to the CPU 41. For example, the input device 45 can be a mouse, keyboard, or touch sensor, and the user can input information or instructions by operating the input device 45. The display device 44 and the input device 45 may be configured as an integrated touch panel.

[0022] The network interface 47 uses a communication device such as a NIC (Network Interface Card). The network interface 47 connects to a public communication line via a communication network such as a LAN or a dedicated line connected to the communication device such as the NIC, and transmits and receives various types of data with external devices.

[0023] Furthermore, the computer 40 of the image analysis device 5 and the elevator control device 6 does not necessarily have to be equipped with a display device 44 and an input device 45. For example, an engineer or the like may access the image analysis device 5 from an external terminal device via a network interface 47 and utilize the functions of the person detection setting GUI 24 of the image analysis device 5.

[0024] Next, the configuration of the image analysis device 5 according to this embodiment will be described with reference to Figure 3. Figure 3 is a block diagram showing an example configuration of the image analysis device 5. As shown in Figure 3, the image analysis device 5 is configured to include a camera video receiving unit 20, a camera setting storage unit 21, a person detection unit 22, a person detection model storage unit 23, a person detection setting GUI 24, a passage line coordinate storage unit 25, a button press receiving unit 26, a hall call cancellation determination unit 27, and a determination result transmission unit 28.

[0025] The camera settings storage unit 21 stores the IP address of each camera and parameter values ​​(configuration) indicating which floor the camera is located on.

[0026] The camera video receiver 20 acquires the video captured by the camera 3. For example, the camera video receiver 20 receives video using the RTSP (Real Time Streaming Protocol) protocol in a typical IP (Internet Protocol) camera and converts it from an encoded format such as H.264 to an RGB image. The camera video receiver 20 sends the RGB image and camera position information to the person detection unit 22.

[0027] The person detection model storage unit 23 stores the person detection model and the parameter values ​​(configuration) used for that person detection model. The person detection model is, for example, a machine learning model that detects people in a specific area of ​​an image. The parameter values ​​used for the person detection model include, for example, the size of the object detected in the image, the specified number of frames for object detection, and the confidence level (threshold) of the detected object. The parameter values ​​can be changed by engineers, etc., using the person detection setting GUI 24.

[0028] The person detection setting GUI24 provides engineers and others with an interface to set the coordinates of the line that detects the passage of a person (hereinafter referred to as the "passage line"). The coordinates are numerical representations of the position on the X-axis and the Y-axis perpendicular to it on the image captured by camera 3. The set coordinates are sent to the passage line coordinate storage unit 25.

[0029] The passage line coordinate storage unit 25 stores the coordinates of the passage line (passage line L in Figure 5, described later) that detects the passage of a person. The coordinates of the passage line consist of two points set in the person detection setting GUI 24. However, the passage line may also be a polyline or curve represented by connecting three or more points.

[0030] The person detection unit 22 uses a person detection model and parameter values ​​to detect people within the entire area of ​​the RGB image converted by the camera image receiving unit 20. The person detection unit 22 also identifies and tracks each person detected on the RGB image. That is, the person detection unit 22 tracks the movement of the target person and records the person's coordinates linked to time as tracking information. The person detection unit 22 then determines whether the person has crossed the passage line L (hereinafter referred to as "passage line crossing determination") and sends the determination result to the hall call cancellation determination unit 27.

[0031] The button press receiving unit 26 receives a notification (hereinafter referred to as "hall call button press notification") transmitted by the elevator control device 6 indicating that the call button 7 in the elevator hall 2 has been pressed. The button press receiving unit 26 sends the hall call button press notification to the hall call cancellation determination unit 27. The hall call button press notification is sometimes simply referred to as "notification".

[0032] The hall call cancellation determination unit 27 identifies the person (user) who pressed the call button 7 based on the information about the floor the button was pressed for, which is included in the notification from the button press reception unit 26, and the notification from the person detection unit 22. The hall call cancellation determination unit 27 also determines whether the user who was waiting for the elevator has crossed the passage line. The hall call cancellation determination unit 27 then sends the determination result to the determination result transmission unit 28.

[0033] The judgment result transmission unit 28 sends the judgment result of the hall call cancellation judgment unit 27 to the elevator control device 6. The functions of this judgment result transmission unit 28 and the button press receiving unit 26 are realized using the network interface 47.

[0034] Here, the hall call cancellation determination unit 27 sends a determination result to the determination result transmission unit 28 only if it determines that the user has crossed the passage line and is no longer there. When this determination result is transmitted to the elevator control device 6 via the determination result transmission unit 28, the hall call is canceled in the elevator control device 6. In other words, the process by which the hall call cancellation determination unit 27 transmits the determination result to the determination result transmission unit 28 is equivalent to requesting the cancellation of the hall call (a "hall call cancellation request" described later). Hereafter, the act of the hall call cancellation determination unit 27 transmitting the transmission result will be described as "notifying a hall call cancellation request". The hall call cancellation determination unit 27 may also be configured to notify a hall call cancellation request based on the transmission result.

[0035] Next, the configuration of the elevator control device 6 according to this embodiment will be described with reference to Figure 4. Figure 4 is a block diagram showing an example configuration of the elevator control device 6. As shown in Figure 4, the elevator control device 6 is configured to include an elevator operation control unit 30, a call registration unit 31, a destination floor registration unit 32, a lifting / lowering control unit 33, a door opening / closing control unit 34, a door opening / closing detection unit 35, a hall call notification unit 36, and a cancellation request receiving unit 37.

[0036] The elevator operation control unit 30 controls the operation of the elevator car 4. The elevator operation control unit 30 performs various calculations to control the operation of the entire elevator car 4, including the elevator speed and the opening and closing of the car doors. The elevator operation control unit 30 sends the calculation results to the call registration unit 31, the destination floor registration unit 32, the lifting / lowering control unit 33, the door opening / closing control unit 34, and the door opening / closing detection unit 35.

[0037] The call registration unit 31 registers a hall call based on the call information sent from the call button 7 in the elevator hall 2. The call registration unit 31 sends the call floor registered in the hall call registration to the elevator operation control unit 30 and the hall call notification unit 36.

[0038] The hall call notification unit 36 ​​sends a hall call button press notification, which includes information about the calling floor, received from the call registration unit 31, to the image analysis device 5.

[0039] The destination floor registration unit 32 registers the destination floor based on the information sent from the destination floor registration button inside the elevator car 4. The destination floor registration unit 32 then sends the registered destination floor to the elevator operation control unit 30.

[0040] The elevator operation control unit 30 outputs an operation command to the lifting control unit 33 according to the registered destination floor and call floor.

[0041] The lifting control unit 33 controls the operation of the hoisting machine (not shown) that winds up the main rope in response to the operation command sent from the elevator operation control unit 30, thereby moving the elevator car 4 to the landing floor or destination floor.

[0042] The door opening / closing detection unit 35 detects when the doors of the elevator car 4 are fully open or fully closed based on the detection results from the opening / closing sensors (or opening / closing switches) installed on the elevator car 4. The door opening / closing detection unit 35 sends the detection results to the elevator operation control unit 30. The elevator operation control unit 30 generates an opening / closing command for the doors of the elevator car 4 according to the detection results from the door opening / closing detection unit 35.

[0043] The door opening / closing control unit 34 controls the opening and closing of the elevator car doors in response to the car door opening / closing command sent from the elevator operation control unit 30. The landing doors on each floor of the building structure open and close in conjunction with the car doors. The door opening / closing control unit 34 opens the car doors of the elevator car 4 when it arrives at the landing floor, the destination floor, or both. After a predetermined time has elapsed since the car doors were opened, the door opening / closing control unit 34 closes the car doors.

[0044] The cancellation request receiving unit 37 receives a hall call cancellation request sent by the image analysis device 5. The cancellation request receiving unit 37 sends the received hall call cancellation request to the elevator operation control unit 30. The elevator operation control unit 30 cancels the hall call registration for the corresponding floor based on the hall call cancellation floor information included in the hall call cancellation request. The cancellation request receiving unit 37 and the hall call notification unit 36 ​​can be configured using a network interface 47.

[0045] (1-2) Hall call cancellation process Next, a series of processes for canceling a Hall call (hereinafter referred to as the "Hall call cancellation process") performed in the image analysis device 5 of the elevator control system 1 according to the first embodiment will be described with reference to Figures 8 and 5 to 7. Figure 8 is a flowchart showing an example of the procedure for Hall call cancellation processing by the image analysis device 5.

[0046] Figure 5 shows an example of a person's movement within elevator hall 2 that triggers a cancellation in the hall call cancellation process. In Figure 5, the area indicated by the dashed line represents the field of view 9 of camera 3. A passage line L is set in the lower left of field of view 9. This example shows the path (A1) when person A moves from outside field of view 9 (right side) towards the elevator inside field of view 9, and the path (A2) when person A moves from inside field of view 9 (center side) across passage line L towards stairs 8 outside field of view 9 (left side). Although there is only one passage line L in Figure 5, there may be multiple.

[0047] Figure 6 also shows an example (1) of a person's movement within elevator hall 2 that does not meet the conditions for cancellation in the hall call cancellation process. This example shows the path (A3) when person A passes through elevator hall 2 from outside the field of view 9 (right side) and crosses the passage line L without calling the elevator.

[0048] Furthermore, Figure 7 also shows an example (2) of a person's movement within elevator hall 2 that does not meet the conditions for cancellation in the hall call cancellation process. This example shows the path (A1) when person A moves from outside (right side) of field of view 9 towards the elevator inside field of view 9, and the path (A4) when person A moves from inside (center side) of field of view 9 to outside (right side) of field of view 9 without crossing the passage line L.

[0049] The Hall call cancellation process shown in Figure 8 starts after the image analysis device 5 is activated. In Figure 8, the person detection unit 22 of the image analysis device 5 first analyzes the RGB image from camera 3 received from the camera image receiving unit 20 and determines whether a person has been detected based on the analysis results (S1). If a person is detected in the determination in step S1 (YES in S1), the process proceeds to step S2; if a person is not detected (NO in S1), the process proceeds to step S6.

[0050] The person detection unit 22 then determines whether or not there is a person being detected for the first time among the people it has detected (S2). For example, when person A, as shown in Figure 5, moves from outside the field of view 9 towards the elevator inside the field of view 9 (A1), it is determined to be the first detection. If a negative result (NO in S2) is obtained in the determination in step S2, the process proceeds to step S4.

[0051] Then, if the person detection unit 22 obtains a positive result (YES in S2) in the determination in step S2, it adds that person to the tracking target and starts tracking (S3). In order to identify each person during tracking, the person detection unit 22 sets a unique ID for each person.

[0052] Furthermore, the person detection unit 22 analyzes the RGB image captured by the camera 3 and obtains tracking information (coordinates) for each person from the analysis results. The person detection unit 22 then determines whether the person being tracked has passed through the passage line L, which is formed by the coordinates stored in the passage line coordinate storage unit 25, as set by the person detection setting GUI 24 (S4). For example, when person A, as shown in Figure 5, moves from within the field of view 9 across the passage line L towards the stairs 8 outside the field of view 9 (A2), it is determined that the person has passed through.

[0053] Then, if the person detection unit 22 obtains a positive result (YES in S4) in the determination in step S4, it sets that person as a person who has crossed the line in order to identify them (S5).

[0054] Next, if the result in step S1 is negative (NO in S1), if the result in step S4 is negative (NO in S4), or after processing in step S5, the person detection unit 22 notifies the hall call cancellation determination unit 27 of the person detection result and the set information (S6).

[0055] Next, the hall call cancellation determination unit 27 determines whether the button press receiving unit 26 has received a hall call button press notification from the elevator control device 6 (S7).

[0056] Then, if the hall call cancellation determination unit 27 obtains a positive result (YES in S7) in the determination in step S7, it determines the person who pressed the call button 7 (S8). One method for determining the person who pressed the call button 7 is to use person detection to identify the person closest to the call button 7 in the elevator hall 2 at the moment the hall call button press notification arrives at the image analysis device 5. However, this is not the only method, and there are also methods that use machine learning models to detect the action of pressing the call button 7. However, the determination method is not limited to these.

[0057] Next, the hall call cancellation determination unit 27 sets the person who pressed the determined call button 7 as a target for attention by associating it with the unique ID for each person notified by the person detection unit 22 (S9).

[0058] Next, if the result in step S7 is negative (NO in S7) or after processing in step S9, the hall call cancellation determination unit 27 determines whether there is a person set as a person crossing the line in the person detection notification from the person detection unit 22 (S10).

[0059] Then, if the hall call cancellation determination unit 27 obtains a positive result (YES in S10) in the determination in step S10, it determines whether the person set as the target of attention and the person who crossed the line are the same person (S11).

[0060] Then, if the hall call cancellation determination unit 27 obtains a positive result (YES in S11) in the determination in step S11, it notifies the elevator control device 6 of the hall call cancellation request through the determination result transmission unit 28 (S12).

[0061] Next, the hall call cancellation determination unit 27 sets the person who was set as a target for attention as a person who is not a target for attention (S13).

[0062] On the other hand, as shown in Figure 6, a person who merely passes through elevator hall 2 is included in the tracking target when captured by camera 3, but is not set as a target for attention because there is no notification that they pressed the call button 7 (A3). Therefore, the request to cancel the hall call is not notified.

[0063] Furthermore, as shown in Figure 7, after pressing the call button 7, a person waiting outside the field of view 9 of camera 3 is not detected as a person crossing the line (A4). Therefore, a hall call cancellation request is not notified.

[0064] After processing in step S13, the person detection unit 22 and the hall call cancellation determination unit 27 return to step S1 and execute steps S1 and beyond in the same manner as described above. Also, if the result in step 10 is negative (NO in S10) or if the result in step 11 is negative (NO in S11), the process returns to step S1.

[0065] (1-3) Effects of the first embodiment The elevator control system of the first embodiment, having the above configuration, can detect when a user moves to another floor by means of stairs, escalators, or other means, and can determine whether it is necessary to continue calling for the elevator. This limits the unnecessary movement of the elevator. Therefore, according to this elevator control system, even if a hall call is registered, if the conditions for cancellation are met, the hall call can be canceled, thereby improving the efficiency of elevator operation and reducing the waiting time for users waiting on other floors.

[0066] <Second Embodiment> (2-1) Configuration of the elevator control system according to the second embodiment Next, an elevator control system according to a second embodiment of the present invention will be described with reference to Figures 9 to 11. The elevator control system and elevator control device according to the second embodiment are configured in the same manner as the elevator control system 1 (Figure 1) and elevator control device 6 (Figure 4) according to the first embodiment.

[0067] The difference between the elevator control method according to the second embodiment and the elevator control method according to the first embodiment is that multiple users can be seen within the field of view 9 of camera 3, a person who has made an elevator hall call has crossed the passage line L, and a person who has not made an elevator hall call is waiting for the elevator. Here, the configuration of the elevator control system according to the second embodiment, the movement of people, and the processing procedure for canceling elevator hall calls will be described, and the explanation of configurations that overlap with the first embodiment will be omitted.

[0068] Figure 9 is a block diagram showing an example configuration of the image analysis device 5A according to the second embodiment. The image analysis device 5A is configured similarly to the image analysis device 5 according to the first embodiment, except that a detection area coordinate storage unit 29 is added, which stores the coordinates of the area in which a person is detected.

[0069] The person detection setting GUI24 provides an interface for setting the coordinates of the area where people are detected (hereinafter referred to as the "detection area") and the coordinates of the line L that the person passes through. The coordinates are numerical representations of the positions on the X-axis and the Y-axis perpendicular to it on the image captured by the camera 3. The set coordinates are sent to the detection area coordinate storage unit 29 and the line coordinate storage unit 25, respectively.

[0070] The detection area coordinate storage unit 29 stores the coordinates of the detection area (detection area 10 shown in Figure 10, which will be described later). The coordinates of the detection area consist of three or more points set in the person detection setting GUI 24.

[0071] Similar to the first embodiment, the person detection unit 22 uses a person detection model and parameter values ​​to detect people within the entire area of ​​the RGB image converted by the camera image receiving unit 20. The person detection unit 22 also identifies and tracks each person detected on the RGB image. Furthermore, the person detection unit 22 determines whether a person has stayed in the detection area 10 for a specified time or longer (resident determination) and whether they have crossed the passage line, and sends the determination result to the hall call cancellation determination unit 27. The time until a person is determined to be a resident is included in the parameter value (configuration) and can be changed using the person detection setting GUI 24.

[0072] (2-2) Hall call cancellation process Next, the hall call cancellation process performed in the image analysis device 5A of the elevator control system 1 according to the second embodiment will be described with reference to Figures 11 and 10. Figure 11 is a flowchart showing an example of the procedure for Hall call cancellation processing by the image analysis device 5A. In the explanation of the flowchart in Figure 11, the same or similar processing steps as in Figure 8 are given the same step numbers.

[0073] Figure 10 shows an example of a person's movement within elevator hall 2 that triggers a cancellation in the hall call cancellation process. In Figure 10, the area shown by the thin dashed line represents the field of view 9 of camera 3, and the area shown by the thick, coarse dashed line represents the detection area 10. The figure shows the paths (A1) and (B1) when person A and person B move from outside the field of view 9 (right and left sides, respectively) towards the elevator inside the field of view 9, and then the paths (A2) and (B2) when person A and person B move from inside the field of view 9 (center side) across the passage line L towards the stairs 8 outside the field of view 9 (left side).

[0074] In the second embodiment, the flow of the hall call cancellation process will be explained using as an example the case where person A moves into the field of view 9 (A1), person A makes an elevator hall call, person B moves into the field of view 9 (B1), person A moves to the stairs 8 (A2), and person B moves to the stairs 8 (B2).

[0075] The Hall call cancellation process shown in Figure 11 is started after the image analysis device 5A is activated, similar to the first embodiment. In Figure 11, the person detection unit 22 of the image analysis device 5A first analyzes the RGB image from camera 3 received from camera image receiving unit 20 and determines whether a person has been detected based on the analysis results (S1). If a person is detected in the determination in step S1 (YES in S1), the process proceeds to step S2; if a person is not detected (NO in S1), the process proceeds to step S6.

[0076] The person detection unit 22 then determines whether or not there is a person being detected for the first time among the detected people (S2). For example, when person A and person B, as shown in Figure 10, move from outside the field of view 9 towards the elevator inside the field of view 9 (A1)(B1), it is determined that this is the first detection. If a negative result (NO in S2) is obtained in the determination in step S2, the process proceeds to step S21.

[0077] Then, if the person detection unit 22 obtains a positive result (YES in S2) in the determination in step S2, it adds that person to the tracking target and starts tracking (S3). In order to identify each person during tracking, the person detection unit 22 sets a unique ID for each person.

[0078] Furthermore, the person detection unit 22 analyzes the RGB image captured by the camera 3 and obtains tracking information (coordinates) for each person from the analysis results. The person detection unit 22 then determines whether there is a person being tracked within the area (detection area 10) enclosed by the coordinates stored in the detection area coordinate storage unit 29, which are set by the person detection setting GUI 24. In addition, the person detection unit 22 measures the time a person stays in the detection area 10, and determines whether they have stayed for a time longer than the time specified by the parameter value stored in the person detection model storage unit 23 (S21).

[0079] One method for measuring the time spent in the area is to obtain the time on the image analysis device 5A at the time of the initial detection of a person in the detection area 10 in step S2, and then calculate the time by comparing it with the current time each time the step is repeated. However, the detection method is not limited to this.

[0080] Then, if the person detection unit 22 obtains a positive result (YES in S21) in the determination in step S21, it sets that person as a resident (S22) so that it can be identified. Similarly, if a person obtains a negative result (NO in S21) in the determination in step S21, they are set as a non-resident (S23). Non-residents include people who were once set as residents but have since left the detection area 10. After processing in step S22 or step S23, the process proceeds to step S4.

[0081] Furthermore, the person detection unit 22 analyzes the RGB image captured by the camera 3 and obtains tracking information (coordinates) for each person from the analysis results. The person detection unit 22 then determines whether the person being tracked has passed the passage line L (S4). For example, when person A and person B, as shown in Figure 10, move from within the field of view 9 across the passage line L towards the stairs 8 outside the field of view 9 (A2)(B2), it is determined that they have passed the line.

[0082] Then, if the person detection unit 22 obtains a positive result (YES in S4) in the determination in step S4, it sets that person as a person who has crossed the line in order to identify them (S5).

[0083] Next, if the result in step S1 is negative (NO in S1), if the result in step S4 is negative (NO in S4), or after processing in step S5, the person detection unit 22 notifies the hall call cancellation determination unit 27 of the person detection result and the set information (S6).

[0084] Next, the hall call cancellation determination unit 27 determines whether the button press receiving unit 26 has received a hall call button press notification from the elevator control device 6 (S7).

[0085] Then, if the hall call cancellation determination unit 27 obtains a positive result (YES in S7) in the determination in step S7, it determines the person who pressed the call button 7 (S8).

[0086] Next, the hall call cancellation determination unit 27 sets the person who pressed the determined call button 7 as a target for attention by associating it with the unique ID for each person notified by the person detection unit 22 (S9).

[0087] Next, if the result in step S7 is negative (NO in S7) or after processing in step S9, the hall call cancellation determination unit 27 determines whether there is a person set as a resident in the person detection notification from the person detection unit 22 (S24).

[0088] Then, if the hall call cancellation determination unit 27 obtains a positive result (YES in S24) in the determination in step S24, it sets the person who has been identified as a resident as a target for attention by linking them with the unique ID for each person notified by the person detection unit 22 (S25).

[0089] Next, if the result in step S24 is negative (NO in S24) or after processing in step S25, the hall call cancellation determination unit 27 determines whether there is a person set as a person crossing the line in the person detection notification from the person detection unit 22 (S10).

[0090] Then, if the hall call cancellation determination unit 27 obtains a positive result (YES in S10) in the determination in step S10, it determines whether the person set as the person to be watched and the person who crossed the line are the same person (S11). Here, the person to be watched includes the person who pressed the call button 7 set as the person to be watched in step S9, and the person staying there set as the person to be watched in step S25.

[0091] Then, if the hall call cancellation determination unit 27 obtains a positive result (YES in S11) in the determination in step S11, it determines whether there are other persons who are staying within the detection area 10 without crossing the passage line L and are also under observation (S26). Here, it is assumed that all persons set as under observation will be checked to see if they have crossed the passage line L. If a positive result (YES in S26) is obtained in the determination in step S26, the process proceeds to step S13.

[0092] In the determination in step S26, if the person crossing the line is the person being watched and there are no other people being watched (NO in S26), the hall call cancellation determination unit 27 notifies the elevator control device 6 of the hall call cancellation request through the determination result transmission unit 28 (S12).

[0093] For example, when person A, as shown in Figure 10, moves from within field of view 9 across the passage line L towards the stairs 8 outside of field of view 9 (A2), no hall call cancellation request is notified because person B remains as a resident within the detection area 10. Subsequently, when person B moves from within field of view 9 across the passage line L towards the stairs 8 outside of field of view 9 (B2), a hall call cancellation request is notified because the person set as a resident is no longer within the detection area 10.

[0094] Next, the hall call cancellation determination unit 27 sets the persons who were set as targets for observation, i.e., persons who have crossed the passage line L and persons who remain in the detection area 10 as persons who are not targets for observation (S13).

[0095] After processing in step S13, the person detection unit 22 and the hall call cancellation determination unit 27 return to step S1 and execute steps S1 and beyond in the same manner as described above. Also, if the result in step 10 is negative (NO in S10) or if the result in step 11 is negative (NO in S11), the process returns to step S1.

[0096] (2-3) Effects of the second embodiment The elevator control system of the second embodiment, having the above configuration, can detect when multiple users are waiting for the elevator and move to another floor by means of stairs, escalators, or other means, and can determine whether it is necessary to continue calling for the elevator. This limits the unnecessary movement of the elevator. Therefore, according to this elevator control system, even if a hall call is registered, if the conditions for cancellation are met, the hall call can be canceled, thereby improving the operational efficiency of the elevator and reducing the waiting time of users waiting on other floors.

[0097] <The invention shown in the above-described embodiment> The embodiments described above illustrate the inventions of the following means. In the descriptions of the means below, the corresponding component names, expressions, and reference numerals used in the drawings in the embodiments described above are noted in parentheses for reference. However, the components of each invention are not limited to these notes.

[0098] [Invention relating to means (1)] This elevator control system comprises a camera that photographs the elevator hall, a control device that controls the operation of the elevator, including the raising and lowering of the elevator car, based on hall calls and registration of destination floors, and an image analysis device that analyzes images captured by the camera. After a hall call is registered, the image analysis device detects the presence of a user under observation in the elevator hall and the user's movement by other means from the image of the elevator hall taken by the camera located on the floor where the hall call was registered, and notifies the control device of a hall call cancellation request. The control device receives the hall call cancellation request from the image analysis device and cancels the hall call.

[0099] This elevator control system, after a hall call is registered, detects the presence of a user under surveillance in the elevator hall and whether that user is moving by means other than the elevator. This allows the system to infer that a user who might have used the elevator on the calling floor has decided against using it and left the elevator hall. At this point, the elevator control system can cancel the hall call for that floor, thereby improving elevator operation efficiency and reducing waiting times for users on other floors.

[0100] [Invention relating to means (2)] A line is set on the above image to detect the movement of the user being watched by another means. The image analysis device notifies the control device of the hall call cancellation request when the user being watched passes the line on the image. The elevator control system described in (1) above.

[0101] In this configuration, the elevator control system estimates that a user has moved by other means when the user being monitored passes a line set on the image. Therefore, this elevator control system can easily detect when a user moves by other means and estimate that the user has left the elevator hall.

[0102] [Invention relating to means (3)] The image analysis device detects from the image above that the person who pressed the call button installed in the elevator hall is the user being monitored. The elevator control system described in (2) above.

[0103] This elevator control system can identify users who wish to use the elevator directly by detecting the person who presses the call button as a user to be monitored.

[0104] [Invention relating to means (4)] The above image analysis device also detects individuals who stay in the designated detection area on the image for a predetermined period of time or longer as users of the target of attention. The image analysis device notifies the control device of the hall call cancellation request when all persons who pressed the call button and all persons who stayed in the detection area for a predetermined time or longer have passed through the line. The elevator control system described in means (3) above.

[0105] This elevator control system, in addition to detecting the person who presses the call button, also identifies individuals who remain in the elevator hall for a predetermined period of time or longer as users under surveillance. This allows for the identification of users who are likely to use the elevator, in addition to those who directly wish to use it, while they are in the elevator hall.

[0106] [Invention relating to means (5)] The above line is set on the path from the elevator hall to the location of the other means in the above image. The elevator control system described in means (3) or (4) above.

[0107] In this configuration, the elevator control system has the above line set on the path from the elevator hall to a location accessible by another means, as shown in the image above, so it can reliably detect when a user moves by another means.

[0108] [Invention relating to means (6)] The image analysis device determines that the user being watched has crossed the line on the image when the user crosses the line on the image from the center of the image outwards. The elevator control system described in (5) above.

[0109] In this configuration, the elevator control system determines that a user has crossed the line on the image when the user moves from the center of the image outwards. Therefore, it can detect that a user has crossed the line, taking into account the direction of the user's movement. Thus, by taking into account the direction of the user's movement, this elevator control system can more reliably detect if the user moves by other means.

[0110] [Invention relating to means (7)] An elevator control method using an elevator control system comprising: a camera that photographs the elevator hall; a control device that controls the operation of the elevator, including the raising and lowering of the elevator car, based on the registration of hall calls and destination floors; and an image analysis device that analyzes images captured by the camera, In the above image analysis device, after a hall call is registered, the device performs a process to detect the presence of a user under observation in the elevator hall and the movement of the user under observation by other means, based on images of the elevator hall taken by the camera located on the floor where the hall call was registered. The above image analysis device includes a process of notifying the control device of a Hall call cancellation request based on the detection result, The control device includes a process of receiving a Hall call cancellation request from the image analysis device and canceling the Hall call. Elevator control method.

[0111] The present invention is not limited to the embodiments described above, and various other modifications and applications are possible as long as they do not depart from the gist of the invention as described in the claims. For example, the embodiments described above are detailed and specific in order to explain the present invention in an easy-to-understand manner, and are not necessarily limited to those comprising all the components described. Furthermore, it is possible to add, replace, or delete other components in the configuration of each embodiment.

[0112] Furthermore, some or all of the above configurations, functions, and processing units may be implemented in hardware, for example, by designing them as integrated circuits. Broadly defined processor devices such as FPGAs (Field Programmable Gate Arrays) and ASICs (Application Specific Integrated Circuits) may be used as hardware.

[0113] Furthermore, in the embodiments described above, the control lines and information lines shown are those deemed necessary for explanatory purposes, and not all control lines and information lines are necessarily shown in the actual product. In practice, it can be assumed that almost all components are interconnected.

[0114] Furthermore, in this specification, processing steps describing chronological processing include not only processing performed chronologically in the order described, but also processing that is not necessarily performed chronologically but is executed in parallel or individually (for example, processing by objects). In addition, the processing order of processing steps describing chronological processing may be changed to the extent that it does not affect the processing result. [Explanation of symbols]

[0115] 1,1A…Elevator control system, 2…Elevator hall, 3…Camera, 4…Elevator car, 5,5A…Image analysis device, 6…Elevator control device, 7…Call button, 8…Stairs (alternative means), 9…Field of view, 10…Detection area, 20…Camera receiver, 21…Camera setting storage unit, 22…Person detection unit, 23…Person detection model storage unit, 24…Person detection setting GUI, 25…Passage line coordinate storage unit, 26…Button press reception unit, 27…Hall call cancellation determination unit, 28…Determination result transmission unit, 29…Detection area coordinate storage unit, 30…Elevator operation control unit, 31…Call registration unit, 32…Destination floor registration unit, 33…Lifting / lowering control unit, 34…Door opening / closing control unit, 35…Door opening / closing detection unit, 36…Hall call notification unit, 37…Cancellation request reception unit, A1, A2, A3, A4... Movement path of person A, B1, B2... Movement path of person B, L... Passage line

Claims

1. An elevator control system comprising: a camera that photographs the elevator hall; a control device that controls the operation of the elevator, including the raising and lowering of the elevator car, based on hall calls and registration of destination floors; and an image analysis device that analyzes images captured by the camera, After a hall call is registered, the image analysis device detects the presence of a user under observation in the elevator hall and the user's movement by other means from the image of the elevator hall taken by the camera located on the floor where the hall call was registered, and notifies the control device of a hall call cancellation request. The control device receives a Hall call cancellation request from the image analysis device and cancels the Hall call. Elevator control system.

2. A line is set on the aforementioned image for detecting the movement of the user being watched by the aforementioned other means. The image analysis device notifies the control device of the hall call cancellation request when the user being watched passes the line on the image. The elevator control system according to claim 1.

3. The image analysis device detects from the image a person who pressed the call button installed in the elevator hall as the user being watched. The elevator control system according to claim 2.

4. The image analysis device further detects individuals who stay in a designated detection area on the image for a predetermined time or longer as users of the object being watched. The image analysis device notifies the control device of the hall call cancellation request when all persons who pressed the call button and all persons who stayed in the detection area for a predetermined time or longer have passed through the line. The elevator control system according to claim 3.

5. The aforementioned line is set on a path in the image that leads from the elevator hall to the location of the other means. The elevator control system according to claim 3 or 4.

6. The image analysis device determines that the user being watched has crossed the line on the image when the user crosses the line on the image from the center of the image outwards. The elevator control system according to claim 5.

7. An elevator control method using an elevator control system comprising: a camera that photographs the elevator hall; a control device that controls the operation of the elevator, including the raising and lowering of the elevator car, based on the registration of hall calls and destination floors; and an image analysis device that analyzes images captured by the camera, In the aforementioned image analysis device, after a hall call is registered, the device performs a process to detect the presence of a user under observation in the elevator hall and the movement of the user under observation by other means, from an image of the elevator hall taken by the camera located on the floor where the hall call was registered. The image analysis device includes a process of notifying the control device of a Hall call cancellation request based on the detection result, The control device includes a process of receiving a Hall call cancellation request from the image analysis device and canceling the Hall call. Elevator control method.

Images