Intelligent monitoring device for elevator car space

Abstract

The invention relates to the technical field of elevator operation, and discloses an elevator car space intelligent monitoring device which comprises an image recognition camera collecting device used for obtaining the original elevator car area and a monitoring image of an elevator car and inputting the original elevator car area and the monitoring image to an image recognition module, and the image recognition module used for processing the monitoring image, extracting feature information and sending the feature information to the elevator car. The feature information is matched with a feature database to obtain an image recognition result, the image recognition result is input to the control module, and the control module is used for comparing the image recognition result with the original elevator car area to obtain a judgment result and controlling the elevator to enter or exit the full-load straight driving function based on the judgment result; and the voice prompt module is used for acquiring the judgment result and performing voice prompt broadcasting according to the judgment result. By analyzing and judging the elevator car space real-time redundant data monitoring information, the elevator carrying capacity is effectively improved, energy consumption is reduced, and the elevator carrier experience is improved.

Description

Technical Field

[0001] This invention relates to the field of elevator operation technology, and in particular to an intelligent monitoring device for elevator car space. Background Technology

[0002] With the rapid development of urbanization, elevators, as an important component of modern buildings and a special vertical transportation tool, have become integrated into daily life. While providing convenience for vertical travel, elevators have also encountered problems. Safety protection devices for vertical elevator load capacity are generally divided into three types: light load, full load (including full load direct travel), and overload. The main function of the elevator light load switch is to detect the car load status. When the actual load is less than 20% of the rated load, the light load mode is triggered. In this mode, if passengers press multiple floor buttons consecutively (e.g., more than 3), the elevator will cancel all non-first-floor commands to prevent malicious or accidental button presses during quiet periods, thus reducing energy waste. Full load and full load direct travel are defined as the elevator not responding to floor calls along the route when the car (or transport device) load reaches the set value. The purpose of operating according to the registered in-car instructions is to ensure the efficiency of elevator use. Elevator overload protection refers to the system that when the car (or carrying device) exceeds the rated load of the elevator, the car (or carrying device) emits audible and visual signals and keeps the doors open, preventing the elevator from starting. During peak hours when the elevator is fully loaded, its full-load function or full-load direct-drive function may not work, or the elevator car may not meet the conditions for full-load direct drive, but the elevator car space may already be filled with people or items. The problem is that after the elevator reaches the waiting hall and the doors open, people waiting to use the elevator cannot enter the elevator car, causing the elevator to repeatedly stop and open the doors, which wastes time and energy and greatly reduces the efficiency of elevator operation. Therefore, there is an urgent need to provide an intelligent monitoring device for elevator car space to solve the technical problems mentioned in the background. Summary of the Invention

[0003] The purpose of this invention is to overcome one or more of the above-mentioned existing technical problems and provide an intelligent monitoring device for elevator car space.

[0004] To achieve the above objectives, the present invention provides an intelligent monitoring device for elevator car space, comprising: An image recognition camera acquisition device is used to acquire the original elevator car area and monitoring images, and input them into the image recognition module; The image recognition module is used to process the monitoring images and extract feature information, match the feature information with the feature database to obtain the image recognition result, and input the image recognition result to the control module; The control module is used to compare the image recognition results with the original elevator car area to obtain a judgment result, and control the elevator to enter or exit the full-load direct travel function based on the judgment result. The voice module is used to obtain the judgment result and provide voice prompts based on the judgment result.

[0005] According to one aspect of the present invention, the image recognition module includes an image preprocessing unit, a feature extraction unit, and a feature matching unit; The image preprocessing unit is used to preprocess the surveillance images, including image denoising, image enhancement, and image scaling. The feature extraction unit is used to detect information in the preprocessed image and extract relevant feature information. The feature matching unit is used to match feature information with a template or feature database to obtain image recognition results.

[0006] According to one aspect of the present invention, in the feature extraction unit, features are extracted from the preprocessed image based on the Sobel detection operator and the Canny detection operator to obtain first edge detection information and second edge detection information; Feature information is obtained by fusing the first edge detection information and the second edge detection information.

[0007] According to one aspect of the present invention, the Sobel detection operator is used to perform a convolution operation based on two 3×3 convolution kernels to obtain gradient values ​​in the horizontal and vertical directions, respectively, and then the gradient magnitude and gradient direction of each pixel are calculated. The first edge detection information is obtained by calculating the image gradient approximation value of the person or object inside the elevator car in the horizontal X-axis direction and the vertical Y-axis direction. Based on the Canny detection operator, the first edge detection information is convolved with the Gaussian smoothing template to obtain a Gaussian blurred image; After performing mask detection on the horizontal, vertical, and diagonal edges of the Gaussian blurred image, the image edges are located to obtain the second edge detection information.

[0008] According to one aspect of the present invention, in the feature matching unit, the feature information is matched with a pre-established elevator car area template or feature database to obtain the image recognition result; Based on the image recognition results, the edges of people and objects in the image are superimposed and converted according to the standard area conversion formula to obtain the current area occupied by the elevator car.

[0009] According to one aspect of the present invention, in the control unit, the current occupied area of ​​the elevator car is compared with the original area of ​​the elevator car to obtain a judgment result; If the current occupied area of ​​the elevator car is less than 90% of the original elevator car area, the elevator will operate normally. If the current occupied area of ​​the elevator car is greater than or equal to 90% of the original elevator car area, the elevator will be controlled to enter the full-load direct travel function.

[0010] According to one aspect of the invention, it also includes a monitoring center, which automatically issues an audio prompt, displays the corresponding building number, elevator number, and automatically pops up the corresponding elevator video image when the monitoring center detects that the elevator has entered the full-load direct driving function.

[0011] According to one aspect of the present invention, the monitoring center receives transmission instructions from the elevator in real time. In response to the monitoring center receiving a control module to control the elevator to enter or exit the full-load direct driving function, the monitoring center activates the Internet of Things system and stores relevant information.

[0012] According to one aspect of the present invention, in the control module, in response to the release of the internal space of the elevator car, the elevator is controlled to exit the full-load direct run function, resume normal response operation outside the elevator landing door, continuously compare the current image recognition result inside the elevator with the original elevator car area, and based on the judgment result, maintain continuous response or enter the full-load direct run function of the elevator.

[0013] According to one aspect of the present invention, the image recognition camera acquisition device is installed inside the top of a light box located in the middle of the top of the elevator car, and illuminates downward in a cone shape at an illumination angle of 60 degrees.

[0014] Based on this, the beneficial effects of the present invention are as follows: The present invention designs an intelligent monitoring device for elevator car space, thereby ensuring that under the condition of constant elevator car load (space), and in the case of whether the full load function or the full load direct drive function is effective or not, once the elevator car space is fully occupied and it is impossible to guarantee that people can enter the elevator car, the intelligent monitoring and pre-judgment is realized, ensuring the safe and efficient operation of the elevator, reducing the waiting time of elevator passengers, improving the elevator carrying capacity, and establishing a safer operation guarantee system. Attached Figure Description

[0015] Figure 1 This is a system flowchart illustrating an intelligent monitoring device for elevator car space according to an exemplary embodiment; Figure 2 This is a flowchart illustrating an image recognition module of an intelligent monitoring device for elevator car space according to an exemplary embodiment; Figure 3 This is a circuit structure diagram of an intelligent monitoring device for elevator car space according to an exemplary embodiment; Figure 4 This is a flowchart illustrating a method for using an intelligent monitoring device for elevator car space according to an exemplary embodiment. Detailed Implementation

[0016] The invention will now be discussed with reference to exemplary embodiments. It should be understood that the described embodiments are merely intended to enable those skilled in the art to better understand and thus implement the invention, and are not intended to imply any limitation on the scope of the invention.

[0017] As used herein, the term “comprising” and its variations are to be interpreted as open-ended terms meaning “including but not limited to”. The term “based on” is to be interpreted as “at least partially based on”, and the terms “one embodiment” and “an embodiment” are to be interpreted as “at least one embodiment”.

[0018] According to one embodiment of the present invention, Figure 1 This is a system flowchart illustrating an intelligent monitoring device for elevator car space according to an exemplary embodiment. Figure 4 This is a flowchart illustrating a method for using an intelligent monitoring device for elevator car space according to an exemplary embodiment, such as... Figure 1 , Figure 4 As shown, to achieve the above objectives, the present invention provides an intelligent monitoring device for elevator car space, comprising: An image recognition camera acquisition device is used to acquire the original elevator car area and monitoring images, and input them into the image recognition module; The image recognition module is used to process the monitoring images and extract feature information, match the feature information with the feature database to obtain the image recognition result, and input the image recognition result to the control module; The control module is used to compare the image recognition results with the original elevator car area to obtain a judgment result, and control the elevator to enter or exit the full-load direct travel function based on the judgment result. The voice module is used to obtain the judgment result and provide voice prompts based on the judgment result.

[0019] According to one embodiment of this application, Figure 2 This is a flowchart illustrating an image recognition module of an intelligent monitoring device for elevator car space according to an exemplary embodiment, such as... Figure 2 As shown, the image recognition module includes an image preprocessing unit, a feature extraction unit, and a feature matching unit; The image preprocessing unit is used to preprocess the monitoring images, including image denoising, image enhancement and image scaling, to facilitate the extraction of feature information; The feature extraction unit is used to detect information in the preprocessed image, extract relevant feature information, detect shape, color, edge, corner, texture and other information in the preprocessed image, and extract meaningful features; The feature matching unit is used to match feature information with a template or feature database to determine whether a target object exists in the image and obtain the image recognition result.

[0020] According to one embodiment of this application, in the feature extraction unit, features are extracted from the preprocessed image based on the Sobel detection operator and the Canny detection operator, respectively, to obtain first edge detection information and second edge detection information; Feature information is obtained by fusing the first edge detection information and the second edge detection information; This information extraction method uses the feature edge extraction and monitoring method. The Sobel operator and Canny operator are used to detect the maximum contour feature extraction method of objects in the image. By continuously superimposing the maximum contour features of people or objects in the elevator car, the elevator will enter the full-load direct-run function, regardless of whether the elevator car has reached the full-load direct-run condition of the original elevator design. The reserved redundancy design value will be compared with the space area occupied by the existing elevator, and the elevator will not answer any external calls and will directly reach the selected floor in the elevator.

[0021] According to one embodiment of this application, the Sobel detection operator is used to perform a convolution operation based on two 3×3 convolution kernels to obtain the gradient values ​​in the horizontal and vertical directions, and then the gradient magnitude and gradient direction of each pixel are calculated. The first edge detection information is obtained by calculating the image gradient approximation value of the person or object inside the elevator car in the horizontal X-axis direction and the vertical Y-axis direction. Based on the Canny detection operator, the first edge detection information is convolved with the Gaussian smoothing template to obtain a Gaussian blurred image; After performing mask detection on the horizontal, vertical, and diagonal edges of the Gaussian blurred image, the image edges are located to obtain the second edge detection information.

[0022] According to one embodiment of this application, in the feature matching unit, the feature information is matched with a pre-established elevator car area template or feature database to obtain the image recognition result; Based on the image recognition results, the edges of people and objects in the image are superimposed and converted according to the standard area conversion formula to obtain the current area occupied by the elevator car.

[0023] According to one embodiment of this application, in the control unit, the current occupied area of ​​the elevator car is compared with the original area of ​​the elevator car to obtain a judgment result; If the current occupied area of ​​the elevator car is less than 90% of the original elevator car area, the elevator will operate normally. If the current occupied area of ​​the elevator car is greater than or equal to 90% of the original elevator car area, the elevator will be controlled to enter the full-load direct drive function and will not respond to calls registered outside the elevator landing door. The effective area of ​​the elevator is recorded as the initial value. When the area inside the elevator car is less than or equal to 90% of the original elevator car area, the elevator will enter the full-load direct-run function. Simultaneously, a voice announcement function stating "The elevator has entered the full-load direct-run function" can be added inside the elevator car upon request. The external call button will also display the full-load direct-run status. The elevator car area redundancy design value is 90%, based on an example of an elevator car with a load capacity of 1000kg, 1 person / 75kg, totaling 13 people. The maximum elevator car area is [see details missing]. Figure 1 The area is 2.4 square meters. At this point, the average area per person is about 0.185 square meters. Based on the maximum area of ​​1000kg elevator car load, 90% is 2.16 square meters. For 12 people, it is about 0.18 square meters. At this point, the elevator car space should have redundancy. This also avoids the situation where the elevator car space is completely filled. When people are trapped in the elevator car, their physical experience will be very poor, and it may also cause secondary injuries.

[0024] According to one embodiment of this application, it also includes a monitoring center, which automatically issues an audio prompt, displays the corresponding building number, elevator number, and automatically pops up the corresponding elevator video image when the monitoring center detects that the elevator has entered the full-load direct driving function.

[0025] According to one embodiment of this application, the monitoring center receives transmission instructions from the elevator in real time. In response to the control module issuing a control to allow the elevator to enter or exit the full-load direct driving function, the monitoring center activates its Internet of Things system and stores the corresponding relevant information.

[0026] According to one embodiment of this application, in the control module, in response to the release of the internal space of the elevator car, the elevator is controlled to exit the full-load direct-drive function and resume normal elevator door response operation. The current image recognition result inside the elevator is continuously compared with the original elevator car area, and based on the judgment result, the continuous response is maintained or the elevator enters the full-load direct-drive function.

[0027] According to one embodiment of this application, the image recognition camera acquisition device is installed inside the light box at the middle position of the top of the elevator car, and shines downward in a cone shape with an illumination angle of 60 degrees. The effective detection area can reach 20 square meters, which fully meets the elevator car monitoring coverage requirements and monitors the "outline" information of the presence of people or objects in the elevator car in real time.

[0028] According to one embodiment of this application, Figure 3This is a circuit structure diagram of an intelligent monitoring device for elevator car space according to an exemplary embodiment, such as... Figure 3 As shown, the signal is implemented through the information acquisition and processing board, and the control module is implemented through the PLC programmable controller. When the elevator enters the full-load direct-drive function, the switch for entering full-load direct-drive closes, and the +24V power supply voltage is transmitted to the input terminal IN, which is the signal for entering full-load direct-drive. After voltage reduction processing (resistive voltage reduction or level shifter), it is connected to the first output terminal OUT1 of the signal acquisition and processing board. When the elevator exits the full-load direct-drive function, the switch for entering full-load direct-drive closes and opens, and the +24V power supply voltage is transmitted to the input terminal IN, which is the signal for exiting full-load direct-drive. After voltage reduction processing (resistive voltage reduction or level shifter), it is connected to the second output terminal OUT2 of the signal acquisition and processing board. During elevator operation, the image recognition camera acquisition device monitors and processes the image in real time. The +220V power supply voltage connected to the power supply D of the image recognition camera acquisition device is transmitted to the input terminal IN, which is the signal for the judgment result, through the output terminal S of the image recognition camera acquisition device. After voltage reduction processing (resistive voltage reduction or level shifter), it is connected to the second output terminal OUT2 of the signal acquisition and processing board. The image recognition camera (HIFT) is connected to the third output terminal OUT3 of the signal acquisition and processing board. When no one is present, the output terminal S of the image recognition camera is at ground level. The information acquisition and processing board also has an amplifier circuit. The image recognition camera is connected to the input terminal of the amplifier circuit. Through the bias resistor, the NPN transistor is turned on. The +24V power supply voltage is grounded through the relay. The relay generates current to close the contacts and turn on the voice module, so that the PLC module programmable controller can issue a voice prompt saying "The elevator has entered the full load direct drive function". Other resistors are used to eliminate the surge of the relay JK1. The signal of the voice module output by the PLC programmable controller is connected to the fourth input / output terminal OUT4 of the signal acquisition and processing board. After isolation processing, it is connected to the voice module. When the device determines that an alarm is needed, since the output terminal of the image recognition camera is at a high level, the NPN transistor is turned on through the bias resistor. The +24V power supply voltage is grounded through the relay. The relay generates current to close the contacts and turn on the voice module, and under the signal control of the voice module, a voice reminder is issued.

[0029] According to one embodiment of this application, the system software of an intelligent monitoring device for elevator car space is developed using Microsoft Visual Basic 6.0 and consists of system configuration software, database, remote network communication software system, data acquisition and processing program, and trigger program.

[0030] According to one embodiment of this application, the device can realize 24-hour all-weather real-time data acquisition, exchange and monitoring of the monitored elevator car space, and at the same time has the function of elevator car video security monitoring and realizes the function of automatic alarm when electric bicycles enter the elevator car.

[0031] According to one embodiment of this application, the information acquisition signal device installed, collected, and arranged in this device is selected independently. The system has strong compatibility and is applicable to elevators of various brands, models, and control methods. This device is easy to master and operate, and can intuitively reflect the changes in the space inside the elevator car in real time. It can detect, monitor, judge, handle, and provide voice prompts for special situations and special needs such as "the space in the elevator car is full but the load is insufficient" in real time, thus meeting the usage needs of different users.

[0032] Those skilled in the art will recognize that the modules and algorithm steps described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementations should not be considered beyond the scope of this invention.

[0033] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working process of the above-described apparatus and equipment can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0034] In the embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple modules or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or modules may be electrical, mechanical, or other forms.

[0035] The modules described as separate components may or may not be physically separate. The components shown as modules may or may not be physical modules; that is, they may be located in one place or distributed across multiple network modules. Some or all of the modules can be selected to achieve the purpose of the embodiments of the present invention, depending on actual needs.

[0036] In addition, the functional modules in the embodiments of the present invention can be integrated into one processing module, or each module can exist physically separately, or two or more modules can be integrated into one module.

[0037] If the aforementioned functions are implemented as software functional modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this invention, essentially, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the energy-saving signal transmission / reception methods of the various embodiments of this invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, ROM, RAM, magnetic disks, or optical disks.

[0038] The above description is merely a preferred embodiment of this application and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of the invention involved in this application is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the inventive concept. For example, technical solutions formed by substituting the above features with (but not limited to) technical features with similar functions disclosed in this application.

[0039] It should be understood that the sequence number of each step in the invention and embodiments of the present invention does not absolutely imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.

Claims

1. An intelligent monitoring device for elevator car space, characterized in that, include: An image recognition camera acquisition device is used to acquire the original elevator car area and monitoring images, and input them into the image recognition module; The image recognition module is used to process the monitoring images and extract feature information, match the feature information with the feature database to obtain the image recognition result, and input the image recognition result to the control module; The control module is used to compare the image recognition results with the original elevator car area to obtain a judgment result, and control the elevator to enter or exit the full-load direct travel function based on the judgment result. The voice module is used to obtain the judgment result and provide voice prompts based on the judgment result.

2. The intelligent monitoring device for elevator car space as described in claim 1, characterized in that, The image recognition module includes an image preprocessing unit, a feature extraction unit, and a feature matching unit; The image preprocessing unit is used to preprocess the surveillance images, including image denoising, image enhancement, and image scaling. The feature extraction unit is used to detect information in the preprocessed image and extract relevant feature information. The feature matching unit is used to match feature information with a template or feature database to obtain image recognition results.

3. The intelligent monitoring device for elevator car space as described in claim 2, characterized in that, In the feature extraction unit, features are extracted from the preprocessed image based on the Sobel and Canny detection operators to obtain first edge detection information and second edge detection information; Feature information is obtained by fusing the first edge detection information and the second edge detection information.

4. The intelligent monitoring device for elevator car space as described in claim 3, characterized in that, The Sobel detection operator is used to perform convolution operations based on two 3×3 convolution kernels to obtain the gradient values ​​in the horizontal and vertical directions, and then the gradient magnitude and gradient direction of each pixel are calculated. The first edge detection information is obtained by calculating the image gradient approximation value of the person or object inside the elevator car in the horizontal X-axis direction and the vertical Y-axis direction. Based on the Canny detection operator, the first edge detection information is convolved with the Gaussian smoothing template to obtain a Gaussian blurred image; After performing mask detection on the horizontal, vertical, and diagonal edges of the Gaussian blurred image, the image edges are located to obtain the second edge detection information.

5. The intelligent monitoring device for elevator car space as described in claim 4, characterized in that, In the feature matching unit, the feature information is matched with a pre-established elevator car area template or feature database to obtain the image recognition result; Based on the image recognition results, the edges of people and objects in the image are superimposed and converted according to the standard area conversion formula to obtain the current area occupied by the elevator car.

6. The intelligent monitoring device for elevator car space as described in claim 5, characterized in that, In the control unit, the current occupied area of ​​the elevator car is compared with the original area of ​​the elevator car to obtain the judgment result; If the current occupied area of ​​the elevator car is less than 90% of the original elevator car area, the elevator will operate normally. If the current occupied area of ​​the elevator car is greater than or equal to 90% of the original elevator car area, the elevator will be controlled to enter the full-load direct travel function.

7. The intelligent monitoring device for elevator car space as described in claim 6, characterized in that, It also includes a monitoring center. When the monitoring center detects that the elevator has entered the full-load direct-drive function, it will automatically issue an audio prompt, display the corresponding building number, elevator number, and automatically pop up the corresponding elevator video image.

8. The intelligent monitoring device for elevator car space as described in claim 7, characterized in that, The monitoring center receives transmission commands from the elevator in real time. In response to the control module's command to control the elevator to enter or exit the full-load direct driving function, the monitoring center activates its Internet of Things (IoT) system and stores relevant information.

9. The intelligent monitoring device for elevator car space as described in claim 8, characterized in that, In the control module, in response to the release of the internal space of the elevator car, the elevator is controlled to exit the full-load direct run function and resume normal response operation outside the elevator landing door. The current image recognition result inside the elevator is continuously compared with the original elevator car area, and based on the judgment result, the elevator is either kept responding or enters the full-load direct run function.

10. The intelligent monitoring device for elevator car space as described in claim 9, characterized in that, The image recognition camera acquisition device is installed inside the light box in the middle of the top of the elevator car, and shines downward in a cone shape at an angle of 60 degrees.

Images