Method, system and equipment for judging personnel state through elevator camera and medium
Through the elevator camera and near-field wireless communication signal transmitter combined with computer vision technology, the key point coordinates of the elevator rider are identified, their status is judged in real time and alarm is activated, which solves the problem of insufficient sensor sensitivity in the existing elevator monitoring system and improves the Monitoring accuracy and timely monitoring of fainting by people riding on the elevator is accurate and timely.
Patent Information
- Application Number
- CN202411271975.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-11
- Publication Date
- 2024-12-13
AI Technical Summary
In the existing elevator monitoring system, the sensitivity of the fall sensor is insufficient, which makes it easy for people riding on the elevator to miss the report when they squat slowly or faint on their backs, and cannot effectively prevent and deal with emergencies.
The method of judging personnel's status through the elevator camera, using near-field wireless communication signal transmitter and computer vision technology, identify the preset key point coordinates of the elevator rider, and calculate in real time whether the personnel's status meets the preset abnormal conditions, such as fainting or lying on the ground, Faint and start the alarm program when the fainting time exceeds the threshold.
Effectively identify and prevent the elevator riders from fainting on their backs or fainting on the ground, avoid missed reports, and improve the accuracy and timeliness of safety monitoring of personnel in the elevator.
Smart Images
Figure CN119117841A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of live broadcast auxiliary application technology, and in particular to a method, system, device and medium for determining the status of a person through an elevator camera. Background Art
[0002] With the acceleration of urbanization, elevators have become an indispensable vertical transportation tool in modern buildings. However, accidents in elevators, such as people fainting or falling at night, can seriously threaten the safety of passengers if they are not discovered in time. Traditional elevator monitoring systems mainly rely on simple video recording functions, which cannot accurately determine the status of people inside the elevator in real time, making it difficult to effectively prevent and handle emergencies.
[0003] The existing personnel status monitoring is mainly fall monitoring, and the implementation plan is mainly as follows: after the fall sensor detects that a passenger has fallen, the main control module sends a fall control command to the elevator control cabinet, sends a fall alarm signal and the fall passenger file information to the background management platform, and activates the intercom in the car to make a call request. The background management platform can control the sound and light alarm module to send out sound and light alarms according to the fall alarm signal to inform the property staff of abnormal status. At the same time, the elevator information that sends out the fall alarm signal, the fall passenger file information, and the internal image of the elevator car are displayed on the background display module.
[0004] However, the above scheme mainly uses the fall sensor to sense whether a person falls in real time. Once a person falls, an alarm signal will be issued immediately. However, in some cases, such as when an elevator passenger slowly squats and falls or leans and faints, the sensitivity of the sensor is not enough to trigger the alarm, resulting in missed reports. Summary of the invention
[0005] In view of the above-mentioned deficiencies in the prior art, the present application provides a system, method and medium for determining the status of personnel through elevator cameras, so as to solve the problem that the sensitivity of the existing fall sensors is insufficient, which easily leads to missed reports when the elevator passengers slowly squat and fall down or lean against something and faint.
[0006] In the first aspect, the present application provides a method for determining the status of a person through an elevator camera, the method comprising: obtaining the three-dimensional coordinates of the elevator space with a preset position in the elevator as the origin; identifying the preset key point coordinates of the elevator passengers based on the three-dimensional coordinates of the elevator space and a signal transmitter; based on the preset key point coordinates, calculating in real time whether the current status of the elevator passengers meets the preset abnormal conditions; wherein the preset abnormal conditions include at least fainting due to leaning or fainting due to lying on the ground; when the status of the person meets the preset abnormal conditions and the fainting time exceeds the preset time threshold, starting the preset alarm program.
[0007] Furthermore, the signal transmitter is a near field wireless communication signal transmitter.
[0008] Furthermore, based on the three-dimensional coordinates of the elevator space and the signal transmitter, the preset key point coordinates of the elevator passengers are identified, specifically including: The signal response from the elevator passengers is received and analyzed through the near-field wireless communication signal transmitter, so as to determine the three-dimensional coordinates of the elevator passengers in the elevator space; Use computer vision technology to detect key points of passengers and identify the preset key point coordinates; Among them, the preset key point coordinates include at least: head coordinates, neck coordinates, waist coordinates, right heel coordinates, left heel coordinates, right knee coordinates, left knee coordinates, right foot coordinates, and left foot coordinates.
[0009] Furthermore, based on the preset key point coordinates, the current status of the elevator passengers is calculated in real time to determine whether the preset abnormal conditions are met, including: Calculate the vector b between the left foot and the left knee = ( - , - , - ); Calculate the vector c between the right foot and the right knee ; Calculate the vector d between the left knee and the left heel ; Calculate the vector e between the right knee and the right heel ; Calculate the vector f between the waist and neck ; Calculate the angle between vector f and the elevator vertical vector a ; where a=(0, 0, z); Calculate the angle between vectors b and d ; Calculate the angle between vectors c and e ; Calculate the angle between vectors f and d ; Calculate the angle between vectors f and e ; Calculate the distance between the head and the ground d1= , calculate the distance between the waist and the ground d2 = ; When the preset normal standing state conditions are met, , determine that the person is in a normal standing state; When the preset fainting condition is met, , determine the status of the person as relying on fainting; When the preset fainting conditions are met, , determine the person's status as relying on fainting.
[0010] Furthermore, when the state of the person satisfies the preset abnormal condition and the fainting time exceeds the preset time threshold, after starting the preset alarm program, the method further includes: Obtain the current position of each preset maintenance terminal and the elevator position; send a maintenance instruction to the preset maintenance terminal whose distance to the elevator position is less than a preset first threshold; when no maintenance feedback is received within a preset time period, send a maintenance instruction to the preset maintenance terminal whose distance to the elevator position is greater than or equal to the preset first threshold and less than a preset second threshold; when no maintenance feedback is received within a preset second time period, start the automatic dialing function, automatically dial the preset maintenance terminal, stop the automatic dialing when connected, and automatically output the elevator position that needs maintenance to the connected preset maintenance terminal.
[0011] In a second aspect, the present application provides a system for determining a person's status through an elevator camera, the system comprising: An acquisition module is used to acquire the three-dimensional coordinates of the elevator space with a preset position in the elevator as the origin; an identification module is used to identify the preset key point coordinates of the elevator passengers based on the three-dimensional coordinates of the elevator space and the signal transmitter; a calculation module is used to calculate in real time whether the current status of the elevator passengers meets the preset abnormal conditions based on the preset key point coordinates; wherein the preset abnormal conditions at least include fainting due to leaning or fainting on the ground; a start module is used to start the preset alarm program when the status of the person meets the preset abnormal conditions and the fainting time exceeds the preset time threshold.
[0012] Furthermore, the identification module includes an identification unit, Used to receive and analyze the signal response from the elevator passengers through the near-field wireless communication signal transmitter, so as to determine the three-dimensional coordinates of the elevator passengers in the elevator space; Use computer vision technology to detect key points of passengers and identify the preset key point coordinates; Among them, the preset key point coordinates include at least: head coordinates, neck coordinates, waist coordinates, right heel coordinates, left heel coordinates, right knee coordinates, left knee coordinates, right foot coordinates, and left foot coordinates.
[0013] Furthermore, the calculation module includes a calculation unit, Used to calculate the vector b between the left foot and the left knee = ( - , - , - ); Calculate the vector c between the right foot and the right knee ; Calculate the vector d between the left knee and the left heel ; Calculate the vector e between the right knee and the right heel ; Calculate the vector f between the waist and neck ; Calculate the angle between vector f and the elevator vertical vector a ; where a=(0, 0, z); Calculate the angle between vectors b and d ; Calculate the angle between vectors c and e ; Calculate the angle between vectors f and d ; Calculate the angle between vectors f and e ; Calculate the distance between the head and the ground d1= , calculate the distance between the waist and the ground d2 = ; When the preset normal standing state conditions are met, , determine that the person is in a normal standing state; When the preset fainting condition is met, , determine the status of the person as relying on fainting; When the preset fainting conditions are met, , determine the person's status as relying on fainting.
[0014] In a third aspect, the present application provides a device for determining the status of a person through an elevator camera, the device comprising: a processor; and a memory on which executable code is stored, and when the executable code is executed, the processor executes a method for determining the status of a person through an elevator camera such as any one of the above.
[0015] In a fourth aspect, the present application provides a non-volatile computer storage medium having computer instructions stored thereon, which, when executed, implement a method for determining the status of a person through an elevator camera as described above.
[0016] Those skilled in the art can understand that the present application has at least the following beneficial effects: The present application calculates in real time whether the preset key point coordinates corresponding to the current elevator passengers meet the requirements of the current elevator passengers, thereby effectively determining whether there is a person who has fainted by leaning against something or lying on the ground, thereby solving the problem of insufficient sensitivity of existing fall sensors, which can easily lead to missed reports when elevator passengers slowly squat and fall down or lean against something and faint. BRIEF DESCRIPTION OF THE DRAWINGS
[0017] Some embodiments of the present disclosure are described below with reference to the accompanying drawings, in which: Figure 1 This is a flow chart of a method for determining the status of personnel through an elevator camera provided in an embodiment of the present application.
[0018] Figure 2 It is a schematic diagram of the internal structure of a system for determining the status of personnel through an elevator camera provided in an embodiment of the present application.
[0019] Figure 3 It is a schematic diagram of the internal structure of a device for determining the status of personnel through an elevator camera provided in an embodiment of the present application. DETAILED DESCRIPTION
[0020] It should be understood by those skilled in the art that the embodiments described below are only preferred embodiments of the present disclosure, and do not mean that the present disclosure can only be implemented through the preferred embodiments. The preferred embodiments are only used to explain the technical principles of the present disclosure, and are not used to limit the protection scope of the present disclosure. Based on the preferred embodiments provided by the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work should still fall within the protection scope of the present disclosure.
[0021] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.
[0022] The technical solution proposed in the embodiments of the present application is described in detail below with reference to the accompanying drawings.
[0023] The present application embodiment provides a method for determining the status of a person through an elevator camera, such as Figure 1 As shown, the method provided in the embodiment of the present application mainly includes the following steps: Step 110: Obtain the three-dimensional coordinates of the elevator space with a preset position in the elevator as the origin.
[0024] It should be noted that the executor of the present application is a server that can identify the coordinates of preset key points. Among them, the process of obtaining the three-dimensional coordinates of the elevator space with a preset position in the elevator as the origin can be: select a preset position in the elevator as the coordinate origin, and establish a three-dimensional coordinate system based on the origin. This usually includes defining three axes X, Y, and Z starting from the origin, which represent different directions in the elevator, and using measurement tools or technologies (such as near-field wireless communication signals and signal arrival angle information) to determine the positions of other points in the elevator relative to the origin. Through measurement and calculation, the coordinate values of these points in the three-dimensional coordinate system can be obtained.
[0025] Step 120: Based on the three-dimensional coordinates of the elevator space and the signal transmitter, identify the preset key point coordinates of the elevator passengers.
[0026] It should be noted that the signal transmitter may be a near-field wireless communication signal transmitter.
[0027] This step can be specifically as follows: receiving and analyzing the signal response of the passenger through the near-field wireless communication signal transmitter, so as to determine the three-dimensional coordinates of the passenger in the elevator space; using computer vision technology to detect key points of the passenger, and identifying the preset key point coordinates. The preset key point coordinates include at least: head coordinates, neck coordinates, waist coordinates, right leg heel coordinates, left leg heel coordinates, right knee coordinates, left knee coordinates, right foot coordinates, and left foot coordinates.
[0028] Step 130: Based on the preset key point coordinates, calculate in real time whether the current passenger's status meets the preset abnormal conditions.
[0029] It should be noted that the preset abnormal conditions at least include fainting while leaning against a wall or fainting while lying on the ground.
[0030] This step can be specifically as follows: Calculate the vector b between the left foot and the left knee = ( - , - , - ).
[0031] Calculate the vector c between the right foot and the right knee .
[0032] Calculate the vector d between the left knee and the left heel .
[0033] Calculate the vector e between the right knee and the right heel .
[0034] Calculate the vector f between the waist and neck .
[0035] Calculate the angle between vector f and the elevator vertical vector a ; where a=(0, 0, z).
[0036] Calculate the angle between vectors b and d .
[0037] Calculate the angle between vectors c and e .
[0038] Calculate the angle between vectors f and d .
[0039] Calculate the angle between vectors f and e .
[0040] Calculate the distance between the head and the ground d1= , calculate the distance between the waist and the ground d2 = .
[0041] When the preset normal standing state conditions are met, , determine that the personnel status is normal standing status.
[0042] It should be additionally explained that the first preset value may be 15°.
[0043] When the preset fainting condition is met, , determine the person's status as relying on fainting.
[0044] It should be additionally explained that the second preset value may be 75°, and the preset distance may be 10 cm.
[0045] When the preset fainting conditions are met, , determine the person's status as relying on fainting.
[0046] Step 140: When the person's status meets the preset abnormal condition and the fainting time exceeds the preset time threshold, the preset alarm program is started.
[0047] It should be noted that the preset time threshold may be 20 seconds.
[0048] In addition, the present application can also quickly summon maintenance personnel. The specific process can be: obtaining the current position and elevator position of each preset maintenance terminal; issuing maintenance instructions to the preset maintenance terminal whose distance from the elevator position is less than the preset first threshold; when no maintenance feedback is received within the preset time period, issuing maintenance instructions to the preset maintenance terminal whose distance from the elevator position is greater than or equal to the preset first threshold and less than the preset second threshold; when no maintenance feedback is received within the preset second time period, starting the automatic dialing function, automatically dialing the preset maintenance terminal, and stopping the automatic dialing when connected, and automatically outputting the elevator position that needs maintenance to the connected preset maintenance terminal.
[0049] besides, Figure 2 The present application provides a system for determining the status of personnel through an elevator camera. Figure 2 As shown, the system provided in the embodiment of the present application mainly includes: The acquisition module 210 is used to acquire the three-dimensional coordinates of the elevator space with a preset position in the elevator as the origin.
[0050] The identification module 220 is used to identify the preset key point coordinates of the elevator passengers based on the three-dimensional coordinates of the elevator space and the signal transmitter.
[0051] The identification module 220 includes an identification unit, which is used to receive and analyze the signal response of the elevator passenger through a near-field wireless communication signal transmitter, so as to determine the three-dimensional coordinates of the elevator passenger in the elevator space; use computer vision technology to detect key points of the elevator passenger and identify preset key point coordinates; wherein the preset key point coordinates include at least: head coordinates, neck coordinates, waist coordinates, right leg heel coordinates, left leg heel coordinates, right knee coordinates, left knee coordinates, right foot coordinates, and left foot coordinates.
[0052] The calculation module 230 is used to calculate in real time whether the current status of the elevator passengers meets the preset abnormal conditions based on the preset key point coordinates.
[0053] Among them, the preset abnormal conditions at least include fainting while leaning against something or fainting while lying on the ground.
[0054] The calculation module 230 includes a calculation unit, Used to calculate the vector b between the left foot and the left knee = ( - , - , - ); Calculate the vector c between the right foot and the right knee ; Calculate the vector d between the left knee and the left heel ; Calculate the vector e between the right knee and the right heel ; Calculate the vector f between the waist and neck ; Calculate the angle between vector f and the elevator vertical vector a ; where a=(0, 0, z); Calculate the angle between vectors b and d ; Calculate the angle between vectors c and e ; Calculate the angle between vectors f and d ; Calculate the angle between vectors f and e ; Calculate the distance between the head and the ground d1= , calculate the distance between the waist and the ground d2 = ; When the preset normal standing state conditions are met, , determine that the person is in a normal standing state; When the preset fainting condition is met, , determine the status of the person as relying on fainting; When the preset fainting conditions are met, , determine the person's status as relying on fainting.
[0055] The start module 240 is used to start a preset alarm program when the status of the person meets the preset abnormal condition and the fainting time exceeds the preset time threshold.
[0056] The above is a method embodiment of the present application. Based on the same inventive concept, the present application embodiment also provides a device for determining the status of a person through an elevator camera. Figure 3 As shown, the device includes: a processor; and a memory, on which executable codes are stored. When the executable codes are executed, the processor executes a method for determining the status of a person through an elevator camera as in the above-mentioned embodiment.
[0057] Specifically, the server side obtains the three-dimensional coordinates of the elevator space with a preset position in the elevator as the origin; based on the three-dimensional coordinates of the elevator space and the signal transmitter, the preset key point coordinates of the elevator passengers are identified; based on the preset key point coordinates, real-time calculation is performed on whether the current status of the elevator passengers meets the preset abnormal conditions; wherein the preset abnormal conditions at least include fainting due to leaning or fainting due to lying on the ground; when the status of the person meets the preset abnormal conditions and the fainting time exceeds the preset time threshold, the preset alarm program is started.
[0058] In addition, an embodiment of the present application further provides a non-volatile computer storage medium on which executable instructions are stored. When the executable instructions are executed, a method for determining the status of a person through an elevator camera as described above is implemented.
[0059] So far, the technical solutions of the present disclosure have been described in combination with the above multiple embodiments, but it is easy for those skilled in the art to understand that the protection scope of the present disclosure is not limited to these specific embodiments. Without departing from the technical principles of the present disclosure, those skilled in the art can split and combine the technical solutions in the above-mentioned various embodiments, and can also make equivalent changes or replacements to the relevant technical features. Any changes, equivalent replacements, improvements, etc. made within the technical concept and / or technical principle of the present disclosure will fall within the protection scope of the present disclosure.
Claims
1. A method for judging the status of personnel through an elevator camera, characterized in that: The method comprises: Obtain the three-dimensional coordinates of the elevator space with the preset position in the elevator as the origin; Based on the three-dimensional coordinates of the elevator space and the signal transmitter, the preset key point coordinates of the elevator passengers are identified; Based on the preset key point coordinates, calculate in real time whether the current passenger's status meets the preset abnormal conditions; wherein the preset abnormal conditions at least include leaning and fainting or lying on the ground and fainting; When the person's status meets the preset abnormal conditions and the fainting time exceeds the preset time threshold, the preset alarm program is activated.
2. The method for determining personnel status by using an elevator camera according to claim 1, characterized in that: The signal transmitter is a near field wireless communication signal transmitter.
3. The method for determining personnel status by using an elevator camera according to claim 2, characterized in that: Based on the three-dimensional coordinates of the elevator space and the signal transmitter, the preset key point coordinates of the elevator passengers are identified, including: The signal response from the elevator passengers is received and analyzed through the near-field wireless communication signal transmitter, so as to determine the three-dimensional coordinates of the elevator passengers in the elevator space; Use computer vision technology to detect key points of passengers and identify the preset key point coordinates; Among them, the preset key point coordinates include at least: head coordinates, neck coordinates, waist coordinates, right heel coordinates, left heel coordinates, right knee coordinates, left knee coordinates, right foot coordinates, and left foot coordinates.
4. The method for determining personnel status by using an elevator camera according to claim 1, characterized in that: Based on the preset key point coordinates, calculate in real time whether the current status of the elevator passengers meets the preset abnormal conditions, including: Calculate the vector b between the left foot and the left knee = ( - , - , - ); Calculate the vector c between the right foot and the right knee ; Calculate the vector d between the left knee and the left heel ; Calculate the vector e between the right knee and the right heel ; Calculate the vector f between the waist and neck ; Calculate the angle between vector f and the elevator vertical vector a ; where a=(0, 0, z); Calculate the angle between vectors b and d ; Calculate the angle between vectors c and e ; Calculate the angle between vectors f and d ; Calculate the angle between vectors f and e ; Calculate the distance between the head and the ground d1= , calculate the distance between the waist and the ground d2 = ; When the preset normal standing state conditions are met, , determine that the person is in a normal standing state; When the preset fainting condition is met, , determine the status of the person as relying on fainting; When the preset fainting conditions are met, , determine the person's status as relying on fainting.
5. The method for determining personnel status through an elevator camera according to claim 1, characterized in that: When the state of the person meets the preset abnormal condition and the fainting time exceeds the preset time threshold, after starting the preset alarm program, the method further includes: Get the current location of each preset maintenance terminal and the elevator location; Sending a maintenance instruction to a preset maintenance terminal whose distance from the elevator position is less than a preset first threshold; When no maintenance feedback is received within a preset time period, a maintenance instruction is issued to a preset maintenance terminal whose distance to the elevator position is greater than or equal to a preset first threshold and less than a preset second threshold; When no maintenance feedback is received within the preset second time period, the automatic dialing function is started to automatically dial the preset maintenance terminal, and the automatic dialing is stopped when the call is connected, and the elevator position that needs maintenance is automatically output to the connected preset maintenance terminal.
6. A system for judging the status of personnel through an elevator camera, characterized in that: An acquisition module, used to acquire the three-dimensional coordinates of the elevator space with a preset position in the elevator as the origin; An identification module, used to identify the preset key point coordinates of the elevator passengers based on the three-dimensional coordinates of the elevator space and the signal transmitter; A calculation module, for calculating in real time whether the current state of the elevator passengers meets the preset abnormal conditions based on the preset key point coordinates; wherein the preset abnormal conditions at least include leaning and fainting or lying on the ground and fainting; The start module is used to start the preset alarm program when the personnel status meets the preset abnormal conditions and the fainting time exceeds the preset time threshold.
7. The system for determining personnel status through elevator cameras according to claim 6, characterized in that: The recognition module includes a recognition unit, Used to receive and analyze the signal response from the elevator passengers through the near-field wireless communication signal transmitter, so as to determine the three-dimensional coordinates of the elevator passengers in the elevator space; Use computer vision technology to detect key points of passengers and identify the preset key point coordinates; Among them, the preset key point coordinates include at least: head coordinates, neck coordinates, waist coordinates, right heel coordinates, left heel coordinates, right knee coordinates, left knee coordinates, right foot coordinates, and left foot coordinates.
8. The system for determining personnel status through an elevator camera according to claim 6, characterized in that: The computing module includes a computing unit, Used to calculate the vector b between the left foot and the left knee = ( - , - , - ); Calculate the vector c between the right foot and the right knee ; Calculate the vector d between the left knee and the left heel ; Calculate the vector e between the right knee and the right heel ; Calculate the vector f between the waist and neck ; Calculate the angle between vector f and the elevator vertical vector a ; where a=(0, 0, z); Calculate the angle between vectors b and d ; Calculate the angle between vectors c and e ; Calculate the angle between vectors f and d ; Calculate the angle between vectors f and e ; Calculate the distance between the head and the ground d1= , calculate the distance between the waist and the ground d2 = ; When the preset normal standing state conditions are met, , determine that the person is in a normal standing state; When the preset fainting condition is met, , determine the status of the person as relying on fainting; When the preset fainting conditions are met, , determine the person's status as relying on fainting.
9. A device for judging the status of people through an elevator camera, characterized in that: The device comprises: processor; and a memory having executable codes stored thereon, which, when executed, causes the processor to execute a method for determining a personnel status through an elevator camera as described in any one of claims 1 to 5.
10. A non-volatile computer storage medium, characterized in that: Computer instructions are stored thereon, and when the computer instructions are executed, a method for determining the status of a person through an elevator camera as described in any one of claims 1-5 is implemented.