Integrated media and safety monitoring system in elevator

Abstract

The invention relates to an integrated media and safety monitoring system in an elevator. The integrated media and safety monitoring system comprises a media display module, a safety monitoring module, an event detection module and a data processing module. And the media display module is used for displaying audio and video contents in the elevator car. The safety monitoring module can collect multi-dimensional monitoring data in the elevator, and the multi-dimensional monitoring data comprise audio, video, acceleration, speed, vibration, temperature, working voltage and cable tension. The event detection module identifies abnormal events such as sudden acceleration or deceleration, abnormal pause, overload, inclination, door faults, temperature abnormity and cable tension abnormity by analyzing the monitoring data. And the data processing module is used for displaying conventional media contents according to a monitoring result when the elevator runs normally, switching to emergency video and audio prompts when abnormality is detected, guiding passengers to take corresponding measures, and sending real-time alarm information to a remote safety center. According to the system, through multi-dimensional monitoring data and a dynamic response mechanism, the safety and the intelligent level of the elevator are improved.

Description

Technical Field

[0001] The present invention relates to the field of monitoring technology, and in particular to an integrated media and safety monitoring system in an elevator. Background Art

[0002] In the prior art, elevator systems are generally equipped with basic safety monitoring systems, which mainly collect audio and video data in the elevator to monitor the basic operating status inside the elevator. These systems use preset thresholds to identify common events such as speed changes, door switch failures, and abnormal vibrations. In addition, some elevators are also equipped with media display devices for playing advertisements, entertainment content, or simple notification information. These devices operate independently of the safety monitoring system and are mainly used for passengers' entertainment needs or information transmission, and have not been effectively integrated into the elevator's safety assurance system.

[0003] However, the existing technology has some obvious defects. First, the functions of the security monitoring system and the media display system are separated from each other. When an abnormal event occurs in the elevator, the media display content cannot be switched to the emergency state in real time, resulting in delays or omissions in the transmission of emergency information. Secondly, the existing monitoring system has limitations in collecting and analyzing multi-dimensional data (such as acceleration, speed, vibration, temperature, voltage, cable tension, etc.), and is often limited to monitoring a single or a few parameters. It is difficult to conduct multi-dimensional comprehensive analysis and judgment, and it is impossible to accurately identify complex abnormal events. In addition, the existing system lacks an intelligent response mechanism, and it is difficult to provide targeted emergency guidance according to different abnormal types, and it is also impossible to effectively transmit alarm information to the remote security center in real time for response.

[0004] Therefore, there is an urgent need to develop an improved elevator integrated media and safety monitoring system. Summary of the invention

[0005] This application provides an integrated media and security monitoring system in an elevator to improve the safety and intelligence level of the elevator

[0006] The present application provides an elevator integrated media and security monitoring system, including:

[0007] A media display module is installed in the elevator car and is used to display the audio and video content of the media;

[0008] A safety monitoring module, installed in the elevator car, configured to collect monitoring data in the elevator car, the monitoring data including audio, video, elevator acceleration, speed, vibration, temperature, elevator operating voltage, and elevator cable tension;

[0009] an event detection module, connected to the safety monitoring module, for analyzing monitoring data to identify predetermined abnormal events, wherein the abnormal events include sudden acceleration or deceleration, abnormal pause or unexpected floor stop, car overload, car tilt or imbalance, elevator door failure to close or open normally, power failure or voltage abnormality, abnormal vibration or noise, abnormal temperature increase, and abnormal cable tension;

[0010] The data processing module is coupled to the media display module and the event detection module, and is configured to display media content through the media display module under the normal working state of the elevator according to preset conditions; when an abnormal event is detected, according to the type of the abnormal event, corresponding response video and audio information are displayed to passengers through the media display module to guide passengers to respond to specific abnormal situations, and an alarm signal is sent to a remote security center.

[0011] Furthermore, the elevator integrated media and security monitoring system further includes a social distance monitoring module connected to the security monitoring module and the data processing module, and the social distance monitoring module is configured as follows:

[0012] Using the camera and depth sensor in the safety monitoring module to detect the distance between passengers in the elevator car;

[0013] Transmitting the monitored distance data to the data processing module;

[0014] The data processing module is further configured to:

[0015] receiving distance data from a social distance monitoring module;

[0016] Compare the received distance data with a preset safety distance threshold;

[0017] When it is detected that the distance between any two passengers is less than the preset safety distance threshold, a warning signal is triggered;

[0018] According to the triggered warning signal, the media display module is controlled to display a visual reminder and / or a voice reminder is played through the audio system to remind passengers to maintain a safe social distance;

[0019] Wherein, the media display module is further configured as follows:

[0020] While displaying media content normally, the real-time social distance status in the elevator is continuously displayed in a designated area of ​​the screen, including intuitive presentation of passenger distribution and distance information in the form of heat maps or color coding;

[0021] The system also includes a remote control interface, which allows administrators to remotely adjust the safety distance threshold and warning trigger conditions according to current prevention and control requirements.

[0022] Furthermore, the media display module is implemented using a transparent OLED display screen;

[0023] The data processing module is also used for:

[0024] Under normal working state of the elevator, the transparent OLED display screen is controlled to be in a non-transparent working mode;

[0025] When an abnormal event is detected, the transparent OLED display screen is controlled to be in a transparent working mode to display the external environment of the car.

[0026] Furthermore, the media display module includes:

[0027] Eye-tracking cameras to capture where passengers are looking;

[0028] Adaptive content rendering engine, used to adjust the position, size and clarity of displayed content according to the captured passenger's visual focus to optimize the passenger's viewing experience.

[0029] Furthermore, the media display module includes a multimedia processing unit and a high-definition display screen, and the multimedia processing unit is configured to switch the display content in real time according to the operating status of the elevator, display advertisements or entertainment content on the high-definition display screen under normal operating conditions, and switch to display emergency response video and audio information when an abnormal event is detected.

[0030] Furthermore, the media display module further includes a touch screen interface, allowing passengers to interact with the system through the touch screen in an emergency situation to obtain personalized emergency guidance information.

[0031] Furthermore, the security monitoring module includes:

[0032] A multispectral imaging unit, including visible light, infrared, and depth cameras, for collecting high-quality images and depth information in a variety of light conditions;

[0033] Acoustic arrays, which consist of multiple directional microphones to pinpoint sound sources and filter out background noise;

[0034] Multi-dimensional acceleration sensor, used to simultaneously measure the acceleration, angular velocity and tilt angle of the elevator in the three axes of X, Y and Z;

[0035] Thermal imaging cameras are used to monitor the temperature distribution of key elevator components and the body temperature of passengers.

[0036] Furthermore, the event detection module includes:

[0037] A crowd behavior analyzer that uses computer vision technology to analyze passenger behavior and identify potential safety threats or medical emergencies;

[0038] And send identified security threats or medical emergencies to a remote security center.

[0039] Furthermore, the data processing module performs real-time analysis on the monitoring data based on the following formula 1:

[0040]

[0041] Among them, R(t) is the response adjustment coefficient of the system at time t; A(t) represents the elevator acceleration at time t; S(t) represents the elevator speed at time t; S avg (t) is the average speed up to time t; V(t) represents the elevator vibration data at time t; T(t) represents the elevator temperature at time t; Tn(t) represents the cable tension at time t; Tn nominal is the nominal value of the cable tension; Vt(t) represents the voltage at time t; Vt nominal is the nominal operating voltage; δ 1 ,δ 2 ,δ 3 ,δ 4 ,δ 5 is the weight coefficient dynamically adjusted based on environmental conditions and historical data; γ is the nonlinear adjustment index;

[0042] When the response adjustment coefficient R(t) exceeds the preset upper limit, perform the following steps:

[0043] The data processing module switches the media display module to play high-priority emergency response videos and audios, including emergency evacuation prompts, audio guidance to stay calm, and methods to contact rescue;

[0044] If the abnormal condition involves dangerous signals such as acceleration, vibration or cable tension of the elevator, the system will issue a command to gradually slow down the elevator until it stops safely to ensure the safety of passengers;

[0045] Send detailed abnormal data and real-time video information to the remote security center through the wireless communication module;

[0046] When the response adjustment coefficient R(t) is lower than the preset lower limit, perform the following steps:

[0047] The media display module plays a low-intensity prompt video or audio to remind passengers that there may be slight abnormalities in the current elevator, so please remain vigilant but do not panic;

[0048] Depending on the different types of minor abnormalities, the media display module provides specific safety tips, including advising passengers to stand firm, stay away from the elevator door, or adjust their position.

[0049] Furthermore, the event detection module is specifically used for:

[0050] The accumulated abnormal event detection score is calculated according to the following formula 2:

[0051]

[0052] Where, E(t) is the cumulative abnormal event detection score; A(t) represents the elevator acceleration at time t; S(t) represents the elevator speed at time t; V(t) represents the elevator vibration data at time t; T(t) represents the elevator temperature at time t; T safe is the preset safety temperature threshold; Tn(t) represents the cable tension at time t; Tn max Vt is the maximum allowable value of cable tension; nominal is the nominal working voltage of the elevator; 1 ,λ 2 ,λ 3 ,λ 4 ,λ 5 is the weight coefficient;

[0053] When the calculated cumulative abnormal event detection score E(t) exceeds the preset safety threshold, the corresponding response measures and alarm signals are triggered.

[0054] The technical solution provided by this application has the following beneficial effects:

[0055] (1) The present invention integrates the media display module and the security monitoring module to achieve intelligent linkage between the two. When the elevator is operating normally, the media display module plays regular content. When an abnormal event is detected, the system can immediately switch to an emergency state and provide corresponding response video and audio through the media display module. This design significantly improves the response efficiency of the system in emergency situations, ensuring that passengers can obtain timely and accurate safety guidance. (2) The security monitoring module of the present invention can collect a variety of monitoring data in the elevator, including audio, video, acceleration, speed, vibration, temperature, voltage and cable tension. These data are comprehensively analyzed by the event detection module to identify a variety of complex abnormal events. This multi-dimensional data fusion analysis capability enables the system to have higher detection accuracy in complex abnormal situations, and can identify more types of abnormalities and take countermeasures quickly. (3) The data processing module provides targeted emergency video and audio content according to the different abnormal types detected, and sends an alarm signal to the remote security center. The system automatically selects different response strategies according to the type and severity of the abnormal event, ensuring that passengers can get the most appropriate safety guidance in different situations, thereby improving the overall safety in the elevator. (4) When an abnormal event is detected, the present invention transmits real-time monitoring data and alarm signals to a remote security center, thus realizing remote real-time monitoring of the elevator status. This design not only ensures the timeliness of local emergency response, but also provides detailed real-time data support for remote security personnel, which helps to quickly assess the situation and take further emergency measures. BRIEF DESCRIPTION OF THE DRAWINGS

[0056] Figure 1 It is a schematic diagram of an integrated media and security monitoring system in an elevator provided in the first embodiment of the present application. DETAILED DESCRIPTION

[0057] Many specific details are described in the following description to facilitate a full understanding of the present application. However, the present application can be implemented in many other ways than those described herein, and those skilled in the art can make similar generalizations without violating the connotation of the present application, so the present application is not limited by the specific implementation disclosed below.

[0058] The first embodiment of the present application provides an integrated media and security monitoring system in an elevator. Figure 1 , which is a schematic diagram of the first embodiment of the present application. Figure 1 A first embodiment of the present application provides an elevator integrated media and security monitoring system for a detailed description.

[0059] The system includes a media display module 101 , a security monitoring module 102 , an event detection module 103 and a data processing module 104 .

[0060] The media display module 101 is installed in the elevator car and is used to display the audio and video content of the media.

[0061] The media display module 101 is installed in the elevator car and is used to display audio and video content during the operation of the elevator. The module includes a display unit, an audio output unit, a multimedia processing unit, a data interface unit and a power management unit. The display unit can use a high-definition LCD screen, an LED screen or other visual display screen, supporting a variety of resolutions and screen sizes to meet the installation requirements of different types of elevators. The audio output unit is equipped with a speaker that can clearly and accurately convey audio information to ensure that passengers can obtain effective media content both visually and auditorily.

[0062] The multimedia processing unit is the core component of module 101, which is used to receive, process and output various media signals. When the elevator is in normal operation, the multimedia processing unit receives instructions from the data processing module 104, calls pre-stored advertising, entertainment or information content, and converts it into a visual video signal or audio signal, which is played through the display unit and the audio output unit. When an abnormal event is detected, the multimedia processing unit will quickly switch to the emergency mode according to the instructions of the data processing module 104, and play the pre-set emergency response video and audio. Emergency videos and audio may include emergency evacuation instructions, reminders to stay calm, or operating steps to contact the outside world, etc., to ensure that passengers can get clear safety guidance in abnormal situations.

[0063] The data interface unit is used to establish a communication connection with the data processing module 104. The unit can receive various control signals sent by the data processing module 104, and adjust the priority and display mode of the playback content according to the abnormal event type identified by the event detection module 103. For example, when the elevator has abnormal acceleration or tilt, the data interface unit will instruct the multimedia processing unit to immediately switch to the relevant response video to quickly guide passengers to take safety measures. The data interface unit can also be configured to receive and process control signals from a remote security center to achieve the purpose of remote intervention.

[0064] In addition, the power management unit of the media display module 101 is responsible for providing a stable power supply for the module. The power management unit has voltage stabilization and overload protection functions, which can maintain the normal operation of the module under voltage fluctuations or abnormal conditions of the elevator, and ensure the continuous playback of emergency video and audio in emergency conditions. In order to improve the stability of the power supply, the power management unit may include a backup power supply (such as a battery unit) to provide temporary power supply when the main power supply of the elevator fails, ensuring at least several minutes of continuous emergency display.

[0065] In summary, the media display module 101 realizes the dynamic switching and playback functions of various audio and video contents in normal and abnormal states through the cooperation of the multimedia processing unit, the data interface unit, the display unit, the audio output unit and the power management unit. This design ensures the versatility and high reliability of the module in different elevator operation states, and can effectively guide passengers to make reasonable responses in different situations.

[0066] Furthermore, the media display module is implemented using a transparent OLED display screen;

[0067] The data processing module is also used for:

[0068] Under normal working state of the elevator, the transparent OLED display screen is controlled to be in a non-transparent working mode;

[0069] When an abnormal event is detected, the transparent OLED display screen is controlled to be in a transparent working mode to display the external environment of the car.

[0070] In the elevator integrated media and security monitoring system, the media display module uses a transparent OLED display screen, which has two working modes, transparent and non-transparent, to meet the needs of the elevator in different states. The core feature of the transparent OLED display screen is that it can present high-contrast, clear media content in normal conditions, and can switch to transparent mode in abnormal conditions, allowing passengers to directly observe environmental changes outside the car, thereby enhancing passengers' sense of security and real-time information acquisition capabilities.

[0071] When the elevator is in normal working condition, the transparent OLED display is set to non-transparent working mode through the control of the data processing module. In this mode, the display panel of the transparent OLED display will fully present the predetermined advertisements, entertainment videos or other multimedia information. The display screen has a visual effect similar to that of an ordinary LED display, and passengers can clearly watch the playback content. To achieve this non-transparent state, the transparent OLED display adjusts the brightness and opacity of its pixels at the hardware level to achieve the same display effect as traditional displays. This non-transparent working mode can not only provide passengers with conventional entertainment and information services, but also create a more attractive media presentation effect visually.

[0072] When an abnormal event is detected, the data processing module will quickly switch the signal to instruct the transparent OLED display to switch from non-transparent mode to transparent mode. In this case, the transparent OLED display achieves the visual transparency of the screen by reducing pixel brightness and increasing pixel transparency. The activation of transparent mode allows passengers to directly see the environment outside the car through the display, such as the actual situation of the elevator shaft. This design is particularly suitable for sudden abnormal events in the elevator, such as elevator pauses, unexpected floor stops, tilts, etc., so that passengers can understand the external environment in time, reduce panic, and take self-help measures when necessary.

[0073] The intelligent control mechanism of the data processing module is the key to switching between the two working modes of the transparent OLED display. In the normal state of the elevator, the data processing module will continue to keep the transparent OLED display in non-transparent mode according to the preset conditions to ensure the stable playback of the displayed content; and when abnormal events such as sudden acceleration or deceleration of the elevator, imbalance of the car, abnormal temperature, etc. are detected, the data processing module will use fast signal instructions to switch the transparent OLED display to transparent mode in a short time. The switching time of this process is very short, ensuring that passengers can see the external environment of the car as soon as possible under abnormal conditions. At the same time, the data processing module will also determine the duration of the transparent mode according to the type and severity of the event to ensure that the visual information output to the passengers remains effective.

[0074] The transparent OLED display still has some information display functions in transparent mode. Even in transparent mode, the data processing module can still display simplified text or icon information on the screen, such as prompts such as "Keep calm" and "Wait for rescue", to ensure that passengers can get appropriate guidance and instruction while observing the external environment. This design makes full use of the dual functions of the transparent OLED display, so that it can provide visual transparency in an emergency state while maintaining basic information transmission functions.

[0075] By using a transparent OLED display as a media display module, not only can the multimedia content display be realized in the normal state of the elevator, but also visual information of the external environment can be provided in the abnormal state, making the media display module in the elevator more adaptable and safe. This design is innovative in both hardware and software control, ensuring the versatility of the transparent OLED display and enhancing the practicality and reliability of the integrated media and security monitoring system in the elevator.

[0076] Furthermore, the media display module includes:

[0077] Eye-tracking cameras to capture where passengers are looking;

[0078] Adaptive content rendering engine, used to adjust the position, size and clarity of displayed content according to the captured passenger's visual focus to optimize the passenger's viewing experience.

[0079] In the elevator integrated media and security monitoring system, the media display module further integrates an eye tracking camera and an adaptive content rendering engine to enhance the passenger experience when viewing displayed content. The eye tracking camera is a key component of the module. It is installed above or on both sides of the transparent OLED display screen. The specific position is adjusted according to the layout of the elevator car so that the camera can capture the changes in the passenger's line of sight. The eye tracking camera illuminates the passenger's eye area with infrared or near-infrared light, and calculates the passenger's line of sight and focus position in real time through the changes in reflected light.

[0080] After capturing the passenger's gaze focus, the eye tracking camera transmits this data to the adaptive content rendering engine. The rendering engine is responsible for analyzing the gaze data and dynamically adjusting the displayed content according to the specific situation. The adaptive content rendering engine can quickly identify the location area where the passenger is looking at on the display screen and determine the passenger's attention to specific content. This real-time analysis function enables the system to present content in the best way, ensuring that passengers can always view the displayed content in a comfortable posture.

[0081] Based on the captured line of sight, the adaptive content rendering engine can adjust the position, size and clarity of the displayed content. For example, when a passenger looks at an advertising area in the center of the screen, the rendering engine will partially enlarge the content of that area and enhance the clarity in the enlarged area so that the passenger can see the details of the content more clearly. In addition, for content areas where passengers look at them for a long time, the rendering engine will automatically increase the brightness or contrast of that area to further enhance the display effect. In areas where passengers look less or do not pay attention, the rendering engine will appropriately reduce their clarity and brightness, thereby saving energy and concentrating resources on the passengers' main areas of concern.

[0082] This adaptive display mechanism is not only suitable for ordinary media playback, but also plays an important role in emergency situations. When an abnormal event occurs in the elevator and triggers an emergency state, the adaptive content rendering engine will display emergency prompts or escape guidance information in the passenger's gaze area according to the passenger's line of sight. For example, when a passenger looks at the top of the screen, the system will prioritize text prompts such as "Keep calm" and "Dial an emergency number" in this area, which may be accompanied by relevant emergency icons and color warnings. Through this flexible display adjustment, the system can convey key information more efficiently in an emergency state, ensuring that passengers can understand the response measures in a timely manner.

[0083] The adaptive content rendering engine also has a learning function. Through the long-term collection and analysis of passenger sight data, the engine can automatically optimize the content layout strategy. For example, for passenger groups of different heights or angles (such as children, adults or wheelchair users), the system will adjust the default position and size of the displayed content based on historical data to adapt to different viewing habits. This adaptive optimization based on historical data not only improves the visual comfort of passengers, but also enhances the user-friendliness and intelligence level of the system.

[0084] Through the combination of eye-tracking cameras and adaptive content rendering engines, the media display module can achieve dynamic content adjustment based on the passenger's line of sight, so that passengers can get the best viewing experience in different states. This design not only improves the accessibility and visibility of media content in the elevator, but also provides a more targeted way of information communication in emergency situations.

[0085] Furthermore, the media display module includes a multimedia processing unit and a high-definition display screen, and the multimedia processing unit is configured to switch the display content in real time according to the operating status of the elevator, display advertisements or entertainment content on the high-definition display screen under normal operating conditions, and switch to display emergency response video and audio information when an abnormal event is detected.

[0086] In the elevator integrated media and safety monitoring system, the media display module further includes a multimedia processing unit and a high-definition display screen to provide adaptive display content under different elevator operating conditions. The multimedia processing unit is the core component of the module, responsible for real-time management and scheduling of multiple media contents, and flexibly switching display content according to changes in the elevator operating status to ensure that appropriate information and guidance can be provided to passengers in both normal and abnormal conditions.

[0087] The multimedia processing unit includes an integrated multimedia processing chip with efficient image processing capabilities and audio decoding functions, which can support the playback of video and audio content in multiple formats. When the elevator is in normal operation, the multimedia processing unit will give priority to retrieving preset advertisements, entertainment videos or other information content, and transmit them to the high-definition display for playback. The high-definition display can present multimedia content with high resolution and high contrast, providing passengers with a clear visual experience. The display content in this normal operating mode usually includes advertisements, news, weather forecasts, public welfare information, etc., which can be automatically updated and rotated according to the system's preset schedule or passengers' preferences.

[0088] When the security monitoring module detects an abnormal event, the event detection module sends the abnormal signal to the multimedia processing unit. After receiving the abnormal signal, the multimedia processing unit will immediately stop the currently playing advertisements or entertainment content and switch to the emergency response mode in a very short time. In this mode, the multimedia processing unit will call up the pre-stored emergency response video and audio content, and the high-definition display will immediately display the relevant emergency information, and the audio system will synchronously play the corresponding emergency prompt sound.

[0089] The content of the emergency response video and audio varies according to the type of abnormal event. For example, when the elevator detects an overload, the multimedia processing unit will switch to display the "overload prompt" video and play a voice prompt to ask passengers to reduce the elevator load; when the elevator is detected to be tilted or the car is unbalanced, the multimedia processing unit will play the video and audio content of "Please stay calm and wait for rescue." In addition, when potential safety risks such as abnormal temperature rise or voltage fluctuations occur, the system will automatically switch to the corresponding emergency response video and provide necessary safety guidance. This design can ensure the display switching speed and content accuracy in emergency situations, thereby providing passengers with timely and effective safety information.

[0090] The multimedia processing unit also has an adaptive content management function, that is, after the abnormal event is resolved, the multimedia processing unit will automatically return to normal operation according to the instructions of the data processing module and continue to play regular advertisements or entertainment content. This automatic switching mechanism not only improves the overall intelligence level of the system, but also ensures a seamless transition between emergency and normal states, reducing the loss of safety information or passenger anxiety caused by switching delays.

[0091] Under the control of the multimedia processing unit, the high-definition display screen can not only provide high-quality visual effects in normal mode, but also has strong anti-interference ability. Even when there is vibration or power fluctuation in the elevator internal environment, the high-definition display screen can still operate stably to ensure that emergency information is clearly visible. In addition, the material and installation method of the high-definition display screen have also been optimized to prevent damage caused by accidental touch by passengers or external impact, and to ensure that the display content can be clearly viewed at any angle. This design greatly improves the stability and durability of the display system in the elevator.

[0092] In short, through the organic combination of the multimedia processing unit and the high-definition display screen, the media display module can realize real-time display content switching based on the elevator operation status, providing passengers with the most appropriate information and visual experience under both normal and abnormal conditions.

[0093] Furthermore, the media display module further includes a touch screen interface, allowing passengers to interact with the system through the touch screen in an emergency situation to obtain personalized emergency guidance information.

[0094] In the elevator integrated media and safety monitoring system, the media display module further integrates a touch screen interface to provide passengers with interactive functions between the system and provide passengers with personalized emergency guidance information in emergency situations. This design aims to improve the practicality and flexibility of the system in emergency situations, while enhancing passengers' sense of security and convenience in obtaining information in emergency situations.

[0095] The touch screen interface is part of a transparent OLED display or high-definition display that can sense the touch operation of passengers on the screen surface. The touch screen uses capacitive touch technology or infrared touch technology, with high sensitivity and fast response capabilities, and can accurately capture the touch actions of passengers even in crowded or vibrating elevator environments. This touch screen interface not only supports multi-touch, but also automatically adjusts the interface layout and response speed in different display modes to ensure that passengers can operate quickly and intuitively in emergency situations.

[0096] When the elevator is operating normally, the interactive function of the touch screen interface is mainly in standby mode and is only used for basic functions such as switching multimedia content or adjusting the volume. However, when the event detection module identifies an abnormal event, the emergency function of the touch screen interface is activated and the multimedia processing unit switches to the emergency interface. At this time, a series of emergency options and guidance information will be displayed on the screen, and passengers can get personalized emergency guidance by touching the corresponding options. For example, when the elevator is overloaded, tilted, paused, and other abnormal situations, the touch screen interface will provide options such as "emergency contact", "rescue information", and "self-rescue measures", and passengers can select the required emergency information.

[0097] In addition, the touch screen interface can also provide multi-language support according to the needs of different passengers. In an emergency, the system will display the preset language interface by default, and passengers can also select other language versions through the touch screen. This multi-language design ensures that all passengers can get clear emergency instructions when there are passengers with different language backgrounds in the elevator. In addition, the text and icons on the touch screen interface are designed to be clear and concise, and use a high-contrast color scheme, so that passengers can quickly identify relevant information in low light or emergency situations.

[0098] The touch screen interface also has a real-time interactive feedback function. When a passenger selects an emergency option, the system will immediately provide corresponding feedback information on the screen, such as the estimated arrival time of rescue, the current elevator location, and detailed instructions for emergency steps. This real-time interactive function not only improves the intelligence level of the system, but also allows passengers to obtain timely feedback and guidance in tense emergency situations, reducing anxiety and increasing confidence in coping.

[0099] The touch screen interface can also record the passenger's interactive information in the background and transmit this information to the remote security center in real time. In this way, the staff of the remote security center can provide more accurate and personalized rescue measures based on the passenger's choices and needs. At the same time, the data processing module in the system will analyze the passenger's interactive data and optimize the subsequent emergency guidance information based on the passenger's choice and emergency status.

[0100] By adding a touch screen interface to the media display module, the system not only provides static emergency information display, but also realizes two-way interaction between passengers and the system. This design greatly enhances the intelligence and humanization of the elevator safety monitoring system, allowing passengers to obtain targeted and personalized emergency guidance information in emergencies. Whether it is the diversity of information, the operability of the interface, or the timeliness of response, the system has achieved a high level of security and user experience.

[0101] The safety monitoring module 102 is installed in the elevator car and is configured to collect monitoring data in the elevator car, wherein the monitoring data includes audio, video, elevator acceleration, speed, vibration, temperature, elevator operating voltage and elevator cable tension.

[0102] The safety monitoring module 102 is installed in the elevator car and is used to collect and process multi-dimensional monitoring data inside the elevator. The module integrates multiple sensors and data processing units to obtain key data under the elevator operation status in real time and provide basic data support for the event detection module 103. The main function of the safety monitoring module 102 is to monitor multiple parameters such as audio, video, elevator acceleration, speed, vibration, temperature, working voltage and cable tension in the elevator to fully understand the operation status inside the elevator.

[0103] In terms of audio and video monitoring, the security monitoring module 102 is equipped with a high-definition camera and a high-sensitivity microphone. The high-definition camera is used to monitor the real-time image in the elevator car and capture the dynamic situation of the passengers in the elevator, while providing clear visual data. The microphone can collect audio data in the elevator in real time, including sensitive capture of abnormal sounds (such as impact sounds, sharp noises, etc.), and these audio data can provide effective information for further event analysis. In addition, the audio and video data are processed by an efficient data compression algorithm for easy transmission and analysis.

[0104] Acceleration and velocity sensors are installed at different locations in the elevator car to monitor the real-time acceleration changes and running speed of the elevator. These sensors sample the dynamic parameters of the elevator at a high frequency to ensure timely capture of events such as sudden acceleration, deceleration or unexpected pauses. By collecting and analyzing acceleration and velocity data in real time, the system can accurately identify the stability and sudden states of elevator operation.

[0105] The vibration sensor is arranged at the key parts of the elevator structure to detect the mechanical vibration that may occur during the operation of the elevator. The vibration sensor can identify abnormal vibration conditions of the elevator, including car tilt, abnormal running track, etc. The sensor converts the vibration signal into a digital signal through a high-precision data acquisition unit and transmits it to the event detection module 103 for analysis. This monitoring mechanism can effectively prevent safety hazards caused by structural problems and provide a reliable basis for triggering subsequent emergency measures.

[0106] The temperature sensor is used to monitor the temperature changes of the internal environment of the elevator car in real time. In particular, when the elevator is running for a long time or there are many passengers in the elevator, the temperature sensor can detect the abnormal increase of the internal environment temperature. Such temperature change information will be transmitted to the event detection module 103 for further analysis to identify potential overheating and trigger corresponding emergency measures.

[0107] The working voltage sensor is used to monitor the voltage status of the elevator system, including real-time voltage changes, fluctuations, and potential power failures. When a voltage anomaly is detected, the sensor will automatically send a signal to the event detection module 103 to start the corresponding abnormal event identification program. At the same time, the module is equipped with overvoltage and undervoltage protection functions to ensure continuous monitoring and emergency response in the event of voltage anomalies.

[0108] Cable tension sensors are used to detect changes in the tension of elevator suspension cables. The sensor can monitor the cable stress state in real time during elevator operation and identify whether the cable is loose, has abnormal tension or is damaged. By analyzing the cable tension data, the system can promptly identify potential safety risks and initiate safety measures such as deceleration or emergency stop when necessary to avoid serious accidents caused by cable breakage.

[0109] All sensors in the security monitoring module 102 are integrated and processed by a data aggregation unit, which synchronizes and transmits data from different sensors to ensure the uniformity and accuracy of multi-dimensional monitoring data. The data aggregation unit also supports communication connection with the data processing module 104, enabling fast data transmission when an event occurs, and supports remote data transmission function.

[0110] Furthermore, the security monitoring module includes:

[0111] A multispectral imaging unit, including visible light, infrared, and depth cameras, for collecting high-quality images and depth information in a variety of light conditions;

[0112] Acoustic arrays, which consist of multiple directional microphones to pinpoint sound sources and filter out background noise;

[0113] Multi-dimensional acceleration sensor, used to simultaneously measure the acceleration, angular velocity and tilt angle of the elevator in the three axes of X, Y and Z;

[0114] Thermal imaging cameras are used to monitor the temperature distribution of key elevator components and the body temperature of passengers.

[0115] In the elevator integrated media and security monitoring system, the security monitoring module further integrates a multi-spectral imaging unit, an acoustic array, a multi-dimensional acceleration sensor, and a thermal imaging camera to improve the monitoring accuracy and safety inside the elevator. Each component has specific functions and features to ensure real-time data collection and analysis in various situations, and fully cover the state changes inside the elevator.

[0116] The multispectral imaging unit consists of visible light, infrared and depth cameras, and is designed to provide high-quality image data and depth information under different lighting conditions. The visible light camera captures visual information inside the elevator under normal lighting, ensuring clear presentation of passenger activities and the cabin environment. The infrared camera is used for monitoring in low-light or no-light conditions, especially at night or in the event of a sudden power outage, and can still clearly capture the movements of passengers and changes inside the elevator. By acquiring the depth data of the scene, the depth camera can accurately measure the three-dimensional position of passengers and objects, which is particularly important for detecting the distribution of people in the cabin, whether there are falls or other abnormal behaviors. The data of the multispectral imaging unit is processed by an image fusion algorithm, and images of different bands are integrated into a multi-layered composite image to provide more comprehensive visual information.

[0117] The acoustic array consists of multiple directional microphones, and its main function is to identify the sound characteristics inside the elevator through sound source localization technology. The arrangement of each directional microphone is precisely designed to form an acoustic network that can capture multi-directional sound sources. When abnormal sounds occur inside the elevator (such as impact sounds, screams, equipment failure sounds, etc.), the acoustic array can accurately determine the source of the sound and transmit the sound source information to the event detection module for analysis. At the same time, the acoustic array has the function of filtering background noise. Through digital signal processing algorithms, it can effectively filter out background noise and other irrelevant sound sources in the operation of the elevator, thereby ensuring the accuracy and reliability of sound monitoring.

[0118] The multi-dimensional acceleration sensor is a key physical status monitoring component in the safety monitoring module, which is specifically used to measure the acceleration, angular velocity and tilt angle of the elevator in the three axes of X, Y and Z. The sensor captures the movement state of the elevator in real time through the integrated accelerometer and gyroscope, including the vertical acceleration, lateral swing and tilt of the elevator. When the elevator suddenly accelerates, decelerates, tilts or swings abnormally, the multi-dimensional acceleration sensor can immediately collect this data and transmit it to the event detection module to identify the severity and nature of these abnormal events. This multi-axial precise measurement can significantly improve the detection accuracy of abnormal elevator conditions and provide a reliable data basis for subsequent emergency decision-making.

[0119] Thermal imaging cameras are used to monitor the temperature distribution of key elevator components and the body temperature of passengers. The camera can capture temperature changes inside the elevator through infrared thermal imaging technology, including the temperature distribution of key components such as elevator brakes, control cabinets, and cables. By real-time monitoring of the temperature of these components, the system can predict potential overheating risks and take corresponding measures in advance to prevent possible failures or fires. At the same time, thermal imaging cameras can also monitor the temperature distribution of passengers. When the passenger's body temperature rises significantly (such as the body temperature exceeds the normal range), the system can automatically trigger a health warning signal to assist in prevention and control and other health monitoring needs.

[0120] In summary, the safety monitoring module can monitor the interior of the elevator in all aspects under various lighting, environmental conditions and physical conditions through the comprehensive application of multi-spectral imaging units, acoustic arrays, multi-dimensional acceleration sensors and thermal imaging cameras. This design not only improves the accuracy and diversity of monitoring, but also ensures full control of the status of passengers and equipment during the operation of the elevator, thus providing strong technical support for the overall safety and emergency response of the system.

[0121] The event detection module 103 is connected to the safety monitoring module and is used to analyze the monitoring data to identify predetermined abnormal events, wherein the abnormal events include sudden acceleration or deceleration, abnormal pause or unexpected floor stop, car overload, car tilt or imbalance, elevator door cannot be closed or opened normally, power failure or voltage abnormality, abnormal vibration or noise, abnormal temperature increase, and abnormal cable tension.

[0122] The event detection module 103 is one of the core components of the system, which is specifically used to analyze the multi-dimensional data collected by the safety monitoring module 102 and identify various abnormal events that may affect the operation of the elevator. This module is closely coupled with the safety monitoring module 102 and has efficient data processing capabilities and intelligent abnormality recognition algorithms to ensure the safety of the elevator in various complex conditions.

[0123] The event detection module 103 first receives the raw data from the security monitoring module 102, which includes audio, video, acceleration, speed, vibration, temperature, operating voltage, cable tension and other information. In order to improve the accuracy of identifying abnormal events, the module is equipped with a variety of signal processing units and analysis algorithms to pre-process different types of data. For example, audio and video signals are preliminarily analyzed through filtering and feature extraction algorithms to identify possible abnormal sound or visual features; acceleration, speed and vibration data are judged through a series of statistical analysis and spectrum analysis to determine whether there are abnormal fluctuations; temperature, voltage and cable tension data are determined through threshold comparison and trend analysis to determine whether they exceed the safe operating range.

[0124] In the process of identifying abnormal events, the event detection module 103 adopts a multi-level discrimination logic. This logic uses a preset algorithm model to perform real-time calculations according to different states and environmental conditions of the elevator operation, and dynamically adjusts the weights of different parameters. In this way, the module can make accurate judgments in a variety of abnormal situations. For example, when the acceleration of the elevator suddenly increases and is accompanied by obvious vibration, the module will identify this state as a potential tilt or imbalance event. At the same time, if the acceleration and vibration data fluctuate repeatedly in a short period of time, the module will further analyze whether the car is overloaded or there are other abnormal conditions. Through cross-analysis and dynamic adjustment of multi-dimensional data, the module can identify a variety of abnormal states such as abnormal pauses, unexpected floor stops, elevator doors unable to close normally, overloads, etc., and classify and process them according to the type and severity of the abnormality.

[0125] The event detection module 103 is not only able to identify a single type of anomaly, but also has the ability to conduct comprehensive anomaly analysis. When multiple abnormal signals appear in the elevator at the same time (for example, temperature rise and cable tension drop), the module will identify potential major safety risks through multi-parameter joint analysis and immediately send an alarm signal to the data processing module 104. In addition, in order to improve the response speed of the system, the module has a built-in fast response mechanism. Once high-risk events such as acceleration abnormalities or voltage fluctuations are detected, the module will prioritize these signals and trigger emergency measures in a short time to ensure passenger safety.

[0126] In order to further enhance the recognition accuracy of abnormal events and the adaptive ability of the system, the event detection module 103 is also equipped with a learning algorithm for self-adjustment based on historical operation data and abnormal events. This learning algorithm can optimize parameter settings and recognition models, so that the module can continuously improve its recognition efficiency and accuracy in long-term operation. Through the synergy of these mechanisms, the event detection module 103 can efficiently and accurately detect various abnormal events in various complex elevator operation environments, and provide reliable data support for subsequent emergency response.

[0127] Furthermore, the event detection module includes:

[0128] A crowd behavior analyzer that uses computer vision technology to analyze passenger behavior and identify potential safety threats or medical emergencies;

[0129] And send identified security threats or medical emergencies to a remote security center.

[0130] In the elevator integrated media and security monitoring system, the event detection module further integrates a group behavior analyzer to enhance the system's ability to analyze and monitor passenger behavior. The group behavior analyzer uses advanced computer vision technology to perform real-time analysis of group behavior inside the elevator to identify potential security threats or emergency medical situations. This design is intended to improve the level of security monitoring inside the elevator and ensure a quick response to abnormal passenger behavior in emergencies.

[0131] The group behavior analyzer is tightly integrated with the multispectral imaging unit and the depth camera to capture the behavior and body posture changes of passengers. Through computer vision algorithms, the group behavior analyzer analyzes the images and video data collected by the camera in real time to identify the body posture, behavior patterns and relative positions of passengers. For example, when a passenger is detected to have an abnormal fall, sudden fainting or continuous immobility, the group behavior analyzer can respond quickly and further confirm whether it is a sudden emergency medical condition through a deep learning model.

[0132] In terms of identifying potential security threats, the group behavior analyzer can also dynamically evaluate the overall behavior of the group in the elevator. For example, when there are dense crowds of people in the elevator and there are intense physical movements, the system will identify such behavior as a potential conflict or crowd risk, thereby triggering an early warning. In addition, the analyzer can also detect abnormal collective behavior of people in the elevator, such as multiple people approaching the elevator door at the same time, intending to force the elevator door open, and other dangerous behaviors. In this case, the system will issue a voice warning inside the elevator and provide visual prompts through the multimedia display module to remind passengers to stop the relevant behavior.

[0133] When the group behavior analyzer confirms that the detected behavior is a medical emergency or a serious security threat, the system will immediately send relevant information to the remote security center. This information includes not only the type and severity of the behavior, but may also be accompanied by real-time image and video data so that remote security personnel can quickly evaluate and intervene in the on-site situation. In order to improve the accuracy and efficiency of information transmission, the system will appropriately compress and encrypt this data to ensure the rapid and secure transmission of information in emergency situations.

[0134] In the system, the core of the crowd behavior analyzer is a computer vision algorithm based on deep learning. These algorithms are trained with a large amount of behavioral data to ensure the recognition and adaptability of common abnormal behaviors. For example, the fall detection algorithm uses posture estimation and limb key point analysis to determine whether there is a fall event by judging the changes in the passenger's body posture; the crowd conflict detection algorithm identifies potential conflicts by analyzing the distance changes between multiple people, the speed and direction of body movements. This multi-level behavior analysis not only improves the intelligence of the system, but also ensures high-precision recognition of complex crowd behaviors.

[0135] In addition, the group behavior analyzer also has an adaptive learning function, that is, it can continuously optimize the algorithm model according to new behavior data during daily operation. In this way, when the system encounters new behavior patterns or more complex behavior combinations during operation, the group behavior analyzer can enhance its ability to identify new situations by continuously learning and adjusting these data. This adaptive function not only improves the robustness and response speed of the system, but also ensures its continued effectiveness in various complex elevator usage environments.

[0136] Through the application of group behavior analyzers in the event detection module, the integrated media and security monitoring system in the elevator can identify and respond to a variety of potential security threats and emergency medical situations in real-time monitoring. This design significantly improves the system's security monitoring capabilities and emergency response level, not only effectively protecting the safety of passengers, but also providing timely and accurate information support to the remote security center, facilitating rapid intervention and rescue.

[0137] Furthermore, the event detection module is specifically used for:

[0138] The accumulated abnormal event detection score is calculated according to the following formula 2:

[0139]

[0140] Where, E(t) is the cumulative abnormal event detection score;

[0141] A(t) represents the acceleration of the elevator at time t;

[0142] S(t) represents the elevator speed at time t;

[0143] V(t) represents the elevator vibration data at time t;

[0144] T(t) represents the elevator temperature at time t;

[0145] T safe is the preset safety temperature threshold;

[0146] Tn(t) represents the cable tension at time t;

[0147] Tn max is the maximum allowable value of cable tension; Vt(t) is the elevator operating voltage at time t;

[0148] Vt nominal is the nominal working voltage of the elevator; 1 ,λ 2 ,λ 3 ,λ 4 ,λ 5 is the weight coefficient;

[0149] When the calculated cumulative abnormal event detection score E(t) exceeds the preset safety threshold, the corresponding response measures and alarm signals are triggered.

[0150] In formula 2, the upper and lower limits of the integral, 0 and t, are both related to time, as described below:

[0151] 0: indicates the starting point of time, that is, the initial moment when the elevator starts running or monitoring begins. This is the starting time for calculating the cumulative abnormal event detection score E(t).

[0152] t: represents the current time, or a specific time when the anomaly score is calculated. It is the upper limit of the time variable and is used to define the end point of the integration.

[0153] Therefore, the integral range [0, t] represents the system's continuous cumulative monitoring and evaluation of abnormal events over a period of time from the initial moment to the current moment.

[0154] The data processing module 104 is coupled to the media display module and the event detection module, and is configured to display media content through the media display module under the normal working state of the elevator according to preset conditions; when an abnormal event is detected, according to the type of the abnormal event, corresponding response video and audio information are displayed to passengers through the media display module to guide passengers to respond to specific abnormal situations, and an alarm signal is sent to a remote security center.

[0155] The data processing module 104 is the control center of the entire system, responsible for receiving and processing abnormal event information from the event detection module 103, and controlling the content output of the media display module 101 and sending alarm signals to the remote security center according to preset conditions. This module has multi-tasking processing capabilities and can quickly switch between normal and abnormal states to adapt to different scene requirements in elevator operation.

[0156] When the elevator is operating normally, the data processing module 104 controls the media display module 101 according to the system preset conditions to display conventional media content, such as advertisements, entertainment videos or information prompts. The data processing module 104 manages and schedules multimedia content to achieve automatic content update and scheduled playback. The module has data caching and priority management functions, which can ensure continuous playback of media content in normal state and provide quick response when switching to emergency state is required.

[0157] When the event detection module 103 detects an abnormal event, the data processing module 104 will immediately receive the corresponding abnormal event signal and analyze the type and severity of the event. At this time, the data processing module 104 will select the most appropriate response video and audio content according to the preset response strategy and abnormal type, and play it to the passengers through the media display module 101. The data processing module 104 has an adaptive content switching mechanism based on event classification. For example, when the car is detected to be tilted or unbalanced, the module will give priority to playing the safety reminder video to guide passengers to stand firm and stay away from the elevator door; when overloading is detected, the data processing module 104 will play the weight reduction reminder audio to ask passengers to reduce the load.

[0158] In addition, the data processing module 104 has a multi-channel alarm function in an emergency state. Once the module confirms that the severity of the abnormal event reaches the preset alarm threshold, it will immediately send an alarm signal to the remote security center through the wireless communication module. The signal not only includes the type of abnormal event, but also includes the real-time status information of the elevator, such as acceleration, vibration, temperature, operating voltage, cable tension and other parameters, so that the remote security center can comprehensively evaluate the current elevator status. In order to improve the reliability of data transmission, the data processing module 104 also has a multiple communication path selection function. When the main communication path cannot work normally due to a fault, the module can automatically switch to a backup communication path, such as a mobile network, satellite signal or a dedicated communication link, to ensure the effective transmission of the alarm information.

[0159] The data processing module 104 is also equipped with an intelligent decision-making algorithm to achieve dynamic response to abnormal events. The algorithm can continuously optimize the response strategy for abnormal events based on historical data and real-time monitoring information. For example, when the system detects a specific type of abnormality (such as continuous voltage fluctuations or temperature abnormalities) multiple times, the data processing module 104 will automatically adjust the priority of the response strategy and increase the playback frequency of the corresponding emergency video and audio content. At the same time, the module will store such frequent abnormal records in the system log for subsequent analysis by the remote security center.

[0160] In order to ensure the stability and efficiency of the system, the data processing module 104 has an independent power management function. A backup power supply unit is designed inside the module, which can maintain emergency processing and alarm information transmission for a short period of time when the main power supply of the elevator is interrupted. In addition, the module also has overload protection and self-recovery functions, which can automatically adjust the processing frequency and priority when the data processing volume is too large or the power supply is abnormal, ensuring the priority execution of key tasks.

[0161] In short, the data processing module 104 ensures the efficient operation of the system in normal and abnormal conditions through the combination of multi-task scheduling, dynamic response and intelligent decision-making algorithms. This module can not only realize the accurate control of media content and alarm signals, but also has the intelligent processing ability to adapt to complex elevator environments, providing passengers with timely and effective emergency guidance.

[0162] Furthermore, the data processing module performs real-time analysis on the monitoring data based on the following formula 1:

[0163]

[0164] Among them, R(t) is the response adjustment coefficient of the system at time t; A(t) represents the elevator acceleration at time t; S(t) represents the elevator speed at time t; S avg (t) is the average speed up to time t; V(t) represents the elevator vibration data at time t; T(t) represents the elevator temperature at time t; Tn(t) represents the cable tension at time t; Tn nominal is the nominal value of the cable tension; Vt(t) represents the voltage at time t; Vt nominal is the nominal operating voltage; δ 1 ,δ 2 ,δ 3 ,δ 4 ,δ 5 is the weight coefficient dynamically adjusted based on environmental conditions and historical data; γ is the nonlinear adjustment index;

[0165] When the response adjustment coefficient R(t) exceeds the preset upper limit, perform the following steps:

[0166] The data processing module switches the media display module to play high-priority emergency response videos and audios, including emergency evacuation prompts, audio guidance to stay calm, and methods to contact rescue;

[0167] If the abnormal condition involves dangerous signals such as acceleration, vibration or cable tension of the elevator, the system will issue a command to gradually slow down the elevator until it stops safely to ensure the safety of passengers;

[0168] Send detailed abnormal data and real-time video information to the remote security center through the wireless communication module;

[0169] When the response adjustment coefficient R(t) is lower than the preset lower limit, perform the following steps:

[0170] The media display module plays a low-intensity prompt video or audio to remind passengers that there may be slight abnormalities in the current elevator, so please remain vigilant but do not panic;

[0171] Depending on the different types of minor abnormalities, the media display module provides specific safety tips, including advising passengers to stand firm, stay away from the elevator door, or adjust their position.

[0172] In Formula 1, each item analyzes the changes in specific parameters of the elevator in real time and comprehensively reflects the stability and safety of the elevator's current state in a weighted manner. The following is a detailed description of each item in the formula:

[0173] This term is the integration of the absolute value of the second derivative of the elevator acceleration over the time interval [0, t], followed by the square root. This calculation is used to measure the severity of the elevator acceleration change. The second derivative of acceleration represents the rate of change of acceleration, also known as "shock" or "jerk". This parameter can identify the sharp fluctuations generated by the elevator during rapid acceleration or deceleration, which has a great impact on the safety of passengers.

[0174] In formula 1, the upper and lower limits of the integral 0 and t are both related to time, as described below:

[0175] 0: indicates the starting point of time, that is, the initial moment when the elevator starts running or monitoring begins. It is the starting point of time for calculating the response adjustment coefficient R(t).

[0176] t represents the current time, or a specific time at which the response adjustment coefficient is calculated. It is the upper limit of the time variable and defines the end point of the integration.

[0177] Therefore, the integral range [0, t] represents the system's cumulative calculation of the drastic change in acceleration from the initial moment to the current moment. As time goes by, t will continue to increase, and the system will update the response adjustment coefficient R(t) in real time, thereby continuously and dynamically monitoring and evaluating the elevator status.

[0178] Weight coefficient δ 1 It is a parameter that is adjusted according to the importance of the impact of acceleration changes on the system. Its value is dynamically set according to the historical operating data and environmental conditions of the elevator to ensure that the contribution of this item to R(t) can accurately reflect the potential risks during severe acceleration or deceleration.

[0179] This term is calculated by calculating the elevator's hourly speed S(t) and average speed S avgThe nonlinear adjustment of the ratio is determined by the exponent γ, which can highlight the impact of speed fluctuations on system safety, especially when the elevator speed increases or decreases abnormally.

[0180] Weight coefficient δ 2 It is used to adjust the importance of the speed term in the response adjustment coefficient to ensure that the term can sensitively reflect speed anomalies. Specifically, δ 2 The value of is based on the historical data of elevator speed changes and adapts to the operating characteristics of different elevators.

[0181] V(t)·log(T(t)+1): This item is calculated by combining the elevator's vibration data V(t) and temperature data T(t), and is mainly used to evaluate the vibration intensity of the elevator under different temperature conditions. The vibration data directly reflects the mechanical state of the elevator operation, while the logarithmic calculation of the temperature can reduce the linear impact of temperature fluctuations on the overall score and highlight its amplification effect on vibration abnormalities under high temperature conditions.

[0182] Weight coefficient δ 3 By adjusting the combined effect of vibration and temperature, the system is ensured to have sufficient response sensitivity in high vibration or high temperature conditions. The weight coefficient is dynamically adjusted based on historical temperature and vibration data to ensure that the temperature and vibration combination in different environments can accurately reflect the potential risks.

[0183] |Tn(t)-Tn nominal |: This term represents the deviation of cable tension, where Tn(t) is the real-time cable tension, Tn nominal The absolute value of this item is used to measure the deviation of the current cable tension from the normal value. The greater the deviation, the more unstable the elevator operation state is, and there may be a risk of cable loosening or damage.

[0184] Weight coefficient δ 4 Adjust according to the influence of cable tension on system safety. This coefficient is determined by the historical data of cable tension to ensure that the system safety can be reflected in time when the deviation is large. |Vt(t)-Vt nominal |: This item represents the deviation of the elevator voltage, where Vt(t) is the real-time voltage, Vt nominal The absolute value of this item is used to evaluate the stability of the current voltage. Too high or too low voltage deviation will threaten the normal operation of the elevator.

[0185] Weight coefficient δ 5 It is a regulation parameter based on the impact of voltage deviation on the system. Its value is set based on historical data of voltage fluctuations to ensure high sensitivity to voltage anomalies.

[0186] The data processing module evaluates the real-time status of the electric sample by calculating R(t). If R(t) exceeds the preset upper limit, the system will immediately enter the emergency state. At this time, the data processing module will trigger the media display module to play high-priority emergency videos and frequency production, guiding passengers to stay calm and take corresponding measures. At the same time, the system will send real-time abnormal data and video information to the remote security center through the wireless communication module. If R(t) is lower than the preset lower limit, the media display module will play a low-intensity prompt to remind passengers to stay vigilant, but there is no need to panic.

[0187] This design through real-time analysis and adjustment ensures the system's ability to respond quickly in a variety of abnormal situations and provides highly intelligent safety protection in the elevator. The various items in Formula 1 are analyzed in detail according to different physical parameters, combined with weight coefficients and nonlinear adjustments, which can flexibly adapt to a variety of complex operating conditions and ensure efficient emergency response.

[0188] Furthermore, the elevator integrated media and security monitoring system further includes a social distance monitoring module connected to the security monitoring module and the data processing module, and the social distance monitoring module is configured as follows:

[0189] Using the camera and depth sensor in the safety monitoring module to detect the distance between passengers in the elevator car;

[0190] Transmitting the monitored distance data to the data processing module;

[0191] The data processing module is further configured to:

[0192] receiving distance data from a social distance monitoring module;

[0193] Compare the received distance data with a preset safety distance threshold;

[0194] When it is detected that the distance between any two passengers is less than the preset safety distance threshold, a warning signal is triggered;

[0195] According to the triggered warning signal, the media display module is controlled to display a visual reminder and / or a voice reminder is played through the audio system to remind passengers to maintain a safe social distance;

[0196] Wherein, the media display module is further configured as follows:

[0197] While displaying media content normally, the real-time social distance status in the elevator is continuously displayed in a designated area of ​​the screen, including intuitive presentation of passenger distribution and distance information in the form of heat maps or color coding;

[0198] The system also includes a remote control interface, which allows administrators to remotely adjust the safety distance threshold and warning trigger conditions according to current prevention and control requirements.

[0199] The social distance monitoring module is closely connected with the security monitoring module and the data processing module. Its function is to use the camera and depth sensor in the security monitoring module to detect the distance between passengers in the elevator car in real time. The camera is mainly responsible for capturing the relative position and distribution images of passengers, while the depth sensor is used to measure the distance data between passengers to provide more accurate three-dimensional space perception.

[0200] When the social distance monitoring module collects the distance data, the data will be transmitted to the data processing module through the communication interface for further processing. The data processing module receives the distance data and compares it with the preset safety distance threshold in the system. If it is detected that the actual distance between any two passengers is less than the preset safety distance threshold, the data processing module will immediately trigger a warning signal. The triggering of the warning signal will activate the corresponding function of the media display module, and the media display module will warn the passengers through visual and audio reminders.

[0201] After receiving the warning signal, the media display module will visually remind passengers to maintain social distance on the display screen in the elevator. This visual reminder can intuitively present passenger distribution and distance information in the form of heat maps or color coding. For example, when the distance between passengers is less than the safety threshold, the relevant area on the display screen will turn red, accompanied by voice prompts to guide passengers to disperse and maintain a safe distance. This dual visual and audio reminder method can effectively attract the attention of passengers and prompt them to take action, thereby improving the epidemic prevention and safety management effects in the elevator.

[0202] At the same time, in order to adapt to different prevention and control requirements, the system also includes a remote control interface, allowing administrators to remotely adjust the safety distance threshold and warning trigger conditions according to actual needs. The remote control interface can be connected to the data processing module in the system through the network. The administrator can remotely set a new safety distance threshold or adjust the trigger conditions of the warning signal through a dedicated management terminal or mobile device. This remote control function not only improves the flexibility and adaptability of the system, but also ensures timely response and adjustment at different prevention and control stages.

[0203] In addition, the media display module will continue to display the real-time social distance situation in the elevator in a designated area of ​​the screen while playing advertisements, entertainment or information content normally. Specifically, a part of the display screen will be dedicated to presenting the relative position and distance of passengers in real time. For example, the passenger position can be displayed by color-coded dots or character icons, and the change of color intuitively indicates whether the distance is safe. When the distance between passengers is large, the display area will be displayed in green or blue; when the distance is less than the safety threshold, it will be displayed in orange or red to prompt passengers to pay attention. This continuous visual prompt ensures that passengers can maintain a clear understanding of social distance throughout the elevator ride.

[0204] In summary, the social distance monitoring module realizes real-time distance detection through cameras and depth sensors, and works with the data processing module and media display module to ensure social distance management in the elevator. This design not only improves the safety and intelligence level in the elevator, but also provides efficient and real-time technical support for prevention and control, and has the flexibility of remote control, which can adapt to changing prevention and control needs.

[0205] Although the present application is disclosed as above in the form of a preferred embodiment, it is not intended to limit the present application. Any technical personnel in this field may make possible changes and modifications without departing from the spirit and scope of the present application. Therefore, the scope of protection of the present application shall be based on the scope defined by the claims of the present application.

Claims

1. An integrated media and safety monitoring system in an elevator, characterized in that: include: A media display module is installed in the elevator car and is used to display the audio and video content of the media; A safety monitoring module, installed in the elevator car, configured to collect monitoring data in the elevator car, the monitoring data including audio, video, elevator acceleration, speed, vibration, temperature, elevator operating voltage, and elevator cable tension; an event detection module, connected to the safety monitoring module, for analyzing monitoring data to identify predetermined abnormal events, wherein the abnormal events include sudden acceleration or deceleration, abnormal pause or unexpected floor stop, car overload, car tilt or imbalance, elevator door failure to close or open normally, power failure or voltage abnormality, abnormal vibration or noise, abnormal temperature increase, and abnormal cable tension; The data processing module is coupled to the media display module and the event detection module, and is configured to display media content through the media display module under the normal working state of the elevator according to preset conditions; when an abnormal event is detected, according to the type of the abnormal event, corresponding response video and audio information are displayed to passengers through the media display module to guide passengers to respond to specific abnormal situations, and an alarm signal is sent to a remote security center.

2. The elevator integrated media and safety monitoring system according to claim 1, characterized in that: The elevator integrated media and safety monitoring system further includes a social distance monitoring module connected to the safety monitoring module and the data processing module, and the social distance monitoring module is configured as follows: Using the camera and depth sensor in the safety monitoring module to detect the distance between passengers in the elevator car; Transmitting the monitored distance data to the data processing module; The data processing module is further configured to: receiving distance data from a social distance monitoring module; Compare the received distance data with a preset safety distance threshold; When it is detected that the distance between any two passengers is less than the preset safety distance threshold, a warning signal is triggered; According to the triggered warning signal, the media display module is controlled to display a visual reminder and / or a voice reminder is played through the audio system to remind passengers to maintain a safe social distance; Wherein, the media display module is further configured as follows: While displaying media content normally, the real-time social distance status in the elevator is continuously displayed in a designated area of ​​the screen, including intuitive presentation of passenger distribution and distance information in the form of heat maps or color coding; The system also includes a remote control interface, which allows administrators to remotely adjust the safety distance threshold and warning trigger conditions according to current prevention and control requirements.

3. The elevator integrated media and safety monitoring system according to claim 1, characterized in that: The media display module is implemented by a transparent OLED display screen; The data processing module is also used for: Under normal working state of the elevator, the transparent OLED display screen is controlled to be in a non-transparent working mode; When an abnormal event is detected, the transparent OLED display screen is controlled to be in a transparent working mode to display the external environment of the car.

4. The integrated media and safety monitoring system in an elevator according to claim 1, characterized in that: The media display module includes: Eye-tracking cameras to capture where passengers are looking; Adaptive content rendering engine, used to adjust the position, size and clarity of displayed content according to the captured passenger's visual focus to optimize the passenger's viewing experience.

5. The integrated media and safety monitoring system in an elevator according to claim 1, characterized in that: The media display module includes a multimedia processing unit and a high-definition display screen. The multimedia processing unit is configured to switch the display content in real time according to the operating status of the elevator, display advertisements or entertainment content on the high-definition display screen under normal operating conditions, and switch to display emergency response video and audio information when an abnormal event is detected.

6. The elevator integrated media and safety monitoring system according to claim 3, characterized in that: The media display module further includes a touch screen interface, allowing passengers to interact with the system through the touch screen in an emergency situation to obtain personalized emergency guidance information.

7. The integrated media and safety monitoring system in an elevator according to claim 1, characterized in that: The security monitoring module includes: A multispectral imaging unit, including visible light, infrared, and depth cameras, for collecting high-quality images and depth information in a variety of light conditions; Acoustic arrays, which consist of multiple directional microphones to pinpoint sound sources and filter out background noise; Multi-dimensional acceleration sensor, used to simultaneously measure the acceleration, angular velocity and tilt angle of the elevator in the three axes of X, Y and Z; Thermal imaging cameras are used to monitor the temperature distribution of key elevator components and the body temperature of passengers.

8. The integrated media and safety monitoring system in an elevator according to claim 1, characterized in that: The event detection module comprises: A crowd behavior analyzer that uses computer vision technology to analyze passenger behavior and identify potential safety threats or medical emergencies; And send identified security threats or medical emergencies to a remote security center.

9. The integrated media and safety monitoring system in an elevator according to claim 1, characterized in that: The data processing module performs real-time analysis on the monitoring data based on the following formula 1: Among them, R(t) is the response adjustment coefficient of the system at time t; A(t) represents the elevator acceleration at time t; S(t) represents the elevator speed at time t; S avg (t) is the average speed up to time t; V(t) represents the elevator vibration data at time t; T(t) represents the elevator temperature at time t; Tn(t) represents the cable tension at time t; Tn nominal is the nominal value of the cable tension; Vt(t) represents the voltage at time t; Vt nominal is the nominal operating voltage; δ1, δ2, δ3, δ4, δ5 are weight coefficients dynamically adjusted based on environmental conditions and historical data; γ is the nonlinear adjustment index; When the response adjustment coefficient R(t) exceeds the preset upper limit, perform the following steps: The data processing module switches the media display module to play high-priority emergency response videos and audios, including emergency evacuation prompts, audio guidance to stay calm, and methods to contact rescue; If the abnormal condition involves dangerous signals such as acceleration, vibration or cable tension of the elevator, the system will issue a command to gradually slow down the elevator until it stops safely to ensure the safety of passengers; Send detailed abnormal data and real-time video information to the remote security center through the wireless communication module; When the response adjustment coefficient R(t) is lower than the preset lower limit, perform the following steps: The media display module plays a low-intensity prompt video or audio to remind passengers that there may be slight abnormalities in the current elevator, so please remain vigilant but do not panic; Depending on the different types of minor abnormalities, the media display module provides specific safety tips, including advising passengers to stand firm, stay away from the elevator door, or adjust their position.

10. The elevator integrated media and safety monitoring system according to claim 1, characterized in that: The event detection module is specifically used for: The accumulated abnormal event detection score is calculated according to the following formula 2: Where, E(t) is the cumulative abnormal event detection score; A(t) represents the elevator acceleration at time t; S(t) represents the elevator speed at time t; V(t) represents the elevator vibration data at time t; T(t) represents the elevator temperature at time t; T safe is the preset safety temperature threshold; Tn(t) represents the cable tension at time t; Tn max Vt is the maximum allowable value of cable tension; nominal is the nominal working voltage of the elevator; λ1,λ2,λ3,λ4,λ5 are weight coefficients; When the calculated cumulative abnormal event detection score E(t) exceeds the preset safety threshold, the corresponding response measures and alarm signals are triggered.

Images