Multielement intelligent fusion analysis method, system and terminal based on ladder media

Abstract

The invention discloses a multi-element intelligent fusion analysis method, system and terminal based on an elevator medium, and the method comprises the steps: forming a multi-element intelligent interaction environment based on various monitoring devices, an intelligent screen and an intelligent voice terminal which are deployed in an elevator in advance; elevator abnormal conditions and natural disaster conditions are automatically monitored based on the multi-element intelligent interaction environment, and the elevator abnormal conditions and the natural disaster conditions are correspondingly processed; obtaining an interaction instruction sent by a user based on the multi-element intelligent interaction environment, wherein the interaction instruction comprises an AR cross-screen interaction instruction and an AI intelligent dialogue instruction; and if the interaction instruction is an AR cross-screen interaction instruction, carrying out AR cross-screen interaction with the user through the smart screen, and if the interaction instruction is an AI intelligent dialogue instruction, carrying out recognition and transmission on user voice through the intelligent voice terminal to meet user requirements. According to the invention, the safety of passengers is guaranteed while the user experience is enriched, and the intelligent requirements of diversified ladder media are met.

Description

Technical Field

[0001] The present invention relates to the technical field of elevator media intelligence, and particularly to a multi - intelligent fusion analysis method, system, terminal and computer - readable storage medium based on elevator media. Background Art

[0002] Elevator media refers to an advertising media form centered around the elevator scenario. By setting up carriers such as advertising screens, framed posters, etc. inside and outside the elevator (such as in the car, waiting hall, building lobby, etc.), commercial or public welfare information is transmitted to the audience.

[0003] However, the current elevator media functions are relatively traditional, and the interaction forms with users are limited. There are problems with unstable connection and poor content adaptation in AR cross - screen interaction; the efficiency of the full - link service of AI intelligent dialogue in complex scenarios needs to be improved; in the face of natural disasters, elevators lack efficient dynamic recognition and autonomous protection capabilities. For example, in an aging society, the elderly have weak abilities to respond to emergencies, and there are differences in aging - friendly services and information dissemination in different regions. Existing technologies are difficult to meet diverse needs. At the same time, in case of emergencies or special situations, there is a lack of an emotional comfort mechanism for users.

[0004] Therefore, existing technologies still need to be improved and developed. Summary of the Invention

[0005] The main purpose of the present invention is to provide a multi - intelligent fusion analysis method, system, terminal and computer - readable storage medium based on elevator media, aiming to solve the problems in the prior art that elevator media functions are relatively traditional, the functions are relatively single, the interaction forms with users are limited, and elevator media is difficult to meet diverse intelligent needs.

[0006] To achieve the above purpose, the present invention provides a multi - intelligent fusion analysis method based on elevator media. The multi - intelligent fusion analysis method based on elevator media includes the following steps:

[0007] Based on a variety of monitoring devices, smart screens and intelligent voice terminals pre - deployed in the elevator, a multi - intelligent interaction environment is formed;

[0008] Based on the multi - intelligent interaction environment, elevator abnormal situations and natural disaster situations are automatically monitored, and corresponding processing is performed on the elevator abnormal situations and the natural disaster situations;

[0009] Based on the multi - intelligent interaction environment, interaction instructions sent by users are obtained, and the interaction instructions include: AR cross - screen interaction instructions and AI intelligent dialogue instructions;

[0010] If the interactive instruction is an AR cross-screen interactive instruction, perform AR cross-screen interaction with the user through the smart screen. If the interactive instruction is an AI intelligent dialogue instruction, recognize and transmit the user's voice through the intelligent voice terminal to meet the user's needs.

[0011] Optionally, in the above-mentioned multi-intelligent fusion analysis method based on in-building media, the monitoring device includes: a gravity sensor, a displacement sensor, a positioning device, a high-definition camera, a vibration sensor, an inclination sensor, and a meteorological data receiving device;

[0012] Automatically monitor the elevator abnormal conditions and natural disaster conditions based on the multi-intelligent interaction environment, and perform corresponding processing on the elevator abnormal conditions and the natural disaster conditions, specifically including:

[0013] Automatically detect elevator abnormal conditions through the gravity sensor, the displacement sensor, the positioning device, and the high-definition camera, report the abnormal conditions to the rescue center, and guide the passengers in the elevator through the intelligent voice terminal;

[0014] Identify future or ongoing natural disasters through the vibration sensor, the inclination sensor, and the meteorological data receiving device, execute corresponding protection measures according to the type of the natural disaster, and display and broadcast the natural disaster on the smart screen and the intelligent voice terminal respectively.

[0015] Optionally, in the above-mentioned multi-intelligent fusion analysis method based on in-building media, the process of automatically detecting elevator abnormal conditions through the gravity sensor, the displacement sensor, the positioning device, and the high-definition camera, reporting the abnormal conditions to the rescue center, and guiding the passengers in the elevator through the intelligent voice terminal specifically includes:

[0016] Collect the operation data of the elevator through the gravity sensor and the displacement sensor. If the operation data is abnormal, it is determined that the elevator has an abnormality;

[0017] After the elevator has an abnormality, determine the floor position of the elevator through the positioning device, and obtain the passenger status in the elevator through the high-definition camera;

[0018] Transmit the floor position and the passenger status to the rescue center through the Internet of Things, so as to notify the rescue center to dispatch corresponding rescue personnel and equipment to carry out the rescue according to the preset rescue plan, and communicate and guide the passengers in the elevator through the intelligent voice terminal.

[0019] Optionally, in the above-mentioned multi-intelligence fusion analysis method based on in-building media, when natural disasters that will occur or are occurring in the future are identified by the vibration sensor, the tilt sensor, and the meteorological data receiving device, corresponding protection measures are executed according to the types of the natural disasters, and the natural disasters are respectively displayed and broadcast on the smart screen and the intelligent voice terminal. Specifically, it includes:

[0020] The vibration change and tilt change of the elevator are respectively detected by the vibration sensor and the tilt sensor, and meteorological data from the meteorological department is received by the meteorological data receiving device;

[0021] Multi-source data fusion analysis is performed on the vibration change, the tilt change, and the meteorological data to identify natural disasters that will occur or are occurring in the future;

[0022] According to the types of the natural disasters, the elevator operation mode is adjusted according to a preset adjustment plan, and the natural disasters are respectively displayed and broadcast on the smart screen and the intelligent voice terminal.

[0023] Optionally, in the above-mentioned multi-intelligence fusion analysis method based on in-building media, a Bluetooth module, a Wi-Fi module, and a high-performance graphics processing chip are provided in the smart screen;

[0024] The AR cross-screen interaction with the user through the smart screen specifically includes:

[0025] The smart screen receives the connection information sent by the mobile application through the Bluetooth beacon or Wi-Fi and sends it to the smart screen, and a preliminary connection with the mobile application is established through the Bluetooth module or the Wi-Fi module of the smart screen. The mobile application is an interactive application program pre-installed by the user on the mobile phone, and the interactive application program supports Bluetooth, Wi-Fi connection, and AR functions.

[0026] After the preliminary connection is established, the sensor data sent by the mobile application is received, and the current viewing angle and position of the user are calculated according to the sensor data. The sensor data is generated by the gyroscope and accelerometer of the mobile phone;

[0027] The viewing angle and the position are transmitted to the smart screen through an encrypted channel, and the smart screen uses the high-performance graphics processing chip to render and present an AR interaction effect matching the user's mobile phone perspective in real time according to the viewing angle, the position, and the locally stored advertising materials.

[0028] Optionally, in the above-mentioned multi-intelligence fusion analysis method based on in-building media, the intelligent voice terminal is equipped with a microphone array, a high-definition camera, and a high-performance processor;

[0029] The intelligent voice terminal is used to identify and transmit the user's voice to fulfill the user's needs, specifically including:

[0030] Collect the first voice signal emitted by the user through the microphone array, perform noise reduction and filtering processing on the first voice signal, and then input it into the high-performance processor for identification and analysis to obtain a voice analysis result;

[0031] Collect the user's facial image and body movements through the high-definition camera, input the facial image and the body movements into the high-performance processor for feature extraction and analysis to obtain an image analysis result;

[0032] Fuse the voice analysis result and the image analysis result to obtain the user's target intention, and report the intention to the staff to help the user complete the target intention.

[0033] Optionally, in the above-mentioned multi-source intelligent fusion analysis method based on in-building media, the multi-source intelligent fusion analysis method based on in-building media further includes:

[0034] When an abnormal situation occurs in the elevator, a future natural disaster is identified, or a natural disaster that is occurring is identified, the microphone array and the high-definition camera continuously collect the second voice signal and facial expression information of the passengers respectively;

[0035] Input the second voice signal into the high-performance processor to analyze the tone and speech rate of the passengers, and input the facial expression information into the high-performance processor to identify the facial expressions of the passengers;

[0036] Comprehensively analyze the tone, speech rate and facial expressions to obtain the emotional state of the passengers. If the emotional state is in a state of fear, soothing words and soothing pictures are played through the intelligent voice terminal and the smart screen respectively.

[0037] In addition, to achieve the above object, the present invention also provides a multi-source intelligent fusion analysis system based on in-building media, wherein the multi-source intelligent fusion analysis system based on in-building media includes:

[0038] A hardware environment deployment module for forming a multi-source intelligent interaction environment based on a variety of monitoring devices, smart screens and intelligent voice terminals pre-deployed in the elevator;

[0039] An abnormal protection analysis and processing module for automatically monitoring the abnormal situation of the elevator and natural disaster situations based on the multi-source intelligent interaction environment, and performing corresponding processing on the elevator abnormal situation and the natural disaster situations;

[0040] An interaction instruction acquisition module, configured to acquire interaction instructions issued by a user based on the multi-intelligence interaction environment, where the interaction instructions include: AR cross-screen interaction instructions and AI intelligent dialogue instructions;

[0041] An intelligent dialogue interaction module, configured to, if the interaction instruction is an AR cross-screen interaction instruction, perform AR cross-screen interaction with the user through the smart screen, and if the interaction instruction is an AI intelligent dialogue instruction, identify and transmit the user's voice through the intelligent voice terminal to meet the user's needs.

[0042] In addition, to achieve the above object, the present invention further provides a terminal, where the terminal includes: a memory, a processor, and a multi-intelligence fusion analysis program based on in-building media stored on the memory and executable on the processor. When the multi-intelligence fusion analysis program based on in-building media is executed by the processor, the steps of the multi-intelligence fusion analysis method based on in-building media described above are implemented.

[0043] In addition, to achieve the above object, the present invention further provides a computer-readable storage medium, where the computer-readable storage medium stores a multi-intelligence fusion analysis program based on in-building media. When the multi-intelligence fusion analysis program based on in-building media is executed by a processor, the steps of the multi-intelligence fusion analysis method based on in-building media described above are implemented.

[0044] In the present invention, a variety of monitoring devices, smart screens, and intelligent voice terminals are deployed in the elevator. Based on the variety of monitoring devices, smart screens, and the intelligent voice terminals, a multi-intelligence interaction environment is formed; the elevator abnormal situation and natural disaster situation are automatically monitored through the multi-intelligence interaction environment, and corresponding processing is performed on the elevator abnormal situation and natural disaster situation; interaction instructions issued by the user are acquired through the multi-intelligence interaction environment, and the interaction instructions include: AR cross-screen interaction instructions and AI intelligent dialogue instructions; if the interaction instruction is an AR cross-screen interaction instruction, AR cross-screen interaction is performed with the user through the smart screen, and if the interaction instruction is an AI intelligent dialogue instruction, the user's voice is identified and transmitted through the intelligent voice terminal to complete the user's needs. The present invention enriches the user experience while ensuring the safety of passengers and meeting the diverse intelligent needs of in-building media. Description of the Drawings

[0045] Figure 1 is a flowchart of a preferred embodiment of the multi-intelligence fusion analysis method based on in-building media of the present invention;

[0046] Figure 2 is a structural diagram of a preferred embodiment of the multi-intelligence fusion analysis system based on in-building media of the present invention;

[0047] Figure 3 is a structural diagram of a preferred embodiment of the terminal of the present invention. Specific Embodiments

[0048] This application provides a multi - intelligent fusion analysis method, system, and terminal based on ladder media. To make the objectives, technical solutions, and effects of this application clearer and more explicit, the following further elaborates on this application with reference to the accompanying drawings and by way of examples. It should be understood that the specific embodiments described herein are only used to explain this application and are not used to limit this application.

[0049] Those skilled in the art of this technology can understand that, unless otherwise defined, all terms used herein (including technical terms and scientific terms) have the same meaning as the general understanding of those of ordinary skill in the art to which this application belongs. It should also be understood that terms such as those defined in a general dictionary should be understood to have a meaning consistent with their meaning in the context of the prior art, and will not be interpreted with an idealized or overly formal meaning unless specifically defined as herein.

[0050] In addition, if the descriptions in the embodiments of the present invention involve "first", "second", etc., such descriptions of "first", "second", etc. are only for descriptive purposes and cannot be understood as indicating or implying their relative importance or implicitly indicating the quantity of the technical features indicated. Thus, features defined with "first", "second" may explicitly or implicitly include at least one of such features. In addition, the technical solutions between various embodiments can be combined with each other, but it must be based on the ability of those of ordinary skill in the art to implement. When the combination of technical solutions results in contradictions or cannot be implemented, it should be considered that such a combination of technical solutions does not exist and is not within the scope of protection required by the present invention.

[0051] The multi - intelligent fusion analysis method based on ladder media according to a preferred embodiment of the present invention is as Figure 1 shown. The multi - intelligent fusion analysis method based on ladder media includes the following steps:

[0052] Step S10: Based on a variety of monitoring devices, smart screens, and intelligent voice terminals pre - deployed in the elevator, form a multi - intelligent interaction environment.

[0053] It can be understood that, in order to achieve multi - intelligent fusion analysis based on ladder media, this embodiment first deploys the hardware of the multi - intelligent interaction environment, including deploying a variety of monitoring devices, the smart screen, and the intelligent voice terminal in the elevator.

[0054] Step S20: Automatically monitor the abnormal conditions and natural disaster conditions of the elevator based on the multi - intelligent interaction environment, and perform corresponding processing on the abnormal conditions and natural disaster conditions of the elevator.

[0055] Among them, the monitoring device includes: a gravity sensor, a displacement sensor, a positioning device, a high-definition camera, a vibration sensor, an inclination sensor, and a meteorological data receiving device.

[0056] The abnormal situation of the elevator is automatically detected through the gravity sensor, the displacement sensor, the positioning device, and the high-definition camera, and the abnormal situation is reported to the rescue center, and the passengers in the elevator are guided through the intelligent voice terminal.

[0057] Specifically, the operation data of the elevator is collected through the gravity sensor and the displacement sensor. If the operation data is abnormal, it is determined that the elevator has an abnormality.

[0058] After the elevator has an abnormality, the floor position of the elevator is determined through the positioning device, and the passenger condition in the elevator is obtained through the high-definition camera.

[0059] The floor position and the passenger condition are transmitted to the rescue center through the Internet of Things to notify the rescue center to dispatch the corresponding rescue personnel and equipment to carry out the rescue according to the preset rescue plan, and communicate and guide the passengers in the elevator through the intelligent voice terminal.

[0060] In this embodiment, with the help of the gravity sensor, displacement sensor, positioning device (such as GPS, indoor positioning system) installed in the elevator, and combined with the management platform server equipped in the rescue center, the elevator Internet of Things system is connected to realize intelligent elevator rescue.

[0061] As an example, when a person in the elevator triggers the emergency button or the system detects an abnormal situation, the gravity sensor and the displacement sensor collect the operation data of the elevator, the positioning device determines the floor position of the elevator, and the high-definition camera identifies the condition of the people in the elevator. These information are transmitted to the rescue center through the Internet of Things. The rescue center dispatches the corresponding rescue personnel and equipment according to the preset rescue plan. At the same time, the rescue center maintains real-time communication with the trapped people through the voice communication device, informs the trapped people that the rescue personnel have set out and the estimated arrival time, and guides the trapped people to perform simple self-rescue actions.

[0062] With the help of the Internet of Things platform in this application, the sensors and positioning devices in the elevator can accurately obtain the floor position information of the elevator in real time. Using the camera and human body sensing technology, not only can the number of people in the elevator be identified, but also whether there are people with mobility difficulties can be judged, providing comprehensive and accurate data support for the rescue. Once an emergency rescue request is triggered in the elevator or the system detects an abnormal situation, the rescue system immediately responds and pushes the elevator position and personnel information to the rescue center. The rescue center quickly formulates a rescue plan according to this information, dispatches rescue personnel and equipment, and maintains real-time communication with the trapped people through the voice system in the elevator, soothing their emotions and guiding self-rescue.

[0063] It can be seen that the present application achieves the technical effect of intelligent elevator rescue and improves the rescue efficiency: the precise positioning and rapid response mechanism greatly shortens the elevator rescue time and ensures life safety; the safety guarantee is enhanced: the real-time monitoring and intelligent rescue system provide more reliable safety guarantee for elevator passengers, reduce the risks brought by elevator safety accidents, and enhance the public's confidence in elevator safety.

[0064] Furthermore, the future or ongoing natural disasters are identified through the vibration sensor, the tilt sensor, and the meteorological data receiving device. According to the type of the natural disaster, corresponding protective measures are executed, and the natural disaster is respectively displayed and broadcast on the intelligent screen and the intelligent voice terminal.

[0065] Specifically, the vibration change and tilt change of the elevator are respectively detected through the vibration sensor and the tilt sensor, and the meteorological data from the meteorological department is received through the meteorological data receiving device;

[0066] Multi-source data fusion analysis is performed on the vibration change, the tilt change, and the meteorological data to identify the future or ongoing natural disasters;

[0067] According to the type of the natural disaster, the elevator operation mode is adjusted according to a preset adjustment scheme, and the natural disaster is respectively displayed and broadcast on the intelligent screen and the intelligent voice terminal.

[0068] In this embodiment, with the help of devices such as vibration sensors, tilt sensors, and meteorological data receiving modules installed in the elevator, and at the same time connected to the external disaster monitoring data network through the elevator control system, the natural disaster dynamic identification and autonomous protection technology are realized.

[0069] Taking earthquake monitoring as an example, when the earthquake monitoring network detects an earthquake and the seismic waves spread to the area where the elevator is located, the vibration sensor and tilt sensor in the elevator detect the vibration and tilt changes of the elevator. The elevator control system receives the earthquake data sent by the meteorological department and the earthquake monitoring network, and performs multi-source data fusion analysis. If it is judged that the elevator is about to be affected by the earthquake, the elevator operation mode is adjusted. At this time, the operation mode of the elevator is switched to automatically execute the emergency stop procedure, stop at the nearest floor and open the elevator door. The elevator screen and the voice system play emergency guidance information for the passengers.

[0070] Taking a typhoon as an example, after the typhoon warning is issued, the elevator system makes early protection preparations according to the path and intensity information of the typhoon. When the typhoon affects the area where the elevator is located, the elevator automatically adjusts the operation mode, such as stopping the operation on high floors to avoid damage to the elevator caused by strong winds. The elevator screen displays typhoon-related information and safety tips for the passengers.

[0071] This application combines meteorological department data, earthquake monitoring network data, and the sensor data of the elevator itself to monitor the occurrence and development trends of natural disasters such as earthquakes, tsunamis, and typhoons in real time. Vibration sensors, tilt sensors, and other devices are installed in the elevator to collect the status data of the elevator itself, and perform fusion analysis with external disaster data to achieve accurate dynamic identification of disasters. When the system identifies that it is about to be affected by natural disasters, the elevator automatically executes a series of self-protection actions, such as emergency stopping at the nearest floor and opening the elevator doors, to prevent being trapped due to elevator failures caused by disasters. At the same time, the smart screen (elevator screen) and the intelligent voice terminal provide passengers with detailed emergency guidance information.

[0072] It can be seen that this application has achieved the technical effects of dynamic identification and self-protection of natural disasters, ensuring life safety: when natural disasters occur, through the dynamic identification and self-protection functions, it provides safety guidance and protection measures for passengers in a timely manner, minimizing the harm of disasters to elevator passengers; improving the social emergency response ability: the application of this technology helps to improve the emergency response ability of the entire society in the face of natural disasters, providing strong support for urban safety and social stability.

[0073] Furthermore, the multi-intelligent fusion analysis method based on in-elevator media also includes:

[0074] When the elevator encounters abnormal situations, identifies future natural disasters, or identifies ongoing natural disasters, the microphone array and the high-definition camera continuously collect the second voice signals and facial expression information of passengers respectively;

[0075] Input the second voice signals into the high-performance processor to analyze the intonation and speech rate of passengers, and input the facial expression information into the high-performance processor to identify the facial expressions of passengers;

[0076] Comprehensively analyze the intonation, speech rate, and facial expressions to obtain the emotional state of passengers. If the emotional state is in a state of fear, play soothing words and soothing pictures through the intelligent voice terminal and the smart screen respectively.

[0077] In this embodiment, relying on the intelligent voice terminal and elevator screen at the elevator entrance, using their existing voice and image acquisition devices, and the server in the background to process and analyze emotional data. Taking the scenario of being trapped due to elevator failure as an example, the intelligent voice terminal continuously collects the voice and facial expression information of the trapped person. The voice recognition system analyzes the intonation and speech rate of the voice, and the image recognition system recognizes the facial expression to comprehensively judge the emotional state of the trapped person. If it is judged that the trapped person is in a state of fear, the soothing program is immediately activated, and soothing words such as "Don't panic, we have contacted the rescue team and they will arrive soon. Staying calm is more beneficial to us" are played through the voice system in the elevator. At the same time, some reassuring animations or pictures, such as warm landscape pictures, are displayed on the elevator screen, and soft music is played to relieve the tension of the trapped person.

[0078] This application uses the voice recognition and image recognition technologies of the intelligent voice terminal to analyze the user's voice intonation, speech rate, facial expression, etc. in real time, judge the user's emotional state, such as anxiety, fear, happiness, etc. And according to the recognized emotional state, corresponding soothing words and interactive content are automatically generated. In case of emergencies such as elevator failures or natural disasters, when it is detected that the user is in a tense or fearful state, the AI emotional intelligent agent soothes through gentle and soothing voices.

[0079] It can be seen that this application provides an AI emotional intelligent agent for the elevator media, which relieves the tense mood: in case of emergencies or special situations, it can timely recognize the user's emotional state and effectively soothe, relieve the user's negative emotions such as tension and fear, avoid dangerous behaviors caused by emotional fluctuations, and enhance the user's psychological sense of security in special scenarios; improves the service quality: provides a more user-friendly service experience for users, making the elevator service not only a simple transportation, but also able to give care at the emotional level, enhancing the user's favorability and trust in the elevator service.

[0080] Step S30, obtain the interaction instructions issued by the user based on the multi-intelligent interaction environment, and the interaction instructions include: AR cross-screen interaction instructions and AI intelligent dialogue instructions.

[0081] Specifically, obtain the AR (Augmented Reality) cross-screen interaction instructions and AI intelligent dialogue instructions issued by the user through the smart screen and the intelligent voice terminal. Among them, the AR cross-screen interaction instructions are used to implement the AR cross-screen interaction technology between the user and the smart screen, and the AI intelligent dialogue instructions are used to implement AI intelligent dialogue.

[0082] Step S40: If the interaction instruction is an AR cross-screen interaction instruction, conduct AR cross-screen interaction with the user through the smart screen; if the interaction instruction is an AI intelligent dialogue instruction, recognize and transmit the user's voice through the intelligent voice terminal to meet the user's needs.

[0083] In this embodiment, the smart screen is internally provided with a Bluetooth module, a Wi-Fi module, and a high-performance graphics processing chip. Specifically, install a smart screen with high resolution and supporting multi-touch in the elevator, and internally install a Bluetooth beacon, a Wi-Fi module, and a high-performance graphics processing chip. The user's mobile phone needs to install a dedicated interaction application, which supports Bluetooth, Wi-Fi connection, and AR functions.

[0084] Further, the AR cross-screen interaction with the user through the smart screen specifically includes:

[0085] The smart screen receives the connection information sent by the mobile phone application through the Bluetooth beacon or Wi-Fi and sends it to the smart screen, and establishes a preliminary connection with the mobile phone application through the Bluetooth module or the Wi-Fi module of the smart screen. The mobile phone application is an interaction application program pre-installed by the user on the mobile phone, and the interaction application program supports Bluetooth, Wi-Fi connection, and AR functions.

[0086] After the preliminary connection is established, receive the sensor data sent by the mobile phone application, and calculate the user's current viewing angle and position according to the sensor data. The sensor data is generated by the gyroscope and accelerometer of the mobile phone;

[0087] Transmit the viewing angle and the position to the smart screen through an encrypted channel, and the smart screen uses the high-performance graphics processing chip to perform real-time rendering and present an AR interaction effect matching the user's mobile phone perspective according to the viewing angle, the position, and the locally stored advertising materials.

[0088] It can be understood that when the user enters the elevator and opens the mobile phone application, the mobile phone application will automatically scan the nearby Bluetooth beacon and establish a preliminary connection with the elevator screen. After the connection is successful, the application obtains the device information and network status of the elevator screen and selects the optimal connection method. When performing AR advertisement interaction, the mobile phone application calculates the user's viewing angle and position according to the sensor data such as the gyroscope and accelerometer of the mobile phone, and transmits these data to the elevator screen through an encrypted channel. The elevator screen performs real-time rendering using the graphics processing chip according to the received data in combination with the locally stored advertising materials, and presents an AR interaction effect matching the user's mobile phone perspective.

[0089] This application adopts a hybrid connection and optimized transmission method, and through the collaborative work of Bluetooth, Wi-Fi direct connection and cloud services, it realizes a stable connection between the elevator screen and the user's mobile phone. The elevator screen is equipped with a Bluetooth beacon and a Wi-Fi module. The mobile phone application automatically searches for Bluetooth signals to establish a preliminary connection, and then selects the optimal data transmission method according to the network conditions to ensure that the screen switching delay during the interaction is less than 0.1 second, ensuring real-time response in AR games or advertising interactions. At the same time, the present invention develops an adaptive rendering algorithm for different resolutions, sizes and performances of the elevator screen and the mobile phone screen. The operation data on the mobile phone side is quickly transmitted to the elevator screen through an encrypted channel. The elevator screen combines with the local rendering engine to render the interactive effect matching the mobile phone side in real time, bringing an immersive cross-screen interactive experience to users.

[0090] It can be seen that this application achieves the AR cross-screen interactive effect and enriches the user experience: it breaks the single display mode of traditional elevator media, brings an immersive experience to users through AR cross-screen interaction, increases the interest and interactivity of taking the elevator, and improves the user's attention and participation in elevator media; it enhances the advertising value: provides a more attractive advertising delivery method for advertisers. AR interactive advertisements can enable users to understand products more deeply, improving the conversion rate and commercial value of advertisements.

[0091] Furthermore, the intelligent voice terminal is equipped with a microphone array, a high-definition camera and a high-performance processor. Specifically, an intelligent voice terminal is set at the elevator entrance, equipped with a high-definition camera, a microphone array and a high-performance processor. The management platform is equipped with a server, which is connected to the monitoring system, personnel positioning system, etc. in the mall or community.

[0092] The recognition and transmission of the user's voice by the intelligent voice terminal to complete the user's needs specifically includes:

[0093] Collect the first voice signal emitted by the user through the microphone array, perform noise reduction and filtering processing on the first voice signal, and then input it into the high-performance processor for recognition and analysis to obtain a voice analysis result;

[0094] Collect the user's facial image and body movements through the high-definition camera, input the facial image and the body movements into the high-performance processor for feature extraction and analysis to obtain an image analysis result;

[0095] Fuse the voice analysis result and the image analysis result to obtain the user's target intention, and report the intention to the staff to help the user complete the target intention.

[0096] It is understandable that, taking a child looking for his mother in a shopping mall as an example, the child says "looking for mom" in front of the smart voice terminal at the elevator entrance, and the microphone array collects the voice signal. After pre-processing such as noise reduction and filtering, it is input into the voice recognition model for recognition. At the same time, the high-definition camera collects the child's facial image and body movements, and the image recognition algorithm extracts and analyzes its features. After the voice recognition results and image analysis results are integrated, the system determines that the child's intention is to find his mother. The elevator screen immediately switches to the guidance interface for finding mom and displays prompt information. The child answers the characteristics of his mother by voice, and the system integrates this information with the previously collected information and sends it to the management platform through the Internet of Things. The management platform performs intelligent search in the monitoring screen based on the real-time images provided by the monitoring system in the mall and the characteristics of his mother described by the child. According to the property personnel positioning system, the search task is assigned to the property personnel who are closest to the child and free, and the processing progress is fed back to the elevator screen and the smart voice terminal used by the child in real time.

[0097] In this application, the intelligent voice terminal at the elevator entrance integrates advanced voice recognition and image recognition technologies. Voice recognition uses a deep learning model, and the recognition accuracy of voice content in a noisy environment can reach more than 95%; image recognition analyzes the user's facial expressions and body movements in real time, and combines the information of both to accurately judge the user's intentions. When the user initiates a request, the elevator screen quickly switches to the corresponding guidance interface, collects key information, and transmits the request and user-related information (desensitized) to the management platform through the Internet of Things. The management platform uses intelligent scheduling algorithms to quickly assign tasks and track feedback processing progress in real time based on factors such as the location and busyness of the staff, ensuring efficient operation of the entire link from help to resolution.

[0098] It can be seen that this application realizes the technical effect of AI intelligent dialogue and ensures the safety of special groups: provides convenient channels for seeking help for special groups such as children and the elderly, quickly responds to and solves problems they encounter in public places, and enhances their sense of security in unfamiliar environments; optimizes service processes: intelligent scheduling and full-link processing mechanisms improve the work efficiency of property and related service departments, optimize service processes, improve overall service quality, and enhance user satisfaction with the venue.

[0099] Furthermore, the present application performs software upgrades on the smart screen and the smart voice terminal in the elevator to achieve functional optimization and realize AI voice adaptation for the elderly and regionalization.

[0100] Specifically, in terms of aging-friendly, when the elevator system detects that the majority of users are elderly people (which can be determined through long-term usage data or manually set), the voice settings are automatically adjusted. The voice broadcast volume is increased, and the speech speed is adjusted to 120-140 words per minute, which is 20%-30% slower than the normal speed. In terms of display, the text size is increased to 1.5-2 times the original size, and a high-contrast color combination is selected, such as white text on a black background or black text on a yellow background.

[0101] It is understandable that this application optimizes the AI ​​voice function, increases the voice volume, and uses clear and slow speech speed for the elderly to see the characteristics of decreased vision and hearing. At the same time, it is displayed on the elevator screen with concise and clear text. For example, in terms of elevator operation prompts and emergency instructions, larger fonts and high-contrast colors are used to make it easier for the elderly to read.

[0102] Furthermore, in regionalized applications, according to the geographical location information of the area where the elevator is located, it automatically switches to the local dialect voice broadcast. In the Cantonese-speaking areas of Guangdong, the elevator provides Cantonese voice options in operation prompts, advertising playback, etc., and the voice content conforms to the local expression habits, such as saying "Please be careful of the steps" as "Be careful of the stairs", which enhances residents' acceptance and user experience.

[0103] It is understandable that this application provides regionalized voice customization, and customizes AI voice content according to the dialects and cultural habits of different regions. In the application of the ladder media network, familiar dialect voice services are provided to users in different regions to enhance the user's sense of intimacy and identity. In some areas where dialects are more commonly used, the intelligent voice terminal can provide dialect broadcast options for the convenience of residents.

[0104] It can be seen that the technical effect of achieving AI voice adaptation for the elderly and regionalized application in this application relieves tension: in emergency or special circumstances, it can promptly identify the user's emotional state and effectively comfort the user, relieve the user's tension, fear and other negative emotions, avoid dangerous behaviors caused by emotional fluctuations, and enhance the user's psychological security in special scenarios; improve service quality: provide users with a more humane service experience, so that elevator services are not just simple transportation, but can also provide care on an emotional level, enhancing users' favorability and trust in elevator services.

[0105] Furthermore, if Figure 2 As shown, based on the above-mentioned ladder-based multiple intelligence fusion analysis method, the present invention also provides a ladder-based multiple intelligence fusion analysis system, wherein the ladder-based multiple intelligence fusion analysis system includes:

[0106] A hardware environment deployment module, configured to form a multi - intelligent interaction environment based on a variety of monitoring devices, smart screens, and intelligent voice terminals pre - deployed in the elevator;

[0107] An abnormal protection analysis and processing module, configured to automatically monitor elevator abnormal conditions and natural disaster conditions based on the multi - intelligent interaction environment, and perform corresponding processing on the elevator abnormal conditions and the natural disaster conditions;

[0108] An interaction instruction acquisition module, configured to acquire interaction instructions issued by a user based on the multi - intelligent interaction environment, where the interaction instructions include: AR cross - screen interaction instructions and AI intelligent dialogue instructions;

[0109] An intelligent dialogue interaction module, configured to, if the interaction instruction is an AR cross - screen interaction instruction, perform AR cross - screen interaction with the user through the smart screen, and if the interaction instruction is an AI intelligent dialogue instruction, recognize and transmit the user's voice through the intelligent voice terminal to meet the user's needs.

[0110] Further, as Figure 3 shown, based on the above - mentioned multi - intelligent fusion analysis method and system based on in - elevator media, the present invention also correspondingly provides a terminal, which includes a processor 10, a memory 20, and a display 30. Figure 3 Only some components of the terminal are shown, but it should be understood that it is not required to implement all the shown components, and more or fewer components can be alternatively implemented.

[0111] The memory 20 may be an internal storage unit of the terminal in some embodiments, such as the hard disk or memory of the terminal. The memory 20 may also be an external storage device of the terminal in other embodiments, such as a plug - in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) card, a Flash Card, etc. equipped on the terminal. Further, the memory 20 may also include both the internal storage unit and the external storage device of the terminal. The memory 20 is used to store application software installed on the terminal and various types of data, such as the program code for installing the terminal. The memory 20 may also be used to temporarily store data that has been output or will be output. In one embodiment, a multi - intelligent fusion analysis program 40 based on in - elevator media is stored on the memory 20, and the multi - intelligent fusion analysis program 40 based on in - elevator media can be executed by the processor 10, thereby implementing the multi - intelligent fusion analysis method based on in - elevator media in this application.

[0112] In some embodiments, the processor 10 may be a central processing unit (CPU), a microprocessor, or other data processing chips, which are used to run the program code stored in the memory 20 or process data, such as executing the above-mentioned multi-intelligence fusion analysis method based on ladder media, etc.

[0113] In some embodiments, the display 30 may be an LED display, a liquid crystal display, a touch liquid crystal display, and an OLED (Organic Light-Emitting Diode) touch device, etc. The display 30 is used to display the information in the terminal and to display a visual user interface. The components of the terminal communicate with each other through a system bus.

[0114] In one embodiment, when the processor 10 executes the multi-intelligence fusion analysis program 40 based on ladder media in the memory 20, the following steps are implemented:

[0115] Based on a variety of monitoring devices, intelligent screens, and intelligent voice terminals pre-deployed in the elevator, a multi-intelligence interaction environment is formed;

[0116] Based on the multi-intelligence interaction environment, the elevator abnormal conditions and natural disaster conditions are automatically monitored, and corresponding processing is performed on the elevator abnormal conditions and the natural disaster conditions;

[0117] Based on the multi-intelligence interaction environment, interaction instructions issued by the user are obtained, and the interaction instructions include: AR cross-screen interaction instructions and AI intelligent dialogue instructions;

[0118] If the interaction instruction is an AR cross-screen interaction instruction, AR cross-screen interaction is performed with the user through the intelligent screen. If the interaction instruction is an AI intelligent dialogue instruction, the user's voice is recognized and transmitted through the intelligent voice terminal to meet the user's needs.

[0119] Among them, the monitoring devices include: a gravity sensor, a displacement sensor, a positioning device, a high-definition camera, a vibration sensor, an inclination sensor, and a meteorological data receiving device;

[0120] The step of automatically monitoring the elevator abnormal conditions and natural disaster conditions based on the multi-intelligence interaction environment and performing corresponding processing on the elevator abnormal conditions and the natural disaster conditions specifically includes:

[0121] The elevator abnormal conditions are automatically monitored through the gravity sensor, the displacement sensor, the positioning device, and the high-definition camera, the abnormal conditions are reported to the rescue center, and the passengers in the elevator are guided through the intelligent voice terminal;

[0122] Identify future or ongoing natural disasters through the vibration sensor, the tilt sensor, and the meteorological data receiving device, execute corresponding protective measures according to the type of the natural disaster, and display and broadcast the natural disaster on the smart screen and the intelligent voice terminal respectively.

[0123] Among them, automatically monitor the abnormal situation of the elevator through the gravity sensor, the displacement sensor, the positioning device, and the high-definition camera, report the abnormal situation to the rescue center, and guide the passengers in the elevator through the intelligent voice terminal. Specifically, it includes:

[0124] Collect the operation data of the elevator through the gravity sensor and the displacement sensor. If the operation data is abnormal, it is determined that the elevator has an abnormality.

[0125] After the elevator has an abnormality, determine the floor position of the elevator through the positioning device, and obtain the passenger status in the elevator through the high-definition camera.

[0126] Transmit the floor position and the passenger status to the rescue center through the Internet of Things, so as to notify the rescue center to dispatch corresponding rescue personnel and equipment to rescue according to the preset rescue plan, and communicate and guide the passengers in the elevator through the intelligent voice terminal.

[0127] Among them, identify future or ongoing natural disasters through the vibration sensor, the tilt sensor, and the meteorological data receiving device, execute corresponding protective measures according to the type of the natural disaster, and display and broadcast the natural disaster on the smart screen and the intelligent voice terminal respectively. Specifically, it includes:

[0128] Detect the vibration change and tilt change of the elevator through the vibration sensor and the tilt sensor respectively, and receive the meteorological data from the meteorological department through the meteorological data receiving device.

[0129] Perform multi-source data fusion analysis on the vibration change, the tilt change, and the meteorological data to identify future or ongoing natural disasters.

[0130] According to the type of the natural disaster, adjust the elevator operation mode according to the preset adjustment plan, and display and broadcast the natural disaster on the smart screen and the intelligent voice terminal respectively.

[0131] Among them, the smart screen is equipped with a Bluetooth module, a Wi-Fi module, and a high-performance graphics processing chip.

[0132] The AR cross-screen interaction with the user through the smart screen specifically includes:

[0133] The smart screen receives the connection information sent by the mobile application via Bluetooth beacon or Wi-Fi, and sends it to the smart screen. A preliminary connection with the mobile application is established through the Bluetooth module or the Wi-Fi module of the smart screen. The mobile application is an interactive application program pre-installed by the user on the mobile phone, and the interactive application program supports Bluetooth, Wi-Fi connection, and AR function.

[0134] After the preliminary connection is established, it receives the sensor data sent by the mobile application, calculates the user's current viewing angle and position according to the sensor data, and the sensor data is generated by the gyroscope and accelerometer of the mobile phone;

[0135] The viewing angle and the position are transmitted to the smart screen through an encrypted channel, and the smart screen, through the high-performance graphics processing chip, renders and presents in real time an AR interactive effect that matches the user's mobile phone perspective according to the viewing angle, the position, and the advertisement materials stored locally.

[0136] Among them, the intelligent voice terminal is equipped with a microphone array, a high-definition camera, and a high-performance processor;

[0137] The intelligent voice terminal recognizes and transmits the user's voice to complete the user's needs, specifically including:

[0138] Collect the first voice signal emitted by the user through the microphone array, perform noise reduction and filtering processing on the first voice signal, and then input it into the high-performance processor for recognition and analysis to obtain a voice analysis result;

[0139] Collect the user's facial image and body movements through the high-definition camera, input the facial image and the body movements into the high-performance processor for feature extraction and analysis to obtain an image analysis result;

[0140] Fuse the voice analysis result and the image analysis result to obtain the user's target intention, and report the intention to the staff to help the user complete the target intention.

[0141] Among them, the multi-intelligent fusion analysis method based on in-building media also includes:

[0142] When an abnormal situation occurs in the elevator, a future natural disaster is recognized, or a natural disaster that is occurring is recognized, the microphone array and the high-definition camera continuously collect the second voice signal and facial expression information of the passengers respectively;

[0143] Input the second voice signal into the high-performance processor to analyze the tone and speech rate of the passenger, and input the facial expression information into the high-performance processor to identify the facial expression of the passenger;

[0144] Comprehensively analyze the tone, speech rate and facial expression to obtain the emotional state of the passenger. If the emotional state is in a state of fear, play soothing words and soothing pictures through the intelligent voice terminal and the smart screen respectively.

[0145] The present invention also provides a computer-readable storage medium, wherein the computer-readable storage medium stores a multi-element intelligent fusion analysis program based on in-elevator media. When the multi-element intelligent fusion analysis program based on in-elevator media is executed by a processor, the steps of the multi-element intelligent fusion analysis method based on in-elevator media as described above are implemented.

[0146] In summary, the present invention proposes a multi-element intelligent fusion analysis method, system and terminal based on in-elevator media. The method includes: deploying a variety of monitoring devices, a smart screen and an intelligent voice terminal in the elevator, and forming a multi-element intelligent interaction environment based on the variety of monitoring devices, the smart screen and the intelligent voice terminal; automatically monitoring elevator abnormal situations and natural disaster situations through the multi-element intelligent interaction environment, and performing corresponding processing on the elevator abnormal situations and natural disaster situations; obtaining interaction instructions issued by the user through the multi-element intelligent interaction environment, and the interaction instructions include: AR cross-screen interaction instructions and AI intelligent dialogue instructions; if the interaction instruction is an AR cross-screen interaction instruction, perform AR cross-screen interaction with the user through the smart screen, and if the interaction instruction is an AI intelligent dialogue instruction, identify and transmit the user's voice through the intelligent voice terminal to complete the user's needs. While enriching the user experience, the present invention ensures the safety of passengers and meets the diverse intelligent needs of in-elevator media. The present invention effectively improves the accuracy of typhoon azimuth estimation.

[0147] It should be noted that in this article, the terms "include", "comprise" or any other variant thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal including a series of elements not only includes those elements, but also includes other elements not expressly listed, or further includes elements inherent to such process, method, article or terminal. Without further limitation, an element defined by the phrase "including a..." does not exclude the existence of additional identical elements in the process, method, article or terminal including that element.

[0148] Of course, those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above methods. Among them, any reference to a memory, storage, database, or other medium used in the various embodiments provided by the present invention can include non-volatile and / or volatile memories. Non-volatile memories can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memories can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in various forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), Rambus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and Rambus dynamic RAM (RDRAM), etc.

[0149] It should be understood that the application of the present invention is not limited to the above examples. For those of ordinary skill in the art, improvements or transformations can be made according to the above description. All such improvements and transformations should fall within the protection scope of the appended claims of the present invention.

Claims

1. A multi-intelligence fusion analysis method based on ladder media, characterized in that, The described multi-intelligence fusion analysis method based on ladder media includes: Based on a variety of monitoring devices, smart screens, and intelligent voice terminals pre-deployed in elevators, a multi-intelligence interactive environment is formed; Based on the multi-intelligence interactive environment, elevator abnormal situations and natural disaster situations are automatically monitored, and corresponding processing is carried out on the elevator abnormal situations and the natural disaster situations; Based on the multi-intelligence interactive environment, interactive instructions issued by users are obtained, and the interactive instructions include: AR cross-screen interactive instructions and AI intelligent dialogue instructions; If the interactive instruction is an AR cross-screen interactive instruction, AR cross-screen interaction is carried out with the user through the smart screen. If the interactive instruction is an AI intelligent dialogue instruction, the user's voice is recognized and transmitted through the intelligent voice terminal to meet the user's needs.

2. The multi-intelligent fusion analysis method based on ladder media according to claim 1, wherein The monitoring devices include: gravity sensors, displacement sensors, positioning devices, high-definition cameras, vibration sensors, tilt sensors, and meteorological data receiving devices; The automatically monitoring elevator abnormal situations and natural disaster situations based on the multi-intelligence interactive environment and carrying out corresponding processing on the elevator abnormal situations and the natural disaster situations specifically includes: The elevator abnormal situations are automatically detected through the gravity sensor, the displacement sensor, the positioning device, and the high-definition camera, the abnormal situations are reported to the rescue center, and the passengers in the elevator are guided through the intelligent voice terminal; The future or ongoing natural disasters are identified through the vibration sensor, the tilt sensor, and the meteorological data receiving device. According to the type of the natural disaster, corresponding protection measures are executed, and the natural disaster is respectively displayed and broadcast on the smart screen and the intelligent voice terminal.

3. The multi-intelligent fusion analysis method based on ladder media according to claim 2, wherein The automatically detecting elevator abnormal situations through the gravity sensor, the displacement sensor, the positioning device, and the high-definition camera, reporting the abnormal situations to the rescue center, and guiding the passengers in the elevator through the intelligent voice terminal specifically includes: The operation data of the elevator is collected through the gravity sensor and the displacement sensor. If the operation data is abnormal, it is determined that the elevator has an abnormality; After the elevator has an abnormality, the floor position of the elevator is determined through the positioning device, and the passenger situation in the elevator is obtained through the high-definition camera; The floor position and the passenger situation are transmitted to the rescue center through the Internet of Things to notify the rescue center to dispatch corresponding rescue personnel and equipment to carry out rescue according to the preset rescue plan, and the passengers in the elevator are communicated with and guided through the intelligent voice terminal.

4. The multi-intelligent fusion analysis method based on ladder media according to claim 3, characterized in that The identifying future or ongoing natural disasters through the vibration sensor, the tilt sensor, and the meteorological data receiving device, executing corresponding protection measures according to the type of the natural disaster, and respectively displaying and broadcasting the natural disaster on the smart screen and the intelligent voice terminal specifically includes: The vibration change and tilt change of the elevator are respectively detected through the vibration sensor and the tilt sensor, and the meteorological data from the meteorological department is received through the meteorological data receiving device; Perform multi-source data fusion analysis on the vibration change, the tilt change, and the meteorological data to identify natural disasters that will occur or are occurring in the future; According to the type of the natural disaster, adjust the elevator operation mode according to a preset adjustment plan, and display and broadcast the natural disaster on the smart screen and the intelligent voice terminal respectively.

5. The multi-intelligent fusion analysis method based on ladder media according to claim 4, wherein, The smart screen is internally provided with a Bluetooth module, a Wi-Fi module, and a high-performance graphics processing chip; The AR cross-screen interaction with the user through the smart screen specifically includes: The smart screen receives the connection information sent by the mobile application through the Bluetooth beacon or Wi-Fi and sends it to the smart screen, and establishes a preliminary connection with the mobile application through the Bluetooth module or the Wi-Fi module of the smart screen. The mobile application is an interactive application program pre-installed by the user on the mobile phone, and the interactive application program supports Bluetooth, Wi-Fi connection, and AR functions. After the preliminary connection is established, receive the sensor data sent by the mobile application, and calculate the user's current viewing angle and position according to the sensor data. The sensor data is generated by the gyroscope and accelerometer of the mobile phone. Transmit the viewing angle and the position to the smart screen through an encrypted channel. The smart screen uses the high-performance graphics processing chip to render and present an AR interaction effect that matches the user's mobile phone perspective in real time according to the viewing angle, the position, and the advertisement materials stored locally.

6. The method for multi-intelligent fusion analysis based on ladder media according to claim 5, wherein The intelligent voice terminal is equipped with a microphone array, a high-definition camera, and a high-performance processor; The recognition and transmission of the user's voice through the intelligent voice terminal to complete the user's needs specifically includes: Collect the first voice signal emitted by the user through the microphone array, perform noise reduction and filtering processing on the first voice signal, and then input it into the high-performance processor for recognition and analysis to obtain a voice analysis result; Collect the user's facial image and body movements through the high-definition camera, input the facial image and the body movements into the high-performance processor for feature extraction and analysis to obtain an image analysis result; Fuse the voice analysis result and the image analysis result to obtain the user's target intention, and report the intention to the staff to help the user complete the target intention.

7. The method for multi-intelligent fusion analysis based on ladder media according to claim 6, characterized in that, The multi-source intelligent fusion analysis method based on in-elevator media further includes: When an abnormal situation occurs in the elevator, a natural disaster that will occur in the future is identified, or a natural disaster that is occurring is identified, the microphone array and the high-definition camera respectively continuously collect the second voice signal and the facial expression information of the passengers; Input the second voice signal into the high-performance processor to analyze the tone and speech rate of the passengers, and input the facial expression information into the high-performance processor to identify the facial expressions of the passengers; Perform comprehensive analysis on the tone, the speech rate, and the facial expression to obtain the emotional state of the passengers. If the emotional state is in a state of fear, play soothing words and soothing pictures through the intelligent voice terminal and the smart screen respectively.

8. A multi-intelligence fusion analysis system based on ladder media, characterized in that, The above-mentioned multi-intelligence fusion analysis system based on ladder media includes: A hardware environment deployment module, which is used to form a multi-intelligence interaction environment based on a variety of monitoring devices, intelligent screens, and intelligent voice terminals pre-deployed in the elevator; An abnormal protection analysis and processing module, which is used to automatically monitor the abnormal conditions and natural disaster conditions of the elevator based on the multi-intelligence interaction environment, and perform corresponding processing on the abnormal conditions and natural disaster conditions of the elevator; An interaction instruction acquisition module, which is used to acquire the interaction instructions issued by the user based on the multi-intelligence interaction environment, and the interaction instructions include: AR cross-screen interaction instructions and AI intelligent dialogue instructions; An intelligent dialogue interaction module, which is used to perform AR cross-screen interaction with the user through the intelligent screen if the interaction instruction is an AR cross-screen interaction instruction, and if the interaction instruction is an AI intelligent dialogue instruction, it will recognize and transmit the user's voice through the intelligent voice terminal to meet the user's needs.

9. A terminal, characterized in that, The terminal includes: a memory, a processor, and a multi-intelligence fusion analysis program based on ladder media stored on the memory and executable on the processor. When the multi-intelligence fusion analysis program based on ladder media is executed by the processor, it realizes the steps of the multi-intelligence fusion analysis method based on ladder media as described in any one of claims 1-7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a multi-intelligence fusion analysis program based on ladder media. When the multi-intelligence fusion analysis program based on ladder media is executed by the processor, it realizes the steps of the multi-intelligence fusion analysis method based on ladder media as described in any one of claims 1-7.

Images