Elevator monitoring image response method and system based on elevator operation status

By configuring the mapping relationship between elevator event identifiers and historical elevator monitoring images in the elevator monitoring system, the network congestion problem caused by multiple calls to cameras in the elevator monitoring system is solved, the response speed and accuracy are improved, and the real-time data transmission and processing enhances the relevance of the image.

CN118684095BActive Publication Date: 2024-11-01ZHEJIANG NEW ZAILING TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411187092.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-08-28
Publication Date
2024-11-01
Estimated Expiration
2044-08-28

AI Technical Summary

Technical Problem

When multiple algorithms call the photo function at the same time, the existing elevator monitoring system can easily cause network transmission congestion, affecting the real-time data transmission and processing, and reducing the system's response speed and accuracy.

Method used

By preconfiguring the mapping relationship between elevator event identification and historical elevator monitoring images, query and respond to the latest historical elevator monitoring images based on the elevator operation status, avoid multiple calls to the camera, optimize CPU resource usage, and ensure real-time data transmission and processing.

Benefits of technology

It improves the system's response speed and accuracy, reduces the need for real-time image processing, ensures real-time data transmission and processing, and image capture is closely related to elevator operation, and improves the relevance and practicality of images.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118684095B_ABST
    Figure CN118684095B_ABST
Patent Text Reader

Abstract

The present application discloses a method and system for responding to elevator monitoring images based on the elevator operation status, the method comprising: receiving one or more photo call requests sent by different channels at the same time, the photo call request carrying a target elevator event identifier for analyzing abnormal events in a target elevator; according to the target elevator event identifier, querying the corresponding historical elevator monitoring image closest to the current moment from a first mapping relationship between a pre-configured elevator event identifier and a historical elevator monitoring image; the historical elevator monitoring image in the first mapping relationship is obtained by capturing and pre-processing the elevator monitoring image in the target elevator based on the elevator operation status and the preset event triggering camera installed on the target elevator; responding the queried historical elevator monitoring image to the target service corresponding to the photo call request, so that the target service analyzes the abnormal events existing in the target elevator. Therefore, the use of the present application can improve the response speed and accuracy of the system.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to an elevator monitoring image response method and system based on the elevator operation status. Background Art

[0002] With the acceleration of urbanization and the increase in high-rise buildings, elevators, as the main means of vertical transportation, have a monitoring system that is directly related to public safety and operational efficiency. The internal environment of an elevator is complex and changeable, including but not limited to passenger behavior, elevator operating status, and possible emergencies, all of which need to be captured and analyzed in real time through high-quality image processing technology. Therefore, the development of efficient and reliable elevator monitoring image processing technology is of great significance to improving the effectiveness of the entire intelligent monitoring system.

[0003] In the prior art, elevator monitoring systems generally use real-time image capture technology, which enables real-time monitoring of elevator operation status and passenger behavior by installing monitoring cameras inside the elevator. These systems are usually equipped with advanced image processing algorithms that can analyze captured images to identify abnormal events. Due to the limited CPU resources of elevator cameras, when multiple algorithms call the photo function at the same time, it is easy to cause network transmission congestion, affecting the real-time transmission and processing of data, thereby reducing the response speed and accuracy of the system. Summary of the invention

[0004] The embodiments of the present application provide an elevator monitoring image response method and system based on the elevator operation status. In order to have a basic understanding of some aspects of the disclosed embodiments, a simple summary is given below. This summary is not a general review, nor is it intended to identify key / important components or describe the scope of protection of these embodiments. Its only purpose is to present some concepts in a simple form as a preface to the detailed description that follows.

[0005] In a first aspect, an embodiment of the present application provides an elevator monitoring image response method based on an elevator operation state, the method comprising:

[0006] Receiving one or more photo call requests sent by different channels at the same time, the photo call request carrying a target elevator event identifier for analyzing abnormal events in a target elevator;

[0007] According to the target elevator event identifier, query the corresponding historical elevator monitoring image closest to the current moment from the pre-configured first mapping relationship between the elevator event identifier and the historical elevator monitoring image; wherein the historical elevator monitoring image in the first mapping relationship is obtained by capturing and pre-processing the elevator monitoring image in the target elevator based on the elevator running state and the preset event triggering camera installed on the target elevator, and the elevator running state is determined based on sensor data fed back by the sensor pre-installed on the target elevator;

[0008] The queried historical elevator monitoring images are responded to the target service corresponding to the photo call request, so that the target service can analyze the abnormal events existing in the target elevator.

[0009] Optionally, the first mapping relationship is generated according to the following steps, including:

[0010] receiving sensor data fed back by a sensor pre-installed in a target elevator;

[0011] Determine the elevator operation state of the target elevator according to the sensor data; wherein the elevator operation state is determined based on a preset multi-dimensional analysis component, and the preset multi-dimensional analysis component is used to determine the elevator operation state of the target elevator;

[0012] In the pre-configured second mapping relationship between the elevator running state and the elevator event identifier, if there is an elevator event identifier corresponding to the elevator running state, a camera installed on the target elevator is triggered by a preset event corresponding to the elevator event identifier to capture and pre-process the elevator monitoring image in the target elevator as a historical elevator monitoring image;

[0013] A first mapping relationship between an elevator event identifier corresponding to an elevator running state and a historical elevator monitoring image is stored.

[0014] Optionally, the preset multi-dimensional analysis components include a data preprocessing layer, a vector information generation layer, a feature dimension reduction layer, a feature sequence input layer, and an elevator operation status output layer;

[0015] According to the sensor data, the elevator operation status of the target elevator is determined, including:

[0016] The data preprocessing layer preprocesses the sensor data to obtain the standardized parameters of each sensor;

[0017] The vector information generation layer generates target vector information corresponding to the standardized parameters of each sensor according to the standardized parameters of each sensor;

[0018] The feature dimension reduction layer performs feature dimension reduction and feature reduction processing on the target vector information of each sensor to generate a feature sequence;

[0019] The feature sequence input layer inputs the feature sequence into a pre-trained elevator operation state recognition model; the pre-trained elevator operation state recognition model is a mathematical model trained by machine learning for identifying the elevator operation state;

[0020] The elevator operation status output layer outputs the elevator operation status of the target elevator at the current moment. The elevator operation status includes any one of open door, closed door, stationary, upward, downward, maintenance status and emergency stop.

[0021] Optionally, preprocess the sensor data to obtain standardized parameters for each sensor, including:

[0022] Remove missing values ​​or outliers in sensor data; sensor data includes data from velocity sensors, acceleration sensors, position sensors, and load sensors;

[0023] The sensor data with missing or outliers removed is scaled to a uniform range to generate standardized parameters for each sensor;

[0024] Standardized parameters for each sensor The calculation formula is:

[0025] ;

[0026] Or for, ;in, and are the minimum and maximum values ​​in the sensor data after removing missing values ​​or outliers, To remove missing values ​​or outliers, is the standard deviation after removing missing values ​​or outliers.

[0027] Optionally, according to the standardized parameters of each sensor, target vector information corresponding to the standardized parameters of each sensor is generated, including:

[0028] Integrate the standardized parameters of each sensor to obtain a multidimensional data set for each sensor;

[0029] Based on the multidimensional data set of each sensor, a continuous feature vector capable of representing the elevator state is constructed;

[0030] The sliding time window method is used to extract the feature vectors of fixed time intervals from the continuous feature vectors to obtain the data in each time window;

[0031] The data in each time window is converted into a target feature vector, each of which contains the comprehensive features of all sensor data in the time window;

[0032] All target feature vectors are normalized to eliminate the dimensional effects between different features, and serve as the target vector information corresponding to the standardized parameters of each sensor.

[0033] Optionally, the conversion formula of the target feature vector is: ;

[0034] in, For each time window The target feature vector of each sensor is , is the total number of sensors, For the Sensors at time The derivative of It is Sensors at time The first derivative of It is Sensors at time The second-order derivative of is the size of the time window, [ ] for each time window.

[0035] Optionally, feature dimension reduction and feature reduction processing are performed on the target vector information of each sensor to generate a feature sequence, including:

[0036] According to the target vector information of each sensor, a balanced F score of each dimension in a preset plurality of dimensions is calculated;

[0037] The dimension corresponding to the maximum balanced F score is taken as the optimal dimension;

[0038] Dynamically reduce the dimension of the target vector information according to the optimal dimension to extract the part with the most vector information in the target vector information to obtain the vector information to be processed;

[0039] Perform feature compression on the vector information to be processed to generate a feature sequence.

[0040] Optionally, a pre-trained elevator operation status recognition model is generated according to the following steps, including:

[0041] Collect historical elevator sensor data and elevator operation logs;

[0042] Perform feature engineering on historical elevator sensor data and elevator operation logs to extract door switch frequency, operating speed, and acceleration changes that are useful for judging the elevator status and obtain sensor features;

[0043] Define the elevator's operating states of door opening, door closing, stationary, upward, downward, maintenance, and emergency stop;

[0044] The sensor features are annotated using the operating status to obtain model training data;

[0045] Divide the model training data into time series data and non-time series data;

[0046] Using time series data to train the hidden Markov model, obtaining the first model weight file;

[0047] Use non-time series data to train the random forest network and obtain the second model weight file;

[0048] A pre-trained elevator operation status recognition model is generated according to the first model weight file and the second model weight file.

[0049] Optionally, generating a pre-trained elevator operation state recognition model according to the first model weight file and the second model weight file includes:

[0050] Randomly obtain a test set from the model training data;

[0051] The test set is processed using the first model weight file to obtain a state sequence;

[0052] The test set is processed using the second model weight file to obtain the probability distribution of the classification results;

[0053] Input the probability distribution of state sequence and classification results into the meta-model, and train the meta-model with stacked generalization fusion technology. The meta-model is logistic regression or gradient boosting machine.

[0054] After the meta-model training is completed, the trained meta-model is used as a pre-trained elevator operation state recognition model.

[0055] In a second aspect, an embodiment of the present application provides an elevator monitoring image response system based on an elevator operation state, the system comprising:

[0056] A photo call request receiving module is used to receive one or more photo call requests sent by different channels at the same time, and the photo call request carries a target elevator event identifier for analyzing abnormal events in the target elevator;

[0057] The elevator monitoring image query module is used to query the corresponding historical elevator monitoring image closest to the current moment from the first mapping relationship between the pre-configured elevator event identifier and the historical elevator monitoring image according to the target elevator event identifier; wherein the historical elevator monitoring image in the first mapping relationship is obtained by capturing and pre-processing the elevator monitoring image in the target elevator based on the elevator running state and the preset event triggering camera installed on the target elevator, and the elevator running state is determined based on the sensor data fed back by the sensor pre-installed on the target elevator;

[0058] The elevator monitoring image response module is used to respond to the queried historical elevator monitoring images to the target service corresponding to the photo call request, so that the target service can analyze the abnormal events in the target elevator.

[0059] The technical solution provided by the embodiments of the present application may have the following beneficial effects:

[0060] In the embodiment of the present application, on the one hand, the present application pre-configures a first mapping relationship between an elevator event identifier and a historical elevator monitoring image, and the historical elevator monitoring image in the mapping relationship is obtained by capturing the elevator monitoring image in the target elevator based on the elevator running status and the preset event triggering the camera installed on the target elevator and pre-processing the elevator monitoring image, thereby ensuring that there is a latest elevator monitoring image for each elevator event that occurs. Therefore, after receiving photo call requests sent by multiple channels at the same time, multiple latest elevator monitoring images can be queried and obtained at the same time through the first mapping relationship, avoiding congestion caused by multiple photo call requests calling the camera installed on the target elevator, reducing real-time image processing requirements, optimizing CPU resource usage, and ensuring real-time transmission and processing of data, thereby improving the response speed and accuracy of the system; on the other hand, the historical elevator monitoring image is captured based on the elevator running status and preset event triggering, so that image capture is closely related to the actual operation of the elevator, improving the relevance and practicality of the image.

[0061] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0062] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0063] Figure 1 This is a schematic diagram of an operating environment corresponding to different languages ​​provided in an embodiment of the present application;

[0064] Figure 2 It is a schematic diagram of a data table between a target elevator event identifier and an abnormal event provided in an embodiment of the present application;

[0065] Figure 3 is a schematic diagram of a sensor and a data table of operating status provided by the present application;

[0066] Figure 4 It is a schematic diagram of a data structure in a first mapping relationship provided by the present application;

[0067] Figure 5It is a schematic diagram of the architecture of a preset multi-dimensional analysis component provided by this application;

[0068] Figure 6 It is a flow chart of a model training method of an elevator operation status recognition model provided by the present application;

[0069] Figure 7 It is a structural schematic diagram of an elevator monitoring image response system based on the elevator operation status provided by the present application;

[0070] Figure 8 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0071] The following description and the accompanying drawings sufficiently illustrate specific embodiments of the present application to enable those skilled in the art to practice them.

[0072] It should be clear that the described embodiments are only part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application.

[0073] When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Instead, they are only examples of systems and methods consistent with some aspects of the present application as detailed in the attached claims.

[0074] In the description of the present application, it should be understood that the terms "first", "second", etc. are used for descriptive purposes only and should not be understood as indicating or implying relative importance. For those of ordinary skill in the art, the specific meanings of the above terms in the present application can be understood according to the specific circumstances. In addition, in the description of the present application, unless otherwise specified, "multiple" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the objects associated before and after are in an "or" relationship.

[0075] At present, elevator monitoring systems generally use real-time image capture technology, which can monitor the elevator's operating status and passenger behavior in real time by installing surveillance cameras inside the elevator. These systems are usually equipped with advanced image processing algorithms that can analyze the captured images to identify abnormal events.

[0076] The inventors realized that the CPU resources of elevator cameras are limited. When multiple algorithms call the photo-taking function at the same time, it is easy to cause network transmission congestion, affecting the real-time transmission and processing of data, thereby reducing the response speed and accuracy of the system.

[0077] In order to solve the problem of low response speed and accuracy, the present application provides an elevator monitoring image response method and system based on the elevator running state to solve the problems existing in the above-mentioned related technical problems. In the embodiment of the present application, on the one hand, the present application pre-configures a first mapping relationship between an elevator event identifier and a historical elevator monitoring image, and the historical elevator monitoring image in the mapping relationship is obtained by capturing and preprocessing the elevator monitoring image in the target elevator based on the elevator running state and the preset event triggering the camera installed on the target elevator, thereby ensuring that there is a latest elevator monitoring image for each elevator event that occurs. Therefore, after receiving the photo call request sent by multiple channels at the same time, the first mapping relationship can be used to query and obtain multiple latest elevator monitoring images at the same time, avoiding the congestion caused by multiple photo call requests calling the camera installed on the target elevator, reducing the real-time image processing requirements, optimizing the use of CPU resources, and ensuring the real-time transmission and processing of data, thereby improving the response speed and accuracy of the system; on the other hand, the historical elevator monitoring image is captured based on the elevator running state and the preset event triggering, so that the image capture is closely related to the actual operation of the elevator, and the relevance and practicality of the image are improved. The following exemplary embodiments are used for detailed description.

[0078] The following will be combined with the attached Figure 1 -Attached Figure 6 , the elevator monitoring image response method based on the elevator running state provided by the embodiment of the present application is introduced in detail. The method can be implemented by relying on a computer program and can be run on an elevator monitoring image response system based on the elevator running state based on the von Neumann system. The computer program can be integrated into an application or run as an independent tool application.

[0079] See also Figure 1 , which is a flow chart of an elevator monitoring image response method based on the elevator running status provided in the embodiment of the present application. Figure 1 As shown, the method of the embodiment of the present application may include the following steps:

[0080] S101, receiving one or more photo call requests sent by different channels at the same time, where the photo call requests carry a target elevator event identifier for analyzing abnormal events in a target elevator;

[0081] Among them, the same moment refers to events or requests that occur almost simultaneously in the system. Different channels refer to the sources of sending the photo call request may be different, such as emergency buttons in the elevator, security monitoring centers, remote monitoring systems, etc. The photo call request is used to request the elevator system to capture images in the elevator to analyze or record the situation in the elevator. The target elevator refers to a specific elevator that needs to be monitored or has triggered a photo request. Abnormal events refer to abnormal situations that occur in the elevator, such as fighting, failures, or other behaviors or states that require attention. The target elevator event identifier is a label used to identify and classify specific events in the elevator.

[0082] In some embodiments, a high-definition camera is installed in the elevator to monitor the internal situation of the elevator in real time, and sensors such as door status sensors and speed sensors are configured to obtain the operating status of the elevator, and a series of target elevator event identifiers are defined, such as "door not closed for a long time", "abnormal motion detection", etc., to identify possible abnormal events. Then, when the elevator control center processing unit receives one or more photo call requests sent by different channels at the same time, it parses the target elevator event identifier carried in the request, and obtains the target elevator event identifier carried by the photo call request for analyzing abnormal events in the target elevator.

[0083] Among them, the data table between the target elevator event identifier and the abnormal event is as follows: Figure 2 As shown in the figure, event ID is a number used to uniquely identify each event. Event ID is a unique identifier or code used to identify and process events within the system. Event description is a brief description of the abnormal event. Trigger condition defines the specific sensor reading or system status that triggers the event. Event type is classified into warning, emergency, notification, etc. according to the urgency and processing priority of the event.

[0084] S102, according to the target elevator event identifier, query the corresponding historical elevator monitoring image closest to the current moment from a first mapping relationship between the pre-configured elevator event identifier and the historical elevator monitoring image; wherein the historical elevator monitoring image in the first mapping relationship is obtained by capturing and pre-processing the elevator monitoring image in the target elevator based on the elevator running state and the preset event triggering camera installed on the target elevator, and the elevator running state is determined based on sensor data fed back by a sensor pre-installed on the target elevator;

[0085] Among them, the first mapping relationship is a pre-configured data structure used to associate elevator event identifiers with historical elevator monitoring images. Historical elevator monitoring images are images captured and pre-processed by the camera in the elevator, recording the internal conditions of the elevator at different time points. The current moment refers to the time point when the query operation occurs. The elevator operating status is the working status of the elevator at a specific time point, such as stationary, up, down, open door, closed door, etc. The preset event is a specific situation or condition pre-defined by the system. When these conditions are met, the camera will be triggered to capture the image. The sensor is a device installed on the elevator for monitoring and feedback of the elevator's operating status, such as speed, acceleration, door status, etc. The camera is a device installed in the elevator for real-time monitoring, which can capture video images inside the elevator.

[0086] In some embodiments, when the system receives a query request, it searches the first mapping relationship for the associated image closest to the current moment according to one or more target elevator event identifiers.

[0087] In an embodiment of the present application, the specific steps of generating a first mapping relationship include: receiving sensor data fed back by a sensor pre-installed on a target elevator; determining the elevator operating state of the target elevator based on the sensor data; wherein the elevator operating state is determined based on a preset multi-dimensional analysis component, and the preset multi-dimensional analysis component is used to determine the elevator operating state of the target elevator; in a second mapping relationship between a pre-configured elevator operating state and an elevator event identifier, if there is an elevator event identifier corresponding to the elevator operating state, the preset event corresponding to the elevator event identifier triggers the camera installed on the target elevator to capture and pre-process the elevator monitoring image in the target elevator as a historical elevator monitoring image; and the first mapping relationship between the elevator event identifier corresponding to the elevator operating state and the historical elevator monitoring image is stored.

[0088] Among them, the data tables of sensors and operating status are as follows Figure 3 As shown in the figure, the serial number is the unique identifier of the data record. The timestamp is used to record the specific time point of the data. The door status sensor indicates whether the elevator door is open or closed. The speed sensor is used to record the real-time running speed of the elevator. The acceleration sensor is used to record the real-time acceleration of the elevator. A positive value may indicate acceleration, and a negative value indicates deceleration. The load sensor is used to record the load weight in the elevator. The position sensor is used to record the current floor position of the elevator. The running state is the elevator state obtained based on the comprehensive analysis of the sensor data, which may include stationary, waiting to start, up, down, stopped, open door, closed door, etc.

[0089] The multi-dimensional analysis component is a preset analysis tool or algorithm for comprehensively considering multiple sensor data dimensions to accurately determine the operating status of the elevator. The second mapping relationship is a pre-configured mapping table that associates the elevator operating status with the elevator event identifier. Preprocessing is the preliminary processing of the captured image, which may include format conversion, compression, adjustment of brightness and contrast, etc.

[0090] In some embodiments, first, real-time data feedback from sensors in the elevator is received. Using a preset multi-dimensional analysis component, the current operating state of the elevator is determined based on a comprehensive analysis of the sensor data. The elevator event identifier corresponding to the current elevator operating state is searched in the second mapping relationship. If a corresponding event identifier exists, the system will trigger the camera in the elevator to capture and pre-process images inside the elevator. These images are saved as historical elevator monitoring images, associated with corresponding elevator event identifiers, and stored in the first mapping relationship for future query and analysis.

[0091] Among them, the first mapping relationship is, for example, Figure 4 As shown in the figure, event ID is used to uniquely identify the number of each event record. Elevator event identification is an identifier or code used to identify events within the system. Operation status description is used to describe the operation status of the elevator or the event that occurred when the image was captured. Image storage path is used to store the file system path or database reference of the captured image. Image timestamp identifies the specific time point of image capture. Remarks represent additional descriptions or important information about events or images.

[0092] Among them, for example Figure 5 As shown, the preset multi-dimensional analysis component includes a data preprocessing layer, a vector information generation layer, a feature dimensionality reduction layer, a feature sequence input layer and an elevator operation status output layer. After the sensor data is input into each layer in turn, the elevator operation status of the target elevator at the current moment is output.

[0093] In an embodiment of the present application, the specific process of determining the elevator operating status of the target elevator based on the sensor data includes: the data preprocessing layer preprocesses the sensor data to obtain the standardized parameters of each sensor; the vector information generation layer generates the target vector information corresponding to the standardized parameters of each sensor according to the standardized parameters of each sensor; the feature dimension reduction layer performs feature dimension reduction and feature reduction processing on the target vector information of each sensor to generate a feature sequence; the feature sequence input layer inputs the feature sequence into a pre-trained elevator operating status recognition model; the pre-trained elevator operating status recognition model is a mathematical model trained by machine learning for identifying the elevator operating status; the elevator operating status output layer outputs the elevator operating status of the target elevator at the current moment, and the elevator operating status includes any one of open door, closed door, stationary, up, down, maintenance status and emergency stop.

[0094] Specifically, the specific process of preprocessing the sensor data to obtain the standardized parameters of each sensor includes: removing missing values ​​or abnormal values ​​in the sensor data; the sensor data includes data of the velocity sensor, acceleration sensor, position sensor and load sensor; scaling the sensor data with missing values ​​or abnormal values ​​removed to a uniform range to generate the standardized parameters of each sensor; wherein the standardized parameters of each sensor The calculation formula is:

[0095] ;

[0096] Or for, ;in, and are the minimum and maximum values ​​in the sensor data after removing missing values ​​or outliers, To remove missing values ​​or outliers, is the standard deviation after removing missing values ​​or outliers.

[0097] Specifically, the specific process of generating target vector information corresponding to the standardized parameters of each sensor according to the standardized parameters of each sensor includes: integrating the standardized parameters of each sensor to obtain a multidimensional data set of each sensor; constructing a continuous feature vector capable of characterizing the state of the elevator based on the multidimensional data set of each sensor; using a sliding time window method to extract feature vectors with fixed time intervals from the continuous feature vector to obtain data within each time window; converting the data within each time window into a target feature vector, each target feature vector containing the comprehensive features of all sensor data within the time window; and normalizing all target feature vectors to eliminate the dimensional influence between different features, as the target vector information corresponding to the standardized parameters of each sensor.

[0098] Among them, the conversion formula of the target feature vector is: ;

[0099] in, For each time window The target feature vector of each sensor is , is the total number of sensors, For the Sensors at time The derivative of It is Sensors at time The first derivative of It is Sensors at time The second-order derivative of is the size of the time window, [ ] for each time window.

[0100] Specifically, when performing feature dimensionality reduction and feature reduction processing on the target vector information of each sensor, the specific process of generating a feature sequence includes: calculating the balanced F-score of each dimension in a preset plurality of dimensions according to the target vector information of each sensor; taking the dimension corresponding to the maximum balanced F-score as the optimal dimension; dynamically reducing the dimension of the target vector information according to the optimal dimension to extract the part with the largest amount of vector information in the target vector information to obtain the vector information to be processed; and performing feature compression on the vector information to be processed to generate a feature sequence.

[0101] In an embodiment of the present application, a pre-trained elevator operation status recognition model can be generated according to the following steps: historical elevator sensor data and elevator operation logs are collected; feature engineering is performed on the historical elevator sensor data and elevator operation logs to extract door switch frequency, operating speed, and acceleration changes that are useful for elevator status judgment to obtain sensor features; the elevator operation states of open door, closed door, stationary, up, down, maintenance status, and emergency stop are defined; the sensor features are labeled with the operation status to obtain model training data; the model training data is divided into time series data and non-time series data; the hidden Markov model is trained with time series data to obtain a first model weight file; the random forest network is trained with non-time series data to obtain a second model weight file; a pre-trained elevator operation status recognition model is generated based on the first model weight file and the second model weight file.

[0102] Specifically, the specific process of generating a pre-trained elevator operation status recognition model according to the first model weight file and the second model weight file includes: randomly obtaining a test set from the model training data; using the first model weight file to process the test set to obtain a state sequence; using the second model weight file to process the test set to obtain a probability distribution of the classification result; inputting the state sequence and the probability distribution of the classification result into a meta-model, and training the meta-model in combination with the stacked generalization fusion technology, the meta-model being a logistic regression or a gradient boosting machine; after the meta-model training is completed, the trained meta-model is used as the pre-trained elevator operation status recognition model.

[0103] S103, responding the queried historical elevator monitoring image to the target service corresponding to the photo call request, so that the target service analyzes abnormal events existing in the target elevator.

[0104] In some embodiments, after querying the historical elevator monitoring image corresponding to each photo call request, the historical elevator monitoring image can be responded to the target service corresponding to the photo call request, so that the target service analyzes abnormal events in the target elevator.

[0105] In the embodiment of the present application, on the one hand, the present application pre-configures a first mapping relationship between an elevator event identifier and a historical elevator monitoring image, and the historical elevator monitoring image in the mapping relationship is obtained by capturing the elevator monitoring image in the target elevator based on the elevator running status and the preset event triggering the camera installed on the target elevator and pre-processing the elevator monitoring image, thereby ensuring that there is a latest elevator monitoring image for each elevator event that occurs. Therefore, after receiving photo call requests sent by multiple channels at the same time, multiple latest elevator monitoring images can be queried and obtained at the same time through the first mapping relationship, avoiding congestion caused by multiple photo call requests calling the camera installed on the target elevator, reducing real-time image processing requirements, optimizing CPU resource usage, and ensuring real-time transmission and processing of data, thereby improving the response speed and accuracy of the system; on the other hand, the historical elevator monitoring image is captured based on the elevator running status and preset event triggering, so that image capture is closely related to the actual operation of the elevator, improving the relevance and practicality of the image.

[0106] See also Figure 6 , is a flow chart of a model training method for an elevator operation status recognition model provided in an embodiment of the present application. Figure 6 As shown, the method of the embodiment of the present application may include the following steps:

[0107] S201, collecting historical elevator sensor data and elevator operation logs;

[0108] S202, performing feature engineering processing on historical elevator sensor data and elevator operation logs to extract door switch frequency, operating speed, and acceleration changes that are useful for elevator status judgment to obtain sensor features;

[0109] S203, define the elevator operation states of door opening, door closing, stationary, upward, downward, maintenance state and emergency stop;

[0110] S204, labeling sensor features using the operating status to obtain model training data;

[0111] S205, dividing the model training data into time series data and non-time series data;

[0112] S206, using the time series data to train the hidden Markov model to obtain a first model weight file;

[0113] S207, using non-time series data to train a random forest network to obtain a second model weight file;

[0114] S208: Generate a pre-trained elevator operation status recognition model according to the first model weight file and the second model weight file.

[0115] In the embodiment of the present application, on the one hand, the present application pre-configures a first mapping relationship between an elevator event identifier and a historical elevator monitoring image, and the historical elevator monitoring image in the mapping relationship is obtained by capturing the elevator monitoring image in the target elevator based on the elevator running status and the preset event triggering the camera installed on the target elevator and pre-processing the elevator monitoring image, thereby ensuring that there is a latest elevator monitoring image for each elevator event that occurs. Therefore, after receiving photo call requests sent by multiple channels at the same time, multiple latest elevator monitoring images can be queried and obtained at the same time through the first mapping relationship, avoiding congestion caused by multiple photo call requests calling the camera installed on the target elevator, reducing real-time image processing requirements, optimizing CPU resource usage, and ensuring real-time transmission and processing of data, thereby improving the response speed and accuracy of the system; on the other hand, the historical elevator monitoring image is captured based on the elevator running status and preset event triggering, so that image capture is closely related to the actual operation of the elevator, improving the relevance and practicality of the image.

[0116] The following is a system embodiment of the present application, which can be used to execute the method embodiment of the present application. For details not disclosed in the system embodiment of the present application, please refer to the method embodiment of the present application.

[0117] See also Figure 7 , which shows a schematic diagram of the structure of an elevator monitoring image response system based on the elevator running state provided by an exemplary embodiment of the present application. The elevator monitoring image response system based on the elevator running state can be implemented as all or part of an electronic device through software, hardware or a combination of both. The system 1 includes a photo call request receiving module 10, an elevator monitoring image query module 20, and an elevator monitoring image response module 30.

[0118] The photo call request receiving module 10 is used to receive one or more photo call requests sent by different channels at the same time, and the photo call request carries a target elevator event identifier for analyzing abnormal events in the target elevator;

[0119] The elevator monitoring image query module 20 is used to query the corresponding historical elevator monitoring image closest to the current moment from the first mapping relationship between the pre-configured elevator event identifier and the historical elevator monitoring image according to the target elevator event identifier; wherein the historical elevator monitoring image in the first mapping relationship is obtained by capturing and pre-processing the elevator monitoring image in the target elevator based on the elevator running state and the preset event triggering camera installed on the target elevator, and the elevator running state is determined based on the sensor data fed back by the sensor pre-installed on the target elevator;

[0120] The elevator monitoring image response module 30 is used to respond the queried historical elevator monitoring image to the target service corresponding to the photo call request, so that the target service can analyze the abnormal events existing in the target elevator.

[0121] It should be noted that the elevator monitoring image response system based on the elevator running state provided in the above embodiment only uses the division of the above functional modules as an example when executing the elevator monitoring image response method based on the elevator running state. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the elevator monitoring image response system based on the elevator running state provided in the above embodiment and the elevator monitoring image response method based on the elevator running state belong to the same concept, and the embodiment and implementation process thereof are detailed in the method embodiment, which will not be repeated here.

[0122] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0123] In the embodiment of the present application, on the one hand, the present application pre-configures a first mapping relationship between an elevator event identifier and a historical elevator monitoring image, and the historical elevator monitoring image in the mapping relationship is obtained by capturing the elevator monitoring image in the target elevator based on the elevator running status and the preset event triggering the camera installed on the target elevator and pre-processing the elevator monitoring image, thereby ensuring that there is a latest elevator monitoring image for each elevator event that occurs. Therefore, after receiving photo call requests sent by multiple channels at the same time, multiple latest elevator monitoring images can be queried and obtained at the same time through the first mapping relationship, avoiding congestion caused by multiple photo call requests calling the camera installed on the target elevator, reducing real-time image processing requirements, optimizing CPU resource usage, and ensuring real-time transmission and processing of data, thereby improving the response speed and accuracy of the system; on the other hand, the historical elevator monitoring image is captured based on the elevator running status and preset event triggering, so that image capture is closely related to the actual operation of the elevator, improving the relevance and practicality of the image.

[0124] The present application also provides a computer-readable medium having program instructions stored thereon, and when the program instructions are executed by a processor, the elevator monitoring image response method based on the elevator operating status provided by the above-mentioned various method embodiments is implemented.

[0125] The present application also provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute the elevator monitoring image response method based on the elevator operating status of each of the above method embodiments.

[0126] See also Figure 8 , is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Figure 8 As shown, the electronic device 1000 may include: at least one processor 1001 , at least one network interface 1004 , a user interface 1003 , a memory 1005 , and at least one communication bus 1002 .

[0127] The communication bus 1002 is used to realize the connection and communication between these components.

[0128] The user interface 1003 may include a display screen (Display) and a camera (Camera). Optionally, the user interface 1003 may also include a standard wired interface and a wireless interface.

[0129] The network interface 1004 may optionally include a standard wired interface or a wireless interface (such as a WI-FI interface).

[0130] Among them, the processor 1001 may include one or more processing cores. The processor 1001 uses various interfaces and lines to connect various parts of the entire electronic device 1000, and executes various functions and processes data of the electronic device 1000 by running or executing instructions, programs, code sets or instruction sets stored in the memory 1005, and calling data stored in the memory 1005. Optionally, the processor 1001 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). The processor 1001 can integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU) and a modem. Among them, the CPU mainly processes the operating system, user interface and application programs; the GPU is responsible for rendering and drawing the content to be displayed on the display screen; the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 1001, and it can be implemented separately through a chip.

[0131] Among them, the memory 1005 may include a random access memory (Random Access Memory, RAM) and may also include a read-only memory (Read-Only Memory). Optionally, the memory 1005 includes a non-transitory computer-readable storage medium. The memory 1005 can be used to store instructions, programs, codes, code sets or instruction sets. The memory 1005 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc.; the data storage area may store data involved in the above-mentioned various method embodiments, etc. The memory 1005 may also be optionally at least one storage system located away from the aforementioned processor 1001. As Figure 8 As shown, the memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and an elevator monitoring image response application based on the elevator running status.

[0132] exist Figure 8In the electronic device 1000 shown, the user interface 1003 is mainly used to provide an input interface for the user and obtain the data input by the user; and the processor 1001 can be used to call the elevator monitoring image response application based on the elevator operation status stored in the memory 1005, and specifically perform the following operations:

[0133] Receiving one or more photo call requests sent by different channels at the same time, the photo call request carrying a target elevator event identifier for analyzing abnormal events in a target elevator;

[0134] According to the target elevator event identifier, query the corresponding historical elevator monitoring image closest to the current moment from the pre-configured first mapping relationship between the elevator event identifier and the historical elevator monitoring image; wherein the historical elevator monitoring image in the first mapping relationship is obtained by capturing and pre-processing the elevator monitoring image in the target elevator based on the elevator running state and the preset event triggering camera installed on the target elevator, and the elevator running state is determined based on sensor data fed back by the sensor pre-installed on the target elevator;

[0135] The queried historical elevator monitoring images are responded to the target service corresponding to the photo call request, so that the target service can analyze the abnormal events existing in the target elevator.

[0136] In one embodiment, when generating the first mapping relationship, the processor 1001 specifically performs the following operations:

[0137] receiving sensor data fed back by a sensor pre-installed in a target elevator;

[0138] Determine the elevator operation state of the target elevator according to the sensor data; wherein the elevator operation state is determined based on a preset multi-dimensional analysis component, and the preset multi-dimensional analysis component is used to determine the elevator operation state of the target elevator;

[0139] In the pre-configured second mapping relationship between the elevator running state and the elevator event identifier, if there is an elevator event identifier corresponding to the elevator running state, a camera installed on the target elevator is triggered by a preset event corresponding to the elevator event identifier to capture and pre-process the elevator monitoring image in the target elevator as a historical elevator monitoring image;

[0140] A first mapping relationship between an elevator event identifier corresponding to an elevator running state and a historical elevator monitoring image is stored.

[0141] In one embodiment, when the processor 1001 determines the elevator operation state of the target elevator according to the sensor data, the processor 1001 specifically performs the following operations:

[0142] The data preprocessing layer preprocesses the sensor data to obtain the standardized parameters of each sensor;

[0143] The vector information generation layer generates target vector information corresponding to the standardized parameters of each sensor according to the standardized parameters of each sensor;

[0144] The feature dimension reduction layer performs feature dimension reduction and feature reduction processing on the target vector information of each sensor to generate a feature sequence;

[0145] The feature sequence input layer inputs the feature sequence into a pre-trained elevator operation state recognition model; the pre-trained elevator operation state recognition model is a mathematical model trained by machine learning for identifying the elevator operation state;

[0146] The elevator operation status output layer outputs the elevator operation status of the target elevator at the current moment. The elevator operation status includes any one of open door, closed door, stationary, upward, downward, maintenance status and emergency stop.

[0147] In one embodiment, when the processor 1001 performs preprocessing on the sensor data to obtain the standardized parameters of each sensor, the processor 1001 specifically performs the following operations:

[0148] Remove missing values ​​or outliers in sensor data; sensor data includes data from velocity sensors, acceleration sensors, position sensors, and load sensors;

[0149] The sensor data with missing or outliers removed is scaled to a uniform range to generate standardized parameters for each sensor;

[0150] Standardized parameters for each sensor The calculation formula is:

[0151] ;

[0152] Or for, ;in, and are the minimum and maximum values ​​in the sensor data after removing missing values ​​or outliers, To remove missing values ​​or outliers, is the standard deviation after removing missing values ​​or outliers.

[0153] In one embodiment, when the processor 1001 generates target vector information corresponding to the standardized parameters of each sensor according to the standardized parameters of each sensor, the processor 1001 specifically performs the following operations:

[0154] Integrate the standardized parameters of each sensor to obtain a multidimensional data set for each sensor;

[0155] Based on the multidimensional data set of each sensor, a continuous feature vector capable of representing the elevator state is constructed;

[0156] The sliding time window method is used to extract the feature vectors of fixed time intervals from the continuous feature vectors to obtain the data in each time window;

[0157] The data in each time window is converted into a target feature vector, each of which contains the comprehensive features of all sensor data in the time window;

[0158] All target feature vectors are normalized to eliminate the dimensional effects between different features, and serve as the target vector information corresponding to the standardized parameters of each sensor.

[0159] In one embodiment, when the processor 1001 performs feature dimension reduction and feature reduction processing on the target vector information of each sensor to generate a feature sequence, the processor 1001 specifically performs the following operations:

[0160] According to the target vector information of each sensor, a balanced F score of each dimension in a preset plurality of dimensions is calculated;

[0161] The dimension corresponding to the maximum balanced F score is taken as the optimal dimension;

[0162] Dynamically reduce the dimension of the target vector information according to the optimal dimension to extract the part with the most vector information in the target vector information to obtain the vector information to be processed;

[0163] Perform feature compression on the vector information to be processed to generate a feature sequence.

[0164] In one embodiment, when the processor 1001 generates a pre-trained elevator operation status recognition model, the processor 1001 specifically performs the following operations:

[0165] Collect historical elevator sensor data and elevator operation logs;

[0166] Perform feature engineering on historical elevator sensor data and elevator operation logs to extract door switch frequency, operating speed, and acceleration changes that are useful for judging the elevator status and obtain sensor features;

[0167] Define the elevator's operating states of door opening, door closing, stationary, upward, downward, maintenance, and emergency stop;

[0168] The sensor features are annotated using the operating status to obtain model training data;

[0169] Divide the model training data into time series data and non-time series data;

[0170] Using time series data to train the hidden Markov model, obtaining the first model weight file;

[0171] The random forest network is trained using non-time series data to obtain the second model weight file;

[0172] A pre-trained elevator operation status recognition model is generated according to the first model weight file and the second model weight file.

[0173] In one embodiment, when the processor 1001 generates a pre-trained elevator operation state recognition model according to the first model weight file and the second model weight file, the processor 1001 specifically performs the following operations:

[0174] Randomly obtain a test set from the model training data;

[0175] The test set is processed using the first model weight file to obtain a state sequence;

[0176] The test set is processed using the second model weight file to obtain the probability distribution of the classification results;

[0177] Input the probability distribution of state sequence and classification results into the meta-model, and train the meta-model with stacked generalization fusion technology. The meta-model is logistic regression or gradient boosting machine.

[0178] After the meta-model training is completed, the trained meta-model is used as a pre-trained elevator operation state recognition model.

[0179] In the embodiment of the present application, on the one hand, the present application pre-configures a first mapping relationship between an elevator event identifier and a historical elevator monitoring image, and the historical elevator monitoring image in the mapping relationship is obtained by capturing the elevator monitoring image in the target elevator based on the elevator running status and the preset event triggering the camera installed on the target elevator and pre-processing the elevator monitoring image, thereby ensuring that there is a latest elevator monitoring image for each elevator event that occurs. Therefore, after receiving photo call requests sent by multiple channels at the same time, multiple latest elevator monitoring images can be queried and obtained at the same time through the first mapping relationship, avoiding congestion caused by multiple photo call requests calling the camera installed on the target elevator, reducing real-time image processing requirements, optimizing CPU resource usage, and ensuring real-time transmission and processing of data, thereby improving the response speed and accuracy of the system; on the other hand, the historical elevator monitoring image is captured based on the elevator running status and preset event triggering, so that image capture is closely related to the actual operation of the elevator, improving the relevance and practicality of the image.

[0180] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing related hardware through a computer program, and the program for responding to elevator monitoring images based on the elevator running state can be stored in a computer-readable storage medium, and when the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, the storage medium of the program for responding to elevator monitoring images based on the elevator running state can be a disk, an optical disk, a read-only storage memory, or a random access memory, etc.

[0181] The above disclosure is only the preferred embodiment of the present application, which certainly cannot be used to limit the scope of rights of the present application. Therefore, equivalent changes made according to the claims of the present application are still within the scope covered by the present application.

Claims

1. An elevator monitoring image response method based on elevator operation status, characterized in that: The method comprises: Receiving one or more photo calling requests sent by different channels at the same time, wherein the photo calling requests carry a target elevator event identifier for analyzing abnormal events in a target elevator; According to the target elevator event identifier, query the corresponding historical elevator monitoring image closest to the current moment from a first mapping relationship between the pre-configured elevator event identifier and the historical elevator monitoring image; wherein the historical elevator monitoring image in the first mapping relationship is obtained by capturing and pre-processing the elevator monitoring image in the target elevator based on the elevator running state and the preset event triggering the camera installed on the target elevator, and the elevator running state is determined based on the sensor data fed back by the sensor pre-installed on the target elevator; The queried historical elevator monitoring image is responded to the target service corresponding to the photo call request, so that the target service analyzes abnormal events existing in the target elevator.

2. The method according to claim 1, characterized in that The first mapping relationship is generated according to the following steps, including: Receiving sensor data fed back by a sensor pre-installed in the target elevator; Determine the elevator operation state of the target elevator according to the sensor data; wherein the elevator operation state is determined based on a preset multi-dimensional analysis component, and the preset multi-dimensional analysis component is used to determine the elevator operation state of the target elevator; In the pre-configured second mapping relationship between the elevator running state and the elevator event identifier, if there is an elevator event identifier corresponding to the elevator running state, a camera installed on the target elevator is triggered by a preset event corresponding to the elevator event identifier to capture and pre-process the elevator monitoring image in the target elevator as a historical elevator monitoring image; A first mapping relationship between the elevator event identifier corresponding to the elevator running state and the historical elevator monitoring image is stored.

3. The method according to claim 2, characterized in that The preset multi-dimensional analysis component includes a data preprocessing layer, a vector information generation layer, a feature dimension reduction layer, a feature sequence input layer and an elevator operation status output layer; Determining the elevator operation state of the target elevator according to the sensor data includes: The data preprocessing layer preprocesses the sensor data to obtain standardized parameters of each sensor; The vector information generation layer generates target vector information corresponding to the standardized parameters of each sensor according to the standardized parameters of each sensor; The feature dimension reduction layer performs feature dimension reduction and feature reduction processing on the target vector information of each sensor to generate a feature sequence; The feature sequence input layer inputs the feature sequence into a pre-trained elevator operation state recognition model; the pre-trained elevator operation state recognition model is a mathematical model trained by machine learning for identifying the elevator operation state; The elevator operation status output layer outputs the elevator operation status of the target elevator at the current moment, and the elevator operation status includes any one of open door, closed door, stationary, upward, downward, maintenance status and emergency stop.

4. The method according to claim 3, characterized in that The preprocessing of the sensor data to obtain standardized parameters of each sensor includes: removing missing values ​​or abnormal values ​​in the sensor data; the sensor data includes data of a velocity sensor, an acceleration sensor, a position sensor, and a load sensor; The sensor data with missing or outliers removed is scaled to a uniform range to generate standardized parameters for each sensor; The standardized parameters of each sensor are The calculation formula is: ; Or for, ;in, and are the minimum and maximum values ​​in the sensor data after removing missing values ​​or outliers, To remove missing values ​​or outliers, is the standard deviation after removing missing values ​​or outliers.

5. The method according to claim 3, characterized in that: The step of generating target vector information corresponding to the standardized parameters of each sensor according to the standardized parameters of each sensor includes: Integrate the standardized parameters of each sensor to obtain a multi-dimensional data set of each sensor; Based on the multidimensional data set of each sensor, a continuous feature vector capable of representing the state of the elevator is constructed; Using a sliding time window method, extracting feature vectors of fixed time intervals from the continuous feature vectors to obtain data within each time window; Converting the data in each time window into a target feature vector, each target feature vector includes comprehensive features of all sensor data in the time window; All target feature vectors are normalized to eliminate the dimensional effects between different features, and serve as the target vector information corresponding to the standardized parameters of each sensor.

6. The method according to claim 5, characterized in that The conversion formula of the target feature vector is: ; in, For each time window The target feature vector of each sensor is , is the total number of sensors, For the Sensors at time The derivative of It is Sensors at time The first derivative of It is Sensors at time The second-order derivative of is the size of the time window, [ ] for each time window.

7. The method according to claim 3, characterized in that The step of performing feature dimension reduction and feature reduction processing on the target vector information of each sensor to generate a feature sequence includes: Calculating a balanced F score for each of the preset multiple dimensions according to the target vector information of each sensor; The dimension corresponding to the maximum balanced F score is taken as the optimal dimension; Dynamically reducing the dimension of the target vector information according to the optimal dimension to extract the part with the largest amount of vector information in the target vector information to obtain the vector information to be processed; Feature compression is performed on the vector information to be processed to generate a feature sequence.

8. The method according to claim 3, characterized in that Follow these steps to generate a pre-trained elevator operation status recognition model, including: Collect historical elevator sensor data and elevator operation logs; Performing feature engineering processing on the historical elevator sensor data and the elevator operation log to extract door switch frequency, operating speed, and acceleration changes that are useful for judging the elevator status, and obtaining sensor features; Define the elevator's operating states of door opening, door closing, stationary, upward, downward, maintenance, and emergency stop; Using the operating state to label the sensor features to obtain model training data; Dividing the model training data into time series data and non-time series data; Using the time series data to train a hidden Markov model to obtain a first model weight file; Using the non-time series data to train a random forest network to obtain a second model weight file; A pre-trained elevator operation status recognition model is generated according to the first model weight file and the second model weight file.

9. The method according to claim 8, characterized in that The step of generating a pre-trained elevator operation state recognition model according to the first model weight file and the second model weight file comprises: Randomly obtain a test set from the model training data; Processing the test set using the first model weight file to obtain a state sequence; Processing the test set using the second model weight file to obtain a probability distribution of classification results; Inputting the state sequence and the probability distribution of the classification result into a meta-model, and training the meta-model in combination with the stacked generalization fusion technique, wherein the meta-model is a logistic regression or a gradient boosting machine; After the meta-model training is completed, the trained meta-model is used as a pre-trained elevator operation state recognition model.

10. An elevator monitoring image response system based on elevator operation status, characterized in that: The system comprises: A photo call request receiving module, used to receive one or more photo call requests sent by different channels at the same time, wherein the photo call request carries a target elevator event identifier for analyzing abnormal events in a target elevator; an elevator monitoring image query module, for querying the corresponding historical elevator monitoring image closest to the current moment from a first mapping relationship between a pre-configured elevator event identifier and a historical elevator monitoring image according to the target elevator event identifier; wherein the historical elevator monitoring image in the first mapping relationship is obtained by capturing and pre-processing the elevator monitoring image in the target elevator based on the elevator running state and the preset event triggering the camera installed on the target elevator, and the elevator running state is determined based on sensor data fed back by a sensor pre-installed on the target elevator; The elevator monitoring image response module is used to respond the queried historical elevator monitoring image to the target service corresponding to the photo call request, so that the target service analyzes abnormal events existing in the target elevator.