Elevator digital twin modeling method

Abstract

The invention discloses an elevator digital twin modeling method, and relates to the technical field of elevator emergency disposal, the method comprises the following steps: obtaining multi-dimensional monitoring data of a target elevator; building an elevator multi-dimensional digital dynamic simulation model according to the elevator basic parameters and the physical model parameters; based on the character / voice / video / model multi-dimensional display technology of mixed reality, an elevator running state 3D holographic display model is established, the elevator running state, the position of trapped people and alarm information are visually displayed, and rescue aid decision making and visual guidance are provided. And rescue aid decision making and visual guidance are provided.

Description

Technical Field

[0001] This application relates to the technical field of elevator emergency disposal, and particularly to an elevator digital twin modeling method. Background Art

[0002] With the rapid development of urbanization, elevators have been closely connected with the lives of the people. However, elevator failures are inevitable during use. Therefore, it is quite necessary to perform digital twin modeling on elevators to facilitate timely and effective emergency rescue after elevator failures occur.

[0003] Digital twin modeling is an integrated technology based on physical models, sensor updates, historical and real-time data, aiming to closely connect the physical world with the virtual world, construct a virtual model corresponding to the real world, and simulate the state, behavior, and performance changes of entities. Currently, in the prior art, it is impossible to accurately and efficiently construct an elevator digital twin simulation model, and thus it is impossible to provide rescue auxiliary decision-making and visual guidance, which is not conducive to elevator emergency rescue. Summary of the Invention

[0004] The purpose of this application is to provide an elevator digital twin modeling method, which can accurately and efficiently construct an elevator digital twin simulation model, intuitively display the elevator operation status, trapped person location, and alarm information, and provide rescue auxiliary decision-making and visual guidance.

[0005] To achieve the above purpose, this application provides an elevator digital twin modeling method, which includes:

[0006] Obtain multi-dimensional monitoring data of the target elevator; the multi-dimensional monitoring data includes the basic elevator parameters and physical model parameters of the target elevator;

[0007] Construct a multi-dimensional digital dynamic simulation model of the elevator according to the basic elevator parameters and the physical model parameters;

[0008] Based on the multi-dimensional display technology of text / speech / video / model based on mixed reality, establish a 3D holographic display model of the elevator operation status, and intuitively display the elevator operation status, trapped person location, and alarm information according to the multi-dimensional digital dynamic simulation model of the elevator and the 3D holographic display model of the elevator operation status, and provide rescue auxiliary decision-making and visual guidance.

[0009] According to the specific embodiments provided by this application, this application has the following technical effects:

[0010] The present application provides an elevator digital twin modeling method. First, an elevator multi-dimensional digital dynamic simulation model is constructed based on elevator basic parameters and physical model parameters. Then, an elevator operation status 3D holographic display model is established through a multi-dimensional display technology of text / speech / video / model based on mixed reality. By separately establishing the elevator multi-dimensional digital dynamic simulation model and the elevator operation status 3D holographic display model, the elevator digital twin modeling is realized, and the elevator digital twin simulation model can be accurately and efficiently constructed. According to the elevator multi-dimensional digital dynamic simulation model and the elevator operation status 3D holographic display model, the elevator operation status, the trapped person location, and the alarm information can be intuitively displayed, and rescue auxiliary decision-making and visualization guidance are provided, realizing the panoramic perception of the elevator operation situation and the visualization guidance for emergency rescue, helping rescue personnel shorten the elevator fault handling time, improving the efficiency of elevator fault handling and emergency rescue, and reducing the life and property losses of trapped passengers. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings required to be used in the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0012] Figure 1 It is an application environment diagram of an elevator digital twin modeling method provided by an embodiment of the present application.

[0013] Figure 2 It is a flowchart of an elevator digital twin modeling method provided by an embodiment of the present application.

[0014] Figure 3 It is a schematic diagram of the principle of an elevator digital twin modeling method provided by an embodiment of the present application.

[0015] Figure 4 It is a schematic diagram of the three-dimensional model structure of elevator machine room equipment provided by an embodiment of the present application.

[0016] Figure 5 It is a schematic diagram of the three-dimensional model structure of an elevator car provided by an embodiment of the present application.

[0017] Figure 6 It is a schematic diagram of the overall elevator geometric model structure provided by an embodiment of the present application.

[0018] Figure 7 It is a flowchart of the expert MR remote guidance rescue technology provided by an embodiment of the present application.

[0019] Figure 8 It is a schematic diagram of the structure of a computer device provided by an embodiment of the present application. Specific implementation manners

[0020] The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in the present application without creative efforts shall fall within the protection scope of the present application.

[0021] To make the above objects, features, and advantages of the present application more obvious and understandable, the present application will be further described in detail below with reference to the accompanying drawings and specific implementation manners.

[0022] The elevator digital twin modeling method provided by the embodiments of the present application can be applied to an application environment as Figure 1 shown. Among them, the terminal 102 communicates with the server 104 through the network. The data storage system can store the multi-dimensional monitoring data of the target elevator that the server 104 needs to process. The data storage system can be set up separately, integrated on the server 104, or placed on the cloud or other servers. The terminal 102 can send the multi-dimensional monitoring data of the target elevator to the server 104. After receiving the multi-dimensional monitoring data, for the multi-dimensional monitoring data, the server 104 constructs a multi-dimensional digital dynamic simulation model of the elevator according to the basic elevator parameters and physical model parameters; based on the multi-dimensional display technology of text / speech / video / model based on Mixed Reality (MR), a 3D holographic display model of the elevator operation state is established to intuitively display the elevator operation state, the trapped person location, and alarm information, and provide rescue auxiliary decision-making and visual guidance. The server 104 can feedback data such as the obtained elevator operation state, trapped person location, and alarm information to the terminal 102. In addition, in some embodiments, the elevator digital twin modeling method can also be implemented by the server 104 or the terminal 102 alone. For example, the terminal 102 can directly perform modeling, prediction of elevator fault cause categories, and visual display on the multi-dimensional monitoring data of the target elevator, or the server 104 can obtain the multi-dimensional monitoring data of the target elevator from the data storage system and perform modeling, prediction of elevator fault cause categories, and visual display on the multi-dimensional monitoring data of the target elevator.

[0023] Among them, the terminal 102 can be, but is not limited to, various desktop computers, laptop computers, smart phones, tablet computers, Internet of Things devices, and portable wearable devices. The Internet of Things devices can be smart speakers, smart TVs, smart air conditioners, smart in-vehicle devices, etc. The portable wearable devices can be smart glasses, smart watches, smart bracelets, head-mounted devices, etc. The server 104 can be implemented by an independent server or a server cluster composed of multiple servers, and can also be a cloud server.

[0024] In this embodiment, the terminal 102 is a field terminal installed around the elevator site, preferably a mixed reality glasses terminal. The server 104 is preferably a remote Web server terminal, and there is a wireless connection between the Web server terminal and the mixed reality glasses terminal to facilitate data transmission and information interaction between the two. At the same time, an expert terminal (PC terminal or Android mobile terminal) can also be set on the Web server terminal, and there is a wireless connection between the expert terminal and the field terminal, that is, the mixed reality glasses terminal. The expert terminal provides rescue auxiliary decision-making and visualization guidance for the mixed reality glasses terminal to remotely guide the emergency handling process after the elevator fails.

[0025] In an exemplary embodiment, as Figure 2 and Figure 3 shown, a method for elevator digital twin modeling is provided. This method is executed by a computer device, specifically, it can be executed alone by a computer device such as the terminal 102 or the server 104, or jointly executed by the terminal 102 and the server 104. In the embodiment of the present application, taking this method applied to Figure 1 the server 104 as an example for description, it includes the following steps S1 to S4:

[0026] Step S1: Obtain multi-dimensional monitoring data of the target elevator. Among them, the multi-dimensional monitoring data includes the basic elevator parameters and physical model parameters of the target elevator.

[0027] Step S2: Construct a multi-dimensional digital dynamic simulation model of the elevator according to the basic elevator parameters and physical model parameters.

[0028] In this embodiment, when step S2 constructs a multi-dimensional digital dynamic simulation model of the elevator according to the basic elevator parameters and the physical model parameters, first, an elevator geometric model and an elevator physical model are respectively established according to the basic elevator parameters and the physical model parameters; then, the elevator geometric model and the elevator physical model are fused to form the multi-dimensional digital dynamic simulation model of the elevator. Specifically, it includes the following steps:

[0029] Step S21: Perform three-dimensional modeling on the elevator car, hoistway, machine room, and pit according to the basic elevator parameters and the physical model parameters to establish an elevator geometric model.

[0030] Step S22: Adjust the model parameters of the elevator geometric model according to the basic elevator parameters so that the adjusted model parameters are consistent with the parameters corresponding to the actual elevator operation conditions, and establish a virtual mapping body of the elevator physical model; the basic elevator parameters include specification parameters such as car area, number of floors, number of stations, number of doors, diameter of the traction sheave and traction rope, etc.

[0031] Step S23: Obtain the physical state data of the target elevator, access the physical state data to the elevator virtual mapping body, and perform model fusion using the method of Cyber-Physical Systems (CPS) fusion to obtain an elevator multi-dimensional digital dynamic simulation model; the physical state data includes floor display, running direction, door opening / closing signal, speed, acceleration, position, etc.

[0032] In the method for constructing the elevator multi-dimensional digital dynamic simulation model in this embodiment, multi-modal multi-scale spatial data intelligent extraction technology and high-performance three-dimensional rendering technology are used to perform three-dimensional modeling on the elevator car, hoistway, machine room, pit, etc., establish an elevator geometric model, and establish an elevator physical model based on the physical characteristics of the elevator (such as traction rope tension, inertia, etc.). The elevator geometric model and the elevator physical model together constitute a general geometric physical model, which is applicable to both geared and gearless elevators. For example, the three-dimensional model of elevator machine room equipment is as Figure 4 shown, the three-dimensional model of the elevator car is as Figure 5 shown, and the overall geometric model of the elevator is as Figure 6 shown. Then, according to the basic parameters of the elevator, including but not limited to specifications such as car area (rated load), number of floors, number of stops, number of doors, diameter of the traction sheave, diameter of the traction rope, car mass, and counterweight mass, the model parameters are adjusted to be consistent with the actual elevator operating conditions to form an elevator virtual mapping body. The elevator virtual mapping body is the result of parameter adjustment of the elevator geometric model and the elevator physical model, and is used to reflect the dynamic operating characteristics of the actual elevator in the virtual space; then, physical state data such as elevator floor display, running direction, door opening / closing signal, etc. are accessed to the elevator virtual mapping body, and through the Cyber-Physical Systems fusion technology, the physical state data of the physical elevator (such as floor display, running direction, door opening / closing signal, speed, acceleration, position, etc.) are dynamically accessed to the elevator virtual mapping body, so as to realize the real-time coupling of the physical elevator and the virtual model, and form an elevator multi-dimensional digital dynamic simulation model that can reflect the elevator operating state in real time.

[0033] Step S3: Based on the multi-dimensional display technology of text / speech / video / model based on mixed reality, establish a 3D holographic display model of the elevator operating state, and intuitively display the elevator operating state, trapped person position, and alarm information according to the elevator multi-dimensional digital dynamic simulation model and the 3D holographic display model of the elevator operating state, and provide rescue assistance decision-making and visual guidance.

[0034] In this embodiment, the elevator multi-dimensional digital dynamic simulation model and the predicted results of the predicted fault causes are set on the Web server side, and the elevator operation status 3D holographic display model is set on the on-site side. The on-site side is a mixed reality glasses terminal, which is set around the site of the target elevator and worn by on-site rescue personnel. The mixed reality glasses terminal is wirelessly connected to the Web server side. For example, the wireless connection is achieved through a 4G / 5G wireless network.

[0035] In this embodiment, step S3 is based on the mixed reality text / voice / video / model multi-dimensional display technology to establish an elevator operation status 3D holographic display model, and intuitively display the elevator operation status, the trapped person location, and the alarm information according to the elevator multi-dimensional digital dynamic simulation model and the elevator operation status 3D holographic display model, and provide rescue assistance decision-making and visualization guidance. The specific steps are as follows:

[0036] Step S31: Based on the mixed reality glasses terminal, use the mixed reality text / voice / video / model multi-dimensional display technology to establish an elevator operation status 3D holographic display model.

[0037] Step S32: Send the elevator multi-dimensional digital dynamic simulation model and the predicted results of the fault causes in the Web server side to the mixed reality glasses terminal through a 4G / 5G wireless network, and perform 3D holographic display using the elevator operation status 3D holographic display model in the mixed reality glasses terminal. Among them, the content of the 3D holographic display includes the elevator operation status, the trapped person location, and the alarm information determined according to the elevator multi-dimensional digital dynamic simulation model and the predicted results of the fault causes.

[0038] Step S33: Adopt the MR three-dimensional registration virtual-real fusion method combining artificial identification and natural feature points to improve the virtual-real fusion effect displayed by the mixed reality glasses terminal, and provide rescue assistance decision-making and visualization guidance.

[0039] In this embodiment, step S33 adopts the MR three-dimensional registration virtual-real fusion method combining artificial identification and natural feature points to improve the virtual-real fusion effect displayed by the mixed reality glasses terminal, and provide rescue assistance decision-making and visualization guidance. The specific steps are as follows:

[0040] Based on the elevator holographic scenario, an MR three-dimensional registration virtual-real fusion method combining artificial markers and natural feature points is adopted to carry out expert MR remote guidance for rescue. Among them, expert MR remote guidance for rescue refers to the real-time transmission of information through functions such as holographic audio and video communication, icon annotation tool, file sending, text message sending back, and image sending between the expert side and the on-site side. During the communication process, the expert side freezes the screen and annotates the graphics, and sends the annotated 2D graphics to the mixed reality glasses terminal. The mixed reality glasses terminal converts the received 2D graphics into 3D graphics and locates the 3D graphics in the elevator space. Through functions such as voice, holographic video, spatial annotation (2D / 3D), and information projection, the process of the expert MR remote guidance rescue technology is as Figure 7 shown, providing rescue auxiliary decision-making and visual guidance, quickly guiding the on-site positioning of problems, remotely collaborating to efficiently solve on-site problems, and improving the rescue efficiency in complex on-site situations.

[0041] In this embodiment, the Web server side is an application server deployed in the elevator remote monitoring center or the cloud computing platform, which is used to store, calculate, and transmit the elevator multi-dimensional digital dynamic simulation model and the prediction result of the fault cause. The mixed reality glasses terminal (such as Microsoft HoloLens or other MR smart glasses) is worn by on-site rescue personnel and is used to receive and display in real time the 3D holographic display model of the elevator operation status transmitted from the Web server side. Specifically, the Web server side establishes a communication connection with the mixed reality glasses terminal through 4G / 5G wireless network, and transmits the 3D holographic display model of the elevator operation status and the prediction result of the fault cause to the mixed reality glasses terminal; the mixed reality glasses terminal performs holographic display according to the received 3D holographic display model of the elevator operation status and the prediction result of the fault cause (elevator operation status, trapped person location, and alarm information) for rescue personnel to view in real time. Through the MR three-dimensional registration virtual-real fusion method combining artificial markers and natural feature points, virtual-real matching is achieved. Specifically, it includes: first, placing artificial markers at key parts of the elevator site (such as the elevator control panel, emergency passage, etc.) to provide accurate initial positioning information; second, using natural feature points (such as elevator internal structure features and texture information) for automatic tracking and correction; providing an initial reference point through artificial markers, and combining natural feature points to dynamically update the position and posture of the 3D holographic display model of the elevator operation status, making the fusion of the 3D holographic display model of the elevator operation status and the real scene more accurate, thereby improving the virtual-real fusion effect and providing rescue auxiliary decision-making and visual guidance.

[0042] In this embodiment, the mixed reality glasses terminal is worn by rescue personnel at the elevator failure site. The mixed reality glasses terminal is used to receive in real time the holographic elevator scene (i.e., the 3D holographic display model of the elevator operation state) sent by the Web server during the rescue process, helping on-site rescue personnel intuitively understand the trapped position and operation state information of the elevator, and performing efficient rescue in combination with the guidance information provided by the expert terminal. Through the real-time transmission of information such as holographic audio and video communication, icon annotation tools, file sending, text message return, and image sending between the expert terminal and the on-site terminal, the frozen screen based on freeze screen annotation refers to the static preservation of the dynamic screen of the rescue site during the real-time monitoring by the expert terminal, and annotation information (such as position marks, operation prompts, etc.) is added to this screen; these annotation information are then sent to the mixed reality glasses terminal in the form of 2D graphics. The mixed reality glasses terminal converts the received 2D graphics into 3D graphics and performs positioning and projection in the real space inside the elevator through the virtual-real fusion technology. For example, after an elevator failure occurs, the mixed reality glasses terminal can project a 3D model of the failure part or an operation path inside or outside the elevator to assist rescue personnel in quickly troubleshooting problems and executing instructions.

[0043] In this embodiment, the process of rescue guidance includes the following steps:

[0044] 1) The Web server collects the multi-dimensional digital dynamic simulation model of the elevator and the prediction result of the failure cause, and sends them to the mixed reality glasses terminal and the expert terminal through the 4G / 5G network.

[0045] 2) The expert terminal remotely monitors the situation at the rescue site, freezes the on-site screen, and annotates graphics (such as the failure part, operation path, etc.) on this screen; then the annotation information and the frozen screen are sent to the mixed reality glasses terminal together.

[0046] 3) After receiving the information sent by the expert terminal, the mixed reality glasses terminal converts the 2D annotation graphics into 3D graphics, and performs positioning and projection in the internal space of the elevator by combining the MR three-dimensional registration virtual-real fusion method that combines artificial marks and natural feature points.

[0047] 4) Through the holographic display, voice guidance and spatial annotation functions of the mixed reality glasses terminal, rescue personnel can quickly identify the failure part and perform operations according to the instructions of the expert terminal.

[0048] 5) The two parties achieve real-time collaboration through means such as holographic audio and video communication, image sending, and text message return to further optimize the rescue plan until the on-site problem is solved.

[0049] This embodiment can achieve panoramic perception of the elevator operation situation and intelligent visualization guidance for emergency rescue, provide remote expert assistance for elevator emergency disposal, help rescue personnel shorten the elevator fault handling time, comprehensively improve the quality and efficiency of elevator emergency disposal, and avoid casualties and economic losses caused by elevator safety accidents.

[0050] As Figure 7 shown, the technical principle of the expert MR remote guidance rescue technology in this embodiment includes the following steps.

[0051] Step (1) Fault detection and analysis.

[0052] Step (1.1) Fault detection. Data storage and data services are carried out through the underlying data storage and service layer (such as MySQL and REST API), mainly collecting the operation data and fault status data of the elevator, and sending the fault information prediction results to relevant terminals through the message transmission module (MR-Server).

[0053] Step (1.2) Information classification and processing. In the "message transmission / parsing" module, the predicted fault cause prediction results are classified and parsed to determine the specific fault type, fault location and severity, and generate elevator operation status, fault location and alarm information. Integrate relevant context information (such as floor, time and elevator status) to provide data support for subsequent guidance.

[0054] Step (2) Generate rescue strategies.

[0055] Step (2.1) Spatial positioning. Use the "spatial annotation" module to perform spatial positioning according to the geographical location information of the faulty elevator and the building layout. Through the "2D / 3D coordinate conversion" module, the specific location of the elevator (such as the floor of the building, specific elevator number) is converted into a plane or three-dimensional view that is easy for rescue personnel to understand.

[0056] Step (2.2) Real-time data acquisition. If real-time audio and video data are collected at the on-site end, the situation inside the faulty elevator (such as whether there are trapped passengers, the number and condition) is transmitted to the expert end and the mixed reality glasses terminal through the "audio and video transmission / parsing" module. Rescue personnel can view the inside of the elevator in real time through WebRTC (Web Real-Time Communication) technology.

[0057] Step (2.3) Rescue path planning. Integrate the spatial map information and rescue channels in the building through the "holographic interaction" module to generate a rescue path. Special positions such as emergency channels and elevator shafts can be marked in the holographic interaction interface to provide clear path guidance for the rescue team.

[0058] Step (3) Rescue information transmission.

[0059] Step (3.1) Multi-terminal notification. Through the "File parsing / transmission" and "Message transmission / parsing" modules, the rescue plan is sent to relevant terminals (such as on-site terminals, i.e., mixed reality glasses terminals or other mobile devices of the rescue team). The expert terminal can receive the rescue path and detailed information through a PC or UWP device for remote guidance.

[0060] Step (3.2) Rescue process collaboration. Rescue personnel can communicate with the expert terminal in real time through the WebSocket (a full-duplex communication protocol based on TCP) module, including transmitting audio and video information inside the elevator and the rescue progress. The expert terminal can adjust the rescue strategy in a timely manner according to the feedback. For example, guiding firefighters to preferentially select a specific floor to enter.

[0061] Step (4) On-site operation and monitoring.

[0062] Step (4.1) Rescue on-site execution. According to the planned rescue path, the rescue personnel reach the designated location and perform rescue operations. The rescue progress is updated in real time in the "Holographic interaction" and "Spatial annotation" modules, such as whether the personnel have been successfully evacuated and whether the elevator status has been restored. Through the "Frozen screen annotation" module, the freeze frame function is used to enable the expert terminal to statically save the dynamic picture of the rescue site during real-time monitoring and add annotation information (such as position marks, operation tips, etc.) to this picture.

[0063] Step (4.2) Rescue effect confirmation. Through the audio and video parsing module, it is confirmed whether there are still trapped passengers in the elevator after the rescue is completed. The position and relevant data where the rescue is completed are recorded through the "2D / 3D coordinate conversion" module for subsequent analysis.

[0064] Step (5) Rescue report generation. The system automatically generates a rescue report, including data such as the fault type, rescue path, and time consumption. The rescue report is stored in the data storage module (such as MySQL) for analysis by the expert terminal or the management department.

[0065] At present, various problems are inevitably exposed in each management link of the elevator's full life cycle. First, the failure modes are complex, it is difficult to model the elevator digital twin, and the efficiency of emergency rescue is low. These are all due to the lack of technical applications in multi-dimensional, multi-scale dynamic real-time data collection and processing, the inability to accurately depict the operating state of the equipment, the inability to establish a clearer fault evolution mechanism and diagnostic warning method, the lack of tools to simulate and simulate different working conditions / defects / faults, the inability to quickly capture fault phenomena and accurately locate the cause of the fault, the lack of comprehensive presentation ability of the visualization model of the equipment operation trend, the difficulty in deducing the evolution path of accident risks, the lack of information guarantee for emergency command and comprehensive decision-making, and the limited ability of emergency disposal and accident prevention. Second, the acquisition of knowledge for special equipment fault rescue and maintenance guidance is not intuitive, and due to force majeure factors such as natural disasters and major events, on-site expert guidance is not timely, high-quality expert resources are difficult to benefit the public, industry standard knowledge is complex, and the knowledge reserve of operators is insufficient. And this embodiment aims at the problems of complex elevator fault modes, difficult and inaccurate elevator digital twin modeling, and low emergency rescue efficiency. Through the above process of constructing the elevator multi-dimensional digital dynamic simulation model, combined with the multi-dimensional display technology of text / speech / video / model based on mixed reality, a 3D holographic display model of the elevator operating state is established to intuitively display the elevator operating state, warning position and alarm information, provide rescue auxiliary decision-making and visualization guidance, and realize the panoramic perception of the elevator operation trend and the intelligent visualization guidance of emergency rescue.

[0066] In an exemplary embodiment, a computer device is provided. The computer device can be a server or a terminal, and its internal structure diagram can be as Figure 8 shown. The computer device includes a processor, a memory, an input / output interface (Input / Output, abbreviated as I / O), and a communication interface. Among them, the processor, the memory, and the input / output interface are connected through a system bus, and the communication interface is connected to the system bus through the input / output interface. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store multi-dimensional monitoring data. The input / output interface of the computer device is used to exchange information between the processor and external devices. The communication interface of the computer device is used to communicate with external terminals through a network connection. When the computer program is executed by the processor, it realizes the elevator digital twin modeling method.

[0067] Those skilled in the art can understand, Figure 8The structure shown is only a block diagram of some structures related to the solution of this application, and does not constitute a limitation on the computer device to which the solution of this application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine some components, or have different component arrangements.

[0068] Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above methods. Among them, any reference to a memory, database, or other medium used in the embodiments provided in this application can include at least one of non-volatile and volatile memories. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc.

[0069] In this embodiment, an elevator multi-dimensional digital dynamic simulation model is first constructed according to elevator basic parameters and physical model parameters; an elevator operation state 3D holographic display model is established through a multi-dimensional display technology of text / speech / video / model based on mixed reality. After a fault and alarm occur in the elevator, the elevator operation state 3D holographic display model can be used to intuitively display the elevator operation state, the location of trapped people, and alarm information, and provide rescue auxiliary decision-making and visual guidance. This method can achieve panoramic perception of the elevator operation situation and intelligent visual guidance for emergency rescue, help rescue personnel shorten the elevator fault handling time, improve the efficiency of elevator fault handling and emergency rescue, and reduce the life and property losses of trapped passengers.

[0070] The technical features of the above embodiments can be combined arbitrarily. For the sake of brevity of description, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered as the scope recorded in this specification.

[0071] Specific examples are used in this article to elaborate on the principles and implementation manners of the present application. The description of the above embodiments is only used to help understand the method and its core idea of the present application; at the same time, for those of ordinary skill in the art, according to the idea of the present application, there will be changes in the specific implementation manners and application scopes. In summary, the content of this specification should not be construed as a limitation to the present application.

Claims

1. A method for modeling an elevator digital twin, characterized in that: The elevator digital twin modeling method includes: Acquire multi-dimensional monitoring data of a target elevator; the multi-dimensional monitoring data includes basic elevator parameters and physical model parameters of the target elevator; Constructing a multi-dimensional digital dynamic simulation model of the elevator according to the basic parameters of the elevator and the physical model parameters; Based on the mixed reality text / voice / video / model multi-dimensional display technology, a 3D holographic display model of the elevator operation status is established, and the elevator operation status, trapped person location and alarm information are intuitively displayed based on the elevator multi-dimensional digital dynamic simulation model and the elevator operation status 3D holographic display model, and rescue auxiliary decision-making and visual guidance are provided.

2. The elevator digital twin modeling method according to claim 1, characterized in that: According to the basic parameters of the elevator and the physical model parameters, a multi-dimensional digital dynamic simulation model of the elevator is constructed, specifically including: According to the basic parameters of the elevator and the physical model parameters, respectively establish an elevator geometric model and an elevator physical model; The elevator geometric model and the elevator physical model are fused to form a multi-dimensional digital dynamic simulation model of the elevator.

3. The elevator digital twin modeling method according to claim 2, characterized in that: According to the basic parameters of the elevator and the physical model parameters, respectively establish an elevator geometric model and an elevator physical model; The elevator geometric model and the elevator physical model are fused to form a multi-dimensional digital dynamic simulation model of the elevator, specifically including: According to the basic parameters of the elevator and the physical model parameters, three-dimensional modeling is performed on the elevator car, hoistway, machine room and pit to establish an elevator geometric model; According to the basic parameters of the elevator, the model parameters of the elevator geometric model are adjusted so that the adjusted model parameters are consistent with the parameters corresponding to the actual elevator operation status, and an elevator virtual mapping body of the elevator physical model is established; The physical state data of the target elevator is obtained, and the physical state data is connected to the elevator virtual mapping body, and the model fusion is performed using the information-physical system fusion method to obtain the multi-dimensional digital dynamic simulation model of the elevator.

4. The elevator digital twin modeling method according to claim 1, characterized in that: The elevator multi-dimensional digital dynamic simulation model and the predicted fault cause prediction results are set on the Web server side, and the elevator operation status 3D holographic display model is set on the site side. The site side is a mixed reality glasses terminal, and the mixed reality glasses terminal is set around the site of the target elevator, and the mixed reality glasses terminal is wirelessly connected to the Web server side; Based on the mixed reality text / voice / video / model multi-dimensional display technology, a 3D holographic display model of the elevator operation status is established, and the elevator operation status, trapped person location and alarm information are intuitively displayed based on the elevator multi-dimensional digital dynamic simulation model and the elevator operation status 3D holographic display model, and rescue auxiliary decision-making and visual guidance are provided, including: Based on the mixed reality glasses terminal, a 3D holographic display model of the elevator operation status is established by using the mixed reality-based text / voice / video / model multi-dimensional display technology; The multi-dimensional digital dynamic simulation model of the elevator and the fault cause prediction result in the Web server are sent to the mixed reality glasses terminal, and the 3D holographic display model of the elevator operation status in the mixed reality glasses terminal is used for 3D holographic display; the content of the 3D holographic display includes the elevator operation status, trapped person position and alarm information determined according to the multi-dimensional digital dynamic simulation model of the elevator and the fault cause prediction result; An MR three-dimensional registration virtual-reality fusion method combining artificial markers and natural feature points is adopted to improve the virtual-reality fusion effect displayed by the mixed reality glasses terminal, and provide rescue auxiliary decision-making and visual guidance.

5. The elevator digital twin modeling method according to claim 4, characterized in that: The MR three-dimensional registration virtual-real fusion method combining artificial markers and natural feature points is used to improve the virtual-real fusion effect displayed by the mixed reality glasses terminal, and provide rescue auxiliary decision-making and visual guidance, specifically including: Based on the elevator holographic scene, an MR three-dimensional registration virtual-reality fusion method combining artificial markings and natural feature points is adopted to carry out expert MR remote guidance rescue. The expert MR remote guidance rescue refers to the real-time transmission of information through holographic audio and video communication, icon annotation tools, file sending, text message return and image sending functions between the expert end and the on-site end. During the communication process, the expert end is used to freeze the screen and annotate the graphics, and the annotated 2D graphics are sent to the mixed reality glasses terminal. The received 2D graphics are converted into 3D graphics by the mixed reality glasses terminal, and the 3D graphics are positioned in the elevator space. Through voice, holographic video, space annotation and information projection functions, rescue auxiliary decision-making and visual guidance are provided to on-site rescue personnel.

Images