Elevator remote virtual maintenance method, maintenance device, electronic device, and storage device

Abstract

The application relates to the field of elevator fault maintenance, in particular to an elevator remote virtual maintenance method, a maintenance device, electronic equipment and a storage device, wherein the elevator remote virtual maintenance method comprises a preset database, which stores maintenance schemes of different faults, elevator drawings and different fault condition characteristics, and the different fault condition characteristics are marked by fault codes; the maintenance scheme comprises a maintenance point and a maintenance method; fault information and on-site image information are acquired; a fault code is acquired according to the acquired fault information and / or on-site image information, the maintenance scheme in the database is called according to the fault code and is output; based on the on-site image information and the elevator drawings, a facing surface is located, if the facing surface has a maintenance point, the maintenance method is output; and if the facing surface does not have a maintenance point, turning guidance is output. The application has the effects of improving the maintenance efficiency of the elevator and improving the personnel efficiency.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of elevator fault maintenance, in particular to an elevator remote virtual maintenance method, a maintenance device, an electronic device and a storage device. BACKGROUND

[0002] After the elevator fails, the maintenance personnel are usually contacted for maintenance. After the maintenance personnel arrive at the scene, they query the elevator data according to their own experience and the related information of the fault elevator, and then troubleshoot and maintain the elevator according to the queried data, resulting in a long downtime of the elevator. When problems that cannot be troubleshooted on site by the maintenance personnel or problems that cannot be solved by the maintenance personnel on site occur, other professional personnel need to be contacted for auxiliary maintenance, at which time the personnel efficiency is low due to the need to wait for the arrival of professional personnel on site and the information troubleshooting after their arrival. SUMMARY

[0003] In order to improve the maintenance efficiency of the elevator and improve the personnel efficiency, the present application provides an elevator remote virtual maintenance method, a maintenance device, an electronic device and a storage device.

[0004] The present application provides an elevator remote virtual maintenance method, which adopts the following technical scheme:

[0005] An elevator remote virtual maintenance method comprises the following steps:

[0006] A preset database stores maintenance solutions for different faults, elevator drawings, and different fault condition characteristics, and different fault condition characteristics are marked with fault codes;

[0007] The maintenance solution comprises a maintenance point and a maintenance method;

[0008] Obtain fault information and on-site image information;

[0009] According to the obtained fault information and / or on-site image information, obtain the fault code, retrieve the maintenance solution in the database according to the fault code, and output;

[0010] Based on the on-site image information and the elevator drawings, locate the facing surface,

[0011] If the facing surface has the maintenance point, output the maintenance method;

[0012] If the facing surface does not have the maintenance point, output a turning guide.

[0013] In a specific implementable scheme, the method for finding the maintenance point is:

[0014] extracting key features from the field image information, performing feature matching between the key features and positioning features in the elevator drawing, and performing overlap calculation, when the overlap reaches a preset threshold, indicating that the matching is successful, and the orientation surface is positioned in the surface of the elevator drawing;

[0015] reading the maintenance scheme, matching the orientation surface with the surface where the maintenance point is located, if matching, indicating that the maintenance point exists on the orientation surface,

[0016] if not matching, indicating that the maintenance point does not exist on the orientation surface.

[0017] In a specific implementable embodiment, after determining that the maintenance point exists on the orientation surface, the maintenance point is positioned and projected into the field image information.

[0018] In a specific implementable embodiment, the method for projecting the maintenance point into the field image information is:

[0019] based on the coordinates of the positioning features in the elevator drawing, the coordinates of the maintenance point, and the coordinates of the key features in the field image information;

[0020] calculating the first Euclidean distance between each two of the positioning features in the elevator drawing,

[0021] calculating the second Euclidean distance between each two of the key features in the field image information,

[0022] calculating the scaling ratio between the first Euclidean distance and the second Euclidean distance,

[0023] calculating the third Euclidean distance between the positioning features in the elevator drawing and the maintenance point,

[0024] calculating the fourth Euclidean distance between the key features in the field image information and the maintenance point according to the scaling ratio, and further determining the coordinates of the maintenance point in the field image information.

[0025] In a specific implementable embodiment, after completing the calculation of the scaling ratio, the angle of the field image information is adjusted so that multiple scaling ratios are equal.

[0026] In a specific implementable embodiment, the method for generating the turning guide is:

[0027] numbering the six surfaces of the elevator, based on the positioned orientation surface, calculating the positional relationship between the orientation surface and the surface where the maintenance point is located, and generating guide information.

[0028] The application further provides a maintenance device, which adopts the technical scheme as follows:

[0029] A maintenance device comprises one or more processors, a memory, and one or more computer programs.

[0030] The one or more computer programs are stored in the memory, and the one or more computer programs comprise instructions, which, when executed by the maintenance device, cause the maintenance device to perform the elevator remote virtual maintenance method.

[0031] An image acquisition module acquires the on-site image information.

[0032] A display module displays the steering guide, the maintenance scheme, and the fault code.

[0033] An input module acquires the input fault code and the instruction.

[0034] The application further provides an electronic device, which adopts the technical scheme as follows:

[0035] An electronic device comprises one or more processors, a memory, and one or more computer programs.

[0036] The one or more computer programs are stored in the memory, and the one or more computer programs comprise instructions, which, when executed by the electronic device, cause the electronic device to perform the elevator remote virtual maintenance method.

[0037] The application further provides a storage medium, which adopts the technical scheme as follows:

[0038] A non-transitory computer-readable storage medium stores computer instructions for causing a computer to perform the elevator remote virtual maintenance method.

[0039] In summary, the application has at least one beneficial technical effect as follows:

[0040] 1. Through the construction of the database, when a maintenance personnel encounters a difficult problem, the maintenance personnel can call the relevant maintenance scheme in the database to maintain the elevator, thereby saving the process of contacting other maintenance personnel and improving the maintenance efficiency of the elevator.

[0041] 2. The maintenance personnel inputs the fault code, or the fault code can be automatically identified through image recognition, and the corresponding maintenance method is displayed on the device of the maintenance personnel, thereby saving the process of the maintenance personnel searching for information according to the elevator fault and improving the maintenance efficiency of the elevator.

[0042] 3. Even if the maintenance experience is less, the elevator maintenance can be quickly completed through the guidance of the maintenance party valve, the difficulty of elevator maintenance is reduced, the maintenance personnel with less maintenance experience can undertake more work, the threshold of maintenance personnel is reduced, and the problem of elevator maintenance personnel shortage is alleviated. BRIEF DESCRIPTION OF DRAWINGS

[0043] Figure 1 is a flowchart of an elevator remote virtual maintenance method. DETAILED DESCRIPTION

[0044] The following will be described in conjunction with the accompanying Figure 1 The application will be further described in detail.

[0045] AR (Augmented Reality) is an augmented reality, which is a new technology that combines real world information and virtual world information. It is to overlay virtual information on real world entities (visual information, sound, taste, touch, etc.) in a certain time and space range in the real world through computer and other scientific technologies, and to be perceived by human senses, so as to achieve a sensory experience beyond reality.

[0046] The elevator remote virtual maintenance method provided by the embodiment of the application can be applied to a server, and can also be applied to a terminal. The server can be a physical server, a server cluster or a distributed system composed of multiple physical servers, or a cloud server providing cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content distribution networks (CDN), and basic cloud computing services such as big data and artificial intelligence platforms. The terminal can be a user equipment (UE) such as a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a personal digital assistant (PDA), a tablet computer (PAD), a handheld device, a vehicle-mounted device, a wearable device, a computing device, or other processing devices connected to a wireless modem, a mobile station (MS), a mobile terminal (Mobile Terminal), etc. The application does not limit the terminal.

[0047] If the application is applied to a server, data in a region file related to a target region needs to be received from a terminal in communication connection with the server, and then the server performs the elevator remote virtual maintenance method of the application based on the data in the region file.

[0048] If the present invention is applied in a terminal, the terminal can directly execute the elevator remote virtual maintenance method of the present invention after acquiring data in a region file related to a target region.

[0049] Reference Figure 1 ,The elevator remote virtual maintenance method includes the following steps:

[0050] S100. A database is pre-established on the server. Possible elevator faults are extracted and stored in the database. The features are labeled with fault codes for different faults. Repair plans corresponding to different elevator faults are stored in the database. The repair plans are matched with the fault codes, ensuring that each repair plan corresponds to at least one fault code and a combination of multiple fault codes. Drawings of different elevators are stored in the database. Different elevator surfaces are numerically labeled, and at least three positioning features are set on each elevator surface.

[0051] The maintenance plan includes maintenance methods and maintenance points. The maintenance point is the fault location of the elevator, and the maintenance method is the operation that the maintenance personnel needs to perform.

[0052] S200: After the maintenance personnel arrive at the scene, they obtain image information of the scene through AR glasses, mobile phones and other devices, upload the image information to the server, compare the image information with the fault characteristics in the database on the server, identify the fault code of the elevator, and call the relevant maintenance plan, which is output on the display device of AR glasses, mobile phones and the like.

[0053] The fault code can also be determined by maintenance personnel during on-site inspections and input through built-in input devices such as AR glasses and mobile phones. After the server obtains the input fault code, it outputs the corresponding maintenance plan.

[0054] At the same time, the server extracts key features based on the acquired on-site image information, and then combines the key features with the positioning features of the elevator drawings stored in the database to perform feature matching and calculate the degree of overlap. If the degree of overlap is greater than or equal to 90%, it indicates that the surface is the facing surface, that is, the surface of the elevator that the maintenance personnel are facing. If the degree of overlap is less than 90%, it indicates that the surface is not the surface that the maintenance personnel are facing. The degree of overlap of other surfaces in the elevator drawings and the on-site image information is calculated.

[0055] S300, when the orientation positioning of the maintenance personnel is completed, the position of the maintenance point in the maintenance scheme is detected, if the maintenance point is located on the orientation surface, the specific maintenance scheme is displayed on the AR glasses, mobile phone and other equipment of the maintenance personnel, and the maintenance point is projected on the image information of the scene. If the maintenance point is not on the orientation surface, the server calculates the positional relationship between the orientation surface and the surface where the maintenance point is located, and outputs the steering guide. The steering guide can be an arrow pattern displayed on the device, or voice broadcast, text description, etc.

[0056] Take the north, east, south, west, up and down directions of the elevator as examples, and label them as 1, 2, 3, 4, 5 and 6 in sequence.

[0057] After the maintenance personnel enter the elevator shaft, image information of multiple angles such as front, back, left, right, up and down is obtained, and the orientation positioning of the maintenance personnel is uploaded to the server. When obtaining image information, it can be an image of a region occupying 60% of the corresponding direction of the shaft wall in the entire front direction.

[0058] The maintenance point of the elevator is on the surface (No. 3 surface) on the south side of the elevator, and at this time the maintenance personnel face the north surface (No. 1 surface) of the elevator. An arrow that rotates 180° clockwise or counterclockwise is displayed on the device of the maintenance personnel to guide the maintenance personnel to turn.

[0059] After the maintenance personnel complete the steering, the server calculates the position of the maintenance point based on the position of the maintenance personnel and projects it on the device of the maintenance personnel. Specifically as follows:

[0060] Take 3 key features and 3 positioning features as examples. In actual calculation, the number of key features and positioning features can be adjusted according to actual conditions, and the number of key features and positioning features is at least 3.

[0061] Obtain the coordinates of the positioning features, the coordinates of the key features, and the coordinates of the maintenance point on the drawing of the elevator.

[0062] Calculate the first Euclidean distance s d12 , s d13 , s d23 between each two of the positioning features (x d1 , y d1 ), (x d2 , y d2 ) and (x d3 , y d3 ).

[0063]

[0064] Calculate the second Euclidean distance s 12 , s 13 , s 23.

[0065]

[0066] Calculate the scaling ratio between the image information of the scene and the elevator drawing, that is, the ratio c between the first Euclidean distance and the second Euclidean distance 12 、c 13 、c 23 .

[0067]

[0068]

[0069] Calculate the third Euclidean distance s between the drawing end maintenance point (x rd , y rd ) and each positioning feature rd1 、s rd2 、s rd3 .

[0070]

[0071] According to the scaling ratio, calculate the fourth Euclidean distance s between the scene end maintenance point and each key feature r1 、s r2 、s r3 .

[0072]

[0073] Determine a unique point through the fourth Euclidean distance and the key feature, that is, the coordinates (x r , y r ) of the maintenance point in the scene.

[0074] After the scaling ratio is calculated, the maintenance personnel adjust the position so that c 12 =c 13 =c 23 , so that subsequent calculation is more convenient, and the subsequent calculation result is more accurate, and the positioning accuracy of the maintenance point in the actual scene is improved.

[0075] After the positioning of the maintenance point is completed, the voice broadcast of the maintenance method is performed, so that the maintenance personnel follow the indication of the voice broadcast to maintain the elevator. In some other embodiments, animation demonstration, text description and the like can be used, which are not limited by the present application.

[0076] The present application also discloses a maintenance device, comprising: one or more processors; memory;

[0077] and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs comprise instructions, which when executed by the maintenance device, cause the maintenance device to perform the above-mentioned elevator remote virtual maintenance method.

[0078] an image acquisition module, configured to acquire on-site image information;

[0079] a display module, configured to display steering guidance, maintenance solutions and fault codes;

[0080] an input module, configured to acquire input fault codes and instructions.

[0081] The application further discloses an electronic device, comprising: one or more processors; a memory;

[0082] and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs comprise instructions, which when executed by the electronic device, cause the electronic device to perform the above-mentioned elevator remote virtual maintenance method.

[0083] The application further discloses a non-transient computer readable storage medium storing computer instructions, wherein the computer instructions are used for causing a computer to perform the above-mentioned elevator remote virtual maintenance method.

[0084] The above are preferred embodiments of the application, which do not limit the protection scope of the application, and thus: any equivalent changes made according to the structure, shape and principle of the application should be covered within the protection scope of the application.

Claims

1. A remote virtual maintenance method for an elevator, characterized by: The steps include: A preset database stores maintenance plans for different faults, elevator drawings, and different fault condition characteristics, and marks the different fault condition characteristics with fault codes; The maintenance plan includes maintenance points and maintenance methods; Obtain fault information and on-site image information; Obtaining the fault code according to the acquired fault information and / or the on-site image information, and retrieving and outputting the maintenance plan in the database according to the fault code; Based on the on-site image information and the elevator drawings, locate the orientation surface. If the maintenance point exists on the facing surface, output the maintenance method; If the maintenance point does not exist on the facing surface, outputting a steering guidance; The method for finding the maintenance point is: Extracting key features from the on-site image information, performing feature matching on the key features with the positioning features in the elevator drawing, and calculating a degree of overlap. When the degree of overlap reaches a preset threshold, it indicates a successful match, and the facing surface in the elevator drawing is located; Read the maintenance plan and match the facing surface with the surface where the maintenance point is located. If they match, it indicates that the maintenance point exists on the facing surface. If there is no match, it indicates that the maintenance point does not exist on the orientation surface; After determining that the maintenance point exists on the orientation surface, locating the maintenance point and projecting it into the on-site image information; The method of projecting the maintenance point into the on-site image information is: Based on the positioning features in the elevator drawings, the coordinates of the maintenance points, and the coordinates of the key features in the on-site image information; Calculate the first Euclidean distance between each of the positioning features in the elevator drawing, Calculating the second Euclidean distance between the key features in the scene image information, calculating a scaling ratio between the first Euclidean distance and the second Euclidean distance, Calculating the third Euclidean distance between the positioning feature in the elevator drawing and the maintenance point, The fourth Euclidean distance between the maintenance point in the on-site image information and the key feature is calculated according to the scaling ratio, thereby determining the coordinates of the maintenance point in the on-site image information.

2. The elevator remote virtual maintenance method according to claim 1, characterized in that: After the calculation of the scaling ratio is completed, the angle of the on-site image information is adjusted so that the multiple scaling ratios are equal.

3. The elevator remote virtual maintenance method according to claim 1, characterized in that: The generation method of the steering guidance is: The six faces of the elevator are numbered, and based on the located facing face, the positional relationship between the facing face and the face where the maintenance point is located is calculated to generate guidance information.

4. A maintenance device, characterized in that: include: one or more processors; Memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions, which, when executed by the maintenance device, enable the maintenance device to perform the remote virtual maintenance method for an elevator according to any one of claims 1 to 3; An image acquisition module, for acquiring the on-site image information; a display module, displaying the steering guidance, the maintenance plan, and the fault code; The input module obtains the input fault code and the instruction.

5. An electronic device, characterized in that: include: one or more processors; Memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions, which, when executed by the electronic device, enable the electronic device to execute the remote virtual maintenance method for an elevator as described in any one of claims 1 to 3.

6. A non-transitory computer-readable storage medium storing computer instructions, characterized in that: The computer instructions are used to enable a computer to execute the elevator remote virtual maintenance method according to any one of claims 1 to 3.

Images