Power transmission equipment information augmented reality human-computer interaction method and device and computer equipment

Abstract

The application relates to a power transmission equipment information augmented reality human-computer interaction method and device and a computer device. The method comprises the following steps: acquiring an equipment image of a power transmission equipment to be displayed; in response to a selection operation for a display mode in a displayed mode selection interface, if the display mode is an augmented reality display mode, acquiring a real scene contained in the equipment image and a virtual power transmission equipment model associated with the power transmission equipment, and adding the virtual power transmission equipment model to an augmented reality image with the real scene as a background; and displaying the augmented reality image in a preset information viewing function interface, and if a triggering operation for a device information viewing function control contained in the information viewing function interface is detected, displaying device information matched with the device information viewing function control and acquired from device information associated with the virtual power transmission equipment model. The method can improve the field operation efficiency.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of information processing, in particular to a power transmission equipment information augmented reality human-computer interaction method and device and computer equipment. BACKGROUND

[0002] With the development of direct current transmission technology, the normal operation of power transmission equipment is the basis for ensuring direct current transmission, and the maintenance of power transmission equipment is becoming more and more important. For the maintenance method of power transmission equipment, it is necessary to understand the equipment structure and equipment information of power transmission equipment. However, for power transmission equipment, the valve hall of direct current transmission is in a charged state for a long time, the power transmission equipment is large in size and high in cost, and it is difficult to transport and disassemble, which is not conducive to the acquisition of equipment information of power transmission equipment.

[0003] The existing method for understanding the equipment information of power transmission equipment usually learns the equipment information of power transmission equipment through text records and pictures, or learns the structure and equipment information of power transmission equipment through virtual environment simulation.

[0004] However, the current method for understanding the equipment information of power transmission equipment is not conducive to the operation of power transmission equipment after the staff learn the equipment information, and there is a problem of low field operation efficiency. SUMMARY

[0005] Therefore, it is necessary to provide a power transmission equipment information augmented reality human-computer interaction method, device and computer equipment capable of improving the low field operation efficiency of power transmission equipment.

[0006] In a first aspect, the present application provides a power transmission equipment information augmented reality human-computer interaction method, which comprises:

[0007] obtaining an equipment image of power transmission equipment to be displayed;

[0008] in response to a selection operation for a display mode in a displayed mode selection interface, in a case where the display mode is an augmented reality display mode, obtaining a real scene contained in the equipment image and a virtual power transmission equipment model associated with the power transmission equipment, and adding the virtual power transmission equipment model to an augmented reality image with the real scene as the background;

[0009] displaying the augmented reality image in a preset information viewing function interface, and if a triggering operation for an equipment information viewing function control contained in the information viewing function interface is detected, displaying equipment information matched with the equipment information viewing function control, which is obtained from the equipment information associated with the virtual power transmission equipment model.

[0010] In one of the embodiments, the equipment information viewing function control comprises a maintenance viewing function control.

[0011] The device information matched with the device information viewing function control is obtained from the device information associated with the virtual power transmission equipment model, and the device information is displayed.

[0012] In response to a triggering operation on the maintenance viewing function control, a maintenance viewing interface is displayed, and a sub-maintenance viewing function control is displayed on the maintenance viewing interface.

[0013] In response to a triggering operation on the sub-maintenance viewing function control, maintenance information of the power transmission equipment matched with the sub-maintenance viewing function control is obtained from the device information associated with the virtual power transmission equipment model.

[0014] In one of the embodiments, in response to a triggering operation on the sub-maintenance viewing function control, maintenance information of the power transmission equipment matched with the sub-maintenance viewing function control is obtained from the device information associated with the virtual power transmission equipment model, and the maintenance information is displayed.

[0015] In response to a triggering operation on the sub-maintenance viewing function control, maintenance step information of the power transmission equipment corresponding to the sub-maintenance viewing function control is displayed.

[0016] In response to a step switching operation on the maintenance step information, maintenance step information corresponding to the step switching operation is displayed.

[0017] In one of the embodiments, the device information viewing function control includes a device introduction function control.

[0018] The device information matched with the device information viewing function control is obtained from the device information associated with the virtual power transmission equipment model, and the device information is displayed.

[0019] In response to a triggering operation on the device introduction function control, a device introduction interface corresponding to the device introduction function control is displayed.

[0020] In the device introduction interface, video introduction information and text introduction information of the power transmission equipment are displayed.

[0021] In one of the embodiments, the virtual power transmission equipment model is a two-dimensional virtual power transmission equipment model.

[0022] The device information matched with the device information viewing function control is obtained from the device information associated with the virtual power transmission equipment model, and the device information is displayed.

[0023] In response to a triggering operation on the two-dimensional virtual power transmission equipment model, a three-dimensional virtual power transmission equipment model corresponding to the two-dimensional virtual power transmission equipment model is displayed.

[0024] In response to a shape transformation operation triggered on the three-dimensional virtual power transmission equipment model, the three-dimensional virtual power transmission equipment model after the shape transformation operation is displayed.

[0025] In one of the embodiments, after displaying the three-dimensional virtual power transmission equipment model corresponding to the two-dimensional virtual power transmission equipment model, the method further comprises:

[0026] In response to a triggering operation on the hierarchical display function control of the three-dimensional virtual power transmission equipment model, displaying an identification control of a three-dimensional virtual sub-module contained in the three-dimensional virtual power transmission equipment model; the three-dimensional virtual sub-module is a three-dimensional virtual module corresponding to a component contained in the power transmission equipment;

[0027] In response to a triggering operation on the identification control, displaying the three-dimensional virtual sub-module corresponding to the identification control.

[0028] In one of the embodiments, the method further comprises:

[0029] In response to a selection operation on the display mode in the displayed mode selection interface, in a case where the display mode is a preview mode, taking a preset background as a display background of the preview mode, and displaying an information viewing function interface;

[0030] In the information viewing function interface, displaying the two-dimensional virtual power transmission equipment model of the selected power transmission equipment, and a device information viewing function control corresponding to the two-dimensional virtual power transmission equipment model;

[0031] In response to a triggering operation on the device information viewing function control, displaying a device information interface corresponding to the device information viewing function control, and in the device information interface, displaying device information of the power transmission equipment corresponding to the device information viewing function control.

[0032] In a second aspect, the application further provides an augmented reality human-computer interaction device for power transmission equipment information, which comprises:

[0033] A device image acquisition module, configured to acquire a device image of a power transmission equipment whose device information is to be displayed;

[0034] A mode selection response module, configured to, in response to a selection operation on a display mode in a displayed mode selection interface, in a case where the display mode is an augmented reality display mode, acquire a real scene contained in the device image and a virtual power transmission equipment model associated with the power transmission equipment, and add the virtual power transmission equipment model to an augmented reality image with the real scene as a background;

[0035] A device information display module, configured to display the augmented reality image in a preset information viewing function interface, and if a triggering operation on a device information viewing function control contained in the information viewing function interface is detected, display device information matched with the device information viewing function control, which is acquired from device information associated with the virtual power transmission equipment model.

[0036] In a third aspect, the present application provides a computer device, comprising a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the method described above when executing the computer program.

[0037] In a fourth aspect, the present application provides a computer readable storage medium, which stores a computer program, and the computer program implements the steps of the method described above when executed by a processor.

[0038] The power transmission equipment information augmented reality human-computer interaction method, device and computer device described above acquire the equipment image of the power transmission equipment to be displayed; in response to the selection operation for the display mode in the displayed mode selection interface, in the case that the display mode is the augmented reality display mode, the real scene contained in the equipment image and the virtual power transmission equipment model associated with the power transmission equipment are acquired, and the virtual power transmission equipment model is added to the augmented reality image with the real scene as the background; the augmented reality image is displayed in the preset information viewing function interface, and if the triggering operation for the equipment information viewing function control contained in the information viewing function interface is detected, the equipment information matched with the equipment information viewing function control, which is acquired from the equipment information associated with the virtual power transmission equipment model, is displayed. Compared with the traditional technology, the two-dimensional virtual power transmission equipment model matched with the equipment image and the corresponding equipment information viewing function control are displayed in the augmented reality display mode with the real scene contained in the equipment image in the present application, which is beneficial for the staff to acquire and learn the equipment information of the power transmission equipment in the field of the power transmission equipment in the augmented reality display mode, thereby being beneficial for the staff to learn and work in the field, and further being capable of improving the field work efficiency and the ability of the staff to work in the field. BRIEF DESCRIPTION OF DRAWINGS

[0039] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the related art, the drawings needed to be used in the embodiments or the related art description will be briefly introduced. Obviously, the drawings in the following description only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained without creative labor on the basis of these drawings.

[0040] Figure 1 For a flowchart of the power transmission equipment information augmented reality human-computer interaction method in an embodiment;

[0041] Figure 2 For a schematic diagram of the information viewing function interface in an embodiment;

[0042] Figure 3 For a flowchart of the display equipment information step in an embodiment;

[0043] Figure 4 This is a flowchart illustrating the steps for checking and maintaining information in one embodiment;

[0044] Figure 5 This is a schematic diagram illustrating the sub-inspection and maintenance viewing function control window in one embodiment;

[0045] Figure 6 This is a schematic diagram illustrating the sub-inspection and maintenance viewing function control window in another embodiment;

[0046] Figure 7 This is a schematic diagram of the device introduction interface in one embodiment;

[0047] Figure 8 This is a schematic diagram of a display page for a three-dimensional virtual power transmission equipment model in one embodiment;

[0048] Figure 9 This is a schematic diagram of the information viewing function interface in preview mode in one embodiment;

[0049] Figure 10 This is a structural block diagram of an augmented reality human-computer interaction device for power transmission equipment information in one embodiment;

[0050] Figure 11 This is an internal structural diagram of a computer device in one embodiment. Detailed Implementation

[0051] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0052] In one exemplary embodiment, such as Figure 1 As shown, an augmented reality human-computer interaction method for power transmission equipment information is provided. This embodiment illustrates the method applied to a terminal. It is understood that this method can also be applied to a server, and further to a system including both a terminal and a server, and is implemented through interaction between the terminal and the server. In this embodiment, the method includes the following steps: S102 to S106. Wherein:

[0053] S102, Obtain the equipment image of the power transmission equipment whose equipment information is to be displayed.

[0054] The power transmission equipment can be DC power transmission equipment, such as a converter valve. The equipment image can be a photograph or scan of the power transmission equipment taken on-site. On-site photographing or scanning can refer to photographing or scanning power transmission equipment that is currently in operation.

[0055] Exemplarily, the terminal can acquire a device image of the power transmission device which needs to show the device information. For example, the user can take a photo or scan the power transmission device which needs to show the device information, and input the device image of the power transmission device taken or scanned to the terminal, the terminal identifies the power transmission device which needs to show the device according to the device image, and further the terminal can locate the power transmission device according to the device image, and can show the device information of the power transmission device in the form of augmented reality (AR).

[0056] In the implementation process, spatial positioning in complex environments is an important challenge in AR applications. Complex environments may contain a large number of objects, structures, obstructions, and dynamic changes, which can cause difficulties in spatial positioning for AR applications. Spatial positioning in complex environments can comprehensively use various technical means and strategies, which complement and improve each other, thereby achieving accurate spatial positioning in various environments. The AR positioning technology provided in the present application includes at least one of the following technologies:

[0057] SLAM positioning (Simultaneous Localization and Mapping): By recognizing and tracking feature points or feature regions in the environment and matching them with previously established maps, the spatial positioning of the camera can be achieved. Visual SLAM can estimate the position and attitude of the camera through consecutive image frames and accurately superimpose virtual content onto the actual scene.

[0058] Depth sensor positioning: Depth sensors (such as ToF cameras, structured light sensors, etc.) can provide distance information of objects in the scene. Combined with camera images, the position and attitude of objects can be more accurately inferred, thereby achieving more accurate spatial positioning.

[0059] Point cloud matching positioning: Point cloud is a set of discrete 3D points generated by 3D sensors or multiple perspective images. By matching the real-time acquired point cloud with the previously established point cloud map, the spatial positioning of the camera can be achieved. Point cloud matching can provide more stable and accurate spatial positioning results in complex environments.

[0060] Inertial Measurement Unit (IMU) positioning: IMU is a sensor combination that integrates an accelerometer and a gyroscope, which can measure the acceleration and angular velocity of the device. By combining IMU data and visual information, the robustness and accuracy of spatial positioning can be improved. IMU can be used to estimate the motion state of the device, thereby tracking the position in complex environments.

[0061] Landmark identification positioning: In complex environments, pre-identified landmarks or feature points can be used to assist spatial positioning. By identifying and tracking these landmarks, more reliable positioning information can be provided. Landmarks can be QR codes, AR markers, objects of specific shapes, etc. By identifying them and performing pose estimation, accurate positioning of the camera position can be achieved.

[0062] S104, in response to the selection operation of the display mode in the display mode selection interface, in the case of the display mode being an augmented reality display mode, obtaining a real scene contained in the device image and a virtual power transmission device model associated with the power transmission device, and adding the virtual power transmission device model to an augmented reality image with the real scene as the background.

[0063] Wherein, the mode selection interface can be an interface for selecting a display mode; the display mode can be an AR mode or a preview mode; the AR mode can be a mode for displaying power transmission device information in an AR manner. The preview mode can be a mode for displaying power transmission device information with a preset background. The augmented reality display mode can refer to the AR mode. The real scene contained in the device image can be an environmental object in the device image other than the power transmission device. The display background can be a rendering background of the AR mode. The information viewing function interface can be an interface for displaying information viewing function controls.

[0064] Illustratively, the terminal can display selection controls of the display mode in the mode selection interface, and the user can trigger the selection controls to select the corresponding display mode. The terminal can determine the display mode selected by the user in response to the display mode control triggered by the user in the mode selection interface. If the augmented reality display mode is selected by the user, the terminal can use the environmental object background contained in the device image as the rendering background of the augmented reality display mode, and display the information viewing function interface with the augmented reality display mode rendering background. The terminal can also obtain a pre-set virtual power transmission device model associated with the power transmission device, and add the virtual power transmission device model to the augmented reality image with the real scene as the background.

[0065] Further, in the augmented reality display mode, all interfaces can use the real scene contained in the device image as the display background. In this way, it is beneficial to display the device information of the power transmission device in an augmented reality (AR) manner, and to superimpose virtual device information on the real power transmission device, thereby improving the on-site learning ability and on-site operation efficiency of users or workers.

[0066] S106, display the augmented reality image in the preset information viewing function interface, and if a triggering operation on a device information viewing function control included in the information viewing function interface is detected, display device information matched with the device information viewing function control and obtained from the device information associated with the virtual power transmission device model.

[0067] The virtual power transmission device model can be a two-dimensional virtual model of the power transmission device. The device information viewing function control can be a function control for querying device information. For example, the device information viewing function control can include a device introduction viewing function control, a device maintenance viewing function control, a component structure viewing function control, and a remote training viewing function control.

[0068] For example, the terminal can display the augmented reality image in the information viewing function interface, that is, the virtual power transmission device model corresponding to the power transmission device matched with the device image can be displayed, and the device information viewing function control corresponding to the virtual power transmission device model can be displayed in the information viewing function interface. For example, the terminal can identify the device image photographed or scanned to obtain the power transmission device included in the device image, and can display the virtual model of the power transmission device in the information viewing function interface. The terminal can superimpose the virtual model of the power transmission device on the position of the power transmission device included in the device image, and can display the device information viewing function control possessed by the power transmission device on the virtual model of the power transmission device.

[0069] The user can trigger a selection operation of the device information viewing function control in the information viewing function interface to select the device information to be viewed. The terminal can display the device information interface corresponding to the selected device information viewing function control in response to the selection operation of the device information viewing function control triggered by the user in the information viewing function interface. For example, the terminal can jump from the information viewing function interface to the device information interface corresponding to the device information interface. The terminal can display the device information corresponding to the device information viewing function control and obtained from the device information associated with the virtual power transmission device model in the device information interface, which is the information of the power transmission device described above.

[0070] Optionally, as shown in Figure 2 The environment object 210, the environment object 220, the environment object 230, the environment object 240, the environment object 250, and the environment object 260 can be used as the display background in the augmented reality display mode, that is, the information viewing function interface can use the above environment objects as the display background. The two-dimensional virtual power transmission device model 260 and the device information viewing function control of the power transmission device, including the function control A, the function control B, and the function control C, can be displayed in the information viewing function interface.

[0071] Optionally, as Figure 2 As shown in the figure, the user can select any one of the function controls A, B, and C, for example, the user can select the function control A, and the terminal can display the device information interface corresponding to the function control A in response to the triggering operation of the function control A, and display the device information of the function control A in the device information interface corresponding to the function control A.

[0072] In this embodiment, the device image of the power transmission device to be displayed is obtained; in response to the selection operation of the display mode in the displayed mode selection interface, in the case of the augmented reality display mode as the display mode, the real scene contained in the device image and the virtual power transmission device model associated with the power transmission device are obtained, and the virtual power transmission device model is added to the augmented reality image with the real scene as the background; the augmented reality image is displayed in the preset information viewing function interface, and if the triggering operation of the device information viewing function control contained in the information viewing function interface is detected, the device information matched with the device information viewing function control is displayed from the device information associated with the virtual power transmission device model. Compared with the prior art, in this embodiment, the two-dimensional virtual power transmission device model matched with the device image and the corresponding device information viewing function control are displayed in the augmented reality display mode with the real scene contained in the device image, which is beneficial to the staff to obtain and learn the device information of the power transmission device in the field of the power transmission device in the augmented reality display mode, thereby facilitating the staff to learn and work on site, and thus the efficiency of on-site work can be improved, and the ability of the staff to work on site can be improved.

[0073] In one exemplary embodiment, the device information viewing function control includes a maintenance viewing function control;

[0074] As Figure 3 As shown in the figure, the device information matched with the device information viewing function control is displayed from the device information associated with the virtual power transmission device model, including S302 to S304, wherein:

[0075] S302, in response to the triggering operation of the maintenance viewing function control, a maintenance viewing interface is displayed, and a sub-maintenance viewing function control is displayed in the maintenance viewing interface;

[0076] S304, in response to the triggering operation of the sub-maintenance viewing function control, the maintenance information of the power transmission device matched with the sub-maintenance viewing function control is displayed from the device information associated with the virtual power transmission device model.

[0077] The maintenance and repair viewing function control can be a function control used to query maintenance and repair information of power transmission equipment. The maintenance and repair viewing interface can be an interface used to display maintenance and repair information. Sub-maintenance and repair viewing function controls can be sub-function controls of the maintenance and repair viewing function control. For example, the maintenance and repair viewing function control can include disassembly information viewing function controls, replacement information viewing function controls, test information viewing function controls, etc.

[0078] For example, the terminal can respond to a user's selection of a maintenance and repair viewing function control triggered by the information viewing function interface, displaying a maintenance and repair viewing interface. The terminal can display at least one sub-maintenance and repair viewing function control within this interface. For instance, for a power transmission device like a converter valve, the sub-maintenance and repair viewing function controls displayed on the interface could include thyristor disassembly, thyristor replacement, scheduled maintenance of the converter valve, and function control testing. The terminal can also display a return control within the maintenance and repair viewing interface that leads back to the information viewing function interface.

[0079] Users can trigger a selection operation for a sub-maintenance viewing function control, displaying the maintenance information corresponding to the selected sub-maintenance viewing function control. This maintenance information is the maintenance information for the aforementioned power transmission equipment. For example, a user can select the thyristor disassembly viewing function control, and the terminal can display the corresponding steps for thyristor disassembly. In some embodiments, the thyristor disassembly viewing function control may also include multiple sub-information viewing function controls for thyristor disassembly. For example, thyristor disassembly may also include drainage, valve tower equipment cleaning, valve tower equipment inspection, valve tower equipment testing, etc. Further selecting the above function control can display the relevant information of the above function control.

[0080] In this embodiment, by responding to a trigger operation on the maintenance and inspection viewing function control, the maintenance and inspection viewing interface can be displayed, and sub-maintenance and inspection viewing function controls can be displayed on the maintenance and inspection viewing interface. Furthermore, by responding to a trigger operation on the sub-maintenance and inspection viewing function control, the maintenance and inspection information of the power transmission equipment matched by the sub-maintenance and inspection viewing function control can be displayed, which is obtained from the equipment information associated with the virtual power transmission equipment model. In this way, the equipment information of the power transmission equipment can be displayed in the augmented reality display mode, which is beneficial to the on-site learning and on-site operation of the staff, thereby improving the efficiency of on-site operation and the ability of the staff to perform on-site operations.

[0081] In one exemplary embodiment, such as Figure 4As shown, in response to the triggering operation of the sub-overhaul maintenance viewing function control, the overhaul maintenance information of the power transmission equipment matched by the sub-overhaul maintenance viewing function control is displayed, which is obtained from the device information associated with the virtual power transmission equipment model, including S402 to S404, wherein:

[0082] S402, in response to the triggering operation of the sub-overhaul maintenance viewing function control, the overhaul maintenance step information of the power transmission equipment corresponding to the sub-overhaul maintenance viewing function control is displayed;

[0083] S404, in response to the step switching operation of the overhaul maintenance step information, the overhaul maintenance step information corresponding to the step switching operation is displayed.

[0084] The overhaul maintenance step information can be the step information of the overhaul maintenance. The step switching operation can be an operation of switching the step information of the overhaul maintenance, for example, the first step can be switched to the second step.

[0085] Exemplarily, the user can select the sub-overhaul maintenance viewing function control displayed in the overhaul maintenance viewing interface, and the terminal can switch the overhaul maintenance viewing interface to the overhaul maintenance information display interface in response to the triggering operation of the selected sub-overhaul maintenance viewing function control by the user. The terminal can display a plurality of overhaul maintenance step information corresponding to the sub-overhaul maintenance viewing function control in the overhaul maintenance information display interface, and the plurality of overhaul maintenance step information can be displayed in different windows. The terminal can switch the currently displayed window to the window corresponding to the step information selected by the user in response to the step switching operation of the overhaul maintenance step information, and can display the switched overhaul maintenance step information in the switched window.

[0086] Optionally, as shown in Figure 5 , 6 The terminal can display the information display window 510 of the sub-overhaul maintenance viewing function control in response to the triggering operation of the sub-overhaul maintenance viewing function control, and can display the overhaul maintenance step information of the power transmission equipment in the information display window 510. The user can trigger the switching operation of the overhaul maintenance step information of the power transmission equipment, and the terminal can switch the information display window 510 to the information display window 610 in response to the switching operation, and display the switched overhaul maintenance step information in the information display window 610.

[0087] In this embodiment, the sub-overhaul maintenance viewing function control can display the overhaul maintenance step information of the power transmission equipment corresponding to the sub-overhaul maintenance viewing function control in response to a triggering operation of the sub-overhaul maintenance viewing function control. Further, the overhaul maintenance step information corresponding to the step switching operation can be displayed in response to a step switching operation of the overhaul maintenance step information. In this way, the staff can understand each step information of the equipment overhaul maintenance, and the overhaul maintenance step information can be displayed more intuitively, thereby improving the on-site operation efficiency of the staff.

[0088] In one exemplary embodiment, the device information viewing function control includes a device introduction function control.

[0089] The device information matching the device information viewing function control is obtained from the device information associated with the virtual power transmission equipment model and displayed.

[0090] The device introduction interface corresponding to the device introduction function control is displayed in response to a triggering operation of the device introduction function control.

[0091] The video introduction information and the text introduction information of the power transmission equipment are displayed on the device introduction interface.

[0092] The device introduction function control can be a function control for querying the introduction information of the power transmission equipment. The device introduction interface can be an interface for displaying the device introduction information.

[0093] For example, the terminal can display the device introduction interface corresponding to the device introduction function control in response to a selection operation of the device introduction function control triggered by the user on the information viewing function interface. The terminal can display the video introduction information on the device introduction interface, and the user can trigger the video play control. The terminal can play the video and display the video introduction information in response to the video play operation triggered by the user. The video introduction information can be pre-stored video information. The terminal can also display the text introduction information on the device introduction interface.

[0094] Optionally, as shown in Figure 7 The terminal can display the video window 710 and the text window 720 of the power transmission equipment on the device introduction interface, and display the video introduction information in the video window 710 and the text introduction information in the video window 710.

[0095] In this embodiment, the device introduction interface corresponding to the device introduction function control can be displayed in response to a triggering operation of the device introduction function control. Further, the video introduction and the text introduction of the staff can be provided by displaying the video introduction information and the text introduction information of the power transmission equipment on the device introduction interface, which can enrich the diversity of the device introduction function control and improve the on-site operation efficiency of the staff.

[0096] In an example embodiment, the virtual power transmission equipment model is a two-dimensional virtual power transmission equipment model; and the device information matched with the device information viewing function control is displayed from the device information associated with the virtual power transmission equipment model, including:

[0097] In response to a triggering operation on the two-dimensional virtual power transmission equipment model, a three-dimensional virtual power transmission equipment model corresponding to the two-dimensional virtual power transmission equipment model is displayed;

[0098] In response to a shape transformation operation triggered on the three-dimensional virtual power transmission equipment model, the three-dimensional virtual power transmission equipment model after the shape transformation operation is displayed.

[0099] The three-dimensional virtual power transmission equipment model can be a three-dimensional virtual model of the power transmission equipment. The shape transformation operation can be a rotation, magnification, reduction, or the like.

[0100] For example, the user can click the two-dimensional virtual power transmission equipment model to trigger a command to display the three-dimensional virtual power transmission equipment model. The terminal can display a display page of the three-dimensional virtual power transmission equipment model in response to a triggering operation on the two-dimensional virtual power transmission equipment model in the information viewing function interface, and display the three-dimensional virtual power transmission equipment model corresponding to the two-dimensional virtual power transmission equipment model on the display page. The user can perform rotation, magnification, reduction, or the like on the three-dimensional virtual power transmission equipment model. The terminal can display the three-dimensional virtual power transmission equipment model after the shape transformation operation in response to a shape transformation operation triggered on the three-dimensional virtual power transmission equipment model.

[0101] Optionally, as shown in Figure 8 the terminal can display a display page of the three-dimensional virtual power transmission equipment model in response to a triggering operation on the two-dimensional virtual power transmission equipment model, and display the three-dimensional virtual power transmission equipment model 810 corresponding to the two-dimensional virtual power transmission equipment model on the page. The user can perform rotation, magnification, reduction, or the like on the three-dimensional virtual power transmission equipment model 810.

[0102] In this embodiment, the three-dimensional virtual power transmission equipment model corresponding to the two-dimensional virtual power transmission equipment model can be displayed in response to a triggering operation on the two-dimensional virtual power transmission equipment model, and the three-dimensional virtual power transmission equipment model after the shape transformation operation can be displayed in response to a shape transformation operation triggered on the three-dimensional virtual power transmission equipment model, which is beneficial for the staff to understand the structure of the power transmission equipment through AR on site, thereby improving the efficiency of on-site operation.

[0103] In an example embodiment, after displaying the three-dimensional virtual power transmission equipment model corresponding to the two-dimensional virtual power transmission equipment model, the method further includes:

[0104] In response to a triggering operation on the hierarchical display function control of the three-dimensional virtual power transmission equipment model, an identification control of a three-dimensional virtual sub-module contained in the three-dimensional virtual power transmission equipment model is displayed; the three-dimensional virtual sub-module is a three-dimensional virtual module corresponding to a component of the power transmission equipment;

[0105] In response to a triggering operation on the identification control, the three-dimensional virtual sub-module corresponding to the identification control is displayed.

[0106] In the embodiment, in response to a triggering operation on the hierarchical display function control of the three-dimensional virtual power transmission equipment model, an identification control of a three-dimensional virtual sub-module contained in the three-dimensional virtual power transmission equipment model can be displayed; further, in response to a triggering operation on the identification control, the three-dimensional virtual sub-module corresponding to the identification control can be displayed, which is beneficial for a staff to understand the components of the power transmission equipment through AR in the field, thereby improving the field operation efficiency of the staff.

[0107] For example, the terminal can display a floating label of a three-dimensional virtual sub-module contained in the three-dimensional virtual power transmission equipment model in response to a control corresponding to the hierarchical display function control clicked by the user. Further, the terminal can display the three-dimensional virtual sub-module matched with the floating label in response to a triggering operation of the floating label by the user.

[0108] In the embodiment, in response to a triggering operation on the hierarchical display function control of the three-dimensional virtual power transmission equipment model, an identification control of a three-dimensional virtual sub-module contained in the three-dimensional virtual power transmission equipment model can be displayed; further, in response to a triggering operation on the identification control, the three-dimensional virtual sub-module corresponding to the identification control can be displayed, which is beneficial for a staff to understand the components of the power transmission equipment through AR in the field, thereby improving the field operation efficiency of the staff.

[0109] In one example embodiment, the method further includes:

[0110] In response to a selection operation on the display mode in the displayed mode selection interface, in a case where the display mode is a preview mode, a preset background is used as a display background of the preview mode, and an information viewing function interface is displayed;

[0111] In the information viewing function interface, a two-dimensional virtual power transmission equipment model of the selected power transmission equipment and a device information viewing function control corresponding to the two-dimensional virtual power transmission equipment model are displayed;

[0112] In response to a triggering operation on the device information viewing function control, a device information interface corresponding to the device information viewing function control is displayed, and device information of the power transmission equipment corresponding to the device information viewing function control is displayed in the device information interface.

[0113] In the embodiment, the preview mode can be a mode for previewing a virtual model of the power transmission equipment. The preset background can be a preset solid color space background. The device information viewing function control in the preview mode can be the same as the device information viewing function control in the augmented reality display mode.

[0114] For example, the terminal can display a selection control for display modes in the mode selection interface. Users can trigger the selection control to choose the corresponding display mode. The terminal can respond to the user's triggering of the display mode control in the mode selection interface to determine the selected display mode. If the selected display mode is preview mode, a preset background can be used as the preview mode's display background, and the terminal can display information and view the functional interface using the preset background. Furthermore, in preview mode, all interfaces can use the preset background as their display background.

[0115] The terminal can display a two-dimensional virtual power transmission equipment model corresponding to the power transmission equipment selected by the user in the information viewing interface of the preview mode. The selected power transmission equipment can be identified by recognizing the equipment image. The terminal can also display the equipment information viewing function controls corresponding to the two-dimensional virtual power transmission equipment model in the information viewing interface. For example, the terminal can recognize the captured or scanned equipment image to obtain the power transmission equipment contained in the equipment image, and can display the virtual model of the power transmission equipment in the information viewing interface of the preview mode. The terminal can overlay the virtual model of the power transmission equipment onto the location of the power transmission equipment contained in the equipment image, and can display the equipment information viewing function controls of the power transmission equipment on the virtual model.

[0116] Users can select the desired device information from the device information viewing control within the preview mode's information viewing interface. The terminal responds to this selection by displaying the corresponding device information interface. For example, the terminal can navigate from the information viewing interface to the device information interface corresponding to the selected control, where it can display the device information associated with the aforementioned power transmission equipment.

[0117] Optionally, such as Figure 9 As shown, a preset background can be used as the display background in preview mode. The information viewing function interface can also use the preset background mentioned above as the display background. The information viewing function interface can display a two-dimensional virtual power transmission equipment model 260, as well as equipment information viewing function controls for the power transmission equipment. The equipment information viewing function controls include function control A, function control B, and function control C.

[0118] Optionally, the functional controls and information displayed in preview mode can be consistent with those displayed in augmented reality display mode. That is, Figure 3 , 4The steps shown can also be applied to implement the power transmission equipment information augmented reality human-computer interaction method in preview mode, Figures 5 to 8 The display function control shown can also be applied to implement the preview mode, and only the display background in the augmented reality display mode is replaced by the preset background of the preview mode.

[0119] In this embodiment, by responding to the selection operation for the display mode in the displayed mode selection interface, the preset background can be used as the display background of the preview mode when the display mode is the preview mode, and the information viewing function interface is displayed; the two-dimensional virtual power transmission equipment model of the selected power transmission equipment and the equipment information viewing function control corresponding to the two-dimensional virtual power transmission equipment model are displayed in the information viewing function interface; by responding to the triggering operation of the equipment information viewing function control, the equipment information interface corresponding to the equipment information viewing function control can be displayed, and the equipment information of the power transmission equipment corresponding to the equipment information viewing function control is displayed in the equipment information interface, which is beneficial to the staff to preview the virtual model of the power transmission equipment on site, thereby improving the on-site work efficiency of the staff.

[0120] In one exemplary embodiment, a power transmission equipment information augmented reality human-computer interaction method is provided, which can be applied to the display scene of the converter valve assembly.

[0121] By using AR recognition technology to recognize and track the real converter valve, edge computing can be used in AR applications to help reduce latency and improve user experience. For example, if a user is using an AR application to view virtual objects, edge computing can process most of the data on the local device without sending all the data to the cloud for processing. This can speed up data processing and make virtual objects appear faster, thereby improving user experience. In addition, edge computing can also be used to reduce the data transmission requirements of AR applications. By processing part of the data on the local device, the amount of data that must be sent to the cloud can be reduced, thereby saving bandwidth and reducing network load. By recognizing the appearance of the converter valve, relevant virtual information such as converter valve introduction, component structure, maintenance, and remote training can be superimposed on it.

[0122] An AR model of the converter valve can be established in advance. The AR model is a model that can be projected into the real world using a mobile phone or other device. Users can observe any details that can be seen from all angles without dead angles. Compared with traditional rendering of static frame models, there are strict requirements for the number of faces, and the least number of faces and texture resources are required to achieve the most realistic effect.

[0123] After establishing the AR model, the power transmission equipment information augmented reality human-computer interaction method provided above can be used to realize AR information display of the converter valve.

[0124] In this embodiment, by combining R technology with edge computing, we can realize real-time monitoring, fault prediction and intelligent maintenance of the converter valve assembly, effectively improving the reliability and maintenance efficiency of the equipment. Through the application of AR technology, paper-based data information and work conditions can be displayed in 3D visual form and displayed online through a mobile terminal. For inspection personnel, they can check equipment parameters, related information, etc. at any time and anywhere by identifying power transmission equipment through a mobile terminal; it is beneficial to save the time of workers.

[0125] It should be understood that, although each step in the flowchart involved in each embodiment as described above is displayed in sequence according to the arrow, these steps are not necessarily executed in the order indicated by the arrow. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and these steps can be executed in other orders. Moreover, at least part of the steps in the flowchart involved in each embodiment as described above can include multiple steps or stages, which are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily sequential, but can be executed alternately or alternately with at least part of other steps or steps or stages in other steps.

[0126] Based on the same inventive concept, the embodiments of the present application also provide a power transmission equipment information augmented reality human-computer interaction device for implementing the power transmission equipment information augmented reality human-computer interaction method described above. The problem-solving implementation scheme provided by the device is similar to the implementation scheme described in the above method, so the specific limitations in one or more power transmission equipment information augmented reality human-computer interaction device embodiments provided below can be referred to the limitations of the power transmission equipment information augmented reality human-computer interaction method described above, which will not be repeated here.

[0127] In one exemplary embodiment, as shown in Figure 10 A power transmission equipment information augmented reality human-computer interaction device is provided, comprising: a device image acquisition module 910, a selection mode response module 920, and a device information display module 930, wherein:

[0128] The device image acquisition module 910 is configured to acquire a device image of a power transmission equipment for which device information is to be displayed;

[0129] The selection mode response module 920 is configured to, in response to a selection operation for a display mode in a displayed mode selection interface, acquire a real scene contained in the device image and a virtual power transmission equipment model associated with the power transmission equipment in a case where the display mode is an augmented reality display mode, and add the virtual power transmission equipment model to an augmented reality image with the real scene as the background.

[0130] The device information display module 930 is configured to display the augmented reality image in the preset information viewing function interface, and display device information matched with the device information viewing function control and acquired from the device information associated with the virtual power transmission device model if a triggering operation on the device information viewing function control included in the information viewing function interface is detected.

[0131] In an exemplary embodiment, the device information viewing function control includes a maintenance viewing function control. The device information display module includes a sub-function control display unit and a maintenance information display unit.

[0132] The sub-function control display unit is configured to display a maintenance viewing interface and display a sub-maintenance viewing function control in the maintenance viewing interface in response to a triggering operation on the maintenance viewing function control. The maintenance information display unit is configured to display maintenance information of the power transmission device matched with the sub-maintenance viewing function control and acquired from the device information associated with the virtual power transmission device model in response to a triggering operation on the sub-maintenance viewing function control.

[0133] In an exemplary embodiment, the maintenance information display unit includes a step information display unit and a step information switching unit.

[0134] The step information display unit is configured to display maintenance step information of the power transmission device corresponding to the sub-maintenance viewing function control in response to a triggering operation on the sub-maintenance viewing function control. The step information switching unit is configured to display maintenance step information corresponding to a step switching operation on the maintenance step information.

[0135] In an exemplary embodiment, the device information viewing function control includes a device introduction function control. The device information display module includes an introduction interface display unit and a brief information display unit.

[0136] The introduction interface display unit is configured to display a device introduction interface corresponding to the device introduction function control in response to a triggering operation on the device introduction function control. The brief information display unit is configured to display video brief information and text brief information of the power transmission device in the device introduction interface.

[0137] In an exemplary embodiment, the device information display module includes a three-dimensional device display unit and a shape transformation display unit.

[0138] The three-dimensional device display unit is configured to display a three-dimensional virtual power transmission device model corresponding to a two-dimensional virtual power transmission device model in response to a triggering operation on the two-dimensional virtual power transmission device model. The shape transformation display unit is configured to display the three-dimensional virtual power transmission device model after a shape transformation operation in response to a triggering operation on the three-dimensional virtual power transmission device model.

[0139] In an exemplary embodiment, the device information display module further includes a sub-module identification display unit and a sub-module display unit.

[0140] The sub-module identification display unit is configured to display an identification control of a three-dimensional virtual sub-module included in the three-dimensional virtual power transmission device model in response to a triggering operation on a hierarchical display function control of the three-dimensional virtual power transmission device model. The three-dimensional virtual sub-module is a three-dimensional virtual module corresponding to a component included in the power transmission device. The sub-module display unit is configured to display the three-dimensional virtual sub-module corresponding to the identification control in response to a triggering operation on the identification control.

[0141] In an exemplary embodiment, the apparatus further includes a preview mode display module and a selected device display module.

[0142] The preview mode display module is configured to display an information viewing function interface with a preset background as a display background of a preview mode in response to a selection operation on a display mode in a displayed mode selection interface. The selected device display module is configured to display a two-dimensional virtual power transmission device model of a selected power transmission device and a device information viewing function control corresponding to the two-dimensional virtual power transmission device model in the information viewing function interface. The device information display module is configured to display a device information interface corresponding to the device information viewing function control in response to a triggering operation on the device information viewing function control, and display device information of the power transmission device corresponding to the device information viewing function control in the device information interface.

[0143] The above-mentioned modules in the power transmission device information augmented reality human-computer interaction apparatus can be realized by software, hardware, and combinations thereof, in whole or in part. The above-mentioned modules can be embedded in or independent of a processor in a computer device in hardware form, or stored in a memory in a computer device in software form, so as to be called and executed by a processor to perform operations corresponding to the above-mentioned modules.

[0144] In an exemplary embodiment, a computer device is provided, which can be a terminal, and an internal structure diagram of the computer device can be as shown in Figure 11The computer device shown in the figure includes a processor, a memory, an input / output interface, a communication interface, a display unit and an input device. Among them, the processor, the memory and the input / output interface are connected through a system bus, and the communication interface, the display unit and the input device are connected to the system bus through the input / output interface. Among them, the processor of the computer device is used to provide computing and control capability. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operating system and the computer program in the non-volatile storage medium to run. The input / output interface of the computer device is used to exchange information between the processor and external devices. The communication interface of the computer device is used to communicate with external terminals in a wired or wireless manner. The wireless manner can be realized through WIFI, mobile cellular network, NFC (near field communication) or other technologies. The computer program is executed by the processor to realize a power transmission device information augmented reality human-computer interaction method. The display unit of the computer device is used to form a visually visible picture, which can be a display screen, a projection device or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen. The input device of the computer device can be a touch layer overlaid on the display screen, or a key, trackball or touchpad arranged on the shell of the computer device, or an external keyboard, touchpad or mouse, etc.

[0145] Those skilled in the art can understand that, Figure 11 The structure shown in the figure is only a block diagram of part of the structure related to the scheme of the present application, and does not constitute a limitation on the computer device to which the scheme of the present application is applied. The specific computer device can include more or fewer components than those shown in the figure, or combine certain components, or have a different component arrangement.

[0146] In one embodiment, a computer device is also provided, including a memory and a processor, the memory storing a computer program, and the processor executing the computer program to realize the steps in each of the above method embodiments.

[0147] In one embodiment, a computer readable storage medium is provided, which stores a computer program, and the computer program is executed by a processor to realize the steps in each of the above method embodiments.

[0148] In one embodiment, a computer program product is provided, including a computer program, and the computer program is executed by a processor to realize the steps in each of the above method embodiments.

[0149] It should be noted that the user information (including but not limited to user equipment information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the present application are all information and data authorized by the user or authorized by all parties, and the collection, use and processing of related data need to comply with relevant regulations.

[0150] It can be understood by those skilled in the art that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing related hardware through a computer program. The computer program can be stored in a non-volatile computer readable storage medium, and when the computer program is executed, it can include the processes of the above-mentioned embodiments of each method. Any reference to memory, database or other medium used in the embodiments provided by the present application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (Read-Only Memory, ROM), magnetic tape, floppy disk, flash memory, optical storage, high-density embedded non-volatile memory, resistive memory (ReRAM), magnetoresistive random access memory (Magnetoresistive Random Access Memory, MRAM), ferroelectric memory (Ferroelectric Random Access Memory, FRAM), phase change memory (Phase Change Memory, PCM), graphene memory, etc. Volatile memory can include random access memory (Random Access Memory, RAM) or external cache memory, etc. As an illustration but not limitation, RAM can be in various forms, such as static random access memory (Static Random Access Memory, SRAM) or dynamic random access memory (Dynamic Random Access Memory, DRAM), etc. The database involved in the embodiments provided by the present application can include at least one of a relational database and a non-relational database. The non-relational database can include a distributed database based on a block chain, etc., without being limited thereto. The processor involved in the embodiments provided by the present application can be a general-purpose processor, a central processing unit, a graphics processing unit, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., without being limited thereto.

[0151] The technical features of the above embodiments can be combined in any way. In order to make the description simple, not all possible combinations of technical features in the above embodiments are described, but as long as the combination of technical features does not exist contradictory, it should be considered as the scope of the present application.

[0152] The above-described embodiments are merely illustrative of several embodiments of the present application, and the description is relatively specific and detailed, but should not be understood as a limitation on the scope of the patent. It should be noted that for those skilled in the art, without departing from the concept of the present application, a number of modifications and improvements can be made, which are all within the scope of the present application. Therefore, the scope of protection of the present application should be subject to the appended claims.

Claims

1. A power transmission equipment information augmented reality human-computer interaction method, characterized in that, The method comprises: acquiring a device image of a power transmission device to be displayed, identifying the power transmission device to be displayed according to the device image, and positioning the power transmission device by using multiple AR positioning technologies according to the device image; in response to a selection operation for a display mode in a mode selection interface of display, if the display mode is an augmented reality display mode, acquiring a real scene contained in the device image and a virtual power transmission device model associated with the power transmission device, and adding the virtual power transmission device model to an augmented reality image with the real scene as the background; the virtual power transmission device model is a two-dimensional virtual power transmission device model; displaying the augmented reality image in a preset information viewing function interface, and if a triggering operation for a device information viewing function control contained in the information viewing function interface is detected, displaying device information matched with the device information viewing function control, which is acquired from device information associated with the virtual power transmission device model; the display of the device information matched with the device information viewing function control, which is acquired from the device information associated with the virtual power transmission device model, comprises: in response to a triggering operation for the two-dimensional virtual power transmission device model, displaying a three-dimensional virtual power transmission device model corresponding to the two-dimensional virtual power transmission device model; in response to a triggering operation for a hierarchical display function control of the three-dimensional virtual power transmission device model, displaying an identification control of a three-dimensional virtual sub-module contained in the three-dimensional virtual power transmission device model; the three-dimensional virtual sub-module is a three-dimensional virtual module corresponding to a component contained in the power transmission device; the identification control comprises a label of the component; in response to a triggering operation for the identification control, displaying a three-dimensional virtual sub-module corresponding to the identification control.

2. The method of claim 1, wherein, The device information viewing function control comprises a maintenance viewing function control; the display of the device information matched with the device information viewing function control, which is acquired from the device information associated with the virtual power transmission device model, comprises: in response to a triggering operation for the maintenance viewing function control, displaying a maintenance viewing interface, and displaying a sub-maintenance viewing function control in the maintenance viewing interface; in response to a triggering operation for the sub-maintenance viewing function control, displaying maintenance information of the power transmission device matched with the sub-maintenance viewing function control, which is acquired from the device information associated with the virtual power transmission device model.

3. The method of claim 2, wherein, the display of the maintenance information of the power transmission device matched with the sub-maintenance viewing function control, which is acquired from the device information associated with the virtual power transmission device model in response to the triggering operation for the sub-maintenance viewing function control, comprises: in response to a triggering operation for the sub-maintenance viewing function control, displaying maintenance step information of the power transmission device corresponding to the sub-maintenance viewing function control; in response to a step switching operation for the maintenance step information, displaying maintenance step information corresponding to the step switching operation.

4. The method of claim 1, wherein, The device information viewing function control comprises a device introduction function control; The device information matched with the device information viewing function control is obtained from the device information associated with the virtual power transmission equipment model, and the device information is displayed. In response to a triggering operation on the device introduction function control, a device introduction interface corresponding to the device introduction function control is displayed. The device introduction interface displays video and text introduction information of the power transmission equipment.

5. The method of claim 1, wherein, After displaying the three-dimensional virtual power transmission equipment model corresponding to the two-dimensional virtual power transmission equipment model in response to the triggering operation on the two-dimensional virtual power transmission equipment model, the method further comprises: In response to a shape transformation operation triggered on the three-dimensional virtual power transmission equipment model, the three-dimensional virtual power transmission equipment model after the shape transformation operation is displayed.

6. The method according to any one of claims 1 to 5, characterized in that, The method further comprises: In response to a selection operation on a display mode in a displayed mode selection interface, in a case where the display mode is a preview mode, a preset background is used as a display background of the preview mode, and the information viewing function interface is displayed. The two-dimensional virtual power transmission equipment model of the selected power transmission equipment and the device information viewing function control corresponding to the two-dimensional virtual power transmission equipment model are displayed in the information viewing function interface. In response to a triggering operation on the device information viewing function control, a device information interface corresponding to the device information viewing function control is displayed, and device information of the power transmission equipment corresponding to the device information viewing function control is displayed in the device information interface.

7. A power transmission equipment information augmented reality human-machine interaction device, characterized in that, The device comprises: A device image acquisition module is configured to acquire a device image of a power transmission equipment whose device information is to be displayed, identify the power transmission equipment whose device information is to be displayed according to the device image, and perform positioning of the power transmission equipment by using multiple AR positioning technologies according to the device image. A selection mode response module is configured to, in response to a selection operation on a display mode in a displayed mode selection interface, in a case where the display mode is an augmented reality display mode, acquire a real scene contained in the device image and a virtual power transmission equipment model associated with the power transmission equipment, and add the virtual power transmission equipment model to an augmented reality image with the real scene as a background; the virtual power transmission equipment model is a two-dimensional virtual power transmission equipment model. A device information display module is configured to display the augmented reality image in a preset information viewing function interface, and if a triggering operation on a device information viewing function control contained in the information viewing function interface is detected, display device information matched with the device information viewing function control and obtained from device information associated with the virtual power transmission equipment model. The device information display module comprises: a three-dimensional device display unit, configured to display a three-dimensional virtual power transmission device model corresponding to the two-dimensional virtual power transmission device model in response to a triggering operation on the two-dimensional virtual power transmission device model; a sub-module identification display unit, configured to display an identification control of a three-dimensional virtual sub-module contained in the three-dimensional virtual power transmission device model in response to a triggering operation on a hierarchical display function control of the three-dimensional virtual power transmission device model; the three-dimensional virtual sub-module is a three-dimensional virtual module corresponding to a component contained in the power transmission device; the identification control comprises a label of the component; and a sub-module display unit, configured to display the three-dimensional virtual sub-module corresponding to the identification control in response to a triggering operation on the identification control.

8. A computer device comprising a memory and a processor, the memory storing a computer program, characterized in that, The computer program is executed by the processor to implement the steps of the method of any one of claims 1 to 6.

9. A computer readable storage medium having stored thereon a computer program, characterized in that, The computer program is executed by the processor to implement the steps of the method of any one of claims 1 to 6.

Images