Method and device for inspection in industrial environment, and medium

Abstract

The present application aims to provide a method and a device for inspection in an industrial environment, and a medium. The method comprises: acquiring from a network device augmented reality resource information corresponding to an inspection space corresponding to an industrial environment, the augmented reality resource information corresponding to the inspection space comprising one or more pieces of augmented reality content belonging to the inspection space, and position information of each piece of augmented reality content in the industrial environment, the one or more pieces of augmented reality content comprising inspection task information corresponding to one or more industrial devices in the industrial environment; and, on the basis of real-time pose information of a user in the industrial environment, and the position information of the one or more pieces of augmented reality content in the industrial environment, determining a real-time presentation position of the one or more pieces of augmented reality content in a real-life picture of a user device, and, on the basis of the real-time presentation position, superimposing and presenting at least one piece of augmented reality content in the real-life picture.

Description

Method, device and medium for inspection in industrial scene

[0001] This application is based on CN application number 202410481529.3, filed on April 19, 2024, and claims priority thereto, the disclosure of which is incorporated herein in its entirety. TECHNICAL FIELD

[0002] The present application relates to the field of communication, in particular to a technology for inspection in an industrial scene. BACKGROUND

[0003] Due to technical limitations, the traditional operation mode of the industrial scene in the prior art usually needs to scan the code of the equipment or the workstation first, and the system can only feedback the corresponding equipment information and operation information after identifying the equipment object. The whole process information is on the screen of the terminal, and there is a gap between the virtual and the real, which seriously breaks the continuity and smoothness of the work.

[0004] SUMMARY

[0005] An object of the present application is to provide a method, device and medium for inspection in an industrial scene.

[0006] According to an aspect of the present application, a method for inspection in an industrial scene is provided, the method comprising:

[0007] obtaining, from a network device, augmented reality resource information corresponding to an inspection space of the industrial scene, wherein the augmented reality resource information corresponding to the inspection space includes one or more augmented reality contents belonging to the inspection space and position information of each augmented reality content in the industrial scene, and the one or more augmented reality contents include inspection task information corresponding to one or more industrial devices in the industrial scene;

[0008] determining a real-time presentation position of the one or more augmented reality contents in a real scene picture of the user device according to real-time pose information of the user in the industrial scene and the position information of the one or more augmented reality contents in the industrial scene, and superimposing and presenting at least one augmented reality content in the real scene picture according to the real-time presentation position, wherein the user has entered the inspection space.

[0009] According to an aspect of the present application, a computer device for inspection in an industrial scene is provided, the device comprising:

[0010] a processor; and

[0011] a memory arranged to store computer executable instructions which, when executed, cause the processor to perform the following operations:

[0012] obtain, from a network device, augmented reality resource information corresponding to an inspection space of an industrial scene, wherein the augmented reality resource information corresponding to the inspection space comprises one or more augmented reality contents belonging to the inspection space and position information of each augmented reality content in the industrial scene, and the one or more augmented reality contents comprise inspection task information corresponding to one or more industrial devices in the industrial scene;

[0013] determine, according to real-time pose information of the user in the industrial scene and the position information of the one or more augmented reality contents in the industrial scene, a real-time presentation position of the one or more augmented reality contents in a live view picture of the user device, and superimpose and present at least one augmented reality content in the live view picture according to the real-time presentation position, wherein the user has entered the inspection space.

[0014] According to an aspect of the present application, a computer readable medium storing instructions is provided, which when executed cause a system to perform the following operations:

[0015] obtain, from a network device, augmented reality resource information corresponding to an inspection space of an industrial scene, wherein the augmented reality resource information corresponding to the inspection space comprises one or more augmented reality contents belonging to the inspection space and position information of each augmented reality content in the industrial scene, and the one or more augmented reality contents comprise inspection task information corresponding to one or more industrial devices in the industrial scene;

[0016] determine, according to real-time pose information of the user in the industrial scene and the position information of the one or more augmented reality contents in the industrial scene, a real-time presentation position of the one or more augmented reality contents in a live view picture of the user device, and superimpose and present at least one augmented reality content in the live view picture according to the real-time presentation position, wherein the user has entered the inspection space.

[0017] According to an aspect of the present application, a user device for inspection in an industrial scene is provided, which comprises:

[0018] a module configured to obtain, from a network device, augmented reality resource information corresponding to an inspection space of an industrial scene, wherein the augmented reality resource information corresponding to the inspection space comprises one or more augmented reality contents belonging to the inspection space and position information of each augmented reality content in the industrial scene, and the one or more augmented reality contents comprise inspection task information corresponding to one or more industrial devices in the industrial scene;

[0019] a second module configured to determine a real-time presentation position of the one or more augmented reality contents in a live scene picture of the user equipment according to real-time pose information of the user in the industrial scene and position information of the one or more augmented reality contents in the industrial scene, and superimpose and present at least one augmented reality content in the live scene picture according to the real-time presentation position, wherein the user has entered the inspection space.

[0020] Compared with the prior art, the application obtains augmented reality resource information corresponding to an inspection space of an industrial scene from a network device, wherein the augmented reality resource information corresponding to the inspection space includes one or more augmented reality contents belonging to the inspection space and position information of each augmented reality content in the industrial scene, and the one or more augmented reality contents include inspection task information corresponding to one or more industrial devices in the industrial scene; the real-time presentation position of the one or more augmented reality contents in a live scene picture of the user equipment is determined according to real-time pose information of the user in the industrial scene and position information of the one or more augmented reality contents in the industrial scene, and at least one augmented reality content is superimposed and presented in the live scene picture according to the real-time presentation position, wherein the user has entered the inspection space. The application can realize that a user-defined augmented reality content is superimposed and displayed around live devices of an industrial scene, and supports an inspection personnel to interact with the augmented reality content through a terminal, helps the inspection personnel to quickly understand device data information, device state information and inspection task information by displaying relevant business process data, real-time data and customized data in an inspection space, and creates an immersive live operation environment, so that a live operation mode of an industrial scene can be changed from a traditional device code scanning mode to a scene-based, spatialized and integrated operation mode. Through augmented reality technology, a traditional technical bottleneck is broken through, a virtual-real gap is bridged, a device code does not need to be scanned, an inspection personnel can roam in a live scene without feeling, the system automatically identifies a position where the person is and pushes corresponding device information and operation information nearby, all information is around the device, knowledge is in the live scene, and a high-efficiency operation and maintenance environment of virtual-real fusion and integration of people, scenes and data is created. Through augmented reality technology, data of each department, each system and each platform of an enterprise corresponding to an industrial scene is connected and accessed, and is all mapped to be presented around live devices. An inspection personnel no longer needs to go back and forth between multiple sites and log in to multiple systems, but can conveniently obtain knowledge and information around live devices, and what is seen is what is obtained, and all can be concentrated and visually presented in a live scene through augmented reality technology. BRIEF DESCRIPTION OF DRAWINGS

[0021] Other characteristics, objects and advantages of the application will become more apparent from the following detailed description of non-restrictive embodiments, made with reference to the accompanying drawings:

[0022] FIG. 1 illustrates a flow chart of a method for inspection in an industrial scenario, according to one embodiment of the present application;

[0023] FIG. 2 illustrates a structure diagram of a user equipment for inspection in an industrial scenario, according to one embodiment of the present application;

[0024] FIG. 3 illustrates an exemplary system that can be used to implement various embodiments described herein.

[0025] The same or similar reference numerals in the drawings denote the same or similar components. DETAILED DESCRIPTION

[0026] The present application is further described in detail by the following embodiments.

[0027] In one typical configuration of the present application, the terminal, the device of the service network and the trusted party each comprises one or more processors (e.g., a central processing unit (CPU)), an input / output interface, a network interface and a memory.

[0028] The memory can include a non-persistent memory, a random access memory (RAM), and / or a non-volatile memory, etc. in a computer readable medium, such as a read only memory (ROM) or a flash memory. The memory is an example of the computer readable medium.

[0029] Computer-readable media includes permanent and non-permanent, moveable and non- moveable media that can be implemented in any method or technology for storage of information, such as computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, without limitation, phase-change memory (PCM), programmable random access memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically-erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile discs (DVDs) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information for access by a computing device.

[0030] The device referred to in the present application includes but is not limited to a user device, a network device, or a device formed by integrating a user device and a network device through a network. The user device includes but is not limited to any kind of mobile electronic product capable of human-computer interaction (for example, human-computer interaction through a touch panel), such as a smart phone, a tablet computer, etc. The mobile electronic product can adopt any operating system, such as an Android operating system, an iOS operating system, etc. The network device includes an electronic device capable of automatically performing numerical calculation and information processing according to a pre-set or stored instruction. The hardware of the network device includes but is not limited to a microprocessor, an application specific integrated circuit (ASIC), a programmable logic device (PLD), a field programmable gate array (FPGA), a digital signal processor (DSP), an embedded device, etc. The network device includes but is not limited to a computer, a network host, a single network server, a plurality of network servers, or a cloud formed by a plurality of servers. The cloud is formed by a large number of computers or network servers based on cloud computing. The cloud computing is a kind of distributed computing, which is a virtual supercomputer formed by a group of loosely coupled computer clusters. The network includes but is not limited to the Internet, a wide area network, a metropolitan area network, a local area network, a VPN network, a wireless Ad Hoc network, etc. Preferably, the device can also be a program running on the user device, the network device, or a device formed by integrating a user device and a network device, a network device, a touch terminal, or a device formed by integrating a network device and a touch terminal through a network.

[0031] Of course, those skilled in the art should understand that the above device is only an example, and other existing or future devices, such as devices that can be applicable to the present application, should also be included in the protection scope of the present application, and are hereby included by reference.

[0032] In the description of the present application, the meaning of "a plurality of" is two or more, unless otherwise explicitly and specifically limited.

[0033] FIG. 1 shows a flowchart of a method for inspection in an industrial scene according to an embodiment of the present application, which includes steps S11 and S12. In step S11, a user device acquires augmented reality resource information corresponding to an inspection space of an industrial scene from a network device, wherein the augmented reality resource information corresponding to the inspection space includes one or more augmented reality contents belonging to the inspection space and position information of each augmented reality content in the industrial scene, and the one or more augmented reality contents include inspection task information corresponding to one or more industrial devices in the industrial scene; in step S12, the user device determines a real-time presentation position of the one or more augmented reality contents in a real scene picture of the user device according to real-time pose information of the user in the industrial scene and the position information of the one or more augmented reality contents in the industrial scene, and superimposes and presents at least one augmented reality content in the real scene picture according to the real-time presentation position, wherein the user has entered the inspection space.

[0034] In step S11, the user equipment obtains the augmented reality resource information corresponding to the inspection space of the industrial scene from the network equipment, wherein the augmented reality resource information corresponding to the inspection space includes one or more augmented reality contents belonging to the inspection space and position information of each augmented reality content in the industrial scene, and the one or more augmented reality contents include inspection task information corresponding to one or more industrial devices in the industrial scene. In some embodiments, the user equipment includes but is not limited to a mobile phone, an iPad / Pad, an AR smart wearable device (such as AR glasses), etc. In some embodiments, the industrial scene refers to a real physical space related to industry, such as a workshop scene, a factory scene, an industrial production line scene, etc. In some embodiments, the inspection space is a virtual space, and the inspection space includes one or more augmented reality contents (AR contents), such as a window containing text content, or a window containing interactive controls, or a window containing text content and interactive controls, or it can also be a picture, an icon, text content, a video, an audio, a free brush, a specific graph (such as a circle, a rectangle, etc.), a 3D model, a PDF document, a form, application calling information, real-time sensing information, etc., or any combination of the above. In some embodiments, the inspection space is created by a background staff on the network equipment (a background server / management platform corresponding to the user equipment), and an association (or a corresponding relationship) between the inspection space and the industrial scene is established (for example, by associating an anchor point of the industrial scene with the inspection space, wherein the anchor point is a reference basis for the position of all or part of the augmented reality contents in the augmented reality space, including pictures, point clouds, GIS coordinates, etc., such as a picture of a device in the industrial scene, a point cloud of a device or a production line in the industrial scene, or a GIS coordinate of the industrial scene, etc. are used as anchor points, and the anchor points are associated with the inspection space). In some embodiments, the background staff can create (for example, upload augmented reality contents, bind augmented reality contents, or generate augmented reality contents, etc.) and edit (for example, modify positions, enlarge, reduce, rotate, etc.) the augmented reality contents belonging to the inspection space in the network equipment, and set the position information of the augmented reality contents in the industrial scene, or the inspection staff (operation personnel) can also create and edit the augmented reality contents belonging to the inspection space on the user equipment, and set the position information of the augmented reality contents in the industrial scene, so that the augmented reality contents are superimposed and presented in the real scene picture corresponding to the inspection space.In some embodiments, the augmented reality resource information corresponding to the inspection space is obtained from the network device, the augmented reality resource information including one or more augmented reality contents included in the inspection space and position information of each augmented reality content in the industrial scene, the one or more augmented reality contents including inspection task information corresponding to one or more industrial devices in the industrial scene, the presentation form of the inspection task information being a window containing text content, in which only as an example, the inspection task information includes task-related information of one or more inspection tasks, each inspection task corresponding to at least one industrial device to be inspected in the task, and the task-related information of each inspection task including one or more of task item number, task name, device identification information of the industrial device bound to the task, task content, data type (quantitative or qualitative, etc.), state, inspection standard, operation result, exception note, attachment, etc. In some embodiments, the inspection task information further includes note information, and the user can click to view detailed notes (such as alpha item number note information, etc.) in part or all of the task details when performing the inspection task, and the note content is edited by the user through the background customization and supports the form of text and pictures. In some embodiments, the presentation window of the inspection task information displays the task-related information of the inspection task of only one industrial device at a time, and the user can sequentially view the task-related information of the inspection task of other industrial devices by performing an interactive operation (such as selecting other industrial devices, etc.) on the presentation window. In some embodiments, the presentation window of the inspection task information displays the task-related information of a specific number of inspection tasks at a time, and the user can sequentially view the task-related information of other inspection tasks by performing an interactive operation (such as page turning, etc.) on the presentation window. In some embodiments, the augmented reality resource information corresponding to the inspection space can be obtained from the network device in response to a download trigger operation performed by the user on the industrial scene, or the augmented reality resource information corresponding to the inspection space can be automatically obtained from the network device after detecting that the user enters the industrial scene, or the augmented reality resource information corresponding to the inspection space can be automatically obtained from the network device after the user enters the inspection space. In some embodiments, the user can manually select to enter the industrial scene or the inspection space, or the current real-time position of the user can be determined according to GPS, Bluetooth, WiFi, etc. positioning, or the current real-time position of the user can be determined by anchor point recognition on the real-time camera picture taken by the camera of the user device through a positioning algorithm (such as SLAM -simultaneous localization and mapping, VIO -visual odometry, VPS -visual positioning system, 2D recognition, etc.), and then it is determined whether the user is located in the physical space corresponding to the industrial scene or the inspection space according to the current real-time position, and then the user manually or automatically selects to enter the industrial space or the inspection space.

[0035] In step S12, the user equipment determines the real-time presentation position of the one or more augmented reality contents in the real scene picture of the user equipment according to the real-time pose information of the user in the industrial scene and the position information of the one or more augmented reality contents in the industrial scene, and presents at least one augmented reality content in the real scene picture according to the real-time presentation position, wherein the user has entered the inspection space. The presentation of at least one augmented reality content in the real scene picture can be that the display device of the user equipment displays the real scene picture captured by the camera of the user equipment, and presents the at least one augmented reality content on the real scene picture displayed by the display device (corresponding to the video see-through mode). In addition, the display device of the user equipment can not display the real scene picture captured by the camera of the user equipment, and the display device only presents the at least one augmented reality content, so that the user of the user equipment can see the real scene picture through the display device, thereby realizing the presentation of the at least one augmented reality content in the real scene picture (corresponding to the optical see-through mode). In some embodiments, when the user (i.e., the inspection personnel) has entered the inspection space, the real-time pose information of the user in the industrial scene can be obtained by using SLAM, VIO, VPS, 2D recognition and other positioning technologies and anchor point information corresponding to the inspection space based on the real-time camera picture captured by the camera of the user equipment. Here, the positioning technology can be recognized locally or through the cloud, for example, the user equipment sends the real-time camera picture to a network device, the network device performs feature extraction and pose estimation, and then sends the estimated result information to the user equipment. In some embodiments, the foregoing positioning technologies can be used alone or in combination, which is not limited herein. In some embodiments, the real-time presentation position of the one or more augmented reality contents in the real scene picture of the user equipment is determined according to the real-time pose information of the user in the industrial scene and the position information of the one or more augmented reality contents in the industrial scene, and then each augmented reality content is presented in the real scene picture according to the corresponding real-time presentation position. If the real-time presentation position of the augmented reality content is located outside the screen of the user equipment, the augmented reality content will not be displayed at present. In some embodiments, if the real-time pose information of the user in the industrial scene changes, the latest real-time presentation position of each augmented reality content in the real scene picture can be calculated in real time, and the display position of the augmented reality content in the screen is updated in real time according to the latest real-time presentation position. In some embodiments, the inspection space is suitable for the industrial equipment inspection and inspection operation of the inspection personnel in the industrial scene. When the inspection personnel enters the industrial scene, the inspection space can prompt, remind, guide and help the inspection personnel to complete the whole process of the inspection operation through the augmented reality content presented in the display screen of the user equipment, so that the knowledge is on site, the data is nearby, the operation is scene-based, and the process has a closed loop.

[0036] In some embodiments, the obtaining, from the network device, the augmented reality resource information corresponding to the inspection space of the industrial scene comprises any one of the following: in response to the user entering the industrial scene, obtaining, from the network device, the augmented reality resource information corresponding to one or more augmented reality spaces of the industrial scene, wherein the one or more augmented reality spaces comprise the inspection space; in response to the user entering the inspection space of the industrial scene, obtaining, from the network device, the augmented reality resource information corresponding to the inspection space; in response to a resource downloading operation performed by the user for the industrial scene, obtaining, from the network device, the augmented reality resource information corresponding to one or more augmented reality spaces of the industrial scene, wherein the one or more augmented reality spaces comprise the inspection space; and in response to a resource downloading operation performed by the user for the inspection space of the industrial scene, obtaining, from the network device, the augmented reality resource information corresponding to the inspection space. In some embodiments, for an industrial scene, a background staff can create one or more augmented reality spaces including the inspection space on the network device, and establish an association (or a corresponding relationship) between the one or more augmented reality spaces and the industrial scene (for example, associating (or corresponding) an A production line in the industrial scene with an A augmented reality space (such as associating an anchor point corresponding to the A production line with the A augmented reality space), associating (or corresponding) a B production line in the industrial scene with a B augmented reality space (such as associating an anchor point corresponding to the B production line with the B augmented reality space), or associating (or corresponding) an A device of a C production line in the industrial scene with an A augmented reality space, associating a B device with a B augmented reality space, etc., or associating (or corresponding) the same production line / device in the industrial scene with different augmented reality spaces, etc.), wherein the functions of the augmented reality spaces other than the inspection space are the same as or similar to those of the inspection space, which will not be described herein. In some embodiments, the user can trigger the downloading of the augmented reality resource information corresponding to the inspection space in a manual manner, for example, by clicking an industrial scene space resource downloading button in a user interface, the augmented reality resource information corresponding to one or more augmented reality spaces of the industrial scene is downloaded, thereby obtaining the augmented reality resource information corresponding to the inspection space, or by clicking a downloading button corresponding to the inspection space in the user interface, or the like.In some embodiments, the user can trigger the downloading of the augmented reality resource information corresponding to the inspection space in an automatic manner, for example, when the user enters an industrial scene (for example, the user manually selects to enter the industrial scene, or for example, the user carries the user equipment into the physical space corresponding to the industrial scene (for example, the user equipment matches the Bluetooth, GPS, WiFi, etc. corresponding to the physical space corresponding to the industrial scene through Bluetooth, GPS, WiFi, etc., or the user equipment recognizes the anchor point associated with the industrial scene, etc.), and then the user enters the industrial scene through manual or automatic means, etc.), the augmented reality resource information corresponding to one or more augmented reality spaces corresponding to the industrial scene is downloaded, so that the augmented reality resource corresponding to the inspection space is obtained, or when the user enters the inspection space (for example, the user manually selects to enter the inspection space, or for example, the user carries the user equipment into the physical space corresponding to the inspection space (for example, the user equipment matches the Bluetooth, GPS, WiFi, etc. corresponding to the physical space corresponding to the inspection space through Bluetooth, GPS, WiFi, etc., or the user equipment recognizes the anchor point associated with the inspection space, etc.), and then the user enters the inspection space through manual or automatic means, etc.), the augmented reality resource information corresponding to the inspection space is downloaded. In some embodiments, the way to enter the inspection space includes but is not limited to that the user manually selects to enter the inspection space in one or more augmented reality spaces corresponding to the industrial scene (subsequently positioned according to the anchor point of the inspection space), detects the current real-time position of the user equipment in the industrial scene, and if the current real-time position is located in the physical space corresponding to the inspection space, manually or automatically enters the inspection space, wherein if the physical space is associated with the inspection space and other augmented reality spaces, manually selects to enter the inspection space or automatically enters the augmented reality space with the highest priority (for example, the augmented reality spaces are sorted in advance based on a predetermined strategy, wherein the predetermined strategy can be sorted according to the access time, sorted according to the task relevance, sorted according to the priority, etc., which are only examples and are not limited) (subsequently positioned according to the anchor point of the inspection space), etc. In some embodiments, the current real-time position of the user equipment can be determined according to the GPS, Bluetooth, WiFi, etc. positioning, or the current real-time position of the user equipment can also be determined by an anchor point recognition of a real-time camera picture taken by a camera of the user equipment through a positioning algorithm (such as SLAM, VIO, VPS, 2D recognition, etc.), and then it is determined whether the user is located in the physical space corresponding to the industrial scene or the inspection space according to the current real-time position.In some embodiments, the industrial scene corresponding to the one or more augmented reality spaces including the inspection space corresponding to the augmented reality resource information can be automatically triggered from the network device after detecting that the user enters the industrial scene, or the inspection space corresponding to the augmented reality resource information can be automatically triggered from the network device after the user enters the inspection space, or the user can actively perform a resource download operation for the industrial scene (which can be before or after the user enters the industrial scene) to obtain the industrial scene corresponding to the one or more augmented reality spaces including the inspection space corresponding to the augmented reality resource information from the network device, or the user can actively perform a resource download operation for the inspection space (which can be before or after the user enters the inspection space) to obtain the inspection space corresponding to the augmented reality resource information from the network device.

[0037] In some embodiments, for each of the one or more augmented reality contents, if the following type corresponding to the augmented reality content is following screen, the position information of the augmented reality content in the industrial scene is the screen fixed presentation position corresponding to the augmented reality content; wherein, the step S12 comprises: for each of the augmented reality contents, if the following type corresponding to the augmented reality content is following screen, the augmented reality content is presented in the real scene picture according to the screen fixed presentation position corresponding to the augmented reality content, otherwise, the real-time presentation position of the augmented reality content in the real scene picture is determined according to the real-time pose information of the user in the industrial scene and the position information of the augmented reality content in the industrial scene, and the augmented reality content is presented in the real scene picture according to the real-time presentation position, wherein the user has entered the inspection space. In some embodiments, the background personnel can set the following type of each augmented reality content on the network equipment, and can set the following type as following screen (for example, set to be fixedly displayed at a certain position in the screen, such as the upper left corner of the screen, the lower left corner of the screen, the upper right corner of the screen, the lower right corner of the screen, the center of the screen, etc.). In some embodiments, if the following type corresponding to a certain augmented reality content is following screen, it is not necessary to calculate the real-time presentation position of the augmented reality content in the real scene picture according to the real-time pose information of the user, but directly present the augmented reality content on the real scene picture according to the screen fixed presentation position of the augmented reality content set by the background (i.e. present the augmented reality content on the real scene picture at the screen fixed presentation position in the display screen of the user equipment, so that the superposition position of the augmented reality content on the real scene picture is fixed), that is, the position of the augmented reality content on the screen is fixed and will not change with the real-time pose information of the user, if the following type corresponding to a certain augmented reality content is not following screen, the determination method of the real-time presentation position of the augmented reality content in the real scene picture is as described above, which will not be repeated, and the position of the augmented reality content on the screen is not fixed and will change with the real-time pose information of the user.

[0038] In some embodiments, the one or more augmented reality contents further comprise at least one of: inspection route information; inspection performance summary information; inspection location reminder information; device abnormality record information; device monitoring picture viewing information; device profile information; and device status information. In some embodiments, the inspection route information is route information overlaid in the industrial scene, such as a virtual arrow, to facilitate the user to perform the inspection task. In some embodiments, the inspection performance summary information is usually set at the starting position and the ending position of the user's inspection route in the industrial scene, and the inspection performance summary information comprises one or more of, but not limited to, the total number of planned inspection task items for the day, the number of uncompleted items, and at least one interactive button, and the user can select to batch process all quantitative items, select whether to submit the result of the inspection task for the day, etc. after inspecting the technology by triggering the interactive button. In some embodiments, the inspection location reminder information is used to remind the user at which position in the industrial scene the operation of a specific item (e.g., temperature measurement) in the inspection task can be performed, and in some embodiments, the inspection location reminder information can be a reminder identifier composed of a position reminder and a direction reminder, for example, reminding the user to go to the position of the position reminder and take a picture according to the direction reminder to complete the infrared temperature measurement item, and in other embodiments, the inspection location reminder information can also be a reminder identifier composed of only a position reminder, for example, reminding the user to go to the position of the position reminder and take a picture to complete the infrared temperature measurement item. The inspection location reminder information can help the inspection personnel to remember the accurate operation position (e.g., temperature measurement position) and operation direction (e.g., temperature measurement direction) of a specific item in the inspection task, thereby reducing the work pressure of the inspection personnel and making the inspection work more convenient and intelligent. In some embodiments, the execution result of the temperature measurement item can be synchronized to the inspection performance summary information, so that the user can view in the inspection performance summary information how many items related to infrared temperature measurement have been performed and how many have not been performed, and can jump to the corresponding page of the device management system in the inspection performance summary information to take a picture of the temperature measurement. In some embodiments, the device abnormality record information comprises the abnormality history of one or more industrial devices in the industrial scene, and the user can view the abnormality history of a certain device during the inspection, and in some cases, the user can also actively enter the abnormality of a certain device in the presentation window of the inspection task information during the inspection. In some embodiments, the device monitoring picture viewing information can be a piece of predetermined content text or an icon of a predetermined style, and the user can view the live monitoring probe picture by performing an access trigger operation thereon. In some embodiments, the device profile information comprises, but is not limited to, the basic profile of a certain industrial device in the industrial scene, the device drawing (which can be any business attribute file, supporting PDF and picture formats), the device hand order (which can be any business attribute file, supporting video format), and the device model (which can be any business attribute file, supporting three-dimensional model format).In some embodiments, the device status information includes, but is not limited to, the fault history of a certain industrial device in the industrial scene (device historical fault condition), the maintenance history (device historical maintenance condition), real-time parameters, real-time alarm results, historical curves (device historical operation curve), abnormal state (if the device is in one or more of the "abnormal processing" state, preferably, the corresponding display window color or animation change display, highlighting whether the device in the certain item of the inspection task is in abnormal processing), etc. In some embodiments, one or more augmented reality contents of the inspection space can be independently presented respectively, each of which is presented in the real scene picture according to the position in the industrial scene, and part of the augmented reality contents can be combined and presented according to a certain strategy, for example, the three augmented reality contents of the inspection task information, the device information and the device status information are combined and presented in the real scene picture in the form of a three-screen combination, which is not limited herein. In some embodiments, one or more augmented reality contents can be presented simultaneously or sequentially, for example, gradually presented with the change of the position of the user device in the industrial scene, or another or more augmented reality contents are presented or hidden according to the triggering action (such as clicking, voice call, specific gesture instruction, etc.) of the user to a certain augmented reality content or the satisfaction of a predetermined event, etc. In some embodiments, one or more augmented reality contents can be obtained by editing in the real scene picture or in the background, for example, the augmented reality content can be directly edited and determined in the editor in the background (for example, adding a window in the editor and inputting a text or placing a picture in the window, etc.), or the real-time update can be realized by accessing other management systems or information systems and binding the industrial device (for example, adding a window in the editor, and the content of the window is updated by obtaining the data of the bound industrial device from the device management system, etc.), which is not limited herein.

[0039] In some embodiments, the one or more augmented reality contents further include device information and device status information, and the inspection task information, the device information and the device status information are superimposed and presented in the real scene picture in the form of a three-screen combination. In some embodiments, the number of inspection task information, device information and device status information windows is consistent, and the inspection task information, device information and device status information are simultaneously presented in the real scene picture near one or more industrial devices in the form of a three-screen combination. The three-screen combination refers to the display windows corresponding to the three information are arranged in sequence and displayed in a certain direction (for example, the horizontal direction of the screen or the vertical direction of the screen), for example, the left display window displays the device status information, the middle display window displays the inspection task information, and the right display window displays the device information.

[0040] In some embodiments, the one or more augmented reality contents further include device profile information and device status information, and the inspection task information, the device profile information, and the device status information are superimposed in the real scene picture in a thumbnail presentation form; wherein the method further includes at least one of the following: if the distance between the user and the augmented reality content presented in the thumbnail presentation form is less than or equal to a predetermined threshold, the augmented reality content presented in the thumbnail presentation form is changed to be presented in the real scene picture in a three-screen presentation form; if the user performs an access trigger operation on the augmented reality content presented in the thumbnail presentation form, the augmented reality content presented in the thumbnail presentation form is changed to be presented in the real scene picture in a three-screen presentation form. In some embodiments, the inspection task information, the device profile information, and the device status information are combined and presented in the thumbnail presentation form near one or more industrial devices in the real scene picture, without directly presenting the specific content of the three information, for example, the three information are combined and presented in the real scene picture in the form of a small circle, a small square, or other icon styles. In some embodiments, if the distance between the user and the augmented reality content (i.e., the inspection task information, the device profile information, and the device status information) combined and presented in the thumbnail presentation form is less than or equal to a predetermined threshold, the three information are changed to be simultaneously presented in the real scene picture in a three-screen presentation form, or if the user performs an access trigger operation (e.g., a click operation) on the augmented reality content (i.e., the inspection task information, the device profile information, and the device status information) combined and presented in the thumbnail presentation form, the three information are changed to be simultaneously presented in the real scene picture in a three-screen presentation form.

[0041] In some embodiments, the method further comprises: in response to a first interaction operation performed by the user on the inspection task information, the user equipment acquires task execution result information corresponding to the inspection task information input by the user, and sends the task execution result information to the network equipment. In some embodiments, the display window corresponding to the inspection task information includes at least one interactive button, and the user can perform an interaction operation (for example, clicking, checking, inputting, etc.) on the interactive button to input the task execution result information corresponding to the inspection task information. The task execution result information includes but is not limited to one or more of the following: a photo or video input by the user for a certain inspection task, confirmation information input by the user confirming completion of a certain inspection task, claim information input by the user claiming a certain inspection task, feedback information input by the user on abnormal record viewing, and task completion information input by the user on a certain inspection task, such as normal completion, incomplete, or abnormality (and note information for abnormality, which can be text and / or pictures, etc.). In some embodiments, the task execution result is synchronized to the device management system server, the third-party information system server (such as the device management center server, etc.), and / or the big data center server (IoT data) corresponding to the industrial scene through the forwarding of the network equipment, or the task execution result is directly synchronized to the device management system server, the third-party information system server (such as the device management center server, etc.), and / or the big data center server (IoT data) corresponding to the industrial scene.

[0042] In some embodiments, the industrial scene corresponds to one or more augmented reality spaces, and the one or more augmented reality spaces include the inspection space; and the method further includes: in response to a space switching operation performed by the user on the industrial scene, the user device ceases to present the inspection space in the live view, and superimposes at least one augmented reality content belonging to another augmented reality space other than the inspection space in the one or more augmented reality spaces in the live view. In some embodiments, a background staff can create one or more augmented reality spaces including the inspection space on a network device, and establish an association (or correspondence) between the one or more augmented reality spaces and the industrial scene, wherein the other augmented reality spaces other than the inspection space have the same or similar functions as the inspection space, which will not be described herein. In some embodiments, the user can perform a space switching operation on the industrial scene, and the inspection space is then ceased to be presented in the live view, i.e., all augmented reality contents belonging to the inspection space are ceased to be presented in the live view, and at least one augmented reality content belonging to another augmented reality space other than the inspection space in the one or more augmented reality spaces is superimposed in the live view. For example, the one or more augmented reality spaces are arranged in sequence, and the augmented reality contents in the augmented reality space behind the inspection space are superimposed in the live view. Alternatively, the user performs a space switching operation, such as manually selecting an augmented reality space in the one or more augmented reality spaces, and the augmented reality contents in the augmented reality space are superimposed in the live view. For example, the user device presents an entry (such as a floating window, etc.) or identification information corresponding to each augmented reality space, and the user clicks the entry or identification information corresponding to a certain augmented reality space to switch from the currently entered augmented reality space to the augmented reality space corresponding to the entry or identification information clicked by the user. Alternatively, the user performs a space switching operation, such as moving the user device to recognize an anchor point corresponding to another augmented reality space, and the user can select to enter any augmented reality space in the another augmented reality space, and at least one augmented reality content belonging to the augmented reality space is superimposed in the live view.

[0043] In some embodiments, the one or more augmented reality spaces further comprise at least one of: an initial desktop space; a maintenance work space; a free interaction space. In some embodiments, the entry / identification information corresponding to the plurality of augmented reality spaces are arranged and displayed on the user interface, and a message reminder can be realized at one or more entry / identification information, for example, an abnormal message quantity reminder is displayed at the floating window entry of the initial desktop space, and for another example, an unread message quantity reminder is displayed at the floating window entry corresponding to the free interaction space, when the message reminder is clicked, the message details can be viewed on the terminal screen, including viewing the message content, message location, message person and mobile phone number, and the message can be immediately handled (confirmed as read), and the viewing and confirming process can be completed without going to the site. In some embodiments, the augmented reality content in the initial desktop space comprises one or more of, but is not limited to, regional production information, regional hazard source prompt, regional display information, device sharing information, etc., and the user can understand the work start of the day, master the overview of the work area, and plan the overall work of the day by viewing the information in the initial desktop space, which is also suitable for display when a superior unit or a friend company visits. In some embodiments, the augmented reality content in the maintenance work space comprises one or more of, but is not limited to, maintenance work guidance (maintenance SOP steps), device state viewing, device data query, etc., and the maintenance work space is suitable for device maintenance personnel to perform device maintenance work, when the work personnel holds the terminal in front of the device to be maintained, the maintenance work space provides the basic data and state information of the device, and guides the entire maintenance process through the detailed SOP (standard operation procedure) with pictures and texts, which is particularly suitable for use when there is a complex and major maintenance event. In some embodiments, the augmented reality content in the free interaction space comprises one or more of, but is not limited to, work messages, shift information, etc., and the free interaction space is suitable for mutual communication among maintenance engineers, inspectors, and operation and maintenance personnel, and leaves traces of work reporting, work guidance, and shift, etc., in the free interaction space, the user can freely create space digital information using the terminal device (for example, through a drag-and-drop tool, etc.), leave messages for others, or leave space notes for himself, which can promote the work coordination relationship among the three roles and improve the overall team work efficiency.

[0044] In some embodiments, the common augmented reality content belonging to the one or more augmented reality spaces includes knowledge reminder information corresponding to one or more industrial devices in the industrial scene. In some embodiments, the common augmented reality content refers to augmented reality content that will be presented in any augmented reality space, and the common augmented reality content includes knowledge reminder information corresponding to one or more industrial devices in the industrial scene. The knowledge reminder information can be in the form of text, or in the form of an icon (for example, an arrow icon), or in the form of a picture, which is only an example and is not limited. By presenting the knowledge reminder information about a certain industrial device near the industrial device in the augmented reality space, the knowledge reminder function or warning function is achieved. Regardless of whether the user is a novice or an experienced person, the knowledge reminder can be seen globally when the user is processing work. When the user enters different augmented reality spaces from the user device, different augmented reality content is reproduced in the space, but the knowledge reminder always exists in the space. The knowledge reminder can be a label for a frequently malfunctioning bolt, or a label next to an observation device that needs to be observed. The knowledge reminder is derived from the experience of plant operation and management personnel, and the experience is left on site to empower people with knowledge.

[0045] In some embodiments, the one or more augmented reality spaces further include an initial desktop space, and the augmented reality content belonging to the initial desktop space includes at least one of the following: regional production information; regional hazard source prompt information; regional display information; device sharing information. In some embodiments, the regional production information includes but is not limited to one or more of rolling capacity, daily production, rolling rhythm, and other production information of a certain region / device / production line in the industrial scene, the regional hazard source prompt information is used to prompt the user that there is a hazard source in a certain region of the industrial scene, the regional display information includes but is not limited to display information (for example, temporary important notifications, a welcome word, etc.) that needs to be displayed in a certain region of the industrial scene, and the device sharing information includes device basic information of a certain industrial device in the industrial scene.

[0046] In some embodiments, the one or more augmented reality spaces further include a maintenance work space, and the augmented reality content belonging to the maintenance work space includes at least one of the following: maintenance work guidance information; device data information; device state information. In some embodiments, the device data information and the device state information have been described in detail above, and will not be described again here. In some embodiments, by presenting the maintenance work guidance information in the maintenance work space, guidance and help can be provided to the maintenance personnel. The maintenance work guidance information includes but is not limited to maintenance guidance content corresponding to a maintenance project, and the maintenance work guidance information can be presented in the form of pictures and text displayed page by page. The background personnel can edit the maintenance work guidance information on the network device, support uploading of text and picture content, and support step-by-step splitting and editing.

[0047] In some embodiments, the one or more augmented reality spaces further include a free interaction space, and the augmented reality content belonging to the free interaction space includes at least one of the following: device message information; device shift information. In some embodiments, when a user enters the free interaction space, the user will be presented with message information about a certain industrial device in the free interaction space, which is edited and generated in the free interaction space by other users who have previously entered the industrial scene and designated for the user to view, and / or shift information about a certain industrial device in the free interaction space, which is edited and generated in the free interaction space by other users who have previously entered the industrial scene. In some embodiments, the presentation style of the message information can be a window containing text content. In some embodiments, the shift information can include one or more of the following presentation styles of augmented reality content: a 3D model (such as an arrow, etc.), a line, a circle, a freehand brush, a label, an icon, a picture, an audio / video, a form, a window containing text content.

[0048] In some embodiments, the method further includes: if the device message information or the device shift information meets a preset condition, canceling the presentation of the message information or the device shift information in the real scene picture, so that after other users subsequently enter the free interaction space, the corresponding user devices of the other users will not present the device message information or the device shift information in the free interaction space. In some embodiments, the other users who edit and generate the message information or the shift information can set a corresponding disappearance preset condition (for example, disappear after being viewed by others, disappear after being clicked and confirmed by others, automatically disappear after a predetermined time period, etc.). In some embodiments, if the message information or the device shift information currently presented in the real scene picture meets the disappearance preset condition, the message information or the device shift information will be canceled in the real scene picture, and after that, the message information or the device shift information will not be presented in the real scene picture of the corresponding user devices of the other users when the other users subsequently enter the free interaction space.

[0049] In some embodiments, the method further comprises: obtaining, by the user device, first device message information and user identification information of a message object user designated by the user according to a message editing operation performed by the user in the free interaction space; determining first position information of the first device message information in the industrial scene according to position information of the first device message information on the real scene picture; and sending the first device message information, the first position information, and the user identification information to the network device, or sending the first device message information and the first position information to a user device corresponding to the message object user, so that the user device corresponding to the message object user presents the first device message information in the free interaction space according to the first position information after the message object user enters the free interaction space. In some embodiments, a user can perform a message editing operation in the free interaction space, input corresponding message information for a certain industrial device / region / production line, and set position information of the message information on the real scene picture. For example, in the free interaction space, the user views the real scene picture through the user device (for example, the display device of the user device displays the real scene picture captured by the camera, or the user can see the real scene picture through the display device of the user device), can quickly place a message window in the real scene picture through an AR toolkit provided in the free interaction space by an interaction instruction (for example, dragging and dropping on the real scene picture captured by the camera through a mouse or a gesture on the display device, or the user wears AR glasses and performs a gesture instruction in the real scene), and input corresponding message information in the message window. The position of the message window in the real scene picture (for example, the position finally determined by dragging and dropping on the real scene picture captured by the camera and superimposed and displayed, or the position finally determined by the user through a gesture instruction in the real scene) is the position information of the message information on the real scene picture. In some embodiments, the user can also select which other user(s) can view the message information (i.e., the user can designate user identification information of the message object user corresponding to the message information), or the user can also select a preset condition for disappearance of the message information (for example, disappearing after being viewed by others, disappearing after being clicked and confirmed by others, automatically disappearing after a predetermined time period, etc.).In some embodiments, the user equipment determines first position information (spatial position in the industrial scene) of the message information in the industrial scene according to the position information of the message information on the real scene picture, and then sends the message information, the first position information, and the user identifier information of the user specified as the message object user corresponding to the message information to the network equipment, or directly sends the message information and the first position information to the user equipment of the user specified as the message object user corresponding to the message information, so that the user equipment corresponding to the message object user subsequently enters the free interaction space, and the user equipment corresponding to the message object user superimposes and presents the message information on the real scene picture according to the first position information and real-time pose information of the user equipment corresponding to the message object user. In some embodiments, the message function in the industrial scene is better than information tools such as WeChat and QQ, and is more suitable for the needs of the operation site. The user can post the message near the corresponding industrial equipment or near the specified area, so that the message content is close to reality. When the other party reproduces the augmented reality content near the message position through the terminal, the message content can be seen, and the user can experience it in person. In some embodiments, the message function of the free interaction space provides the user with a function of freely editing the on-site space at any time and anywhere, and leaves process traces on the site. This function is suitable for maintenance engineers to guide the work of inspection and maintenance personnel, and is also suitable for operation personnel to report work to maintenance engineers. The message can be checked through the network equipment to trace the source.

[0050] In some embodiments, the method further comprises: obtaining, by the user device, first device handover information according to a handover editing operation performed by the user in the free interaction space; determining second position information of the first device handover information in the industrial device scene according to position information of the first device handover information on the real scene picture; and sending the first device handover information and the second position information to a user device corresponding to a network device or other user, so that the user device corresponding to the other user presents the first device handover information in the free interaction space according to the second position information after the other user enters the free interaction space. In some embodiments, the user can perform a handover editing operation in the free interaction, and input corresponding handover information for an industrial device. For example, the user views a real scene picture in the free interaction space (for example, the display device of the user device displays a real scene picture taken by a camera, or the user can see the real scene picture through the display device of the user device), and places a handover information in the real scene picture in the free interaction space by using an AR toolkit provided in the free interaction space through an interaction instruction (for example, dragging and dropping on the real scene picture taken by the camera displayed on the display device by using a mouse or a gesture, or the user wears AR glasses and performs a gesture instruction in the real scene space). In some embodiments, the user device determines second position information (a spatial position in the industrial scene) of the handover information in the industrial scene according to position information of the handover information on the real scene picture, and then sends the handover information and the second position information to a network device, so that the user device of the other user presents the handover information on the real scene picture according to the second position information and real-time pose information of the user device of the other user after the other user enters the free interaction space, that is, the user device of the other user reproduces the handover information added by the user before, and the other user can view the detailed content of the handover, so as to seamlessly connect to the work.

[0051] In some embodiments, the network device has bound at least one of the one or more augmented reality contents to at least one industrial device in the industrial scene, and the network device acquires the at least one augmented reality content according to device identification information of the at least one industrial device.In some embodiments, at least one of the one or more augmented reality contents has established a binding relationship with at least one industrial device in the industrial scene, and there is an augmented reality content that has not established a binding relationship with any industrial device. A background staff can establish a binding relationship between a certain augmented reality content in the inspection space and the device identification information of a certain industrial device or certain industrial devices in the industrial scene on the network device, for example, in the network device (management platform) / corresponding space editor, the user can add a certain augmented reality content (for example, the certain augmented reality content is a window) and edit the position, size, direction relationship between the anchor point or three-dimensional model corresponding to the industrial scene, can determine the spatial position information of the certain augmented reality content in the industrial scene, and bind the certain augmented reality content with the device identification information of the corresponding industrial device (such as binding the window with a certain industrial device), so that the network device can pull the specific presentation content of the certain augmented reality content according to the device identification information of the industrial device bound with the augmented reality content from at least one of the device management system server, the third-party information system server (such as the management center server, etc.), and the big data center server corresponding to the industrial scene, for example, the content presented by the window is the data of the corresponding bound industrial device pulled from other servers, and can be continuously updated, for example, the device operation data of the industrial device in the device management system server is pulled as the specific presentation content of the augmented reality content bound with the industrial device, for example, the device basic information, abnormal history of a certain industrial device in the device management system is taken as the specific presentation content of the device shared information, message prompt, etc. augmented reality content in the initial desktop space; the today's plan item, item list, abnormal history, fault history, maintenance history, abnormal contact sheet, and device basic information of a certain industrial device in the device management system are taken as the specific presentation content of the inspection performance summary information, inspection task information, abnormal record, device state information fault history, maintenance history, abnormal state, and device data query basic information, etc. augmented reality content in the inspection space, or the IoT real-time data of the industrial device in the big data center server is pulled as the specific presentation content of the augmented reality content bound with the industrial device, for example, the production data of a certain industrial device in the big data center server is taken as the specific presentation content of the regional production information of the augmented reality content in the initial desktop space; the real-time state information (such as K-V value) of the device of a certain industrial device in the big data center server, real-time alarm, historical curve (such as motor temperature data trend chart, etc.) are taken as the specific presentation content of the real-time parameter, real-time alarm, and historical curve of the device state information in the inspection space, etc. augmented reality content.

[0052] In some embodiments, at least one of the one or more augmented reality contents is generated by a second user entering the industrial scene before and editing in the inspection space. The second user's user equipment determines the spatial position information of the at least one augmented reality content in the industrial scene according to the position information of the at least one augmented reality content in the real scene picture set by the second user. In some embodiments, a part of the augmented reality contents in the inspection space can be generated by a second user (i.e., an inspection personnel) entering the industrial scene before and editing in the real scene of the inspection space. For example, the second user views the real scene picture (e.g., the display device of the user equipment displays the real scene picture taken by the camera, or the user can see the real scene picture through the display device of the user equipment) through the user equipment, and places an augmented reality content in the real scene picture through the AR toolkit provided in the inspection space by interacting with the instruction (e.g., dragging and dropping on the real scene picture taken by the camera displayed on the display device by a mouse or a gesture, or the user equipment is AR glasses, and the user places the augmented reality content in the real scene by a gesture instruction). The spatial position information of the augmented reality content in the industrial scene is determined according to the position information of the augmented reality content finally determined for superimposed display in the real scene picture. Then, the second user equipment sends the augmented reality content and the spatial position information of the augmented reality content in the industrial scene to the corresponding network equipment.

[0053] In some embodiments, the network equipment establishes the association relationship between the inspection space and the anchor point corresponding to the industrial scene. In some embodiments, the background personnel can create the inspection space on the network equipment for the anchor point corresponding to the scanned industrial scene, so as to establish the association relationship between the inspection space and the industrial scene, or the background personnel can first create the inspection space on the network equipment, and then associate the inspection space with the anchor point corresponding to the scanned industrial scene, so as to establish the association relationship between the inspection space and the industrial scene. The anchor point is a reference basis for the position of all or part of the augmented reality contents in the augmented reality space, including pictures, point clouds, GIS coordinates, etc. For example, the picture of a certain device in the industrial scene, the point cloud of a certain device or production line in the industrial scene, or the GIS coordinates of the industrial scene are taken as the anchor point, and the anchor point is associated with the inspection space.

[0054] In some embodiments, at least one of the one or more augmented reality contents is generated by a third user on the network device for the inspection space, and the network device obtains position information of the at least one augmented reality content in the industrial scene set by the third user. In some embodiments, a part of the augmented reality contents in the inspection space can be generated by a third user (i.e., a backstage staff) on the network device for the inspection space, for example, the third user can enter the space editor corresponding to the inspection space by selecting the inspection space on the network device (such as a management platform, etc.), and the space editor presents the anchor points (such as pictures, point clouds, GIS coordinates, etc.) corresponding to the industrial scene associated with the inspection space or the three-dimensional model corresponding to the anchor points (such as the three-dimensional model or the dense point cloud model of the space corresponding to the anchor points, etc.). The third user can customize to add augmented reality contents (such as user uploading augmented reality contents or user selecting augmented reality contents from a resource list, etc.), and edit the position, size, and direction relationship between the editable augmented reality contents and the anchor points or the three-dimensional model. Optionally, the third user can also edit the events corresponding to the augmented contents, such as displaying or hiding another or more augmented reality contents after a certain augmented reality content is “clicked”, etc. Optionally, the third user can also edit the following types corresponding to the augmented contents, such as the following type of a certain augmented reality content is the screen (such as fixing the display of the augmented reality content at the upper left corner, lower left corner, center, upper right corner, and lower right corner of the user device display screen, etc.), etc. The network device can determine the spatial position information of the augmented reality content in the industrial scene according to the position, size, and direction relationship between the augmented reality content and the anchor points or the three-dimensional model set by the third user. In some embodiments, the network device / space editor can further bind a certain augmented reality content with the device identification information of the corresponding industrial equipment, so that the network device can pull the specific presentation content of the augmented reality content from at least one of the device management system server, the third-party information system server (such as a management center server, etc.), and the big data center server corresponding to the industrial equipment according to the device identification information of the industrial equipment bound with the augmented reality content, and the subsequent user device can identify the anchor points corresponding to the industrial scene, superimpose and present the specific presentation content of the augmented reality content from the data of the corresponding industrial equipment in other system servers, and can be continuously updated. In some embodiments, the space editor is an interactive editor of augmented reality contents and anchor points (or three-dimensional models), and after editing in the background space, the user device can reproduce the augmented reality contents in the live real scene environment (industrial scene).

[0055] In some embodiments, all backstage personnel can view the augmented reality content belonging to the inspection space on the network device, or only the backstage personnel with viewable role permissions of the inspection space can view the augmented reality content belonging to the inspection space on the network device. In some embodiments, all backstage personnel can edit the augmented reality content belonging to the inspection space on the network device, or only the backstage personnel with editable role permissions of the inspection space can edit the augmented reality content belonging to the inspection space on the network device. In some embodiments, on the backstage management page / space editor of the network device, the backstage personnel can create and edit the augmented reality content, for example, can create and edit the content in the "knowledge reminder" window, can create and edit the content in the "area danger source prompt" window, can create and edit the content in the "area display information" window, can create and edit the task-related information of one or more inspection tasks in the "inspection task information" window, and check which inspection tasks are "key inspection tasks", the marked key inspection tasks will be displayed in the "inspection task information" window with priority in order and with special marks, can create and edit the common standard speech text required for exception entry, for the on-site personnel to quickly enter the exception during the execution of the inspection task, can create and edit the device data information such as device drawings (PDF, picture files), hand orders (video files), and models (three-dimensional model files), can create and edit the maintenance items and maintenance contents in the maintenance operation guidance information, the maintenance contents support step-by-step editing page by page, and support the content form of text + picture, the user device can view the details page by page through user interaction in the "maintenance operation guidance information" window, and the creation and editing of the foregoing augmented reality content are only examples and are not limited. In some embodiments, the backstage personnel can pre-configure who will be frequently left a message in the message information in the free interaction space, and check from the complete user account information list (for example, obtained from other system servers, etc.), so that the inspection personnel do not need to select "who" to leave a message when leaving a message in the free interaction space of the user device. In some embodiments, the backstage personnel can view the history record of the message information in the free interaction space.

[0056] Fig. 2 shows a structure diagram of a user equipment for inspection in an industrial scene according to an embodiment of the present application, which comprises a first module 11 and a second module 12. The first module 11 is configured to acquire, from a network device, augmented reality resource information corresponding to an inspection space of the industrial scene, wherein the augmented reality resource information corresponding to the inspection space comprises one or more augmented reality contents belonging to the inspection space and position information of each augmented reality content in the industrial scene, and the one or more augmented reality contents comprise inspection task information corresponding to one or more industrial devices in the industrial scene. The second module 12 is configured to determine, according to real-time pose information of the user in the industrial scene and the position information of the one or more augmented reality contents in the industrial scene, a real-time presentation position of the one or more augmented reality contents in a live view picture of the user equipment, and present at least one augmented reality content in the live view picture according to the real-time presentation position, wherein the user has entered the inspection space.

[0057] The module 11 is configured to obtain, from a network device, augmented reality resource information corresponding to an inspection space of an industrial scene, wherein the augmented reality resource information corresponding to the inspection space comprises one or more augmented reality contents belonging to the inspection space and position information of each augmented reality content in the industrial scene, and the one or more augmented reality contents comprise inspection task information corresponding to one or more industrial devices in the industrial scene. In some embodiments, the user device includes, but is not limited to, a mobile phone, an iPad / Pad, an AR smart wearable device (such as AR glasses), and the like. In some embodiments, the industrial scene refers to a real physical space related to an industrial scene, such as a workshop scene, a factory scene, an industrial production line scene, and the like. In some embodiments, the inspection space is a virtual space, and the inspection space comprises one or more augmented reality contents (AR contents), such as a window comprising text content, or a window comprising interactive controls, or a window comprising text content and interactive controls, or a picture, an icon, text content, a video, audio, a freehand brush, a specific graphic (such as a circle, a rectangle, and the like), a 3D model, a PDF document, a form, application invocation information, real-time sensing information, or any combination thereof. In some embodiments, the inspection space is created by a background staff on a network device (a background server / management platform corresponding to the user device), and an association (or a corresponding relationship) between the inspection space and the industrial scene is established (for example, by associating an anchor point of the industrial scene with the inspection space, wherein the anchor point is a reference basis for a position of all or part of the augmented reality contents in the augmented reality space, including a picture, a point cloud, a GIS coordinate, or the like, such as a picture of a device in the industrial scene, a point cloud of a device or a production line in the industrial scene, or a GIS coordinate of the industrial scene, and the like). In some embodiments, the background staff can create (for example, upload augmented reality contents, bind augmented reality contents, or generate augmented reality contents, and the like) and edit (for example, modify a position, enlarge, reduce, rotate, and the like) the augmented reality contents belonging to the inspection space in the network device, and set position information of the augmented reality contents in the industrial scene, or the inspection staff (an operating staff) can create and edit the augmented reality contents belonging to the inspection space on the user device, and set position information of the augmented reality contents in the industrial scene, so that the augmented reality contents are superimposed and presented in a real scene picture corresponding to the inspection space.In some embodiments, the augmented reality resource information corresponding to the inspection space is obtained from the network device, the augmented reality resource information including one or more augmented reality contents included in the inspection space and position information of each augmented reality content in the industrial scene, the one or more augmented reality contents including inspection task information corresponding to one or more industrial devices in the industrial scene, the presentation form of the inspection task information being a window containing text content, in which only as an example, the inspection task information includes task-related information of one or more inspection tasks, each inspection task corresponding to at least one industrial device to be inspected in the task, and the task-related information of each inspection task including one or more of task item number, task name, device identification information of the industrial device bound to the task, task content, data type (quantitative or qualitative, etc.), state, inspection standard, operation result, exception note, attachment, etc. In some embodiments, the inspection task information further includes note information, and the user can click to view detailed notes (such as alpha item number note information, etc.) in part or all of the task details when performing the inspection task, and the note content is edited by the user through the background customization and supports the form of text and pictures. In some embodiments, the presentation window of the inspection task information displays the task-related information of the inspection task of only one industrial device at a time, and the user can sequentially view the task-related information of the inspection task of other industrial devices by performing an interactive operation (such as selecting other industrial devices, etc.) on the presentation window. In some embodiments, the presentation window of the inspection task information displays the task-related information of a specific number of inspection tasks at a time, and the user can sequentially view the task-related information of other inspection tasks by performing an interactive operation (such as page turning, etc.) on the presentation window. In some embodiments, the augmented reality resource information corresponding to the inspection space can be obtained from the network device in response to a download trigger operation performed by the user on the industrial scene, or the augmented reality resource information corresponding to the inspection space can be automatically obtained from the network device after detecting that the user enters the industrial scene, or the augmented reality resource information corresponding to the inspection space can be automatically obtained from the network device after the user enters the inspection space. In some embodiments, the user can manually select to enter the industrial scene or the inspection space, or the current real-time position of the user can be determined according to GPS, Bluetooth, WiFi, etc. positioning, or the current real-time position of the user can be determined by anchor point recognition on the real-time camera picture taken by the camera of the user device through a positioning algorithm (such as SLAM -simultaneous localization and mapping, VIO -visual odometry, VPS -visual positioning system, 2D recognition, etc.), and then it is determined whether the user is located in the physical space corresponding to the industrial scene or the inspection space according to the current real-time position, and then the user manually or automatically selects to enter the industrial space or the inspection space.

[0058] a second module 12 configured to determine a real-time presentation position of the one or more augmented reality contents in a live view of the user device according to real-time pose information of the user in the industrial scene and position information of the one or more augmented reality contents in the industrial scene, and superimpose and present at least one augmented reality content in the live view according to the real-time presentation position, wherein the user has entered the inspection space. The presentation of the at least one augmented reality content in the live view can be that the display device of the user device displays the live view captured by the camera of the user device, and superimposes and presents the at least one augmented reality content on the live view displayed by the display device (corresponding to a video see-through mode), or that the display device of the user device does not display the live view captured by the camera of the user device, and the display device only presents the at least one augmented reality content, so that the user of the user device can see the live view through the display device, thereby achieving the superimposition and presentation of the at least one augmented reality content in the live view (corresponding to an optical see-through mode). In some embodiments, when the user (i.e., the inspection personnel) has entered the inspection space, the real-time pose information of the user in the industrial scene can be obtained by using a positioning technology such as SLAM, VIO, VPS, 2D recognition, and anchor point information corresponding to the inspection space. Here, the positioning technology can be local recognition or cloud recognition. For example, the user device sends the real-time camera view to a network device, the network device performs feature extraction and pose estimation, and then sends the estimated result information to the user device. In some embodiments, the foregoing positioning technology can be used alone or in combination, which is not limited herein. In some embodiments, the real-time presentation position of the one or more augmented reality contents in the live view of the user device is determined according to the real-time pose information of the user in the industrial scene and the position information of the one or more augmented reality contents in the industrial scene, and then the augmented reality content is superimposed and presented in the live view according to the real-time presentation position corresponding to each augmented reality content. If the real-time presentation position corresponding to the augmented reality content is located outside the screen of the user device, the augmented reality content will not be displayed at present. In some embodiments, if the real-time pose information of the user in the industrial scene changes, the latest real-time presentation position of each augmented reality content in the live view is calculated in real time, and the display position of the augmented reality content in the screen is updated in real time according to the latest real-time presentation position. In some embodiments, the inspection space is suitable for the industrial equipment inspection and inspection operation of the inspection personnel in the industrial scene. When the inspection personnel enters the industrial scene, the inspection space can prompt, remind, guide, and help the inspection personnel to complete the whole process of the inspection operation through the augmented reality content presented in the display screen of the user device, so that the knowledge is on site, the data is nearby, the operation is scene-based, and the process is closed-loop.

[0059] In some embodiments, the obtaining, from the network device, the augmented reality resource information corresponding to the inspection space of the industrial scene comprises any one of the following: in response to the user entering the industrial scene, obtaining, from the network device, the augmented reality resource information corresponding to one or more augmented reality spaces of the industrial scene, wherein the one or more augmented reality spaces comprise the inspection space; in response to the user entering the inspection space of the industrial scene, obtaining, from the network device, the augmented reality resource information corresponding to the inspection space; in response to a resource downloading operation performed by the user for the industrial scene, obtaining, from the network device, the augmented reality resource information corresponding to one or more augmented reality spaces of the industrial scene, wherein the one or more augmented reality spaces comprise the inspection space; and in response to a resource downloading operation performed by the user for the inspection space of the industrial scene, obtaining, from the network device, the augmented reality resource information corresponding to the inspection space. Here, the related operations are the same as or similar to those of the embodiment shown in FIG. 1, and thus will not be described herein by way of introduction.

[0060] In some embodiments, for each augmented reality content of the one or more augmented reality contents, if the following type corresponding to the augmented reality content is follow screen, the position information of the augmented reality content in the industrial scene is the screen fixed presentation position corresponding to the augmented reality content; and the module 12 is configured to: for each augmented reality content, if the following type corresponding to the augmented reality content is follow screen, the augmented reality content is presented in the real scene picture according to the screen fixed presentation position corresponding to the augmented reality content, otherwise, the real-time presentation position of the augmented reality content in the real scene picture is determined according to the real-time pose information of the user in the industrial scene and the position information of the augmented reality content in the industrial scene, and the augmented reality content is presented in the real scene picture according to the real-time presentation position, wherein the user has entered the inspection space. Here, the related operations are the same as or similar to those of the embodiment shown in FIG. 1, and thus will not be described herein by way of introduction.

[0061] In some embodiments, the one or more augmented reality contents further comprise at least one of the following: inspection performance summary information; inspection position reminder information; device exception record information; device monitoring picture viewing information; device profile information; and device status information. Here, the related operations are the same as or similar to those of the embodiment shown in FIG. 1, and thus will not be described herein by way of introduction.

[0062] In some embodiments, the one or more augmented reality contents further include device profile information and device status information, and the inspection task information, the device profile information and the device status information are superimposed and presented in the real scene picture in a three-screen presentation form. Here, the related operations are the same as or similar to those of the embodiment shown in FIG. 1, and thus will not be described here in detail, and are hereby included in the present disclosure by reference.

[0063] In some embodiments, the one or more augmented reality contents further include device profile information and device status information, and the inspection task information, the device profile information and the device status information are superimposed and presented in the real scene picture in a thumbnail presentation form; and the method further includes at least one of the following: if the distance between the user and the augmented reality content presented in the thumbnail presentation form is less than or equal to a predetermined threshold, the augmented reality content presented in the thumbnail presentation form is changed to be presented in the real scene picture in the three-screen presentation form; and if the user performs an access triggering operation on the augmented reality content presented in the thumbnail presentation form, the augmented reality content presented in the thumbnail presentation form is changed to be presented in the real scene picture in the three-screen presentation form. Here, the related operations are the same as or similar to those of the embodiment shown in FIG. 1, and thus will not be described here in detail, and are hereby included in the present disclosure by reference.

[0064] In some embodiments, the device is further configured to: in response to a first interaction operation performed by the user on the inspection task information, acquire task execution result information corresponding to the inspection task information input by the user, and send the task execution result information to the network device. Here, the related operations are the same as or similar to those of the embodiment shown in FIG. 1, and thus will not be described here in detail, and are hereby included in the present disclosure by reference.

[0065] In some embodiments, the industrial scene corresponds to one or more augmented reality spaces, and the one or more augmented reality spaces include the inspection space; and the device is further configured to: in response to a space switching operation performed by the user on the industrial scene, cancel the presentation of the inspection space in the real scene picture, and superimpose and present at least one augmented reality content belonging to another augmented reality space other than the inspection space in the one or more augmented reality spaces in the real scene picture. Here, the related operations are the same as or similar to those of the embodiment shown in FIG. 1, and thus will not be described here in detail, and are hereby included in the present disclosure by reference.

[0066] In some embodiments, the one or more augmented reality spaces further include at least one of the following: an initial desktop space; a maintenance operation space; a free interaction space. Here, the related operations are the same as or similar to those of the embodiment shown in FIG. 1, and thus will not be described here in detail, and are hereby included in the present disclosure by reference.

[0067] In some embodiments, the common augmented reality content belonging to the one or more augmented reality spaces comprises knowledge reminding information corresponding to one or more industrial devices in the industrial scene. Here, the related operations are the same as or similar to those of the embodiment shown in FIG. 1, and thus are not described herein again by reference.

[0068] In some embodiments, the one or more augmented reality spaces further comprises an initial desktop space, and the augmented reality content belonging to the initial desktop space comprises at least one of the following: regional production information; regional hazard source prompt information; regional display information; device sharing information. Here, the related operations are the same as or similar to those of the embodiment shown in FIG. 1, and thus are not described herein again by reference.

[0069] In some embodiments, the one or more augmented reality spaces further comprises a maintenance operation space, and the augmented reality content belonging to the maintenance operation space comprises at least one of the following: maintenance operation guidance information; device material information; device state information. Here, the related operations are the same as or similar to those of the embodiment shown in FIG. 1, and thus are not described herein again by reference.

[0070] In some embodiments, the one or more augmented reality spaces further comprises a free interaction space, and the augmented reality content belonging to the free interaction space comprises at least one of the following: device message information; device shift information. Here, the related operations are the same as or similar to those of the embodiment shown in FIG. 1, and thus are not described herein again by reference.

[0071] In some embodiments, the device is further configured to: if the device message information or the device shift information meets a preset condition, cancel the presentation of the message information or the device shift information in the real scene picture, so that subsequent, when other users enter the free interaction space, the user device corresponding to the other users does not present the device message information or the device shift information in the free interaction space. Here, the related operations are the same as or similar to those of the embodiment shown in FIG. 1, and thus are not described herein again by reference.

[0072] In some embodiments, the device is further configured to: obtain first device message information and user identification information of a message object user specified by the user according to a message editing operation performed by the user in the free interaction space; determine first position information of the first device message information in the industrial scene according to position information of the first device message information on the real scene picture; and send the first device message information, the first position information, and the user identification information to the network device, or send the first device message information and the first position information to a user device corresponding to the message object user, so that the user device corresponding to the message object user presents the first device message information in the free interaction space according to the first position information after the message object user enters the free interaction space. Here, the related operations are the same as or similar to those of the embodiment shown in FIG. 1, and thus will not be described herein by way of introduction.

[0073] In some embodiments, the device is further configured to: obtain first device handover information according to a handover editing operation performed by the user in the free interaction space; determine second position information of the first device handover information in the industrial device scene according to position information of the first device handover information on the real scene picture; and send the first device handover information and the second position information to the network device or a user device corresponding to another user, so that the user device corresponding to the another user presents the first device handover information in the free interaction space according to the second position information after the another user enters the free interaction space. Here, the related operations are the same as or similar to those of the embodiment shown in FIG. 1, and thus will not be described herein by way of introduction.

[0074] In some embodiments, the network device has bound at least one augmented reality content of the one or more augmented reality contents to at least one industrial device in the industrial scene, and the network device acquires the at least one augmented reality content according to device identification information of the at least one industrial device. Here, the related operations are the same as or similar to those of the embodiment shown in FIG. 1, and thus will not be described herein by way of introduction.

[0075] In some embodiments, at least one augmented reality content of the one or more augmented reality contents is generated by a second user entering the industrial scene before and editing in the inspection space, and a user device corresponding to the second user determines position information of the at least one augmented reality content in the industrial scene according to position information of the at least one augmented reality content in a real scene picture set by the second user. Here, the related operations are the same as or similar to those of the embodiment shown in FIG. 1, and thus will not be described herein by way of introduction.

[0076] In some embodiments, the network device establishes an association between the inspection space and an anchor point corresponding to the industrial scene. Here, the related operations are the same as or similar to those of the embodiment shown in FIG. 1, and thus are not described herein in detail by way of reference.

[0077] In some embodiments, at least one of the one or more augmented reality contents is edited by a third user on the network device for the inspection space, and the network device acquires position information of the at least one augmented reality content in the industrial scene set by the third user. Here, the related operations are the same as or similar to those of the embodiment shown in FIG. 1, and thus are not described herein in detail by way of reference.

[0078] In addition to the methods and devices described in the above embodiments, the present application further provides a computer readable storage medium storing computer code, when the computer code is executed, the method of any one of the preceding embodiments is executed.

[0079] The present application further provides a computer program product, when the computer program product is executed by a computer device, the method of any one of the preceding embodiments is executed.

[0080] The present application further provides a computer device, the computer device comprising:

[0081] one or more processors;

[0082] a memory for storing one or more computer programs;

[0083] when the one or more computer programs are executed by the one or more processors, the one or more processors implement the method of any one of the preceding embodiments.

[0084] FIG. 3 shows an exemplary system that can be used to implement various embodiments described in the present application;

[0085] As shown in FIG. 3, in some embodiments, the system 300 can serve as any of the devices in the embodiments. In some embodiments, the system 300 can include one or more computer readable media (e.g., system memory or NVM / storage 320) having instructions and one or more processors (e.g., processor(s) 305) coupled with the one or more computer readable media and configured to execute the instructions to implement modules to perform the actions described in the present application.

[0086] For one embodiment, system control module 310 can include any suitable interface controllers to provide for any suitable interface to at least one of processor(s) 305 and / or any suitable device or component in communication with system control module 310.

[0087] System control module 310 can include a memory controller module 330 to provide an interface to system memory 315. Memory controller module 330 can be a hardware module, a software module, and / or a firmware module.

[0088] System memory 315 can be used to, for example, load and store data and / or instructions for system 300. For one embodiment, system memory 315 can include any suitable volatile memory, such as suitable DRAM. In some embodiments, system memory 315 can include double data rate type four synchronous dynamic random access memory (DDR4 SDRAM).

[0089] For one embodiment, system control module 310 can include one or more input / output (I / O) controller(s) to provide an interface to NVM / storage device 320 and communication interface(s) 325.

[0090] For example, NVM / storage device 320 can be used to store data and / or instructions. NVM / storage device 320 can include any suitable non-volatile memory (e.g., flash memory) and / or can include any suitable non-volatile storage device(s) (e.g., one or more hard disk drives (HDDs), one or more compact disk (CD) drives, and / or one or more digital versatile disk (DVD) drives).

[0091] NVM / storage device 320 can include a storage resource that is physically part of the device on which system 300 is installed or it can be accessed via the device but not necessarily physically part of the device. For example, NVM / storage device 320 can be accessed over a network via communication interface(s) 325.

[0092] Communication interface(s) 325 can provide an interface to system 300 to communicate over one or more networks and / or with any other suitable device. System 300 can wirelessly communicate with one or more components of a wireless network according to any of one or more wireless network standards and / or protocols.

[0093] For one embodiment, at least one of the processor(s) 305 can be packaged together with logic for one or more controllers of the system control module 310 (e.g., a memory controller module 330). For one embodiment, at least one of the processor(s) 305 can be packaged together with logic for one or more controllers of the system control module 310 to form a system in a package (SiP). For one embodiment, at least one of the processor(s) 305 can be fabricated together with logic for one or more controllers of the system control module 310 on the same die. For one embodiment, at least one of the processor(s) 305 can be fabricated together with logic for one or more controllers of the system control module 310 on the same die to form a system on a chip (SoC).

[0094] In various embodiments, the system 300 can be, but is not limited to, a server, a workstation, a desktop computing device, or a mobile computing device (e.g., a laptop computing device, a handheld computing device, a tablet, a netbook, etc.). In various embodiments, the system 300 can have more or less components, and / or different architectures. For example, in some embodiments, the system 300 includes one or more cameras, a keyboard, a liquid crystal display (LCD) screen (including touch screen displays), non- volatile memory port, multiple antennas, a graphics chip, an application specific integrated circuit (ASIC), and speakers.

[0095] In addition to the methods and devices described in the above embodiments, the present application also provides a computer readable storage medium, the computer readable storage medium storing computer code, when the computer code is executed, the method as any one of the preceding is executed.

[0096] The present application also provides a computer program product, when the computer program product is executed by a computer device, the method as any one of the preceding is executed.

[0097] The present application also provides a computer device, the computer device comprising:

[0098] one or more processors;

[0099] a memory for storing one or more computer programs;

[0100] when the one or more computer programs are executed by the one or more processors, the one or more processors implement the method as any one of the preceding.

[0101] It is noted that the present application can be implemented in software and / or in a combination of software and hardware, e.g., using application specific integrated circuits (ASIC), a general purpose computer or any other similar hardware devices. In one embodiment, the software program of the present application is implemented by the processor to perform the above-described steps or functions. Also, the software program of the present application (including related data structures) can be stored in a computer-readable recording medium, e.g., RAM memory, magnetic or optical drive or diskette, and so on. Additionally, some of the steps or functions can be implemented with hardware. For example, a circuitry can be used in place of software or in combination with software to perform some of the steps or functions.

[0102] In addition, some of the steps or functions can be implemented with hardware, e.g., as an integrated circuit, a processor, a programmable logic device, an ASIC, etc. Also, some of the steps or functions can be implemented with software, e.g., as a computer program, an application, a computer program product, etc. In one embodiment, the present application is implemented as a computer program product, e.g., a computer program tangibly embodied in a machine-readable storage medium, e.g., a memory, a magnetic or optical disk, etc. The computer program can be executed by a computer, e.g., a processor, a programmable logic device, an ASIC, etc. to implement some of the steps or functions.

[0103] Communication media includes any medium to facilitate the transfer of a computer program from one place to another. A storage medium can include one or more types of computer-readable storage media. Computer-readable storage media include, but are not limited to, volatile media, non-volatile media, and transmission media. Volatile media include dynamic memories, such as main memory. Non-volatile media include, for example, a hard disk, a magnetic disk, a magnetic tape, a CD-ROM, a DVD, Blu-Ray discs™, or any disk. Transmission media include coaxial cables, copper wire, and fiber optics, among others. Examples of transmission media include any physical medium that conveys information, such as a carrier wave, a modulated data signal, or a signal.

[0104] By way of example and not limitation, computer-readable storage media may include volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data. For example, computer-readable storage media include, but are not limited to, volatile memory, such as random access memory (RAM, DRAM, SRAM); and non-volatile memory, such as flash memory, various read-only memories (ROM, PROM, EPROM, EEPROM), magnetic and ferromagnetic / ferroelectric memories (MRAM, FeRAM); and magnetic and optical storage devices (hard disks, magnetic tapes, CDs, DVDs); or other media now known or later developed that can store computer-readable information / data for use by a computer system.

[0105] Here, according to one embodiment of the present application, a device is included, which includes a memory for storing computer program instructions and a processor for executing the program instructions, wherein, when the computer program instructions are executed by the processor, the device is triggered to run the methods and / or technical solutions based on the aforementioned multiple embodiments of the present application.

[0106] It is obvious to those skilled in the art that the present application is not limited to the details of the above-mentioned exemplary embodiments, and that the present application can be implemented in other specific forms without departing from the spirit or basic characteristics of the present application. Therefore, from any point of view, the embodiments should be regarded as exemplary and non-restrictive, and the scope of the present application is defined by the appended claims rather than the above description, and it is intended that all changes that fall within the meaning and scope of the equivalent elements of the claims are included in the present application. Any figure mark in the claims should not be regarded as limiting the claims involved. In addition, it is obvious that the word "comprising" does not exclude other units or steps, and the singular does not exclude the plural. Multiple units or devices stated in the device claim can also be implemented by one unit or device through software or hardware. Words such as first and second are used to indicate names and do not indicate any particular order.

Claims

1. A method for inspection in an industrial scene, applied to a user equipment, wherein, The method comprises: obtaining, from a network device, augmented reality resource information corresponding to an inspection space of an industrial scene, wherein the augmented reality resource information corresponding to the inspection space comprises one or more augmented reality contents belonging to the inspection space and position information of each augmented reality content in the industrial scene, and the one or more augmented reality contents comprise inspection task information corresponding to one or more industrial devices in the industrial scene; determining, according to real-time pose information of the user in the industrial scene and the position information of the one or more augmented reality contents in the industrial scene, a real-time presentation position of the one or more augmented reality contents in a live view picture of the user device, and superimposedly presenting at least one augmented reality content in the live view picture according to the real-time presentation position, wherein the user has entered the inspection space.

2. The method of claim 1, wherein, The method comprises: obtaining, from a network device, augmented reality resource information corresponding to an inspection space of an industrial scene, wherein the augmented reality resource information corresponding to the inspection space comprises one or more augmented reality contents belonging to the inspection space and position information of each augmented reality content in the industrial scene, and the one or more augmented reality contents comprise inspection task information corresponding to one or more industrial devices in the industrial scene; obtaining, from a network device, augmented reality resource information corresponding to an inspection space of an industrial scene, wherein the augmented reality resource information corresponding to the inspection space comprises one or more augmented reality contents belonging to the inspection space and position information of each augmented reality content in the industrial scene, and the one or more augmented reality contents comprise inspection task information corresponding to one or more industrial devices in the industrial scene; obtaining, from a network device, augmented reality resource information corresponding to an inspection space of an industrial scene, wherein the augmented reality resource information corresponding to the inspection space comprises one or more augmented reality contents belonging to the inspection space and position information of each augmented reality content in the industrial scene, and the one or more augmented reality contents comprise inspection task information corresponding to one or more industrial devices in the industrial scene; obtaining, from a network device, augmented reality resource information corresponding to an inspection space of an industrial scene, wherein the augmented reality resource information corresponding to the inspection space comprises one or more augmented reality contents belonging to the inspection space and position information of each augmented reality content in the industrial scene, and the one or more augmented reality contents comprise inspection task information corresponding to one or more industrial devices in the industrial scene.

3. The method of claim 1, wherein, For each augmented reality content in the one or more augmented reality contents, if a following type corresponding to the augmented reality content is screen following, the position information of the augmented reality content in the industrial scene is a screen fixed presentation position corresponding to the augmented reality content. The method comprises: For each augmented reality content in the one or more augmented reality contents, if a following type corresponding to the augmented reality content is screen following, the position information of the augmented reality content in the industrial scene is a screen fixed presentation position corresponding to the augmented reality content. For each augmented reality content in the one or more augmented reality contents, if a following type corresponding to the augmented reality content is screen following, the position information of the augmented reality content in the industrial scene is a screen fixed presentation position corresponding to the augmented reality content.

4. The method of claim 1, wherein, The one or more augmented reality contents further comprise at least one of: inspection route information; inspection performance summary information; inspection position reminding information; equipment exception record information; equipment monitoring picture viewing information; equipment profile information; equipment status information.

5. The method of claim 4, wherein, The one or more augmented reality contents further comprise equipment profile information and equipment status information, and the inspection task information, the equipment profile information and the equipment status information are superimposed and presented in the real scene picture in a three-screen presentation form.

6. The method of claim 4, wherein, The one or more augmented reality contents further comprise equipment profile information and equipment status information, and the inspection task information, the equipment profile information and the equipment status information are superimposed and presented in the real scene picture in a thumbnail presentation form. The method further comprises at least one of: if the distance between the user and the augmented reality content presented in the thumbnail presentation form in the industrial scene is less than or equal to a predetermined threshold, the augmented reality content presented in the thumbnail presentation form is changed to be presented in the real scene picture in the three-screen presentation form; if the user performs an access trigger operation on the augmented reality content presented in the thumbnail presentation form, the augmented reality content presented in the thumbnail presentation form is changed to be presented in the real scene picture in the three-screen presentation form.

7. The method of claim 1, wherein, The method further comprises: in response to a first interaction operation performed by the user on the inspection task information, obtaining task execution result information corresponding to the inspection task information input by the user, and sending the task execution result information to the network device.

8. The method of claim 1, wherein, The industrial scene corresponds to one or more augmented reality spaces, and the one or more augmented reality spaces comprise the inspection space; The method further comprises: in response to a space switching operation performed by the user on the industrial scene, canceling the presentation of the inspection space in the real scene picture, and superimposing and presenting at least one augmented reality content belonging to another augmented reality space other than the inspection space in the one or more augmented reality spaces in the real scene picture. The one or more augmented reality spaces further comprise at least one of:

9. The method of claim 8, wherein, an initial desktop space; a maintenance operation space; a free interaction space. The common augmented reality content belonging to the one or more augmented reality spaces comprises knowledge reminding information corresponding to one or more industrial devices in the industrial scene.

10. The method of claim 8 or 9, wherein, The one or more augmented reality spaces further comprise an initial desktop space, and the augmented reality content belonging to the initial desktop space comprises at least one of:

11. The method of claim 9, wherein, region production information; region danger source prompt information; region display information; equipment sharing information. The one or more augmented reality spaces further comprise a maintenance operation space, and the augmented reality content belonging to the maintenance operation space comprises at least one of:

12. The method of claim 9, wherein, maintenance operation guidance information; equipment profile information; equipment status information. The one or more augmented reality spaces further comprise a free interaction space, and the augmented reality content belonging to the free interaction space comprises at least one of:

13. The method of claim 9, wherein, equipment message information; equipment shift information. The method further comprises:

14. The method of claim 14 or 15, wherein, ​ If the device message information or the device shift information meets a preset condition, the device message information or the device shift information is cancelled in the real scene picture, so that after other users enter the free interaction space, the user device corresponding to the other users does not present the device message information or the device shift information in the free interaction space.

15. The method of claim 13, wherein, The method further comprises: According to a message editing operation performed by the user in the free interaction space, first device message information and user identifier information of a message target user specified by the user are obtained; According to position information of the first device message information on the real scene picture, first position information of the first device message information in the industrial scene is determined, and the first device message information, the first position information and the user identifier information are sent to the network device, or the first device message information and the first position information are sent to a user device corresponding to the message target user, so that after the message target user enters the free interaction space, the user device corresponding to the message target user presents the first device message information in the free interaction space according to the first position information.

16. The method of claim 13, wherein, The method further comprises: According to a shift editing operation performed by the user in the free interaction space, first device shift information is obtained; According to position information of the first device shift information on the real scene picture, second position information of the first device shift information in the industrial device scene is determined, and the first device shift information and the second position information are sent to the network device or a user device corresponding to other users, so that after other users enter the free interaction space, the user device corresponding to the other users presents the first device shift information in the free interaction space according to the second position information.

17. The method of claim 1, wherein, The network device has bound at least one of the one or more augmented reality contents to at least one industrial device in the industrial scene, and the network device acquires the at least one augmented reality content according to device identifier information of the at least one industrial device.

18. The method of claim 1, wherein, At least one of the one or more augmented reality contents is generated by a second user who enters the industrial scene before in the inspection space, and a user device corresponding to the second user determines spatial position information of the at least one augmented reality content in the industrial scene according to position information of the at least one augmented reality content in a real scene picture set by the second user.

19. The method of claim 1, wherein, The network device establishes an association relationship between the inspection space and an anchor point corresponding to the industrial scene.

20. The method of claim 19, wherein, At least one of the one or more augmented reality contents is generated by a third user in the network device for the inspection space, and the network device acquires position information of the at least one augmented reality content in the industrial scene set by the third user.

21. A computer device for patrolling in an industrial scene, wherein, The device comprises: A first module is configured to acquire, from a network device, augmented reality resource information corresponding to an inspection space of an industrial scene, wherein the augmented reality resource information corresponding to the inspection space comprises one or more augmented reality contents belonging to the inspection space and position information of each augmented reality content in the industrial scene, and the one or more augmented reality contents comprise inspection task information corresponding to one or more industrial devices in the industrial scene. A second module is configured to determine, according to real-time pose information of the user in the industrial scene and the position information of the one or more augmented reality contents in the industrial scene, a real-time presentation position of the one or more augmented reality contents in a live view of the user device, and superimpose and present at least one augmented reality content in the live view according to the real-time presentation position, wherein the user has entered the inspection space. The processor executes the computer program to implement the steps of the method according to any one of claims 1-20.

22. A computer device for inspection in an industrial scene, comprising a memory, a processor and a computer program stored on the memory, characterized in that, The computer program / instruction is executed by the processor to implement the steps of the method according to any one of claims 1-20.

23. A computer readable storage medium having stored thereon computer programs / instructions, characterized in that, The computer program is executed by the processor to implement the steps of the method according to any one of claims 1-20.

24. A computer program product comprising a computer program, characterized in that, ​

Images