Steel mill equipment operation and maintenance auxiliary system and method based on augmented reality and electronic equipment
Through the steel plant equipment operation and maintenance assistance system with augmented reality technology, remote guidance and training problems are solved, operation and maintenance efficiency and training effects are improved, and are suitable for complex steel plant equipment operation and maintenance environments.
Patent Information
- Application Number
- CN202310629924.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-05-30
- Publication Date
- 2024-12-03
Smart Images

Figure CN119071426A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of augmented reality technology, and in particular to an augmented reality technology-based steel plant equipment operation and maintenance auxiliary system, method and electronic equipment. Background Art
[0002] AR (augmented reality) technology is a technology that cleverly integrates virtual information with the real world. It widely uses a variety of technical means such as multimedia, three-dimensional modeling, real-time tracking and registration, intelligent interaction, and sensing. It simulates computer-generated virtual information such as text, images, three-dimensional models, music, and videos, and applies them to the real world. The two types of information complement each other, thereby achieving "enhancement" of the real world.
[0003] The operation and maintenance of steel plant equipment is characterized by complex equipment failures and high professionalism. When encountering problems in operation and maintenance, experts are often required to rush to the site to solve them. Since steel plants are distributed all over the country and some are even abroad, the equipment is dispersed and the distance is far. There are often not many equipment operation and maintenance experts within the company. When encountering equipment fault diagnosis and maintenance problems, it is often difficult to solve them as soon as possible, which prolongs the time for troubleshooting and handling, resulting in low operation and maintenance efficiency.
[0004] In addition, as the issue of technology inheritance faced by retired personnel becomes increasingly prominent, building a comprehensive technical knowledge base has become one of the issues that need to be solved urgently. New employees also need pre-job skills training. Traditional training methods have certain shortcomings, such as limited teacher resources and high teaching aid costs; the explanation of complex knowledge is not vivid enough, with little theory and practical operation; lack of intuitive experience, and the training effect is not ideal.
[0005] In order to solve these problems, various types of auxiliary systems have emerged in recent years. However, in practical applications, these systems still have certain limitations. For example, when expert remote guidance is required in some cases, it is difficult for on-site operators to accurately understand the guidance content and operation process of the remote instructor. Therefore, a new, efficient and flexible auxiliary system is needed to overcome the above limitations and better assist users in completing various tasks. Summary of the invention
[0006] The purpose of the present application is to provide an augmented reality-based steel plant equipment operation and maintenance auxiliary system, method and electronic equipment, which are used to solve the problem in the prior art that remote guidance cannot be well implemented during steel plant equipment maintenance.
[0007] In the first aspect, the present application provides an augmented reality-based steel plant equipment operation and maintenance assistance system, which includes: a remote expert guidance module, an augmented reality module, a data acquisition module, and a communication module; the data acquisition module is used to obtain the real-time scene on site; the augmented reality module is used to call the virtual information of the model, and superimpose and merge the virtual information with the real-time scene on site to form an augmented reality picture; the remote expert guidance module is used to determine the corresponding remote guidance personnel, and send the augmented reality picture to the remote guidance personnel, so that the remote guidance personnel can perform remote guidance operations on the augmented reality picture; the communication module is used to receive the remote guidance operations of the remote guidance personnel on the augmented reality picture, so as to realize the transmission of communication information between the remote guidance personnel and the on-site operators.
[0008] In an implementation of the first aspect, the steel plant equipment operation and maintenance auxiliary system based on augmented reality also includes an equipment model browsing module; the equipment model browsing module is used to implement the remote guidance operation of the remote guidance personnel on the augmented reality screen.
[0009] In an implementation manner of the first aspect, the remote guidance operation includes: translating, rotating, and splitting the augmented reality screen.
[0010] In an implementation of the first aspect, the steel plant equipment operation and maintenance assistance system based on augmented reality also includes a training module; the training module is used to convert the equipment maintenance process into a virtual simulation resource based on prefabricated augmented reality virtual simulation content to guide on-site operators to learn.
[0011] In an implementation manner of the first aspect, the communication information includes text, pictures, videos and voice messages.
[0012] In an implementation of the first aspect, the steel plant equipment operation and maintenance auxiliary system based on augmented reality also includes a model library module; the model library module is used to store virtual information of the model and store expert data information.
[0013] On the second aspect, the present application also provides an augmented reality-based steel plant equipment operation and maintenance assistance method, the method comprising: obtaining a real-time on-site scene; calling virtual information in a model library, and superimposing and integrating the virtual information with the real-time on-site scene to form an augmented reality picture; determining a remote guidance personnel, and sending the augmented reality picture to a remote guidance terminal, so that the remote guidance personnel receives the augmented reality picture and performs remote guidance operations on the augmented reality picture; receiving the remote guidance operations of the remote guidance personnel on the augmented reality picture to realize the transmission of communication information between the remote guidance personnel and the on-site workers.
[0014] In an implementation of the second aspect, the remote instructor and the on-site operator perform remote operation guidance work through video recording, picture transmission, and / or file sharing.
[0015] In a third aspect, the present application provides a computer-readable storage medium having a computer program stored thereon, which, when executed by an electronic device, implements the augmented reality-based steel plant equipment operation and maintenance assistance method as described in any one of the second aspects of the present application.
[0016] In a fourth aspect, the present application provides an electronic device comprising: a processor and a memory; the memory is used to store a computer program; the processor is used to execute the computer program stored in the memory, so that the electronic device executes the augmented reality-based steel plant equipment operation and maintenance assistance method as described in any one of the second aspects of the present application.
[0017] As described above, the steel plant equipment operation and maintenance auxiliary system, method and electronic equipment based on augmented reality described in this application have the following beneficial effects:
[0018] First, in this application, by applying the advantages of augmented reality technology, real-time remote guidance of on-site operation and maintenance services for steel plant equipment is realized, and various virtual information on equipment operation and maintenance is integrated into the actual picture of the steel plant environment and equipment, thereby improving the efficiency of problem solving and reducing the cost of equipment operation and maintenance.
[0019] Second, in this application, immersive virtual training on steel plant equipment maintenance technology is realized through training modules, which improves the intelligence level of training and teaching, effectively shortens the training time for new employees, reduces the company's investment in new employee training costs, and enables employees to quickly master job operation process technology and safety and quality points, and strictly work according to standardized specifications.
[0020] Third, the augmented reality-based steel plant equipment operation and maintenance assistance system of the present application is universal and extensible, can adapt to the operation and maintenance working environment under different conditions, and is suitable for the monitoring and maintenance of steel plant equipment with different signals and in different fields. BRIEF DESCRIPTION OF THE DRAWINGS
[0021] Figure 1 Shown is a schematic diagram of a scene of an electronic device in an embodiment of the present application.
[0022] Figure 2 Shown is a structural schematic diagram of the steel plant equipment operation and maintenance assistance system based on augmented reality as described in an embodiment of the present application.
[0023] Figure 3 Shown is a schematic diagram of the actual application structure of the steel plant equipment operation and maintenance assistance system based on augmented reality as described in an embodiment of the present application.
[0024] Figure 4 Shown is a flow chart of the augmented reality-based steel plant equipment operation and maintenance assistance method described in an embodiment of the present application.
[0025] Figure 5 Shown is a schematic diagram of the structure of an electronic device described in an embodiment of the present application.
[0026] Component number description
[0027] 11. Cell Phone
[0028] 12 Tablet
[0029] 13 Laptop
[0030] 100 Steel Plant Equipment Operation and Maintenance Assistance System Based on Augmented Reality
[0031] 101 Remote Expert Guidance Module
[0032] 102 Augmented Reality Module
[0033] 103 Data Acquisition Module
[0034] 104 Communication module
[0035] 105 Equipment Model Browsing Module
[0036] 106 training modules
[0037] 107 Model Library Module
[0038] 301 Handheld Devices
[0039] 302 Head-mounted devices
[0040] 303 PC Client
[0041] 51 Processing Units
[0042] 52 Memory
[0043] 521 Random Access Memory
[0044] 522 Cache memory
[0045] 523 Storage System
[0046] 524 Programs / Utilities
[0047] 5241 Program Module
[0048] 53 Bus
[0049] 54 Input / Output Interfaces
[0050] 55 Network Adapter
[0051] Steps S1 to S4 DETAILED DESCRIPTION
[0052] The following describes the embodiments of the present application through specific examples, and those skilled in the art can easily understand other advantages and effects of the present application from the contents disclosed in this specification. The present application can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present application. It should be noted that the following embodiments and features in the embodiments can be combined with each other without conflict.
[0053] It should be noted that the illustrations provided in the following embodiments are only schematic illustrations of the basic concept of the present application, and thus the drawings only show components related to the present application rather than being drawn according to the number, shape and size of components in actual implementation. In actual implementation, the type, quantity and proportion of each component may be changed at will, and the component layout may also be more complicated.
[0054] The following embodiments of the present application provide a steel plant equipment operation and maintenance auxiliary system, method and electronic equipment based on augmented reality, and the steel plant equipment operation and maintenance auxiliary method based on augmented reality can be applied to Figure 1 The electronic device shown. The electronic device described in this application may include a mobile phone 11 with wireless charging function, a tablet computer 12, a laptop computer 13, a wearable device, a vehicle-mounted device, an augmented reality (AR) / virtual reality (VR) device, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), etc. The embodiment of this application does not impose any restrictions on the specific type of the electronic device.
[0055] For example, the electronic device may be a station (STAION, ST) in a WLAN with a wireless charging function, a cellular phone, a cordless phone, a Session Initiation Protocol (SIP) phone, a Wireless Local Loop (WLL) station, a Personal Digital Assistant (PDA) device, a handheld device with a wireless charging function, a computing device or other processing device, a computer, a laptop computer, a handheld communication device, a handheld computing device, and / or other devices for communicating on a wireless system and a next generation communication system, such as a mobile terminal in a 5G network, a mobile terminal in a future evolved Public Land Mobile Network (PLMN), or a mobile terminal in a future evolved Non-terrestrial Network (NTN).
[0056] For example, the electronic device can communicate with the network and other devices through wireless communication. The above wireless communication can use any communication standard or protocol, including but not limited to Global System of Mobile communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, Short Messaging Service (SMS), BT, GNSS, WLAN, NFC, FM, and / or IR technology. GNSS can include Global Positioning System (GPS), Global Navigation Satellite System (GLONASS), BeiDou navigation Satellite System (BDS), Quasi-Zenith Satellite System (QZSS) and / or Satellite Based Augmentation Systems (SBAS).
[0057] The embodiments of the present application are described below in conjunction with the drawings in the embodiments of the present application.
[0058] like Figure 2 As shown, the steel plant equipment operation and maintenance auxiliary system 100 based on augmented reality of the present application includes: a remote expert guidance module 101, an augmented reality module 102, a data acquisition module 103, and a communication module 104.
[0059] The data acquisition module 103 is used to obtain real-time scenes on site.
[0060] Specifically, the data acquisition module 103 of the present application acquires real-time scenes on site through a camera or the like.
[0061] The augmented reality module is used to call the virtual information of the model and superimpose and merge the virtual information with the real-time scene on site to form an augmented reality picture.
[0062] The remote expert guidance module 101 is used to determine the corresponding remote guidance personnel and send the augmented reality picture to the remote guidance personnel so that the remote guidance personnel can perform remote guidance operations on the augmented reality picture.
[0063] Specifically, on-site staff can log in to the system through an electronic device, enter the remote expert guidance module 101, select the remote guidance personnel who need help in the remote expert list and make a call. After the connection is established, the remote guidance personnel receives the augmented reality screen, and further enables the remote guidance personnel to perform remote guidance operations on the augmented reality screen to meet the remote guidance operations.
[0064] Specifically, the remote guidance operations include translating, rotating, splitting, etc. the augmented reality screen.
[0065] The communication module 104 is used to realize the transmission of communication information between the remote guidance personnel and the on-site operation personnel.
[0066] Specifically, after receiving the augmented reality screen, the remote instructor performs operations such as translation, rotation, and splitting on the augmented reality screen, and transmits the operation results back through the communication module, so that the on-site workers and the remote instructor can share the augmented reality screen.
[0067] Specifically, communication information includes text, pictures, videos, and voice messages.
[0068] Furthermore, the communication module 104 is used to realize file transmission, voice call and video communication between the remote instructor and the on-site operator. The file transmission between the remote instructor and the on-site operator includes technical specifications, drawings, three-dimensional models, etc.
[0069] In one embodiment, the augmented reality-based steel plant equipment operation and maintenance auxiliary system 100 of the present application also includes: an equipment model browsing module 105; the equipment model browsing module 105 is used to implement remote guidance operations of remote guidance personnel on the augmented reality screen.
[0070] Specifically, AR's plane recognition and spatial positioning technologies are used to superimpose virtual models in real scenes (such as the desktop and floor in the room), supporting common model browsing operations (translation, rotation, scaling, hiding, sectioning, etc.), providing users with an immersive, all-round viewing experience, making it easy to quickly learn and master the components and structural principles of the equipment.
[0071] In one embodiment, the augmented reality-based steel plant equipment operation and maintenance assistance system 100 of the present application also includes: a training module 106; the training module 106 is used to convert the equipment maintenance process into a virtual simulation resource based on prefabricated augmented reality virtual simulation content to guide on-site operators to learn.
[0072] Specifically, through pre-made augmented reality virtual simulation content, the equipment maintenance process is transformed into an online virtual simulation training resource, and made into interactive courseware with AR effects. Students are guided to learn and operate through interactive courseware, and teaching and training are completed through virtual simulation training or virtual simulation training followed by practical training. Students can quickly master the key content of metallurgical equipment maintenance by watching and operating the courseware.
[0073] In one embodiment, the augmented reality-based steel plant equipment operation and maintenance auxiliary system 100 of the present application further includes: a model library module 107, and the model library module 107 is used to store virtual information of the model and store expert data information.
[0074] It should be noted that it should be understood that the division of the above modules is only a division of logical functions. In actual implementation, they can be fully or partially integrated into one physical entity, or they can be physically separated. And these modules can all be implemented in the form of software called by processing elements; they can also be all implemented in the form of hardware; some modules can also be implemented in the form of software called by processing elements, and some modules can be implemented in the form of hardware. For example, the x module can be a separately established processing element, or it can be integrated in a chip of the above-mentioned device for implementation. In addition, it can also be stored in the memory of the above-mentioned device in the form of program code, and called and executed by a processing element of the above-mentioned device. The implementation of other modules is similar. In addition, these modules can be fully or partially integrated together, or they can be implemented independently. The processing element described here can be an integrated circuit with signal processing capabilities. In the implementation process, each step of the above method or each module above can be completed by an integrated logic circuit of hardware in the processor element or instructions in the form of software.
[0075] For example, the above modules may be one or more integrated circuits configured to implement the above methods, such as one or more application-specific integrated circuits (ASICs), or one or more microprocessors (DSPs), or one or more field programmable gate arrays (FPGAs). For another example, when a module is implemented in the form of a processing element scheduling program code, the processing element may be a general-purpose processor, such as a central processing unit (CPU) or other processor that can call program code. For another example, these modules may be integrated together and implemented in the form of a system-on-a-chip (SOC).
[0076] In one embodiment, the operation and maintenance of steel plant equipment is used as an example for explanation. Through augmented reality technology, virtual information is combined with real scenes, and the user can intuitively see the interactive effect of virtual information and real scenes when operating the equipment. After the user logs in to the system through unified authentication, selects the equipment that needs to be operated and maintained in the augmented reality module. Then in the equipment model browsing step, the user can choose to view the three-dimensional model of the equipment to better understand the equipment structure and internal structure. Before performing specific operations, users can also contact professional operation and maintenance personnel for consultation and guidance through the remote expert guidance step. At the same time, we also provide maintenance process training steps to facilitate users to learn specific operating skills.
[0077] like Figure 3 As shown, it is a structural diagram of a practical application of the steel plant equipment operation and maintenance auxiliary system based on augmented reality of the present application.
[0078] In this embodiment, on-site workers obtain the real-time scene on site through the handheld device 301 or the head-mounted device 302, call the virtual information of the model in the model library module through the handheld device 301 or the head-mounted device 302, and superimpose and merge the virtual information of the model with the real-time scene on site to form an augmented reality picture; the remote guidance personnel receive the connection sent by the on-site workers through the PC client 303 or the handheld device 301, and receive the augmented reality picture.
[0079] Specifically, on-site workers and remote guidance personnel communicate online by performing operations such as panning, zooming, and splitting of the augmented reality screen, so as to enable the remote guidance personnel to provide operation and maintenance assistance to the on-site workers.
[0080] Specifically, handheld devices include: mobile phones, tablets, etc.; head-mounted devices include AR glasses, etc. Preferably, the augmented reality-based steel plant equipment operation and maintenance auxiliary system of the present application supports multiple system platforms such as Hongmeng, Android, iOS, and Windows.
[0081] like Figure 4 As shown, the steel plant equipment operation and maintenance auxiliary method based on augmented reality of the present application includes:
[0082] S1. Obtain the real-time scene.
[0083] Specifically, the on-site workers obtain the real-time scene through handheld devices or head-mounted devices. Preferably, the handheld devices include: mobile phones, tablets, etc.; the head-mounted devices include AR glasses, etc.
[0084] S2. Call the virtual information in the model library, and overlay and merge the virtual information with the real-time scene to form an augmented reality picture.
[0085] Specifically, on-site workers call up the virtual information of the model in the model library through handheld devices or head-mounted devices, and superimpose and merge the virtual information with the acquired real-time scene on site to form an augmented reality picture.
[0086] S3. Determine a remote instructor, and send the augmented reality picture to the remote instructor terminal, so that the remote instructor receives the augmented reality picture and performs remote instruction operations on the augmented reality picture.
[0087] Specifically, on-site workers obtain and select the remote instructor who needs to be consulted through handheld devices or head-mounted devices, and send a connection request to the remote instructor. After the remote instructor accepts the connection, the augmented reality screen is sent to the remote instructor to realize the sharing of augmented reality screens between on-site workers and remote instructors.
[0088] Specifically, the remote guidance personnel perform operations such as translation, splitting, rotation, and scaling on the augmented reality screen through a handheld device or PC client, and return the operation results to the on-site workers through the handheld device or PC client.
[0089] S4. Receive remote guidance operations of the remote guidance personnel on the augmented reality screen to realize the transmission of communication information between the remote guidance personnel and the on-site operators.
[0090] Specifically, the remote instructor and the on-site operator conduct remote operation guidance work through video recording, image transmission, and / or file sharing.
[0091] Specifically, the remote guidance operations and file contents returned by the remote guidance personnel are received to realize the sharing of augmented reality images between the on-site workers and the remote guidance personnel, and further realize the operation and maintenance assistance of the on-site equipment by the remote guidance personnel.
[0092] It should be noted that the protection scope of the steel plant equipment operation and maintenance auxiliary method based on augmented reality described in this application is not limited to the execution order of the steps listed in this embodiment. All solutions implemented by adding, reducing or replacing steps in the prior art based on the principles of this application are included in the protection scope of this application.
[0093] The present application embodiment also provides a computer-readable storage medium. A person of ordinary skill in the art can understand that all or part of the steps in the method for implementing the above embodiment can be completed by instructing the processor through a program, and the program can be stored in a computer-readable storage medium, and the storage medium is a non-transitory medium, such as a random access memory, a read-only memory, a flash memory, a hard disk, a solid-state hard disk, a magnetic tape, a floppy disk, an optical disc, and any combination thereof. The above storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or a data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a digital video disc (DVD)), or a semiconductor medium (e.g., a solid-state disk (SSD)), etc.
[0094] An embodiment of the present application also provides an electronic device, including: a processor and a memory.
[0095] Specifically, the memory is used to store computer programs; the memory includes: ROM, RAM, disk, USB flash drive, memory card or CD and other media that can store program codes.
[0096] The processor is used to execute the computer program stored in the memory so that the electronic device executes the above-mentioned automatic image repair method.
[0097] Preferably, the processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.
[0098] like Figure 5 As shown, the electronic device of the present invention is in the form of a general computing device. The components of the electronic device may include but are not limited to: one or more processors or processing units 51, a memory 52, and a bus 53 connecting different system components (including the memory 52 and the processing unit 51).
[0099] Bus 53 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor or a local bus using any of a variety of bus architectures. For example, these architectures include but are not limited to Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MAC) bus, Enhanced ISA bus, Video Electronics Standards Association (VESA) local bus and Peripheral Component Interconnect (PCI) bus.
[0100] Electronic devices typically include a variety of computer system readable media. These media can be any available media that can be accessed by the electronic device, including volatile and non-volatile media, removable and non-removable media.
[0101] The memory 52 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 521 and / or cache memory 522. The electronic device may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, the storage system 523 may be used to read and write non-removable, non-volatile magnetic media ( Figure 5 not shown, usually called a "hard drive"). Although Figure 5Not shown, a disk drive for reading and writing to a removable non-volatile disk (e.g., a "floppy disk"), and an optical disk drive for reading and writing to a removable non-volatile optical disk (e.g., a CD-ROM, a DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to the bus 53 via one or more data medium interfaces. The memory 52 may include at least one program product having a set (e.g., at least one) of program modules that are configured to perform the functions of the various embodiments of the present invention.
[0102] A program / utility 524 having a set (at least one) of program modules 5241 may be stored, for example, in the memory 52, such program modules 5241 including but not limited to an operating system, one or more application programs, other program modules, and program data, each of which or some combination thereof may include an implementation of a network environment. The program modules 5241 generally perform the functions and / or methods of the embodiments described herein.
[0103] The electronic device may also communicate with one or more external devices (e.g., keyboards, pointing devices, displays, etc.), one or more devices that enable a user to interact with the electronic device, and / or any device that enables the electronic device to communicate with one or more other computing devices (e.g., network cards, modems, etc.). Such communication may be performed via input / output (I / O) interface 54. Furthermore, the electronic device may also communicate with one or more networks (e.g., local area networks (LANs), wide area networks (WANs), and / or public networks, such as the Internet) via network adapter 55. Figure 5 As shown, the network adapter 55 communicates with other modules of the electronic device via the bus 53. It should be understood that, although not shown in the figure, other hardware and / or software modules can be used in conjunction with the electronic device, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.
[0104] The descriptions of the processes or structures corresponding to the above-mentioned figures have different emphases. For parts that are not described in detail in a certain process or structure, please refer to the relevant descriptions of other processes or structures.
[0105] To sum up, first, in this application, by applying the advantages of augmented reality technology, real-time remote guidance of on-site operation and maintenance services for steel plant equipment is realized, and various virtual information of equipment operation and maintenance are integrated into the physical images of steel plant environment equipment, so as to improve the efficiency of problem solving and reduce the cost of equipment operation and maintenance; second, in this application, immersive virtual training of steel plant equipment maintenance process is realized through training modules, the intelligence level of training and teaching is improved, the training time of new employees is effectively shortened, and the cost investment of enterprises in training new employees is reduced, so that employees can quickly master the job operation process technology and safety and quality points, and strictly operate according to standardized specifications; third, the augmented reality-based steel plant equipment operation and maintenance auxiliary system of this application is universal and extensible, can adapt to the operation and maintenance working environment under different conditions, and is suitable for the monitoring and maintenance of steel plant equipment with different signals and different fields. Therefore, this application effectively overcomes the various shortcomings in the prior art and has a high industrial utilization value.
[0106] The above embodiments are merely illustrative of the principles and effects of the present application and are not intended to limit the present application. Anyone familiar with the technology may modify or change the above embodiments without violating the spirit and scope of the present application. Therefore, all equivalent modifications or changes made by a person of ordinary skill in the art without departing from the spirit and technical ideas disclosed in the present application shall still be covered by the claims of the present application.
Claims
1. A steel plant equipment operation and maintenance auxiliary system based on augmented reality, characterized in that: The system includes: a remote expert guidance module, an augmented reality module, a data acquisition module, and a communication module; The data acquisition module is used to obtain the real-time scene on site; The augmented reality module is used to call the virtual information of the model, and superimpose and merge the virtual information with the on-site real-time scene to form an augmented reality picture; The remote expert guidance module is used to determine a corresponding remote guidance person, and send the augmented reality picture to the remote guidance person, so that the remote guidance person performs remote guidance operations on the augmented reality picture; The communication module is used to receive the remote guidance operation of the remote guidance personnel on the augmented reality screen, so as to realize the transmission of communication information between the remote guidance personnel and the on-site operation personnel.
2. The steel plant equipment operation and maintenance auxiliary system based on augmented reality according to claim 1 is characterized in that: The system also includes a device model browsing module; the device model browsing module is used to implement the remote guidance operation of the remote guidance personnel on the augmented reality screen.
3. The steel plant equipment operation and maintenance auxiliary system based on augmented reality according to claim 2 is characterized in that: The remote guidance operation includes: translating, rotating, and splitting the augmented reality screen.
4. The steel plant equipment operation and maintenance auxiliary system based on augmented reality according to claim 1 is characterized in that: The system also includes a training module; the training module is used to convert the equipment maintenance process into a virtual simulation resource based on prefabricated augmented reality virtual simulation content to guide on-site operators to learn.
5. The steel plant equipment operation and maintenance auxiliary system based on augmented reality according to claim 1 is characterized in that: The communication information includes text, pictures, videos and voice messages.
6. The steel plant equipment operation and maintenance auxiliary system based on augmented reality according to claim 1 is characterized in that: The system also includes a model library module; the model library module is used to store virtual information of the model and store expert data information.
7. A steel plant equipment operation and maintenance auxiliary method based on augmented reality, characterized in that: The method comprises: Get real-time scene information; Calling virtual information in the model library, and superimposing and integrating the virtual information with the on-site real-time scene to form an augmented reality picture; Determine a remote instructor, and send the augmented reality picture to the remote instructor terminal, so that the remote instructor receives the augmented reality picture and performs remote instruction operations on the augmented reality picture; Receive the remote guidance operation of the remote guidance personnel on the augmented reality picture to realize the transmission of communication information between the remote guidance personnel and the on-site operation personnel.
8. The steel plant equipment operation and maintenance auxiliary method based on augmented reality according to claim 7, characterized in that: The remote instructor and on-site operators conduct remote operation guidance work through video recording, image transmission, and / or file sharing.
9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by an electronic device, it implements the steel plant equipment operation and maintenance assistance method based on augmented reality as described in any one of claims 7-8.
10. An electronic device, characterized in that: include: Processor and memory; The memory is used to store computer programs; The processor is used to execute the computer program stored in the memory so that the electronic device performs the steel plant equipment operation and maintenance assistance method based on augmented reality as described in any one of claims 7-8.
