Universe workshop interaction system and method based on mixed reality

By adopting mixed reality technology in the industrial metaverse workshop, building a unified data background and defining an interaction mode, the problem of unintuitive information interaction and inefficient operation is solved, and efficient and intuitive interaction and information display are achieved.

CN120010654APending Publication Date: 2025-05-16SHANG FEI ZHI NENG JI SHU YOU XIAN GONG SI
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411811937.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-12-10
Publication Date
2025-05-16

AI Technical Summary

Technical Problem

The prior art has problems in the interaction of industrial meta-universe workshops, such as inconspicuous information interaction and low operational efficiency.

Method used

The metacosmic workshop interaction system based on mixed reality is adopted to realize information operation and display of virtual workshops by building a unified data background and defining a diverse interactive mode.

Benefits of technology

It improves the intelligence level of workshop management, enhances the interactive experience between users and virtual workshop information, and realizes the intuitiveness of information interaction, efficient operation and convenient management.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120010654A_ABST
    Figure CN120010654A_ABST
Patent Text Reader

Abstract

The invention relates to the field of universe, and provides a universe workshop interaction system and method based on mixed reality, and the system comprises a data background module which is used for building a unified data background, and the data in the data background comprises personnel data, workshop real-time video stream data, asset data and equipment data; the interaction layer definition module is used for defining interaction modes, and the interaction modes comprise gesture moving and dragging interaction, position placing interaction, zooming interaction and touch and click interaction; and the mixed reality scene display module is used for performing mixed reality scene information display according to the defined interaction mode and realizing information operation and display of the virtual workshop. According to the invention, the problems of non-visual workshop information interaction and low operation efficiency in the prior art are solved, and efficient and visual interaction and information display of the universe workshop based on mixed reality are realized.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of metaverse technology, and in particular to a metaverse workshop interaction system and method based on mixed reality. Background Art

[0002] As a virtual space that integrates virtual reality, augmented reality and the Internet, Metaverse is attracting widespread attention in various industries. Its unique feature is that it can provide users with an intuitive and immersive experience, thereby greatly improving the way users interact. In the industrial field, the application of Metaverse technology has brought revolutionary changes to data visualization and analysis, remote monitoring and maintenance, virtual training and simulation, product design collaboration and many other aspects.

[0003] Workshop control in the industrial metaverse is currently mainly achieved through two technologies: PC and VR mode.

[0004] PC-side implementation: Display the on-site situation of the Metaverse workshop through a PC monitor. This method is convenient to access and does not hinder the normal work of users in reality. However, its interactivity and intuitiveness are not enough, and a single interface cannot carry different information at the same time, so it cannot take into account the display of multi-dimensional information.

[0005] VR mode enables users to immerse themselves in a fully virtual world, giving them a strong sense of experience. Workshop information can be presented to users from a 360-degree perspective. However, this approach overemphasizes the virtual world and places high demands on the real environment. The environment restricts users' operating behaviors, thus affecting their work efficiency in reality.

[0006] In addition, as an emerging technology, Mixed Reality (MR) technology can overlay virtual scenes in the real world, which not only ensures the experience and interactivity, but also does not affect the user's normal real-world office operations. However, despite these advantages of MR technology, its application in the interaction of industrial metaverse workshops is still lacking in practice.

[0007] In summary, existing technologies have obvious defects in industrial metaverse workshop interaction. Summary of the invention

[0008] The present invention provides a metaverse workshop interaction system and method based on mixed reality, which solves the problems of non-intuitive workshop information interaction and low operating efficiency in the prior art, and realizes efficient and intuitive interaction and information display of the metaverse workshop based on mixed reality.

[0009] The present invention provides a metaverse workshop interaction system based on mixed reality, comprising the following modules: The data background module is used to build a unified data background. The data in the data background includes personnel data, real-time video stream data of the workshop, asset data and equipment data; The interaction layer definition module is used to define the interaction mode, which includes gesture movement and drag interaction, position placement interaction, zoom interaction and touch and click interaction; The mixed reality scene display module is used to display mixed reality scene information according to the defined interaction mode, and realize the information operation and display of the virtual workshop.

[0010] According to a mixed reality-based metaverse workshop interaction system provided by the present invention, the data background module further includes: a data collection and update unit, which is used to collect and update the personnel data, workshop real-time video stream data, asset data and equipment data in real time.

[0011] According to a metaverse workshop interaction system based on mixed reality provided by the present invention, the interaction layer definition module further includes: a gesture move and drag interaction definition unit, used to define a gesture move and drag interaction Mi (x, y, z, rx, ry, rz), where Mi represents the movement interaction of object i, and (x, y, z, rx, ry, rz) represents the virtual world coordinates of the metaverse object; a position placement interaction definition unit, used to define a position placement interaction Pi (xr, yr, zr), where Pi represents the placement operation of the metaverse object i in the real world, and (xr, yr, zr) represents the real world coordinates of the object; a scaling interaction definition unit, used to define a scaling interaction Si (sx, sy, sz), where Si represents the scaling operation of the virtual object i, and (sx, sy, sz) represents the scaling ratio of the object i on the xyz axis; a touch and click interaction definition unit, used to define a touch and click interaction Ci, where Ci represents a hand touch or air click on the object i.

[0012] According to a mixed reality-based Metaverse workshop interaction system provided by the present invention, the mixed reality scene display module further includes: a Metaverse Sky Eye functional unit, installed on the office wall, for receiving scenes within the office; a Metaverse equipment functional unit, installed at any position in the factory sandbox, for layout simulation, and customized interaction to place the equipment in the scene within the factory sandbox.

[0013] According to a mixed reality-based metaverse workshop interaction system provided by the present invention, the system also includes: a custom interaction unit module, which is used to combine different interaction modes according to different industrial metaverse functional applications.

[0014] The present invention also provides a metaverse workshop interaction method based on mixed reality, comprising the following steps: Build a unified data background, including personnel data, real-time video stream data of the workshop, asset data and equipment data, to provide an information display basis for the Metaverse workshop; Define an interaction layer, which includes gesture movement and drag interaction, position placement interaction, zoom interaction, and touch and click interaction, which are used to adapt to the interaction effects of different workshop function modules; Perform mixed reality scene information display, display workshop resources according to the interaction mode defined by the interaction layer, and realize information operation and display of the virtual workshop.

[0015] According to a mixed reality-based metaverse workshop interaction method provided by the present invention, after building a unified data background, the method also includes: real-time collection and updating of the personnel data, workshop real-time video stream data, asset data and equipment data to ensure the real-time information of the metaverse workshop.

[0016] The present invention also provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the metaverse workshop interaction method based on mixed reality as described in any one of the above is implemented.

[0017] The present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements any of the mixed reality-based metaverse workshop interaction methods described above.

[0018] The present invention also provides a computer program product, including a computer program, which, when executed by a processor, implements any of the mixed reality-based metaverse workshop interaction methods described above.

[0019] The present invention provides a mixed reality-based metaverse workshop interaction system and method, which includes the following beneficial effects: by building a unified data background, integrating multi-dimensional data such as personnel, real-time workshop videos, assets and equipment, defining a variety of interaction modes, and intuitively displaying workshop information through a mixed reality scene display module. This not only improves the level of intelligent workshop management, but also greatly enhances the user's interactive experience with virtual workshop information, thereby achieving intuitive workshop information interaction, efficient operation and convenient management, bringing more efficient production process management and lower operating costs to enterprises. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0021] Figure 1 It is a structural diagram of the metaverse workshop interaction system based on mixed reality provided by the present invention.

[0022] Figure 2 It is a schematic flow chart of the mixed reality-based metaverse workshop interaction method provided by the present invention.

[0023] Figure 3 This is a solution architecture diagram of the metaverse workshop interaction system based on mixed reality provided by the present invention.

[0024] Figure 4 This is a diagram of the mixed reality workshop interaction implementation architecture provided by the present invention.

[0025] Figure 5 It is a structural schematic diagram of the electronic device provided by the present invention. DETAILED DESCRIPTION

[0026] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the drawings of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0027] As a virtual space that integrates virtual reality, augmented reality and the Internet, Metaverse is attracting attention in various industries. It can improve user interaction by providing an intuitive experience. The current Metaverse technology has been applied in the industrial field, mainly including data visualization and analysis, remote monitoring and maintenance, virtual training and simulation, product design collaboration and other applications. The workshop control of the industrial Metaverse is mainly achieved through the PC side. Its advantage is that the on-site situation of the Metaverse workshop can be displayed through a PC monitor, which is convenient to access and will not hinder the normal office work of users in reality. However, its interactivity and intuitiveness are not enough, and a single interface cannot carry different information at the same time, so it cannot take into account the display of multi-dimensional information. Some systems also realize interactive access to the Metaverse workshop through the VR mode. Its advantage is that it immerses users in a fully virtual world, with a strong sense of experience, and the workshop information can be presented to users in a 360-degree full perspective. However, it overemphasizes the virtual world, has high requirements for the real environment, and the environment restricts the user's operation behavior. Mixed reality technology can superimpose virtual scenes in the real world, while ensuring the sense of experience and interactivity without affecting the normal real office operation of users, but its application in the interaction of workshops lacks practice.

[0028] The biggest feature of the MR-based metaverse workshop interaction method proposed in the present invention is that it uses the characteristics of XR mixed reality technology to present workshop control information to users in a new interactive mode without affecting the user's real office work, allowing users to interact with the metaverse virtual screen in a real environment. That is, it breaks through the constraints of the single screen on the PC side and also ensures the user's experience and interactivity. Thereby improving the user's real and natural viewing experience.

[0029] Combine the following Figure 1-Figure 5 Embodiments of the present invention are described in detail.

[0030] Figure 1 is a system structure diagram of the metaverse workshop interaction system based on mixed reality provided by the present invention, such as Figure 1 As shown, the system includes the following modules: The data background module 110 is used to build a unified data background. The data in the data background includes personnel data, real-time video stream data of the workshop, asset data and equipment data; The interaction layer definition module 120 is used to define the interaction mode, which includes gesture movement and drag interaction, position placement interaction, zoom interaction and touch and click interaction; The mixed reality scene display module 130 is used to display mixed reality scene information according to the defined interaction mode, so as to realize the information operation and display of the virtual workshop.

[0031] According to a mixed reality-based metaverse workshop interaction system provided by the present invention, the data background module 110 further includes: a data collection and update unit, which is used to collect and update personnel data, real-time workshop video stream data, asset data and equipment data in real time.

[0032] According to a metaverse workshop interaction system based on mixed reality provided by the present invention, the interaction layer definition module 120 further includes: a gesture move and drag interaction definition unit, used to define a gesture move and drag interaction Mi (x, y, z, rx, ry, rz), where Mi represents the movement interaction of object i, and (x, y, z, rx, ry, rz) represents the virtual world coordinates of the metaverse object; a position placement interaction definition unit, used to define a position placement interaction Pi (xr, yr, zr), where Pi represents the placement operation of the metaverse object i in the real world, and (xr, yr, zr) represents the real world coordinates of the object; a scaling interaction definition unit, used to define a scaling interaction Si (sx, sy, sz), where Si represents the scaling operation of the virtual object i, and (sx, sy, sz) represents the scaling ratio of the object i on the xyz axis; a touch and click interaction definition unit, used to define a touch and click interaction Ci, where Ci represents a hand touch or air click on the object i.

[0033] According to a mixed reality-based metaverse workshop interaction system provided by the present invention, the mixed reality scene display module 130 further includes: a metaverse sky eye functional unit, installed on the office wall, for receiving scenes within the office; a metaverse equipment functional unit, installed at any position in the factory sandbox, for layout simulation, and customized interaction to place the equipment in the scene within the factory sandbox.

[0034] According to a mixed reality-based metaverse workshop interaction system provided by the present invention, the system also includes: a custom interaction unit module 140, which is used to combine different interaction modes according to different industrial metaverse functional applications.

[0035] The metaverse workshop interaction method based on mixed reality provided by the present invention is described below. The metaverse workshop interaction method based on mixed reality described below and the metaverse workshop interaction system based on mixed reality described above can be referenced to each other.

[0036] The present invention provides a metaverse workshop interaction method based on MR, which specifically relates to a metaverse interaction display method in the MR field, and belongs to the field of metaverse and MR technology. The method provides an innovative display method for the application of industrial metaverse scenarios, aiming to enhance the practicality and interactivity of such applications, thereby effectively solving the operation and use problems in industrial metaverse scenarios.

[0037] The present invention provides an industrial metaverse interaction method using MR technology, which is mainly used for interaction with virtual workshops. This method solves the problem that the current industrial metaverse scene interaction mode is single and cannot take into account both interactivity and practicality. The PC-side mode displays less information, which reduces the user's sense of interaction. The pure immersive mode can be used for workshop management and control, but it has high requirements on the environment and also affects the user's real-life operations.

[0038] This method mainly uses MR technology to turn the control workshop into a virtual sandbox and integrate it into the real desktop. By defining a set of interactive modes, it ultimately realizes the information operation and display of the virtual workshop, improves the system operability and enhances user immersion.

[0039] like Figure 2 The present invention provides a mixed reality-based metaverse workshop interaction method, comprising: S210. Build a unified data background, including personnel data, real-time video stream data of the workshop, asset data and equipment data, to provide an information display basis for the Metaverse workshop.

[0040] According to a mixed reality-based metaverse workshop interaction method provided by the present invention, after building a unified data background, the method also includes: real-time collection and updating of personnel data, real-time workshop video stream data, asset data and equipment data to ensure the real-time nature of the information in the metaverse workshop.

[0041] S220. Define an interaction layer, where the interaction layer includes gesture movement and dragging interaction, position placement interaction, zoom interaction, and touch and click interaction, which are used to adapt to the interaction effects of different workshop functional modules.

[0042] S230: Perform mixed reality scene information display, display workshop resources according to the interaction mode defined by the interaction layer, and realize information operation and display of the virtual workshop.

[0043] Specifically, Figure 3 The figure shows the architecture diagram of the technical solution of the present invention. It is based on the real data background, provides real-time data for the metaverse, and uses a customized interaction layer to integrate virtual scenes and physical spaces to achieve the effect of combining the virtual and the real. On this basis, various industrial metaverse functional applications are realized.

[0044] The specific technical solution is implemented as follows: First, build a unified data background, including personnel data, real-time video stream data of the workshop, asset data, equipment data, etc., to provide an information display basis for the Metaverse workshop.

[0045] Secondly, the interaction layer definition defines a unified general interaction logic to adapt to the different interaction effects of different workshop functional modules. The interaction layer mainly includes gesture movement, position placement, zoom interaction, click interaction, grab interaction, etc.

[0046] Finally, the MR scene information display shows different effects of various workshop assets, personnel, factory buildings, tooling equipment and other resources under different interaction mode definitions.

[0047] The above technical solutions have achieved the following good results: In the industrial metaverse scene, different interaction modes are used to make the information display effect both operational and immersive. For example, the Metaverse Sky Eye function application can place different Sky Eye windows on the office wall, breaking through the limitations of the display screen, allowing users to see the workshop scene in real time at their office; the Metaverse equipment function application, custom interaction can place the equipment at any position in the factory sandbox for layout simulation, and can also zoom, move and drag to view the detailed status of the Metaverse equipment. Realize the information expression of the Metaverse scene, break through the limitations of physical space, and improve the immersion and operability of the scene. Enhance the sense of reality of the experience user, thereby improving the user's understanding of the Metaverse workshop.

[0048] The MR-based Metaverse workshop interaction method is used to provide users with a new Metaverse workshop interaction effect, which improves the scene immersion and operability.

[0049] Based on MR technology, this paper integrates industrial scenes and metaverse, defines and proposes a new interaction method, and builds a workshop metaverse system. The main steps of its implementation are as follows: Figure 4 Shown include: First, define the interaction layer command group, which includes gesture move and drag interaction Mi(x,y,z,rx,ry,rz), ​​where Mi represents the movement interaction of object i, and (x,y,z,rx,ry,rz) represents the virtual world coordinates of the metaverse object; position placement interaction Pi(xr,yr,zr), where Pi represents the placement operation of metaverse object i in the real world, and (xr,yr,zr) represents the real world coordinates of the object; scaling interaction Si(sx,sy,sz), where Si represents the scaling operation of virtual object i, and (sx,sy,sz) represents its scaling ratio on the xyz axis; touch and click interaction Ci, where Ci represents hand touching or air clicking on object i.

[0050] Secondly, the customized interaction unit combines different interaction modes according to different industrial metaverse functional applications, including but not limited to factory sandbox function, scene workstation function, metaverse eye, real-time status display of assets / tooling / equipment, dynamic display of personnel, etc. Different functional applications have different customized commands.

[0051] Finally, the interactive display realizes the multi-faceted interactive effects of the MR-based Metaverse workshop according to the combination of different Metaverse functions and custom interactions. For example: the Sky Eye function combines the command group elements (Ci, Mi, Pi, Si), clicks the virtual Sky Eye button with a gesture, expands the Sky Eye function module, uses gesture movement interaction to move the Sky Eye video window freely in the virtual space, and then uses placement interaction to place it next to the real office, and zooms in and out to achieve the custom size of the window. Finally, users can check the status of the virtual Metaverse workshop at any time while working.

[0052] Figure 5 An example of a physical structure diagram of an electronic device is shown in FIG. Figure 5 As shown, the electronic device may include: a processor 510, a communication interface 520, a memory 530 and a communication bus 540, wherein the processor 510, the communication interface 520 and the memory 530 communicate with each other through the communication bus 540. The processor 510 may call the logic instructions in the memory 530 to execute the metaverse workshop interaction method based on mixed reality, the method comprising: building a unified data background, the data including personnel data, real-time video stream data of the workshop, asset data and equipment data, for providing a basis for information display for the metaverse workshop; defining an interaction layer, the interaction layer including gesture movement and drag interaction, position placement interaction, zoom interaction and touch and click interaction, for adapting the interaction effects of different workshop functional modules; performing mixed reality scene information display, displaying workshop resources according to the interaction mode defined in the interaction layer, and realizing information operation and display of the virtual workshop.

[0053] In addition, the logic instructions in the above-mentioned memory 530 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when it is sold or used as an independent product. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods of each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc. Various media that can store program codes.

[0054] On the other hand, the present invention also provides a computer program product, which includes a computer program. The computer program can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the mixed reality-based metaverse workshop interaction method provided by the above methods, which includes: building a unified data background, the data includes personnel data, real-time workshop video stream data, asset data and equipment data, which is used to provide an information display basis for the metaverse workshop; defining an interaction layer, the interaction layer includes gesture movement and drag interaction, position placement interaction, zoom interaction and touch and click interaction, which is used to adapt to the interaction effects of different workshop functional modules; performing mixed reality scene information display, displaying workshop resources according to the interaction mode defined in the interaction layer, and realizing information operation and display of the virtual workshop.

[0055] On the other hand, the present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, it is implemented to execute the mixed reality-based metaverse workshop interaction method provided by the above-mentioned methods, the method comprising: building a unified data background, the data including personnel data, real-time video stream data of the workshop, asset data and equipment data, for providing an information display basis for the metaverse workshop; defining an interaction layer, the interaction layer including gesture movement and drag interaction, position placement interaction, zoom interaction and touch and click interaction, for adapting to the interaction effects of different workshop functional modules; performing mixed reality scene information display, displaying the workshop resources according to the interaction mode defined in the interaction layer, and realizing information operation and display of the virtual workshop.

[0056] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, i.e., they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Those of ordinary skill in the art may understand and implement it without creative effort.

[0057] Through the description of the above implementation modes, those skilled in the art can clearly understand that each implementation mode can be implemented by means of software plus a necessary general hardware platform, or of course by hardware. Based on such an understanding, the above technical solution can essentially or in other words be embodied in the form of a software product that contributes to the prior art. The computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a magnetic disk, an optical disk, etc., and includes a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods of each embodiment or some parts of the embodiment.

[0058] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A mixed reality-based metaverse workshop interaction system, characterized in that: include: The data background module is used to build a unified data background. The data in the data background includes personnel data, real-time video stream data of the workshop, asset data and equipment data; The interaction layer definition module is used to define the interaction mode, which includes gesture movement and drag interaction, position placement interaction, zoom interaction and touch and click interaction; The mixed reality scene display module is used to display mixed reality scene information according to the defined interaction mode, and realize the information operation and display of the virtual workshop.

2. The mixed reality-based metaverse workshop interaction system according to claim 1, characterized in that: The data background module further includes: The data collection and update unit is used to collect and update the personnel data, real-time video stream data of the workshop, asset data and equipment data in real time.

3. The mixed reality-based metaverse workshop interaction system according to claim 1, characterized in that: The interaction layer definition module further includes: A gesture move and drag interaction definition unit, used to define a gesture move and drag interaction Mi(x, y, z, rx, ry, rz), where Mi represents the movement interaction of object i, and (x, y, z, rx, ry, rz) represents the virtual world coordinates of the metaverse object; A position placement interaction definition unit, used to define a position placement interaction Pi (xr, yr, zr), where Pi represents the placement operation of the metaverse object i in the real world, and (xr, yr, zr) represents the real-world coordinates of the object; A scaling interaction definition unit, used to define a scaling interaction Si (sx, sy, sz), where Si represents a scaling operation on a virtual object i, and (sx, sy, sz) represents a scaling ratio of the object i on the xyz axis; The touch and click interaction definition unit is used to define the touch and click interaction Ci, where Ci represents the hand touching or clicking the object i in the air.

4. The mixed reality-based metaverse workshop interaction system according to claim 1, characterized in that: The mixed reality scene display module further includes: The Metaverse Sky Eye functional unit is installed on the office wall to receive scenes inside the office; The Metaverse equipment functional unit is installed at any location in the factory sandbox for layout simulation and customized interaction to place the equipment in the factory sandbox scene.

5. The mixed reality-based metaverse workshop interaction system according to claim 1, characterized in that: The system further comprises: Customized interaction unit modules are used to combine different interaction modes according to different industrial metaverse functional applications.

6. A mixed reality-based metaverse workshop interaction method, characterized in that: include: Build a unified data background, including personnel data, real-time video stream data of the workshop, asset data and equipment data, to provide an information display basis for the Metaverse workshop; Define an interaction layer, which includes gesture movement and drag interaction, position placement interaction, zoom interaction, and touch and click interaction, which are used to adapt to the interaction effects of different workshop function modules; Perform mixed reality scene information display, display workshop resources according to the interaction mode defined by the interaction layer, and realize information operation and display of the virtual workshop.

7. The mixed reality-based metaverse workshop interaction method according to claim 6, characterized in that: After building a unified data background, the method further includes: The personnel data, real-time video stream data of the workshop, asset data and equipment data are collected and updated in real time to ensure the real-time information of the Metaverse workshop.

8. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, it implements the metaverse workshop interaction method based on mixed reality as described in any one of claims 6 to 7.

9. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the metaverse workshop interaction method based on mixed reality is implemented as described in any one of claims 6 to 7.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the metaverse workshop interaction method based on mixed reality is implemented as described in any one of claims 6 to 7.