Metacosmic space efficient interactive cooperation system and method

By adopting low-latency communication protocols, multiple interaction methods and rich collaboration tools in the metaverse space, combined with intelligent collaboration auxiliary modules, the problems of delay, single interaction methods and insufficient tools in metaverse interactive collaboration are solved, and efficient Secure user interaction and collaboration experience.

CN119094562APending Publication Date: 2024-12-06GUANGDONG POWER GRID CO LTD DONGGUAN POWER SUPPLY BUREAU
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202411221401.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-02
Publication Date
2024-12-06

AI Technical Summary

Technical Problem

The existing metacosmic interaction collaboration schemes have problems such as communication delay, single interaction methods, and insufficient collaboration tools, which limit the collaboration efficiency between users.

Method used

Adopting low-latency, high-bandwidth communication protocols, it provides a variety of innovative interaction methods such as gesture recognition and eye tracking interactions, rich collaboration tools such as virtual whiteboards and real-time audio and video conferencing systems, and user-based use through intelligent collaboration auxiliary modules Intelligent analysis and recommendations for behavioral and task requirements.

Benefits of technology

Real-time and efficient interaction and collaboration between users are realized, interactive efficiency and collaboration efficiency are improved, and communication security and user experience are ensured.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119094562A_ABST
    Figure CN119094562A_ABST
Patent Text Reader

Abstract

The invention discloses a meta cosmic space efficient interactive cooperation system and method, and belongs to the technical field of meta cosmic space, and the system comprises a communication protocol optimization module which employs a low-delay and high-bandwidth transmission protocol, and guarantees the real-time transmission of information between users; the interaction mode innovation module adopts a plurality of innovative interaction modes; the multi-collaboration work module provides collaboration tools, comprises a shared virtual whiteboard, a three-dimensional modeling tool and a real-time audio and video conference system, and is used for supporting real-time communication, information sharing and task collaboration requirements among users; and the intelligent cooperation auxiliary module performs intelligent analysis and recommendation based on user behaviors and task demand information, and provides personalized cooperation suggestions and resource support for the user. By adopting the meta-cosmic space efficient interaction cooperation system and method, the problems of communication delay, single interaction mode and insufficient cooperation tools are solved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of metaverse technology, and in particular to a metaverse space efficient interactive collaboration system and method. Background Art

[0002] With the rapid development of metaverse technology, users have an increasing demand for efficient and convenient interactive collaboration in the virtual world. However, existing metaverse interactive collaboration solutions have problems such as communication delay, single interaction mode, and insufficient collaboration tools, which limit the efficiency of collaboration between users. Therefore, it is of great significance to develop a new type of efficient interactive collaboration method and system for metaverse space. Summary of the invention

[0003] The purpose of the present invention is to provide a metaverse space efficient interactive collaboration system and method to solve the problems existing in the above-mentioned background technology.

[0004] To achieve the above objectives, the present invention provides a metaverse space efficient interactive collaboration system, comprising:

[0005] The communication protocol optimization module adopts a low-latency, high-bandwidth transmission protocol to ensure real-time transmission of information between users; it also has data encryption and verification mechanisms to ensure the security of the communication process;

[0006] The interactive mode innovation module adopts several innovative interactive modes, including natural interaction based on gesture recognition, voice control, and interaction based on eye tracking. The interactive mode enables users to perform interactive operations more naturally and conveniently, thus improving the interaction efficiency.

[0007] The multi-collaboration work module provides a variety of collaboration tools, including shared virtual whiteboards, 3D modeling tools, real-time audio and video conferencing systems, etc., to support real-time communication, information sharing, and task collaboration between users, further improving collaboration efficiency;

[0008] The intelligent collaboration assistance module performs intelligent analysis and recommendations based on user behavior and task requirement information, providing users with personalized collaboration suggestions and resource support; through the intelligent collaboration assistance module, users can complete collaboration tasks more efficiently.

[0009] Preferably, the transmission protocols adopted by the communication protocol optimization module include TCP transmission control protocol, UDP user datagram protocol, WebSocket protocol, QUIC fast UDP Internet connection protocol, HTTP hypertext transfer protocol and HTTPS secure hypertext transfer protocol.

[0010] Preferably, the natural interaction based on gesture recognition of the interactive mode innovation module specifically includes vision-based gesture recognition, structured light-based gesture recognition, millimeter-wave radar-based gesture recognition, deep learning-based gesture recognition and multimodal gesture recognition.

[0011] Preferably, the gesture recognition based on vision is specifically as follows: using a camera to capture the user's hand movements, and identifying the user's gestures through image processing technology, including edge detection, shape matching and deep learning technology; once the gesture is recognized, it is mapped to the corresponding interactive operation in the virtual world; the gesture recognition based on structured light is specifically as follows: by projecting a known pattern of light to the user's hand, and using an infrared sensor to receive the reflected light, by analyzing the deformation and displacement of the reflected light, the spatial position and posture of the user's hand are obtained; the gesture recognition based on millimeter wave radar is specifically as follows: the millimeter wave radar detects the position and speed of the target object by emitting radio waves and receiving echoes. In gesture recognition, the millimeter wave radar detects the movement and posture changes of the user's hand; the gesture recognition based on deep learning is specifically as follows: by training a large amount of gesture data, the deep learning model learns the characteristics and patterns of the gestures to realize gesture recognition; the multimodal gesture recognition is specifically as follows: combining several sensor technologies, including cameras, infrared sensors, accelerometers, etc., to capture the user's gestures; by fusing data from multiple information sources, the system obtains more accurate and comprehensive gesture recognition results.

[0012] Preferably, the interaction based on eye tracking of the interaction mode innovation module specifically includes:

[0013] Eye tracking and positioning: Eye tracking technology is used to track the user's gaze by measuring the position of the eye's gaze point or the movement of the eyeball relative to the head. It uses infrared cameras and LED devices to capture images of human eyes or faces, and then uses algorithms to detect, locate and track faces and eyes.

[0014] Intention inference: Infer the user's intention based on eye tracking data. If the user stares at a virtual button or link for a long time, the user has the intention to click or interact. Intention inference is used to trigger specific interactive events or actions to improve the naturalness and intuitiveness of the interaction.

[0015] User feedback and interaction optimization. Eye tracking data is also used to collect user feedback and optimize the interaction design of the virtual world. By analyzing the user's gaze trajectory and dwell time, we can understand the user's attention and interest in interface elements, thereby adjusting the layout, color and size attributes to improve the user experience.

[0016] Preferably, when the collaboration tool is a shared virtual whiteboard, the construction of the shared virtual whiteboard is specifically as follows:

[0017] Demand analysis to clarify the functional requirements of the virtual whiteboard, including support for simultaneous editing by multiple people, support for the insertion of multiple elements such as text, graphics, and pictures, and support for real-time saving and sharing;

[0018] Design the virtual whiteboard interface, including toolbar, editing area, save and share buttons;

[0019] 3D modeling and rendering: Use 3D modeling software to create a 3D model of the virtual whiteboard, including background, toolbar, and editing area elements; import it into the Metaverse platform and use real-time rendering technology to present it in the virtual space, optimize rendering performance, and ensure smooth operation under different devices and network conditions;

[0020] Implement user interaction and write code to implement the interaction between the user and the virtual whiteboard. The interaction functions include responding to the user's mouse clicks, keyboard input events, and updating the status of the virtual whiteboard; using input devices to capture user operations and convert them into editing commands for the virtual whiteboard; implementing the function of multiple people editing at the same time to ensure that the operations between different users can be synchronized and updated in real time;

[0021] Testing and optimization: testing the virtual whiteboard under different devices and network conditions to ensure that it can operate normally in various situations; collecting user feedback and optimizing and improving the virtual whiteboard based on the feedback;

[0022] Integrate the constructed virtual whiteboard into the Metaverse platform, and seamlessly connect it with other virtual scenes and interactive functions to ensure that the interaction between the virtual whiteboard and other virtual objects and users is natural and smooth.

[0023] Preferably, when the collaboration tool is a three-dimensional modeling tool, the construction of the three-dimensional modeling tool is specifically as follows:

[0024] Select 3D modeling tool, choose Maya, 3ds Max or Blender as the 3D modeling tool;

[0025] Learn modeling techniques, including polygonal modeling, surface modeling, and parametric modeling. Polygonal modeling is a method of using polygonal meshes to represent or approximate the surface of an object, and is used to generate models by increasing or decreasing the number of points, lines, and faces or adjusting the positions of points, lines, and faces. Surface modeling uses curves and surfaces to define shapes. Parametric modeling is a method of establishing and analyzing models through parameters, which can be geometric parameters or temperature and material property parameters.

[0026] Design the model, designing the basic shape and structure of the model; using basic shapes in modeling tools as a starting point, then adding details and features, using polygonal modeling, surface modeling, or parametric modeling techniques to create each part of the model;

[0027] Texturing and materials, using texture maps, colors, glossiness, and reflection properties to enhance the appearance of your models;

[0028] Lighting and rendering: adding light sources to the scene, simulating real-world lighting effects, and using rendering engines to generate high-quality images or animations;

[0029] Export and integration: export the model to a format suitable for the Metaverse platform, integrate the model into the Metaverse platform, and interact and share it with other users.

[0030] Preferably, when the collaboration tool is a real-time audio and video conferencing system, the construction of the real-time audio and video conferencing system is specifically as follows:

[0031] Determine system requirements, clarify the target users, usage scenarios, and required functions of the conference system; including whether it supports multi-person real-time audio and video communication, screen sharing, virtual background, and chat functions;

[0032] Choose a technology stack that is suitable for real-time audio and video communication, including WebRTC, RTMP, etc.; choose a backend technology stack to handle user authentication, conference management, and signal transmission tasks, including Node.js, Python, Java language and corresponding frameworks, etc.;

[0033] Design system architecture, design the overall architecture of the system, including client, server and database components, determine the network topology of the system, and ensure that audio and video data can be efficiently transmitted between users in different geographical locations;

[0034] Determine the network topology of the system for efficient transmission of audio and video data between users in different geographical locations;

[0035] Implement audio and video encoding and decoding, use audio and video encoding and decoding algorithms to compress and decompress the collected audio and video data; select audio and video formats and encoding parameters to adapt to different devices and network conditions;

[0036] Realize real-time transmission, use WebRTC technology to achieve real-time transmission of audio and video data, ensure that data can maintain low latency and high quality during transmission, and realize signaling transmission to coordinate communication and conference management between different users;

[0037] Develop client interface, design and implement user-friendly client interface, including audio and video acquisition device selection, conference joining, screen sharing, chat function, etc., and ensure that the interface can run well on different devices and browsers;

[0038] Implement conference management functions, develop server-side logic to handle conference creation, user joining, leaving, and permission management tasks, implement real-time monitoring and fault handling mechanisms during the conference, and ensure the stability and availability of the conference;

[0039] Testing and optimization: Test the system under different devices and network conditions, and optimize and improve it based on the test results to improve system performance and user experience.

[0040] A method for efficient interactive collaboration in a metaverse space, comprising the following steps:

[0041] Users log in to the Metaverse space through a terminal device that uses a communication protocol optimization module and choose to participate in an interactive and collaborative session;

[0042] The system allocates corresponding interactive collaboration interfaces and functions according to the user's role and authority;

[0043] The system innovates the interactive mode module, adopts natural interaction based on gesture recognition, voice control and interaction based on eye tracking. The interactive mode enables users to perform interactive operations more naturally and conveniently, thus improving the interaction efficiency.

[0044] The system provides collaborative tools through multiple collaborative tool modules. The collaborative tools are used to support real-time communication, information sharing, and task collaboration needs among users.

[0045] Through the intelligent collaboration assistance module, the system conducts intelligent analysis and recommendations based on user behavior and task requirement information, and provides users with collaboration suggestions and resource support; through the intelligent collaboration assistance module, users can complete collaborative tasks more efficiently.

[0046] Therefore, the present invention adopts the above-mentioned metaverse space efficient interactive collaboration system and method to solve the problems of communication delay, single interaction method and insufficient collaboration tools in the prior art.

[0047] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] Figure 1 It is a schematic diagram of the structure of an embodiment of a metaverse space efficient interactive collaboration system of the present invention;

[0049] Reference numerals

[0050] 1. Communication protocol optimization module; 2. Interaction mode innovation module; 3. Multi-collaboration tool module; 4. Intelligent collaboration assistance module. DETAILED DESCRIPTION

[0051] Example

[0052] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Generally, the components of the embodiments of the present invention described and shown in the drawings here can be arranged and designed in various different configurations.

[0053] like Figure 1 As shown, a metaverse space efficient interactive collaboration system includes:

[0054] Communication protocol optimization module 1 adopts low-latency, high-bandwidth transmission protocol to ensure real-time transmission of information between users; and has data encryption and verification mechanisms to ensure the security of the communication process; transmission protocols include TCP transmission control protocol, UDP user datagram protocol, WebSocket protocol, QUIC fast UDP Internet connection protocol, HTTP hypertext transfer protocol and HTTPS secure hypertext transfer protocol, etc.

[0055] TCP (Transmission Control Protocol): TCP is a connection-oriented, reliable, byte-stream-based transport layer communication protocol. It is often used in scenarios in the Metaverse where data integrity and reliability need to be guaranteed, such as file transfer, real-time chat, etc.

[0056] UDP (User Datagram Protocol): UDP is a connectionless protocol that does not establish a connection before transmitting data, so the transmission speed is fast, but the data reliability is relatively low. In the metaverse, UDP is often used in scenarios with high real-time requirements but low data integrity requirements, such as real-time voice communication, real-time video transmission, etc.

[0057] WebSocket: WebSocket is a protocol for full-duplex communication over a single TCP connection. It allows the server to actively push information to the client, and the client can immediately respond after receiving the information, without having to establish multiple connections like HTTP. In the metaverse, WebSocket is often used in scenarios that require real-time interaction and data updates, such as multiplayer online games, real-time map updates, etc.

[0058] QUIC (Quick UDP Internet Connections): QUIC is a UDP-based protocol that provides reliability, flow control, and congestion control features similar to TCP, but with lower latency and higher performance. QUIC may be used in scenarios that require high performance and real-time performance in the Metaverse, such as VR / AR applications, remote desktops, etc.

[0059] HTTP / HTTPS: HTTP (Hypertext Transfer Protocol) and HTTPS (Secure Hypertext Transfer Protocol) are commonly used communication protocols on the Web. In the Metaverse, HTTP / HTTPS may be used by clients to obtain static resources from servers, API requests, etc. However, due to the high latency of HTTP / HTTPS, it may not be suitable for scenarios that require real-time interaction.

[0060] Interaction mode innovation module 2 adopts several innovative interaction modes, including natural interaction based on gesture recognition, voice control, and interaction based on eye tracking. The interaction mode enables users to perform interaction operations more naturally and conveniently, thus improving interaction efficiency.

[0061] The natural interaction based on gesture recognition in the interactive mode innovation module 2 specifically includes vision-based gesture recognition, structured light-based gesture recognition, millimeter-wave radar-based gesture recognition, deep learning-based gesture recognition, and multimodal gesture recognition.

[0062] The specific examples of gesture recognition based on vision are: using a camera to capture the user's hand movements, and using image processing techniques, including edge detection, shape matching, and deep learning techniques, to identify the user's gestures; once the gesture is recognized, it is mapped to the corresponding interactive operation in the virtual world; the specific examples of gesture recognition based on structured light are: by projecting a known pattern of light onto the user's hand, and using an infrared sensor to receive the reflected light, the spatial position and posture of the user's hand are obtained by analyzing the deformation and displacement of the reflected light; the specific examples of gesture recognition based on millimeter wave radar are: the millimeter wave radar detects the position and speed of the target object by emitting radio waves and receiving echoes. In gesture recognition, the millimeter wave radar detects the movement and posture changes of the user's hand; the specific examples of gesture recognition based on deep learning are: by training a large amount of gesture data, the deep learning model learns the characteristics and patterns of gestures to achieve gesture recognition; the specific examples of multimodal gesture recognition are: combining several sensor technologies, including cameras, infrared sensors, accelerometers, etc., to capture the user's gestures; by fusing data from multiple information sources, the system obtains more accurate and comprehensive gesture recognition results.

[0063] The interaction based on eye tracking in the interactive mode innovation module 2 specifically includes:

[0064] Eye tracking and positioning: Eye tracking technology is used to track the user's gaze by measuring the position of the eye's gaze point or the movement of the eyeball relative to the head. It uses infrared cameras and LED devices to capture images of human eyes or faces, and then uses algorithms to detect, locate and track faces and eyes.

[0065] Intention inference: Infer the user's intention based on eye tracking data. If the user stares at a virtual button or link for a long time, the user has the intention to click or interact. Intention inference is used to trigger specific interactive events or actions to improve the naturalness and intuitiveness of the interaction.

[0066] User feedback and interaction optimization. Eye tracking data is also used to collect user feedback and optimize the interaction design of the virtual world. By analyzing the user's gaze trajectory and dwell time, we can understand the user's attention and interest in interface elements, thereby adjusting the layout, color and size attributes to improve the user experience.

[0067] The multi-collaboration work module provides a variety of collaboration tools, including shared virtual whiteboards, 3D modeling tools, real-time audio and video conferencing systems, etc., to support real-time communication, information sharing, and task collaboration between users, further improving collaboration efficiency;

[0068] When the collaboration tool is a shared virtual whiteboard, the construction of the shared virtual whiteboard is as follows:

[0069] Demand analysis to clarify the functional requirements of the virtual whiteboard, including support for simultaneous editing by multiple people, support for the insertion of multiple elements such as text, graphics, and pictures, and support for real-time saving and sharing;

[0070] Design the virtual whiteboard interface, including toolbar, editing area, save and share buttons;

[0071] 3D modeling and rendering: Use 3D modeling software to create a 3D model of the virtual whiteboard, including background, toolbar, and editing area elements; import it into the Metaverse platform and use real-time rendering technology to present it in the virtual space, optimize rendering performance, and ensure smooth operation under different devices and network conditions;

[0072] Implement user interaction and write code to implement the interaction between the user and the virtual whiteboard. The interaction functions include responding to the user's mouse clicks, keyboard input events, and updating the status of the virtual whiteboard; using input devices to capture user operations and convert them into editing commands for the virtual whiteboard; implementing the function of multiple people editing at the same time to ensure that the operations between different users can be synchronized and updated in real time;

[0073] Testing and optimization: testing the virtual whiteboard under different devices and network conditions to ensure that it can operate normally in various situations; collecting user feedback and optimizing and improving the virtual whiteboard based on the feedback;

[0074] Integrate the constructed virtual whiteboard into the Metaverse platform, and seamlessly connect it with other virtual scenes and interactive functions to ensure that the interaction between the virtual whiteboard and other virtual objects and users is natural and smooth.

[0075] When the collaboration tool is a 3D modeling tool, the construction of the 3D modeling tool is specifically as follows:

[0076] Select 3D modeling tool, choose Maya, 3ds Max or Blender as the 3D modeling tool;

[0077] Learn modeling techniques, including polygonal modeling, surface modeling, and parametric modeling. Polygonal modeling is a method of using polygonal meshes to represent or approximate the surface of an object, and is used to generate models by increasing or decreasing the number of points, lines, and faces or adjusting the positions of points, lines, and faces. Surface modeling uses curves and surfaces to define shapes. Parametric modeling is a method of establishing and analyzing models through parameters, which can be geometric parameters or temperature and material property parameters.

[0078] Design the model, designing the basic shape and structure of the model; using basic shapes in modeling tools as a starting point, then adding details and features, using polygonal modeling, surface modeling, or parametric modeling techniques to create each part of the model;

[0079] Texturing and materials, using texture maps, colors, glossiness, and reflection properties to enhance the appearance of your models;

[0080] Lighting and rendering: adding light sources to the scene, simulating real-world lighting effects, and using rendering engines to generate high-quality images or animations;

[0081] Export and integration: export the model to a format suitable for the Metaverse platform, integrate the model into the Metaverse platform, and interact and share it with other users.

[0082] When the collaboration tool is a real-time audio and video conferencing system, the construction of the real-time audio and video conferencing system is specifically as follows:

[0083] Determine system requirements, clarify the target users, usage scenarios, and required functions of the conference system; including whether it supports multi-person real-time audio and video communication, screen sharing, virtual background, and chat functions;

[0084] Choose a technology stack that is suitable for real-time audio and video communication, including WebRTC, RTMP, etc.; choose a backend technology stack to handle user authentication, conference management, and signal transmission tasks, including Node.js, Python, Java language and corresponding frameworks, etc.;

[0085] Design system architecture, design the overall architecture of the system, including client, server and database components, determine the network topology of the system, and ensure that audio and video data can be efficiently transmitted between users in different geographical locations;

[0086] Determine the network topology of the system for efficient transmission of audio and video data between users in different geographical locations;

[0087] Implement audio and video encoding and decoding, use audio and video encoding and decoding algorithms to compress and decompress the collected audio and video data; select audio and video formats and encoding parameters to adapt to different devices and network conditions;

[0088] Realize real-time transmission, use WebRTC technology to achieve real-time transmission of audio and video data, ensure that data can maintain low latency and high quality during transmission, and realize signaling transmission to coordinate communication and conference management between different users;

[0089] Develop client interface, design and implement user-friendly client interface, including audio and video acquisition device selection, conference joining, screen sharing, chat function, etc., and ensure that the interface can run well on different devices and browsers;

[0090] Implement conference management functions, develop server-side logic to handle conference creation, user joining, leaving, and permission management tasks, implement real-time monitoring and fault handling mechanisms during the conference, and ensure the stability and availability of the conference;

[0091] Testing and optimization: Test the system under different devices and network conditions, and optimize and improve it based on the test results to improve system performance and user experience.

[0092] Intelligent collaboration assistance module 4 performs intelligent analysis and recommendation based on user behavior and task requirement information, and provides users with personalized collaboration suggestions and resource support; through intelligent collaboration assistance module 4, users can complete collaborative tasks more efficiently.

[0093] The intelligent collaboration auxiliary module 4 provides intelligent analysis and recommendations by analyzing the user's behavior and task requirement information, thereby optimizing the workflow and improving efficiency. The intelligent collaboration auxiliary module 4 performs intelligent analysis and recommendations based on user behavior and task requirement information, including at least:

[0094] 1. User behavior analysis, which can track and record various user behaviors, including but not limited to:

[0095] Interaction data: such as clicks, scrolling, input, etc., which can reveal user preferences and habits. Time patterns: when users start and end tasks, and how long they spend on tasks. Path analysis: the navigation path users take on the interface, which can reveal how they find and complete tasks.

[0096] 2. Task requirement information, in addition to user behavior, also considers the specific requirements of the task, including:

[0097] Task type: Is it creative, repetitive, or decision-making? Task complexity: How many steps and resources does the task require? Deadline: When does the task need to be completed? Dependencies: Does the task depend on other tasks or resources?

[0098] 3. Intelligent analysis: Based on the above data, the following intelligent analysis is performed: Prediction model: Use machine learning algorithms to predict users' future behavior or task requirements. Pattern recognition: Identify common patterns of user behavior, such as bottlenecks or optimization points in the workflow. Anomaly detection: Discover abnormal situations that are inconsistent with users' regular behavior or task requirements.

[0099] 4. The recommendation system provides the following recommendations based on the results of intelligent analysis: Personalized recommendations: Provide personalized workflow or interface layout recommendations based on user preferences and habits. Optimization strategies: Provide optimization strategies for task requirements, such as reallocating resources, adjusting deadlines, or optimizing task order. Exception handling: Provide solutions or recommended alternative paths when an abnormal situation is detected.

[0100] A method for efficient interactive collaboration in a metaverse space, comprising the following steps:

[0101] The user logs into the Metaverse space through a terminal device using the communication protocol optimization module 1 and chooses to participate in an interactive collaborative session;

[0102] The system allocates corresponding interactive collaboration interfaces and functions according to the user's role and authority;

[0103] The system uses interactive mode innovation module 2, adopting natural interaction based on gesture recognition, voice control and interaction based on eye tracking. The interactive mode enables users to perform interactive operations more naturally and conveniently, thus improving the interaction efficiency.

[0104] The system provides collaborative tools through the multi-collaboration tool module 3. The collaborative tools are used to support real-time communication, information sharing, and task collaboration needs among users, further improving collaboration efficiency;

[0105] The system uses the intelligent collaboration assistance module 4 to perform intelligent analysis and recommendations based on user behavior and task requirement information, and provides users with collaboration suggestions and resource support; through the intelligent collaboration assistance module 4, users can complete collaborative tasks more efficiently.

[0106] Therefore, the present invention adopts the above-mentioned metaverse space efficient interactive collaboration system and method to solve the problems of communication delay, single interaction method, and insufficient collaboration tools.

[0107] Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that they can still modify or replace the technical solution of the present invention with equivalents, and these modifications or equivalent replacements cannot cause the modified technical solution to deviate from the spirit and scope of the technical solution of the present invention.

Claims

1. A highly efficient interactive collaboration system for the metaverse space, characterized in that: include: The communication protocol optimization module adopts a low-latency, high-bandwidth transmission protocol to ensure real-time transmission of information between users; it also has data encryption and verification mechanisms to ensure the security of the communication process; The interactive mode innovation module adopts several innovative interactive modes, including natural interaction based on gesture recognition, voice control, and interaction based on eye tracking; Multi-collaboration work module, providing collaboration tools, including shared virtual whiteboards, 3D modeling tools, and real-time audio and video conferencing systems, to support real-time communication, information sharing, and task collaboration needs among users; The intelligent collaboration assistance module performs intelligent analysis and recommendations based on user behavior and task requirement information, providing users with personalized collaboration suggestions and resource support.

2. The efficient interactive collaboration system of the metaverse space according to claim 1, characterized in that: The transmission protocols used by the communication protocol optimization module include TCP transmission control protocol, UDP user datagram protocol, WebSocket protocol, QUIC fast UDP Internet connection protocol, HTTP hypertext transfer protocol and HTTPS secure hypertext transfer protocol.

3. The efficient interactive collaboration system of the metaverse space according to claim 1, characterized in that: The natural interaction based on gesture recognition of the interactive mode innovation module specifically includes vision-based gesture recognition, structured light-based gesture recognition, millimeter-wave radar-based gesture recognition, deep learning-based gesture recognition and multimodal gesture recognition.

4. The efficient interactive collaboration system of the metaverse space according to claim 3 is characterized in that: Vision-based gesture recognition is as follows: using a camera to capture the user's hand movements, and using image processing technology to identify the user's gestures; once the gesture is recognized, it is mapped to the corresponding interactive operation in the virtual world; structured light-based gesture recognition is as follows: by projecting a known pattern of light onto the user's hand, and using an infrared sensor to receive the reflected light, the spatial position and posture of the user's hand are obtained by analyzing the deformation and displacement of the reflected light; millimeter-wave radar-based gesture recognition is as follows: millimeter-wave radar detects the position and speed of the target object by emitting radio waves and receiving echoes. In gesture recognition, millimeter-wave radar detects the movement and posture changes of the user's hand; deep learning-based gesture recognition is as follows: by training a large amount of gesture data, the deep learning model learns the characteristics and patterns of gestures to achieve gesture recognition; multimodal gesture recognition is as follows: combining several sensor technologies to capture the user's gesture movements; by fusing data from multiple information sources, the system obtains gesture recognition results.

5. The efficient interactive collaboration system of the metaverse space according to claim 1, characterized in that: The eye-tracking-based interactions in the interactive mode innovation module include: Eye tracking and positioning: Eye tracking technology is used to track the user's gaze by measuring the position of the eye's gaze point or the movement of the eyeball relative to the head. It uses infrared cameras and LED devices to capture images of human eyes or faces, and then uses algorithms to detect, locate and track faces and eyes. Intention inference: Infer the user's intention based on eye tracking data. If the user stares at a virtual button or link for a long time, the user has the intention to click or interact. Intention inference is used to trigger specific interactive events or actions. User feedback and interaction optimization. Eye tracking data is also used to collect user feedback and optimize the interaction design of the virtual world. By analyzing the user's gaze trajectory and dwell time, we can understand the user's attention and interest in interface elements, and thus adjust the layout, color, and size attributes.

6. The efficient interactive collaboration system of the metaverse space according to claim 1, characterized in that: When the collaboration tool is a shared virtual whiteboard, the construction of the shared virtual whiteboard is as follows: Demand analysis to clarify the functional requirements of the virtual whiteboard, including support for simultaneous editing by multiple people, support for the insertion of multiple elements such as text, graphics, and pictures, and support for real-time saving and sharing; Design the virtual whiteboard interface, including toolbar, editing area, save and share buttons; 3D modeling and rendering, using 3D modeling software to create a 3D model of the virtual whiteboard, including background, toolbar, and editing area elements; Import it into the Metaverse platform and present it in the virtual space using real-time rendering technology to optimize rendering performance; Implement user interaction and write code to implement the interaction between the user and the virtual whiteboard. The interaction function includes responding to the user's mouse clicks, keyboard input events, and updating the status of the virtual whiteboard; Using input devices to capture user actions and convert them into editing commands for the virtual whiteboard; Realize the function of multiple people editing at the same time to ensure that the operations between different users can be synchronized and updated in real time; Testing and optimization: testing the virtual whiteboard under different devices and network conditions; Collect user feedback and optimize and improve the virtual whiteboard based on the feedback; Integrate into the Metaverse platform, integrate the constructed virtual whiteboard into the Metaverse platform, and seamlessly connect with other virtual scenes and interactive functions.

7. The efficient interactive collaboration system of the metaverse space according to claim 1, characterized in that: When the collaboration tool is a 3D modeling tool, the construction of the 3D modeling tool is specifically as follows: Select 3D modeling tool, choose Maya, 3ds Max or Blender as the 3D modeling tool; Learn modeling techniques, including polygonal modeling, surface modeling, and parametric modeling. Polygonal modeling is a method of using polygonal meshes to represent or approximate the surface of an object, and is used to generate models by increasing or decreasing the number of points, lines, and faces or adjusting the positions of points, lines, and faces. Surface modeling uses curves and surfaces to define shapes. Parametric modeling uses parameters to establish and analyze models. Design the model, designing the basic shape and structure of the model; using basic shapes in modeling tools as a starting point, then adding details and features, using polygonal modeling, surface modeling, or parametric modeling techniques to create each part of the model; Texturing and materials, using texture maps, colors, glossiness, and reflection properties to enhance the appearance of your models; Lighting and rendering: adding light sources to the scene, simulating real-world lighting effects, and using rendering engines to generate images or animations; Export and integration: export the model to a format suitable for the Metaverse platform, integrate the model into the Metaverse platform, and interact and share it with other users.

8. The efficient interactive collaboration system of the metaverse space according to claim 1, characterized in that: When the collaboration tool is a real-time audio and video conferencing system, the construction of the real-time audio and video conferencing system is specifically as follows: Determine system requirements, clarify the target users, usage scenarios, and required functions of the conference system; including whether it supports multi-person real-time audio and video communication, screen sharing, virtual background, and chat functions; Select a technology stack, including WebRTC and RTMP; select a backend technology stack to handle user authentication, conference management, and signal transmission tasks, including Node.js, Python, Java, and corresponding frameworks; Design system architecture, design the overall architecture of the system, including client, server and database components; Determine the network topology of the system for efficient transmission of audio and video data between users in different geographical locations; Implement audio and video encoding and decoding, use audio and video encoding and decoding algorithms to compress and decompress the collected audio and video data; select audio and video formats and encoding parameters to adapt to different devices and network conditions; Realize real-time transmission, use WebRTC technology to achieve real-time transmission of audio and video data, ensure that data can maintain low latency and high quality during transmission, and realize signaling transmission to coordinate communication and conference management between different users; Develop client interface, design and implement user-friendly client interface, including audio and video acquisition device selection, conference joining, screen sharing, and chat functions; Implement conference management functions, develop server-side logic to handle conference creation, user joining, leaving, and permission management tasks, implement real-time monitoring and fault handling mechanisms during the conference, and ensure the stability and availability of the conference; Testing and optimization: test the system under different equipment and network conditions, and optimize and improve it based on the test results.

9. A method for efficient interactive collaboration in a metaverse space, characterized in that: The following steps are involved: Users log in to the Metaverse space through a terminal device that uses a communication protocol optimization module and choose to participate in an interactive and collaborative session; The system allocates corresponding interactive collaboration interfaces and functions according to the user's role and authority; The system innovates the interactive mode module, adopting natural interaction based on gesture recognition, voice control and interaction based on eye tracking; The system provides collaborative tools through multiple collaborative tool modules. The collaborative tools are used to support real-time communication, information sharing, and task collaboration needs among users. The system uses the intelligent collaboration assistance module to perform intelligent analysis and recommendations based on user behavior and task requirement information, providing users with collaboration suggestions and resource support; and completes collaboration tasks through the intelligent collaboration assistance module.

Citation Information

Cited By

  • Universe-based workshop logistics system joint research and development method and system

    CN120046374A