A distributed metaverse storage construction method and system

Through the distributed storage construction method of HDFS system and multi-master control nodes, the metacosmic data is sharded and mapped using functional tag information, solving the problem of inefficient construction of a single main organization and achieving efficient metacosmic data storage and processing.

CN118567578BActive Publication Date: 2024-11-15ZHEJIANG POST & TELECOMM
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411037286.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-07-31
Publication Date
2024-11-15
Estimated Expiration
2044-07-31

AI Technical Summary

Technical Problem

The existing meta-universe storage construction method is inefficient due to the construction of a single main organization, and the huge amount of data processing is under great pressure, making it difficult to meet the storage needs of the meta-universe.

Method used

The HDFS system is used for distributed storage and processing, and communication connection is built through multiple master control nodes to realize distributed storage and processing of metacosmic data. The data is sharded and mapped using functional tag information to improve processing efficiency.

Benefits of technology

It significantly reduces the data storage and processing pressure during the construction of the metaverse, improves data processing efficiency, and realizes efficient storage and processing of GB, TB and even PB levels of data.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118567578B_ABST
    Figure CN118567578B_ABST
Patent Text Reader

Abstract

The present invention provides a distributed metaverse storage construction method and system, including: configuring a master control node according to a metaverse client in an HDFS system, wherein each master control node maintains multiple storage nodes, and the corresponding master control node receives data from the corresponding metaverse client; defining a first master control node to obtain request information of the corresponding metaverse client, the first master control node determines whether there is a function tag in the request information, and generates a query request including other second master control nodes according to the function tag, after the query request is sent to the second master control node, the second master control node determines whether the function tag exists in its own node; if the function tag exists in the second master control node itself, a response message is generated to accept the request information of the metaverse client corresponding to the first master control node; the second master control node performs the corresponding metaverse data operation according to the request information.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of metaverse technology, and in particular to a distributed metaverse storage construction method and system. Background Art

[0002] At present, metaverse technologies include virtual reality (VR), augmented reality (AR) and mixed reality (MR), which generate virtual environments through computers or superimpose virtual information into the real world to provide users with an immersive experience. However, the storage construction method of the above metaverse is still to build and store related models through a host. However, the metaverse model built by a single host involves a huge amount of model design calculations, which makes the model construction inefficient. In addition, since the metaverse involves a huge amount of data such as model rendering, the existing storage method after the metaverse is built is also under great pressure. Summary of the invention

[0003] One of the inventive purposes of the present invention is to provide a distributed metaverse storage construction method and system, which utilizes the HDFS system to perform distributed storage and construction of metaverse-related data. The HDFS system can realize GB, TB, or even PB-level distributed storage and processing of data, thereby greatly reducing the pressure of data storage and processing during the construction of the metaverse. The HDFS system can realize efficient storage and processing of metaverse data.

[0004] Another inventive object of the present invention is to provide a distributed metaverse storage construction method and system, wherein the method and system utilize the HDFS system to construct multiple master nodes according to the number and position of the execution subjects, wherein the multiple master nodes establish communication connections, and perform distributed storage construction of metaverse data under multiple master nodes under certain standards. The multiple master nodes store the distributed constructed metaverse data in the storage nodes managed by themselves, and perform analysis, processing and transmission of relevant metaverse data through the corresponding master nodes, thereby realizing distributed processing of distributed metaverse data and improving the processing efficiency of the metaverse data.

[0005] Another inventive object of the present invention is to provide a distributed metaverse storage construction method and system, which constructs the function label information processed by each function module of the metaverse, and generates a metaverse construction processing request based on the function label information and sends it to the current master node of the HDFS system. The current master node sends the metaverse construction processing request containing the function label information to another master node, and the other master node performs the corresponding metaverse construction processing operation according to the metaverse construction processing request, and stores the metaverse data generated by the construction processing operation in the storage node maintained by the other master node, and binds and saves the function label information; the present invention can realize distributed processing and storage of metaverse data in the above manner.

[0006] In order to achieve at least one of the above-mentioned invention objects, the present invention further provides a distributed metaverse storage construction method, the method comprising:

[0007] In the HDFS system, a corresponding number of master nodes are configured according to the number of Metaverse clients, wherein each of the master nodes maintains a plurality of storage nodes, and the corresponding master node receives data of the corresponding Metaverse client;

[0008] Define a first master control node to obtain request information of a corresponding metaverse client, the first master control node determines whether there is a function tag in the request information, and generates a query request including other second master control nodes according to the function tag. After the query request is sent to the second master control node, the second master control node determines whether the function tag exists in its own node;

[0009] If the function tag exists in the second master control node itself, a response message is generated to accept the request information of the metaverse client corresponding to the first master control node;

[0010] After the second master control node obtains the request information of the Metaverse client corresponding to the first master control node, it analyzes and executes the content in the request information, and sends the request information to the Metaverse client of the second master control node.

[0011] According to one of the preferred embodiments of the present invention, each of the Metaverse clients is bound to a master control node, and each of the Metaverse clients sends a list of function labels related to Metaverse operations to the bound master control node in advance, wherein the bound master control node stores the list of function labels in its own node, and uses the master control node to establish a mapping list of each function label and Metaverse file to the storage node, wherein the mapping list constructs an address mapping of the Metaverse file related to the function label in the corresponding storage node, and the mapping list is used to search for Metaverse files of corresponding functions in the storage nodes maintained by the master control node.

[0012] According to another preferred embodiment of the present invention, when the Metaverse client bound to the first master control node needs to collaboratively construct corresponding Metaverse data or process corresponding Metaverse data, a function tag of a corresponding type is selected according to the type of Metaverse data that needs to be constructed or processed, and the function tag is encapsulated into the request information of the Metaverse client. The first master control node parses the request information of the bound Metaverse client, and obtains the function tag in the request information, which is used to encapsulate the function tag into a query message of the first master control node. The query message is also used to query the function tag mapping list of the first master control node. If the corresponding function tag exists in the function tag mapping list of the first master control node, a communication connection with the storage node maintained by the first master control node is established according to the mapping address of the function tag mapping list.

[0013] According to another preferred embodiment of the present invention, when the function tag sent by the binding client does not exist in the function tag mapping list in the first master control node, the first master control node encapsulates the function tag of the binding client into a query request to other second master control nodes, and the other second master control nodes parse the query request information of the first master control node to obtain the corresponding function tag, and compare the function tag with the function tag mapping list stored in the second master control node itself. If the corresponding function tag does not exist, no response message is returned.

[0014] According to another preferred embodiment of the present invention, the request information of the Metaverse client bound to the first master control node includes method instructions for processing operations related to Metaverse data, wherein the method instructions for Metaverse data processing operations include: Metaverse data collection instructions, Metaverse data classification and grading instructions, Metaverse data storage instructions, Metaverse data visualization rendering instructions, Metaverse data migration instructions and Metaverse data merging processing instructions; wherein each Metaverse data processing operation method sends corresponding method instructions according to the actual needs of the Metaverse client corresponding to the first master control point.

[0015] According to another preferred embodiment of the present invention, when the second master control node returns the request information of the Metaverse client bound to the first master control node, the request information is sent to the second master control node, and the second master control node sends the method instruction of the Metaverse data processing operation to the Metaverse client bound to itself, and after the Metaverse client of the second master control node receives the method instruction of the Metaverse data processing operation, it executes the corresponding Metaverse data processing operation according to the method instruction.

[0016] According to another preferred embodiment of the present invention, the second master control node of the HDFS system obtains the metaverse operation data obtained by the metaverse client bound to itself executing the method instructions, and the second master control node divides the metaverse operation data into n data blocks according to the functional type of the metaverse operation data, wherein the n data blocks with the same functional type are stored in a storage node maintained by the second master control node, and a mapping relationship is established with the function label in the storage node corresponding to the second master control node, and a function label mapping list is constructed in the second master control node for querying and obtaining the corresponding metaverse operation data.

[0017] According to another preferred embodiment of the present invention, after the second master control node receives the request information of the Metaverse client corresponding to the first master control node, it queries the function label mapping list stored in the second master control node according to the function label in the request information and the method instructions for operating the Metaverse data, and obtains the mapping address of the corresponding Metaverse data in the storage node according to the function label mapping list in the second master control node, and the second master control node returns the mapping address to the Metaverse client bound to the first master control node. After receiving the mapping address, the Metaverse client bound to the first master control node establishes a communication connection with the corresponding storage node.

[0018] In order to achieve at least one of the above-mentioned invention purposes, the present invention further provides a distributed metaverse storage construction system, which executes the above-mentioned distributed metaverse storage construction method.

[0019] The present invention further provides a computer-readable storage medium, which stores a computer program, and the computer program is executed by a processor to implement the above-mentioned distributed metaverse storage construction method. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 Shown is a flow chart of a distributed metaverse storage construction method of the present invention. DETAILED DESCRIPTION

[0021] The following description is used to disclose the present invention so that those skilled in the art can implement the present invention. The preferred embodiments described below are only examples, and those skilled in the art can think of other obvious variations. The basic principles of the present invention defined in the following description can be applied to other embodiments, variations, improvements, equivalents, and other technical solutions that do not deviate from the spirit and scope of the present invention.

[0022] It is to be understood that the term "one" should be understood as "at least one" or "one or more", that is, in one embodiment, the number of an element may be one, while in another embodiment, the number of the element may be multiple, and the term "one" should not be understood as a limitation on the quantity.

[0023] Please combine Figure 1 The present invention discloses a distributed metaverse storage construction method and system, wherein the method includes: first, it is necessary to construct multiple distributed master control nodes (name nodes) in the HDFS system, wherein each master control node establishes a communication connection with a metaverse client, and it should be noted that each of the above-mentioned metaverse clients can be distributedly configured according to the location of the master control node, that is, the master control node is bound to a corresponding metaverse client, wherein different metaverse clients can be distributedly configured in different locations. And each of the master control nodes maintains multiple storage nodes (date nodes), and the master control node can maintain storage nodes that are close to its own node location and have good network communication performance. The present invention defines a first master control node and a second master control node, wherein the first master control node is a request node, and the second master control node is an execution node, and the first master control node sends the relevant request information to the second master control node, and the second master control node performs the corresponding metaverse data construction, storage and processing operations according to the relevant request of the first master node. It should be noted that the first master control node and the second master control node can be set to multiple respectively, and the corresponding master control nodes can perform identity conversion under different tasks, that is, the second master control node can also be a request node, and the first master node can also be an execution node. Therefore, the present invention utilizes the multi-master node configuration of the distributed file system of the HDFS system to achieve distributed construction and processing of the metaverse data.

[0024] When the function tag sent by the binding client does not exist in the function tag mapping list in the first master control node, the first master control node encapsulates the function tag of the binding client into a query request to other second master control nodes. The other second master control nodes parse the query request information of the first master control node to obtain the corresponding function tag, and compare the function tag with the function tag mapping list stored in the second master control node itself. If the corresponding function tag does not exist, no response message is returned.

[0025] It is worth mentioning that the request information of the Metaverse client bound to the first master control node includes method instructions for processing operations related to Metaverse data, wherein the method instructions for Metaverse data processing operations include: Metaverse data collection instructions, Metaverse data classification and grading instructions, Metaverse data storage instructions, Metaverse data visualization rendering instructions, Metaverse data migration instructions and Metaverse data merging processing instructions; wherein each Metaverse data processing operation method sends the corresponding method instructions according to the actual needs of the Metaverse client corresponding to the first master control point. The above different method instructions are for execution by the Metaverse client bound to the corresponding second master control node. For example, if a rendering operation of a certain Metaverse scene needs to be performed, the Metaverse data visualization rendering instructions for the corresponding scene can be generated by the Metaverse client bound to the first master control node and sent to the second master control node.

[0026] According to one of the preferred embodiments of the present invention, when the second master control node returns the request information of the Metaverse client bound to the first master control node, the request information is sent to the second master control node, and the second master control node sends the method instruction of the Metaverse data processing operation to the Metaverse client bound to itself. After the Metaverse client of the second master control node receives the method instruction of the Metaverse data processing operation, it executes the corresponding Metaverse data processing operation according to the method instruction.

[0027] The second master control node of the HDFS system obtains the metaverse operation data obtained by the metaverse client bound to itself executing the method instructions. The second master control node divides the metaverse operation data into n data blocks according to the functional type of the metaverse operation data, wherein the n data blocks with the same functional type are stored in the storage node maintained by the second master control node, and a mapping relationship is established with the function label in the storage node corresponding to the second master control node, and a function label mapping list is constructed in the second master control node for querying and obtaining the corresponding metaverse operation data.

[0028] Specifically, since the processing methods of metaverse data are different and the functional modules implemented by the metaverse data are different, the present invention constructs function tags based on the implementation methods of different metaverse data, and uses the function tags as the basis for distributed storage, construction and processing of related metaverse data. Thereby, efficient storage, construction and processing of remote distributed metaverse data are realized. The specific implementation method includes the following steps: when the first master control node obtains the request information of the corresponding metaverse client, the first master control node determines whether there is a function tag in the request information, and generates a query request including other second master control nodes according to the function tag. After the query request is sent to the second master control node, the second master control node determines whether the function tag exists in its own node; if the function tag exists in the second master control node itself, a response message is generated to accept the request information of the metaverse client corresponding to the first master control node; when the second master control node obtains the request information of the metaverse client corresponding to the first master control node, it analyzes and executes the content in the request information, and sends the request information to the metaverse client of the second master control node. Since the request information of the first master control node comes from the bound Metaverse client, when the request information of the first master control node does not have the function tag of the relevant Metaverse, it means that the current Metaverse client does not need to perform the processing of the corresponding Metaverse data, and the request may be the processing of system data. Therefore, the present invention distinguishes through the setting and judgment of the function tag. The second master control node can be configured with different function tag data from the first master control node, so that different Metaverse data processing operations are performed between the first master control node and the second master control node, so that different Metaverse clients can effectively divide the work and cooperate with each other.

[0029] Furthermore, in the present invention, each of the Metaverse clients sends a list of function labels related to Metaverse operations to the bound master node in advance, wherein the bound master node stores the list of function labels in its own node, and uses the master node to establish a mapping list of each function label and Metaverse file to the storage node, wherein the mapping list constructs an address mapping of the Metaverse file related to the function label in the corresponding storage node, and the mapping list is used to search for Metaverse files of corresponding functions in the storage nodes maintained by the master node. When the Metaverse client bound to the first master control node needs to collaboratively construct corresponding Metaverse data or process corresponding Metaverse data, a function tag of a corresponding type is selected according to the type of Metaverse data that needs to be constructed or processed, and the function tag is encapsulated into the request information of the Metaverse client. The first master control node parses the request information of the bound Metaverse client, and obtains the function tag in the request information, which is used to encapsulate the function tag into the query message of the first master control node. The query message is also used to query the function tag mapping list of the first master control node. If the corresponding function tag exists in the function tag mapping list of the first master control node, a communication connection with the storage node maintained by the first master control node is established according to the mapping address of the function tag mapping list. When the second master control node receives the request information of the Metaverse client corresponding to the first master control node, it queries the function label mapping list stored in the second master control node according to the function label in the request information and the method instructions for operating the Metaverse data, and obtains the mapping address of the corresponding Metaverse data in the storage node according to the function label mapping list in the second master control node. The second master control node returns the mapping address to the Metaverse client bound to the first master control node. After receiving the mapping address, the Metaverse client bound to the first master control node establishes a communication connection with the corresponding storage node.

[0030] The embodiments disclosed in the present invention, the process described above with reference to the flowchart can be implemented as a computer software program. The embodiments disclosed in the present invention include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part, and / or installed from a removable medium. When the computer program is executed by the central processing unit (CPU), the above-mentioned functions defined in the method of the present application are executed. It should be noted that the above-mentioned computer-readable medium of the present application can be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium can be, for example, but not limited to, a system, device or device of an electrical, magnetic, optical, electromagnetic, infrared segment, or semiconductor, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to, an electrical connection with one or more wire segments, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In the present application, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries a computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code embodied on the computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, electrical wire, optical cable, RF, etc., or any suitable combination of the foregoing.

[0031] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present invention. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0032] Those skilled in the art should understand that the embodiments of the present invention described above and shown in the accompanying drawings are only examples and do not limit the present invention. The objectives of the present invention have been fully and effectively achieved. The functional and structural principles of the present invention have been demonstrated and explained in the embodiments. Without departing from the principles, the implementation methods of the present invention may be deformed or modified in any way.

Claims

1. A distributed metaverse storage construction method, characterized in that: The method comprises: In the HDFS system, a corresponding number of master nodes are configured according to the number of Metaverse clients, wherein each of the master nodes maintains multiple storage nodes, and the master node receives data of the corresponding Metaverse client; Define a first master control node to obtain request information of a corresponding metaverse client, the first master control node determines whether there is a function tag in the request information, and generates a query request including other second master control nodes according to the function tag. After the query request is sent to the second master control node, the second master control node determines whether the function tag exists in its own node; If the function tag exists in the second master control node itself, a response message is generated to accept the request information of the metaverse client corresponding to the first master control node; After the second master control node obtains the request information of the Metaverse client corresponding to the first master control node, it analyzes and executes the content in the request information, and sends the request information to the Metaverse client of the second master control node; When the second master control node returns the request information of the Metaverse client bound to the first master control node, the request information is sent to the second master control node, and the second master control node sends the method instruction of the Metaverse data processing operation to the Metaverse client bound to itself. After the Metaverse client of the second master control node receives the method instruction of the Metaverse data processing operation, it executes the corresponding Metaverse data processing operation according to the method instruction; The second master control node of the HDFS system obtains the metaverse operation data obtained by the method instructions of the metaverse data processing operation executed by the metaverse client bound to itself, and the second master control node divides the metaverse operation data into n data blocks according to the functional type of the metaverse operation data, wherein the n data blocks with the same functional type are stored in the storage node maintained by the second master control node, and a mapping relationship is established with the function label in the storage node corresponding to the second master control node, and a function label mapping list is constructed in the second master control node for querying and obtaining the corresponding metaverse operation data.

2. A distributed metaverse storage construction method according to claim 1, characterized in that: Each of the Metaverse clients is bound to a master control node, and each of the Metaverse clients sends a list of function labels related to Metaverse operations to the bound master control node in advance, wherein the bound master control node stores the list of function labels in its own node, and uses the master control node to establish a mapping list of each function label and Metaverse file to the storage node, wherein the mapping list constructs an address mapping of the Metaverse file related to the function label in the corresponding storage node, and the mapping list is used to search for Metaverse files of corresponding functions in the storage nodes maintained by the master control node.

3. A distributed metaverse storage construction method according to claim 1, characterized in that: When the Metaverse client bound to the first master control node needs to collaboratively construct corresponding Metaverse data or process corresponding Metaverse data, a function tag of a corresponding type is selected according to the type of Metaverse data that needs to be constructed or processed, and the function tag is encapsulated into the request information of the Metaverse client. The first master control node parses the request information of the bound Metaverse client, and obtains the function tag in the request information, which is used to encapsulate the function tag into the query message of the first master control node. The query message is also used to query the function tag mapping list of the first master control node. If the corresponding function tag exists in the function tag mapping list of the first master control node, a communication connection with the storage node maintained by the first master control node is established according to the mapping address of the function tag mapping list.

4. A distributed metaverse storage construction method according to claim 1, characterized in that: When the function tag sent by the binding client does not exist in the function tag mapping list in the first master control node, the first master control node encapsulates the function tag of the binding client into a query request to other second master control nodes. The other second master control nodes parse the query request information of the first master control node to obtain the corresponding function tag, and compare the function tag with the function tag mapping list stored in the second master control node itself. If the corresponding function tag does not exist, no response message is returned.

5. A distributed metaverse storage construction method according to claim 1, characterized in that: The request information of the Metaverse client bound to the first master control node includes method instructions for processing operations related to Metaverse data, wherein the method instructions for Metaverse data processing operations include: Metaverse data collection instructions, Metaverse data classification and grading instructions, Metaverse data storage instructions, Metaverse data visualization rendering instructions, Metaverse data migration instructions and Metaverse data merging and processing instructions; wherein the method instructions for each Metaverse data processing operation send corresponding method instructions according to the actual needs of the Metaverse client corresponding to the first master control point.

6. A distributed metaverse storage construction method according to claim 1, characterized in that: When the second master control node receives the request information of the Metaverse client corresponding to the first master control node, it queries the function label mapping list stored in the second master control node according to the function label in the request information and the method instructions for operating the Metaverse data, and obtains the mapping address of the corresponding Metaverse data in the storage node according to the function label mapping list in the second master control node. The second master control node returns the mapping address to the Metaverse client bound to the first master control node. After receiving the mapping address, the Metaverse client bound to the first master control node establishes a communication connection with the corresponding storage node.

7. A distributed metaverse storage construction system, characterized in that: The system executes a distributed metaverse storage construction method as described in any one of claims 1-6 above.

8. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and the computer program is executed by a processor to implement a distributed metaverse storage construction method as described in any one of claims 1 to 6.