Method for reproducing meta-universe content, reproduction device, and storage medium

Abstract

A method of reproducing meta-universe content, a reproducing device, and a storage medium are disclosed. The meta-universe content has a data format including a plurality of blocks. The method is performed by the reproducing device and includes virtually loading a first block among the plurality of blocks to a storage area of the reproducing device, acquiring or accessing at least one remaining block other than the first block among the plurality of blocks based on information defined in the first block, and reproducing the meta-universe content according to information defined in the at least one remaining block.

Description

Technical Field

[0001] This invention relates to a method, apparatus, and storage medium for reproducing the contents of the metaverse. Background Technology

[0002] The metaverse, a portmanteau of "meta" meaning virtual and transcendent and "universe" meaning world or universe, refers to the virtual world that connects real life and legally recognized activities in the three-dimensional world, such as professions, finance, and learning. In other words, the metaverse is a concept that represents a more advanced stage than virtual reality (VR). Utilizing virtual avatars allows not only to enjoy games or virtual reality but also to engage in socio-cultural activities similar to those in the real world.

[0003] The Acceleration Studies Foundation (ASF), a nonprofit technology research organization, categorizes the metaverse into four types: augmented reality, life logging, mirror worlds, and virtual worlds.

[0004] Augmented reality (AR) refers to an environment where users interact with seemingly virtual overlapping objects represented in 2D or 3D in real space. It reduces feelings of alienation from virtual worlds and increases immersion. An example of AR is when a user uses a terminal camera to photograph what are now just ruins, and sees digitally constructed replicas of past buildings overlapping on their terminal screen.

[0005] Life recording is a technology that captures, stores, and describes the daily experiences and information of things and people. Users can capture all the moments that happen in their daily lives through text, images, and sound, and store this content on a server for organization and sharing with other users. An example of daily recording is linking sensor-equipped sportswear with a network-connected MP3 player to store and share information such as running distance, calories burned, and music selections.

[0006] A mirror world refers to a virtual world that reflects the real world as realistically and directly as possible, while also expanding upon it in terms of information. A representative example is Google Earth. Google Earth collects satellite images from around the world and updates them periodically, directly reflecting the ever-changing reality. As technology continues to advance, mirror worlds that reflect reality will gradually approach the real world, becoming a significant investment element in the future of virtual reality. Users can browse such mirror worlds and thus gain information about the real world.

[0007] The virtual world is an alternative world constructed from digital data, similar to or completely different from reality. Within the virtual world, users engage in activities similar to those in the real world, such as economic and social activities, through virtual avatars. As the most familiar form of the metaverse, the virtual world is a concept encompassing communities embodied in a three-dimensional computer graphics environment, ranging from online role-playing games to life-oriented virtual worlds like SANDBOX, ZEPETO, and Roblox.

[0008] [Preliminary Technology Documents] [Patent Documents] (Patent Document 1) Korean Patent Publication No. 10-2012-0110942 (October 10, 2012) Summary of the Invention

[0009] The purpose of this invention is to provide a method, apparatus and storage medium for reproducing the content of the metaverse, which can load and reproduce the content of the metaverse based on a data format including multiple blocks, and can be linked with physical or virtual devices corresponding to objects in the metaverse when needed.

[0010] However, the problem to be solved by the present invention is not limited thereto, and various extensions can be made without departing from the spirit and scope of the present invention.

[0011] According to an embodiment of the present invention, a method for reproducing metaverse content, the metaverse content having a data format comprising multiple blocks, the method being performed by a reproduction device, comprising: virtualizing and loading a first block of the multiple blocks into a storage area of ​​the reproduction device; obtaining or accessing at least one remaining block of the multiple blocks other than the first block based on information defined in the first block; and reproducing the metaverse content according to information defined in the at least one remaining block.

[0012] The first block can be an interface block, and the information defined in the first block may include at least one of the following: approval procedures, communication specifications, metaverse content information, abstraction information, and access permission information.

[0013] When obtaining or accessing at least one remaining block based on the information defined in the first block, at least one remaining block can be obtained through a content provider, server, P2P node, or serverless communication method according to the communication specifications defined in the first block.

[0014] At least one remaining block may include a second block. The second block may be an active block and may include at least one of the following: information about the activities of objects within the metaverse, information about their functions, and information about their interfaces.

[0015] According to the interface defined in the second block, the reproduction device can establish a connection with a physical or virtual device corresponding to an object in the metaverse. The physical device can be a physical device capable of communicating with the reproduction device and corresponding to the actual existence of the object in the metaverse, and the virtual device can be a virtual device capable of communicating with the reproduction device and corresponding to the object in the metaverse.

[0016] The reproduction device can remotely control physical or virtual devices within the metaverse based on the interface defined in the second block.

[0017] At least one remaining block may also include at least one of a third block, a fourth block, and a fifth block. The third block may include information about the matter of the object or the object's surrounding environment corresponding to the metaverse content, the fourth block may include information about the design of the object or the object's surrounding environment, and the fifth block may include information about the state of the object or the object's surrounding environment.

[0018] Multiple metaverse contents can correspond to multiple objects. The reproduction device can load the first block of each of the multiple metaverse contents and access the corresponding remaining blocks according to the information defined in each first block, so as to reproduce the combined object or combined scene composed of multiple objects.

[0019] According to another embodiment of the present invention, a reproduction device may be provided, including a processor and a memory, wherein the memory stores a computer program, which, when executed by the processor, causes the reproduction device to perform the aforementioned method for reproducing metaverse content.

[0020] According to another embodiment of the present invention, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by a processor, implements the aforementioned method for reproducing the contents of the metaverse.

[0021] According to the foregoing embodiments, the content of the metaverse can be reproduced based on the block-based data format, and when needed, the interface information of the second block can be used to connect with physical or virtual devices, thereby realizing the reproduction, linkage and remote control of digital twin objects. Attached Figure Description

[0022] Figure 1 A metaverse content format according to an embodiment of the present invention is shown.

[0023] Figure 2 A method for providing metaverse content according to an embodiment of the present invention is illustrated.

[0024] Figure 3 A method for providing multiple metaverse contents is shown according to another embodiment of the present invention.

[0025] Figure 4This is a sequence diagram of a method for reproducing the content of the metaverse according to another embodiment of the present invention. Detailed Implementation

[0026] This invention can be modified in many ways and has many embodiments; therefore, specific embodiments will be illustrated and described in detail with reference to the accompanying drawings.

[0027] However, this is not intended to limit the specific implementation of the present invention, but should be understood to include all modifications, equivalents and even substitutions within the scope of the present invention's ideas and technology.

[0028] While terms such as "first" and "second" are used to describe various constituent elements, the constituent elements are not limited by these terms. The purpose of these terms is solely to distinguish one constituent element from others. For example, without departing from the scope of this invention, a first constituent element may be named a second constituent element, and similarly, a second constituent element may be named a first constituent element.

[0029] When it is mentioned that a certain constituent element is "connected" or "accessed" to other constituent elements, it can be understood as being directly connected to or accessed to other constituent elements, but it can also be understood as the existence of other constituent elements in between. Conversely, when it is mentioned that a certain constituent element is "directly connected" or "directly accessed" to other constituent elements, it can be understood as the absence of other constituent elements in between.

[0030] The terminology used in this application is for illustrative purposes only and is not intended to limit the scope of the invention. Singular expressions include plural expressions unless the context clearly distinguishes them. In this application, terms such as "comprising" or "having" should be understood to specify the presence of features, numbers, steps, actions, constituent elements, components, or combinations thereof as described in the specification, and not to preclude the presence or additional possibilities of one or more other features or numbers, steps, actions, constituent elements, components, or combinations thereof.

[0031] Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention pertains. Terms as defined in commonly used dictionaries should be interpreted as having the same meaning as they have in the context of the relevant art, and should not be construed as having an ideal or overly formal meaning unless expressly defined herein.

[0032] Hereinafter, preferred embodiments of the present invention will be described clearly and in detail with reference to the accompanying drawings, so that those skilled in the art to which this invention pertains can easily implement the invention.

[0033] Metaverse content includes data about objects within the metaverse and / or data about the surrounding environment that constitutes the metaverse. Metaverse content may include, for example, data about user-controllable objects within the metaverse and / or data about the surrounding environment that constitutes the metaverse. Data about objects may include, for example, the object's shape, weight, color, temperature, speech (when the object is a person), sound, odor, taste, etc. Data about the surrounding environment may include air, temperature, sounds, odors, tastes, and tactile sensations around the object.

[0034] Figure 1 A metaverse content format according to an embodiment of the present invention is shown.

[0035] Reference Figure 1 According to one embodiment of the present invention, the metaverse content 100 may include an interface block 101, an activity block 103, a material block 105, a design block 107, a status block 109, and a revision block 111. The metaverse content 100 may also include a reserve block 113.

[0036] Interface block 101 may include at least one of the following: settings for the approval process of providing metaverse content, a communication protocol for transmitting other blocks besides interface block 101, information about metaverse content, and user permissions to access the remaining blocks.

[0037] The communication specifications used to transmit the remaining blocks can be defined, for example, for server-based methods such as a central server managed by the content provider, or P2P and serverless methods. More specifically, in the case of server-based or P2P / serverless methods, the communication specifications used to transmit the remaining blocks can include wired specifications such as Ethernet, HDMI (High-Definition Multimedia Interface), DP (DisplayPort), and USB (Universal Serial Bus), or wireless communication specifications such as Bluetooth, WiFi, 4G, 5G, or 6G.

[0038] The approval process for providing metaverse content may include at least one of the following: deciding to provide metaverse content unconditionally, deciding to provide metaverse content after a separate user confirmation process, or deciding to provide metaverse content if pre-defined conditions are met.

[0039] Information about metaverse content, as an abstract representation of what metaverse content is about, is information that users receiving metaverse content can refer to when purchasing or selecting metaverse content. For example, when transmitting abstract information about the object "car," abstract information about the visual perspective of "car" (e.g., shape, size, etc.) and abstract information about the sensory perspective (e.g., sound, touch, etc.) can be transmitted.

[0040] When purchasing or selecting actual cars or toy cars, live animals or toy animals, it is difficult to distinguish them by appearance alone. Therefore, to improve accuracy, one can confirm the operation and reaction by trying to touch the abstract object, and confirm whether it is a living being by touch.

[0041] On the other hand, the receiving user of metaverse content can refer to abstract information about the metaverse content to infer the purpose or function of objects contained within the content. In this case, additional artificial intelligence technology can be used to automatically read the purpose or function. Here, artificial intelligence can be installed on the receiving user's terminal or external to the terminal, or on a server / cloud drive. For example, artificial intelligence can use abstract information about objects contained in the metaverse content to determine the purpose of the object, try its function, and thus determine the usability of the actual content. This can also constitute a judgment on the validity of the result of the artificial intelligence's judgment. For example, using abstract information about the visual perspective of the object "car," such as its image and size, and abstract information about the functional perspective of the steering wheel, wheels, etc., the receiving user or artificial intelligence can infer the purpose or function of the object and determine it to be "car."

[0042] On the other hand, not only users, but also devices used to reproduce the content of the metaverse can utilize information determined by artificial intelligence.

[0043] It provides abstract information about metaverse content and uses artificial intelligence to determine its purpose or function, so that metaverse content can be shared without setting differentiators or classes for the content, and content can be provided even without classifying specific objects into differentiators or classes.

[0044] Activity block 103 includes information about the functions of objects within the metaverse and information about the interface through which the metaverse reproduction device can communicate with the outside world. Here, the interface-related information included in the activity block may be the same as or different from the communication specifications set in the aforementioned interface block 101.

[0045] Information regarding the function of objects within the metaverse may include, for example, information about rotating the corresponding object clockwise or counterclockwise. The receiving user or artificial intelligence can determine, based on this information related to the object's function, whether the object is a steering wheel or a wheel of a car. In other words, according to an embodiment of the present invention, the metaverse content does not define the purpose of an object, but only its function, thereby enabling the receiving user or artificial intelligence receiving the metaverse content to determine and use the object for various purposes. In other words, the metaverse content only provides the receiving user or artificial intelligence with basic information about the object's function that can be read by the receiving party (i.e., the user or the reproduction device used to reproduce the metaverse content), and the specific utilization or method of use of the object can be entirely determined within the virtual environment connected to the receiving user or artificial intelligence.

[0046] The information regarding the interface through which the metaverse reconstruction device can communicate with the outside world is used to determine the communication (or network) interface used for the connection when the metaverse reconstruction device needs to connect to an external physical or virtual device during metaverse reconstruction.

[0047] Material block 105 includes information about objects within the metaverse and the materials of their surrounding environment. For example, information about materials may include information about the object's material composition, the material's properties (physical information such as shape, color, and weight, and chemical information), or other information about the material (such as odor).

[0048] Design block 107 includes information about the design of objects within the metaverse and / or their surrounding environment. For example, design information may include the object's shape, size, and space. Additionally, design information may include the shape and size of the space surrounding the object. For instance, if the object's surrounding space is a room, the design information may include the room's shape and size.

[0049] The Status block 109 includes information about the state of objects and their surrounding environment within the metaverse. For example, information about the state may include the object's location within the metaverse, the temperature, humidity, wind direction, wind speed, gravity, magnetic field, illuminance, odor, and other information about the surrounding environment, and may also include information about time.

[0050] The revision block 111 includes information about versions of the metaverse content. For example, this version information is provided in a logistic management format similar to the Git concept of version control systems supporting distributed storage, encompassing creation, modification, branching, copying, transfer, correction, updating, referencing, etc. Version updates can be performed automatically, manually, or arbitrarily by the user when metaverse content is provided.

[0051] Preparatory block 113 may include methods for handling transaction content, abstract information based on senses that are difficult to read in reality (e.g., sounds generated from objects or the surrounding environment), and encrypted information for general verification. For example, the methods for handling transaction content may involve processing as stipulated in electronic contracts.

[0052] For example, when converting artworks into metaverse content, the artwork painted on canvas by the artist can be digitized using a precision scanning device. At this point, metaverse content can be directly generated using tools for metaverse content conversion. The precision scanning device can distinguish and scan the size, shape, materials, and features of the artwork. It's not a simple planar scan, but a 5D scan. The 3D point cloud shape of each location in the brush-drawn portion, composed of material and color information, can include material and color information. In this case, the feature elements are treated as physical entities, excluding individual communication or electrical / mechanical operations. However, the physical entities include material information at each location, allowing for prediction of the weight and properties of each part, and include morphological information, which can be generated in the same form as the actual artwork. The scanned results can be stored in the appropriate blocks within the activity block 103, material block 105, and design block 107.

[0053] The generated metaverse content can be protected by non-fungible tokens (NFTs) with special inherent properties or by dedicated private blockchains, public blockchains, PKI, compression algorithms, and other encryption and inherent protection technologies.

[0054] The generated metaverse content has inherent ownership, and ownership can be transferred according to the owner's choice or the rules set when the metaverse content is generated, and usage rights can also be granted.

[0055] As mentioned earlier, metaverse content can only define the function or physical properties of objects, such as materials, design, and state, but not their uses. Therefore, the way an object is used can be determined by the choice of the user who owns or has the right to use it. For example, in the aforementioned example of artwork, while a user can choose to display the artwork so that other users can view it, they can also choose to use it as a table or a piece of wood for a doorway, and as a plank-shaped sled for a game.

[0056] In other words, it allows many people to use metaverse content while protecting ownership, thus ensuring the safe use of metaverse content.

[0057] According to an embodiment of the present invention, when generating metaverse content, content information based on the physical, chemical or conceptual information of the object, information about the object's function, and methods of transaction content are pre-set in the aforementioned interface block 101, activity block 103, material block 105, design block 107, state block 109 or preparation block 113, so that even if the recipient does not perform separate analysis, the inherent nature can be utilized without restriction.

[0058] Figure 2 A method for providing metaverse content according to an embodiment of the present invention is illustrated.

[0059] Reference Figure 2 In step S201, the user or user terminal 220 requests metaverse content from the content provider 210, and the content provider 210 approves the request according to the content provision-related approval procedure in step S203. Here, the content provider providing metaverse content can pre-set and operate the approval procedure settings within the metaverse content interface block 101. Subsequently, the user terminal 220 can become a playback device for reproducing metaverse content.

[0060] The approval process for content provision is defined in the interface block 101 of the corresponding metaverse content format. For example, it can be defined as unconditionally approving a user's request, approving it after another confirmation process, or approving it when certain pre-set conditions are met.

[0061] Here, metaverse content may include content about user-controllable objects within the metaverse and content about the surrounding environment that constitutes the metaverse. For example, in a metaverse application used for driving practice, it may include content about the car (i.e., the object) and content about the driving route (i.e., the surrounding environment).

[0062] If the content request is approved, the content provider 210 transmits the content-related interface block 101 S205 to the user or user terminal 220.

[0063] Based on the structure of the metaverse, metaverse content concerning more than one object can be grouped and transmitted, and in this case, interface blocks 101 related to each object can be transmitted (see reference). Figure 3 For example, in the case of a metaverse used for driving practice, the various interface blocks 101 that constitute the metaverse (e.g., objects such as cars) and the second content (e.g., the surrounding environment such as driving routes) can be grouped and bundled into a single content and then transmitted to the user.

[0064] Interface block 101 can transmit according to a predetermined other communication specification, regardless of the communication specification specified in interface block 101.

[0065] For example, when the content provider 210 is an enterprise or group serving a specific metaverse, the interface block 101 can be sent from the server operated by the enterprise or group to the user terminal 220 via a wired or wireless network. When the content provider is an individual, the interface block 101 can be transmitted to the user terminal 220 via a wired or wireless network in a P2P manner.

[0066] Interface block 101 can be transmitted in a manner that grants inherent permissions. For example, content provider 210 can tokenize interface block 101 to restrict the duration and / or access rights of the corresponding content and transmit it to users. In this case, only users granted access rights can use the content. If there are multiple users, content provider 210 can set individual durations and / or access rights for each user and transmit the tokenized interface block 101.

[0067] When interface block 101 is transmitted, content provider 210 transmits the remaining content-related blocks S207 according to the communication specifications specified in interface block 101.

[0068] On the other hand, in addition to assigning inherent properties to interface block 101, the remaining blocks can also be transmitted in a manner that assigns inherent properties.

[0069] exist Figure 2 The document describes a method for providing metaverse content from content provider 210 to user terminal 220.

[0070] Based on the composition of the metaverse, multiple metaverse contents, such as an object (first metaverse content) and the corresponding object's surrounding environment (second metaverse content), can also be provided to the user terminal 220.

[0071] Figure 3 A method for providing multiple metaverse contents is shown according to another embodiment of the present invention.

[0072] Content provider 210 can first transmit an object (first content) and the corresponding object's surrounding environment (second content) related interface blocks to user terminal 220, and then transmit the remaining blocks to user terminal 220 according to the communication specifications defined in the interface blocks. For example, in the case of a metaverse used for driving practice, each interface block 101 related to the first content (e.g., an object such as a car) and the second content (e.g., the surrounding environment such as a driving route) constituting the metaverse can be transmitted to user terminal 220.

[0073] Specifically, the content provider 210 can first transmit the interface block 201a related to the first content (object) to the user terminal 220, and then, according to the communication specifications defined in the interface block 201a, transmit the remaining blocks related to the corresponding object, namely the activity block, material block, design block, status block, revision block, and / or preparation block, to the user terminal 220.

[0074] The content provider 210 can first transmit the surrounding environment of the object, namely the interface block 201b related to the second content, and then, according to the communication specifications defined in the interface block 201b, transmit the remaining blocks related to the surrounding environment, namely the activity block, material block, design block, status block, revision block and / or preparation block, to the user terminal 220.

[0075] In another embodiment of the present invention, multiple metaverse contents, such as multiple objects (multiple metaverse contents), may also be provided to the user terminal 220.

[0076] Within the metaverse, each necessary object has a corresponding metaverse content format. For example, when representing a car within the metaverse, the car can be represented as a group of objects that the user can directly touch, such as the steering wheel and pedals, and objects that the user cannot directly touch, such as the windshield wipers and glass. In this case, the user or user terminal 220 can obtain metaverse content that groups several objects from the content provider 210 so that the car can be represented.

[0077] In this context, providing grouped, object-related metaverse content for the sake of automobiles, such as... Figure 3 As shown, the content provider 210 can first transmit the interface blocks 101 related to each object to the user terminal 220, and then transmit the remaining blocks related to each object to the user terminal 220 according to the communication specifications defined in the interface blocks 101.

[0078] Figure 4 This is a sequence diagram of a method for reproducing the content of the metaverse according to another embodiment of the present invention.

[0079] Reference Figure 4 A method for reproducing metaverse content according to another embodiment of the present invention, such as Figure 1As shown, metaverse content with a data format comprising multiple blocks can be reproduced, for example, by a reproduction device such as an HMD.

[0080] In step S401, the playback device virtualizes and loads the first block of the plurality of blocks into the storage area of ​​the playback device. Here, the first block may be an interface block.

[0081] In step S403, the reproduction device connects to the physical or virtual device corresponding to the object in the metaverse, according to the interface defined in the second block of the plurality of blocks. Here, the second block can be an active block. Step S403 can be omitted when connection to a physical or virtual device is not required.

[0082] In step S405, the reproduction device reproduces the metaverse content based on the information defined in the remaining blocks (excluding the first block) among the multiple blocks. Here, the remaining blocks may include at least one of the following: active block, material block, design block, state block, modification block, and spare block.

[0083] Users can utilize the replay device to experience the metaverse based on the content defined within it. At this time, the replay device connects to external physical or virtual devices based on information related to the interface with the active block. Users can remotely control these physical or virtual devices within the metaverse, and can also control objects solely within the metaverse without connecting to external physical or virtual devices. Because the metaverse content associated with individual objects exists independently when connected to and remotely controlled by physical or virtual devices, communication between individual objects is possible.

[0084] In a metaverse content format according to an embodiment of the present invention, only the function of objects within the metaverse is defined, without specifying their purpose. Therefore, users can use them for various purposes according to their respective functions.

[0085] Furthermore, since communication specifications such as interface information for active blocks are defined simultaneously within the metaverse content, no additional content-driving software is required in the playback device.

[0086] Although the invention has been described above with reference to the accompanying drawings and embodiments, it is not intended to limit the scope of protection of the invention to the drawings or embodiments described above. It is understood that those skilled in the art can make various modifications and alterations to the invention without departing from the spirit and scope of the invention as set forth in the claims.

Claims

1. A method for reproducing metaverse content, the metaverse content having a data format comprising multiple blocks, the method being performed by a reproduction device, comprising: The first block of the plurality of blocks is virtualized and loaded into the storage area of ​​the playback device; Based on the information defined in the first block, obtain or access at least one remaining block other than the first block among the plurality of blocks; and The metaverse content is reproduced based on the information defined in at least one remaining block.

2. The method according to claim 1, wherein the first block is an interface block, and the information defined in the first block includes at least one of approval procedures, communication specifications, metaverse content information, abstraction information, and access permission information.

3. The method according to claim 1, wherein obtaining or accessing the at least one remaining block based on information defined in the first block comprises: According to the communication specifications defined in the first block, the at least one remaining block is obtained through a content provider, server, P2P node, or serverless communication method.

4. The method according to claim 1, wherein the at least one remaining block includes a second block, the second block being an active block, the second block including at least one of information about the activity of objects within the metaverse, information about functions, and information about interfaces.

5. The method according to claim 4, wherein a connection is established with a physical device or virtual device corresponding to an object in the metaverse according to the interface defined in the second block, wherein the physical device is a physical device capable of communicating with the reproduction device and corresponding to the actual existence of the object in the metaverse, and the virtual device is a virtual device capable of communicating with the reproduction device and corresponding to the object in the metaverse.

6. The method according to claim 5, wherein the reproduction device remotely controls the physical device or the virtual device within the metaverse based on the interface defined in the second block.

7. The method according to claim 1, wherein the at least one remaining block comprises at least one of a third block, a fourth block, and a fifth block. The third block includes information about the object corresponding to the metaverse content or the matter surrounding the object. The fourth block includes information about the design of the object or its surrounding environment. The fifth block includes information about the state of the object or its surrounding environment.

8. The method according to claim 1, wherein multiple metaverse contents correspond to multiple objects respectively, the reproduction device loads the first block of each of the multiple metaverse contents respectively, and accesses the corresponding remaining blocks according to the information defined in each first block, so as to reproduce the combined object or combined scene composed of the multiple objects.

9. A playback device comprising a processor and a memory, the memory storing a computer program that, when executed by the processor, causes the playback device to perform the method of any one of claims 1 to 8.

10. A computer-readable storage medium having a computer program stored thereon, the computer program implementing the method of any one of claims 1 to 8 when executed by a processor.

Images