Method and apparatus for providing reality-linked content in metaverse
The method and device in the metaverse enable real-time playback of user-generated content on virtual objects, addressing the lack of reality-linked content services, thereby improving revenue generation and service quality by integrating user content with real-time interaction and reward mechanisms.
Patent Information
- Application Number
- PCT/KR2023/010995
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-06-27
- Filing Date
- 2023-07-27
- Publication Date
- 2024-12-05
AI Technical Summary
The metaverse lacks a reality-linked content playback service technology that allows user-generated content from real space to be played in real-time within virtual spaces, hindering revenue generation and service quality for content creators.
A method and device that enable users to request and display reality-linked content on virtual objects in real-time, determining user permissions, calculating avatar views, and providing rewards based on content visibility, with features like live home shopping and busking content integration.
Enhances revenue generation and service quality by allowing real-time user content playback in virtual spaces, increasing user engagement and rewarding content providers based on viewer interaction.
Smart Images

Figure KR2023010995_05122024_PF_FP_ABST
Abstract
Description
Method and device for providing reality-linked content within the metaverse
[0001] The present disclosure relates to a method and device for providing reality-linked content, and more specifically, to a method and device for providing reality-linked content within a metaverse that can play user content in a real space in real time in a virtual space within the metaverse.
[0002] Recently, virtual reality, augmented reality, and mixed reality technologies that apply computer graphics technology are being developed.
[0003] Here, virtual reality technology refers to a technology that uses a computer to create a virtual space that does not exist in the real world and then makes that virtual space feel like reality, while augmented reality or mixed reality technology refers to a technology that adds computer-generated information on top of the real world, that is, a technology that allows real-time interaction with users by combining the real world and the virtual world.
[0004] Among these, augmented reality and mixed reality technologies are being utilized in conjunction with technologies in various fields (e.g., broadcasting technology, medical technology, and gaming technology).
[0005] Representative examples of augmented reality technology being applied in the broadcasting field include cases where the weather map in front of a weathercaster giving a weather forecast on TV changes naturally, or where advertising images that do not exist in the stadium are inserted into the screen and broadcast as if they were actually in the stadium during a sports broadcast.
[0006] In particular, these augmented reality and mixed reality technologies are being implemented and provided as various application services with the advent of smartphones.
[0007] As a representative service that provides users with augmented reality or mixed reality, there is the Metaverse. The Metaverse is a compound word of 'Meta', meaning fiction or abstraction, and 'Universe', meaning the real world, and refers to a three-dimensional virtual world.
[0008] The metaverse is a more advanced concept than the existing term virtual reality environment, and provides an augmented reality environment in which virtual worlds such as the web and the internet are absorbed into the real world.
[0009] However, this metaverse has a poor revenue-generating environment for content creators in the real world to generate new revenue because the technology for real-time content playback service that can play user content created in the real world in the virtual space of the metaverse has not been developed, and there have been problems such as poor service quality due to the unsatisfactory playback of various contents within the metaverse.
[0010] Therefore, in the future, there is a need to develop a reality-linked content provision device within the metaverse that can improve the quality of service and create a new revenue-generating environment by playing real-time user content from the real space in the virtual space within the metaverse.
[0011] [Prior Art Literature]
[0012] [Patent Document]
[0013] Republic of Korea Patent No. 10-2492985 (January 25, 2023)
[0014] One purpose of the present disclosure to solve the above-described problems is to provide a device, method, and program for providing reality-linked content within a metaverse that can improve a new revenue-generating environment and service quality by granting a user in a real space the right to use a certain object in a virtual space and displaying user content on an object in the virtual space in real time.
[0015] The problems to be solved by the present disclosure are not limited to the problems mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the description below.
[0016] A method for providing reality-linked content according to the present invention for achieving the above object includes the steps of: receiving a request from a user to use a predetermined object placed in a metaverse; determining whether the user has permission to use the predetermined object; receiving reality-linked content from the user in real time if it is determined that the user has permission to use the predetermined object; and displaying the reality-linked content by overlapping it on the predetermined object.
[0017] And, the above-mentioned object may be an object having a flat surface.
[0018] Additionally, the above-mentioned object may be any one of a screen, a building exterior wall, a building interior wall, a fence, a wall, and a billboard.
[0019] And, based on the request of the user, the step of providing an item for playing back reality-linked content is further included; and based on whether the user owns the item for playing back reality-linked content, the presence or absence of the usage right can be determined.
[0020] In addition, the method may further include a step of calculating the number of avatars adjacent to the predetermined object; and a step of providing a reward to each avatar adjacent to the predetermined object based on the number of avatars.
[0021] And, the step of calculating the number of avatars can calculate the number of avatars located within a predetermined radius centered on the predetermined object.
[0022] In addition, the method further includes a step of determining whether the reality-linked content has been actually viewed; and the number of avatars may include only avatars that actually view the reality-linked content.
[0023] And, the step of determining whether or not there is actual viewing may include a step of extracting the line of sight of an avatar located within a predetermined radius centered on the predetermined object; and a step of counting only avatars that include all or part of the predetermined object within the line of sight.
[0024] Additionally, the step of providing the reward may provide a reward determined based on the number of avatars to each avatar adjacent to the predetermined object.
[0025] And, it may further include a step of calculating the number of avatars adjacent to the predetermined object; and a step of providing a reward to the user who transmitted the reality-linked content based on the number of avatars.
[0026] In addition, the method may further include: receiving a summoning request of a second avatar from a first avatar adjacent to the predetermined object; transmitting the summoning request signal to the second avatar; and moving the second avatar to a position close to the first avatar when receiving an acceptance signal for the summoning request signal from the second avatar.
[0027] And, the step of providing product information of a product included in the above-mentioned reality-linked content; and the step of changing the product information in real time based on the number of avatars calculated in real time; further comprising, the above-mentioned reality-linked content may be live home shopping content.
[0028] Additionally, the product information may include at least one of the product's price, discount rate, and gift information.
[0029] Meanwhile, a reality-linked content providing device according to the present invention for achieving the above object includes a metaverse space generating unit for generating a predetermined object for playing video content in a metaverse space; and a reality-linked content providing unit for overlapping and displaying reality-linked content on the predetermined object based on a user request, wherein the reality-linked content providing unit, when receiving a request for use of the predetermined object from a user, determines the user's usage right for the predetermined object, and when it is determined that the user has usage right for the predetermined object, receives reality-linked content from the user in real time and displays the received reality-linked content in real time.
[0030] Additionally, the above-mentioned object may be any one of a screen, a building exterior wall, a building interior wall, a fence, a wall, and a billboard.
[0031] In addition, the reality-linked content provider can provide an item for playing the reality-linked content based on the user's request, and determine whether or not the user has the usage right based on whether or not the user owns the item for playing the reality-linked content.
[0032] In addition, the system may further include a reward providing unit that calculates the number of avatars adjacent to the predetermined object and provides a reward to each avatar adjacent to the predetermined object based on the number of avatars.
[0033] And, it further includes a real viewing judgment unit that extracts the line of sight of an avatar located within a predetermined radius centered on the predetermined object and determines whether or not the actual viewing has occurred based on whether all or part of the predetermined object is included within the line of sight; and the number of avatars can be calculated based on whether or not the actual viewing has occurred.
[0034] Additionally, the reward providing unit can provide a reward to the user who transmitted the reality-linked content based on the number of avatars.
[0035] In addition, the above-mentioned reality-linked content providing unit places a tip jar around the predetermined object to induce real-time donation of goods by an avatar viewing the above-mentioned reality-linked content when the above-mentioned reality-linked content is displayed, and the above-mentioned reality-linked content may be live busking content.
[0036] In addition, the reality-linked content providing unit provides product information of a product included in the reality-linked content, and changes the product information in real time based on the number of avatars calculated in real time, and the product information may include at least one of the price, discount rate, and gift information of the product.
[0037] Meanwhile, a device for providing reality-linked content in a metaverse according to an embodiment of the present disclosure for solving the above-described problem includes a communication unit that is communicatively connected to a user terminal in a real space, a database that stores user terminal information and user information in the real space, and a control unit that displays content on a predetermined object in a virtual space of the metaverse, wherein the control unit provides a content playback item in response to a request from the user terminal, grants a user terminal that owns the content playback item a usage right for a predetermined object in the virtual space of the metaverse, and when a content image is received from a user terminal that owns the content playback item, displays the content image on a predetermined object corresponding to the usage right granted to the user terminal.
[0038] A method according to one embodiment of the present disclosure may include a step of providing a content playback item in response to a request from a user terminal in a real space, a step of granting a usage right for a predetermined object in a virtual space of the metaverse to a user terminal owning the content playback item, a step of receiving a content image from a user terminal owning the content playback item, and a step of displaying the content image on a predetermined object corresponding to the usage right granted to the user terminal when the content image is received.
[0039] A computer program providing a method according to another embodiment of the present disclosure for solving the above-described problem is stored in a medium to perform any one of the above-described methods by being combined with a computer as hardware.
[0040] In addition, other methods for implementing the present disclosure, other systems, and computer-readable recording media recording a computer program for executing the above methods may be further provided.
[0041]
[0042] The effects of the present disclosure are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the description below.
[0043] Figure 1 is a schematic diagram for explaining a device (or server) according to the present invention.
[0044] Figure 2 is a block diagram for explaining the server of Figure 1.
[0045] Figure 3 is a drawing for explaining the display process of reality-linked content within the metaverse according to the present invention.
[0046] Figure 4 is a drawing for explaining the content playback item purchase list of Figure 3.
[0047] Figures 5 to 8 are drawings for explaining the process of providing rewards for viewing reality-linked content within the metaverse according to the present invention.
[0048] Figures 9 to 12 are flowcharts for explaining a method according to the present invention.
[0049] Figure 13 is a flowchart illustrating another embodiment of a method according to the present invention.
[0050] FIG. 14 is a drawing for explaining a method for determining whether or not to actually view reality-linked content in a method and device according to the present invention.
[0051] FIG. 15 is a diagram for explaining a learning method of an AI model for determining whether or not actual viewing has occurred in a method and device according to the present invention.
[0052] FIG. 16 is a schematic diagram showing a method for selecting an avatar as a target for acquiring gaze information or user status information in a method and device according to the present invention.
[0053] FIG. 17 is a schematic diagram illustrating a method for determining whether to view content based on avatar gaze information in a method and device according to the present invention.
[0054] Figure 18 is a schematic diagram for explaining a method for determining content viewing time in a method and device according to the present invention.
[0055] FIG. 19 is a drawing for explaining a method for determining whether to view content based on screen information of a user device in a method and device according to the present invention.
[0056] FIG. 20 is a drawing for explaining a method for determining whether to view content based on user gaze information extracted using electrooculogram (EOG) in a method and device according to the present invention.
[0057] FIG. 21 is a drawing for explaining an HMD structure for extracting user gaze information and a method for determining whether to view content based on user gaze information in a method and device according to the present invention.
[0058] Figure 22 is a flowchart summarizing the method according to the present invention from the perspective of rewards for content providers and viewers.
[0059] FIG. 23 is a drawing for explaining a method for setting an area for extracting an avatar, which is a target for determining whether content is viewed, in a method and device according to the present invention.
[0060] FIG. 24 is a drawing for explaining a reward provision method based on the number of avatars in a setting area for avatar extraction in a method and device according to the present invention.
[0061] Figure 25 is a block diagram showing the configuration of a device (or server) according to the present invention.
[0062] The advantages and features of the present invention, and methods for achieving them, will become clearer with reference to the embodiments described in detail below together with the accompanying drawings. However, the present disclosure is not limited to the embodiments disclosed below and may be implemented in various different forms. These embodiments are provided solely to ensure that the present disclosure is complete and to fully inform those skilled in the art of the scope of the present disclosure, and the present disclosure is defined solely by the scope of the claims.
[0063] The terminology used herein is for the purpose of describing embodiments only and is not intended to limit the present disclosure. In this specification, the singular also includes the plural unless specifically stated otherwise. As used herein, the terms "comprises" and / or "comprising" do not exclude the presence or addition of one or more other components in addition to the mentioned components. Like reference numerals refer to like components throughout the specification, and "and / or" includes each and any combination of one or more of the mentioned components. Although "first", "second", etc. are used to describe various components, these components are not limited by these terms. These terms are only used to distinguish one component from another. Therefore, it should be understood that a first component mentioned below may also be a second component within the technical spirit of the present disclosure.
[0064] Unless otherwise defined, all terms (including technical and scientific terms) used herein may be used in their common sense to those of ordinary skill in the art to which this disclosure pertains. Furthermore, terms defined in commonly used dictionaries are not to be interpreted ideally or excessively unless explicitly and specifically defined otherwise.
[0065] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the attached drawings.
[0066] Before proceeding, the meanings of terms used in this specification will be briefly explained. However, it should be noted that the explanation of terms is intended to aid understanding of this specification, and therefore, unless explicitly stated to limit the disclosure, they are not intended to limit the technical concepts of this disclosure.
[0067] FIG. 1 is a schematic diagram for explaining a device for providing reality-linked content within a metaverse according to the present disclosure, and FIG. 2 is a block diagram for explaining the server of FIG. 1.
[0068] As illustrated in FIG. 1, a device for providing reality-linked content within a metaverse according to the present disclosure may include a server (200) and a database (220) of a metaverse service platform that are connected to a user terminal (100) via a network.
[0069] Here, the user terminal (100) may include both a stationary device (standing device) such as a personal computer (PC), a network TV, a hybrid broadcast broadband TV (HBBTV), a smart TV, an Internet protocol TV (IPTV), and the like, and a mobile device (mobile device or handheld device) such as a smart phone, a tablet PC, a notebook, a personal digital assistant (PDA), and the like.
[0070] And, the network that provides communication connection between the user terminal (100) and the server (200) includes both wired and wireless networks, and is a general term for a communication network that supports various communication standards or protocols for pairing or / and data transmission and reception between the user terminal (100) and the server (300).
[0071] These wired / wireless networks include all current or future communication networks supported by the standard, and can support one or more communication protocols for them.
[0072] These wired / wireless networks can be formed by networks for wired connections such as USB (Universal Serial Bus), CVBS (Composite Video Banking Sync), Component, S-Video (analog), DVI (Digital Visual Interface), HDMI (High Definition Multimedia Interface), RGB, and D-SUB, and communication standards or protocols therefor, and networks for wireless connections such as Bluetooth, RFID (Radio Frequency Identification), IrDA (infrared Data Association), UWB (Ultra Wideband), ZigBee, DLNA (Digital Living Network Alliance), WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), LTE / LTE-A (Long Term Evolution / LTE-Advanced), and Wi-Fi Direct, and communication standards or protocols therefor.
[0073] And, as illustrated in FIG. 2, the server (200) may include a communication unit (210) that is connected to a user terminal (100) in a real space, a database (220) that stores user terminal information and user information in a real space, and a control unit (230) that displays content on a predetermined object in a virtual space of the metaverse.
[0074] Here, the control unit (230) provides a content playback item in response to a request from a user terminal (100), grants a user terminal (100) that owns the content playback item a right to use a predetermined object within the virtual space of the metaverse, and when a content image is received from the user terminal (100) that owns the content playback item, the control unit (230) can display the content image on a predetermined object corresponding to the right to use granted to the user terminal (100).
[0075] In addition, the control unit (230) may, before providing content playback items, select objects capable of displaying content images among objects located within the virtual space of the metaverse, calculate the number of content playback items to be created based on the total number of selected objects, and create content playback items corresponding to the calculated number of creations.
[0076] For example, the control unit (230) can calculate the number of content playback items to be created to be less than or equal to the total number of pre-selected objects.
[0077] The reason is to grant usage rights to one or more objects to one content playback item, thereby enabling smooth and uniform use of objects.
[0078] In addition, objects capable of displaying content images may include building walls, screens, billboards, and flat-surfaced fixtures located within a virtual space, but this is only an example and is not limited thereto.
[0079] Next, when the control unit (230) receives a request to acquire a content playback item from a user terminal (100), it performs authentication based on the user terminal information and user information extracted from the database (220), and when authentication is completed, it can provide the content playback item to the user terminal (100).
[0080] Here, when performing authentication, the control unit (230) requests user terminal information and user information from the user terminal if the user terminal information and user information do not exist in the database (220), and when receiving user terminal information and user information from the user terminal (100), the control unit (230) can store the user terminal information and user information in the database (220) and perform authentication.
[0081] Additionally, the control unit (230) may assign an identification code to a content playback item provided to the user terminal (100) when authentication is completed.
[0082] For example, the identification code may be generated using at least one of numbers, letters, symbols, and combinations thereof, but this is only one example and is not limited thereto.
[0083] As another embodiment, when the control unit (230) receives a request to purchase a content playback item from a user terminal (100), the control unit (230) performs authentication based on user terminal information and user information extracted from the database (220), and when authentication is completed, provides a list of content playback items with different purchase prices to the user terminal (100), and when the user terminal (100) selects one content playback item from the list of content playback items with different purchase prices and pays the corresponding purchase price, the control unit (230) may provide the user terminal (100) with the completed content playback item.
[0084] Here, the control unit (230) can set a different purchase price for the content playback item depending on the usage level of the object capable of displaying the content image.
[0085] For example, the usage level of an object may be set based on at least one of the location, number, area, and usage period of the object that can display the content image.
[0086] That is, the usage level is higher the more avatars there are in the virtual space where the object is located, the higher the number of objects, the higher the area of the object, and the longer the usage period of the object.
[0087] In this way, the control unit (230) can provide a list of content playback items in which the purchase price of the content playback item increases as the usage right level increases.
[0088] Here, the content playback item may have a usage level that includes at least one of the location, number, area, and usage period of an object capable of displaying the content image.
[0089] Next, when granting a usage right, the control unit (230) can grant a usage right for a certain object in the virtual space of the metaverse based on the user level of the user terminal (100) that owns the content playback item.
[0090] Here, the control unit (230) can set a user level based on the frequency of metaverse visits and metaverse use, and grant different levels of usage rights according to the set user level.
[0091] At this time, the control unit (230) can increase the level of usage rights as the user level increases.
[0092] In some cases, the control unit (230) may set a user level based on at least one of the user's social recognition, preference, likability, and trustworthiness, and may grant different levels of usage rights according to the set user level.
[0093] Here, the control unit (230) grants different levels of usage rights according to the user level when granting usage rights, and the usage rights level can be set based on at least one of the location, number, area, and usage period of an object that can display content images.
[0094] In addition, when granting a usage right, the control unit (230) may grant a usage right for a certain object in the virtual space of the metaverse based on the usage right level of the content playback item purchased by the user terminal (100).
[0095] Here, the usage right level of the content playback item purchased by the user terminal (100) can be set based on at least one of the location, number, area, and usage period of the object capable of displaying the content image.
[0096] At this time, the usage level may be higher as the location of the object is in an area with a large number of avatars in the virtual space, as the number of objects increases, as the area of the object increases, and as the usage period of the object increases.
[0097] Next, when displaying a content image, the control unit (230) can receive the content image in real time from the user terminal (100) and display the content image by overlapping it on an object.
[0098] In addition, the control unit (230) can calculate the number of avatars watching the content video when the content video is displayed on the object, and provide a reward to each avatar based on the calculated number of avatars.
[0099] For example, when calculating the number of avatars, the control unit (230) can track the gaze of each avatar located around the object on which the content image is displayed, and if all or part of the content image is included within the gaze of the avatar, recognize the avatar as an actual viewing avatar viewing the content image, and calculate the number of avatars viewing the content image by counting the number of actual viewing avatars.
[0100] As another example, when calculating the number of avatars, the control unit (230) may track the gaze of each avatar located around an object on which a content image is displayed, and if all or part of the content image is included within the gaze of the avatar, recognize the avatar as an actual viewing avatar viewing the content image, determine a reward for the content image based on the number of actual viewing avatars, and transmit the determined reward to the user terminal (100) that provided the content image.
[0101] In addition, the control unit (230) may place a tip jar around the object to induce real-time donations of goods from avatars watching the live busking-related content video when the live busking-related content video is displayed on the object. When another avatar watching the live busking-related content approaches the tip jar, a pop-up window is displayed on the user terminal corresponding to the other avatar asking whether or not to donate a tip, and when a tip is donated by the other avatar, the tip may be given to the avatar that provided the live busking-related content.
[0102] In addition, when a live home shopping related content video is displayed on an object, the control unit (230) can calculate the number of avatars watching the live home shopping related content video, and provide a reward to at least one of the avatars and the user terminal that is the content video provider according to the calculated number of avatars.
[0103] Additionally, the control unit (230) can generate and provide an avatar invitation option for recruiting avatars to view the content video when displaying the content video on an object.
[0104] Meanwhile, the control unit (230) may be composed of one or more cores and may include a processor for data analysis and deep learning, such as a central processing unit (CPU), a general purpose graphics processing unit (GPGPU), or a tensor processing unit (TPU) of a computing device.
[0105] Additionally, the communication unit (210) may include a wireless Internet module, a short-range communication module, a location information module, etc.
[0106] A wireless Internet module is a module for wireless Internet access, and is configured to transmit and receive wireless signals in a communication network according to wireless Internet technologies.
[0107] Wireless Internet technologies include, for example, WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband), WiMAX (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), HSUPA (High Speed Uplink Packet Access), LTE (Long Term Evolution), and LTE-A (Long Term Evolution-Advanced), and the wireless Internet module transmits and receives data according to at least one wireless Internet technology, including Internet technologies not listed above.
[0108] From the perspective that wireless Internet access through WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE, LTE-A, etc. is achieved through a mobile communication network, a wireless Internet module that performs wireless Internet access through a mobile communication network can be understood as a type of the above mobile communication module.
[0109] The short-range communication module is for short-range communication and can support short-range communication using at least one of Bluetooth™, RFID (Radio Frequency Identification), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee, NFC (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technologies.
[0110] A location information module is a module for obtaining the location (or current location) of a server, and representative examples include a GPS (Global Positioning System) module or a WiFi (Wireless Fidelity) module.
[0111] And, the database (220) may include at least one type of storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and an optical disk.
[0112] The server (200) of the present disclosure may operate in connection with web storage that performs the storage function of a database (120) on the Internet. The description of the database described above is merely an example and is not limited thereto.
[0113] Additionally, the server (200) of the present disclosure may further include an output unit and an input unit.
[0114] Here, the output unit can display a user interface (UI) for providing a virtual space of the metaverse. The output unit can output any type of information generated or determined by the control unit (230) and any type of information received by the communication unit (210).
[0115] For example, the output unit may include at least one of a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display, and a three-dimensional display (3D display). Some of these display modules may be configured as transparent or light-transmitting so that the outside can be viewed through them. This may be referred to as a transparent display module, and a representative example of a transparent display module is TOLED (Transparent OLED).
[0116] Additionally, the input unit can receive user input. The input unit may include keys and / or buttons on a user interface for receiving user input, or physical keys and / or buttons. A computer program according to embodiments of the present disclosure may be executed based on user input through the input unit.
[0117] Additionally, the input unit may receive a signal by detecting the user's button operation or touch input, or may receive the user's voice or motion through a camera or microphone and convert it into an input signal. For this purpose, speech recognition technology or motion recognition technology may be used.
[0118] Additionally, the input unit may be implemented as an external input device connected to the server (200). For example, the input device may be at least one of a touch pad, a touch pen, a keyboard, or a mouse for receiving user input, but this is merely an example and is not limited thereto.
[0119] For example, the input unit can recognize a user touch input. In some cases, the input unit may have the same configuration as the output unit. The input unit may be configured as a touch screen implemented to receive a user's selection input. The touch screen may use any one of a contact-type electrostatic capacitance method, an infrared light sensing method, a surface acoustic wave (SAW) method, a piezoelectric method, and a resistive film method. The detailed description of the touch screen described above is merely an example according to one embodiment of the present disclosure, and various touch screen panels may be employed in the platform server (100). The input unit configured as a touch screen may include a touch sensor. The touch sensor may be configured to convert a change in pressure applied to a specific portion of the input unit or an electrostatic capacitance generated at a specific portion of the input unit into an electrical input signal. The touch sensor may be configured to detect not only the position and area of a touch, but also the pressure at the time of the touch. When there is a touch input to the touch sensor, a corresponding signal(s) is sent to the touch controller. The touch controller can process the signal(s) and then transmit corresponding data to the processor. This allows the processor to recognize which area of the input unit has been touched, etc.
[0120] The server (200) of the present disclosure may include other components for implementing a server environment. The server (200) may include any type of device. The server (200) may be a digital device equipped with a processor, memory, and computing power, such as a laptop computer, notebook computer, desktop computer, web pad, or mobile phone.
[0121] The server (200) of the present disclosure may be a computing system capable of generating a user interface according to embodiments of the present disclosure and providing information to a user terminal via a network. The server (200) may transmit a virtual space of the metaverse space to the user terminal. In this case, the user terminal may be any type of computing device capable of accessing the server (200). The control unit (230) of the server (200) may transmit the user interface to the user terminal (100) via the communication unit (210). The server (200) of the present disclosure may be a cloud server. The server (200) may be a web server that processes services. The types of servers (200) described above are merely examples and are not limited thereto.
[0122] In this way, the present disclosure can provide a new revenue-generating environment and improve service quality by granting users in real space the right to use certain objects in virtual space and displaying user content on objects in virtual space in real time.
[0123] FIG. 3 is a diagram for explaining the display process of reality-linked content within the metaverse according to the present disclosure.
[0124] As illustrated in FIG. 3, the present disclosure can display a content image (400) on a predetermined object (500) corresponding to the usage right granted to the user terminal when a content image (400) is received from a user terminal that owns a content playback item.
[0125] Here, objects (500) capable of displaying content images (400) may include building walls (510), screens, billboards (520), and fixtures with flat surfaces located within the virtual space (300), but this is only an example and is not limited thereto.
[0126] In addition, the present disclosure can receive a content image in real time from a user terminal and display the content image (400) by overlapping it on an object (500) in a virtual space (300).
[0127] Here, the present disclosure calculates the number of avatars (600) viewing the content image (400) when the content image (400) is displayed on an object (500), and provides a reward to each avatar (600) based on the calculated number of avatars (600).
[0128] In addition, the present disclosure can set the purchase price of a content playback item differently depending on the usage level of the object (500).
[0129] For example, the usage level may be set based on at least one of the location, number, area, and usage period of an object (500) capable of displaying a content image (400).
[0130] That is, the usage right level is higher the more the location of the object (500) is in an area of the virtual space (300) with a large number of avatars, the higher the number of objects (500), the higher the area of the object (500), and the longer the usage period of the object (500).
[0131] Figure 4 is a drawing for explaining the purchase list of content playback items of Figure 3.
[0132] As illustrated in FIG. 4, the present disclosure performs authentication based on user terminal information and user information extracted from a database when a content playback item purchase request is received from a user terminal, and upon completion of authentication, provides a list of content playback items with different purchase prices to the user terminal, and when the user terminal selects one content playback item from the list of content playback items with different purchase prices and pays the corresponding purchase price, the purchased content playback item may be provided to the user terminal.
[0133] Here, you can set different purchase prices for content playback items depending on the object's usage level.
[0134] For example, the usage level may be set based on at least one of the location, number, area, and usage period of objects that can display content images.
[0135] That is, the usage level is higher the more avatars there are in the virtual space where the object is located, the higher the number of objects, the higher the area of the object, and the longer the usage period of the object.
[0136] As shown in Figure 4, the purchase price of content playback item 1 may be higher than that of other content playback item 2 because the object's usage right level is high.
[0137] For example, in the case of content playback item 1, if the location of the object is a billboard in an area of virtual space with a large number of avatars, there are two objects, the area of the object is large, and the object's usage period is preset to two months, and in the case of content playback item 2, if the location of the object is a building wall in an area of virtual space with a small number of avatars, there are two objects, the area of the object is small, and the object's usage period is preset to one month, the purchase price of content playback item 1 may be higher than that of content playback item 2 because the object's usage right level may be higher.
[0138] In this way, the present disclosure can provide a list of content playback items in which the purchase price of the content playback item increases as the usage right level increases.
[0139] In some cases, the present disclosure may grant a right to use a certain object within the virtual space of the metaverse based on the user level of the user terminal owning the content playback item.
[0140] Here, the present disclosure can set a user level based on the frequency of metaverse visits and metaverse use, and grant different levels of usage rights according to the set user level.
[0141] At this time, the present disclosure can increase the level of object usage rights as the user level increases.
[0142] In another case, the present disclosure may set a user level based on at least one of the user's social recognition, preference, likability, and trustworthiness, and grant different levels of usage rights according to the set user level.
[0143] In addition, the present disclosure can grant a usage right for a certain object within the virtual space of the metaverse based on the usage right level of the content playback item purchased by the user terminal.
[0144] Here, the usage right level of the content playback item purchased by the user terminal can be set based on at least one of the location, number, area, and usage period of the object that can display the content video.
[0145] At this time, the usage level may be higher as the location of the object is in an area with a large number of avatars in the virtual space, as the number of objects increases, as the area of the object increases, and as the usage period of the object increases.
[0146] FIGS. 5 to 8 are diagrams for explaining a process of providing rewards for viewing reality-linked content within the metaverse according to the present disclosure.
[0147] As illustrated in FIGS. 5 to 8, the present disclosure can receive a content image in real time from a user terminal and display the content image (400) by overlapping it on an object (500).
[0148] In addition, the present disclosure calculates the number of avatars (600) viewing the content image (400) when the content image (400) is displayed on an object (500), and provides a reward to each avatar (600) based on the calculated number of avatars (600).
[0149] Here, as shown in FIGS. 5 and 6, the present disclosure can provide reward information (700) around an avatar (600).
[0150] Reward information (700) may include information such as avatar nickname, number of advertisements viewed, and reward points.
[0151] For example, as shown in FIGS. 5 and 6, when calculating the number of avatars, the present disclosure tracks the gaze of each avatar (600) located around an object (500) on which a content image (400) is displayed, and if all or part of the content image (400) is included within the gaze of the avatar (600), the avatar is recognized as an actual viewing avatar viewing the content image (400), and the number of actual viewing avatars is counted to calculate the number of avatars (600) viewing the content image (400).
[0152] In addition, the present disclosure may determine a reward for a content video based on the number of actual viewing avatars, and transmit the determined reward to a user terminal that provided the content video (400).
[0153] In addition, as shown in FIG. 7, the present disclosure can place a tip jar (800) around an object to induce real-time donation of goods by an avatar (600) watching a live busking-related content video (400) when the live busking-related content video (400) is displayed on the object.
[0154] In addition, as shown in FIG. 8, the present disclosure calculates the number of avatars (600) viewing the live home shopping related content video (400) when the live home shopping related content video (400) is displayed on an object, and provides a reward to at least one of the avatars and the user terminal that is the content video provider according to the calculated number of avatars (600).
[0155] Here, the present disclosure can generate and provide an avatar invitation option and a discount coupon (900) for recruiting avatars (600) to watch the content image (400) when displaying the content image (400) on an object.
[0156] Figures 9 to 12 are flowcharts for explaining a method according to the present invention.
[0157] As illustrated in FIG. 9, the present disclosure can provide a content playback item corresponding to a request from a user terminal in a real space (S10).
[0158] Here, the present disclosure selects objects capable of displaying content images from among objects located within a virtual space of the metaverse before providing content playback items, calculates the number of content playback items to be generated based on the total number of selected objects, and generates content playback items corresponding to the calculated number of creations, but this is only one example and is not limited thereto.
[0159] For example, objects capable of displaying content images may include, but are not limited to, building walls, screens, billboards, and flat-surfaced fixtures located within a virtual space.
[0160] In addition, the present disclosure can perform authentication based on user terminal information and user information extracted from a database when a request for acquiring a content playback item is received from a user terminal, and provide a content playback item to the user terminal when authentication is completed.
[0161] Here, the present disclosure may also assign an identification code to a content playback item provided to a user terminal when authentication is completed.
[0162] For example, the identification code may be generated using at least one of numbers, letters, symbols, and combinations thereof, but this is only one example and is not limited thereto.
[0163] In addition, the present disclosure performs authentication based on user terminal information and user information extracted from a database when a request to purchase a content playback item is received from a user terminal, and when authentication is completed, a list of content playback items with different purchase prices is provided to the user terminal, and when the user terminal selects one content playback item from the list of content playback items with different purchase prices and pays the corresponding purchase price, the purchased content playback item may be provided to the user terminal.
[0164] Here, the present disclosure can set the purchase price of a content playback item differently depending on the usage level of an object capable of displaying a content image.
[0165] For example, the usage level of an object may be set based on at least one of the location, number, area, and usage period of the object that can display the content image.
[0166] In addition, the present disclosure can grant a user terminal owning a content playback item the right to use a predetermined object within the virtual space of the metaverse (S20).
[0167] Here, the present disclosure can grant a right to use a certain object within the virtual space of the metaverse based on the user level of a user terminal that owns a content playback item.
[0168] For example, the present disclosure may set user levels based on the frequency of metaverse visits and metaverse usage, and grant different levels of usage rights based on the set user levels.
[0169] As another example, the present disclosure may set a user level based on at least one of the user's social recognition, preference, likability, and trustworthiness, and grant different levels of usage rights based on the set user level.
[0170] As another example, the present disclosure may grant a user terminal a right to use a specific object within a virtual space of the metaverse based on the level of use of a content playback item purchased by the user terminal.
[0171] Here, the usage right level of the content playback item purchased by the user terminal can be set based on at least one of the location, number, area, and usage period of the object that can display the content video.
[0172] Next, the present disclosure can receive a content video from a user terminal that owns a content playback item (S30).
[0173] Next, the present disclosure can display the content image on a predetermined object corresponding to the usage right granted to the user terminal when the content image is received (S40).
[0174] Here, the present disclosure can receive a content image in real time from a user terminal and display the content image by overlapping it on an object.
[0175] And, as illustrated in FIG. 10, the present disclosure calculates the number of avatars viewing the content video when the content video is displayed on an object (S50), and provides a reward to each avatar based on the calculated number of avatars (S60).
[0176] Here, the present disclosure, as illustrated in FIG. 11, when calculating the number of avatars, tracks the gaze of each avatar located around an object on which a content image is displayed (S51), checks whether all or part of the content image is included within the gaze of the avatar (S52), and if all or part of the content image is included within the gaze of the avatar, recognizes the avatar as an actual viewing avatar viewing the content image, counts the number of actual viewing avatars (S53), and calculates the number of avatars viewing the content image based on the counted number of actual viewing avatars (S54).
[0177] In some cases, the present disclosure, as illustrated in FIG. 12, when calculating the number of avatars, tracks the gaze of each avatar located around an object on which a content image is displayed (S51), checks whether all or part of the content image is included within the gaze of the avatar (S52), recognizes the avatar as an actual viewing avatar viewing the content image if all or part of the content image is included within the gaze of the avatar, counts the number of actual viewing avatars (S53), calculates the number of avatars viewing the content image based on the counted number of actual viewing avatars (S54), determines a reward for the content image based on the number of avatars (S55), and transmits the determined reward to a user terminal that provided the content image (S56).
[0178] In this way, the present disclosure can provide a new revenue-generating environment and improve service quality by granting users in real space the right to use certain objects in virtual space and displaying user content on objects in virtual space in real time.
[0179] Figure 13 is a flowchart illustrating another embodiment of a method according to the present invention. Here, the reality-linked content may include, but is not limited to, live home shopping, live busking, etc., as described above. Here, the reality-linked content is assumed to be live home shopping content.
[0180] First, a request to use a specific object placed within the metaverse is received from a user (S110). The specific object is a flat surface, and may be, but is not limited to, a screen, a building exterior wall, a building interior wall, a fence, a wall, or a billboard. In other words, the specific object may be a structure within the metaverse capable of displaying reality-linked content, such as a media façade.
[0181] Next, the user's access rights to the specified object are determined (S120). The user's access rights to the specified object may correspond to the right to provide live home shopping content within the metaverse. In other words, users seeking to earn a certain amount of revenue through live busking content or to achieve advertising effects through live home shopping content must pay a certain fee to provide real-world content to avatars within the metaverse space.
[0182] To this end, although not illustrated in Figure 13, a step (not illustrated) of providing an item for playing live home shopping content based on a user's request may be further included. Specifically, the user purchases an item for playing live home shopping content, and the server grants the user permission to play the live home shopping content within the metaverse. In other words, the presence or absence of usage rights can be determined based on whether the user owns the item for playing live home shopping content.
[0183] Thereafter, if it is determined that the user has the right to use the service, live home shopping content is received from the user in real time (S130), and the content is overlapped on a predetermined object such as a wall or screen and displayed in the form of a media facade (S140).
[0184] Meanwhile, the method according to the present invention can provide a certain reward to avatars watching live home shopping or live busking. Rewards may include, but are not limited to, product discount coupons, product coupons, points, virtual currency, or items. Therefore, the method according to the present invention determines whether a user is actually watching a live home shopping or live busking event.
[0185] FIG. 14 is a diagram illustrating a method for determining whether or not a user is actually viewing reality-linked content in a method and device according to the present invention. Whether or not a user is actually viewing content can be determined by comparing the avatar's field of view, based on avatar gaze information or user status information, with the content transmission area. The avatar's posture, motion, and position are rendered based on user manipulation. Accordingly, the avatar's gaze information can be obtained based on the directionality of the rendered avatar. In another embodiment, when the user manipulating the avatar uses an HMD and VR gear, the avatar's gaze may be identical to the gaze of the user viewing the screen through the HMD. Accordingly, the avatar's gaze information can also be obtained through user gaze information, HMD screen information, etc. Furthermore, in one embodiment, the determination of whether or not a user is actually viewing content can be automatically performed based on a learned AI model.
[0186] FIG. 15 is a diagram illustrating a learning method of an AI model for determining whether or not a real viewing has occurred in a method and device according to the present invention. The deep neural network (DNN) illustrated in FIG. 15 may refer to a neural network that includes multiple hidden layers in addition to an input layer and an output layer. Using a deep neural network, latent structures of data can be identified. The deep neural network may include, but is not limited to, a convolutional neural network (CNN), a recurrent neural network (RNN), a generative adversarial network (GAN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a Q network, a U network, and a Siamese network.
[0187] Neural networks can be trained using at least one of supervised learning, unsupervised learning, and semi-supervised learning. The goal of neural network training is to minimize output errors. Training involves repeatedly inputting training data into the neural network, calculating the neural network output and target error for the training data, and backpropagating the neural network error from the output layer to the input layer to update the weights of each node in the neural network in a direction that reduces the error. Supervised learning uses training data with correct answers labeled for each training data (i.e., labeled training data). Unsupervised learning, on the other hand, may not have correct answers labeled for each training data. For example, in the case of supervised learning for data classification, the training data may be data with categories labeled for each training data. Labeled training data is input to a neural network, and an error can be calculated by comparing the output (categories) of the neural network with the labels of the training data. For example, in unsupervised learning for data classification, the error can be calculated by comparing the input training data with the neural network output. The calculated error is backpropagated backwards (i.e., from the output layer to the input layer) in the neural network, and the connection weights of each node in each layer of the neural network can be updated through backpropagation. The amount of change in the connection weights of each updated node can be determined by the learning rate. The neural network's calculation of the input data and the backpropagation of the error can constitute a learning cycle (epoch). The learning rate can be applied differently depending on the number of iterations of the neural network's learning cycle.For example, in the early stages of training a neural network, a high learning rate can be used to quickly allow the neural network to achieve a certain level of performance, thereby improving efficiency, while in the later stages of training, a low learning rate can be used to improve accuracy.
[0188] Within a neural network, one or more nodes connected through links can form a relationship between input nodes and output nodes. The concept of input nodes and output nodes is relative, meaning that any node in an output node relationship with one node can also be in an input node relationship with another node, and vice versa. As described above, the input node-to-output node relationship can be created based on links. One or more output nodes can be connected to an input node through links, and vice versa. In a relationship between input nodes and output nodes connected through a link, the value of the output node can be determined based on data input to the input node. Here, the nodes interconnecting the input nodes and output nodes can have weights. The weights can be variable and can be varied by the user or an algorithm to perform the desired function of the neural network. For example, if one or more input nodes are interconnected to an output node through links, the output node can determine the output node value based on the values input to the input nodes connected to the output node and the weights set for the links corresponding to each input node.
[0189] The characteristics of a neural network can be determined based on the number of nodes and links within the network, the relationships between nodes and links, and the weight values assigned to each link. For example, if two neural networks have the same number of nodes and links but different weight values between links, the two neural networks can be recognized as different from each other. Some of the nodes constituting the neural network can form a layer based on their distances from the initial input node. For example, a set of nodes that are n distances from the initial input node can form layer n. The distance from the initial input node can be defined by the minimum number of links required to reach the node from the initial input node. However, this definition of a layer is arbitrary for illustrative purposes, and the order of layers within a neural network can be defined in different ways than described above. For example, a layer of nodes can be defined by its distance from the final output node. An initial input node can refer to one or more nodes within the neural network into which data is directly input without going through links in their relationships with other nodes. Alternatively, within a neural network, in terms of the relationship between nodes based on links, it may refer to nodes that do not have other input nodes connected by links. Similarly, a final output node may refer to one or more nodes that do not have an output node in terms of the relationship between other nodes within the neural network. In addition, a hidden node may refer to nodes that constitute a neural network other than the initial input node and the final output node. A neural network according to one embodiment of the present invention may be a neural network in which the number of nodes in an input layer may be greater than that in a hidden layer closer to the output layer, and the number of nodes decreases as it progresses from the input layer to the hidden layer. The neural network may include one or more hidden layers. A hidden node in a hidden layer may take as input the output of a previous layer and the output of a surrounding hidden node.The number of hidden nodes in each hidden layer may be the same or different. The number of nodes in the input layer can be determined based on the number of data fields in the input data and may be the same as or different from the number of hidden nodes. The input data entered into the input layer can be computed by the hidden nodes of the hidden layer and output by the fully connected layer (FCL), which is the output layer.
[0190] Avatar gaze information, user status information, and content transmission areas can be preprocessed into a format that can be learned by a deep learning model. The preprocessed training data is provided to the input layer and, through a learning stage, creates an AI model.
[0191] Since the content transmission area is often preset from the time the metaverse space is built, if only the gaze information of adjacent avatars, user status information, and / or the avatar field of view obtained based on them are determined, it is possible to quickly determine whether an avatar is viewing reality-linked content or not through an AI model.
[0192] Meanwhile, in another embodiment, actual viewing can be determined based on avatar gaze information and / or user status information. To do this, an avatar, the target of which gaze information or user status information will be obtained, must first be selected. Avatar selection can be accomplished by extracting avatars adjacent to a given object (e.g., an object playing live home shopping or live busking content).
[0193] FIG. 16 is a schematic diagram showing a method for selecting an avatar to acquire gaze information or user status information in a method and device according to the present invention. The reality-linked content transmission area may be designated when designing the metaverse space, but may also be set in various locations by platform managers, advertisers, etc. First, the reality-linked content transmission area is determined. The reality-linked content transmission area can be determined based on the location coordinates and content transmission area within the metaverse space. Thereafter, an area within a predetermined radius from the content transmission area can be set as an avatar selection area. For example, if the coordinates of the content transmission area are {x1∼x2, y1∼y2, z1∼z2}, since the avatar is active on the floor of the metaverse space (road, ground, etc.), an area of a circle with a predetermined radius (D) centered at {(x1+x2) / 2, (y1+y2) / 2} can be set as the avatar selection area (PA). Of course, in other embodiments, the avatar selection area may be a rectangular area, and in other embodiments, if the straight-line distance between the content transmission area and the avatar is within a predetermined distance, the avatar may be selected to determine whether to view the content.
[0194] Below, a method for determining whether content has been viewed will be described. Figure 17 is a schematic diagram illustrating a method for determining whether content has been viewed based on avatar gaze information in a method and device according to the present invention.
[0195] In the present invention, an avatar's gaze is tracked, and if the content transmission area is within the avatar's field of view based on the avatar's gaze by a predetermined percentage or more, the user is determined to be viewing the advertising content. Then, the actual viewing time is calculated by counting the time spent viewing the content.
[0196] Determining whether to view content based on avatar gaze information begins with tracking the avatar's gaze. For example, when operating an avatar using an HMD, the avatar's gaze and posture are rendered based on the viewpoint of a camera installed in front of the HMD, and the avatar's gaze can be tracked through this. Specifically, assuming the 12 o'clock direction in Figure 17 as a reference point (reference direction), based on the rendered avatar's posture (direction), the avatar in (a) has a gaze of 0°, (b) has a gaze of -60°, and (c) has a gaze of 150°. Once the avatar's gaze is tracked, the field of view can be set based on the avatar's gaze. The avatar's field of view (θ) can range from ±α° to the avatar's gaze. α is a constant, can be preset by the user, and can vary based on the HMD's display field of view, the distance between the HMD and the user's eyes, etc.
[0197] And, based on the location / area of the content transmission area (S) in the metaverse space where the content is played, the avatar field of view (θ), and the distance between the content transmission area (S) and the avatar (A), the overlap area (V) and / or the overlap length (L) can be extracted. The overlap area (V) means the area where the avatar field of view and the content transmission area overlap, and the overlap ratio between the avatar field of view and the content transmission area can be determined based on the overlap area. In another embodiment, in order to minimize the amount of computation, only the overlap length (L) at one point of the overlap area (V) can be calculated to determine the overlap ratio between the avatar field of view and the content transmission area.
[0198] Figure 18 is a schematic diagram for explaining a method for determining content viewing time in a method and device according to the present invention.
[0199] The determination of whether content is viewed and the content viewing time may be continuously performed while the content is being played, or may be performed intermittently at preset intervals. In FIG. 18, the determination of whether content is viewed and the content viewing time is performed every 0.5 hours (30 minutes), but this is not limited thereto. In the present embodiment, if the overlap ratio between the avatar's field of view and the content transmission area is 60% or higher, it is determined that the content is being viewed. Accordingly, the section of 0m to 1.5 hours with an overlap ratio of 100% and the section of 1.5 to 3 hours with an overlap ratio of 67% can be determined as the user actually viewing the content, and the section of 3 to 4 hours with an overlap ratio of only 18% can be determined as the user not actually viewing the content.
[0200] The content viewing time can be determined based on the time during which all or part of the content transmission area is within the avatar's field of view. In the above explanation, the user's content viewing time can be extracted as 3 hours based on the overlap ratio. A shorter determination period would allow for more precise extraction of the viewing time. However, in another embodiment, regardless of the preset overlap ratio, if all or part of the content transmission area is within the avatar's field of view, it can be determined that the user has actually viewed the content. In this case, since all or part of the content transmission area (S) is within the avatar's field of view during the 4 hours during which the content is played, the content viewing time can be determined as 4 hours.
[0201] FIG. 19 is a drawing for explaining a method for determining whether to view content based on screen information of a user device in a method and device according to the present invention.
[0202] User status information received from a user device (e.g., HMD, tablet PC, laptop, etc.) may be screen information. While screen information of an HMD is illustrated in FIG. 19, in other embodiments, it may be screen information displayed on a laptop screen, screen information displayed on a tablet PC touchscreen, screen information displayed on a computer monitor, etc. In practice, the user sees the screen displayed on the above-mentioned device. That is, when media content is included on the screen, the user sees reality-linked content, and when reality-linked content disappears from the screen, the user no longer sees the content. Therefore, based on the screen information displayed on the user device, it is possible to determine what the user is currently viewing. Consequently, the present invention further includes a step of receiving screen information displayed on the user device, and at least one of whether content has been viewed and the viewing time can be determined based on the screen information.
[0203] Meanwhile, the method according to the present invention further includes a step of receiving user gaze information of a user tracked by a user device (e.g., HMD, tablet PC, laptop, etc.), and at least one of viewing status and viewing time can be determined based on the user gaze information.
[0204] FIG. 20 is a drawing for explaining a method for determining whether to view content based on user gaze information extracted using electrooculogram (EOG) in a method and device according to the present invention.
[0205] As illustrated in FIG. 20, the user device can extract user gaze information using the user's electrooculography. The electrooculography can be divided into horizontal electrooculography, which is the electrooculography according to the horizontal (left-right) movement of the eye, and vertical electrooculography, which is the electrooculography according to the vertical (up-down) movement of the eye. The user device includes one or more sensors for measuring the electrooculography, and can extract the user's gaze information based on the electrooculography measured by the sensor. At this time, the type, shape, size, number, and position of the sensors for sensing the electrooculography can be designed in various ways.
[0206] The HMD can measure an eye electromyography signal by a sensor placed in an area that contacts the user's face, and generates a linear coefficient vector that separates the measured eye electromyography signal into multiple signal components. At this time, in order to generate the linear coefficient vector, the user may be requested to perform a pre-movement to detect horizontal / vertical eye movement. The eye electromyography signal according to a specific pattern of pre-movement may include a signal component and a noise component according to the movement of the eye. The HMD can separate the eye electromyography signal into a signal component for horizontal movement, a signal component for vertical movement, and a noise component. At this time, the mixed signal including the signal component for horizontal movement, the signal component for vertical movement, and the noise component can be separated using the ICA (Independent Component Analysis) algorithm or the RICA (Reconstruction Independent Component Analysis) algorithm that separates each signal from a mixed signal of multiple signal components, and the linear coefficient vector corresponding to the separated signal is output and then applied to the separated signal. Furthermore, using the linear coefficient vector, horizontal and vertical eye conduction signals are estimated from the eye movement signal. That is, once the linear coefficient vector is acquired based on the pre-movement of the eye, the horizontal and vertical eye conduction signals can be estimated by applying the linear coefficient vector to the eye conduction signal. The horizontal and vertical eye conduction signals estimated in this way can also be used to render the eye movements of the avatar.
[0207] Based on user gaze information extracted using EOG, it is possible to determine whether the user is actually viewing reality-integrated content displayed on the HMD. More specifically, EOG can even be used to determine if the user is asleep and not actively viewing the content.
[0208] FIG. 21 is a diagram illustrating an HMD structure for extracting user gaze information and a method for determining whether content has actually been viewed based on the user gaze information in a method and device according to the present invention. Specifically, FIG. 21 (a) is a diagram illustrating an HMD structure for extracting user gaze information, and FIG. 21 (b) is a diagram illustrating a method for determining whether content has actually been viewed based on the user gaze information.
[0209] User gaze information can also be extracted through the user's pupil movement acquired through an internal camera. The HMD includes a cushion, lens, display, and housing that come into contact with the user's face, as well as an eye tracking sensor (e.g., a camera) for tracking the user's pupil movement. Various other sensor modules (e.g., inertial sensors), a head tracking module, a communication module, a variable focus module, and a controller may be provided inside and outside the housing. The eye tracking sensor may include information about the orientation of the user's eyes, i.e., information about the angle of the gaze. Through the user gaze information acquired from the eye tracking sensor and the image information displayed on the HMD, the content area that the user is currently viewing can be extracted, and based on this, whether or not the user is actually viewing the reality-linked content and the actual viewing time can be determined.
[0210] Meanwhile, the method according to the present invention may include a step of calculating the number of avatars adjacent to the predetermined object, and a step of providing a reward to each avatar adjacent to the predetermined object based on the number of avatars. That is, the greater the number of avatars viewing the reality-linked content, the greater the benefit can be provided to each avatar. Furthermore, the greater the number of avatars viewing the reality-linked content, the more rewards can be provided to the avatars providing the content. That is, the method according to the present invention may include a step of providing a reward determined based on the number of avatars to each avatar adjacent to the predetermined object.
[0211] At this time, the number of avatars can be calculated for avatars located within a predetermined radius centered on a predetermined object, as described above. More specifically, since it is unreasonable to provide a reward simply for being adjacent to an area where reality-linked content is displayed, it is possible to determine whether avatars adjacent to a predetermined object are actually viewing the content, and to calculate the number of avatars only for avatars that are actually viewing the content. To this end, the method according to the present invention may include a step of extracting the line of sight of avatars located within a predetermined radius centered on a predetermined object, and a step of counting only avatars that include all or part of the predetermined object within the line of sight, and through these two steps, only the number of avatars that are actually viewing the content can be calculated.
[0212] Meanwhile, for content providers, the method according to the present invention may further include the steps of calculating the number of avatars adjacent to the given object, and providing a reward to a user who transmits real-time content based on the number of avatars. The reward may be, but is not limited to, an item granting the right to provide real-time content.
[0213] As described above, depending on the number of avatars viewing the reality-linked content, viewers and content providers can receive a predetermined reward. Therefore, in order to summon more avatars, the method according to the present invention may further include the steps of receiving a summoning request for a second avatar from a first avatar adjacent to a predetermined object, transmitting a summoning request signal to the second avatar, and, upon receiving an acceptance signal for the summoning request signal from the second avatar, moving the second avatar to a position closer to the first avatar. In other words, by allowing the avatar summoning function, the platform provider can enable more users to utilize the metaverse space, and the content providers and viewers can receive more rewards, thereby promoting the activation of the metaverse platform.
[0214] Meanwhile, if the reality-linked content is live home shopping, the method according to the present invention may further include the steps of providing product information for products included in the live home shopping content, and the step of updating the product information in real time based on the number of avatars calculated in real time. In this case, the product information may include at least one of the product price, discount rate, and free gift information. In other words, the number of avatars watching the live home shopping is calculated in real time, and the corresponding benefits are visually displayed, thereby encouraging users to actively recruit avatars.
[0215] Figure 22 is a flowchart summarizing the method according to the present invention from the perspective of rewards for content providers and viewers.
[0216] First, a predetermined object for playing video content in the metaverse space is created (S210). Then, based on a user request, the reality-linked content is displayed by overlapping it on the predetermined object (S220). Then, using the method described above, the number of avatars viewing the reality-linked content is calculated (S230), and a reward is provided to each avatar viewing the reality-linked content based on the number of avatars (S240).
[0217] At this time, with respect to content provision authority, the method according to the present invention may further include the steps of receiving a request for use of a predetermined object from a user, determining whether the user has the authority to use the predetermined object, and, if it is determined that the user has the authority, receiving real-time, real-time, linked content from the user. The content received in real time from the user may be displayed in the form of a media facade by overlapping the predetermined object in step S220.
[0218] In order to provide a reward, the method according to the present invention determines whether an avatar has actually viewed the reality-linked content, and the number of avatars viewing the reality-linked content is calculated based on the actual viewing, as described above.
[0219] In a first embodiment of determining whether or not actual viewing is taking place, the avatar's gaze is tracked, and if the playback area of the reality-linked content is included within the avatar's field of view based on the avatar's gaze by a predetermined percentage or more, it can be determined that the avatar is actually viewing the reality-linked content.
[0220] In a second embodiment of determining whether or not actual viewing has occurred, screen information displayed on the user's HMD (Head-Mounted Display) can be received, and whether or not actual viewing has occurred can be determined based on the screen information.
[0221] In a third embodiment of determining whether or not actual viewing has occurred, the user's gaze information tracked by the user's HMD (Head-Mounted Display) is received, and whether or not actual viewing has occurred can be determined based on the user gaze information.
[0222] In addition to the first through third embodiments described above, various methods may be used to determine whether an avatar is actually viewing real-time content. Furthermore, in addition to determining whether a content is being viewed, a step may be added to calculate the actual viewing time of each avatar viewing the content.
[0223] FIG. 23 is a drawing for explaining a method for setting an area for extracting an avatar, which is a target for determining whether content is viewed, in a method and device according to the present invention.
[0224] The avatar extraction area may vary depending on the area of the broadcast area of the reality-linked content. That is, the avatar extraction area (PA) for a small broadcast area (CA) may be a circular area with a short radius (D) from the center of the broadcast area (CA), and the avatar extraction area (PA') for a large broadcast area (CA') may be a circular area with a long radius (D') from the center of the broadcast area (CA'). This is because an avatar must be present at a distance where it can visually recognize the reality-linked content broadcast in the metaverse space to be considered to have actually viewed the content. It is unreasonable to determine that an avatar at a distance has viewed all of the content simply because several pieces of content overlap with 100% within the avatar's field of view. Considering this, the avatar extraction area (PA, PA') must be adjacent to the broadcast area (CA, CA'), and if the avatar is present within a circle with a predetermined radius from the broadcast area, the avatar can be determined to be adjacent to the broadcast area. And, the avatar becomes the subject of judgment on whether to view content and the subject of providing rewards.
[0225] However, this is merely an example, and the avatar extraction area may take the shape of a square, hexagon, or other shape other than a circle. In another embodiment, if the straight-line distance between the content transmission area and the avatar is within a predetermined distance, the avatar may be determined to be located within the avatar extraction area.
[0226] FIG. 24 is a drawing for explaining a reward provision method based on the number of avatars in a setting area for avatar extraction in a method and device according to the present invention.
[0227] Figure 24 (a) illustrates that six avatars are included in the avatar extraction area (PA), and Figure 24 (b) illustrates that four avatars are included. In other words, in Figure 24 (a), there are six avatars adjacent to the content transmission area (CA), and in Figure 24 (b), there are four avatars adjacent to the content transmission area (CA).
[0228] If the avatar extraction area is not set, more avatars will gather in the location (b) of Fig. 24, but in reality, there are more target avatars that can view reality-linked content in the location (a) of Fig. 24. Therefore, the present invention can determine rewards differently based on the number of avatars included in the avatar extraction area (adjacent to the content transmission area). This is because the more avatars included in the avatar extraction area (adjacent to the content transmission area), the more costs reality-linked content providers such as live home shopping / live busking can pay, and thus, it is desirable for the scale of rewards to increase.
[0229] Additionally, the number of avatars used to determine rewards can be limited to those avatars actually viewing the content. Accordingly, a given reward is determined based on the number of avatars located within a predetermined radius from the center of the content transmission area. This number of avatars can be calculated by counting only those avatars whose content transmission area is within the avatar's field of view.
[0230] Figure 25 is a block diagram showing the configuration of a device (or server) according to the present invention.
[0231] The device (1000) according to the present invention can be implemented as various devices such as a server or a terminal. The device (1000) according to the present invention can be a digital device equipped with a processor and memory and capable of computing, such as a laptop computer, a notebook computer, a desktop computer, a web pad, or a mobile phone.
[0232] Furthermore, the device (1000) according to the present invention may be a web server providing a metaverse platform. Furthermore, the device (1000) according to the present invention may be a server providing a cloud computing service. More specifically, the device (1000) according to the present invention may be a server providing a cloud computing service, a type of Internet-based computing that processes information using another computer connected to the Internet rather than the user's computer. A cloud computing service may be a service that stores data on the Internet and allows users to access it anytime and anywhere via an Internet connection without having to install necessary data or programs on their own computers. Data stored on the Internet can be easily shared and transmitted with simple operations and clicks. Furthermore, a cloud computing service may be a service that not only simply stores data on an Internet server, but also allows users to perform desired tasks using the functions of application programs provided on the web without having to install separate programs, and may allow multiple people to simultaneously share and work on documents. Furthermore, a cloud computing service may be implemented in the form of at least one of an Infrastructure as a Service (IaaS), a Platform as a Service (PaaS), a Software as a Service (SaaS), a virtual machine-based cloud server, and a container-based cloud server. That is, the device (1000) according to the present invention can be implemented in the form of at least one of the aforementioned cloud computing services. The specific description of the aforementioned cloud computing services is merely exemplary, and any platform that constructs the cloud computing environment of the present invention may be included.
[0233] A device (1000) according to the present invention may include a processor (1010), a metaverse space creation unit (1020), an avatar creation unit (1030), a reality-linked content provision unit (1040), an eye tracking unit (1050), an actual viewing judgment unit (10060), a reward provision unit (1070), a storage unit (1080), and a communication unit (1090).
[0234] The device (1000) according to the present invention performs various embodiments of the method described above, and each component has a function of performing each step of the method. However, each component illustrated in FIG. 23 is merely functionally distinguished according to the operation performed, and the processor may perform the operation of the entire component or a part of the component. In addition, two or more components may be integrated into one component, and one component may be separated into two or more components. In other words, it should be understood that the block diagram illustrated in FIG. 25 is merely schematically illustrated to easily understand the operation of the device (1000) according to the present invention, and the name, structure, shape, number, etc. of each component do not limit the scope of the rights of the present invention. Meanwhile, each component of FIG. 25 may correspond to the component of FIG. 2, and the operation of each component described below may be performed or controlled by the control unit of FIG. 2, and may be performed by the communication unit and database of FIG. 2. Likewise, it is obvious to those skilled in the art that the operations of the control unit, communication unit, and database of FIG. 2 can be performed by each configuration described below.
[0235] The processor (1010) controls the overall operation of the metaverse space creation unit (1020), the avatar creation unit (1030), the reality-linked content provision unit (1040), the eye-tracking unit (1050), the actual viewing judgment unit (10060), the reward provision unit (1070), the storage unit (1080), and the communication unit (1090). The processor (1010) can read a computer program stored in the storage unit (1080) to perform a method according to the present invention. The processor (1010) may be composed of one or more cores, and may be implemented as a central processing unit (CPU), a general purpose graphics processing unit (GPGPU), a tensor processing unit (TPU), etc. of a computing device.
[0236] The metaverse space creation unit (1020) creates various objects within the metaverse space. The metaverse space creation unit (1020) can create objects for playing back reality-linked content. The reality-linked content may be video content, and for playing back the content, it is preferable that the object have a flat surface. Accordingly, the object for playing back the content may include a building wall, a screen, a billboard, a fixture with a flat surface, etc. located within the virtual space, but this is only one example and is not limited thereto. In other words, any object that can display video content is sufficient, and it may also include a curved surface.
[0237] The user account registration unit (1020) registers user information. User information may include the user's avatar information, item information, authority information, owned assets, shares, etc. Meanwhile, the user account registration unit (1020) may further include media space creation history information, based on which the user's level may be determined. In other words, users who have created multiple media spaces may have their level increased, and various rewards may be granted for activities within the metaverse space.
[0238] The avatar creation unit (1030) creates an avatar that operates in the metaverse space. The avatar operates in the metaverse space through user manipulation. The avatar creation unit (1030) presents the avatar's appearance (face, eyes, nose, mouth, ears, skin color, hair, body type, hands, feet, etc.), clothing, accessories, shoes, gloves, bags, etc. to the user, and can create the avatar's appearance, appearance, posture, etc. by combining options selected by the user. The avatar creation unit (1030) can assign an ID that can identify the user.
[0239] The reality-linked content provider (1040) overlaps reality-linked content on a predetermined object and displays it based on a user request. The reality-linked content provider (1040) selects a location, transmits, modifies, records, etc., for content received from a content provider. The reality-linked content provider (1040) can receive various contents from users through the communication unit (1090), and the contents may be live busking, live home shopping, etc., but are not limited thereto. The reality-linked content provider (1040) can store the contents received from users and display them at a predetermined time. In addition, the reality-linked content provider (1040) can receive contents from users in real time and display the contents through real-time streaming. The selection of the reality-linked content transmission area can be performed arbitrarily by the reality-linked content provider (1040) or can be performed at the request of a platform manager, user, content provider, etc.
[0240] The reality-linked content provider (1040) determines whether a user has permission to use an object for content playback. That is, the reality-linked content provider (1040) receives a request from a user to use a given object, determines whether the user has permission to use the given object, and if it determines that the user has permission, it receives reality-linked content from the user in real time. Meanwhile, the reality-linked content provider (1040) provides product information of a product included in a live home shopping content, and changes the product information in real time based on the number of avatars calculated in real time. At this time, the product information may include at least one of the product price, discount rate, and free gift information, but is not limited thereto.
[0241] If the reality-linked content is live busking content, the reality-linked content provider (1040) may place a tip jar around the object to induce real-time donations of goods by avatars watching the live busking-related content video when the live busking-related content video is displayed on the object.
[0242] The eye tracking unit (1050) tracks the gaze of an avatar adjacent to the transmission area when the reality-linked content is transmitted. The adjacent avatar may be an avatar located within a predetermined radius centered on the transmission area. Accordingly, the eye tracking unit (1050) may set an avatar extraction area to extract avatars adjacent to the transmission area. The eye tracking unit (1050) may track the gaze of an avatar in various ways as mentioned above, but is not limited thereto.
[0243] The actual viewing determination unit (1060) determines at least one of whether the user corresponding to the avatar is viewing the content and the viewing time. The actual viewing determination unit (1060) tracks the avatar's gaze and determines whether the content is being viewed based on whether the content transmission area is included in the avatar's field of view based on the avatar's gaze. Specifically, the actual viewing determination unit (1060) obtains the avatar's field of view based on the avatar's gaze and determines whether the avatar is viewing the reality-linked content based on whether the avatar's field of view and the transmission area overlap. The actual viewing determination unit (1060) can obtain the avatar's gaze and avatar field of view based on the screen information of the user's HMD (Head-Mounted Display) received through the communication unit (1090). In addition, the actual viewing determination unit (1060) can obtain the avatar's gaze and avatar field of view based on the user's gaze information received through the communication unit (1090). The actual viewing judgment unit (1060) calculates the overlap ratio between the avatar's field of view and the content transmission area, and can determine that the avatar is actually viewing the content only when the overlap ratio is greater than or equal to a predetermined value. If two or more contents are included in the avatar's field of view, the actual viewing judgment unit (1060) can extract the overlap ratio between the avatar's field of view and the transmission area of each contents, and determine the content with the highest overlap ratio as the content that the avatar is actually viewing. The actual viewing judgment unit (1060) can extract the actual viewing time during which the avatar's field of view and the content transmission area overlap.
[0244] The reward provision unit (1070) provides a predetermined reward to an avatar depending on whether the content is actually viewed. At this time, the predetermined reward may be selected differently depending on the actual viewing time obtained by the actual viewing determination unit (1060). The reward provision unit (1070) may calculate a reward level based on the ratio of the content's playback time and viewing time, and select a predetermined reward based on the reward level. The reward provision unit (1070) may select a predetermined reward based on the number of avatars adjacent to the content transmission area. At this time, the number of avatars may be calculated by counting only avatars that actually view the content, i.e., avatars whose content transmission area is included within the avatar's field of view. The reward provision unit (1070) provides a reward selected based on the actual viewing time to each avatar viewing the reality-linked content. Additionally, the reward provision unit (1070) provides a reward selected based on the number of avatars viewing the reality-linked content to the user who provided the reality-linked content.
[0245] The storage unit (1080) can store a computer program for performing a method according to the present invention. The storage unit (1080) can include various information about administrators and users, attribute information about objects included in the metaverse space, tokenization information about objects, etc. In addition, the storage unit (1080) can store various contents to be transmitted on the metaverse. The storage unit (1080) can store a look-up table (LUT) for the reward level described above. The storage unit (1080) can store basic reward information about contents, reward setting / change information according to the number of adjacent avatars, reward setting / change information according to the content viewing time, etc.
[0246] The communication unit (1090) is connected to external devices and external servers via wired or wireless means to transmit and receive various signals and data. Here, the external devices may be, but are not limited to, an HMD, a smartphone, a tablet PC, a laptop, etc. The communication unit (1080) transmits and receives data with external devices such as an HMD, a smartphone, a tablet PC, etc. via a wired or wireless communication network. The communication unit (1090) can receive screen information displayed on a user device (e.g., an HMD), user gaze information tracked by the user device, etc.
[0247] Additionally, although not shown in the drawing, the system may further include an object minting unit (not shown) that tokenizes various spaces (landmarks, roads, virtual stores, etc.) and objects within the metaverse created at the user's request into NFTs. The object minting unit (not shown) can generate NFTs by linking with an external platform or can generate NFTs internally within the platform. Meanwhile, assets within the metaverse space can be created as NFTs and used as objects of transaction. In addition, spaces (landmarks, etc.) for sale within the metaverse can be demarcated, and transactions can be made through online and offline payments based on the area of the target transaction.
[0248] In addition, although not shown in the drawing, the system may further include components such as a virtual space composition unit (not shown), an object modeling unit (not shown), and an avatar management unit (not shown) for visualizing the metaverse space. The virtual space design unit (not shown) has the function of pre-demarcating, dividing, and arranging the virtual metaverse space to be the subject of a transaction, and setting the purpose of each space. Users can purchase spaces demarcated by the virtual space design unit (not shown) and use them as landmarks, roads, and virtual stores. The transaction objects may be assigned various values depending on their size, purpose, etc. The object modeling unit (not shown) models objects based on user input, assigns attribute information, and then arranges them in the virtual space. Objects modeled by the object modeling unit (not shown) can be displayed on the user terminal. The avatar management unit (not shown) creates avatar models that will be active within the metaverse space and presents them to users for selection. The avatar management unit (not shown) can create various objects related to the avatar (clothing, bags, accessories, hair, poses, etc.). Alternatively, various objects (clothes, bags, accessories, hair, poses, etc.) created by users can be input and sold on consignment within the metaverse space.
[0249] The method according to one embodiment of the present disclosure described above can be implemented as a program (or application) and stored in a medium to be executed in combination with a hardware server.
[0250] The above-described program may include codes coded in a computer language, such as C, C++, JAVA, or machine language, that can be read by the processor (CPU) of the computer through the device interface of the computer, so that the computer reads the program and executes the methods implemented as a program. Such codes may include functional codes related to functions that define functions necessary for executing the methods, and may include control codes related to execution procedures necessary for the processor of the computer to execute the functions according to a predetermined procedure. In addition, such codes may further include memory reference-related codes regarding which location (address address) of the internal or external memory of the computer should reference additional information or media necessary for the processor of the computer to execute the functions. In addition, if the processor of the computer needs to communicate with any other computer or server located remotely in order to execute the functions, the code may further include communication-related code regarding how to communicate with any other computer or server located remotely using the communication module of the computer, and what information or media to send and receive during communication.
[0251] The above storage medium refers to a medium that stores data semi-permanently and can be read by a device, rather than a medium that stores data for a short period of time, such as a register, cache, or memory. Specifically, examples of the storage medium include, but are not limited to, ROM, RAM, CD-ROM, magnetic tape, floppy disk, and optical data storage device. That is, the program can be stored in various recording media on various servers that the computer can access or in various recording media on the user's computer. In addition, the medium can be distributed across network-connected computer systems, so that computer-readable code can be stored in a distributed manner.
[0252] The steps of a method or algorithm described in connection with the embodiments of the present disclosure may be implemented directly in hardware, implemented as a software module executed by hardware, or implemented by a combination thereof. The software module may reside in a random access memory (RAM), a read only memory (ROM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a flash memory, a hard disk, a removable disk, a CD-ROM, or any other form of computer-readable recording medium well known in the art to which the present disclosure pertains.
[0253] While the embodiments of the present disclosure have been described above with reference to the attached drawings, those skilled in the art will appreciate that the present disclosure can be implemented in other specific forms without altering the technical spirit or essential features thereof. Therefore, the embodiments described above should be understood to be illustrative in all respects and not restrictive.
Claims
1. A step of receiving a request for use of a specific object placed within the metaverse from a user; A step of determining the user's usage rights for the above-mentioned object; If it is determined that the user has the usage rights, a step of receiving real-time linked content from the user; and A method for providing reality-linked content, comprising: a step of displaying the reality-linked content by overlapping it on the predetermined object.
2. In paragraph 1, A method for providing reality-linked content, wherein the above-mentioned object is an object having a flat surface.
3. In paragraph 2, A method for providing reality-linked content, wherein the above-mentioned object is any one of a screen, a building exterior wall, a building interior wall, a fence, a wall, and a billboard.
4. In paragraph 1, Further comprising a step of providing an item for playing reality-linked content based on the request of the user; A method for providing reality-linked content that determines whether or not the user has the above usage rights based on whether or not the user owns the item for playing the above reality-linked content.
5. In paragraph 1, A step of calculating the number of avatars adjacent to the above-mentioned predetermined object; and A method for providing reality-linked content, further comprising: providing a reward to each avatar adjacent to the predetermined object based on the number of avatars.
6. In paragraph 5, A method for providing reality-linked content, wherein the step of calculating the number of avatars includes calculating the number of avatars located within a predetermined radius centered on the predetermined object.
7. In paragraph 6, Further comprising a step of determining whether the above-mentioned reality-linked content has been actually viewed; The number of avatars is a method for providing reality-linked content, including only avatars that actually view the reality-linked content.
8. In paragraph 7, The step of determining whether or not the above actual viewing is as follows: A step of extracting the gaze of an avatar located within a predetermined radius centered on the above-mentioned predetermined object; and A method for providing reality-linked content, comprising: a step of counting only avatars that include all or part of the predetermined object within the above-mentioned field of view.
9. In paragraph 7, The steps for providing the above rewards are: A method for providing reality-linked content, wherein a reward determined based on the number of avatars is provided to each avatar adjacent to the predetermined object.
10. In paragraph 1, A step of calculating the number of avatars adjacent to the above-mentioned predetermined object; and A method for providing reality-linked content, further comprising: providing a reward to the user who transmitted the reality-linked content based on the number of avatars.
11. In paragraph 1, A step of receiving a summoning request of a second avatar from a first avatar adjacent to the above-mentioned predetermined object; A step of transmitting the above summoning request signal to the second avatar; and A method for providing reality-linked content, further comprising: a step of moving the second avatar to a position close to the first avatar when receiving an acceptance signal for the summoning request signal from the second avatar.
12. In paragraph 1, A step of providing product information of a product included in the above reality-linked content; and Further comprising a step of changing the product information in real time based on the number of avatars produced in real time; The above-mentioned reality-linked content is a method for providing reality-linked content that is live home shopping content.
13. In paragraph 12, A method for providing real-time linked content, wherein the above product information includes at least one of the product's price, discount rate, and gift information.
14. A metaverse space creation unit that creates a predetermined object for playing video content on the metaverse space; and It includes a reality-linked content providing unit that displays reality-linked content by overlapping it on the above-mentioned object based on a user request; The above reality-linked content provider is, When a request for use of the above-mentioned object is received from a user, the user's usage authority for the above-mentioned object is determined, If it is determined that the above user has the right to use the above specified object, real-time linked content is received from the above user. A reality-linked content providing device that displays the received reality-linked content in real time.
15. In paragraph 14, The above-mentioned object is a reality-linked content providing device that is any one of a screen, a building exterior wall, a building interior wall, a fence, a wall, and a billboard.
16. In paragraph 14, The above reality-linked content provider is, A reality-linked content providing device that provides an item for playing reality-linked content based on the request of the user, and determines whether or not the user has the right to use the item based on whether or not the user owns the item for playing reality-linked content.
17. In paragraph 14, A reality-linked content providing device further comprising a reward providing unit that calculates the number of avatars adjacent to the predetermined object and provides a reward to each avatar adjacent to the predetermined object based on the number of avatars.
18. In paragraph 17, It further includes an actual viewing judgment unit that extracts the gaze of an avatar located within a predetermined radius centered on the predetermined object and determines whether or not the actual viewing is performed based on whether all or part of the predetermined object is included within the gaze; A reality-linked content providing device in which the number of avatars is calculated based on the actual viewing status.
19. In paragraph 14, The above-mentioned reality-linked content provider places a tip jar around the predetermined object to induce real-time donation of goods by avatars viewing the above-mentioned reality-linked content when the above-mentioned reality-linked content is displayed. The above reality-linked content is a reality-linked content provider that is a live busking content.
20. In paragraph 14, The above reality-linked content provider is, Provide product information of products included in the above-mentioned reality-linked content, and change the product information in real time based on the number of avatars calculated in real time. A reality-linked content providing device wherein the above product information includes at least one of the product's price, discount rate, and gift information.
Citation Information
Patent Citations
Incentive imparting system, incentive imparting device, incentive imparting method for virtual reality space, and incentive management program
JP2020201619A
Methods for reducing biotoxicity by nanomaterials including Hydra magnipapillata protein or Hydra derived peptides
KR1020200125000A
Metaverse hybrid platform service system and method for controlling the same
KR102432524B1
Metaverse-based shopping mall system and its construction method
KR102458098B1
KR20230047726A
