Method and apparatus for providing reward for watching advertisement in metaverse

The method and device in the metaverse track avatar gaze to determine advertisement viewing and provide rewards, addressing the challenge of low advertising effectiveness by ensuring accurate viewing detection and user engagement through varied rewards, thus improving advertising metrics.

WO2024232474A1PCT designated stage expired Publication Date: 2024-11-14MAXST
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2023/010996
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-06-27
Filing Date
2023-07-27
Publication Date
2024-11-14

AI Technical Summary

Technical Problem

In the metaverse, determining whether an avatar has viewed an advertisement is challenging, especially when using VR gear, as users can ignore ads by not directing their gaze towards them, leading to difficulties in calculating advertising costs and low advertising effectiveness.

Method used

A method and device that select an advertising transmission area within the metaverse, track the avatar's gaze to determine if the advertisement is within their field of view, and provide rewards based on the viewing time, with options for different reward levels and calculations based on overlap ratios and the number of avatars within a predetermined radius.

Benefits of technology

This solution allows for clear determination of advertisement viewing, improving participation rates and advertising effectiveness by motivating users to watch ads through varied reward methods, ensuring accurate charging of advertising fees and enhancing user engagement.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2023010996_14112024_PF_FP_ABST
    Figure KR2023010996_14112024_PF_FP_ABST
Patent Text Reader

Abstract

A method according to the present invention comprises the steps of: selecting an advertisement transmission region to which advertisement content is to be transmitted in a metaverse space; tracking the gaze of an avatar adjacent to the advertisement transmission region at the time at which the advertisement content is transmitted; determining, on the basis of the gaze of the avatar, whether the advertisement transmission region is included in the visual field of the avatar; and providing a predetermined reward to the avatar if the advertisement transmission region is included in the visual field of the avatar. According to the method according to the present invention, in order to provide a reward for watching an advertisement transmitted in a metaverse, it should be clearly determined whether an avatar (user) is actually watching the advertisement transmitted in the metaverse. In addition, an advertisement activity participation rate in the metaverse can be improved by giving motivation, through various reward provision methods, to watch an advertisement.
Need to check novelty before this filing date? Find Prior Art

Description

Method and device for providing rewards for viewing advertisements in the metaverse

[0001] The present invention relates to a reward providing method and device that determines whether an advertisement provided in a metaverse has been actually viewed and provides a reward to an avatar based on whether the advertisement has been actually viewed.

[0002] Advertisements, once primarily delivered through TV, radio, and magazines, are now reaching customers through a wider range of media. Consequently, the scope of advertising revenue is expanding beyond broadcasters and newspapers to include AR / VR / MR platform providers and content creators. Advertising activities targeting users manipulating avatars can also be actively pursued in the metaverse, a virtual environment.

[0003] Within the metaverse, users can control their avatars through various interfaces (e.g., VR gear) to perform various activities within the metaverse, such as shopping, playing games, video conferencing, and watching movies. Korean Patent Publication No. 10-1824863 (Title: Virtual Reality Multi-Storytelling Video Theater Multimedia Streaming Device) discloses a method in which multiple viewers wearing a virtual reality HMD (Head Mounted Display) participate in a video story while a real-time video is being played in a virtual reality environment (VR environment) to create different endings for each viewer through a multi-scenario development method. In addition, Korean Patent Publication No. 10-2451246 (Title: Method and Device for Providing Music Source and NFT ID Service Using NFT-Based Unique Account and Encryption Applied to Metaverse Space) relates to an NFT-based music content provision service applied to the metaverse space.

[0004] In this way, users can access the metaverse and enjoy various cultural content such as videos and music, and can maximize advertising effectiveness by broadcasting advertisements on the metaverse where numerous avatars are active.

[0005] However, in media like YouTube, when an advertisement is broadcast, users are forced to watch it, so revenue can be attributed to someone simply by broadcasting the advertisement. However, in the special space of the metaverse, placing an advertisement in a specific area or space does not necessarily mean that all avatars will see it. In particular, users who control their avatars through head-mounted displays (HMDs) or VR gear must turn their gaze to the advertisement to properly view it, even if it is playing nearby. In this case, it is difficult to determine whether the advertisement was properly executed, making it difficult to calculate advertising costs.

[0006] Furthermore, even if numerous advertisements are broadcast within the metaverse, avatars may ignore them and focus solely on achieving their intended goal (e.g., attending a lecture, shopping, etc.) because they don't want to waste time watching them. In this case, the advertising effect will be significantly reduced.

[0007] In order to expect high advertising effectiveness in the metaverse space where numerous users are active, it is necessary to first establish a device that can properly determine whether an ad is being viewed and induce ad viewing.

[0008] [Prior Art Literature]

[0009] [Patent Document]

[0010] Republic of Korea Patent No. 10-1824863 (registered on January 29, 2018)

[0011] Republic of Korea Patent No. 10-2451246 (registered on September 30, 2022)

[0012] The present invention was conceived in consideration of the aforementioned technical requirements, and its purpose is to provide a method for clearly determining whether an avatar (user) is actually viewing an advertisement broadcast within the metaverse. Furthermore, the present invention provides a method for providing rewards to avatars (users) in various ways based on whether or not they have actually viewed the advertisement.

[0013] A method according to the present invention for achieving the above object includes: a step of selecting an advertisement transmission area in which advertisement content is to be transmitted within a metaverse space; a step of tracking the gaze of an avatar adjacent to the advertisement transmission area at the time when the advertisement content is transmitted; a step of determining whether the advertisement transmission area is included in an avatar field of view based on the gaze of the avatar; and a step of providing a predetermined reward to the avatar if the advertisement transmission area is included in the avatar field of view.

[0014] In addition, the method may further include a step of counting the advertisement viewing time in which the advertisement transmission area is included within the avatar field of view.

[0015] Additionally, the above-mentioned reward may be selected differently depending on the advertisement viewing time.

[0016] And, it may further include a step of calculating a reward level based on the ratio of the playback time of the advertisement content and the advertisement viewing time; and a step of selecting the predetermined reward based on the reward level.

[0017] In addition, if two or more advertising contents are included within the avatar field of view, the method may further include a step of extracting an overlap ratio between the avatar field of view and the advertising transmission area of ​​each advertising content.

[0018] And, in the above-mentioned judging step, it can be determined that only the advertisement transmission area of ​​the advertisement content with the highest overlap ratio is included within the avatar field of view.

[0019] In addition, the step of determining may determine that the advertisement transmission areas of the two or more advertisement contents are all included within the avatar's field of view, and the step of providing may reset a preset reward for the two or more advertisement contents based on the overlap ratio and provide the reward to the avatar.

[0020] In addition, the adjacent avatars are avatars located within a predetermined radius centered on the advertisement transmission area, and the predetermined reward can be determined based on the number of avatars located within the predetermined radius.

[0021] Additionally, the number of avatars can be calculated by counting only avatars that include the advertisement transmission area within the avatar field of view.

[0022] Meanwhile, a device according to the present invention for achieving the above object includes an advertising content providing unit for selecting an advertising transmission area in which advertising content is to be transmitted within a metaverse space; an avatar gaze tracking unit for tracking the gaze of an avatar adjacent to the advertising transmission area at the time when the advertising content is transmitted; an advertising viewing determining unit for determining whether the advertising transmission area is included in an avatar field of view based on the avatar's gaze; and a reward providing unit for providing a predetermined reward to the avatar when the advertising transmission area is included in the avatar field of view.

[0023] In addition, the advertisement viewing judgment unit can extract the advertisement viewing time that includes the advertisement transmission area within the avatar field of view.

[0024] Additionally, the above-mentioned reward may be selected differently depending on the advertisement viewing time.

[0025] In addition, the reward providing unit can calculate a reward level based on the ratio of the playback time of the advertisement content and the advertisement viewing time, and select the predetermined reward based on the reward level.

[0026] In addition, the advertisement viewing judgment unit can extract an overlap ratio between the avatar's field of view and the advertisement transmission area of ​​each advertisement content when two or more advertisement contents are included within the avatar's field of view.

[0027] In addition, the advertisement viewing judgment unit can determine that only the advertisement transmission area of ​​the advertisement content with the highest overlap ratio is included within the avatar field of view.

[0028] In addition, the advertisement viewing judgment unit may determine that the advertisement transmission areas of the two or more advertisement contents are all included within the avatar's field of view, and the reward provision unit may reset a preset reward for the two or more advertisement contents based on the overlap ratio and provide the reward to the avatar.

[0029] In addition, the adjacent avatars are avatars located within a predetermined radius centered on the advertisement transmission area, and the predetermined reward can be determined based on the number of avatars located within the predetermined radius.

[0030] Additionally, the number of avatars can be calculated by counting only avatars whose advertising transmission area of ​​the advertising content is included within the avatar field of view.

[0031] Meanwhile, a method according to the present invention includes a step of selecting an advertisement transmission area to transmit advertisement content within a metaverse space; a step of extracting an avatar adjacent to the advertisement transmission area at a time when the advertisement content is transmitted; and a step of determining whether the avatar has viewed the advertisement for the advertisement content; wherein the step of determining may include a step of tracking the gaze of the avatar; a step of obtaining an avatar field of view based on the gaze of the avatar; and a step of determining whether the avatar field of view and the advertisement transmission area overlap.

[0032] And, it further includes a step of receiving screen information of an HMD (Head-Mounted Display) of a user who operates the avatar; and the step of determining can obtain at least one of the avatar's gaze and the avatar's field of view based on the screen information.

[0033] In addition, the method further includes a step of receiving user gaze information of the user tracked by the user's HMD (Head-Mounted Display), and the step of determining may obtain at least one of the avatar's gaze and the avatar's field of view based on the user gaze information.

[0034] Meanwhile, a device according to the present invention includes an advertising content providing unit that selects an advertising transmission area to transmit advertising content within a metaverse space; an avatar gaze tracking unit that extracts an avatar adjacent to the advertising transmission area at a time when the advertising content is transmitted and tracks the gaze of the avatar; and an advertising viewing determining unit that obtains an avatar field of view based on the avatar's gaze and determines whether the avatar has viewed the advertising content based on whether the avatar field of view and the advertising transmission area overlap.

[0035] And, it further includes a communication unit that receives screen information of an HMD (Head-Mounted Display) of a user who operates the avatar, and the gaze of the avatar and the avatar field of view can be obtained based on the screen information.

[0036] In addition, the present invention further includes a communication unit that receives user gaze information of the user tracked by the user's HMD (Head-Mounted Display), and at least one of the avatar's gaze and the avatar's field of view can be acquired based on the user gaze information.

[0037] The method according to the present invention enables clear determination of whether an avatar (user) is actually viewing an advertisement broadcast within the metaverse, thereby providing rewards for viewing advertisements broadcast within the metaverse. Furthermore, by providing incentives for viewing advertisements through various reward provision methods, participation in advertising activities within the metaverse can be improved.

[0038] Figure 1 is a schematic diagram illustrating a method and device according to the present invention.

[0039] FIG. 2 is a diagram illustrating an advertisement-viewing avatar and an advertisement-non-viewing avatar in a metaverse space to which a method and device according to the present invention are applied.

[0040] Figure 3 illustrates various types of information used in the method and device according to the present invention.

[0041] Figure 4 is a flowchart showing the execution steps of the method according to the present invention.

[0042] FIG. 5 is a drawing for explaining a method of selecting an avatar to determine whether or not to view an advertisement in a method according to the present invention.

[0043] FIG. 6 is a drawing for explaining a methodology for determining whether an advertisement has been viewed in a method and device according to the present invention.

[0044] FIG. 7 is a diagram for explaining a learning method of an AI model for determining whether or not to view an advertisement in a method and device according to the present invention.

[0045] FIG. 8 is a schematic diagram illustrating a method for determining whether to view an advertisement based on avatar gaze information in a method and device according to the present invention.

[0046] FIG. 9 is a schematic diagram for explaining a method for determining whether or not to view an advertisement based on avatar gaze information according to advertisement playback time in a method and device according to the present invention.

[0047] FIG. 10 is a drawing for explaining a method for determining whether to view an advertisement based on screen information of a user device in a method and device according to the present invention.

[0048] FIG. 11 is a drawing for explaining a method for determining whether or not to view an advertisement based on user gaze information extracted using electrooculogram (EOG) in a method and device according to the present invention.

[0049] FIG. 12 is a drawing showing an HMD structure for extracting user gaze information in a method and device according to the present invention.

[0050] FIG. 13 is a drawing for explaining a method for determining whether or not to view an advertisement based on user gaze information in a method and device according to the present invention.

[0051] Figure 14 is a drawing for explaining a method of providing rewards according to advertisement viewing in a method according to the present invention.

[0052] Figure 15 is a LUT (Look-Up Table) regarding reward levels used to provide rewards according to advertisement viewing in a method according to the present invention.

[0053] Figures 16 and 17 are schematic diagrams for explaining a judgment method when two or more advertisement contents are included in an avatar field of view in a method and device according to the present invention.

[0054] FIG. 18 is a drawing for explaining a method for setting an area for extracting an avatar, which is a target for determining whether or not to view an advertisement, in a method and device according to the present invention.

[0055] FIG. 19 is a drawing for explaining a reward provision method based on the number of avatars in a setting area in a method and device according to the present invention.

[0056] Figure 20 is a flowchart showing a step of determining whether or not to view an advertisement in a method and device according to the present invention.

[0057] Figures 21 and 22 are flowcharts showing specific examples of determining whether or not to view an advertisement in a method and device according to the present invention.

[0058] Figure 23 is a block diagram showing the configuration of a device (or server) according to the present invention.

[0059] Hereinafter, embodiments disclosed in this specification will be described in detail with reference to the attached drawings. Regardless of the drawing numbers, identical or similar components are given the same reference numbers and redundant descriptions thereof will be omitted.

[0060] In addition, when describing the embodiments disclosed in this specification, if it is determined that a detailed description of a related known technology may obscure the gist of the embodiments disclosed in this specification, the detailed description thereof will be omitted. In addition, the attached drawings are only intended to facilitate easy understanding of the embodiments disclosed in this specification, and the technical ideas disclosed in this specification are not limited by the attached drawings, and should be understood to include all modifications, equivalents, and substitutes included in the spirit and technical scope of the present invention.

[0061] Figure 1 is a schematic diagram illustrating a method and device according to the present invention. The method according to the present invention can provide rewards for viewing advertisements to avatars or charge advertising providers for advertising exposure based on whether or not the avatar actually viewed the advertisement content provided within the metaverse and / or the actual viewing time. Advertising activities can be conducted in various ways within the metaverse space, and in the case of video advertisements, advertisements can be broadcast to various areas within the metaverse.

[0062] Specifically, as illustrated in (a) of Fig. 1, advertising content floats in the sky, and two avatars (A1, A2) can view the advertising content (C). When broadcasting advertisements on TV, the Internet, etc., if the advertisement is broadcast, it is determined that the user has viewed it, and an advertising fee is charged to the advertising provider or an appropriate reward (points, cash, free content provision, etc.) is provided to the user. However, in the space of the metaverse, advertising content can be displayed in spaces such as the sky, land, and sea, and can also be displayed in the form of a media facade on buildings, billboards, and walls. However, it is not easy to determine whether the user controlling the avatar has viewed the advertising content. In particular, when controlling the avatar using an HMD (Head-Mounted Display) or VR gear, the screen displayed on the HMD corresponds to the avatar's viewpoint, so it can be determined that the user has viewed the advertisement only when the avatar's viewpoint is directed to the location of the advertising content. Specifically, as illustrated in (b) of FIG. 1, if the advertising content (C) is being transmitted at the eye level of the avatar (A3), the user can be exposed to the advertisement simply by moving in the metaverse space. However, if the advertising content (C) is not positioned at the eye level, as illustrated in (a) of FIG. 1, the user must direct the avatar's gaze upwards to view the advertisement. If the advertising content (C) is positioned vertically in the air or on the floor, it is difficult for the user to view the advertisement without intentionally directing the avatar's gaze vertically upwards or vertically downwards.

[0063] The present invention allows for greater freedom in the placement of advertising content within the metaverse. Furthermore, by determining whether advertising content has actually been viewed and using this information to charge advertising fees to advertising providers and reward viewers, a more rational advertising platform can be provided.

[0064] Figure 2 is a diagram illustrating an avatar that has viewed an advertisement and an avatar that has not viewed an advertisement within a metaverse space to which a method and device according to the present invention are applied. As illustrated in Figure 2, multiple avatars are active within the metaverse space, and each avatar uses the metaverse space for its own purposes. For example, an avatar may use the metaverse space to communicate with other avatars, to obtain specific information, or to consume various cultural content.

[0065] As illustrated in Figure 2, even in a space where advertising content is being broadcast, there may be avatars (Aw) who view the ad and avatars (An) who do not. In this case, it would be difficult to provide rewards to avatars simply because they are present in the ad space. Therefore, providing rewards for ads within the metaverse requires a clear determination of whether the ad has been viewed.

[0066] The metaverse space to which the present invention is applied may include landmarks, roads connecting each landmark, and various subspaces (e.g., virtual stores) created on the roads. Each landmark includes one or more objects (e.g., buildings, structures, etc.), and an avatar operating in the virtual environment can utilize various objects (e.g., entering buildings, using tools, etc.) while moving around landmarks and roads. The number of landmarks may be one or more, and the number and shape of roads connecting them may also be set in various ways.

[0067] In the present invention, the metaverse space may correspond to a virtual space corresponding to real-world real estate registered in the real estate register. Real-world real estate and the virtual space may correspond one-to-one, or multiple real-world real estates may be merged to form a single virtual space. Furthermore, the metaverse space in the present invention may be a space constructed by users. Just as in the real world, in the metaverse space, ownership of various assets is possible through NFT (Non-Fungible Token) minting using blockchain technology, and metaverse space owners can trade their assets.

[0068] Here, blockchain technology is a distributed computing technology-based data forgery prevention technology that stores small data called blocks in a chain-like, peer-to-peer (P2P)-based distributed data storage environment, making modification or falsification impossible and allowing the results of changes in ownership to be known. Each block records all transaction details transmitted to users prior to the block's discovery, and since these details are transmitted equally to all users via P2P, transaction details cannot be arbitrarily modified or omitted. In the present invention, assets within the metaverse space (various objects such as landmarks, roads, and virtual stores) are tokenized into Non-Fungible Tokens (NFTs) using blockchain technology, thereby verifying ownership of the assets within the metaverse space and making them eligible for transaction. In other words, in the present invention, an owner within the metaverse space refers to a user who owns the various assets within the metaverse space, and as described above, ownership within the metaverse space can be proven through blockchain. Meanwhile, landmarks may have a hierarchical structure. That is, a hierarchy can be established with a first landmark in the upper layer, a second landmark in the middle layer, and a third landmark in the lower layer. Of course, four or more types of landmarks can be included, not just three. Depending on the hierarchy, landmarks can have different values. Furthermore, the initial location of the user's avatar can be determined based on the hierarchy.

[0069] Landmarks within the metaverse space to which the method of the present invention is applied are concepts corresponding to real-world land, and landmarks may include various objects. For example, objects include not only various buildings (houses, companies, schools, exhibition halls, museums, restaurants, cafes, stores, department stores, airports, ports, amusement parks, etc.), but also pipes, facilities, billboards, trees, and various structures that make up a city, just like in the real world. Furthermore, they may include natural environments such as ponds, lakes, and oceans, as well as trains, means of transportation, and ships. As described above, these can be tokenized using blockchain technology and then become the subject of transactions. Spaces such as landmarks and roads, as well as various objects placed within those spaces, can be created by users. In other words, the metaverse space can be constructed and expanded according to user requests.

[0070] Ownership of assets within the metaverse can be tokenized. Specifically, by accessing a ledger platform and linking the digital ledger of a user account, blockchain utilizes a distributed ledger and conducts peer-to-peer transactions through individual connections between servers. Various ledger platforms can use cryptocurrencies such as Ethereum or Klaytn as transaction tokens. Of course, other cryptocurrencies can be used when using other ledger platforms.

[0071] Afterwards, a minting platform is opened, and landmarks, roads, virtual stores, and various objects within the metaverse space are minted into Non-Fungible Tokens (NFTs) using cryptocurrency. Minted NFTs can be traded within the metaverse space or listed on a listing platform for trading. Of course, it can also be designed to mint NFTs in the same manner within the metaverse platform without using a separate minting platform. In this way, NFTs are created upon request from one or more users to create a space (landmark, road, virtual store) or object. The creation of an NFT signifies that the cost (in cryptocurrency) has been paid by the user who requested the space creation, and ownership of the space has been transferred to that user. By implementing various spaces within the metaverse space in this way, the server can build and continuously expand the metaverse space.

[0072] Figure 3 illustrates various pieces of information used in the method and device according to the present invention. Administrator accounts can be classified into accounts with super administrator authority, metaverse space creation authority, virtual store creation authority, and metaverse administrator authority. Administrator accounts with super administrator authority have overall authority over the operation of the metaverse platform, and administrator accounts have authority to create metaverse spaces. However, administrator accounts with metaverse space creation authority and virtual store creation authority can also create landmarks, virtual stores, media spaces, etc. at the request of users. Here, the administrator account with metaverse space creation authority can hierarchize the first to nth landmarks (HIGH to LOW, or LEVEL 1 to LEVEL N), and can assign different values ​​to the first to nth landmarks according to the hierarchy, or grant different authority to the owners of the first to nth landmarks. Administrator accounts with metaverse administrator authority have authority over metaverse operations, such as creating and selling various objects, such as items, within the metaverse, and supporting avatar activities.

[0073] An administrator account with metaverse space creation authority can create one or more media spaces within the metaverse. One or more media spaces can be established at the request of an avatar (in response to a user request), or they can be established in any space during metaverse space creation. Furthermore, multiple media spaces can be created, each with a unique ID and can be managed individually.

[0074] Additionally, administrator accounts with Super Admin privileges may have the authority to select which ads will be broadcast within the metaverse space, authorize the broadcasting of ads, or determine the areas in which ads will be broadcast.

[0075] A user account includes information such as user information, avatars, and items of the first to nth users, as well as information on permissions granted to the first to nth users (ownership, teleportation permission, location setting permission, movement speed upgrade permission, etc.), assets held within the metaverse, and shares.

[0076] Figure 4 is a flowchart illustrating the execution steps of a method according to the present invention. First, an advertising transmission area where advertising content will be transmitted within the metaverse space is selected (S110). The area where the advertising content will be transmitted can be preset, or one of multiple preset areas can be designated as the advertising transmission area. Prior to this, an additional step of determining the advertising content to be transmitted within the metaverse space may be included.

[0077] And, when the advertisement content is transmitted to the advertisement transmission area, the gaze of the avatar adjacent to the advertisement transmission area is tracked (S120). Of course, at this time, the avatar adjacent to the advertisement transmission area may be an avatar located within a predetermined radius centered on the area. That is, the avatar extraction area based on the predetermined radius centered on the area may be identified, and it may be determined whether the avatar coordinates are included in the avatar extraction area. In another embodiment, the avatar extraction area may be a rectangular area, and in yet another embodiment, if the straight-line distance between the advertisement transmission area and the avatar is within a predetermined distance, the avatar may be selected as the avatar for determining whether to view the advertisement. The gaze tracking of the avatar will be described in detail below.

[0078] Next, it is determined whether the advertising content transmission area is within the avatar's field of view based on the avatar's gaze (S130). This can be done based on avatar gaze information or user status information corresponding to the avatar's gaze. This will be further explained below.

[0079] Finally, if the transmission area is included within the avatar's field of view, the user is considered to be watching the advertisement, and a predetermined reward is provided to the avatar (S140).

[0080] A given reward can be an item, virtual coin, or content voucher that can be used within the metaverse, or it can be a discount coupon, gift certificate, or cash that can be used in the real world. Furthermore, the advertisement can be provided between selected content (e.g., movies, TV shows), and the reward can be the right to continue watching the content. For example, an advertisement can be broadcast while watching a movie within the metaverse, and the avatar can continue watching the movie only if the avatar actually watches the advertisement. If the avatar is determined to not be watching the advertisement, the avatar can be prevented from watching the movie. For example, the movie broadcast area can be blurred, or the avatar can be forcibly removed or moved from the movie broadcast area.

[0081] FIG. 5 is a diagram illustrating a method for selecting an avatar to determine whether to view an advertisement in a method according to the present invention. As described above, the advertisement transmission area may be designated when designing the metaverse space, but may also be set in various locations by platform managers, advertisers, etc. First, the advertisement transmission area is determined. The advertisement transmission area can be determined based on the location coordinates and advertisement transmission area of ​​the advertisement within the metaverse space. Thereafter, an area within a predetermined radius from the advertisement transmission area can be set as an avatar extraction area. For example, if the coordinates of the advertisement transmission area are {x1∼x2, y1∼y2, z1∼z2}, since the avatar is active on the floor of the metaverse space (road, ground, etc.), an area of ​​a circle with a predetermined radius (D) centered at {(x1+x2) / 2, (y1+y2) / 2} can be set as an avatar extraction area (PA). Of course, in other embodiments, the avatar extraction area may be a rectangular area, and in other embodiments, if the straight-line distance between the advertisement transmission area and the avatar is within a predetermined distance, the avatar may be selected to determine whether to view the advertisement.

[0082] FIG. 6 is a diagram illustrating a methodology for determining whether an advertisement has been viewed in a method and device according to the present invention. Whether an advertisement has been viewed can be determined by comparing the avatar's field of view based on avatar gaze information or user status information with the advertisement transmission area. The avatar's posture, motion, and position are rendered based on user manipulation. Accordingly, the avatar's gaze information can be obtained based on the directionality of the rendered avatar. In another embodiment, when the user manipulating the avatar uses an HMD and VR gear, the avatar's gaze may be identical to the gaze of the user viewing the screen through the HMD. Accordingly, the avatar's gaze information can also be obtained through user gaze information, HMD screen information, etc.

[0083] In one embodiment, the determination of whether to view an advertisement can be made automatically based on a learned AI model.

[0084] FIG. 7 is a diagram illustrating a learning method of an AI model for determining whether or not to view an advertisement in a method and device according to the present invention. The deep neural network (DNN) illustrated in FIG. 7 may refer to a neural network that includes multiple hidden layers in addition to an input layer and an output layer. Using a deep neural network, latent structures of data can be identified. Deep neural networks may include, but are not limited to, convolutional neural networks (CNNs), recurrent neural networks (RNNs), generative adversarial networks (GANs), restricted Boltzmann machines (RBMs), deep belief networks (DBNs), Q networks, U networks, Siamese networks, etc.

[0085] Neural networks can be trained using at least one of supervised learning, unsupervised learning, and semi-supervised learning. The goal of neural network training is to minimize output errors. Training involves repeatedly inputting training data into the neural network, calculating the neural network output and target error for the training data, and backpropagating the neural network error from the output layer to the input layer to update the weights of each node in the neural network in a direction that reduces the error. Supervised learning uses training data with correct answers labeled for each training data (i.e., labeled training data). Unsupervised learning, on the other hand, may not have correct answers labeled for each training data. For example, in the case of supervised learning for data classification, the training data may be data with categories labeled for each training data. Labeled training data is input to a neural network, and an error can be calculated by comparing the output (categories) of the neural network with the labels of the training data. For example, in unsupervised learning for data classification, the error can be calculated by comparing the input training data with the neural network output. The calculated error is backpropagated backwards (i.e., from the output layer to the input layer) in the neural network, and the connection weights of each node in each layer of the neural network can be updated through backpropagation. The amount of change in the connection weights of each updated node can be determined by the learning rate. The neural network's calculation of the input data and the backpropagation of the error can constitute a learning cycle (epoch). The learning rate can be applied differently depending on the number of iterations of the neural network's learning cycle.For example, in the early stages of training a neural network, a high learning rate can be used to quickly allow the neural network to achieve a certain level of performance, thereby improving efficiency, while in the later stages of training, a low learning rate can be used to improve accuracy.

[0086] Within a neural network, one or more nodes connected through links can form a relationship between input nodes and output nodes. The concept of input nodes and output nodes is relative, meaning that any node in an output node relationship with one node can also be in an input node relationship with another node, and vice versa. As described above, the input node-to-output node relationship can be created based on links. One or more output nodes can be connected to an input node through links, and vice versa. In a relationship between input nodes and output nodes connected through a link, the value of the output node can be determined based on data input to the input node. Here, the nodes interconnecting the input nodes and output nodes can have weights. The weights can be variable and can be varied by the user or an algorithm to perform the desired function of the neural network. For example, if one or more input nodes are interconnected to an output node through links, the output node can determine the output node value based on the values ​​input to the input nodes connected to the output node and the weights set for the links corresponding to each input node.

[0087] The characteristics of a neural network can be determined based on the number of nodes and links within the network, the relationships between nodes and links, and the weight values ​​assigned to each link. For example, if two neural networks have the same number of nodes and links but different weight values ​​between links, the two neural networks can be recognized as different from each other. Some of the nodes constituting the neural network can form a layer based on their distances from the initial input node. For example, a set of nodes that are n distances from the initial input node can form layer n. The distance from the initial input node can be defined by the minimum number of links required to reach the node from the initial input node. However, this definition of a layer is arbitrary for illustrative purposes, and the order of layers within a neural network can be defined in different ways than described above. For example, a layer of nodes can be defined by its distance from the final output node. An initial input node can refer to one or more nodes within the neural network into which data is directly input without going through links in their relationships with other nodes. Alternatively, within a neural network, in terms of the relationship between nodes based on links, it may refer to nodes that do not have other input nodes connected by links. Similarly, a final output node may refer to one or more nodes that do not have an output node in terms of the relationship between other nodes within the neural network. In addition, a hidden node may refer to nodes that constitute a neural network other than the initial input node and the final output node. A neural network according to one embodiment of the present invention may be a neural network in which the number of nodes in an input layer may be greater than that in a hidden layer closer to the output layer, and the number of nodes decreases as it progresses from the input layer to the hidden layer. The neural network may include one or more hidden layers. A hidden node in a hidden layer may take as input the output of a previous layer and the output of a surrounding hidden node.The number of hidden nodes in each hidden layer may be the same or different. The number of nodes in the input layer can be determined based on the number of data fields in the input data and may be the same as or different from the number of hidden nodes. The input data entered into the input layer can be computed by the hidden nodes of the hidden layer and output by the fully connected layer (FCL), which is the output layer.

[0088] Avatar gaze information, user status information, and ad delivery areas can be preprocessed into a format that can be learned by a deep learning model. The preprocessed training data is provided to the input layer and, through a learning stage, creates an AI model.

[0089] Since the advertising delivery area is often preset to some extent, if the gaze information of adjacent avatars, user status information, and / or the avatar field of view obtained based on them are determined, it can be quickly determined through the AI ​​model whether the avatar is watching the advertisement or not.

[0090] In another embodiment, the advertisement viewing judgment unit may determine whether an advertisement has been viewed based on avatar gaze information and / or user status information.

[0091] FIG. 8 is a schematic diagram illustrating a method for determining whether to view an advertisement based on avatar gaze information in a method and device according to the present invention.

[0092] In the present invention, an avatar's gaze is tracked, and if the advertising transmission area is within the avatar's field of view based on the avatar's gaze by a predetermined percentage or more, the user is determined to be actually viewing the advertising content. Then, the actual viewing time is calculated by counting the actual viewing time.

[0093] Ad viewing judgment based on avatar gaze information begins with tracking the avatar's gaze. Avatar gaze tracking can be accomplished using a variety of currently commercially available methods. For example, when operating an avatar using an HMD, the avatar's gaze and posture are rendered based on the viewpoint of a camera mounted in front of the HMD, allowing for tracking of the avatar's gaze. Specifically, assuming the 12 o'clock direction in Figure 8 is the reference point (reference direction), based on the rendered avatar's posture (direction), the avatar in (a) has a gaze angle of 0°, the avatar in (b) has a gaze angle of -60°, and the avatar in (c) has a gaze angle of 150°. Once the avatar's gaze is tracked, the field of view can be set based on the avatar's gaze. The avatar's field of view (θ) can range from ±α° to the avatar's gaze. α is a constant, can be preset by the user, and can vary based on factors such as the HMD's display field of view, the distance between the HMD and the user's eyes, etc.

[0094] And, based on the location / area of ​​the advertisement transmission area (S) in the metaverse space where the advertisement content is played, the avatar field of view (θ), and the distance between the advertisement transmission area (S) and the avatar (A), the overlap area (V) and / or the overlap length (L) can be extracted. The overlap area (V) means the area where the avatar field of view and the advertisement transmission area overlap, and the overlap ratio between the avatar field of view and the advertisement transmission area can be determined based on the overlap area. In another embodiment, in order to minimize the amount of computation, only the overlap length (L) at one point of the overlap area (V) can be calculated to determine the overlap ratio between the avatar field of view and the advertisement transmission area.

[0095] FIG. 9 is a schematic diagram for explaining a method for determining whether or not to view an advertisement based on avatar gaze information according to advertisement playback time in a method and device according to the present invention.

[0096] The determination of whether an advertisement has been viewed and the duration of the advertisement viewing may be continuously performed while the advertisement content is being played, or may be performed intermittently at preset intervals. In FIG. 9, the determination of whether an advertisement has been viewed and the duration of the advertisement viewing is illustrated as being performed every 0.5 minutes (30 seconds), but is not limited thereto. In the present embodiment, it is set so that the advertisement content is determined to be viewed if the overlap ratio between the avatar's field of view and the advertisement transmission area is 60% or higher. Accordingly, the section of 0m to 1.5 minutes with an overlap ratio of 100% and the section of 1.5 to 3 minutes with an overlap ratio of 67% can be determined as the user actually viewing the advertisement content, and the section of 3 to 4 minutes with an overlap ratio of only 18% can be determined as the user not actually viewing the advertisement content.

[0097] The ad viewing time can be determined based on the time during which all or part of the ad broadcast area is within the avatar's field of view. In the above description, the user's ad viewing time can be estimated as 3 minutes based on the overlap ratio. A shorter determination period would allow for more precise ad viewing time. However, in another embodiment, regardless of the preset overlap ratio, the user can be determined to have actually viewed the ad as long as all or part of the ad broadcast area is within the avatar's field of view. In this case, the ad viewing time can be determined to be 4 minutes because all or part of the ad broadcast area (S) is within the avatar's field of view during the 4 minutes during which the ad content is played.

[0098] FIG. 10 is a drawing for explaining a method for determining whether to view an advertisement based on screen information of a user device in a method and device according to the present invention.

[0099] User status information received from a user device (e.g., HMD, tablet PC, laptop, etc.) may be screen information. While screen information of an HMD is illustrated in FIG. 10 , in other embodiments, it may be screen information displayed on a laptop screen, screen information displayed on a tablet PC touchscreen, screen information displayed on a computer monitor, etc. In practice, the user sees the screen displayed on the above-mentioned device. That is, if media content is included on the screen, the user sees the media content, and if the media content disappears from the screen, the user does not see the media content. Therefore, based on the screen information displayed on the user device, it is possible to determine what the user is currently viewing. Consequently, the present invention further includes a step of receiving screen information displayed on the user device, and based on the screen information, at least one of whether or not an advertisement has been viewed and the advertisement viewing time may be determined.

[0100] Meanwhile, the method according to the present invention further includes a step of receiving user gaze information of a user tracked by a user device (e.g., HMD, tablet PC, laptop, etc.), and at least one of actual viewing and actual viewing time can be determined based on the user gaze information.

[0101] FIG. 11 is a drawing for explaining a method for determining whether or not to view an advertisement based on user gaze information extracted using electrooculogram (EOG) in a method and device according to the present invention.

[0102] As illustrated in FIG. 11, the user device can extract user gaze information using the user's electrooculography. The electrooculography can be divided into horizontal electrooculography, which is the electrooculography according to the horizontal (left-right) movement of the eye, and vertical electrooculography, which is the electrooculography according to the vertical (up-down) movement of the eye. The user device includes one or more sensors for measuring the electrooculography, and can extract the user's gaze information based on the electrooculography measured by the sensor. At this time, the type, shape, size, number, and position of the sensors for sensing the electrooculography can be designed in various ways.

[0103] The HMD can measure an eye electromyography signal by a sensor placed in an area that contacts the user's face, and generates a linear coefficient vector that separates the measured eye electromyography signal into multiple signal components. At this time, in order to generate the linear coefficient vector, the user may be requested to perform a pre-movement to detect horizontal / vertical eye movement. The eye electromyography signal according to a specific pattern of pre-movement may include a signal component and a noise component according to the movement of the eye. The HMD can separate the eye electromyography signal into a signal component for horizontal movement, a signal component for vertical movement, and a noise component. At this time, the mixed signal including the signal component for horizontal movement, the signal component for vertical movement, and the noise component can be separated using the ICA (Independent Component Analysis) algorithm or the RICA (Reconstruction Independent Component Analysis) algorithm that separates each signal from a mixed signal of multiple signal components, and the linear coefficient vector corresponding to the separated signal is output and then applied to the separated signal. Furthermore, using the linear coefficient vector, horizontal and vertical eye conduction signals are estimated from the eye movement signal. That is, once the linear coefficient vector is acquired based on the pre-movement of the eye, the horizontal and vertical eye conduction signals can be estimated by applying the linear coefficient vector to the eye conduction signal. The horizontal and vertical eye conduction signals estimated in this way can also be used to render the eye movements of the avatar.

[0104] Based on user gaze information extracted using EOG, it is possible to determine whether the user is actually viewing advertising content displayed in the metaverse space on the HMD. More specifically, EOG can even determine if the user is asleep and not actually viewing the advertising content.

[0105] FIG. 12 is a drawing showing an HMD structure for extracting user gaze information in a method and device according to the present invention, and FIG. 13 is a drawing for explaining a method for determining whether to view an advertisement based on user gaze information in a method and device according to the present invention.

[0106] User gaze information can also be extracted through the user's pupil movement acquired through an internal camera. The HMD includes a cushion, lens, display, housing that contacts the user's face, and an eye tracking sensor (e.g., a camera) for tracking the user's pupil movement. Various other sensor modules (e.g., inertial sensors), a head tracking module, a communication module, a variable focus module, a controller, and other components may be provided inside and outside the housing. The eye tracking sensor may include information about the orientation of the user's eyes, i.e., information about the angle of the gaze. The user's gaze information acquired from the eye tracking sensor and the image information displayed on the HMD can be used to extract the content area that the user is currently viewing, and based on this, whether or not the user is actually viewing the content and the actual viewing time can be determined.

[0107] Figure 14 is a diagram illustrating a method for providing rewards based on advertisement viewing in a method according to the present invention. The method according to the present invention may further include a step of counting advertisement viewing time within the advertisement transmission area within the avatar's field of view. Of course, this assumes that the avatar (user) is actually viewing the advertisement.

[0108] Specifically, when a given advertisement is broadcast in the advertisement broadcast area of ​​the metaverse space, it is determined whether the first avatar adjacent to the advertisement broadcast area has viewed the advertisement. The ad viewing decision for the first avatar may continue throughout the advertisement broadcast.

[0109] At this time, if it is determined that the first avatar's ad viewing has been interrupted, the ad viewing time is calculated from the start of the ad broadcast to the point at which viewing ceases. Ad viewing time can be used to select or reset rewards. For example, if the reward given to the avatar for watching the entire ad is 100 Metacoins, the reward can be reset to 60 Metacoins if only 60% of the ad has been viewed. In other words, the reward given to the avatar can be selected and reset differently depending on the ad viewing time.

[0110] In another embodiment, rewards for viewing advertisements may be provided to avatars based on reward levels according to the advertisement viewing time ratio.

[0111] Figure 15 is a Look-Up Table (LUT) regarding reward levels used to provide rewards for viewing advertisements in a method according to the present invention. Reward levels can be categorized as R1 to R10, but are not limited thereto. The advertisement viewing rate can be calculated as (ad viewing time / ad playback time) × 100 (unit: %). If the advertisement viewing rate is 90 to 100%, the avatar can receive a reward of 100 Metacoins, and if the advertisement viewing rate is 10 to 20%, the avatar can receive a reward of 10 Metacoins. Through this calculation method, the avatar (user) can watch the advertisement until the end to obtain more rewards, thereby improving the advertisement effect. In addition, since the advertiser can pay the advertisement fee only when the advertisement is properly viewed by the avatar (user), the advertisement cost can be reduced.

[0112] Figures 16 and 17 are schematic diagrams for explaining a judgment method when two or more advertisement contents are included in an avatar field of view in a method and device according to the present invention.

[0113] Referring to FIG. 16, multiple pieces of advertising content (C1, C2) transmitted within the metaverse space can be placed within close proximity to the avatar. That is, a user who is active in the metaverse space through an avatar, or a user who is viewing a monitor or screen displaying the metaverse space where the avatar is active, can view two or more pieces of advertising content. In this case, it is necessary to clarify which advertising content the user is actually viewing. The method according to the present invention determines that the user is viewing all advertising content when two or more pieces of advertising content are included within the avatar's field of view, and can provide a reward for each advertising content. That is, the method according to the present invention determines that the advertising transmission areas of two or more pieces of advertising content are all included within the avatar's field of view, and can reset and provide a preset reward for two or more pieces of advertising content to the avatar based on an overlap ratio. More specifically, if the reward for the first advertisement content is 100 Metacoins and the reward for the second advertisement content is a 30-day item voucher, these can be reset to 50 Metacoins and a 15-day item voucher, respectively, and provided to the avatar. The reward reset can be modified or altered in various ways. The embodiment, which determines that the user has viewed all advertisements within the avatar's field of view, has the advantage of simplifying the logic for determining whether an advertisement has been viewed and reducing the amount of computation.

[0114] However, it may not be reasonable to reward a user simply for the fact that another piece of advertising content is displayed on the user's device or positioned around their avatar, even though the user is actually viewing only one piece of advertising content.

[0115] Accordingly, the method according to the present invention may have an embodiment of specifying the advertisement being actually viewed based on the overlap ratio between the advertisement transmission area of ​​each of two advertisement contents and the avatar field of view. Specifically, the method according to the present invention may further include a step of extracting the overlap ratio between the avatar field of view and the advertisement transmission area of ​​each advertisement contents, if two or more advertisement contents are included in the avatar field of view. In addition, it may be determined that only the advertisement transmission area of ​​the advertisement contents with the highest overlap ratio is included in the avatar field of view. In other words, the advertisement content that the user is actually viewing can be specified as the advertisement content with the highest overlap ratio. Referring to FIG. 17, if the area of ​​the entire area of ​​the first advertisement contents (C1) is 100, and the overlapping area of ​​the first advertisement contents (C1) and the avatar field of view (V) is 43, the overlap ratio of the advertisement transmission area of ​​the first advertisement contents can be calculated as 43%. Similarly, if the total area of ​​the second advertising content (C2) is 100, and the overlapping area between the second advertising content (C2) and the avatar field of view (V) is 52, the overlap ratio of the advertising transmission area of ​​the second advertising content can be calculated as 52%. Among these, the advertising content with the highest overlap ratio is the second advertising content (C2), so it can be determined that the user is viewing only the second advertising content (C2). As a variation of this, advertising content with an overlap ratio below a predetermined ratio (e.g., 50%) can be considered not to be actually viewed. In other words, if two or more advertising contents are within the avatar field of view and none of the two or more advertisements has an overlap ratio greater than the predetermined ratio, it can be determined that the user is not currently viewing any advertising contents.

[0116] Meanwhile, the method according to the present invention, with regard to providing rewards for viewing advertisements, can determine rewards differently based on the number of avatars adjacent to the advertisement broadcast area. In real space, advertising costs in crowded locations differ from those in relatively sparsely populated locations. In other words, it's natural to pay more for advertising in crowded locations.

[0117] Applying this to the metaverse, it's natural that if an ad delivery area is selected in a space where avatars are relatively numerous, a relatively high cost will be incurred, while if it's selected in a location difficult for avatars to access, a relatively low cost will be incurred. However, because movement in the metaverse is more free than in the real world, calculating advertising costs or providing rewards in the same way as in the real world is undesirable. Considering this, the present invention introduces a method that determines rewards differently based on the number of avatars adjacent to the ad delivery area.

[0118] FIG. 18 is a drawing for explaining a method for setting an area for extracting an avatar, which is a target for determining whether or not to view an advertisement, in a method and device according to the present invention.

[0119] The avatar extraction area may vary depending on the size of the advertising broadcast area. That is, the avatar extraction area (PA) for a small advertising broadcast area (CA) may be a circular area with a short radius (D) from the center of the advertising broadcast area (CA), and the avatar extraction area (PA') for a large advertising broadcast area (CA') may be a circular area with a long radius (D') from the center of the advertising broadcast area (CA'). This is because an avatar must be present at a distance where the user can visually recognize an advertisement broadcast in the metaverse space to be considered to have actually viewed the advertisement. It is unreasonable to determine that the user has viewed all of the advertisement content simply because several advertisement contents are included in the avatar's field of view at a 100% overlap ratio at a distant avatar. Considering this, the avatar extraction area (PA, PA') must be adjacent to the advertisement transmission area (CA, CA'), and if the avatar exists within a circle with a predetermined radius from the advertisement transmission area, the avatar can be determined to be adjacent to the advertisement transmission area. In addition, the avatar becomes a target for determining whether or not to view an advertisement and becomes a target for providing a reward.

[0120] However, this is merely an example, and the avatar extraction area may take the shape of a square, hexagon, or other shape other than a circle. In another embodiment, if the straight-line distance between the advertisement transmission area and the avatar is within a predetermined distance, the avatar may be determined to be located within the avatar extraction area.

[0121] FIG. 19 is a drawing for explaining a reward provision method based on the number of avatars in a setting area in a method and device according to the present invention.

[0122] Figure 19 (a) illustrates that six avatars are included in the avatar extraction area (PA), and Figure 19 (b) illustrates that four avatars are included. In other words, in Figure 19 (a), there are six avatars adjacent to the advertisement transmission area (CA), and in Figure 19 (b), there are four avatars adjacent to the advertisement transmission area (CA).

[0123] If the avatar extraction area is not set, more avatars will gather in the location (b) of FIG. 19, but there will be more target avatars that can actually view advertisements in the location (a) of FIG. 19. Accordingly, the present invention can determine rewards differently based on the number of avatars included in the avatar extraction area (adjacent to the advertisement transmission area). This is because the greater the number of avatars included in the avatar extraction area (adjacent to the advertisement transmission area), the more advertising fees the advertiser will have to pay, and therefore, it is desirable for the corresponding reward size to be larger.

[0124] Furthermore, the number of avatars used to determine rewards can be limited to those avatars that actually view advertisements. Accordingly, a given reward is determined based on the number of avatars located within a predetermined radius from the center of the advertisement transmission area. This number of avatars can be calculated by counting only those avatars whose field of view includes the advertisement transmission area.

[0125] Figure 20 is a flowchart illustrating the steps for determining whether an advertisement has been viewed in the method and device according to the present invention. First, an advertisement transmission area for transmitting advertisement content within the metaverse space is selected (S210). Then, at the time the advertisement content is transmitted, an avatar adjacent to the advertisement transmission area is extracted (S220). The process for extracting adjacent avatars is as described above. Finally, whether the avatar has viewed the advertisement content is determined (S230).

[0126] Here, the determination of whether an advertisement has been viewed can be made in various ways as described above. For example, screen information of the user's HMD (Head-Mounted Display) controlling the avatar can be received, and at least one of the avatar's gaze and avatar field of view can be acquired based on the screen information. Furthermore, user gaze information of the user tracked by the user's HMD (Head-Mounted Display) can be received, and at least one of the avatar's gaze and avatar field of view can be acquired based on the user gaze information.

[0127] Figures 21 and 22 are flowcharts illustrating specific embodiments of determining whether an advertisement has been viewed in a method and device according to the present invention. First, referring to the embodiment of Figure 21, the avatar's gaze is tracked (S241), an avatar's field of view is acquired based on the avatar's gaze (S242), and then it is determined whether the avatar's field of view and the advertisement transmission area overlap (S243). If the avatar's field of view and the advertisement transmission area overlap, it can be determined that the avatar is viewing the advertisement. If it is determined that the avatar is viewing the advertisement, a predetermined reward can be provided to the avatar. At this time, the method further includes a step of extracting the advertisement viewing time during which the avatar's field of view and the advertisement transmission area overlap, and a predetermined reward can be selected and provided to the avatar based on the advertisement viewing time. In addition, as mentioned above, a reward level can be calculated based on the ratio of the advertisement content playback time and the advertisement viewing time, a predetermined reward can be selected based on the reward level, and the predetermined reward can be provided to the avatar.

[0128] As a modified embodiment of this, referring to the embodiment of FIG. 22, the avatar's gaze is tracked (S251), the avatar's field of view is acquired (S252), and the overlap ratio between the avatar's field of view and the advertisement transmission area is determined (S253). At this time, if the overlap ratio exceeds a predetermined value (S254-YES), it is determined that the avatar (user) has actually viewed the advertisement (S255), and if the overlap ratio is lower than the predetermined value (S254-NO), it is determined that the avatar (user) has not viewed the advertisement (S256). At this time, as mentioned above, if two or more advertisement contents are included in the avatar's field of view, a step of extracting the overlap ratio between the avatar's field of view and the advertisement transmission area of ​​each advertisement contents may be further included, and the advertisement content with the highest overlap ratio may be determined as the advertisement content actually viewed by the avatar.

[0129] Figure 23 is a block diagram showing the configuration of a device (or server) according to the present invention.

[0130] The device (1000) according to the present invention can be implemented as various devices such as a server or a terminal. The device (1000) according to the present invention can be a digital device equipped with a processor and memory and capable of computing, such as a laptop computer, a notebook computer, a desktop computer, a web pad, or a mobile phone.

[0131] Furthermore, the device (1000) according to the present invention may be a web server providing a metaverse platform. Furthermore, the device (1000) according to the present invention may be a server providing a cloud computing service. More specifically, the device (1000) according to the present invention may be a server providing a cloud computing service, a type of Internet-based computing that processes information using another computer connected to the Internet rather than the user's computer. A cloud computing service may be a service that stores data on the Internet and allows users to access it anytime and anywhere via an Internet connection without having to install necessary data or programs on their own computers. Data stored on the Internet can be easily shared and transmitted with simple operations and clicks. Furthermore, a cloud computing service may be a service that not only simply stores data on an Internet server, but also allows users to perform desired tasks using the functions of application programs provided on the web without having to install separate programs, and may allow multiple people to simultaneously share and work on documents. Furthermore, a cloud computing service may be implemented in the form of at least one of an Infrastructure as a Service (IaaS), a Platform as a Service (PaaS), a Software as a Service (SaaS), a virtual machine-based cloud server, and a container-based cloud server. That is, the device (1000) according to the present invention can be implemented in the form of at least one of the aforementioned cloud computing services. The specific description of the aforementioned cloud computing services is merely exemplary, and any platform that constructs the cloud computing environment of the present invention may be included.

[0132] A device (1000) according to the present invention may include a processor (1010), a user account registration unit (1020), an avatar generation unit (1030), an advertising content provision unit (1040), an eye tracking unit (1050), an advertising viewing determination unit (10060), a reward provision unit (1070), a storage unit (1080), and a communication unit (1090).

[0133] The device (1000) according to the present invention performs various embodiments of the method described above, and each component has a function of performing each step of the method. However, each component illustrated in FIG. 23 is merely functionally distinguished according to the operation performed, and the processor may perform the operation of the entire component or a part of the component. In addition, two or more components may be integrated into one component, and one component may be separated into two or more components. In other words, it should be understood that the block diagram illustrated in FIG. 23 is merely a schematic diagram to easily understand the operation of the device (1000) according to the present invention, and the name, structure, shape, number, etc. of each component do not limit the scope of the present invention.

[0134] The processor (1010) controls the overall operation of the user account registration unit (1020), the avatar generation unit (1030), the advertising content provision unit (1040), the eye tracking unit (1050), the advertising viewing determination unit (10060), the reward provision unit (1070), the storage unit (1080), and the communication unit (1090). The processor (1010) can read a computer program stored in the storage unit (1080) to perform a method according to the present invention. The processor (1010) may be composed of one or more cores, and may be implemented as a central processing unit (CPU), a general purpose graphics processing unit (GPGPU), a tensor processing unit (TPU), etc. of a computing device.

[0135] The user account registration unit (1020) registers user information. User information may include the user's avatar information, item information, authority information, owned assets, shares, etc. Meanwhile, the user account registration unit (1020) may further include media space creation history information, based on which the user's level may be determined. In other words, users who have created multiple media spaces may have their level increased, and various rewards may be granted for activities within the metaverse space.

[0136] The avatar creation unit (1030) creates an avatar that operates in the metaverse space. The avatar operates in the metaverse space through user manipulation. The avatar creation unit (1030) presents the avatar's appearance (face, eyes, nose, mouth, ears, skin color, hair, body type, hands, feet, etc.), clothing, accessories, shoes, gloves, bags, etc. to the user, and can create the avatar's appearance, appearance, posture, etc. by combining options selected by the user. The avatar creation unit (1030) can assign an ID that can identify the user.

[0137] The advertising content provider (1040) performs location selection, transmission, modification, recording, etc. of advertising content within the metaverse space. The advertising content provider (1040) can be connected to an external server (e.g., an advertising provider server) or an external platform (e.g., an advertising platform) via the communication unit (1090) to receive advertisements to be transmitted in the metaverse. The received advertising content can be stored in the storage unit (1080). In addition, the advertising content provider (1040) can select an advertisement transmission area. The selection of the advertisement transmission area can be performed arbitrarily by the advertising content provider (1040) or at the request of a user, an advertising provider, etc.

[0138] The eye tracking unit (1050) tracks the gaze of an avatar adjacent to the advertising transmission area at the time when the advertising content is transmitted. The adjacent avatar may be an avatar located within a predetermined radius centered on the advertising transmission area. Accordingly, the eye tracking unit (1050) may set an avatar extraction area to extract avatars adjacent to the advertising transmission area. The eye tracking unit (1050) may track the gaze of the avatar in various ways as mentioned above, but is not limited thereto.

[0139] The advertisement viewing determination unit (1060) determines at least one of whether a user corresponding to an avatar has viewed an advertisement and the advertisement viewing time. The advertisement viewing determination unit (1060) tracks the gaze of the avatar and determines whether the advertisement has been viewed based on whether the advertisement transmission area is included in the avatar field of view based on the avatar's gaze. Specifically, the advertisement viewing determination unit (1060) obtains the avatar field of view based on the avatar's gaze and determines whether the avatar has viewed the advertisement for the advertisement content based on whether the avatar field of view and the advertisement transmission area overlap. The advertisement viewing determination unit (1060) can obtain the avatar's gaze and avatar field of view based on the screen information of the user's HMD (Head-Mounted Display) received through the communication unit (1090). In addition, the advertisement viewing determination unit (1060) can obtain the avatar's gaze and avatar field of view based on the user's gaze information received through the communication unit (1090). The advertisement viewing judgment unit (1060) calculates an overlap ratio between the avatar's field of view and the advertisement transmission area, and can determine that the avatar is actually viewing the advertisement content only when the overlap ratio is greater than or equal to a predetermined value. When two or more advertisement contents are included in the avatar's field of view, the advertisement viewing judgment unit (1060) can extract an overlap ratio between the avatar's field of view and the advertisement transmission area of ​​each advertisement contents, and determine the advertisement content with the highest overlap ratio as the advertisement content actually viewed by the avatar. The advertisement viewing judgment unit (1060) can extract an advertisement viewing time during which the avatar's field of view and the advertisement transmission area overlap.

[0140] The reward providing unit (1070) provides a predetermined reward to the avatar depending on whether or not the advertisement is viewed. At this time, the predetermined reward may be selected differently depending on the advertisement viewing time obtained by the advertisement viewing determining unit (1060). The reward providing unit (1070) may calculate a reward level based on the ratio of the advertisement content playback time and the advertisement viewing time, and select a predetermined reward based on the reward level. The reward providing unit (1070) may select a predetermined reward based on the number of avatars adjacent to the advertisement transmission area. At this time, the number of avatars may be calculated by counting only avatars that actually view the advertisement, i.e., avatars whose advertisement transmission area of ​​the advertisement content is included within the avatar's field of view.

[0141] The storage unit (1080) can store a computer program for performing a method according to the present invention. The storage unit (1080) can include various information about administrators and users, attribute information about objects included in the metaverse space, tokenization information about objects, etc. In addition, the storage unit (1080) can store various advertising contents to be transmitted on the metaverse. The storage unit (1080) can store a look-up table (LUT) for the reward level described above. The storage unit (1080) can store basic reward information for advertising contents, reward setting / change information according to the number of adjacent avatars, reward setting / change information according to the advertisement viewing time, etc.

[0142] The communication unit (1090) is connected to external devices and external servers via wired or wireless means to transmit and receive various signals and data. Here, the external devices may be, but are not limited to, an HMD, a smartphone, a tablet PC, a laptop, etc. The communication unit (1080) transmits and receives data with external devices such as an HMD, a smartphone, a tablet PC, etc. via a wired or wireless communication network. The communication unit (1090) can receive screen information displayed on a user device (e.g., an HMD), user gaze information tracked by the user device, etc.

[0143] Meanwhile, although not shown in the drawing, the metaverse space creation unit (not shown) for creating one or more media spaces on the metaverse space may further be included. The metaverse space creation unit may create a first landmark on the metaverse space at the request of a first user, create a second landmark on the metaverse space at the request of a second user, and create a road connecting the first landmark and the second landmark on the metaverse space based on the requests of the first user and the second user. In particular, the metaverse space creation unit may create one or more virtual stores on the road based on at least one of the requests of the first user having authority over the first landmark and the second user having authority over the second landmark.

[0144] Additionally, although not shown in the drawing, the system may further include an object minting unit (not shown) that tokenizes various spaces (landmarks, roads, virtual stores, etc.) and objects within the metaverse created at the user's request into NFTs. The object minting unit (not shown) can generate NFTs by linking with an external platform or can generate NFTs internally within the platform. Meanwhile, assets within the metaverse space can be created as NFTs and used as objects of transaction. In addition, spaces (landmarks, etc.) for sale within the metaverse can be demarcated, and transactions can be made through online and offline payments based on the area of ​​the target transaction.

[0145] In addition, although not shown in the drawing, the system may further include components such as a virtual space composition unit (not shown), an object modeling unit (not shown), and an avatar management unit (not shown) for visualizing the metaverse space. The virtual space design unit (not shown) has the function of pre-demarcating, dividing, and arranging the virtual metaverse space to be the subject of a transaction, and setting the purpose of each space. Users can purchase spaces demarcated by the virtual space design unit (not shown) and use them as landmarks, roads, and virtual stores. The transaction objects may be assigned various values ​​depending on their size, purpose, etc. The object modeling unit (not shown) models objects based on user input, assigns attribute information, and then arranges them in the virtual space. Objects modeled by the object modeling unit (not shown) can be displayed on the user terminal. The avatar management unit (not shown) creates avatar models that will be active within the metaverse space and presents them to users for selection. The avatar management unit (not shown) can create various objects related to the avatar (clothing, bags, accessories, hair, poses, etc.). Alternatively, various objects (clothes, bags, accessories, hair, poses, etc.) created by users can be input and sold on consignment within the metaverse space.

[0146] A computer program according to the present invention can be stored in a recording medium to execute various embodiments of the above-described method on a computer.

[0147] The method according to the present invention may be implemented in the form of program commands that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable recording medium may include program commands, data files, data structures, etc., singly or in combination. The program commands recorded on the medium may be those specially designed and configured for the present invention or may be those known and available to those skilled in the art of computer software. Examples of the computer-readable recording medium include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and hardware devices specially configured to store and execute program commands, such as ROMs, RAMs, and flash memories. Examples of program commands include not only machine language codes generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter, etc. The above-mentioned hardware devices may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

[0148] In addition, although the above description focuses on examples, these are merely examples and do not limit the present invention. Those skilled in the art to which the present invention pertains will appreciate that various modifications and applications not exemplified above are possible without departing from the essential characteristics of the present invention. For example, each component specifically shown in the examples can be modified and implemented. In addition, differences related to such modifications and applications should be interpreted as being included within the scope of the present invention defined in the appended claims.

[0149] [Explanation of symbols]

[0150] 1000: Device or server

[0151] 1010: Processor

[0152] 1020: User Account Registry

[0153] 1030: Avatar Creation Department

[0154] 1040: Advertising Content Provider

[0155] 1050: Eye tracking unit

[0156] 1060: Advertisement Viewing Judgment Department

[0157] 1070: Reward Provider

[0158] 1080: Storage

[0159] 1090: Communications Department

Claims

1. Step of selecting an advertising transmission area to transmit advertising content within the metaverse space; A step of tracking the gaze of an avatar adjacent to the advertisement transmission area at the time when the advertisement content is transmitted; A step of determining whether the advertisement transmission area is included within the avatar field of view based on the avatar's gaze; and A reward providing method comprising: a step of providing a predetermined reward to the avatar when the above advertisement transmission area is included within the avatar field of view.

2. In paragraph 1, A reward providing method further comprising a step of counting an advertisement viewing time in which the advertisement transmission area is included within the above avatar field of view.

3. In paragraph 2, The above-mentioned reward is a reward provision method in which the reward is selected differently depending on the advertisement viewing time.

4. In paragraph 2, A step of calculating a reward level based on the ratio of the playback time of the above advertising content and the advertising viewing time; and A reward providing method further comprising a step of selecting the predetermined reward based on the reward level.

5. In paragraph 1, A reward providing method further comprising: a step of extracting an overlap ratio between the avatar field of view and the advertisement transmission area of ​​each advertisement content, when two or more advertisement contents are included within the avatar field of view.

6. In paragraph 5, The above-mentioned judging step is a reward providing method in which only the advertisement transmission area of ​​the advertisement content with the highest overlap ratio is included within the avatar field of view.

7. In paragraph 5, The above-described judging step determines that the advertisement transmission areas of the two or more advertisement contents are all included within the avatar's field of view, The step of providing the above is a reward providing method that resets the preset reward for the two or more advertising contents based on the overlap ratio and provides the reward to the avatar.

8. In paragraph 1, The above adjacent avatars are avatars located within a predetermined radius centered on the advertisement transmission area, and a reward providing method determines the predetermined reward based on the number of avatars located within the predetermined radius.

9. In paragraph 8, The number of avatars is calculated by a reward provision method by counting only avatars whose advertisement transmission area is included in the avatar field of view.

10. In paragraph 1, Further comprising a step of receiving screen information of a HMD (Head-Mounted Display) of a user who operates the avatar or user gaze information of the user tracked by the HMD; The above-mentioned judging step is a reward providing method, wherein at least one of the avatar's gaze and the avatar's field of view is acquired based on the screen information or the user's gaze information.

11. An advertising content provider that selects an advertising transmission area to transmit advertising content within the metaverse space; An avatar gaze tracking unit that tracks the gaze of an avatar adjacent to the advertisement transmission area at the time the advertisement content is transmitted; An advertisement viewing judgment unit that determines whether the advertisement transmission area is included within the avatar's field of view based on the avatar's gaze; and A reward providing device including a reward providing unit that provides a predetermined reward to the avatar when the advertisement transmission area is included within the avatar field of view.

12. In paragraph 11, The above advertisement viewing judgment unit is a reward providing device that extracts the advertisement viewing time that includes the advertisement transmission area within the above avatar field of view.

13. In paragraph 12, A reward providing device in which the above-mentioned predetermined reward is selected differently depending on the advertisement viewing time.

14. In paragraph 12, The above reward provider, A reward providing device that calculates a reward level based on the ratio of the playback time of the above advertisement content and the advertisement viewing time, and selects the predetermined reward based on the reward level.

15. In paragraph 11, The above advertisement viewing judgment department is, A reward providing device that extracts the overlap ratio between the avatar field of view and the advertisement transmission area of ​​each advertisement content when two or more advertisement contents are included within the avatar field of view.

16. In paragraph 15, The above advertisement viewing judgment unit is a reward providing device that judges that only the advertisement transmission area of ​​the advertisement content with the highest overlap ratio is included within the avatar field of view.

17. In paragraph 15, The above advertisement viewing judgment unit determines that the advertisement transmission areas of the two or more advertisement contents are all included within the avatar's field of view, The reward providing unit is a reward providing device that resets a preset reward for the two or more advertising contents based on the overlap ratio and provides the reward to the avatar.

18. In paragraph 11, The above adjacent avatars are avatars located within a predetermined radius centered on the advertisement transmission area, and the reward providing device determines the predetermined reward based on the number of avatars located within the predetermined radius.

19. In paragraph 18, The number of the above avatars is calculated by counting only the avatars whose advertising transmission area of ​​the above advertising content is included within the above avatar field of view.

20. In paragraph 11, It further includes a communication unit that receives screen information of the HMD (Head-Mounted Display) of the user who operates the avatar or user gaze information of the user tracked by the HMD; A reward providing device, wherein at least one of the avatar's gaze and the avatar's field of view is acquired based on the screen information or the user's gaze information.

Citation Information

Patent Citations

  • System for Calculating Probability of Advertisement Exposure of 360 Game Replay Video

    KR101915400B1

  • Advertisementsystem and method for using cyberspace

    KR1020000036360A

  • Method for transmitting data based on SMS communication at supervisory control and data acquisition system

    KR102052552B1

  • A Method of Providing Advertisements in a Virtual Space through an Algorithm for Determining Whether or Not to Consume Advertisements with Improved Accuracy

    KR102414412B1

  • Inspecting apparatus and method for inspection

    US9030463B2