Method for performing image generation

Abstract

To provide a method for generating an image of a user avatar tied up with regional popularization activity, business activity of a business operator, or the like.SOLUTION: In a method of executing image generation by an application that supports execution of communication between users in a virtual space, a control unit of a server terminal detects that a user avatar visits a photo booth provided by each of a plurality of business operators in the virtual space, determines a business operator that provides the photo booth, and generates an image in which an image based on image data provided by the business operator and an image of the user avatar are combined.SELECTED DRAWING: Figure 8

Description

[Technical Field]

[0001] The present invention relates to a method for performing image generation in an application that supports communication between users in a virtual space. [Background technology]

[0002] Recently, in virtual spaces, users can communicate with each other through avatars and the like, and communication similar to conversation in real space is becoming possible.

[0003] For example, Patent Document 1 discloses a method for capturing an image of a user's avatar object in a virtual space. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent registration No. 6298563 Summary of the Invention [Problem to be solved by the invention]

[0005] However, although several methods for capturing images of user avatars in virtual space have been disclosed, including the technology disclosed in Patent Document 1, no measures have been disclosed for utilizing photographs in virtual space for outreach activities by specific local organizations (including local governments) in virtual space / real space, or for promoting the business activities of specific businesses (such as IP holders of characters, content providers, etc.).

[0006] Therefore, an object of the present invention is to realize the generation of user avatar images that are tied in with local outreach activities, business activities of businesses, and the like. [Means for solving the problem]

[0007] In one embodiment of the present invention, a method for generating images in an application that assists users in communicating with each other in a virtual space is provided, in which a control unit of a server terminal detects that a user avatar has visited a photo booth provided by each of a plurality of businesses within the virtual space, determines the business that provides the photo booth, and generates an image that combines an image based on image data provided by the business with an image of the user avatar. [Effects of the Invention]

[0008] According to the present invention, it is possible to generate user avatar images that are tied in with local outreach activities, business activities of businesses, and the like. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a block diagram showing an image generation execution system according to a first embodiment of the present invention. [Figure 2] FIG. 2 is a functional block diagram showing the server terminal 100 of FIG. [Figure 3] FIG. 2 is a functional block diagram showing the user terminal 200 of FIG. [Figure 4] FIG. 2 is a diagram showing an example of user data stored in the server terminal 100. [Figure 5] 3 is a diagram showing an example of business operator data stored in the server terminal 100. FIG. [Figure 6] FIG. 2 is a diagram showing an example of content data stored in the server terminal 100. [Figure 7] 3 is a flowchart illustrating an example of a method for performing image generation according to a first embodiment of the present invention. [Figure 8] 10 is a flowchart illustrating another example of an image generation execution method according to the first embodiment of the present invention. [Figure 9] 1A to 1C are diagrams illustrating an example of an image generation execution method according to a first embodiment of the present invention. [Figure 10]1A to 1C are diagrams illustrating an example of an image generation execution method according to a first embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments of the present invention will be described with reference to the drawings. Note that the embodiments described below do not unduly limit the content of the present invention described in the claims. Furthermore, not all of the components shown in the embodiments are necessarily essential components of the present invention.

[0011] <Configuration> 1 is a block diagram showing a system for generating images in an application that supports communication between users in a virtual space according to a first embodiment of the present invention. As an example of this embodiment, the system 1 includes a server terminal 100 associated with a virtual space provision service provider that provides an application that enables users to operate user avatars in a virtual space and communicate with other users, and user terminals 200A and 200B (hereinafter collectively referred to as "user terminals 200") associated with the users.

[0012] The server terminal 100 and the user terminal 200 are connected to each other via a network NW1. The network NW is configured by the Internet, an intranet, a wireless LAN (Local Area Network), a WAN (Wide Area Network), or the like.

[0013] The server terminal 100 may be, for example, a general-purpose computer such as a workstation or a personal computer, or may be logically realized by cloud computing.

[0014] The user terminal 200 is, for example, an information processing device such as a personal computer or a tablet terminal, but may also be configured as a smartphone, a mobile phone, a PDA, or the like.

[0015] Fig. 2 is a functional block configuration diagram of the server terminal 100 of Fig. 1. The server terminal 100 includes a communication unit 110, a storage unit 120, and a control unit .

[0016] The communication unit 110 is a communication interface for communicating with the user terminal 200 via the network NW, and communication is performed according to a communication protocol such as TCP / IP (Transmission Control Protocol / Internet Protocol).

[0017] The storage unit 120 stores input data, programs for executing various control processes and functions in the control unit 130, and is composed of RAM (Random Access Memory), ROM (Read Only Memory), etc. The storage unit 120 also has a user data storage unit 121 that stores various data related to users, an operator data storage unit 122 that stores various data related to operators, and a content data storage unit 123 that stores various data related to content. A database (not shown) storing various data may be constructed outside the storage unit 120 or the server terminal 100, and all or part of the user data, operator data, and content-related data may be stored in the user terminal 200.

[0018] The control unit 130 controls the overall operation of the server terminal 100 by executing a program stored in the storage unit 120, and is composed of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), etc. Functions of the control unit 130 include an information receiving unit 131 that receives information from each terminal, and an information processing unit 132 that refers to and processes various data related to users, various data related to businesses, and various data related to content. The information receiving unit 131 and the information processing unit 132 are activated by a program stored in the storage unit 120 and executed by the server terminal 100, which is a computer (electronic calculator). The program stored in the storage unit 120 may also be stored in the user terminal 200 and processed by the control unit 240 of the user terminal 200.

[0019] The information receiving unit 131 is provided by the server terminal 100 and receives information from the user terminal 200 via the communication unit 110. For example, the information receiving unit 131 receives from the user terminal 200 a request to take a picture of a user avatar in a virtual space.

[0020] The information processing unit 132 executes predetermined processing while referring to the user data, business data, and content data, for example, executing processing to generate an image of a user avatar in response to a request to capture a user avatar.

[0021] The control unit 130 may also have a screen generation unit (not shown), which generates screen information to be displayed via the user interface of each of the multiple user terminals 200 upon request. For example, the control unit 130 generates a user interface by using image and text data (not shown) stored in the storage unit 120 as material and arranging various images and text in predetermined areas of the user interface based on predetermined layout rules. Processing related to the image generation unit may also be executed by a GPU (Graphics Processing Unit).

[0022] Fig. 3 is a functional block diagram showing the user terminal 200 of Fig. 1. The user terminal 200 includes a communication unit 410, a display operation unit 420, a storage unit 430, and a control unit 440.

[0023] The communication unit 210 is a communication interface for communicating with the server terminal 100 via the network NW, and communication is performed according to a communication protocol such as TCP / IP.

[0024] The display operation unit 220 is a user interface used by the user to input instructions and display text, images, etc. in accordance with input data from the control unit 240. If the user terminal 200 is a personal computer, the display operation unit 220 is configured with a display, keyboard, and mouse. If the user terminal 200 is a smartphone or tablet terminal, the display operation unit 220 is configured with a touch panel or the like. The display operation unit 420 is activated by a control program stored in the storage unit 430 and executed by the user terminal 200, which is a computer (electronic calculator). Other examples of the user terminal 200 include game consoles and smartwatches, and examples of display devices include VR glasses, AR glasses, head-mounted displays, holograms, and projectors. However, the combination of the user terminal and the display device can be selected appropriately and is not limited to a specific combination. In this case, the display operation unit 220 can also be a VR controller.

[0025] The storage unit 230 stores input data, programs for executing various control processes and functions in the control unit 240, and is composed of RAM, ROM, etc. The storage unit 230 also temporarily stores the contents of communication with the server terminal 100.

[0026] The control unit 240 controls the overall operation of the user terminal 200 by executing the programs stored in the storage unit 230, and is composed of a CPU, a GPU, and the like.

[0027] FIG. 4 is a diagram showing an example of user data stored in the server terminal 100. As shown in FIG.

[0028] The user data 1000 stores various data related to a user. For convenience of explanation, FIG. 4 shows an example of one user (a user identified by the user ID "10001"), but information related to multiple users can be stored. The various data related to a user can include, for example, basic user information (such as a user name arbitrarily registered by the user), avatar data (user avatar image data, 3D shape data, bone object data, texture data, animation data, and parameter data constituting the user avatar, such as coordinate information and color information, as well as the user avatar's profile, conversation / action history, etc.), world data (such as background image data, animation data, and object data constituting the virtual space), and image data (such as images taken by the user avatar in a photo booth within the virtual space). It can also include wallet information (such as a wallet ID and asset transaction history (asset purchase frequency and amount)) related to a wallet for trading images generated by the user. As described above, all or part of the user data 2000 can be stored in the user terminal 200.

[0029] FIG. 5 is a diagram showing an example of business operator data stored in the server terminal 100. As shown in FIG.

[0030] The business data 2000 stores various data related to local organizations and businesses (collectively referred to as "businesses") that promote local areas and products / services through facilities such as antenna shops and stores in the virtual space. For ease of explanation, FIG. 5 shows an example of one business (a business identified by business ID "20001"), but information related to multiple users can also be stored. Examples of data related to businesses include basic business information (such as a user name arbitrarily registered by the business), facility data (image data of objects such as stores, 3D shape data, texture data, animation data, and parameter data constituting them, such as coordinate information and color information, as well as explanatory information about the stores, content / product information, explanatory information about photo booths, identification information (ID) of the stores / photo booths, and location information of the stores / photo booths in the virtual space), and image data (such as background images and object images used by user avatars to take photos in the photo booths in the virtual space). As mentioned above, all or part of the business data 2000 can also be stored in the user terminal 200.

[0031] FIG. 6 is a diagram showing an example of content data stored in the server terminal 100. As shown in FIG.

[0032] The content data 3000 can include asset data such as avatar data (avatar image data, 3D shape data, bone object data, texture data, animation data and parameter data that constitutes them, such as coordinate information and color information) that the user operates within the virtual space, and world data (background image data, animation data, object data, etc. that constitute the virtual space).

[0033] <Processing flow> The flow of image generation processing executed by the system 1 of this embodiment when photographing a user avatar in a virtual space will be described with reference to Fig. 7. Fig. 7 is a flowchart showing an example of an image generation execution method according to the first embodiment of the present invention. Hereinafter, an example will be given in which the control unit 130 of the server terminal 100 processes various data and programs stored in the storage unit 120 of the server terminal 100. However, in the case where the various data and programs are stored in the user terminal 200, this can also be interpreted as processing mainly executed by the control unit 240 of the user terminal 200.

[0034] First, as a preprocessing step in step S101, to use the system 1, a user accesses the server terminal 100 using a web browser or application on their terminal. If this is their first time using the service, they register by entering their basic user data. During user registration, the user can register any username without providing personal information. The information receiving unit 131 of the control unit 130 of the server terminal 100 receives information necessary for user registration from the user terminal 200 via the communication unit 110. The information processing unit 132 of the control unit 130 of the server terminal 100 stores the received information as user data 1000 in the user data storage unit 121 of the memory unit 120. If the user has already registered and obtained a user account, they can log in and use the service after undergoing a predetermined authentication process, such as entering an ID and password. After this authentication, a predetermined user interface is provided via a website, application, or the like. For example, the user can operate a user avatar in a virtual space, visit various facilities, and communicate with other users via voice or text. In this example, first, a user operates their own user avatar in a virtual space and visits facilities (antenna shops, character shops, etc.) set up by local organizations or businesses that provide products / services that they are interested in. Here, photo booths are set up in each facility operated by multiple businesses in the virtual space, and in each photo booth, users can take images that combine their user avatar with other images such as background images.

[0035] First, in the process of step S101, the information processing unit 132 of the control unit 130 of the server terminal 100 detects that the user avatar has approached the photo booth of the facility in the virtual space, i.e., that the user avatar has visited the photo booth. Here, there are several methods for detecting a visit, but for example, the user may operate the user avatar and detect that the user avatar has visited the photo booth when the position coordinates of the photo booth of the facility match the position coordinates of the user avatar, or when the user avatar approaches within a predetermined range from the coordinates of the photo booth, or the user may explicitly send a command to the server terminal 100 via the user terminal 200 indicating that he or she has visited the photo booth.

[0036] Next, in step S102, the information processing unit 132 determines which business provides the photo booth visited by the user avatar. For example, if the detection is based on the coordinates of the photo booth and / or the user avatar, the information processing unit 132 determines which business's photo booth (or facility) the user avatar visited based on the location coordinates of the photo booth (or facility where it is installed) in the virtual space or the location coordinates of the user avatar. As a premise, the location coordinates of the business's photo booth (or facility) in the virtual space are stored as business data 2000 in the memory unit 120 of the server terminal 100, and the information processing unit 132 can identify the business associated with the photo booth (or facility) based on the detected location coordinates of the photo booth or the user avatar. Alternatively, if the detection is based on a command indicating that the user avatar visited the photo booth, the information processing unit 132 can determine the business that provides the photo booth based on the photo booth's identification information or location information included in the command.

[0037] Here, the image generation method in the photo booth will be further described in detail with reference to FIG.

[0038] First, in the process of step S201, the user operates a user avatar visiting the photo booth and sends a request to take a photo of the user avatar at the photo booth to the server terminal 100 via the user terminal 200. Here, the method for starting photography at the photo booth is not limited to this step, and it is also possible to start without this step, or the photography process can be initiated not by the user but by the system.

[0039] Next, in step S202, the information processing unit 132 of the control unit 130 of the server terminal 100 determines a background image for the photograph to be taken in the photo booth based on the information of the determined business. Here, the information processing unit 132 references the business data 2000 of the determined business in the business data storage unit 122 of the memory unit 120, and sets the background image (and / or object images such as people and things) previously set by the business as the background image (and / or object images such as people (real-life singers, idols, characters, etc.) and things (real-life goods or items, etc.)). Here, if the business is a regional organization such as a local government, the background image can be a landscape image of the region (an image of the sea or mountains, etc.). Also, an avatar image of a local mascot can be set as an object image together with or instead of the background image. Also, multiple background images and object images can be set so that the user can select one.

[0040] Next, in step S203, the information processing unit 132 generates multiple patterns of avatar pose images to be composited with the determined background image and presents them to the user terminal 200. For example, as shown in FIG. 9, multiple avatar pose patterns can be presented against a background image prepared by the business operator. At this point, the avatar's texture data is not mapped, and only the 3D shape data of the avatar's pose can be displayed. Here, the information processing unit 132 can pre-set multiple avatar pose images for the determined background image. The pose images may be set to match each background image pre-stored by the business operator. For example, if the background image is an image of a resort, the avatar's pose can be set to resemble a tourist's behavior. The pose settings may be based on a rule-based combination of background image patterns and pose patterns, or may be generated in advance by machine learning based on a learning model based on input data of background images and human images and output data combining the poses of the human images. Also, for example, if the background image is an image of a singer, idol, or character, an avatar can be placed relative to the singer, etc. using a predetermined layout and posing pattern, or the avatar can be superimposed on the singer, etc. and placed relative to the posing pattern of the singer, etc.

[0041] Next, in the process of step S204, the information receiving unit 131 of the control unit 130 of the server terminal 100 receives a selection of a desired posing pattern from the presented plurality of posing patterns from the user terminal 200. Here, there may be multiple desired posing patterns.

[0042] Next, in step S205, the information processing unit 132 maps the texture data of the user avatar onto a posing image selected from among multiple patterns of avatar posing images to be composited onto the determined background image, thereby compositely combining the user avatar image with the background image and ultimately generating an image as a photo booth photo. For example, as shown in FIG. 10, an image of the user avatar in a posing pattern selected by the user is generated against a background image prepared by the business operator. Here, the business operator can unlock and provide a portion of the posing pattern or a frame that forms the background of the photo to the user through a charging process.

[0043] Here, the information processing unit 132 can print the generated image in response to a user request using a printer (not shown) connected to the user terminal 200 or by a method such as online printing, and the service provider providing the photo booth as a function can receive payment from the user for printing. Furthermore, the service provider providing the photo booth as a function can receive a reasonable amount of compensation in exchange for setting up the photo booth (providing the photo booth function) from local organizations and businesses providing digital content that provide photo booths in virtual spaces.

[0044] Users can also trade the generated images with marketplace operators or other users through primary or secondary distribution. The rights and transactions of image ownership transactions and / or revenue distributions (including revenue distributions to creators of background images or characters, etc.) can be recorded on a blockchain network (not shown). Here, the server terminal 100 receives transaction information regarding image transactions conducted with users of user terminals 200 or between users of user terminals 200, as described above, and records non-fungible tokens (NFTs) associated with asset identifiers, etc., along with other transaction information on the blockchain network. NFTs are tokens issued, for example, using the ERC721 standard of Ethereum, a blockchain network platform. They are units of data recorded on the blockchain network and can be associated with editions (ownership rights) of digital content based on IDs, making them non-fungible. NFTs are recorded on the blockchain along with smart contracts and are traceable, making it possible to verify transaction information, including details and history of rights holders and ownership information. Furthermore, by using smart contracts, contracts regarding transactions between platform operators and users, or between multiple users, can be automatically generated, approved, and executed without the need for a third party. Smart contracts also allow the parties to a transaction and third parties to access transaction information without the need for a server terminal, improving service convenience and reducing operational costs.

[0045] As described above, users can operate their user avatars to visit areas or stores of interest in the virtual space and take photos of the user avatar that are unique to that area or its character through photo booths set up by each business. For business operators, this not only eliminates the cost of setting up a photo booth, but also allows for smooth promotion of their business through photo booth photography. Furthermore, since a theoretically infinite number of variations can be provided in the combination of background images, posing patterns, and avatar images, users can also enjoy a wider range of photo booth photos, which can also revitalize the virtual space community.

[0046] Although the embodiments of the present invention have been described above, they can be embodied in various other forms, and various omissions, substitutions, and modifications can be made. These embodiments, modifications, and omissions, substitutions, and modifications are included in the technical scope of the claims and their equivalents. [Explanation of symbols]

[0047] 1 System 100 Server terminal, 110 Communication unit, 120 Storage unit, 130 Control unit, 200 User terminal, NW1 Network

Claims

1. A method for generating images in an application that supports communication between users in a virtual space, comprising: The control unit of the server terminal Detecting that a user avatar has visited a photo booth provided by each of a plurality of businesses within the virtual space; Decide on a business operator to provide the photo booth; A method for generating an image by combining an image based on image data provided by the business operator with an image of the user avatar.

2. 10. The method of claim 1, Determining the business operator Refer to location information of the user or the photo booth; determining the carrier based on the location information.

3. 10. The method of claim 1, generating the image includes: and using image data provided by the business as a background image.

4. 4. The method of claim 3, generating the image includes: presenting a plurality of posing patterns of an avatar against the background image; Based on the selection of one posing pattern from the plurality of posing patterns, rendering an image of the user avatar in the selected posing pattern.

5. 10. The method of claim 1, The method, wherein the plurality of posing patterns are preset corresponding to the background image.

6. 10. The method of claim 1, The method, wherein the control unit unlocks and provides specific images from among the image data provided by the business operator based on a charging process by the user.

7. 10. The method of claim 1, The control unit executes a process to make the image generated by rendering printable in response to a request from the user.

8. 10. The method of claim 1, The control unit controls a business that provides the photo booth as a function to receive payment from the business that provides the photo booth in exchange for installing the photo booth.

Images