Information processor, method for processing information, and program

Abstract

To generate contents with different impressions on the basis of a content created by a game and to provide the contents to a user.SOLUTION: The information processor according to the present technique acquires a content uploaded from a business-oriented game machine which provides a game of creating the content, and generates a processed content obtained by processing a content, by using a generative model generated by machine learning. The generated processed content is provided to a user who used the game. The present technique is applicable to a system which provides a user of the game with the content created by using the game provided by the business-oriented game.SELECTED DRAWING: Figure 11

Description

[Technical field]

[0001] The present technology relates to an information processing device, an information processing method, and a program, and in particular to an information processing device, an information processing method, and a program that are capable of generating content with different impressions based on content created in a game and providing the content to a user. [Background technology]

[0002] Conventionally, photo sticker creation devices are known. The photo sticker creation devices take a picture of a user, allow the user to edit the photographed image, and print the edited image on sticker paper for provision. The photo sticker creation devices are installed in amusement facilities and the like.

[0003] The flow of a game provided by the photo sticker creation device typically involves taking a photo of the user in the shooting space as the subject, then moving the user to the editing space, editing the image according to the operations performed in the editing space, and printing the edited image on sticker paper.

[0004] By the way, there is a membership service that provides users with images created in a game using a photo sticker creation device as image data, not as printed matter. Users who play the game can create an account to use the service, and then use a mobile device such as a smartphone to access an image acquisition site and view the images created in the game on the screen of the mobile device. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2018-031860 A Summary of the Invention [Problem to be solved by the invention]

[0006] Various technologies have been proposed to generate various types of content using inference models generated by machine learning. Such inference models used to generate content such as images, music, and text are also called generative AI (Artificial Intelligence).

[0007] By using generative AI in the above-mentioned services that provide images created in games as data, it is possible to expand the variety of content that users can receive, thereby improving the service.

[0008] The present technology has been made in light of these circumstances, and makes it possible to generate content that gives a different impression based on content created in a game, and provide it to users. [Means for solving the problem]

[0009] The information processing device of the first aspect of the present technology is a device including an acquisition unit that acquires content uploaded from an arcade game machine that provides a game for creating content, and a generation unit that processes the content to generate processed content using a generative model generated by machine learning, and provides the processed content to a user who has used the game.

[0010] A program according to a second aspect of the present technology is a program that causes a computer to execute a process of displaying content uploaded from an arcade game machine that provides a game in which content is created, receiving the processed content transmitted from a server that generates processed content by processing the content using a generative model generated by machine learning, and displaying the processed content.

[0011] In a first aspect of the present technology, content uploaded from an arcade game machine that provides a game in which content is created is obtained, and processed content that processes the content is generated using a generative model generated by machine learning, and is provided to a user who has used the game.

[0012] In a second aspect of the present technology, the content uploaded from an arcade game machine that provides a game for creating content is displayed, and the processed content transmitted from a server that generates processed content by using a generative model generated by machine learning is received, and the processed content is displayed. Effect of the Invention

[0013] According to the present technology, it is possible to generate content that gives a different impression based on content created in a game and provide it to a user. [Brief description of the drawings]

[0014] [Figure 1] 1 is a diagram illustrating an example of a configuration of an image providing system according to an embodiment of the present technology. [Diagram 2] FIG. 11 is a diagram showing an example of information uploaded from the photo sticker creating device. [Diagram 3] FIG. 1 is a diagram showing an example of a usage form of an image providing service. [Figure 4] FIG. 13 is a diagram showing a display example of a My Page screen. [Diagram 5] FIG. 11 is a diagram showing an example of how images are managed in an image management server. [Figure 6] FIG. 13 is a diagram showing an example of a confirmation screen display. [Figure 7] FIG. 13 is a diagram showing an example of generating a portrait image. [Figure 8] FIG. 13 is a diagram showing examples of an image with graffiti and an image without graffiti. [Figure 9] FIG. 4 is a sequence diagram illustrating a series of processes performed by each device. [Figure 10] FIG. 13 is a diagram showing an example of an image selection screen. [Figure 11] FIG. 13 is a diagram showing an example of a taste selection screen. [Figure 12] FIG. 13 is a diagram showing a display example of an edit screen. [Figure 13]FIG. 13 is a diagram showing an example of a display of a confirmation screen. [Figure 14] 2 is a block diagram showing an example of a hardware configuration of an image management server; [Figure 15] 2 is a block diagram showing an example of a functional configuration of an image management server; [Figure 16] 2 is a block diagram showing an example of a functional configuration of an image generation server; [Figure 17] FIG. 2 is a block diagram showing a configuration example of a mobile terminal. [Figure 18] FIG. 13 is a diagram showing a display example of a My Page screen. [Figure 19] 13 is a block diagram showing another example of the functional configuration of the image management server. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] <About the image provision service> System Configuration FIG. 1 is a diagram illustrating an example of the configuration of an image providing system.

[0016] The image providing system in FIG. 1 is configured by connecting an image management server 1, an image creation server 11, a photo sticker creating device 2, and a mobile terminal 3 via the Internet.

[0017] 1 shows only one photo sticker creating device 2, but in reality, multiple photo sticker creating devices 2 sold by the same manufacturer are provided. The mobile terminals 3 are smartphones of users (users) who use the photo sticker creating device 2, and are provided for example in the same number as the number of users who use the photo sticker creating device 2.

[0018] The photo sticker creation device 2 is an arcade game machine that provides a photo creation game. The photo sticker creation device 2 is installed in an amusement facility such as a game center or a store.

[0019] Users of the photo sticker creating device 2 are mainly high school girls and young women. In the photo sticker creating device 2, multiple users, mainly two or three people per group, can enjoy the game. Of course, in the photo sticker creating device 2, one user can also enjoy the game.

[0020] In the photo sticker creation device 2, the user takes a photograph, becoming the subject of the photograph. The user performs an editing operation to combine the photographed image obtained by the photographing operation with a composite image such as handwritten characters or a stamp image, and edits the photographed image into a colorful image. The user receives a sticker paper on which an edited image, which is the edited photographed image, is printed, and ends the series of games.

[0021] In this way, the game provided by the photo sticker creating device 2 is played by taking pictures of multiple users as subjects, and editing the pictures taken by the users in response to their operations to create edited pictures. For example, pictures of multiple users together are created as taken pictures and edited pictures.

[0022] The photo sticker creation device 2 includes a computer that controls the overall operation of the photo sticker creation device 2, a camera that photographs the user, a photography monitor that displays a live view image captured by the camera, an editing monitor that is used by the user to edit the photographed image, a printer that prints the image on a print medium such as sticker paper, etc. Details of the configuration of the photo sticker creation device 2 are disclosed in, for example, JP 2018-64220 A.

[0023] An editing screen on which buttons for selecting various editing tools are provided is displayed on the editing monitor. The user operates the display of the editing screen using, for example, a touch pen to edit the captured image.

[0024] In one game provided by the photo sticker creating device 2, multiple shots are taken, and multiple shot images, for example, five shot images, are obtained. In addition, editing is performed on each of the multiple shot images, and multiple edited images are created.

[0025] Hereinafter, editing will be referred to as doodling where appropriate. Editing of a photographed image is performed by selecting an editing tool displayed on an editing screen with a touch pen, and then tracing the photographed image to be edited with the touch pen as if doodling.

[0026] The photo sticker creating device 2 provides the images thus created to the user by printing them on sticker paper, and also by making the images viewable on the mobile terminal 3. The photo sticker creating device 2 transmits (uploads) the images created in the game to the image management server 1.

[0027] The image management server 1 receives images uploaded from the photo sticker creating device 2 and manages them by assigning a predetermined URL, etc. The image management server 1 provides images that a user who has accessed the image management server 1 by operating a mobile terminal 3 has created in a game on the photo sticker creating device 2.

[0028] The image providing service provided by the image providing system in Fig. 1 is a membership-based service that enables users to view images on the mobile terminal 3 and download images to the mobile terminal 3. It may also be possible to use the image providing service to perform image editing and the like.

[0029] After the user of the mobile terminal 3 finishes the game using the photo sticker creating device 2, he or she operates the mobile terminal 3 to access the image management server 1 and uses the image providing service to view images, etc. An application for displaying the screen of the image providing service provided by the image management server 1 is installed in the mobile terminal 3.

[0030] Other mobile terminals such as tablet terminals, and terminals such as PCs and TVs (television receivers) that can send and receive various information with servers on the Internet may also be used as information processing terminals for using the image provision service.

[0031] In the image providing service, a portrait image, which is content generated by the image generating server 11, is provided to the user of the mobile terminal 3. As will be described later, the image generating server 11 has a function of generating a portrait image, which is an illustration of the user's appearance, based on an image selected by the user of the mobile terminal 3 from among images uploaded from the photo sticker creating device 2.

[0032] In the image providing service, not only the image itself created in the game of the photo sticker creating device 2, but also a portrait image generated based on the image created in the game of the photo sticker creating device 2 is provided to the user.

[0033] <Image management function of Image Management Server 1> First, the function of the image management server 1 that manages the images created in the game of the photograph sticker creating device 2 will be described.

[0034] About uploaded information FIG. 2 is a diagram showing an example of information uploaded from the photo sticker creating device 2. As shown in FIG.

[0035] All photographed images and edited images created in a game are uploaded from the photo sticker creating device 2 to the image management server 1 for each game.

[0036] Management information is added to images uploaded from the photo sticker creating device 2. The management information is information that is generated in the photo sticker creating device 2 in order to manage the uploaded images, and is transmitted to the image management server 1. In the image management server 1, the uploaded images are managed in association with each piece of information included in the management information.

[0037] The management information includes a sticker ID, an image selection flag, an email address, and play information.

[0038] The sticker ID is an ID that is issued by the photo sticker creating device 2 for each game according to a predetermined rule. Since it is an ID that is issued every time a game is played, it can also be said to be an ID for identifying the game.

[0039] For example, the sticker ID is notified to the user in a state where it is printed on the edge of sticker paper on which the edited image is printed. When a user of a mobile terminal 3 who has logged in to the image providing service inputs a sticker ID while looking at the edge of the sticker paper, the image created in the game by the user of the mobile terminal 3 is identified in the image management server 1. In this way, the sticker ID is used to identify the image created by each user.

[0040] For example, two different sticker IDs are issued in one game. By issuing two sticker IDs, two users who play the game together on the photo sticker creation device 2 can each receive an image created in the game.

[0041] The image selection flag is a flag that indicates an image selected by the user during the game as an image to be saved on the My Page screen.

[0042] For example, one image to be edited is selected using a screen displayed on the editing monitor at a predetermined timing, such as when editing of a captured image is completed. As will be described later, the My Page screen is a user-only screen that is assigned to each user who has registered as a member, and is used for viewing images managed in the image management server 1.

[0043] The email address is the email address of the user input during the game. For example, the email address is input using a screen displayed on the editing monitor at a predetermined timing, such as when editing of the captured image is finished.

[0044] The user's email address is used by the image management server 1, for example, to notify the user of the URL assigned as the image storage destination by email. When there are two users, the management information includes the email addresses of each user. By including the email addresses of two users in the management information, it becomes possible to identify who played the game together.

[0045] The play information is information indicating the game play situation. Information indicating various selections made by the user during the game, such as the game mode selected by the user, is included in the play information. Information indicating other play situations, such as the number of users playing the game together, the type of background music selected by the user, and the type of editing tool used by the user during editing, may also be included in the play information.

[0046] Membership type In order to use the image providing service provided by the image management server 1, the user must register as a member and create an account for the image providing service. The account for the image providing service is composed of a user ID and a password.

[0047] Membership registration is performed, for example, by operating the mobile terminal 3 to access a specific site and setting a user ID and password with the registration screen displayed. The user's email address is used as the user ID.

[0048] By using an email address as the user ID, as described above, it becomes possible for the image management server 1 to identify the user who played the game based on the email address included in the management information transmitted together with the image from the photo sticker creating device 2. Instead of an email address, various types of identification information such as a telephone number, an SNS (Social Networking Service) ID, etc. may be used as information for identifying a user.

[0049] The types of members include, for example: (1) Free Membership (2) Paid membership (3) Premium Membership

[0050] A free member is a member who does not pay membership fees.

[0051] Free members are allowed to save only one image on their My Page screen that is created in one game and uploaded from the photo sticker creating device 2. The image that can be saved on the My Page screen is the one image selected during the game.

[0052] When a free member user performs an operation to save an unsaved image, one image selected during the game is saved on the My Page screen. It may be possible for a free member to save multiple images on the My Page screen, rather than just one.

[0053] A paid member is a member who is required to pay a membership fee of a specified amount, for example, 300 yen / month.

[0054] Paid members are allowed to save all images created in one game and uploaded from the photo sticker creating device 2 on their My Page screen.

[0055] A premium member is a member who is required to pay a higher membership fee than a paid member, for example, 500 yen / month. In the sense that a membership fee is required, a premium member can also be called a paid member. Paid members include premium members.

[0056] The images that paid members and free members can save on their MyPage screen are edited images uploaded from the photo sticker creating device 2. On the other hand, the images that premium members can save on their MyPage screen are edited images uploaded from the photo sticker creating device 2 and the photographed images that were the source of the edited images.

[0057] When a paid member performs an operation to save an unsaved image, all edited images created in one game are saved on the My Page screen. When a premium member performs an operation to save an unsaved image, all edited images created in one game and all captured images that were the basis for each edited image are saved on the My Page screen.

[0058] In this way, the type and number of images that can be saved on the My Page screen differs depending on the type of membership used to use the image providing service.

[0059] How the service is used FIG. 3 is a diagram showing an example of how the image providing service is used.

[0060] 3A and 3B, the image providing service can be used in two ways: using a dedicated application 3A installed in a mobile terminal 3, and using a Web browser 3B. The dedicated application 3A is, for example, an application prepared by a service provider of the image providing service (the manufacturer of the photo sticker creating device 2).

[0061] 3A, when a user activates the dedicated application 3A, the dedicated application 3A accesses the image management server 1. On the display of the mobile terminal 3, a login screen is displayed by the dedicated application 3A as appropriate.

[0062] When a login operation is performed using a user ID and password, a screen such as a My Page screen for using the image provision service is displayed on the display of the mobile terminal 3 based on the information sent from the image management server 1.

[0063] On the other hand, as shown in FIG. 3B, when a user accesses the image management server 1 by launching a Web browser 3B and entering a specific URL, a login screen is displayed by the Web browser 3B on the display of the mobile terminal 3 as appropriate.

[0064] When a login operation is performed using a user ID and password, a screen such as a My Page screen for using the image provision service is displayed on the display of the mobile terminal 3 based on the information sent from the image management server 1.

[0065] In this way, the user can use the image providing service via the dedicated application 3A or via the Web browser 3B. The screen displayed by the dedicated application 3A and the screen displayed by the Web browser 3B are screens for using images created in the game of the photo sticker creating device 2. In the following, the process when the image providing service is used using the dedicated application 3A will be mainly described, but the same process is also performed when the image providing service is used using the Web browser 3B.

[0066] My Page screen FIG. 4 is a diagram showing a display example of the My Page screen.

[0067] When a user activates the dedicated application 3A and performs a login operation, the My Page screen is displayed on the display 21 of the mobile terminal 3 based on information transmitted from the image management server 1. The My Page screen shown in Fig. 4 is a screen displayed by the dedicated application 3A.

[0068] Here, the user of the portable terminal 3 is the same person as the user of the photo sticker creating device 2 who played the game using the photo sticker creating device 2. In the image management server 1, the user who performed the login operation is identified based on the user ID, and information about the images saved by the user is transmitted to the portable terminal 3.

[0069] The name of the image provision service, "PPP LINK," is displayed in the upper left corner of the My Page screen in Figure 4.

[0070] Below the name of the image providing service, a menu area 31 is formed in which buttons used to select various items are arranged. For example, the menu area 31 includes a button to be operated when displaying a My Page screen, a button to be operated when browsing beauty-related information, and the like.

[0071] Thumbnail images of images created by the user of the mobile terminal 3 using the photo sticker creation device 2 are displayed in thumbnail area 32 below menu area 31. Thumbnail images of all images created in the past by the user of the mobile terminal 3 using a game similar to the game provided by the photo sticker creation device 2 are displayed in thumbnail area 32.

[0072] 4, thumbnail images representing the photographed images P21 to P26 are displayed in two rows. The thumbnail images of the photographed images P21 to P24 are displayed in their entirety, and the thumbnail images of the photographed images P25 and P26 are displayed only in their upper portions.

[0073] For ease of explanation, the thumbnail image shown in FIG. 4 has not been edited, but the image displayed on the My Page screen will be an edited thumbnail image as appropriate depending on the user's membership type, etc.

[0074] Many more images are arranged below the thumbnail images of the captured images P21 to P24. The user can switch the display range of the thumbnail area 32 to display other thumbnail images by placing a finger on the surface of the display 21 and performing a swipe operation or the like. For example, when a specific thumbnail image is tapped, the image selected by the tap operation is enlarged and displayed on the My Page screen.

[0075] In this way, the user can view the images created in the game of the photo sticker creating device 2 on the My Page screen.

[0076] The image displayed on the My Page screen is an image that has been uploaded from the photo sticker creating device 2 to the image management server 1 and that has been selected by the user to be saved.

[0077] That is, in order for the user to view an image created using the photo sticker creating device 2 on the My Page screen, the user must perform an operation to save (obtain) the image uploaded from the photo sticker creating device 2.

[0078] -Image management FIG. 5 is a diagram showing an example of how images are managed in the image management server 1. As shown in FIG.

[0079] As shown in FIG. 5, the types of images managed by the image management server 1 include unsaved images P41 and saved images P42.

[0080] The unsaved image P41 is an image for which no operation has been performed to save it, and the saved image P42 is an image for which an operation to save it has been performed. The saved image P42 is an image to be displayed on the My Page screen.

[0081] Each image uploaded from the photo sticker creating device 2 is managed as an unsaved image P41 or a saved image P42 according to its attribute. The unsaved image P41 and the saved image P42 may be stored in physically different storage media.

[0082] An image uploaded from the photo sticker creating device 2 and stored in a predetermined storage area is first managed as an unsaved image P41.

[0083] A storage period, such as one week, is set for all images uploaded from the photo sticker creating device 2. Images uploaded from the photo sticker creating device 2 are stored in the storage area of ​​the image management server 1 until the storage period expires. Images whose storage period has expired are, for example, deleted from the storage area.

[0084] When a user who has accessed the image management server 1 using the mobile terminal 3 performs an operation to save an image, the unsaved image P41 for which the operation to save has been performed is managed as a saved image P42, as indicated by the arrow A1. For example, the attributes set for each image are changed.

[0085] Images managed as saved images P42 continue to be stored in the storage area, for example, while the membership registration is valid and the user can use the My Page screen.

[0086] In this way, in order for a user to view an image created using the photo sticker creation device 2 on the My Page screen, the user must perform an operation to save the image before the storage period expires.

[0087] The unsaved image P41 is an image for which a storable period is set, whereas the saved image P42 displayed on the My Page screen is an image for which there is no time limit.

[0088] Furthermore, the saved image P42 is an image with no restrictions on how it can be used, and can be viewed on the My Page screen as well as downloaded to the mobile terminal 3. The image downloaded to the mobile terminal 3 is stored, for example, in the local storage of the mobile terminal 3. The user can manage the images downloaded to the mobile terminal 3 by using, for example, an album application of the mobile terminal 3.

[0089] When a user operates the mobile terminal 3 to log in to the image providing service and performs an operation to save an unsaved image, a confirmation screen according to the user's membership type, etc. is displayed on the display 21 of the mobile terminal 3. Various operations for saving an unsaved image are prepared, as will be described later.

[0090] FIG. 6 is a diagram showing an example of a display of the confirmation screen.

[0091] When a free member user performs an operation to save an unsaved image, the message "One image has been saved to your page" is displayed, as shown at the top of Figure 6, and the saved image is displayed below that as a thumbnail image.

[0092] The graffiti-containing image selected during the game is specified by an image selection flag included in the management information transmitted from the photo sticker creating device 2 together with the image.

[0093] Below each saved image, a message is displayed informing the user that there are unsaved images, and below that, multiple thumbnail images representing the unsaved images are displayed. In the example of Figure 6, there are six unsaved images with graffiti.

[0094] Below the unsaved images, there are provided a save button 51 displaying the words "Save all Puri" and a confirm button 52 displaying the words "Confirm saved Puri."

[0095] The SAVE button 51 is pressed when all unsaved images are to be saved. When the SAVE button 51 is pressed, a screen used for changing the membership type to a paid membership or premium membership is displayed. The CONFIRM button 52 is pressed when the user wants to confirm the saved images.

[0096] <Cartoon image generation function of image generation server 11> FIG. 7 is a diagram showing an example of generating a portrait image.

[0097] As shown in Fig. 7, a portrait image generation model, which is an inference model for generating a portrait image, is prepared in the image generation server 11. The portrait image generation model is an inference model that receives a captured image created in a game by the photo sticker creation device 2 as an input, and outputs a portrait image that illustrates the appearance of the user appearing in the captured image. When two users appear in the captured image, illustrations of the two users are generated as one portrait image, as shown in Fig. 7.

[0098] For example, an illustrated image of a person appearing in a photographed image is used as a training image, and a portrait image generation model is generated by machine learning using a large number of pairs of photographed images and training images.

[0099] A portrait image generation model may be prepared for each taste (style) of illustration. In this case, a plurality of portrait image generation models that output illustrations with different tastes are prepared in the image generation server 11.

[0100] Also, different portrait image generation models may be used depending on the number of users appearing in the captured image. In this case, portrait image generation models for each number of people, such as a portrait image generation model for two people and a portrait image generation model for three people, are prepared in the image generation server 11.

[0101] Here, as shown in Fig. 8, in the game of the photo sticker creating device 2, at least two types of images are generated: a captured image which is an image without graffiti, and an edited image which is an image with graffiti. A captured image is generated by taking a picture with a camera, and an edited image is generated by editing the captured image. The heart-shaped image and handwritten characters shown on the edited image on the left side of Fig. 8 are images to be synthesized that are input using an editing tool.

[0102] For example, a photographed image of the two types of images is used to generate a portrait image in the image generation server 11. By using a photographed image that is not composited with an image for composition to generate a portrait image, it is possible to increase the accuracy of generating the portrait image. If an edited image is used to generate a portrait image, an unnatural illustration may be generated as the portrait image depending on the state of the doodle, but it is possible to prevent such a problem.

[0103] In the game of the photo sticker creating device 2, an image taken by a camera is used as an original image, and retouching is performed on the original image. The retouching includes predetermined image processing including deformation of specific parts of the face, such as processing to enlarge the eyes, processing to brighten the skin, processing to make the face smaller, etc. The parameters used for the retouching may be automatically set by the photo sticker creating device 2, or may be set according to the user's operation during the game.

[0104] The captured image used for editing is an image after retouching. The image of the user after retouching is used to generate a portrait image. By using the image of the user after retouching, it is possible to generate a portrait image that reflects the atmosphere of the game of the photo sticker creation device 2 in terms of the size of the eyes, the brightness of the skin, the smallness of the face, etc.

[0105] A series of processes related to the generation of a portrait image will be described with reference to the sequence of Fig. 9. The process of Fig. 9 is started when a user who has finished the game of the photo sticker creating device 2 starts, for example, a dedicated application 3A and performs an operation to use the portrait image generation function on the mobile terminal 3. When the game of the photo sticker creating device 2 is finished, images and the like created in the game are uploaded and managed in the image management server 1 in association with the sticker ID.

[0106] In step S1, the mobile terminal 3 executing the dedicated application 3A accesses a site managed by the image management server 1 and displays a sticker ID input screen. The user inputs the sticker ID issued in the game into the input screen.

[0107] In step S2, the mobile terminal 3 transmits to the image management server 1 the sticker ID input by the user.

[0108] In step S11, the image management server 1 receives the sticker ID transmitted from the mobile terminal 3, and checks it in step S12. Checks are performed to see if the sticker ID is valid, if it is an ID that has not been used for generating a portrait image, etc. If the sticker ID input by the user is a valid ID and an ID that has not been used for generating a portrait image, the following process is performed.

[0109] In step S13, the image management server 1 transmits information about the selection screen to the mobile terminal 3. The information transmitted from the image management server 1 includes information about the images managed in association with the sticker IDs.

[0110] In step S3, the mobile terminal 3 receives the information transmitted from the image management server 1, and in step S4 displays a selection screen. The selection screen is a screen used to select an image to be used for generating a portrait image and a style of illustration.

[0111] 10 and 11 are diagrams showing examples of the selection screen.

[0112] A message is displayed above the selection screen shown in Fig. 10 to guide the user to select an image that will be the basis for the portrait image. Thumbnail images of captured images P21 to P26 created in the game are displayed below the message. Captured images P21 to P26 are the same images that were displayed on the confirmation screen in Fig. 6 as images that can be saved. In this example, it is possible to select a captured image that will be the basis for generating the portrait image from among the same images that can be saved on the My Page screen.

[0113] For example, when the photographed image P21 is selected as shown in a thick frame, a selection screen used for selecting a taste is displayed as shown in Fig. 11. A message guiding the selection of a taste is displayed at the top of the selection screen shown in Fig. 11. Below the message, a sample image for "Taste A" and a sample image for "Taste B" are displayed side by side. With one of the tastes selected, the user can start creating a portrait image by operating the confirm button 61.

[0114] Returning to the explanation of FIG. 9, when the captured image and taste that are the basis for generating the portrait image are selected, in step S5, the mobile terminal 3 transmits information indicating the user's selection to the image generation server 11. The captured image that is the basis for generating the portrait image is transmitted to the image generation server 11. Information indicating the selection including the captured image may be transmitted to the image generation server 11 via the image management server 1.

[0115] In step S21, the image generation server 11 receives information transmitted from the mobile terminal 3 and acquires a captured image that is to be used as a basis for generating a portrait image.

[0116] In step S22, the image generation server 11 inputs the acquired photographed image into a portrait image generation model to generate a portrait image.

[0117] In step S23, the image generation server 11 transmits the portrait image to the mobile terminal 3.

[0118] In step S6, the mobile terminal 3 receives the portrait image transmitted from the image generation server 11, and in step S7 displays an editing screen. The editing screen is a screen used for editing the portrait image.

[0119] FIG. 12 is a diagram showing an example of the editing screen.

[0120] The portrait image P101 shown in Fig. 12 is a portrait image generated based on the photographed image P21. In this manner, the portrait image P101 is displayed on the editing screen as a result of generation by the image generation server 11. The display of the editing screen may be started after the display of a preview screen including the photographed image P21 and the portrait image P101. For example, the photographed image P21 and the portrait image P101 are displayed side by side on the preview screen. It may be possible to change the taste or reselect the photographed image that is the basis for generating the portrait image by looking at the display of the preview screen.

[0121] In the example of Fig. 12, the editing contents of the background, frame, and set can be selected. The background represents a background image to be composited with the background of the user's illustration in the portrait image, and the frame represents a frame image of various designs to be superimposed and composited with the portrait image. The set represents a combination of the background and the frame. The editing contents by the user are reflected in real time in the display of the portrait image P101.

[0122] When the selection of the editing contents is completed and the decision button 62 is operated, a portrait image confirmation screen is displayed as shown in FIG. 13. The portrait image P101A shown in FIG. 13 is the portrait image P101 that has been edited. The user can save the portrait image P101A by performing a predetermined operation such as a long press on the portrait image P101A. A switch button 63 is provided below the confirmation screen. The switch button 63 is a button that is operated when continuously creating a portrait image using another sticker ID.

[0123] When an operation for saving the portrait image is performed, the mobile terminal 3 saves the portrait image in its internal memory and ends the process in step S8 of Fig. 9. The user can publish the portrait image saved in the memory on a social networking site or send it to friends who played the game together with the user on the photo sticker creating device 2 to share it.

[0124] As described above, the user can receive a portrait image based on an image created in one game every time he plays a game of the photo sticker creating device 2. More specifically, he can receive a portrait image based on an image selected from the images created in one game. The user can also keep the image created when playing a game of the photo sticker creating device 2 in the form of an illustration.

[0125] On the image providing service side, it is possible to generate content with different impressions based on the content created in the game and provide it to the user.

[0126] When the switching button 63 in Fig. 13 is operated, the same process as the above is performed. The user can use the remaining sticker ID of the two issued sticker IDs to select a different captured image as an image that will be used as the basis for generating a portrait image, or select a different taste, and save a different portrait image.

[0127] When two people play the game of the photo sticker creation device 2 together, one user uses a first sticker ID to create a portrait image, and the other user uses a second sticker ID to create a portrait image, so that two portrait images are created in the style selected by each user. Each user may receive multiple portrait images.

[0128] <Configuration of each device> Image management server configuration FIG. 14 is a block diagram showing an example of the hardware configuration of the image management server 1. As shown in FIG.

[0129] As shown in Fig. 14, the image management server 1 is configured by a computer. The image management server 1 may be configured by multiple computers. When the image management server 1 is configured by multiple computers, the computers work together to realize various processes for providing the image providing service. The image creation server 11 is also realized by a computer having a similar configuration. The configuration shown in Fig. 14 will be cited as the configuration of the image creation server 11 as appropriate in the following explanation.

[0130] A central processing unit (CPU) 201, a read only memory (ROM) 202, and a random access memory (RAM) 203 are connected to each other via a bus 204.

[0131] An input / output interface 205 is further connected to the bus 204. An input unit 206, an output unit 207, a storage unit 208, a communication unit 209, and a drive 210 are connected to the input / output interface 205.

[0132] The input unit 206 is composed of a keyboard, a mouse, etc. The output unit 207 is composed of a display, etc.

[0133] The storage unit 208 is composed of a hard disk, a non-volatile memory, etc. The storage unit 208 stores various information used to provide the image providing service, such as the program executed by the CPU 201, and images uploaded from the photo sticker creating device 2.

[0134] The communication unit 209 is an interface to the Internet. For example, the communication unit 209 communicates with the photo sticker creating device 2 and receives images uploaded from the photo sticker creating device 2. The communication unit 209 also communicates with the mobile terminal 3 and transmits various types of information, such as information used for screen display, to the mobile terminal 3.

[0135] The drive 210 controls writing of data to the removable medium 211 and reading of data from the removable medium 211 .

[0136] In the computer configured as above, the CPU 201 loads a program stored in the storage unit 208 into the RAM 203 and executes it, thereby performing processing for realizing an image providing service.

[0137] FIG. 15 is a block diagram showing an example of the functional configuration of the image management server 1. As shown in FIG.

[0138] As shown in Fig. 15, an information processing unit 241 is realized in the image management server 1. The information processing unit 241 is composed of an image acquisition unit 251, an image management unit 252, an image storage unit 253, a user information management unit 254, a user information storage unit 255, and a display control unit 256. At least a part of the functional units shown in Fig. 15 is realized by the CPU 201 executing a predetermined program.

[0139] The image acquiring unit 251 acquires an image uploaded from the photo sticker creating device 2 and received by the communication unit 209 together with management information. The image acquiring unit 251 outputs the image uploaded from the photo sticker creating device 2 and the management information to the image managing unit 252.

[0140] The image management unit 252 manages the images supplied from the image acquisition unit 251 by linking the images with management information and storing them in the image storage unit 253. For example, the image management unit 252 manages each of the images stored in the image storage unit 253 as an unsaved image or a saved image.

[0141] The image management unit 252 manages the storable period of each image managed as an unsaved image. The image management unit 252 deletes images that have not been selected as images to be saved after a predetermined period of time, such as one week, has elapsed since they were uploaded. The image management unit 252 outputs to the display control unit 256 the image of the user who has performed a login operation to the image providing service.

[0142] The user information management unit 254 stores and manages user information, which is information about each user who has registered as a member of the image providing service, in the user information storage unit 255. The user information includes a user ID and password that constitute an account, and information indicating the membership type.

[0143] The user information management unit 254 communicates with the mobile terminal 3, and manages logins to the image providing service via the Web browser 3B and logins to the image providing service via the dedicated application 3A. The user information management unit 254 manages information about users who are logged in to the image providing service.

[0144] The display control unit 256 causes the mobile terminal 3 to display a screen such as a My Page screen based on the image or the like supplied from the image management unit 252. In addition, the display control unit 256 controls the screen display of the mobile terminal 3 in response to a user operation or the like.

[0145] 9, the processes of steps S11 and S12 are performed by the user information management unit 254. The process of step S13 is performed by the display control unit 256.

[0146] Image generation server 11 configuration FIG. 16 is a block diagram showing an example of the functional configuration of the image generating server 11. As shown in FIG.

[0147] In the image generating server 11 as an information processing device for providing a portrait image to a user, an image acquiring unit 271 and a portrait image generating unit 272 are realized as shown in Fig. 16. At least a part of the functional units shown in Fig. 16 is realized by executing a predetermined program by a CPU 201 of a computer constituting the image generating server 11.

[0148] The image acquisition unit 271 acquires a photographed image that is the basis for generating a portrait image. The photographed image that is the basis for generating a portrait image is transmitted from the mobile terminal 3 or the image management server 1 in response to a user's selection on the selection screen of the mobile terminal 3. The image acquisition unit 271 functions as an acquisition unit that acquires a photographed image uploaded from the photo sticker creating device 2.

[0149] The portrait image generating unit 272 generates a portrait image based on the captured image acquired by the image acquiring unit 271. For example, the portrait image generating unit 272 inputs the captured image into a portrait image generation model according to a taste selected by the user to generate a portrait image. The portrait image generating unit 272 transmits the portrait image generated using the portrait image generation model to the mobile terminal 3 and provides it to the user. The portrait image generating unit 272 functions as a generating unit that generates an illustrated and processed portrait image using the portrait image generation model, which is an inference model generated by machine learning, and provides it to the user.

[0150] 9, the process of step S21 is performed by the image acquisition section 271. The processes of steps S22 and S23 are performed by the portrait image generation section 272.

[0151] Mobile device configuration FIG. 17 is a block diagram showing an example of the configuration of the mobile terminal 3.

[0152] As shown in FIG. 17, in addition to the display 21, the mobile terminal 3 is provided with a control unit 301, a communication unit 302, a memory 303, an operation unit 304, and a camera 305.

[0153] The control unit 301 is configured with a CPU, a ROM, a RAM, etc. The control unit 301 controls the overall operation of the mobile terminal 3 by executing a predetermined program.

[0154] In the control unit 301, an application execution unit 301A is realized. Various applications such as the dedicated application 3A and the Web browser 3B are executed by the application execution unit 301A. Each process described with reference to Fig. 9 is performed by the application execution unit 301A. That is, the application execution unit 301A performs the process of displaying an image uploaded from the photo sticker creating device 2 on the selection screen, receiving a portrait image transmitted from the image generating server 11 and displaying it on the preview screen or the editing screen.

[0155] The communication unit 302 communicates with the image management server 1 or the image creation server 11 via the Internet. The communication unit 302 receives information transmitted from the image management server 1 or the image creation server 11, and outputs the information to the control unit 301. The communication unit 302 also transmits information supplied from the control unit 301 to the image management server 1 or the image creation server 11.

[0156] The memory 303 is configured by a flash memory or the like. The memory 303 corresponds to local storage of the mobile terminal 3. When a removable memory card is attached to the mobile terminal 3, the memory card may be used as local storage.

[0157] The memory 303 stores various information such as images downloaded from the image management server 1, portrait images generated by the image generation server 11, and applications executed by the control unit 301.

[0158] The operation unit 304 is configured with various buttons and a touch panel provided over the display 21. The operation unit 304 outputs to the control unit 301 a signal indicating the content of a user's operation.

[0159] The camera 305 takes pictures in response to operations by the user.

[0160] The display 21 is configured with an organic EL display, an LCD, etc. Based on the information received by the communication unit 302, the display 21 displays various screens as described above.

[0161] <Modification> About the images used to generate the portraits Although the photographed image without graffiti is used to generate the portrait image, other images may be used to generate the portrait image as long as they are images generated in the game of the photo sticker creation device 2 and uploaded. An edited image with graffiti may be used, or an original image that has not been retouched may be used.

[0162] When a moving image is being taken in the game of the photo sticker creating device 2, a portrait image of a still image or a moving image may be generated based on the moving image uploaded from the photo sticker creating device 2. When a passport photo is being taken in the photo sticker creating device 2, a portrait image may be generated based on the image of the passport photo.

[0163] In this way, it is possible to use an image other than the photographed image to generate a portrait image.

[0164] A portrait image generated based on a photographed image that is an image without graffiti may be provided to a paid member, and a portrait image generated based on an edited image that is an image with graffiti may be provided to a free member. In this way, it is possible to switch the image that is the basis for generating the portrait image depending on the attributes of the user, such as the membership type.

[0165] About image selection Although the captured image that is the basis for generating the portrait image is selected by the user in the above embodiment, it may be automatically selected by the image generating server 11. For example, a randomly selected captured image is used to generate the portrait image.

[0166] The ability to select an image to be used as a basis for generating a portrait image may be switched according to the attributes of the user, such that a paid member user can select a photographed image to be used as a basis for generating a portrait image, and a free member user cannot select an image to be used as a basis for generating a portrait image. When the user is a free member, a portrait image is generated based on an automatically selected photographed image.

[0167] Although an image selected from unsaved images that can be saved on the MyPage screen is used to generate the portrait image, it may be possible to select from saved images. In this case, while the MyPage screen is displayed, the user selects an arbitrary image from the images displayed on the MyPage screen as an image that will be used as a base image for generating the portrait image. The image selected by the user is acquired by the image acquisition unit 271 of the image generation server 11 and used to generate the portrait image.

[0168] Not only images created in the game of the photo sticker creating device 2, but also images taken by the camera 305 of the mobile terminal 3 may be used to generate the portrait image.

[0169] About the preview screen Although only one image resulting from the generation of the portrait image is displayed on the preview screen, portrait images for each taste may be displayed. In the above example, a portrait image resulting from the generation of "taste A" and a portrait image resulting from the generation of "taste B" are displayed on the preview screen. The user may be allowed to select the image to receive by viewing the portrait images for "taste A" and "taste B" displayed on the preview screen.

[0170] The portrait image of "Taste A" and the portrait image of "Taste B" may be displayed alternately.

[0171] About taste selection Although the taste of the illustration is selected by the user in the above embodiment, it may be automatically selected by the image generating server 11. For example, a portrait image is generated based on a taste selected at random.

[0172] A plurality of tastes may be selected and portrait images for each taste may be generated. Alternatively, only one type of taste may be prepared and the selection of taste may not be performed.

[0173] The taste may be determined according to the model of the photo sticker creation device 2 used by the user. In this case, if the model of the photo sticker creation device 2 used by the user is "model A", a portrait image of "taste A" is generated based on an image created in a game for "model A". Also, if the model of the photo sticker creation device 2 used by the user is "model B", a portrait image of "taste B" is generated based on an image created in a game for "model B". This makes it possible to provide the user with a portrait image with a taste that matches the image of the model.

[0174] The taste may be determined according to the selection made by the user during the game, such as the game mode selected by the user. The selection made by the user is identified based on the play information uploaded together with the image. This makes it possible to provide the user with a portrait image with a taste that matches the image of the game.

[0175] - Saving portrait images If the user has registered as a member, the portrait image may be saved on the My Page screen. In this case, the portrait image generated by the image generation server 11 is transmitted to the image management server 1 and managed in association with the user information together with the photographed image and the edited image.

[0176] FIG. 18 is a diagram showing another example of the My Page screen.

[0177] As shown in Fig. 18, a thumbnail image of the portrait image P101A is displayed on the My Page screen together with thumbnail images of captured images and edited images. The thumbnail image of the portrait image P101A and the thumbnail image of the captured image P21 from which the portrait image P101A was generated may be displayed side by side as shown in Fig. 18.

[0178] The portrait image may be automatically saved in the memory of the mobile terminal 3 without any operation by the user.

[0179] Editing the portrait image While the portrait image is edited by selecting a background, frame, and set, it is also possible to perform more complex editing using tools similar to those available in the photo sticker creation device 2, such as combining a stamp image or text.

[0180] It is also possible to customize each part of the face, such as customizing the shape of the eyes or the shape of the mouth in the portrait image. This provides the illustration of the portrait image with parts that can be customized by the user.

[0181] Types of arcade game machines The above technology of processing a photographed image, which is content created in a game, and providing a portrait image as processed content (processed content) can also be applied to the case of processing content created in a game on an arcade game machine other than the photo sticker creating device 2, and providing the processed content. In addition to still image content, the content includes various types of content such as video content, music content, and 3D model content of an avatar used in a VR space.

[0182] For example, when a user uses an arcade game machine that provides a game in which music content can be created, the music content created in the game is processed to generate processed music content and provided to the user.

[0183] -Type of processed content Although the image of a portrait illustration is generated as the processed content, content other than the image of a portrait illustration may be provided as long as the content is generated using an inference model generated by machine learning. Images after various types of processing, such as an image with emphasized makeup or an image with emphasized facial features, may be provided as the processed content.

[0184] Server configuration variations FIG. 19 is a block diagram showing another example of the functional configuration of the image management server.

[0185] 19, in response to execution of a predetermined program, an image acquisition unit 271 and a portrait image generation unit 272 are realized in addition to an information processing unit 241. The image acquisition unit 271 acquires an image that is to be used as a basis for generating a portrait image, selected, for example, by a user, from among images managed by the information processing unit 241. The portrait image generation unit 272 generates a portrait image based on the image acquired by the image acquisition unit 271 and provides it to the user.

[0186] In this way, it is possible to provide the image management server 1 with the function of the image creation server 11 that creates portrait images.

[0187] ·others Although the image created by the user in the game of the photo sticker creating device 2 is specified based on the sticker ID, if account information such as a user ID is input at the start of the game, it may be specified based on the account information. The account information is input, for example, by having a reader provided in the photo sticker creating device 2 read a two-dimensional code displayed by the dedicated application 3A. The two-dimensional code displayed by the dedicated application 3A includes the user's account information.

[0188] At the timing when the sticker ID is input for generating the portrait image, the image that has been managed in the image management server 1 as an unsaved image may be automatically saved.

[0189] Conversely, a portrait image may be generated when a user performs an operation to save an image that has been managed as an unsaved image in the image management server 1. In this case, a portrait image can be generated and provided based on the image saved by the user.

[0190] When multiple users appear in the image from which the portrait image is generated, one illustration of the multiple users may be generated as the portrait image as described above, or multiple illustrations of each user may be generated as the portrait image. For example, when two users appear, a portrait image of the user appearing on the right side and a portrait image of the user appearing on the left side are generated, respectively.

[0191] When multiple users are shown in the original image, parts of each user are cut out, and multiple illustrations of each user are generated as portrait images based on the cut-out images. Alternatively, parts of each user may be cut out from one illustration, and multiple portrait images may be generated.

[0192] The above-mentioned series of processes can be executed by hardware or software. When the series of processes is executed by software, the program constituting the software is installed in a computer incorporated in dedicated hardware or a general-purpose personal computer.

[0193] The program to be installed is provided by being recorded on a removable medium 211 shown in FIG. 14, which is made up of an optical disk (CD-ROM (Compact Disc-Read Only Memory), DVD (Digital Versatile Disc), etc.) or a semiconductor memory. The program may also be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital broadcasting. The program can be installed in advance in the ROM 202 or the storage unit 208.

[0194] The program executed by the computer may be a program in which processing is performed chronologically in the order described in this specification, or it may be a program in which processing is performed in parallel or at the required timing, such as when called.

[0195] In this specification, a system refers to a collection of multiple components (devices, modules (parts), etc.), regardless of whether all the components are in the same housing. Therefore, multiple devices housed in separate housings and connected via a network, and a single device in which multiple modules are housed in a single housing, are both systems.

[0196] The effects described herein are merely examples and are not limiting, and other effects may also be present.

[0197] The embodiments of the present technology are not limited to the above-described embodiments, and various modifications are possible without departing from the gist of the present technology.

[0198] For example, the present technology can be configured as cloud computing, in which a single function is shared and processed collaboratively by multiple devices via a network.

[0199] Furthermore, each step described in the above flow chart can be executed by one device, or can be shared and executed by a plurality of devices.

[0200] Furthermore, when a single step includes multiple processes, the multiple processes included in the single step can be executed by a single device, or can be shared and executed by multiple devices. [Explanation of symbols]

[0201] 1 image management server, 2 photo sticker creation device, 3 mobile terminal, 11 image generation server, 241 information processing section, 251 image acquisition section, 252 image management section, 253 image storage section, 254 user information management section, 255 user information storage section, 256 display control section, 271 image acquisition section, 272 portrait image generation section

Claims

1. an acquisition unit that acquires the content uploaded from an arcade game machine that provides a game for creating the content; a generation unit that generates processed content by processing the content using a generative model generated by machine learning, and provides the processed content to a user who has played the game; An information processing device comprising:

2. The generating unit generates the processed content based on the content created in one game of the game. The information processing device according to claim 1 .

3. The generating unit generates the processed content based on the content selected by the user from among the plurality of contents created in one game of the game. The information processing device according to claim 1 .

4. the game is a game used by a plurality of the users together, The generating unit provides each of the users with the processed content generated based on the content selected by each of the users. The information processing device according to claim 3 .

5. The generating unit generates the processed content in a taste selected by each of the users. The information processing device according to claim 4.

6. the arcade game machine is a device for providing the game, which takes an image in which a plurality of the users appear together, and edits the taken image in response to an operation by the users to create an edited image; The generating unit generates the processed content based on the photographed image out of the photographed image and the edited image uploaded from the arcade game machine. The information processing device according to claim 3 .

7. editing the photographed image in the game includes a process of compositing a compositing image selected by the user onto the photographed image to be edited, the photographed image having been subjected to predetermined image processing including deformation of a specific part of a face; The generation unit generates the processed content based on the captured image after the predetermined image processing, in which the composite image is not composited. The information processing device according to claim 6.

8. The generation unit generates portrait images of the plurality of users as the processed content based on the photographed image in which the plurality of users appear together.

8. The information processing device according to claim 6 or 7.

9. The acquisition unit acquires the content selected by the user on a screen of a service that stores and manages the content uploaded from the arcade game machine.

8. The information processing apparatus according to claim 3.

10. The processed content is stored in the server providing the service together with the content uploaded from the arcade game machine. The information processing device according to claim 9.

11. An information processing device, Acquire the content uploaded from an arcade game machine that provides a game for creating the content, A processed content is generated by processing the content using a generative model generated by machine learning, and the processed content is provided to a user who has played the game. Information processing methods.

12. On the computer, Acquire the content uploaded from an arcade game machine that provides a game for creating the content, A processed content is generated by processing the content using a generative model generated by machine learning, and the processed content is provided to a user who has played the game. A program that executes a process.

13. On the computer, Displaying the content uploaded from an arcade game machine that provides a game for creating the content; receiving the processed content transmitted from a server that generates processed content by processing the content using a generative model generated by machine learning; Display the edited content A program that executes a process.

14. selecting the content from which the processed content is generated, from among a plurality of the contents, in response to a user operation; When the processed content generated based on the selected content is received, the processed content is displayed together with the content that is the source of the generated processed content. The program according to claim 13.

Images