program

Abstract

To provide a technology capable of improving the interest of a service. [Solution] The program causes the computer to function as a control means that causes an AI to generate an image triggered by a specific object displayed on a designated display means making a specific movement, and controls the display of the image generated by the AI ​​on the designated display means.

Description

[Technical field]

[0001] The present invention relates to a program. [Background technology]

[0002] AI capable of generating images is known (see, for example, Non-Patent Document 1). [Prior art documents] [Non-patent literature]

[0003] [Non-Patent Document 1] “5 Recommended Sites for Generating AI Illustrations | A Thorough Explanation of the Steps and Tips for Automatic Generation!”, [online], [Searched on January 18, 2024], Internet<https: / / www.gmosign.com / media / work-style / ai-illust / > Summary of the Invention [Problem to be solved by the invention]

[0004] Meanwhile, there is a demand for services such as games to be more entertaining.

[0005] An object of the present invention is to provide a technique capable of improving the interest of a service. [Means for solving the problem]

[0006] According to one embodiment shown in the present disclosure, Computer, The system causes an AI to generate an image triggered by a specific object displayed on a specific display means making a specific movement, and functions as a control means for controlling the display of the image generated by the AI ​​on the specific display means. The program is provided. Effect of the Invention

[0007] According to the present invention, it is possible to improve the interest of a service. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating a schematic configuration of an information processing system. [Diagram 2] FIG. 2 is a block diagram showing a functional configuration of the information processing system. [Diagram 3] This is a diagram to explain how AI generates images based on conceptual diagrams. [Figure 4] This is a diagram to explain image generation by AI based on a character string entered by a user. [Diagram 5] This is a diagram to explain image generation by AI while an event is in progress. [Figure 6] 13 is a flowchart showing an example of a process for generating an image of an associated object. [Figure 7] 13 is a flowchart showing an example of a process for generating an image triggered by a specific object making a specific movement. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0010] [First embodiment] <System hardware configuration> As shown in FIG. 1, an information processing system 1 of this embodiment includes a plurality of terminal devices 10 and a server 20.

[0011] The terminal device 10 and the server 20 are connected via a network 2. The network 2 may be configured by, for example, the Internet, a mobile communication system (e.g., 3G, 4G, 5G, LTE (Long Term Evolution), etc.), Wi-Fi (Wireless Fidelity), Bluetooth (registered trademark), other communication lines, or a combination of these. In addition, the connection between the terminal device 10 and the server 20 may be a wired connection or a wireless connection.

[0012] The server 20 (in other words, a computer, an information processing device) may be, for example, a general-purpose computer such as a workstation or a personal computer. The server 20 includes a processor 21, a memory 22, a storage 23, a communication IF (interface) 24, and an input / output IF 25. These components included in the server 20 are connected to each other by a communication bus.

[0013] The processor 21 controls the overall operation of the server 20. The processor 21 may include a central processing unit (CPU), a micro processing unit (MPU), a graphics processing unit (GPU), etc. The processor 21 reads a program from the storage 23 and loads it in the memory 22. The processor 21 executes the loaded program.

[0014] The memory 22 is a main storage device. The memory 22 is composed of storage devices such as a ROM (Read Only Memory) and a RAM (Random Access Memory). The memory 22 temporarily stores the programs and various data read by the processor 21 from the storage 23, thereby providing a working area for the processor 21. The memory 22 also temporarily stores various data generated while the processor 21 is operating according to the programs.

[0015] In this embodiment, the program may be a program that realizes a game by the terminal device 10. The program may also be a program that realizes the game through cooperation between the terminal device 10 and the server 20. The game realized through cooperation between the terminal device 10 and the server 20 may be, for example, a game executed on a browser launched in the terminal device 10. The program may also be a program that realizes the game through cooperation between a plurality of terminal devices 10. The various data include, for example, data related to the game, such as user information and game information, and instructions and notifications transmitted and received between the terminal device 10 and the server 20.

[0016] The storage 23 is an auxiliary storage device. The storage 23 is configured with a storage device such as a flash memory or a hard disk drive (HDD), etc. The storage 23 stores various data related to the game.

[0017] The communication IF 24 controls transmission and reception of various data between the server 20 and the terminal device 10 etc. via the network.

[0018] The input / output IF 25 is an interface through which the server 20 receives input of data and also an interface through which the server 20 outputs data. The input / output IF 25 may include, for example, an input unit that is an information input device such as a mouse or a keyboard, and a display unit that is a device that displays and outputs an image.

[0019] The terminal device 10 (in other words, a computer, an information processing device) may be, for example, a smartphone, a feature phone, a PDA (Personal Digital Assistant), a tablet computer, a personal computer, a wearable terminal, or a game device. The terminal device 10 may be a mobile terminal. The terminal device 10 may be a portable terminal that a user uses when playing a game.

[0020] The terminal device 10 includes a processor 11, a memory 12, a storage 13, a communication IF 14, an input / output IF 15, an input unit 17, and a display unit 18. These components included in the terminal device 10 are connected to each other via a communication bus.

[0021] The processor 11 controls the overall operation of the terminal device 10. The processor 11 may include a CPU, an MPU, a GPU, etc. The processor 11 reads a program from the storage 13 and loads it in the memory 12. The processor 11 executes the loaded program.

[0022] The memory 12 is a main storage device. The memory 12 is composed of storage devices such as a ROM and a RAM. The memory 12 temporarily stores the programs and various data that the processor 11 reads from the storage 13, thereby providing a working area for the processor 11. The memory 12 also temporarily stores various data that the processor 11 generates while it is operating according to the programs.

[0023] The storage 13 is an auxiliary storage device. The storage 13 is configured with a storage device such as a flash memory or a HDD. The storage 13 stores various data related to the game.

[0024] The communication IF 14 controls transmission and reception of various data between the terminal device 10 and the server 20 etc. via the network.

[0025] The input / output IF 15 is an interface through which the terminal device 10 receives input of data and also an interface through which the terminal device 10 outputs data. The input / output IF 15 may input and output data via, for example, a Universal Serial Bus (USB) or the like. The input / output IF 15 may include an input unit 17, a display unit 18, or the like.

[0026] The input unit 17 accepts input from a user. The input unit 17 may be, for example, a pointing device such as a touch pad. The display unit 18 displays an image. The display unit 18 may be, for example, a liquid crystal display or an organic EL (Electro-Luminescence) display. The terminal device 10 includes, for example, a touch screen 16 which is an electronic component combining the input unit 17 and the display unit 18.

[0027] The input unit 17 has a function of detecting a position input on the input surface by a user operation (for example, a touch operation, a tap operation, a slide operation, a swipe operation, a flick operation, etc.) and transmitting information indicating the detected position as an input signal. The touch panel as the input unit 17 may be of a capacitive type or a resistive film type, or may be of another type.

[0028] The input unit 17 may be, for example, a keyboard, various physical buttons, various sensors (for example, an acceleration sensor, an angular velocity sensor, a magnetic sensor, a GPS sensor, a motion sensor, a gaze sensor, a bioelectric potential sensor, a fingerprint sensor, a breath sensor, a pressure sensor, an image sensor, etc.), an operation stick, a camera, a microphone, etc. The display unit 18 may be, for example, a projector, etc.

[0029] <System Functional Configuration> 2 is a block diagram showing the functional configuration of the server 20 and the terminal device 10. Each of the server 20 and the terminal device 10 may include a functional configuration (not shown) required to function as a general computer and a functional configuration required to realize well-known functions in a game.

[0030] In this embodiment, the server 20 identifies each user and the terminal device 10 using a user account that is registered in advance. The method of registering the account is not particularly limited. For example, the terminal device 10 or another device such as a personal computer may transmit information required for registering a user account to the server 20 based on a user's operation, and the server 20 may create and store an account for each user based on the received information.

[0031] The server 20 has a function of communicating with each terminal device 10 and supporting the terminal device 10 in progressing through the game. If the game is a multiplayer game, the server 20 may have a function of communicating with each terminal device 10 participating in the game and mediating interactions between the terminal devices 10. The server 20 functions as a control unit 210 and a storage unit 220 through cooperation of the processor 21, memory 22, storage 23, communication IF 24, input / output IF 25, etc.

[0032] The storage unit 220 stores various data used by the control unit 210. The various data include, for example, a program, game information, and user information. The program is a program for implementing a game. The game information and user information are data that the control unit 210 refers to when executing the program.

[0033] The game information is data that the control unit 210 or the control unit 110 refers to when executing a program. The game information includes, for example, data such as images and sounds used in the game. The user information is data managed for each user's account. The user information includes, for example, information on a character (hereinafter referred to as a "player character") used by the user (in other words, operable by the user), information on owned assets, and information indicating the progress of the game. The owned assets can be said to be value owned by the user within the game (in other words, within the virtual space). Examples of the value (in other words, in-game value, owned assets) include electronic currency, items, and characters. Examples of electronic currency include in-game currency that can be used within the game and cryptocurrency.

[0034] The control unit 210 controls various processes related to the game by executing the programs stored in the storage unit 220. The control unit 210 includes a transmission / reception unit 211, a game control unit 212, and an image generation unit 214, for example.

[0035] The transmission / reception unit 211 transmits or receives various data. For example, the transmission / reception unit 211 receives requests to transmit various data and programs, requests for synchronization processing to support the multiplay function, data to be subjected to synchronization processing, and the like from each terminal device 10, and passes them to the game control unit 212. In addition, the transmission / reception unit 211 transmits various data and programs to each terminal device 10 in accordance with the control of the game control unit 212.

[0036] The game control unit 212 provides a game to the terminal device 10 by executing arithmetic processing described in a program in response to a request from the terminal device 10 or the like.

[0037] The image generation unit 214 generates images to be used in the game. In other words, the image generation unit 214 generates images to be used in providing a service. Specifically, the image generation unit 214 causes the AI ​​to generate images. The images that the image generation unit 214 causes the AI ​​to generate may be two-dimensional images or three-dimensional images (in other words, 3D models). Furthermore, the images that the image generation unit 214 causes the AI ​​to generate may be still images or moving images.

[0038] The terminal device 10 has, for example, a function as an input device that accepts input operations by a user, and a function as an output device that outputs images and sounds of a game.

[0039] The terminal device 10 functions as a control unit 110 and a storage unit 120 through cooperation of the processor 11, memory 12, storage 13, communication IF 14, input / output IF 15, etc. The storage unit 120 stores various data used by the control unit 110. The various data include, for example, a program, game information, and user information. The program is a program for realizing a game on the terminal device 10 side. The game information and user information are data referenced when the control unit 110 executes a program. The game information and user information stored in the storage unit 120 may include information similar to the game information and user information stored in the storage unit 220.

[0040] The control unit 110 executes a program stored in the storage unit 120 to control various processes related to the game executed on the terminal device 10. The control unit 110 includes, for example, an operation reception unit 111, a transmission / reception unit 112, a game control unit 113, and a display control unit 114.

[0041] The operation reception unit 111 receives an operation (hereinafter, also referred to as an "input operation") input by the user via the input unit 17. Specifically, when an input operation is performed on the input unit 17, the operation reception unit 111 detects the coordinates of the input position and the type of the input operation. Examples of the types of input operations include various operations using fingers, such as a touch operation, a tap operation, a slide operation, a swipe operation, a flick operation, a pinch-in operation, and a pinch-out operation. The input operation is not limited to an operation of physically contacting the input unit 17 (for example, the touch screen 16), but may also include a non-contact operation. Note that an operation of ending a previously performed input operation, such as a touch-off operation of ending contact with the touch screen 16, can also be considered as one aspect of the input operation.

[0042] Here, the operation reception unit 111 can also receive an input operation performed using an operation device connected via the input / output IF 15 in the same manner as an input operation to the input unit 17 .

[0043] The transmission / reception unit 112 transmits or receives various types of data. For example, the transmission / reception unit 112 transmits game information or user information, or a synchronization request for supporting a multiplay function, to the server 20. The transmission / reception unit 112 also transmits operation information related to an input operation accepted by the operation acceptance unit 111 to the server 20. The transmission / reception unit 112 also receives various types of data and programs from the server 20.

[0044] The game control unit 113 executes various processes related to the progress of the game. The game control unit 113 identifies the user's instruction content based on the user's input operation detected by the operation reception unit 111. The game control unit 113 also executes various determination processes related to the progress of the game based on the identified instruction content, etc. The game control unit 113 also progresses the game while communicating with the server 20 based on the result of the determination process, etc. The game control unit 113 also instructs the display control unit 114 to display an image according to the progress of the game on the display unit 18.

[0045] The display control unit 114 displays images related to the game on the display unit 18. The display control unit 114 generates images to be displayed on the display unit 18 using various images stored in the storage unit 220 or the storage unit 120, various images generated by the image generation unit 214, and the like, and displays the images on the display unit 18. The various images include images of objects in the game (in other words, in the virtual space) (for example, images related to characters such as player characters, items, and backgrounds, etc.), images related to a UI (User Interface) required for various operations of the game, such as icons, buttons, and menus showing various parameters. Note that the control unit 210 may perform a part or all of the process of generating images to be displayed on the display unit 18 using various images.

[0046] The functions of the terminal device 10 and the server 20 shown in FIG. 2 are merely an example. Each of the terminal device 10 and the server 20 may have at least a part of the functions of the other device. In other words, the server 20 may have some or all of the functional blocks of the terminal device 10 in this embodiment, and the terminal device 10 may have some or all of the functional blocks of the server 20. In addition, each of the devices such as the terminal device 10 and the server 20 may not be realized by an integrated device, and may be realized by, for example, multiple devices connected via a network or the like. In addition, the information processing system 1 may be configured by, for example, only the terminal device 10 or the server 20. In other words, the information processing system 1 may not be realized by multiple devices connected via a network.

[0047] <Processing according to this embodiment> Next, the processing according to this embodiment will be described. In this embodiment, the processor 11 of the terminal device 10 or the processor 21 of the server 20 executes a program stored in the information processing system 1 to perform each processing described later. However, at least a part of the processing performed by the processor 11 to be described later may be executed by a processor other than the processor 11. Also, at least a part of the processing performed by the processor 21 to be described later may be executed by a processor other than the processor 21. In other words, the computer that executes the program in this embodiment may be either the terminal device 10 or the server 20, or may be realized by a combination of multiple devices.

[0048] The image generating unit 214 does not cause the AI ​​to generate an image of a specific object and an associated object associated with the specific object displayed on one screen in a game, but causes the AI ​​to generate an image of the associated object. Here, the specific object may be an object operated by a user. The associated object may be an accessory of the specific object. The specific object may be a face of a character (e.g., a player character), and the associated object may include an accessory of the character and a body of the character (e.g., hands and feet). In this embodiment, a case where the specific object is a player character and the associated object is an accessory of the player character will be described as an example. The AI ​​that generates an image of the associated object may be possessed by the information processing system 1, or an AI provided by an external service may be used. Hereinafter, the AI ​​that generates an image of the associated object is referred to as an image generating AI. The accessory includes, for example, a weapon, a protective gear, a clothing, or an accessory worn by a character. The accessory includes, for example, a part attached to a vehicle body or a machine body as a specific object.

[0049] The game of this embodiment may be, for example, a role-playing game, an action game, a shooting game, a racing game, or the like, in which a specific object is equipped with equipment and the player fights against a specific opponent (here, the "opponent" may be another user or a non-player character, etc.). However, the technology according to this embodiment may also be applied to games other than games in which the player fights against a specific opponent in this way.

[0050] In the game of this embodiment, the user can purchase equipment for the player character at a store in the game. The user can also input the characteristics of the equipment to be purchased, create it, and purchase it. In other words, the user can order the equipment to be purchased. In addition, when there are multiple characters to be used by the user (for example, in the case of a game in which the user progresses using a party consisting of multiple characters), the user may be able to select which of the multiple characters to create equipment for and create it. In the following, an example will be described in which equipment is created for a specific character used by the user. However, the technology described below can also be applied to a configuration in which equipment is created without specifying the target character.

[0051] An example of an equipment creation screen 30 as a screen related to the creation of equipment is shown in Fig. 3. The display control unit 114 causes the display unit 18 to display the equipment creation screen 30 during game play (for example, based on the player character visiting a store within the game). The user can create equipment by performing a predetermined input operation on the equipment creation screen 30. The equipment creation screen 30 can also be said to be a screen for inputting characteristics related to the equipment.

[0052] On the equipment creation screen 30, the user can draw an image of the equipment (in other words, an original image) 32. The operation acceptance unit 111 accepts an input operation of drawing the image of the equipment 32 by the user while the equipment creation screen 30 is displayed on the display unit 18. The input operation may be, for example, an operation of drawing a picture using a pointing device, such as a well-known paint software. The input operation may also be an operation of creating the image 32 by combining a plurality of parts prepared in advance. Also, on the equipment creation screen 30, a create button 33 is displayed as a UI for accepting an operation to instruct the creation of the equipment. The operation acceptance unit 111 accepts the user's operation on the create button 33 as an input operation to instruct the creation of the equipment.

[0053] When an input operation for drawing an image 32 of the equipment and an input operation for instructing the creation of the equipment are performed, the image generation unit 214 causes the image generation AI to generate an image of the equipment based on the image. Note that a generation AI that generates a cleaned up image (in other words, an image in which the associated object is drawn in detail) based on a rough sketch (the original image in this embodiment, in other words, an image showing the outline of the associated object) is known, and the generation of the image of the equipment based on the image may be performed using this type of AI. In other words, the image generation unit 214 may input the image 32 to the image generation AI and cause it to generate an image 36 of the equipment based on the image 32 (for example, an image in which the image 32 is cleaned up) (see FIG. 3). The image 36 of the equipment generated by the image generation AI reflects the features of the equipment in the image 32 created by the user. In other words, the image generation unit 214 causes the image generation AI to generate the image 36 of the equipment reflecting the features of the equipment input by the user.

[0054] The user can purchase the equipment shown in the equipment image 36 generated by the image generation AI. In this embodiment, when the equipment image 36 is generated by the image generation AI, the image generation unit 214 instructs the terminal device 10, which has received an input operation to instruct the creation of the equipment, to display the generated equipment image 36. Based on the instruction, the control unit 110 of the terminal device 10 causes the display unit 18 to display the generated equipment image 36 as shown in FIG. 3. The control unit 110 also causes the display unit 18 to display a purchase button 37 as a UI for accepting an operation to instruct the purchase of the equipment together with the generated equipment image 36. The operation acceptance unit 111 accepts the user's operation on the purchase button 37 as an input operation to instruct the purchase of the equipment shown in the generated equipment image 36. Based on the instruction, the game control unit 212 grants the user the equipment shown in the generated equipment image 36. Specifically, the game control unit 212 stores the equipment shown in the generated equipment image 36 in the storage unit 220 as an item owned by the user based on the instruction. Also, the game control unit 212 makes the user pay the price for the purchase of the equipment based on the instruction. Specifically, the game control unit 212 reduces the predetermined value (e.g., in-game currency) owned by the user by the amount of the price based on the instruction. Thus, in this embodiment, the user is able to consume the predetermined value owned by the user to acquire the equipment shown in the equipment image 36 generated by the image generation AI. Note that the user may consume one or more items as the predetermined value owned by the user to acquire the equipment shown in the equipment image 36 generated by the image generation AI. In other words, the acquisition of the equipment shown in the equipment image 36 generated by the image generation AI may be by purchasing the equipment by paying money or the like in the game, or may be by consuming (e.g., synthesizing) an item owned by the user in the game. Furthermore, the consumption of a predetermined value related to the acquisition of equipment may be performed before or after the image generation AI generates the image 36 of the equipment.For example, when an operation is performed on the create button 33, the game control unit 212 may reduce a predetermined value owned by the user by the amount of the purchase price of the equipment based on the operation, and the image generation unit 214 may then cause an image generation AI to generate an image 36 of the equipment.

[0055] The equipment features that the user can input may be, for example, features related to the shape of the equipment or features related to the color. At least a part (in other words, a part or all) of the equipment features may be input by an operation of inputting a character string or an operation of selecting a specific option from a plurality of options. That is, a generation AI that generates an image based on an input of a character string is publicly known, and the generation of an image of the equipment may be performed using this type of AI. Specifically, for example, the operation receiving unit 111 may receive an input operation by the user to input a character string that describes the equipment features while the equipment creation screen 30 is displayed. Also, the equipment creation screen 30 may display a feature entry field 38 as a UI that receives an input operation to input the character string, as shown in FIG. 4. Then, the image generating unit 214 may cause the image generating AI to generate an equipment image 36 in which the equipment features input by the user are reflected based on the character string. Specifically, for example, when the user inputs "blue sword with a star motif" as a character string describing the characteristics of the equipment, the image generation unit 214 may input a prompt to the image generation AI instructing generation of an image of "blue sword with a star motif" and generate the equipment image 36. Also, when the user draws an image 32 of the equipment and inputs "blue" as a character string describing the characteristics (or when the user performs an operation to select blue from a plurality of color candidates presented to the user), the image generation unit 214 may input the image 32 created by the user and a prompt to instruct generation of an image of "blue" equipment to the image generation AI and generate the equipment image 36.

[0056] In this embodiment, the image 32 used to generate the equipment image 36 includes the character image 40 and the equipment image 41 drawn by the user, as shown in Fig. 3. In other words, on the equipment creation screen 30, the user creates the image 32 by adding the equipment that the user imagines to the character image 40 displayed on the screen. The image generation unit 214 causes the image generation AI to execute generation of the equipment image based on the image 32, but the image generation AI does not process the part of the image 32 that corresponds to the character, but processes the range that corresponds to the equipment (in other words, by adding the image of the equipment to the image 32), thereby generating the equipment image 36 without generating the character image 40. In other words, in this embodiment, the input image input to the image generation AI and the output image output by the image generation AI are both one image including a portion corresponding to a character (in other words, an image corresponding to a character) and a portion corresponding to an accessory (in other words, an image corresponding to an accessory), and the portion corresponding to the character is the same in the input image and the output image, and the portion corresponding to the accessory is different in the input image and the output image. Note that an AI capable of recognizing a predetermined object included in a specific image (e.g., a portion corresponding to a character in the image 32, etc.) is publicly known, and a generation AI that generates an image by processing other portions without processing a predetermined portion in a specific image (e.g., a portion designated by a user, a portion designated in advance by a game operator, or a range determined by a computer based on a predetermined condition, etc.) is publicly known, and the generation of the image 36 of the accessory based on the image 32 may be performed using this type of AI. Note that the image generation unit 214 may cause the AI ​​to specify the range to be processed by the image generation AI and the range to be not processed by the image generation AI for the image 32 as the original image used to generate the image of the attached object. In addition, the AI ​​that specifies the areas to be processed and the areas not to be processed may be the same AI as the image generation AI, or it may be a different AI.

[0057] It should be noted that the image diagram 32 used to generate the equipment image 36 may not include the character image 40. In other words, the image generation unit 214 may input the equipment image diagram 32 not including the character image 40 to the image generation AI, and cause the image generation AI to generate the equipment image 36 based on the image diagram 32. In other words, the image generation unit 214 may input only the equipment image 41 drawn by the user, of the character image 40 and the equipment image 41 drawn by the user shown in FIG. 3, to the image generation AI, and cause the image generation AI to generate the equipment image 36 based on the image diagram 32 (in other words, the equipment image 41 drawn by the user).

[0058] Furthermore, when the image generating unit 214 causes the image generating AI to generate an image of an associated object associated with a specific object, the image generating unit 214 may generate an image according to the characteristics of the associated specific object. Specifically, when the image generating unit 214 causes the AI ​​to generate an image 36 of an equipment item, the image generating unit 214 may generate an image according to the characteristics of a character equipped with the equipment item. The characteristics of the specific object may be, for example, characteristics related to the gender, physique, race (e.g., human, monster, robot, etc.) or occupation (e.g., warrior, wizard, priest, etc.) of the specific object, or may be external characteristics (in other words, characteristics related to appearance).

[0059] The generation of an image according to the characteristics of a specific object can be executed as follows: That is, when the image generation unit 214 causes the image generation AI to generate an image based on at least one of the image diagram 32 and the character string indicating the characteristics of the equipment input by the user, the image generation unit 214 may input information indicating the characteristics of the character to the image generation AI, thereby causing the image generation AI to generate an image 36 of the equipment according to the characteristics of the character.

[0060] Specifically, for example, when the image generation unit 214 causes the image generation AI to generate an image 36 of equipment based on an image 32 including an image 40 of a character and an image 41 of equipment drawn by a user, the image generation unit 214 may instruct the image generation AI to generate an image 36 of equipment corresponding to the characteristics of the image 40 of the character included in the image 32 (in other words, suitable for the character). In other words, the image generation unit 214 may input the image 40 of the character and the image 41 of the equipment drawn by the user to the image generation AI, and generate the image 36 of equipment corresponding to the characteristics of the image 40 of the character. In this embodiment, the image 40 of the character and the image 41 of the equipment drawn by the user are input to the image generation AI as one image (i.e., one image including the part of the equipment drawn by the user and the part of the character not drawn by the user) and the image generation AI generates the image 36 of the equipment by processing the one image, but the image 40 of the character and the image 41 of the equipment drawn by the user may be input to the image generation AI separately. The image generation AI may then perform a clean copy of the image 41 of the equipment drawn by the user while adjusting it so that it matches a pre-prepared image 40 of a character that is separate from the image 41 (for example, so that it suits the character and so that the drawing style, etc., matches the character's image 40).

[0061] Furthermore, when the image generation unit 214 causes the image generation AI to generate an image 36 of equipment based on at least one of the image 32 and the character string indicating the characteristics of the equipment input by the user, the image generation unit 214 may input the character string indicating the characteristics of the character to the image generation AI and instruct the image generation AI to generate an image 36 of equipment according to the characteristics of the character. That is, for example, when the character used by the user is a muscular female warrior and the user creates equipment for the character, when the user draws the image 32 and operates the create button 33, the image generation unit 214 may input a prompt to the image generation AI along with the image 32, instructing the image generation AI to generate an image 36 of equipment according to the image 32, the image 36 of equipment according to the image 32, the image 36 of equipment according to the image 32, the image 36 of equipment according to the image 32, the image 36 of equipment according to the image 32, and the image generation AI may generate the image 36 of equipment according to the image 32. The character string indicating the characteristics of the character input to the image generation AI may be automatically determined by the image generation unit 214 according to the characteristics of the character, or may be determined based on the user's input (for example, input to a predetermined entry field).

[0062] It may be possible to create equipment by having the image generation AI generate the equipment image 36 without drawing the image 32 (in other words, without inputting the characteristics of the equipment). For example, when the user operates the create button 33 without drawing the image 32, the image generation unit 214 may input information indicating the characteristics of the character (for example, an image of the character or a character string indicating the characteristics of the character) to the image generation AI and generate the equipment image 36 according to the characteristics of the character. That is, the image generation AI may generate the equipment image 36 from a state in which there is no rough sketch or the like (in other words, a state in which there is no image related to the equipment), rather than generating the equipment image 36 by cleaning up the image 32 created by the user. In such a configuration, the image generation unit 214 may input information on the characteristics of the equipment input by the user by inputting a character string, in addition to the information indicating the characteristics of the character, to the image generation AI, and cause the image generation AI to generate the equipment image 36 according to the characteristics of the character, in which the characteristics of the equipment input by the user are reflected. In addition, in cases where it is possible to create equipment by having the image generation AI generate an image 36 of the equipment without drawing an image diagram 32 (in other words, without inputting the characteristics of the equipment), the image generation unit 214 may cause the image generation AI to generate the image 36 of the equipment without inputting information indicating the characteristics of the character.

[0063] The generation of images of associated objects associated with such specific objects can also be used in game production. For example, games in which new equipment is added after release (in other words, after the start of service) are conventionally known. In this type of game, the image generation unit 214 may cause an image generation AI to generate an image 36 of equipment based on a predetermined operation by the game creator or automatically at a predetermined timing, and may add the equipment shown in the generated image 36 of equipment as a new piece of equipment (in other words, register it in the storage unit 220 as equipment that can be acquired by the user).

[0064] (Modification) The generation of an image by the image generation AI may not be related to the creation of equipment. For example, the image generation unit 214 may cause the image generation AI to generate an image of an associated object associated with a specific object during the progress of a specific event that is progressed using the specific object. The specific event may be an event in which a player character as a specific object is operated to achieve a specific goal. Specifically, the specific event may be an event in which a player character is operated to win against a specific opponent, to reach a specific destination, or to obtain a specific object. In other words, the specific event may be a quest in a game, etc. The specific event may also be a video distribution (for example, a live distribution, etc.). In this case, a specific event that is progressed using a character (in other words, an avatar, etc.) as a specific object in a specific service can be viewed by a user who uses the specific service. That is, the server 20 may function as a server that provides a video distribution service. Note that such a distribution that can be viewed by a user may be a distribution made by another user, or may be a distribution made by a service provider such as a game operator.

[0065] An example of image generation by the image generation AI during the progress of a specific event will be described with reference to FIG. 5. FIG. 5 is a diagram showing an example of an image (hereinafter referred to as an "event-related image 50") displayed on the display unit 18 during the progress of an event. The event-related image 50 includes an image 51 of a specific object (specifically, a character) used by the user and an image 52 of an associated object (specifically, an accessory) associated with the specific object. The image generation unit 214 inputs an original image 54 that is the source of the event-related image 50 to the image generation AI during the progress of the event, and causes the image generation AI to generate the event-related image 50. For example, the image generation unit 214 causes the image generation AI to generate the event-related image 50 illustrated in FIG. 5(c) based on the original image 54 illustrated in FIG. 5(a) or FIG. 5(b).

[0066] The original image 54 includes an image 51 of a specific object. In other words, the original image 54 has a portion corresponding to the specific object. The image generating unit 214 causes the image generating AI to generate an image 52 of an attached object based on the original image 54, but the image generating AI does not process the portion of the original image 54 corresponding to the specific object, and generates the image 52 of the attached object without generating the image 51 of the specific object by adding the image 52 of the attached object to the original image 54 (in other words, by processing other predetermined portions). Note that the original image 54 may include an image showing an outline of the attached object. In other words, the original image 54 may have a portion showing an outline of the attached object. Specifically, the original image 54 exemplified in FIG. 5(a) or FIG. 5(b) may include a rough drawing of equipment in addition to the face of the character. Also, the original image 54 may not have a portion related to the attached object.

[0067] For example, the image generating unit 214 may input the original image 54 including a portion corresponding to a specific object and a portion showing an outline of an associated object to an image generating AI that generates an image that is cleaned up based on a rough drawing, and may cause the image generating AI to clean up the portion of the original image 54 that corresponds to the specific object without processing the portion of the original image 54 that corresponds to the specific object, thereby generating the event-related image 50. Also, for example, the image generating unit 214 may input the original image 54 including a portion corresponding to a specific object but not a portion showing an outline of an associated object to the image generating AI, and may cause the image generating AI to draw the image 52 of the associated object to the portion of the original image 54 that corresponds to the specific object without processing the portion of the original image 54 that corresponds to the specific object, thereby generating the event-related image 50. Note that cleaning up the portion showing the outline of the associated object in the original image 54 can also be considered as drawing the image 52 of the associated object to the original image 54.

[0068] Furthermore, when the image generating unit 214 causes the image generating AI to generate an image 52 of an associated object associated with a specific object, the image generating unit 214 may generate an image according to the state of the associated specific object. Specifically, when the image generating unit 214 causes the image generating AI to generate an image 52 of an accessory, the image generating unit 214 may generate an image according to the state of the character equipped with the accessory (for example, a state that changes during the progress of an event).

[0069] The generation of an image according to the state of a specific object can be performed as follows. For example, the image generating unit 214 may cause the image generating AI to generate an image 52 of an associated object according to the state of the specific object during the execution of an event in which the state of the specific object may change. Here, the state of the specific object may be the state of a parameter of the specific object that may change during the progress of the event. Specifically, when the event is an event in which a player character fights an enemy character, the state of the specific object may be the state of a parameter such as a vitality value or a magic value of the player character. In addition, the state of the specific object may be the state of an appearance of the specific object that may change during the progress of the event. Specifically, when the event is an event in which a player character fights an enemy character, the state of the specific object may be the state of a scratch or dirt on the face of the player character.

[0070] Specifically, the image generating unit 214 may input the original image 54 to the image generating AI and instruct the image generating AI to generate an image 52 of an attached object corresponding to a specific object included in the original image 54, thereby causing the AI ​​to generate an image 52 of the attached object corresponding to the state of the specific object. That is, for example, when causing the AI ​​to generate an image 52 of the attached object corresponding to the appearance state of the specific object, if the appearance state of the specific object changes according to the progress of the event, the image of the generated attached object corresponds to the appearance state of the specific object by instructing the AI ​​to generate an image 52 of the attached object corresponding to the specific object included in the original image 54. More specifically, for example, as shown in FIG. 5(a) and FIG. 5(b), a plurality of original images 54 having different appearance states of the specific object are stored in the storage unit 220 in advance. Then, the image generating unit 214 may determine which of the plurality of original images 54 having different appearance states is to be input to the image generating AI according to the situation of the event, and input the determined original image 54 to the image generating AI to cause the image generating AI to generate the image 52 of the attached object. Alternatively, image generation unit 214 may use the image being displayed on display unit 18 as original image 54. That is, even in conventional games and video distribution, the appearance state of a character may change as the event progresses, but by inputting the image of the character being displayed on the screen at each timing during the event (or to be displayed immediately after) as original image 54 to the image generation AI, an image 52 of the associated object according to the appearance state may be generated.

[0071] Furthermore, the image generating unit 214 may input the original image 54 to the image generating AI, and input a character string corresponding to the state of a specific object included in the original image 54 to the image generating AI, and generate an image in which the image 52 of the associated object is added to the image 51 of the specific object included in the original image 54 based on the character string, thereby causing the image generating AI to generate the image 52 of the associated object corresponding to the state of the specific object. That is, for example, when causing the image generating AI to generate the image 52 of the associated object corresponding to the parameter state of the specific object, a character string corresponding to the parameter state is input to the image generating AI together with the original image 54, and the image generating AI is instructed to add the image 52 of the associated object corresponding to the character string to the original image 54, so that the generated image 52 of the associated object corresponds to the state of the specific object (even when the same original image 54 is input regardless of the state of the specific object). Specifically, when the AI ​​is made to generate an image of equipment according to the state of the player character's vitality value, in a situation where the vitality value is decreasing due to an attack from an enemy character, a character string indicating that the vitality value is decreasing may be input to the image generation AI along with the original image 54, and the image generation AI may be instructed to add an image of equipment suitable for the situation where the vitality value is decreasing to the original image 54. Also, in a situation where the vitality value is decreasing due to an attack from an enemy character, a character string indicating that the equipment has been damaged by the attack may be input to the image generation AI along with the original image 54, and the image generation AI may be instructed to add an image of the equipment damaged by the attack to the original image.

[0072] The image generating unit 214 may cause the image generating AI to generate the event-related image 50 automatically (in other words, at a predetermined timing (e.g., periodically)), or may cause the image generating AI to generate the event-related image 50 based on a predetermined operation by the user. For example, the operation receiving unit 111 may be capable of receiving an operation related to changing the equipment of a character while an event is in progress, and the image generating unit 214 may cause the image generating AI to generate the event-related image 50 based on the operation.

[0073] In this way, the image generating unit 214 causes the AI ​​to generate images of a specific object and an associated object associated with the specific object displayed on one screen of the terminal device 10, but the terminal device 10 does not have to be a terminal device used by a game player. For example, the terminal device 10 may be a terminal device used by a creator who creates a game, a terminal device used by a viewer who watches a video distribution, or a terminal device used by a distributor who distributes videos. In other words, the screen may be a screen related to the production of a game, or a screen related to the viewing or distribution of a video.

[0074] (Processing related to generation of images of attached objects) Next, with reference to FIG. 6, an example of a process for generating an image of an associated object associated with a specific object will be described.

[0075] First, when a predetermined condition is satisfied, the image generation unit 214 decides to execute image generation by the image generation AI (step S101). The predetermined condition is satisfied, for example, by a predetermined input operation by the user. Specifically, the predetermined condition may be satisfied, for example, by a user performing an input operation on the equipment creation screen 30 to instruct the creation of equipment. Furthermore, the predetermined condition may be satisfied by the occurrence of a predetermined event in an event in a configuration in which image generation by the image generation AI is executed while the event is in progress. Furthermore, the predetermined condition may be satisfied by the arrival of a predetermined timing while the event is in progress.

[0076] When it is determined that the image generation AI is to generate an image, the image generation unit 214 inputs input information to be used in generating the images 36, 52 of the associated objects to the image generation AI, and causes the image generation AI to generate the images 36, 52 of the associated objects based on the input information (step S102). The input information may include, for example, an image diagram 32 or an original image 54. The input information may also include information regarding the characteristics or state of a particular object. The input information may also include information regarding the characteristics of an object input by the user.

[0077] Next, the image generating unit 214 acquires (in other words, receives) the images 36, 52 of the attached objects generated by the image generating AI (step S103).

[0078] Next, the image generating unit 214 displays the image 36, 52 of the associated object generated by the image generating AI and the image of the specific object to which the associated object is associated on the display unit 18 of the terminal device 10 (in other words, on one screen) (step S104). Specifically, the image generating unit 214 transmits the image 36, 52 of the associated object generated by the image generating AI to the terminal device 10. In addition, the control unit 110 of the terminal device 10 that has received the image 36, 52 of the associated object displays the image 36, 52 of the associated object and the image of the specific object to which the associated object is associated on the display unit 18. Here, the image generating unit 214 may transmit the image itself generated by the image generating AI to the terminal device 10, or may transmit the image generated by the image generating AI to the terminal device 10 as part of a composite image obtained by combining the image with another image (for example, an image of a specific object, etc.). Then, the control unit 110 of the terminal device 10 may display the composite image on the display unit 18, thereby displaying the image 36, 52 of the associated object and the image of the specific object to which the associated object is attached on the display unit 18. Also, the image itself output by the image generation AI may include the image 36, 52 of the associated object and the image of the specific object to which the associated object is attached. Also, the image of the specific object displayed together with the image 36, 52 of the associated object does not have to be sent from the control unit 210 at the timing when the image of the associated object is sent. The control unit 110 of the terminal device 10 may composite the image of the specific object sent from the control unit 210 at the first timing (or the image of the specific object stored in advance in the storage unit 120) and the image of the associated object sent from the control unit 210 at the second timing, and display the composite image on the display unit 18. That is, the control performed by the information processing system 1 may be such that the image 36, 52 of the associated object generated by the image generation AI and the image of the specific object to which the associated object is attached are displayed on one screen as a result. Here, the images of specific objects are not generated by an image generation AI.

[0079] [Second embodiment] Next, a second embodiment of the present invention will be described. The information processing system 1 of the second embodiment may adopt the contents described in the first embodiment to the extent that no contradiction occurs. For example, the information processing system 1 of the second embodiment may include a part or all of the configuration of the information processing system 1 of the first embodiment. In the following, the description of the matters described in the first embodiment will be omitted or simplified.

[0080] The image generating unit 214 may cause a predetermined AI to generate an image triggered by a specific object making a specific movement (in other words, a motion), and may cause a predetermined display means to display the image generated by the predetermined AI. For example, the image generating unit 214 may cause a predetermined AI to generate an image triggered by a specific character displayed on the display unit 18 of the user's terminal device 10 making a specific movement, and may cause the image generated by the predetermined AI to be displayed on the display unit 18 of the user's terminal device 10. At this time, the image generating unit 214 may cause the image generated by the predetermined AI to be displayed on the display unit 18 together with the specific character. The specific object may be a character (including an avatar, etc.), or may be an object in a virtual space other than a character (in other words, an object existing in a virtual world). The specific object may also be an object (for example, a character) operated by a user. The specific movement may be any movement including a running movement, a jumping movement, a singing movement, an eating movement, a movement to perform a specific attack or defense, a changing movement, a movement to move a hand or a foot, a moving movement, a falling movement, etc. In other words, the specific movement may be a specific motion of the character. In the following, the specific AI is referred to as an image generation AI. An image generated by the image generation AI is referred to as an output image. An image input to the image generation AI when generating the output image is referred to as an input image.

[0081] The output image may be a background image, an image of an object constituting the background, an image of an object used by a specific object, etc. In other words, the output image may be an image relating to an object around a specific object (e.g., a character). In other words, the output image may be an image for performing a predetermined effect in combination with a specific object.

[0082] The image generating unit 214 causes the image generating AI to generate an output image when a specific object displayed on the display unit 18 of the user's terminal device 10 makes a specific movement. The image generating unit 214 also sends this output image to the terminal device 10 and causes it to be displayed on the display unit 18. Specifically, the image generating unit 214 causes this output image to be displayed on the display unit 18 together with the specific object. That is, the control unit 110 of the terminal device 10 causes the terminal device 10 to display the sent output image. In this embodiment, the image generated by the image generating AI is displayed on the display unit 18 together with the specific object. That is, on the display unit 18, a specific performance is performed by combining the output image and the specific object, and the specific performance is visually recognized by the user. That is, according to the technology of this embodiment, when a character makes a specific movement on the screen viewed by the user, a performance can be realized in which an output image generated by the image generating AI appears on the screen. Specifically, when a character makes a specific movement on the screen viewed by the user, an image of the character's background (in other words, an image of the object around the character) is generated by the image generation AI, and the image of the character's background is switched to the image generated by the image generation AI. Note that the output image generated by the image generation AI does not have to be displayed on the display unit 18 together with the specific object. That is, for example, when a character makes a specific movement on the screen viewed by the user and an output image generated by the image generation AI is made to appear on the screen, the character can disappear from the screen and the output image appears instead.

[0083] In this manner, the image generating unit 214 may cause the image generating AI to generate an output image triggered by a specific movement of a character displayed on the display unit 18 in the user's terminal device 10, and may cause the output image generated by the image generating AI to be displayed on the display unit 18, but the character does not have to be a character operated by the user. For example, the user may be a viewer who watches video distribution (e.g., live distribution, etc.), and the character may be a character that appears in the video distribution. In other words, the image generating unit 214 may cause the image generating AI to generate an output image triggered by a specific movement of a character displayed on the display unit 18 in the viewer's terminal device 10, and may execute control to display the output image generated by the image generating AI on the display unit 18.

[0084] The generation of an image triggered by a specific object making a specific movement may be generation of an image triggered by an AI capable of detecting a specific movement of a specific object detecting the specific movement. Also, the generation of an image triggered by a specific object making a specific movement may be generation of an image triggered by a user performing a predetermined operation that causes a specific object to make a specific movement.

[0085] Specifically, an AI (hereinafter, referred to as a "detection AI") capable of detecting a specific movement (e.g., the specific object jumping) of a specific object shown in an image (in other words, in a video) is publicly known, and the image generation unit 214 may input an image displayed on the display unit 18 (in other words, an image being displayed) to this type of AI and cause it to detect a specific movement of the specific object. In other words, the image generation unit 214 may cause the detection AI to detect a specific movement of a specific object (in other words, a specific object in an image displayed on the display unit 18) during the progress of a predetermined event. Then, when the detection AI detects a specific movement of the specific object, the image generation unit 214 may cause the image generation AI to generate an image. Note that the detection AI and the image generation AI may be the same AI or different AIs.

[0086] As is well known, in games and the like, a user can make a character perform a specific movement by a predetermined operation. Specifically, in games and the like, an operation for making a player character jump, an operation for making a player character run, and the like are defined, and the player character moves according to the operation. When the operation receiving unit 111 receives a user operation for making a specific object perform a specific movement, the image generating unit 214 may cause the image generating AI to generate an image based on the operation.

[0087] In addition, the generation of an image triggered by a specific object making a specific movement may be executed after the specific object makes the specific movement on the display unit 18, or may be executed before the specific movement is made after it is determined that the specific object will make the specific movement on the display unit 18. That is, for example, when an AI detects a specific movement of a specific object from a video displayed on the display unit 18 and generates an output image, the AI ​​may be configured to be able to detect the specific movement of the specific object before a scene in which the specific object makes the specific movement in the video is displayed on the display unit 18, or may be configured to detect the specific movement of the specific object after a scene in which the specific object makes the specific movement in the video is displayed on the display unit 18. Specifically, for example, the image generation unit 214 may input the video to the detection AI prior to the playback of the video on the display unit 18, and cause the detection AI to detect the specific movement prior to the display on the display unit 18. In addition, when an image is generated based on a user performing a specified operation that causes a specific object to perform a specific movement, the generation of the output image by the image generation AI may be performed after the specified operation is performed and before the display of the specific object performing a specific movement is displayed on the display unit 18, or the generation of the output image by the image generation AI may be performed after the display of the specific object performing a specific movement is displayed on the display unit 18.

[0088] The image generation unit 214 inputs input information required for generating an image to the image generation AI, and generates an output image. The input information may or may not include the input image. In other words, the image generation unit 214 may cause the image generation AI to generate an output image based on a predetermined input image, or may cause the image generation AI to generate an output image without providing an input image. For example, as a generation AI, an AI capable of generating an output image based on a prompt such as "Please generate a background image to be used in a game" or a prompt such as "Please generate a background image to be used in video distribution" (in other words, without requiring an input image) is known, and the image generation unit 214 may input such a prompt as input information to the image generation AI and cause it to generate an output image.

[0089] The image generating unit 214 may also cause the image generating AI to generate an output image corresponding to the movement of a specific object. For example, when a character runs, an image of a grass field is generated as an output image, when a character sings, an image of a stage or an image of a microphone is generated as an output image, and when a character eats something, an image of a restaurant or an image of food is generated as an output image. In this manner, the image generating AI may generate an output image corresponding to the movement of a specific object. In addition, regarding the generation of an output image corresponding to the movement of a specific object, the image generating AI may determine the theme (in other words, the outline) of the output image, or the image generating unit 214 may instruct the image generating AI. In other words, the judgment of what kind of output image is suitable for various movements of the player character (for example, the judgment that "an image of a grass field is suitable" for the movement of running, or the judgment that "an image of a restaurant is suitable" for the movement of eating) may be performed by the image generating AI, or may be performed by an AI other than the image generating AI. In addition, a correspondence between the type of movement and the theme (in other words, an outline) of the output image is pre-registered in the memory unit 220, such as an image of a grassland for a running movement and an image of a restaurant for an eating movement, and when the image generation unit 214 identifies the type of movement of a specific object based on detection by the detection AI or user operation, it may instruct the image generation AI to generate an output image in line with the theme corresponding to the identified type of movement.

[0090] For example, the image generation unit 214 may input an image displayed on the display unit 18 (in other words, an image in which a specific object moves) as an input image to the image generation AI, and instruct the image generation AI to generate an output image (for example, a background image) according to the movement of the specific object in the input image. Note that the image generation AI that generates an output image according to the movement of a specific object in the input image in this way can also be generated by, for example, providing a machine learning model with a combination of the movement of the specific object and the answer of the output image as learning data. Also, the image generation AI that generates an output image according to the movement of a specific object in the input image can also be generated by, for example, providing a machine learning model with an image of an object making a specific movement, in which a background or the like is depicted, as learning data. The image generation AI generated in this way can simultaneously detect that a specific object in the input image has made a specific movement, determine a theme suitable for the specific movement, and generate an output image suitable for the specific movement.

[0091] Also, for example, the image generation unit 214 may determine a theme (in other words, an outline) of an output image according to a specific movement of a specific object identified based on detection by the detection AI or a user's operation, and instruct the image generation AI to generate an output image of the determined theme. The image generation unit 214 may determine the theme of the output image based on a correspondence between a type of movement registered in advance and the theme. That is, the image generation unit 214 may determine a theme that is set in advance as a theme corresponding to a specific movement, as the theme of the output image. Also, the image generation unit 214 may instruct a specific AI to propose a theme suitable for a specific movement, and determine the proposed theme as the theme of the output image.

[0092] Furthermore, the image generating unit 214 may cause the image generating AI to generate an image according to the appearance of a specific object. For example, when the equipment (in other words, clothing) of the character is a swimsuit, a background image of a beach is generated as an output image, and when the equipment of the player character is a uniform, a background image of a school is generated as an output image. In this way, an output image according to the appearance of a specific object may be generated by the image generating AI.

[0093] For example, the image generation unit 214 may input information on the appearance of a specific object to the image generation AI as input information, and cause the image generation AI to generate an output image based on the information, thereby causing the image generation AI to generate an output image corresponding to the appearance of the specific object. Specifically, the image generation unit 214 may input an image showing the appearance of a specific object, such as a display image displayed on the display unit 18, as input information to the image generation AI, and cause the image generation AI to generate an output image based on the input information, thereby causing the image generation AI to generate an output image corresponding to the appearance of the specific object. In other words, the image generation unit 214 may cause an AI to detect the appearance characteristics of a specific object, and cause the image generation AI to generate an output image corresponding to the detected characteristics. Note that the AI ​​that detects the appearance characteristics may be the same AI as the image generation AI, or may be a different AI. Furthermore, the image generating unit 214 may input a character string indicating the appearance characteristics of a specific object displayed on the display unit 18 (for example, a character string indicating that the character is wearing a swimsuit) as input information to the image generating AI, and cause the image generating AI to generate an output image based on the input information, thereby causing the image generating AI to generate an output image according to the appearance of the specific object. In this case, the image generating unit 214 may determine the character string to be input to the image generating AI according to the appearance of the specific object (for example, according to equipment, etc.). For example, when a character as a specific object is wearing a swimsuit, the image generating unit 214 may input a prompt such as "Please generate a background image to be used in the game that matches a character wearing a swimsuit" as input information to the image generating AI, and cause the image generating AI to generate an output image.

[0094] (Processing related to the generation of images triggered by specific movements) Next, an example of a process for generating an image triggered by a specific object making a specific movement will be described with reference to FIG.

[0095] First, the image generating unit 214 determines whether or not a specific object displayed on the display unit 18 of the terminal device 10 has made a specific movement (step S201). Here, the determination of whether or not a specific movement has made a specific movement may be a determination of whether or not a specific object has made a specific movement. Also, the determination of whether or not a specific movement has made a specific movement may be a determination of whether or not a specific object is about to make a specific movement. For example, the image generating unit 214 may determine that a specific movement has made a specific movement when a detection AI capable of detecting a specific movement of a specific object in an image displayed on the display unit 18 detects the specific movement. Also, the image generating unit 214 may determine that a specific movement has made a specific movement when a user input operation is made to make a specific object make a specific movement.

[0096] If there is a specific movement of a specific object, the image generation unit 214 determines to execute image generation by the image generation AI (step S202).

[0097] When it is decided to execute image generation by the image generation AI, the image generation unit 214 inputs input information required for generating an output image to the image generation AI, and causes the image generation AI to generate the output image (step S203).

[0098] Next, the image generating unit 214 acquires (in other words, receives) the output image generated by the image generation AI (step S204).

[0099] Next, the image generating unit 214 displays the output image generated by the image generating AI and the image of the specific object on the display unit 18 of the terminal device 10 (in other words, on one screen) (step S205). For example, the image generating unit 214 displays the image of the character as the specific object and the background image generated by the image generating AI (in other words, an image related to objects around the character) on one screen.

[0100] The present invention is not limited to the above-described embodiment, and can be modified in various ways without departing from the scope of the present invention. The technology described in this specification may be applied to services other than games (in other words, applications). The technology described in this specification may also be used in the development process of services such as game production. Within the scope of the present invention, the components can be freely combined, any component can be modified, any component can be replaced, any component can be omitted, or other components can be added. The process flow described in this specification is merely an example, and the order and configuration of each process may be different. Some processes described in this specification may not exist. In other words, the process flow and specific determination processes may be different from those exemplified in this specification.

[0101] <Additional Notes> The configuration of this embodiment may be used, for example, to prepare images in a non-conventional form and use them to provide a service. The configuration of this embodiment may also be used, for example, to improve interest. The matters described in the above embodiment may also be described as follows:

[0102] (Appendix 1-1) Computer, With respect to a specific object and an associated object associated with the specific object that are displayed on one screen in a game, the image generating unit 214 functions as an image generating means (e.g., an image generating unit 214) that causes an AI to generate an image of the associated object without causing an AI to generate an image of the specific object. program. According to such a configuration, among a plurality of objects displayed on one screen, it is possible to make the AI ​​generate images for some objects and not to make the AI ​​generate images for other objects. Therefore, for example, the burden of preparing images to be generated by the AI ​​in advance can be reduced. Also, for example, the images to be generated by the AI ​​can generate unexpected images compared to when they are prepared by humans in advance, and the interest of the game can be improved. Also, for example, in cases where the game creator cannot predict in advance what kind of images should be prepared, it becomes possible to prepare images to be used in the game. Also, for example, by not making the AI ​​generate images for some objects, the game creator can create the images in detail and improve the interest of the game.

[0103] (Appendix 1-2) the specific object is an object operated by a player of the game, The associated object is an accessory of the particular object. The program described in Appendix 1-1. With such a configuration, for example, the effects described in Appendix 1-1 can be obtained while maintaining the worldview of the game created by the game creator for the main parts such as characters.

[0104] (Appendix 1-3) The AI ​​for generating the image of the associated object generates the image of the associated object by adding the image of the associated object to the original image without processing the portion of the original image including the image of the specific object that corresponds to the specific object identified by the AI. The program described in Appendix 1-1 or 1-2. According to such a configuration, for example, by preparing an image depicting a specific object, it is possible to create an image in which an additional object is added to this image.

[0105] (Appendix 1-4) The image generating means causes an AI to generate an image of the associated object according to the characteristics of the specific object. The program described in Appendix 1-1 or 1-2. According to such a configuration, for example, the characteristics of a specific object can be reflected in the image of the associated object generated by AI.

[0106] (Appendix 1-5) The image generating means causes an AI to generate an image of the associated object according to a state of the specific object. The program described in Appendix 1-1 or 1-2. According to such a configuration, for example, the state of a specific object can be reflected in the image of the associated object generated by the AI.

[0107] (Appendix 1-6) The image generating means causes an AI to generate an image of the auxiliary object based on a feature of the auxiliary object input by a player of the game. The program described in Appendix 1-1 or 1-2. According to this configuration, the user can give instructions regarding the image of the associated object to be generated.

[0108] (Appendix 2-1) Computer, The AI ​​is made to generate an image triggered by a specific object displayed on a specific display means making a specific movement, and the image generated by the AI ​​is made to function as a control means (e.g., the image generating unit 214) that controls the display of the image on the specific display means. program. According to such a configuration, for example, when a specific object makes a specific movement, an image generated by AI can be displayed, which is a new effect that has not been achieved before, and the interest of the service can be improved. Also, for example, the image displayed when a specific object makes a specific movement can be changed depending on the situation, which can improve the interest of the service.

[0109] (Appendix 2-2) The control means causes an AI to generate the image according to the movement of the specific object. The program described in Appendix 2-1. With this configuration, for example, it is possible to have the AI ​​generate images that match the movement of a specific object.

[0110] (Appendix 2-3) The control means causes an AI to generate the image according to the appearance of the specific object. The program described in Appendix 2-1. With this configuration, for example, it is possible to have the AI ​​generate an image that matches the appearance of a particular object.

[0111] (Appendix 2-4) The image generated by AI is displayed on the predetermined display means together with the specific object. 2. A program according to any one of Appendices 2-1 to 2-3. With this configuration, for example, when a specific object makes a specific movement, an unprecedented effect becomes possible, in which an image generated by AI is displayed together with the specific object.

[0112] (Appendix 2-5) The control means causes an AI to generate the image when the AI ​​capable of detecting the specific movement of the specific object detects the specific movement. 2. A program according to any one of Appendices 2-1 to 2-3. According to such a configuration, for example, it is possible to determine that a specific object has made a specific movement from a predetermined image, etc., and to execute image generation using AI.

[0113] (Appendix 2-6) The control means causes the AI ​​to generate the image based on a predetermined operation performed by a user to cause the specific object to perform the specific movement. 2. A program according to any one of Appendices 2-1 to 2-3. According to such a configuration, for example, it is possible to realize generation of images by AI at appropriate timing without the need to detect specific movements of specific objects based on images, etc.

[0114] In addition, the problem-solving means constituted by the above-mentioned program (for example, each configuration described in the appendix) can be appropriately diverted to an apparatus, a system, a method, a medium, etc. [Explanation of symbols]

[0115] 1 Information processing system, 10 Terminal device, 11 Processor, 12 Memory, 13 Storage, 14 Communication IF, 15 Input / output IF, 17 Input section, 18 Display section, 20 Server, 21 Processor, 22 Memory, 23 Storage, 24 Communication IF, 25 Input / output IF, 110 Control section, 111 Operation reception section, 112 Transmission / reception section, 113 Game control section, 114 Display control section, 120 Memory section, 210 Control section, 211 Transmission / reception section, 212 Game control section, 214 Image generation section, 220 Memory section

Claims

1. Computer, a learning model that has been trained to be able to generate a desired image is made to generate an image triggered by a specific object displayed on a specific display means making a specific movement, and the control means functions as a control means that controls the output image generated by the learning model to be displayed on the specific display means; The control means inputs input information required for generating an image to the learning model when the specific object makes a specific movement, and causes the learning model to generate the output image. program.

2. The control means causes the learning model to generate the output image according to the movement of the specific object. The program according to claim 1.

3. The control means causes the learning model to generate the output image according to the appearance of the specific object. The program according to claim 1.

4. The output image generated by the learning model is displayed on the predetermined display means together with the specific object. The program according to any one of claims 1 to 3.

5. The control means, when an AI capable of detecting the specific movement of the specific object from an image displayed on the predetermined display means detects the specific movement, inputs input information necessary for generating an image to the learning model, and causes the learning model to generate the output image. The program according to any one of claims 1 to 3.

6. The control means inputs input information necessary for generating an image to the learning model based on a predetermined operation performed by a user to cause the specific object to perform the specific movement, and causes the learning model to generate the output image. The program according to any one of claims 1 to 3.

Images