program

Abstract

To provide a technique that prepares an image in an unprecedented form and can be utilized for providing services.SOLUTION: A program allows a computer to function as image generation means for allowing an AI to generate an image of an attached object without allowing the AI to generate an image of a specific object for the specific object displayed on one screen in a game and the attached object attached to the specific object.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present invention relates to a program.

Background Art

[0002] An AI capable of generating images is known (see, for example, Non-Patent Document 1).

Prior Art Documents

Non-Patent Documents

[0003]

Non-Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] By the way, in services such as games, various images are required for providing the service.

[0005] An object of the present invention is to provide a technique for preparing images in an unprecedented form and making them available for providing services.

Means for Solving the Problems

[0006] According to one embodiment shown in the present disclosure, a computer is functioned as an image generation means for generating an image of an associated object by an AI without generating an image of a specific object displayed on one screen in a game and an associated object associated with the specific object. a program is provided.

Effects of the Invention

[0007] According to the present invention, images can be prepared in a way that is not conventional and used for providing services. [Brief explanation of the drawing]

[0008] [Figure 1] This is a diagram illustrating the schematic configuration of an information processing system. [Figure 2] This is a block diagram showing the functional configuration of an information processing system. [Figure 3] This diagram illustrates the generation of images using AI based on conceptual diagrams. [Figure 4] This is a diagram illustrating the AI-generated image based on text input by the user. [Figure 5] This diagram illustrates the AI-driven image generation process during an event. [Figure 6] This flowchart shows an example of the process involved in generating images of associated objects. [Figure 7] This flowchart shows an example of a process related to generating images triggered by a specific movement of a particular object. [Modes for carrying out the invention]

[0009] Embodiments of the present invention will be described below with reference to the drawings.

[0010] [First Embodiment] <System Hardware Configuration> As shown in Figure 1, the information processing system 1 of this embodiment includes a plurality of terminal devices 10 and a server 20.

[0011] The terminal device 10 and the server 20 are connected via network 2. Network 2 may consist of, for example, the internet, a mobile communication system (e.g., 3G, 4G, 5G, LTE (Long Term Evolution), etc.), Wi-Fi (Wireless Fidelity), Bluetooth (registered trademark), other communication lines, or a combination thereof. Furthermore, the connection between the terminal device 10 and the server 20 may be wired or wireless.

[0012] The server 20 (in other words, a computer or information processing device) may be a general-purpose computer such as a workstation or personal computer. The server 20 comprises a processor 21, memory 22, storage 23, a communication interface 24, and an input / output interface 25. These components of the server 20 are connected to each other by a communication bus.

[0013] The processor 21 controls the overall operation of the server 20. The processor 21 may include a CPU (Central Processing Unit), an MPU (Micro Processing Unit), and a GPU (Graphics Processing Unit), etc. The processor 21 reads programs from the storage 23 and loads them into memory 22. The processor 21 executes the loaded programs.

[0014] Memory 22 is the main memory. Memory 22 is composed of storage devices such as ROM (Read Only Memory) and RAM (Random Access Memory). Memory 22 provides the processor 21 with a workspace by temporarily storing programs and various data read by the processor 21 from storage 23. Memory 22 also temporarily stores various data generated by the processor 21 while it is operating according to the program.

[0015] In addition, in this embodiment, the program may be a program for realizing a game by the terminal device 10. Further, the program may be a program for realizing the game through cooperation between the terminal device 10 and the server 20. Note that, as an example, the game realized through cooperation between the terminal device 10 and the server 20 may be a game executed on a browser started on the terminal device 10. Further, the program may be a program for realizing the game through cooperation of a plurality of terminal devices 10. Further, various data includes, for example, data related to the game such as user information and game information, and instructions and notifications transmitted and received between the terminal device 10 and the server 20.

[0016] The storage 23 is an auxiliary storage device. The storage 23 is constituted by, for example, a storage device such as a flash memory or an HDD (Hard Disk Drive). Various data related to the game is stored in the storage 23.

[0017] The communication IF 24 controls transmission and reception of various data via a network between the server 20 and the terminal device 10 or the like.

[0018] The input / output IF 25 is an interface for the server 20 to receive data input and an interface for the server 20 to output data. The input / output IF 25 may include, for example, an input unit which is an information input device such as a mouse and a keyboard, and a display unit which is a device for displaying and outputting an image.

[0019] The terminal device 10 (in other words, a computer, an information processing device) may be, for example, a smartphone, a feature phone, a PDA (Personal Digital Assistant), a tablet computer, a personal computer, a wearable terminal, or a game device. The terminal device 10 may be a mobile terminal. The terminal device 10 may be a portable terminal when the user executes a game.

[0020] The terminal device 10 comprises a processor 11, memory 12, storage 13, communication interface 14, input / output interface 15, input unit 17, and display unit 18. These components of the terminal device 10 are connected to each other by a communication bus.

[0021] The processor 11 controls the operation of the entire terminal device 10. The processor 11 may include a CPU, MPU, and GPU. The processor 11 reads a program from the storage 13 and loads it into the memory 12. The processor 11 executes the loaded program.

[0022] Memory 12 is the main memory. Memory 12 is composed of storage devices such as ROM and RAM. Memory 12 provides the processor 11 with a workspace by temporarily storing programs and various data read by the processor 11 from storage 13. Memory 12 also temporarily stores various data generated by the processor 11 while it is operating according to the program.

[0023] Storage 13 is an auxiliary storage device. Storage 13 is comprised of, for example, a storage device such as flash memory or an HDD. Various data related to the game is stored in Storage 13.

[0024] The communication interface 14 controls the transmission and reception of various types of data over the network between the terminal device 10 and the server 20, etc.

[0025] The input / output interface 15 is an interface for the terminal device 10 to receive data input and an interface for the terminal device 10 to output data. The input / output interface 15 may perform data input and output via, for example, USB (Universal Serial Bus). The input / output interface 15 may include an input unit 17 or a display unit 18, etc.

[0026] The input unit 17 accepts input from the user. The input unit 17 may be, for example, a pointing device such as a touchpad. The display unit 18 displays an image. The display unit 18 may be, for example, a liquid crystal display or an organic EL (Electro-Luminescence) display. The terminal device 10 includes, for example, a touchscreen 16 which is an electronic component combining the input unit 17 and the display unit 18.

[0027] The input unit 17 has the function of detecting the position input to the input surface by user operation (e.g., touch operation, tap operation, slide operation, swipe operation, and flick operation, etc.) and transmitting information indicating the detected position as an input signal. The touch panel as the input unit 17 can employ a capacitive type or a resistive type, but other types may also be used.

[0028] The input unit 17 may be, for example, a keyboard, various physical buttons, various sensors (e.g., an acceleration sensor, angular velocity sensor, magnetic sensor, GPS sensor, motion sensor, gaze sensor, biopotential sensor, fingerprint sensor, breath sensor, pressure sensor, or image sensor), an operating stick, a camera, or a microphone. The display unit 18 may be, for example, a projector.

[0029] <System Functional Configuration> Figure 2 is a block diagram showing the functional configurations of the server 20 and the terminal device 10. Each of the server 20 and the terminal device 10 may include functional configurations necessary for functioning as a general computer (not shown) and functional configurations necessary for implementing known functions in a game.

[0030] In this embodiment, the server 20 identifies each user and terminal device 10 using user accounts that have been registered in advance. The method of registering accounts is not particularly limited. For example, a terminal device 10 or another device such as a personal computer may transmit information necessary for user account registration to the server 20 based on user operations, and the server 20 may create and store each user's account based on the received information.

[0031] The server 20 has the function of communicating with each terminal device 10 and assisting the terminal devices 10 in progressing through the game. If the game is a multiplayer game, the server 20 may also have the function of communicating with each terminal device 10 participating in the game and mediating communication between the terminal devices 10. The server 20 functions as a control unit 210 and a storage unit 220 through the cooperation of the processor 21, memory 22, storage 23, communication IF 24, and I / O IF 25, etc.

[0032] The memory unit 220 stores various types of data used by the control unit 210. These types of data include, for example, programs, game information, and user information. The program is the program used to implement the game. The game information and user information are data that the control unit 210 references when executing the program.

[0033] Game information is data that the control unit 210 or control unit 110 refers to when executing a program. Game information includes, for example, data such as images and sounds used in the game. User information is data managed for each user account. User information includes, for example, information about the character used by the user (in other words, the character that the user can control) (hereinafter referred to as "player character"), information about owned assets, and information indicating the progress of the game. Owned assets can be said to be the value that the user owns within the game (in other words, within the virtual space). Examples of such value (in other words, in-game value, owned assets) include electronic currency, items, and characters. Examples of electronic currency include in-game currency usable within the game and crypto assets.

[0034] The control unit 210 controls various processes related to the game by executing a program stored in the memory unit 220. The control unit 210 includes, for example, a transmitting / receiving unit 211, a game control unit 212, and an image generation unit 214.

[0035] The transmitting / receiving unit 211 transmits or receives various types of data. For example, the transmitting / receiving unit 211 receives requests to transmit various types of data and programs, requests for synchronization processing to support multiplayer functionality, and data to be synchronized from each terminal device 10, and passes them to the game control unit 212. The transmitting / receiving unit 211 also transmits various types of data and programs to each terminal device 10 according to the control of the game control unit 212.

[0036] The game control unit 212 provides the game to the terminal device 10 by executing calculation processing described in the program in response to requests from the terminal device 10.

[0037] The image generation unit 214 generates images used in the game. In other words, the image generation unit 214 generates images used to provide the service. Specifically, the image generation unit 214 has the AI ​​generate images. The images that the image generation unit 214 has the AI ​​generate may be two-dimensional images or three-dimensional images (in other words, 3D models). Furthermore, the images that the image generation unit 214 has the AI ​​generate may be still images or videos.

[0038] The terminal device 10 has functions such as an input device that accepts user input operations, and an output device that outputs game images and sounds.

[0039] The terminal device 10 functions as a control unit 110 and a storage unit 120 through the cooperation of the processor 11, memory 12, storage 13, communication IF 14, and input / output IF 15, etc. The storage unit 120 stores various data used by the control unit 110. Examples of such data include programs, game information, and user information. The program is a program for implementing a game on the terminal device 10 side. The game information and user information are data that the control unit 110 refers to when executing the program. The game information and user information stored in the storage unit 120 may include the same information as the game information and user information stored in the storage unit 220.

[0040] The control unit 110 controls various processes related to the game executed in the terminal device 10 by executing a program stored in the memory unit 120. The control unit 110 includes, for example, an operation reception unit 111, a transmission / reception unit 112, a game control unit 113, and a display control unit 114.

[0041] The operation reception unit 111 receives operations (hereinafter also referred to as "input operations") input by the user via the input unit 17. Specifically, when an input operation is performed on the input unit 17, the operation reception unit 111 detects the coordinates of the input position and the type of input operation. Examples of input operations include various operations performed with fingers, such as touch operations, tap operations, slide operations, swipe operations, flick operations, pinch-in operations, and pinch-out operations. Input operations are not limited to operations that physically contact the input unit 17 (for example, the touchscreen 16), but can also include non-contact operations. Operations that terminate an input operation that was previously performed, such as a touch-off operation that ends contact with the touchscreen 16, can also be considered a form of input operation.

[0042] Here, the operation reception unit 111 can accept input operations performed using operating devices connected via the input / output IF 15, in the same way as input operations performed on the input unit 17.

[0043] The transmitting / receiving unit 112 transmits or receives various types of data. For example, the transmitting / receiving unit 112 transmits game information or user information, or synchronization requests for multiplayer functionality, to the server 20. The transmitting / receiving unit 112 also transmits operation information related to input operations received by the operation reception unit 111 to the server 20. The transmitting / receiving unit 112 also receives various types of data and programs from the server 20.

[0044] The game control unit 113 performs various processes related to the progress of the game. Based on the user's input detected by the operation reception unit 111, the game control unit 113 identifies the user's instructions. Based on the identified instructions, the game control unit 113 performs various judgment processes related to the progress of the game. Based on the results of the judgment processes, the game control unit 113 communicates with the server 20 to advance the game. The game control unit 113 also instructs the display control unit 114 to display an image on the display unit 18 that corresponds to the progress of the game.

[0045] The display control unit 114 causes the display unit 18 to display images related to the game. The display control unit 114 generates images to be displayed on the display unit 18 using various images stored in the memory unit 220 or memory unit 120, and various images generated by the image generation unit 214, and displays them on the display unit 18. The various images include images of objects in the game (in other words, in the virtual space) (for example, images of characters such as player characters, items, and backgrounds), as well as images related to the UI (User Interface) necessary for various operations of the game, such as icons, buttons, and menus showing various parameters. The control unit 210 may perform part or all of the process of generating images to be displayed on the display unit 18 using the various images.

[0046] Note that the functions of the terminal device 10 and server 20 shown in Figure 2 are merely examples. Each device of the terminal device 10 and server 20 may have at least some of the functions of other devices. In other words, in this embodiment, the server 20 may have some or all of the functional blocks of the terminal device 10, and the terminal device 10 may have some or all of the functional blocks of the server 20. Furthermore, each device such as the terminal device 10 and server 20 does not have to be implemented by a single device, but may be implemented by multiple devices connected via a network, for example. Also, the information processing system 1 may consist of only the terminal device 10 or the server 20, for example. In other words, the information processing system 1 does not have to be implemented by multiple devices connected via a network.

[0047] <Processing according to this embodiment> Next, the processing according to this embodiment will be described. In this embodiment, the processor 11 of the terminal device 10 or the processor 21 of the server 20 will be described as performing the processing described later by executing a program stored in the information processing system 1. However, at least a portion of the processing described later that is performed by the processor 11 may be executed by a processor other than the processor 11. Also, at least a portion of the processing described later that is performed by the processor 21 may be executed by a processor other than the processor 21. In other words, the computer that executes the program in this embodiment may be either the terminal device 10 or the server 20, or it may be realized by a combination of multiple devices.

[0048] The image generation unit 214, for a specific object displayed on a single screen in the game, does not have the AI ​​generate an image of the specific object, but rather has the AI ​​generate an image of the accompanying object. Here, the specific object may be an object operated by the user. The accompanying object may be equipment for the specific object. Furthermore, the specific object may be the face of a character (e.g., a player character), and the accompanying object may include the character's equipment or the character's body (e.g., arms and legs). In this embodiment, the case where the specific object is the player character and the accompanying object is the player character's equipment will be explained as an example. The AI ​​that generates images of the accompanying object may be owned by the information processing system 1, or an AI provided by an external service may be used. Hereinafter, the AI ​​that generates images of the accompanying object will be referred to as the image generation AI. Equipment includes, for example, weapons, armor, clothes, or accessories worn by a character. Equipment also includes, for example, parts attached to a vehicle or machine, which may be a specific object.

[0049] The game of this embodiment may be, for example, a role-playing game, action game, shooting game, or racing game in which equipment is attached to a specific object and used to fight against a predetermined opponent (wherein "opponent" may be another user, a non-player character, etc.). However, the technology of this embodiment can also be applied to games other than games in which a predetermined opponent is fought.

[0050] In the game of this embodiment, users can purchase equipment for their player characters at an in-game shop. Furthermore, users can create and purchase equipment by inputting its characteristics. In other words, users can order custom-made equipment. If a user has multiple characters (for example, in a game where the user progresses using a party composed of multiple characters), the user may be able to select which of the multiple characters the equipment will be created for. The following explanation will focus on the case of creating equipment for a specific character used by the user. However, the techniques described below can also be applied to configurations where equipment is created without specifying a target character.

[0051] Figure 3 shows an example of the equipment creation screen 30, which is a screen related to the creation of equipment. The display control unit 114 displays the equipment creation screen 30 on the display unit 18 during gameplay (for example, based on the player character visiting a shop in the game). The user can create equipment by performing predetermined input operations on the equipment creation screen 30. The equipment creation screen 30 can also be described as a screen for inputting the characteristics of the equipment.

[0052] On the equipment creation screen 30, the user can draw an image diagram (in other words, the original image) 32 of the equipment. The operation reception unit 111 accepts input operations from the user to draw the image diagram 32 of the equipment when the equipment creation screen 30 is displayed on the display unit 18. This input operation may be an operation to draw a picture using a pointing device, such as with well-known paint software. Alternatively, this input operation may be an operation to create the image diagram 32 by combining multiple pre-prepared parts. The equipment creation screen 30 also displays a create button 33 as a UI that accepts operations to instruct the creation of equipment. The operation reception unit 111 accepts the user's operation on the create button 33 as an input operation to instruct the creation of equipment.

[0053] When an input operation is performed to draw an image diagram 32 of the equipment and an input operation is performed to instruct the creation of the equipment, the image generation unit 214 causes the image generation AI to generate an image of the equipment based on the image diagram. It should be noted that generation AIs that generate a cleaned-up image (in other words, an image in which the accompanying object is depicted in detail) based on a rough sketch (the original image in this embodiment, in other words, an image showing the outline of the accompanying object) are well known, and the generation of an image of the equipment based on the image diagram may be performed using this type of AI. In other words, the image generation unit 214 may input the image diagram 32 to the image generation AI and cause it to generate an image of the equipment (for example, a cleaned-up image of the image diagram 32) 36 based on the image diagram 32 (see Figure 3). The image of the equipment 36 generated by the image generation AI reflects the features of the equipment in the image diagram 32 created by the user. That is, the image generation unit 214 causes the image generation AI to generate an image of the equipment 36 that reflects the features of the equipment entered by the user.

[0054] The user can purchase the equipment shown in the equipment image 36 generated by the image generation AI. In this embodiment, when the image generation AI generates the equipment image 36, the image generation unit 214 instructs the terminal device 10, which has received an input operation to instruct the creation of equipment, to display the generated equipment image 36. Based on this instruction, the control unit 110 of the terminal device 10 displays the generated equipment image 36 on the display unit 18, as shown in Figure 3. The control unit 110 also displays a purchase button 37 on the display unit 18, along with the generated equipment image 36, as a UI that accepts an operation to instruct the user to purchase the equipment. The operation reception unit 111 accepts the user's operation on the purchase button 37 as an input operation instructing the user to purchase the equipment shown in the generated equipment image 36. Based on this instruction, the game control unit 212 provides the user with the equipment shown in the generated equipment image 36. Specifically, based on the instruction, the game control unit 212 stores the equipment shown in the generated equipment image 36 in the storage unit 220 as an item owned by the user. The game control unit 212 also causes the user to pay the price for purchasing the equipment based on the instruction. Specifically, based on the instruction, the game control unit 212 reduces a predetermined value owned by the user (e.g., in-game currency) by the amount of the price. Thus, in this embodiment, the user can acquire the equipment shown in the equipment image 36 generated by the image generation AI by consuming a predetermined value owned by the user. Alternatively, the user may acquire the equipment shown in the equipment image 36 generated by the image generation AI by consuming one or more items as predetermined value owned by the user. In other words, acquiring the equipment shown in the equipment image 36 generated by the image generation AI may be done by purchasing the equipment with in-game currency or other payments, or by consuming items owned by the user within the game (e.g., through synthesis). Furthermore, the consumption of a predetermined value related to the acquisition of equipment may be performed before or after the generation of the equipment image 36 by the image generation AI.For example, when an operation is performed on the create button 33, the game control unit 212 may, based on that operation, reduce a predetermined value owned by the user by the amount of the purchase price of the equipment, and the image generation unit 214 may then have the image generation AI perform the generation of an image 36 of the equipment.

[0055] The equipment features that the user can input may include, for example, features related to the shape or color of the equipment. Furthermore, input of at least some (in other words, some or all) of the equipment features may be performed by operations such as entering a string or selecting a specific option from multiple choices. That is, since generating AI that generates images based on string input is publicly known, the generation of equipment images may be performed using this type of AI. Specifically, for example, the operation reception unit 111 may accept an input operation from the user to enter a string describing the equipment features when the equipment creation screen 30 is displayed. Also, as shown in Figure 4, the equipment creation screen 30 may display a feature entry field 38 as a UI for accepting the input operation to enter the string. The image generation unit 214 may then have the image generation AI generate an image 36 of the equipment that reflects the equipment features entered by the user based on the string. Specifically, for example, if the user inputs "a blue sword with a star motif" as a string describing the characteristics of the equipment, the image generation unit 214 may input a prompt to the image generation AI instructing it to generate an image of "a blue sword with a star motif," and have it generate an image 36 of the equipment. Alternatively, if the user draws an image diagram 32 of the equipment and inputs "blue" as a string describing its characteristics (or if the user selects blue from several color options presented to the user), the image generation unit 214 may input the image diagram 32 created by the user and a prompt to the image generation AI instructing it to generate an image of the "blue" equipment, and have it generate an image 36 of the equipment.

[0056] In this embodiment, the image diagram 32 used to generate the equipment image 36 includes a character image 40 and an equipment image 41 drawn by the user, as shown in Figure 3. In other words, on the equipment creation screen 30, the user creates the image diagram 32 by drawing their imagined equipment onto the character image 40 displayed on the screen. The image generation unit 214 causes the image generation AI to generate an equipment image based on the image diagram 32. The image generation AI processes the area corresponding to the equipment without processing the part of the image diagram 32 corresponding to the character (in other words, by drawing the equipment image onto the image diagram 32), thereby generating the equipment image 36 without generating the character image 40. In other words, in this embodiment, the input image input to the image generation AI and the output image output by the image generation AI are both a single image containing a portion corresponding to a character (in other words, an image corresponding to a character) and a portion corresponding to equipment (in other words, an image corresponding to equipment). The portion corresponding to the character is the same in both the input and output images, while the portion corresponding to the equipment differs between the input and output images. It should be noted that AI capable of recognizing predetermined objects contained in a specific image (for example, the portion corresponding to a character in image 32) is publicly known, and generating AI that generates an image by processing other parts without processing predetermined parts in a specific image (for example, a portion specified by the user, a portion specified in advance by the game operator, or a range determined by the computer based on predetermined conditions) is also publicly known. The generation of the equipment image 36 based on image 32 may be performed using this type of AI. The image generation unit 214 may also have the AI ​​specify the range of image 32 used as the source image for generating images of accompanying objects, and the range of image generation AI that should be processed and the range that should not be processed. Furthermore, the AI ​​that identifies the areas to be processed and the areas that should not be processed may be the same AI as the image generation AI, or it may be a different AI.

[0057] Furthermore, the image diagram 32 used to generate the equipment image 36 may not include the character image 40. In other words, the image generation unit 214 may input an image diagram 32 of the equipment that does not include the character image 40 to the image generation AI and have it generate the equipment image 36 based on the image diagram 32. In other words, the image generation unit 214 may input only the user-drawn equipment image 41 from the character image 40 shown in Figure 3 to the image generation AI and have it generate the equipment image 36 based on the image diagram 32 (in other words, the user-drawn equipment image 41).

[0058] Furthermore, when the image generation unit 214 has the image generation AI generate images of accompanying objects attached to a specific object, it may also have the AI ​​generate images that correspond to the characteristics of the specific accompanying object. Specifically, when the image generation unit 214 has the AI ​​generate images 36 of equipment, it may also have the AI ​​generate images that correspond to the characteristics of the character wearing the equipment. The characteristics of a specific object may be, for example, characteristics related to the gender, physique, race (e.g., human, monster, robot, etc.), or occupation (e.g., warrior, mage, cleric, etc.) of the specific object, or they may be physical characteristics (in other words, characteristics related to appearance).

[0059] The generation of images corresponding to the characteristics of a specific object can be performed as follows: When the image generation unit 214 causes the image generation AI to generate an image based on at least one of the image diagram 32 and a string indicating the characteristics of the equipment entered by the user, it may also input information indicating the characteristics of the character into the image generation AI, thereby causing the image generation AI to generate an image 36 of the equipment corresponding to the characteristics of the character.

[0060] Specifically, for example, when the image generation unit 214 instructs the image generation AI to generate an image of equipment 36 based on an image diagram 32 which includes an image of a character 40 and an image of equipment 41 drawn by the user, the image generation unit 214 may instruct the image generation AI to generate an image of equipment 36 that corresponds to the characteristics of the character image 40 included in the image diagram 32 (in other words, an image that suits the character). In other words, the image generation unit 214 may input the character image 40 and the image of equipment 41 drawn by the user to the image generation AI and generate an image of equipment 36 that corresponds to the characteristics of the character image 40. In this embodiment, the character image 40 and the image of equipment 41 drawn by the user are input to the image generation AI as a single image (that is, a single image including the part of the equipment drawn by the user and the part of the character not drawn by the user), and the image generation AI generates the image of equipment 36 by processing this single image. However, the character image 40 and the image of equipment 41 drawn by the user may be input to the image generation AI individually. The image generation AI may then refine the image 41 of the equipment drawn by the user, adjusting it to match a pre-prepared image 40 of a character separate from the image 41 (for example, to make it look like the character, and to ensure that the style of the drawing matches the image 40 of the character).

[0061] Furthermore, when the image generation unit 214 instructs the image generation AI to generate an image 36 of equipment based on at least one of the image diagram 32 and a string indicating the characteristics of the equipment entered by the user, it may also input a string indicating the characteristics of a character to the image generation AI and instruct the image generation AI to generate an image 36 of equipment corresponding to the characteristics of the character. That is, for example, if the character used by the user is a muscular female warrior and the user is creating equipment for that character, when the user draws an image diagram 32 and operates the create button 33, the image generation unit 214 may input a prompt to the image generation AI along with the image diagram 32 instructing it to generate an image of "equipment suitable for a muscular female warrior," and cause the image generation AI to generate an image 36 of equipment corresponding to the image diagram 32, which is an image 36 of "equipment suitable for a muscular female warrior." Note that the string indicating the characteristics of the character input to the image generation AI may be automatically determined by the image generation unit 214 according to the characteristics of the character, or it may be determined based on user input (for example, input into a predetermined input field).

[0062] Furthermore, it may be possible to create equipment by having the image generation AI generate an image 36 of the equipment without drawing an image diagram 32 (in other words, without inputting the characteristics of the equipment). For example, if the user operates the create button 33 without drawing an image diagram 32, the image generation unit 214 may input information indicating the characteristics of the character (for example, an image of the character or a string indicating the characteristics of the character) to the image generation AI and generate an image 36 of the equipment corresponding to the characteristics of the character. That is, the image generation AI may generate an image 36 of the equipment not by refining the image diagram 32 created by the user, but from a state where there is no rough sketch or anything like that (in other words, a state where there is no image related to the equipment). In such a configuration, the image generation unit 214 may input information about the characteristics of the equipment entered by the user by inputting a string, in addition to the information indicating the characteristics of the character, to the image generation AI and generate an image 36 of the equipment corresponding to the characteristics of the character, in which the characteristics of the equipment entered by the user are reflected. Furthermore, in cases where it is possible to create equipment by having the image generation AI generate an image 36 of the equipment without drawing an image diagram 32 (in other words, without inputting the characteristics of the equipment), the image generation unit 214 may have the image generation AI generate the image 36 of the equipment without inputting information indicating the characteristics of the character.

[0063] Furthermore, the generation of images of associated objects attached to specific objects can also be used in game development. For example, games that add new equipment after release (in other words, after the service starts) are well known. In this type of game, the image generation unit 214 may, based on predetermined operations by the game developer or automatically at a predetermined timing, cause the image generation AI to generate images 36 of the equipment, and add the equipment shown in the generated equipment image 36 as new equipment (in other words, register it in the storage unit 220 as equipment that the user can acquire).

[0064] (modified version) Image generation by the image generation AI does not have to be related to the creation of equipment. For example, the image generation unit 214 may have the image generation AI generate images of associated objects attached to a specific object during the progress of a predetermined event that proceeds using that specific object. The predetermined event may involve controlling a player character as a specific object to achieve a predetermined goal. Specifically, this could be an event where the player character aims to defeat a predetermined opponent, reach a predetermined destination, or acquire a predetermined object. In other words, the predetermined event could be a quest in the game. The predetermined event could also be a video stream (e.g., live stream). In this case, the stream, which proceeds as a predetermined event using a character as a specific object (in other words, an avatar), can be viewed by users of the predetermined service. That is, the server 20 may function as a server that provides a video streaming service. Such streams viewable by users may be streams performed by other users, or streams performed by service providers such as game operators.

[0065] An example of image generation by an image generation AI during the progress of a predetermined event will be explained with reference to Figure 5. Figure 5 is a diagram showing an example of an image displayed on the display unit 18 during the progress of an event (hereinafter referred to as "event-related image 50"). The event-related image 50 includes an image 51 of a specific object used by the user (specifically, a character) and an image 52 of an associated object (specifically, equipment) attached to that specific object. During the progress of the event, the image generation unit 214 inputs the source image 54, which will be the basis for the event-related image 50, to the image generation AI and causes it to generate the event-related image 50. For example, the image generation unit 214 causes the image generation AI to generate the event-related image 50 shown in Figure 5(c) based on the source image 54 shown in Figures 5(a) and 5(b).

[0066] The source image 54 includes an image 51 of a specific object. In other words, the source image 54 has a portion corresponding to a specific object. The image generation unit 214 causes the image generation AI to generate an image 52 of an associated object based on the source image 54. However, the image generation AI does not process the portion of the source image 54 corresponding to the specific object, and instead adds the image 52 of the associated object to the source image 54 (in other words, processes other predetermined portions), thereby generating the image 52 of the associated object without generating the image 51 of the specific object. The source image 54 may also include an image showing an outline of the associated object. In other words, the source image 54 may have a portion showing an outline of the associated object. Specifically, the source image 54 exemplified in Figures 5(a) and 5(b) may include a character's face as well as a rough sketch of equipment, etc. Furthermore, the source image 54 does not have to have a portion related to an associated object.

[0067] For example, the image generation unit 214 may input a source image 54, which includes a portion corresponding to a specific object and a portion showing the outline of an associated object, to an image generation AI that generates a cleaned-up image based on a rough sketch. The AI ​​may then leave the portion of the source image 54 corresponding to the specific object unprocessed, while having the portion showing the outline of the associated object cleaned up, thereby generating the event-related image 50. Alternatively, the image generation unit 214 may input a source image 54, which includes a portion corresponding to a specific object but does not include a portion showing the outline of an associated object, to the image generation AI. The AI ​​may then leave the portion of the source image 54 corresponding to the specific object unprocessed, while having the AI ​​add an image 52 of the associated object to the portion of the source image 54, thereby generating the event-related image 50. Note that cleaning up the portion showing the outline of an associated object in the source image 54 can also be considered adding an image 52 of the associated object to the source image 54.

[0068] Furthermore, when the image generation unit 214 has the image generation AI generate an image 52 of an associated object attached to a specific object, it may also generate an image corresponding to the state of the specific associated object. Specifically, when the image generation unit 214 has the image generation AI generate an image 52 of an equipment item, it may also generate an image corresponding to the state of the character equipping the equipment (for example, a state that changes during the progress of an event).

[0069] The generation of images corresponding to the state of a specific object can be performed as follows. For example, the image generation unit 214 may cause the image generation AI to generate an image 52 of an associated object corresponding to the state of the specific object while an event is being executed in which the state of the specific object may change. Here, the state of the specific object may be the state of the parameters of the specific object that may change during the progress of the event. Specifically, if the event is an event in which a player character and an enemy character fight, the state of the specific object may be the state of parameters such as the player character's health value and magic power value. Furthermore, the state of the specific object may also be the state of the appearance of the specific object that may change during the progress of the event. Specifically, if the event is an event in which a player character and an enemy character fight, the state of the specific object may be the state of scratches or dirt on the player character's face.

[0070] Specifically, the image generation unit 214 may input the source image 54 to the image generation AI and instruct the image generation AI to generate an image 52 of an associated object corresponding to a specific object contained in the source image 54, thereby causing the AI ​​to generate an image 52 of an associated object corresponding to the state of the specific object. That is, for example, when the AI ​​is to generate an image 52 of an associated object corresponding to the appearance state of a specific object, if the appearance state of the specific object changes as the event progresses, the generated image of the associated object will correspond to the appearance state of the specific object by instructing the AI ​​to generate an image 52 of an associated object corresponding to a specific object contained in the source image 54. More specifically, for example, as shown in Figures 5(a) and 5(b), multiple source images 54 with different appearance states of a specific object are stored in the storage unit 220 in advance. The image generation unit 214 may then decide which of the multiple source images 54 with different appearance states to input to the image generation AI according to the status of the event, and input the decided source image 54 to the image generation AI to generate the image 52 of the associated object. Alternatively, the image generation unit 214 may use the image currently displayed on the display unit 18 as the source image 54. In other words, even in conventional games and video streaming, the appearance of a character may change according to the progress of an event. By inputting the image of the character currently displayed on the screen (or scheduled to be displayed immediately afterward) as the source image 54 into the image generation AI at each timing during the event, images 52 of accompanying objects corresponding to the appearance can be generated.

[0071] Furthermore, the image generation unit 214 may input the original image 54 to the image generation AI, as well as a string corresponding to the state of a specific object contained in the original image 54, and generate an image by adding an image 52 of an associated object to an image 51 of the specific object contained in the original image 54, based on the string. In other words, for example, when generating an image 52 of an associated object corresponding to the state of a specific object, the image generation unit 214 may input a string corresponding to the state of the parameter along with the original image 54 to the image generation AI, and instruct the image generation AI to add an image 52 of an associated object corresponding to the string to the original image 54, so that the generated image 52 of the associated object corresponds to the state of the specific object (even if the same original image 54 is input regardless of the state of the specific object). Specifically, when having the AI ​​generate images of equipment corresponding to the player character's health status, if the health value is decreasing due to an attack from an enemy character, the image generation AI may be instructed to add an image of equipment appropriate for the decreased health status to the original image 54, along with a string indicating that the health value is decreasing, along with the original image 54. Alternatively, if the health value is decreasing due to an attack from an enemy character, the image generation AI may be instructed to add an image of the damaged equipment to the original image, along with a string indicating that the equipment is damaged by the attack, along with the original image 54.

[0072] The image generation unit 214 may automatically (in other words, at predetermined timings (for example, periodically)) have the image generation AI perform the generation of event-related images 50, or it may perform the generation of event-related images based on predetermined operations by the user. For example, the operation reception unit 111 can receive operations related to changing a character's equipment during the event, and the image generation unit 214 may have the image generation AI perform the generation of event-related images 50 based on such operations.

[0073] In this way, the image generation unit 214 causes the AI ​​to generate images of a specific object and associated objects that are displayed on a single screen in the terminal device 10. However, the terminal device 10 does not have to be a terminal device used by a game player. For example, the terminal device 10 may be a terminal device used by a game developer, a terminal device used by a viewer watching a video stream, or a terminal device used by a video streamer. In other words, the screen may be a screen related to game development, or a screen related to video viewing or streaming.

[0074] (Processing related to the generation of images of associated objects) Next, referring to Figure 6, we will explain an example of the process involved in generating images of associated objects attached to a specific object.

[0075] First, the image generation unit 214 decides to execute image generation by the image generation AI when predetermined conditions are met (step S101). The predetermined conditions are met, for example, when a predetermined input operation is performed by the user. Specifically, the predetermined conditions may be met, for example, when a user inputs an operation to instruct the creation of equipment on the equipment creation screen 30. In addition, in a configuration in which image generation by the image generation AI is performed during the progress of an event, the predetermined conditions may be met when a predetermined event occurs during the event. Furthermore, the predetermined conditions may be met when a predetermined timing is reached during the progress of an event.

[0076] When it is decided to execute image generation by the image generation AI, the image generation unit 214 inputs input information to be used for generating images 36 and 52 of the associated objects into the image generation AI, and causes the AI ​​to execute the generation of images 36 and 52 of the associated objects based on the input information (step S102). The input information may include, for example, the image diagram 32 or the original image 54. The input information may also include information about the characteristics or state of a specific object. Furthermore, the input information may include information about the characteristics of an object entered by the user.

[0077] Next, the image generation unit 214 acquires (in other words, receives) the images 36 and 52 of the accompanying objects generated by the image generation AI (step S103).

[0078] Next, the image generation unit 214 displays the images 36 and 52 of the accompanying object generated by the image generation AI and the image of the specific object to which this accompanying object is associated on the display unit 18 of the terminal device 10 (in other words, on a single screen) (step S104). Specifically, the image generation unit 214 transmits the images 36 and 52 of the accompanying object generated by the image generation AI to the terminal device 10. The control unit 110 of the terminal device 10, upon receiving the images 36 and 52 of the accompanying object, displays the images 36 and 52 of the accompanying object and the image of the specific object to which this accompanying object is associated on the display unit 18. Here, the image generation unit 214 may transmit the images generated by the image generation AI to the terminal device 10 as they are, or it may transmit the images generated by the image generation AI to the terminal device 10 as part of a composite image created by combining the images with other images (for example, images of the specific object). Furthermore, the control unit 110 of the terminal device 10 may display the composite image on the display unit 18, thereby displaying the images 36, 52 of the associated object and the image of the specific object to which this associated object is associated on the display unit 18. Alternatively, the image output by the image generation AI may itself include the images 36, 52 of the associated object and the image of the specific object to which this associated object is associated. Also, the image of the specific object displayed together with the images 36, 52 of the associated object does not have to be sent from the control unit 210 at the same time as the images of the associated object. The control unit 110 of the terminal device 10 may combine the image of the specific object sent from the control unit 210 at a first timing (or an image of the specific object pre-stored in the storage unit 120) with the image of the associated object sent from the control unit 210 at a second timing, and display the composite image on the display unit 18. In other words, the control performed by the information processing system 1 only needs to result in the images 36, 52 of the associated object generated by the image generation AI and the image of the specific object to which this associated object is associated being displayed on a single screen. The images of the specific objects here are not generated by image generation AI.

[0079] [Second Embodiment] Next, a second embodiment of the present invention will be described. The information processing system 1 of the second embodiment may adopt the contents described in the first embodiment to the extent that it does not cause a contradiction. For example, the information processing system 1 of the second embodiment may include some or all of the components of the information processing system 1 of the first embodiment. In the following, the matters described in the first embodiment will be omitted or simplified.

[0080] The image generation unit 214 may cause a predetermined AI to generate an image triggered by a specific object performing a specific movement (in other words, motion), and display the image generated by the predetermined AI on a predetermined display means. For example, the image generation unit 214 may cause a predetermined AI to generate an image triggered by a specific movement of a predetermined character displayed on the display unit 18 of the user's terminal device 10, and display the image generated by the predetermined AI on the display unit 18 of the user's terminal device 10. In this case, the image generation unit 214 may display the image generated by the predetermined AI together with the predetermined character on the display unit 18. The specific object may be a character (including avatars, etc.), or an object in the virtual space other than a character (in other words, an object existing in the virtual world). The specific object may also be an object operated by the user (for example, a character). The specific movement may be any movement including running, jumping, singing, eating, performing specific attacks or defenses, changing clothes, moving hands and feet, moving, falling, etc. In other words, a specific movement may be a specific motion of a character. Furthermore, in the following, the specified AI will be referred to as the image generation AI. The image generated by the image generation AI will be called the output image. The image input to the image generation AI for generating the output image will be called the input image.

[0081] The output image may be a background image, an image of an object that makes up the background, or an image of an object used by a specific object. In other words, the output image may be an image of an object surrounding a specific object (for example, a character). In other words, the output image may be an image used to create a predetermined effect when combined with a specific object.

[0082] The image generation unit 214 causes the image generation AI to generate an output image when a specific object displayed on the display unit 18 on the user's terminal device 10 performs a specific movement. The image generation unit 214 also sends this output image to the terminal device 10 and displays it on the display unit 18. Specifically, the image generation unit 214 displays this output image together with the specific object on the display unit 18. That is, the control unit 110 of the terminal device 10 displays the received output image on the terminal device 10. In this embodiment, the image generated by the image generation AI is displayed on the display unit 18 together with the specific object. That is, a predetermined effect is performed on the display unit 18 by combining the output image and the specific object, and this predetermined effect is visible to the user. In other words, according to the technology of this embodiment, when a character performs a specific movement on the screen viewed by the user, an effect in which the output image generated by the image generation AI appears on the screen can be realized. Specifically, when a character performs a specific movement on the screen viewed by the user, the image generation AI generates a background image for the character (in other words, an image of the objects surrounding the character), and the background image of the character switches to the image generated by the image generation AI. It should be noted that the output image generated by the image generation AI does not necessarily have to be displayed on the display unit 18 along with the specific object. That is, for example, when a character performs a specific movement on the screen viewed by the user, and the output image generated by the image generation AI appears on that screen, the character can disappear from the screen and the output image can appear in its place.

[0083] In this way, the image generation unit 214 may cause the image generation AI to generate an output image triggered by a specific movement of a character displayed on the display unit 18 on the user's terminal device 10, and display the output image generated by the image generation AI on the display unit 18. However, the character does not have to be a character operated by the user. For example, the user could be a viewer of a video stream (e.g., a live stream), and the character could be a character appearing in the video stream. In other words, the image generation unit 214 may control the image generation AI to generate an output image triggered by a specific movement of a character displayed on the display unit 18 on the viewer's terminal device 10, and display the output image generated by the image generation AI on the display unit 18.

[0084] The generation of an image triggered by a specific object performing a specific movement may also be triggered by an AI capable of detecting a specific movement of a specific object detecting that movement. Alternatively, the generation of an image triggered by a specific object performing a specific movement may also be triggered by a user performing a predetermined operation that causes the specific object to perform a specific movement.

[0085] Specifically, AI capable of detecting specific movements of specific objects in an image (in other words, in a video) (for example, when such a specific object jumps) (hereinafter referred to as "detection AI") is publicly known. The image generation unit 214 may input the image displayed on the display unit 18 (in other words, the currently displayed image) to this type of AI and have it detect specific movements of specific objects. In other words, the image generation unit 214 may have the detection AI detect specific movements of a specific object (in other words, a specific object in the image displayed on the display unit 18) during the progress of a predetermined event. When the detection AI detects specific movements of a specific object, the image generation unit 214 may have the image generation AI generate an image. The detection AI and the image generation AI may be the same AI or different AIs.

[0086] Furthermore, as is well known, in games and the like, users can make characters perform specific movements through predetermined operations. Specifically, in games and the like, there are defined operations for making the player character jump, or operations for making the player character run, and the player character moves according to the operations. When the operation reception unit 111 receives a user operation to make a specific object perform a specific movement, the image generation unit 214 may cause the image generation AI to generate an image based on that operation.

[0087] Furthermore, the generation of an image triggered by a specific movement of a specific object may be performed after the specific movement of the specific object has occurred in the display unit 18, or it may be performed after the specific movement has been confirmed in the display unit 18 but before the specific movement occurs. That is, for example, when the AI ​​detects a specific movement of a specific object from a video displayed in the display unit 18 and generates an output image, the system may be configured to detect the specific movement of the specific object before the scene in the video in which the specific movement of the specific object occurs is displayed in the display unit 18, or it may be configured to detect the specific movement of the specific object after the scene in the video in which the specific movement of the specific object occurs is displayed in the display unit 18. Specifically, for example, the image generation unit 214 may input the video to the detection AI in advance of playback of the video in the display unit 18, and have the detection AI detect the specific movement in advance of display in the display unit 18. Furthermore, when generating an image based on a predetermined operation performed by a user to make a specific object perform a specific movement, the generation of the output image by the image generation AI may be performed after the predetermined operation is performed but before the display of the specific object performing the specific movement is displayed on the display unit 18, or the generation of the output image by the image generation AI may be performed after the display of the specific object performing the specific movement is displayed on the display unit 18.

[0088] The image generation unit 214 inputs the necessary input information for image generation to the image generation AI and causes it to generate an output image. The input information may or may not include an input image. In other words, the image generation unit 214 may cause the image generation AI to generate an output image based on a predetermined input image, or it may cause it to generate an output image without providing an input image. For example, there is a known generation AI that can generate an output image based on a prompt such as "Please generate a background image to use in a game" or "Please generate a background image to use in video streaming" (in other words, without requiring an input image). The image generation unit 214 may input such a prompt as input information to the image generation AI and cause it to generate an output image.

[0089] Furthermore, the image generation unit 214 may cause the image generation AI to generate output images corresponding to the movement of a specific object. For example, when a character runs, an image of a grassland may be generated as the output image; when a character sings, an image of a stage or microphone may be generated as the output image; and when a character eats something, an image of a restaurant or food may be generated as the output image. In this way, output images corresponding to the movement may be generated by the image generation AI. Regarding the generation of output images corresponding to the movement of a specific object, the theme (in other words, the outline) of the output image may be determined by the image generation AI, or the image generation unit 214 may instruct the image generation AI. That is, the determination of what kind of output image is appropriate for various movements of the player character (for example, the determination that "an image of a grassland is appropriate" for running, or the determination that "an image of a restaurant is appropriate" for eating) may be performed by the image generation AI, or by an AI other than the image generation AI. Furthermore, the memory unit 220 has pre-registered correspondences between the type of movement and the theme (in other words, the outline) of the output image, such as an image of a grassland for running movements and an image of a restaurant for eating movements. When the image generation unit 214 identifies the type of movement of a particular object based on detection by the detection AI or user operation, it may instruct the image generation AI to generate an output image that conforms to the theme corresponding to the identified type of movement.

[0090] For example, the image generation unit 214 may input an image displayed on the display unit 18 (in other words, an image in which a specific object moves) as an input image to the image generation AI, and instruct the image generation AI to generate an output image (for example, a background image) corresponding to the movement of a specific object in the input image. An image generation AI that generates an output image corresponding to the movement of a specific object in the input image can also be generated, for example, by providing a machine learning model with a combination of the movement of a specific object and the answer for the output image as training data. Alternatively, an image generation AI that generates an output image corresponding to the movement of a specific object in the input image can also be generated, for example, by providing a machine learning model with an image of an object performing a specific movement and with a background drawn as training data. The image generation AI generated in this way can simultaneously perform the detection of a specific movement by a specific object in the input image, the determination of a theme suitable for that specific movement, and the generation of an output image suitable for that specific movement.

[0091] Furthermore, for example, the image generation unit 214 may determine a theme (in other words, an outline) for the output image in accordance with the specific movement of a specific object identified based on detection by the detection AI or user operation, and instruct the image generation AI to generate an output image with the determined theme. The image generation unit 214 may also determine the theme of the output image based on the correspondence between pre-registered movement types and themes. That is, the image generation unit 214 may determine a theme that has been pre-set as a theme corresponding to a specific movement as the theme of the output image. Alternatively, the image generation unit 214 may instruct a predetermined AI to propose a theme suitable for a specific movement, and determine the proposed theme as the theme of the output image.

[0092] Furthermore, the image generation unit 214 may cause the image generation AI to generate an image corresponding to the appearance of a specific object. For example, if the character's equipment (in other words, clothing) is a swimsuit, a beach background image may be generated as the output image, and if the player character's equipment is a school uniform, a school background image may be generated as the output image. In this way, the image generation AI may generate output images corresponding to the appearance of a specific object.

[0093] For example, the image generation unit 214 may input information about the appearance of a specific object as input information to the image generation AI, and cause the image generation AI to generate an output image based on that information, thereby causing the image generation AI to generate an output image corresponding to the appearance of a specific object. Specifically, the image generation unit 214 may input an image showing the appearance of a specific object, such as a display image shown on the display unit 18, as input information to the image generation AI, and cause the image generation AI to generate an output image based on that input information, thereby causing the image generation AI to generate an output image corresponding to the appearance of a specific object. In other words, the image generation unit 214 may cause the AI ​​to detect the features of the appearance of a specific object, and cause the image generation AI to generate an output image corresponding to the detected features. The AI ​​that performs the detection of appearance features may be the same AI as the image generation AI, or it may be a different AI. Furthermore, the image generation unit 214 may input a string indicating the visual characteristics of a specific object displayed on the display unit 18 (for example, a string indicating that the object is wearing a swimsuit) as input information to the image generation AI, and cause the image generation AI to generate an output image based on said input information, thereby causing the image generation AI to generate an output image that corresponds to the appearance of a specific object. In this case, the image generation unit 214 may determine the string to input to the image generation AI according to the appearance of the specific object (for example, according to the equipment, etc.). For example, if a character as a specific object is wearing a swimsuit, the image generation unit 214 may input a prompt such as "Generate a background image for use in the game that is suitable for a character wearing a swimsuit" as input information to the image generation AI, and cause it to generate an output image.

[0094] (Processing related to image generation triggered by specific movements) Next, referring to Figure 7, we will explain an example of the process involved in generating an image triggered by a specific movement of a particular object.

[0095] First, the image generation unit 214 determines whether or not a specific movement exists for a specific object displayed on the display unit 18 of the terminal device 10 (step S201). Here, determining whether or not a specific movement exists may mean determining whether or not a specific object has performed a specific movement. Alternatively, determining whether or not a specific movement exists may mean determining whether or not a specific object will perform a specific movement in the future. For example, the image generation unit 214 may determine that a specific movement exists if a detection AI capable of detecting a specific movement of a specific object in the image displayed on the display unit 18 detects that specific movement. Alternatively, the image generation unit 214 may determine that a specific movement exists if a user input operation is performed to cause a specific movement to occur in that specific object.

[0096] If a specific object is performing a specific movement, the image generation unit 214 decides to execute image generation using the image generation AI (step S202).

[0097] When it is decided to execute image generation using the image generation AI, the image generation unit 214 inputs the necessary input information for generating the output image to the image generation AI and causes it to generate the output image (step S203).

[0098] Next, the image generation unit 214 acquires (in other words, receives) the output image generated by the image generation AI (step S204).

[0099] Next, the image generation unit 214 displays the output image generated by the image generation AI and the image of a specific object on the display unit 18 of the terminal device 10 (in other words, on a single screen) (step S205). For example, the image generation unit 214 displays the image of a character as a specific object and the background image generated by the image generation AI (in other words, an image of the objects surrounding the character) on a single screen.

[0100] Furthermore, the present invention is not limited to the embodiments described above, and can be implemented in various modified forms without departing from its essence. The technology described herein may also be applied to services other than games (in other words, applications). The technology described herein can also be used in the development process of services such as game production. Within the scope of the invention, the present invention allows for free combination of each component, modification of any component, substitution of any component, omission of any component, or addition of other components. Also, the processing flow described herein is merely an example, and the order and configuration of each process may differ. Furthermore, some processes described herein may not exist. In other words, the processing flow and specific decision processes may differ from those exemplified herein.

[0101] <Note> The configuration of this embodiment may, for example, be used to prepare images in an unconventional way and use them for providing services. Furthermore, the configuration of this embodiment may, for example, be used to improve entertainment value. The matters described in the above embodiments may also be described as follows (see appendix).

[0102] (Note 1-1) Computers, In a game, for a specific object displayed on a single screen and an associated object attached to that specific object, the AI ​​is not made to generate an image of the specific object, but rather the AI ​​is made to generate an image of the associated object. This is done by functioning as an image generation means (e.g., image generation unit 214). program. With this configuration, it is possible to have the AI ​​generate images for some of the multiple objects displayed on a single screen, while preventing the AI ​​from generating images for others. Therefore, for example, the burden of preparing images to be generated by the AI ​​can be reduced. Also, for example, images generated by the AI ​​can produce unexpected images compared to those prepared by humans, thereby improving the game's appeal. Furthermore, for example, it becomes possible to prepare images for use in the game in cases where the game developer cannot predict in advance what kind of images should be prepared. In addition, for example, by not having the AI ​​generate images for some objects, the game developer can create those images themselves, further improving the game's appeal.

[0103] (Appendix 1-2) The aforementioned specific object is an object operated by the player of the game, The aforementioned accompanying object is an accessory of the aforementioned specific object. The program described in Appendix 1-1. With this configuration, for example, the game creators can meticulously craft key elements such as characters, maintaining the game's world view while achieving the effects described in Appendix 1-1.

[0104] (Appendix 1-3) The AI ​​that generates the image of the associated object generates the image of the associated object by drawing the image of the associated object onto the original image, without processing the portion of the original image that contains the image of the specific object that is identified by the AI ​​and corresponds to the specific object identified by the AI. The program described in Appendix 1-1 or 1-2. With this configuration, for example, by preparing a single image in which a specific object is depicted, it is possible to create an image in which associated objects are added to this image.

[0105] (Appendix 1-4) The image generation means causes the AI ​​to generate images of the associated objects according to the characteristics of the specific object. The program described in Appendix 1-1 or 1-2. With this configuration, for example, the images of accompanying objects generated by AI can reflect the characteristics of specific objects.

[0106] (Appendix 1-5) The image generation means causes the AI ​​to generate images of the associated objects according to the state of the specific object. The program described in Appendix 1-1 or 1-2. With this configuration, for example, the state of a specific object can be reflected in the image of an accompanying object generated by AI.

[0107] (Appendix 1-6) The image generation means causes the AI ​​to generate an image of the accompanying object based on the characteristics of the accompanying object input by the game player. The program described in Appendix 1-1 or 1-2. With this configuration, the user can give instructions regarding the images of the associated objects that are generated.

[0108] (Note 2-1) Computers, The system functions as a control means (for example, an image generation unit 214) that causes the AI ​​to generate an image triggered by a specific movement of a specific object displayed on a predetermined display means, and controls the display of the AI-generated image on the predetermined display means. program. This configuration allows for unprecedented effects, such as displaying AI-generated images when a specific object performs a specific movement, thereby enhancing the service's appeal. Furthermore, the images displayed when a specific object performs a specific movement can be changed depending on the situation, further enhancing the service's appeal.

[0109] (Note 2-2) The control means causes the AI ​​to generate the image corresponding to the movement of the specific object. The program described in Appendix 2-1. With this configuration, for example, it becomes possible to have the AI ​​generate images that match the movement of a specific object.

[0110] (Appendix 2-3) The control means causes the AI ​​to generate the image corresponding to the appearance of the specific object. The program described in Appendix 2-1. With this configuration, for example, it becomes possible to have the AI ​​generate images that match the appearance of a specific object.

[0111] (Appendix 2-4) The image generated by the AI ​​is displayed on the predetermined display means along with the specific object. The program described in any one of the appendices 2-1 to 2-3. With this configuration, for example, it becomes possible to display an AI-generated image together with a specific object when that object performs a particular movement, which is an unprecedented visual effect.

[0112] (Appendix 2-5) The control means causes the AI ​​to generate the image when the AI, which is capable of detecting the specific movement of the specific object, detects the specific movement. The program described in any one of the appendices 2-1 to 2-3. With this configuration, for example, it is possible to determine from a given image that a specific object has performed a specific movement, and then have the AI ​​generate an image.

[0113] (Appendix 2-6) The control means causes the AI ​​to generate the image based on the user performing a predetermined operation to make the specific object perform the specific movement. The program described in any one of the appendices 2-1 to 2-3. With this configuration, for example, it becomes possible to generate images using AI at the appropriate timing without requiring the detection of specific movements of specific objects based on images or the like.

[0114] Furthermore, the problem-solving means configured in the above-mentioned program (for example, the configurations described in the appendix) can be adapted to devices, systems, methods, media, etc., as appropriate. [Explanation of symbols]

[0115] 1 Information processing system, 10 Terminal device, 11 Processor, 12 Memory, 13 Storage, 14 Communication IF, 15 Input / Output IF, 17 Input unit, 18 Display unit, 20 Server, 21 Processor, 22 Memory, 23 Storage, 24 Communication IF, 25 Input / Output IF, 110 Control unit, 111 Operation reception unit, 112 Transmit / receive unit, 113 Game control unit, 114 Display control unit, 120 Storage unit, 210 Control unit, 211 Transmit / receive unit, 212 Game control unit, 214 Image generation unit, 220 Storage unit

Claims

[Claim 1] Computers, In a game, with respect to a specific object displayed on a single screen and an associated object attached to the specific object, the image generation means functions to have the AI ​​generate images of the associated objects, rather than generating images of the specific object itself. The image generation means receives an image containing the specific object as input to the AI, thereby causing the AI ​​to generate images of the associated objects that correspond to the appearance of the specific object. program.

Images