Program

Abstract

Provided is a technology for preparing an image in a novel manner and enabling the same to be used in the provision of a service.　A program causes a computer to function as an image generation means configured so that, with respect to a specific object and an accompanying object that accompanies the specific object which are displayed on one screen in a game, the means does not cause AI to generate an image of the specific object, but causes AI to generate an image of the accompanying object.

Description

program

[0001] The present invention relates to a program.

[0002] AI capable of generating images is known (see, for example, Non-Patent Document 1).

[0003] “5 Recommended Sites for Generating AI Illustrations | A Thorough Explanation of the Steps and Tips for Automatic Generation!” [online] [Searched January 18, 2024], Internet <https: / / www.gmosign.com / media / work-style / ai-illust / >

[0004] Incidentally, in providing services such as games, various images are required.

[0005] An object of the present invention is to provide a technology that allows images to be prepared in a new way and used to provide services.

[0006] According to one embodiment of the present disclosure, a program is provided that causes a computer to function as an image generation means that causes an AI to generate an image of a specific object and an associated object associated with the specific object, the image of the specific object being displayed on one screen in a game, without causing the AI ​​to generate the image of the specific object.

[0007] According to the present invention, images can be prepared in a manner not previously possible and used to provide services.

[0008] 1 is a diagram showing a schematic configuration of an information processing system; FIG. 2 is a block diagram showing a functional configuration of an information processing system; FIG. 3 is a diagram for explaining image generation by AI based on an image diagram; FIG. 4 is a diagram for explaining image generation by AI based on a character string input by a user; FIG. 5 is a diagram for explaining image generation by AI while an event is in progress; FIG. 6 is a flowchart showing an example of processing related to image generation of an incidental object; FIG. 7 is a flowchart showing an example of processing related to image generation triggered by a specific object making a specific movement;

[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0010] First Embodiment <Hardware Configuration of System> As shown in FIG. 1, an information processing system 1 of this embodiment includes a plurality of terminal devices 10 and a server 20.

[0011] The terminal device 10 and the server 20 are connected via a network 2. The network 2 may be configured, for example, by the Internet, a mobile communication system (e.g., 3G, 4G, 5G, LTE (Long Term Evolution)), Wi-Fi (Wireless Fidelity), Bluetooth (registered trademark), other communication lines, or a combination of these. Furthermore, the connection between the terminal device 10 and the server 20 may be wired or wireless.

[0012] The server 20 (in other words, a computer, an information processing device) may be, for example, a general-purpose computer such as a workstation or a personal computer. The server 20 includes a processor 21, a memory 22, a storage 23, a communication IF (interface) 24, and an input / output IF 25. These components of the server 20 are connected to each other by a communication bus.

[0013] The processor 21 controls the overall operation of the server 20. The processor 21 may include a central processing unit (CPU), a micro processing unit (MPU), a graphics processing unit (GPU), etc. The processor 21 reads a program from the storage 23 and loads it into the memory 22. The processor 21 executes the loaded program.

[0014] The memory 22 is a main storage device. The memory 22 is configured by storage devices such as a read-only memory (ROM) and a random access memory (RAM). The memory 22 temporarily stores programs and various data read by the processor 21 from the storage 23, thereby providing a working area for the processor 21. The memory 22 also temporarily stores various data generated while the processor 21 is operating according to the programs.

[0015] In this embodiment, the program may be a program that realizes a game by the terminal device 10. The program may also be a program that realizes the game through cooperation between the terminal device 10 and the server 20. The game realized through cooperation between the terminal device 10 and the server 20 may, for example, be a game executed on a browser launched on the terminal device 10. The program may also be a program that realizes the game through cooperation between a plurality of terminal devices 10. The various data may include, for example, data related to the game, such as user information and game information, as well as instructions and notifications transmitted and received between the terminal device 10 and the server 20.

[0016] The storage 23 is an auxiliary storage device. The storage 23 is configured by a storage device such as a flash memory or a hard disk drive (HDD). The storage 23 stores various data related to the game.

[0017] The communication IF 24 controls the transmission and reception of various data between the server 20 and the terminal device 10 and the like via the network.

[0018] The input / output IF 25 is an interface through which the server 20 receives input of data and also an interface through which the server 20 outputs data. The input / output IF 25 may include, for example, an input unit that is an information input device such as a mouse or a keyboard, and a display unit that is a device that displays and outputs images.

[0019] The terminal device 10 (in other words, a computer or information processing device) may be, for example, a smartphone, a feature phone, a PDA (Personal Digital Assistant), a tablet computer, a personal computer, a wearable terminal, or a game device. The terminal device 10 may also be a mobile terminal. The terminal device 10 may also be a portable terminal that a user uses when playing a game.

[0020] The terminal device 10 includes a processor 11, a memory 12, a storage 13, a communication IF 14, an input / output IF 15, an input unit 17, and a display unit 18. These components of the terminal device 10 are connected to each other by a communication bus.

[0021] The processor 11 controls the overall operation of the terminal device 10. The processor 11 may include a CPU, an MPU, a GPU, etc. The processor 11 reads a program from the storage 13 and loads it into the memory 12. The processor 11 executes the loaded program.

[0022] The memory 12 is a main storage device. The memory 12 is configured by storage devices such as a ROM and a RAM. The memory 12 temporarily stores programs and various data that the processor 11 reads from the storage 13, thereby providing a working area for the processor 11. The memory 12 also temporarily stores various data that the processor 11 generates while operating according to the programs.

[0023] The storage 13 is an auxiliary storage device. The storage 13 is configured by a storage device such as a flash memory or an HDD. The storage 13 stores various data related to the game.

[0024] The communication IF 14 controls transmission and reception of various data between the terminal device 10 and the server 20 via the network.

[0025] The input / output IF 15 is an interface through which the terminal device 10 receives input of data and outputs data from the terminal device 10. The input / output IF 15 may input and output data via, for example, a Universal Serial Bus (USB) or the like. The input / output IF 15 may include an input unit 17, a display unit 18, or the like.

[0026] The input unit 17 accepts input from a user. The input unit 17 may be, for example, a pointing device such as a touchpad. The display unit 18 displays images. The display unit 18 may be, for example, a liquid crystal display or an organic electroluminescence (EL) display. The terminal device 10 includes, for example, a touch screen 16, which is an electronic component that combines the input unit 17 and the display unit 18.

[0027] The input unit 17 has a function of detecting a position input on the input surface by a user operation (for example, a touch operation, a tap operation, a slide operation, a swipe operation, a flick operation, etc.) and transmitting information indicating the detected position as an input signal. The touch panel serving as the input unit 17 may be of a capacitive type or a resistive type, or may be of another type.

[0028] The input unit 17 may be, for example, a keyboard, various physical buttons, various sensors (for example, an acceleration sensor, an angular velocity sensor, a magnetic sensor, a GPS sensor, a motion sensor, a gaze sensor, a bioelectric potential sensor, a fingerprint sensor, a breath sensor, a pressure sensor, or an image sensor), an operation stick, a camera, a microphone, etc. The display unit 18 may be, for example, a projector, etc.

[0029] 2 is a block diagram showing the functional configuration of the server 20 and the terminal device 10. Each of the server 20 and the terminal device 10 may include a functional configuration (not shown) required to function as a general computer, and a functional configuration required to realize well-known functions in a game.

[0030] In this embodiment, the server 20 identifies each user and the terminal device 10 using a user account that is registered in advance. The method of registering the account is not particularly limited. For example, the terminal device 10 or another device such as a personal computer may transmit information required for user account registration to the server 20 based on a user operation, and the server 20 may create and store an account for each user based on the received information.

[0031] The server 20 has a function of communicating with each terminal device 10 and supporting the terminal devices 10 in progressing through the game. If the game is a multiplayer game, the server 20 may have a function of communicating with each terminal device 10 participating in the game and mediating interactions between the terminal devices 10. The server 20 functions as a control unit 210 and a storage unit 220 through cooperation of the processor 21, memory 22, storage 23, communication IF 24, input / output IF 25, etc.

[0032] The storage unit 220 stores various data used by the control unit 210. Examples of the various data include programs, game information, and user information. The programs are programs for realizing the games. The game information and user information are data that the control unit 210 references when executing the programs.

[0033] Game information is data referenced by the control unit 210 or the control unit 110 when executing a program. Game information includes, for example, data such as images and sounds used in the game. User information is data managed for each user account. User information includes, for example, information about the character (hereinafter referred to as "player character") used by the user (in other words, controllable by the user), information about owned assets, and information indicating the progress of the game. Owned assets can be said to be value possessed by the user within the game (in other words, within the virtual space). Examples of such value (in other words, in-game value, owned assets) include electronic currency, items, and characters. Furthermore, examples of electronic currency include in-game currency that can be used within the game and crypto assets.

[0034] The control unit 210 controls various processes related to the game by executing programs stored in the storage unit 220. The control unit 210 includes, for example, a transmission / reception unit 211, a game control unit 212, and an image generation unit 214.

[0035] The transmitting / receiving unit 211 transmits or receives various types of data. For example, the transmitting / receiving unit 211 receives requests to transmit various types of data and programs, requests for synchronization processing to support the multiplay function, data to be subjected to synchronization processing, and the like from each terminal device 10, and passes them to the game control unit 212. The transmitting / receiving unit 211 also transmits various types of data and programs to each terminal device 10 in accordance with the control of the game control unit 212.

[0036] The game control unit 212 provides a game to the terminal device 10 by executing arithmetic processing described in a program in response to a request from the terminal device 10, etc.

[0037] The image generation unit 214 generates images to be used in the game. In other words, the image generation unit 214 generates images to be used in providing services. Specifically, the image generation unit 214 causes the AI ​​to generate images. The images that the image generation unit 214 causes the AI ​​to generate may be two-dimensional images or three-dimensional images (in other words, 3D models). Furthermore, the images that the image generation unit 214 causes the AI ​​to generate may be still images or moving images.

[0038] The terminal device 10 has, for example, a function as an input device that accepts input operations from the user, and a function as an output device that outputs images and sounds of the game.

[0039] The terminal device 10 functions as a control unit 110 and a storage unit 120 through cooperation of the processor 11, memory 12, storage 13, communication IF 14, input / output IF 15, etc. The storage unit 120 stores various data used by the control unit 110. The various data include, for example, programs, game information, and user information. The programs are programs for realizing games on the terminal device 10 side. The game information and user information are data referenced by the control unit 110 when executing the programs. The game information and user information stored in the storage unit 120 may include information similar to the game information and user information stored in the storage unit 220.

[0040] The control unit 110 executes a program stored in the storage unit 120 to control various processes related to the game executed on the terminal device 10. The control unit 110 includes, for example, an operation reception unit 111, a transmission / reception unit 112, a game control unit 113, and a display control unit 114.

[0041] The operation reception unit 111 receives operations (hereinafter also referred to as "input operations") input by the user via the input unit 17. Specifically, when an input operation is performed on the input unit 17, the operation reception unit 111 detects the coordinates of the input position and the type of input operation. Examples of the input operation include various operations performed with fingers, such as a touch operation, a tap operation, a slide operation, a swipe operation, a flick operation, a pinch-in operation, and a pinch-out operation. The input operation is not limited to an operation of physically contacting the input unit 17 (e.g., the touch screen 16) but may also include a non-contact operation. Note that an operation of ending a previously performed input operation, such as a touch-off operation that ends contact with the touch screen 16, can also be considered a form of input operation.

[0042] Here, the operation reception unit 111 can also receive input operations performed using an operation device connected via the input / output IF 15 in the same way as input operations to the input unit 17 .

[0043] The transmitting / receiving unit 112 transmits or receives various types of data. For example, the transmitting / receiving unit 112 transmits game information, user information, or a synchronization request for supporting a multi-play function to the server 20. The transmitting / receiving unit 112 also transmits operation information related to input operations accepted by the operation accepting unit 111 to the server 20. The transmitting / receiving unit 112 also receives various types of data and programs from the server 20.

[0044] The game control unit 113 executes various processes related to the progress of the game. The game control unit 113 identifies the user's instruction content based on the user's input operation detected by the operation reception unit 111. The game control unit 113 also executes various determination processes related to the progress of the game based on the identified instruction content, etc. The game control unit 113 also progresses the game while communicating with the server 20 based on the results of the determination processes, etc. The game control unit 113 also instructs the display control unit 114 to display an image corresponding to the progress of the game on the display unit 18.

[0045] The display control unit 114 displays images related to the game on the display unit 18. The display control unit 114 generates images to be displayed on the display unit 18 using various images stored in the storage unit 220 or the storage unit 120, various images generated by the image generation unit 214, and the like, and displays the images on the display unit 18. The various images include images of objects in the game (in other words, in the virtual space) (e.g., images of characters such as player characters, items, and backgrounds), as well as images related to the UI (User Interface) required for various game operations, such as icons, buttons, and menus showing various parameters. Note that the control unit 210 may perform some or all of the process of generating images to be displayed on the display unit 18 using various images.

[0046] Note that the functions of the terminal device 10 and the server 20 illustrated in FIG. 2 are merely examples. Each of the terminal device 10 and the server 20 may have at least some of the functions of the other device. In other words, the server 20 may have some or all of the functional blocks of the terminal device 10 in this embodiment, or the terminal device 10 may have some or all of the functional blocks of the server 20. Furthermore, each device, such as the terminal device 10 and the server 20, does not have to be realized by an integrated device, but may be realized, for example, by multiple devices connected via a network or the like. Furthermore, the information processing system 1 may be composed of, for example, only the terminal device 10 or the server 20. In other words, the information processing system 1 does not have to be realized by multiple devices connected via a network.

[0047] <Processing According to the Present Embodiment> Next, processing according to the present embodiment will be described. Note that in the present embodiment, the processor 11 of the terminal device 10 or the processor 21 of the server 20 executes a program stored in the information processing system 1 to perform each of the processes described below. However, at least a portion of the processing performed by the processor 11, which is described below, may be executed by a processor other than the processor 11. Furthermore, at least a portion of the processing performed by the processor 21, which is described below, may be executed by a processor other than the processor 21. In other words, the computer that executes the program in the present embodiment may be either the terminal device 10 or the server 20, or may be realized by a combination of multiple devices.

[0048] The image generation unit 214 does not have the AI ​​generate an image of a specific object and an accompanying object associated with the specific object displayed on one screen in a game, but has the AI ​​generate an image of the accompanying object. Here, the specific object may be an object operated by a user. The accompanying object may also be an accessory for the specific object. The specific object may be the face of a character (e.g., a player character), and the accompanying object may include the character's accessory or the character's body (e.g., limbs). In this embodiment, an example is described in which the specific object is the player character and the accompanying object is the player character's accessory. The AI ​​that generates the image of the accompanying object may be included in the information processing system 1, or may use an AI provided by an external service. Hereinafter, the AI ​​that generates the image of the accompanying object is referred to as the image generation AI. The accessory includes, for example, weapons, armor, clothing, or accessories worn by a character. The accessory also includes, for example, parts attached to a vehicle or aircraft as a specific object.

[0049] The game of this embodiment may be, for example, a role-playing game, an action game, a shooting game, a racing game, or the like, in which equipment is equipped to a specific object and the player fights against a predetermined opponent (here, the "opponent" may be another user, a non-player character, etc.). However, the technology according to this embodiment can also be applied to games other than games in which the player fights against a predetermined opponent in this way.

[0050] In the game of this embodiment, a user can purchase equipment for a player character from an in-game store. The user can also input characteristics of the equipment to be purchased and create and purchase it. In other words, the user can custom-make the equipment to be purchased. Note that if a user uses multiple characters (e.g., in a game in which the user progresses using a party consisting of multiple characters), the user may be able to select which of the multiple characters to create equipment for. The following describes an example in which equipment is created for a specific character used by the user. However, the technology described below can also be applied to a configuration in which equipment is created without specifying the target character.

[0051] An example of an equipment creation screen 30 as a screen for creating equipment is shown in Figure 3. The display control unit 114 causes the display unit 18 to display the equipment creation screen 30 during game play (for example, based on the player character visiting a shop within the game). The user can create equipment by performing a predetermined input operation on the equipment creation screen 30. The equipment creation screen 30 can also be considered a screen for inputting characteristics related to the equipment.

[0052] The equipment creation screen 30 allows the user to draw an image of the equipment (in other words, an original image) 32. The operation accepting unit 111 accepts an input operation by the user to draw the image of the equipment 32 while the equipment creation screen 30 is displayed on the display unit 18. Note that this input operation may be, for example, an operation of drawing a picture using a pointing device, as with well-known paint software, or the like. Alternatively, this input operation may be an operation of combining multiple parts prepared in advance to create the image 32. Furthermore, the equipment creation screen 30 displays a create button 33 as a UI that accepts an operation to instruct the creation of equipment. The operation accepting unit 111 accepts the user's operation on the create button 33 as an input operation to instruct the creation of equipment.

[0053] When an input operation for drawing an image 32 of the equipment and an input operation for instructing the creation of the equipment are performed, the image generation unit 214 causes the image generation AI to generate an image of the equipment based on the image. It should be noted that generation AIs that generate a cleaned-up image (i.e., an image depicting the attached objects in detail) based on a rough sketch (the original image in this embodiment, i.e., an image showing the outline of the attached objects) are well known, and the generation of an image of the equipment based on the image may be performed using this type of AI. In other words, the image generation unit 214 may input the image 32 to the image generation AI and cause it to generate an image 36 of the equipment based on the image 32 (e.g., an image of the cleaned-up image 32) (see FIG. 3 ). The equipment image 36 generated by the image generation AI reflects the features of the equipment in the image 32 created by the user. In other words, the image generation unit 214 causes the image generation AI to generate an image 36 of the equipment that reflects the features of the equipment input by the user.

[0054] The user can purchase the equipment represented by the equipment image 36 generated by the image generation AI. In this embodiment, when the equipment image 36 is generated by the image generation AI, the image generation unit 214 instructs the terminal device 10, which has received an input operation instructing the creation of the equipment, to display the generated equipment image 36. Based on this instruction, the control unit 110 of the terminal device 10 causes the display unit 18 to display the generated equipment image 36, as shown in FIG. 3 . The control unit 110 also causes the display unit 18 to display, together with the generated equipment image 36, a purchase button 37 as a UI for accepting an operation instructing the purchase of the equipment. The operation acceptance unit 111 accepts a user operation on the purchase button 37 as an input operation instructing the purchase of the equipment represented by the generated equipment image 36. Based on this instruction, the game control unit 212 provides the user with the equipment represented by the generated equipment image 36. Specifically, based on the instruction, the game control unit 212 stores the equipment represented by the generated equipment image 36 in the storage unit 220 as an item owned by the user. Furthermore, based on the instruction, the game control unit 212 causes the user to pay the price for the purchase of the equipment. Specifically, based on the instruction, the game control unit 212 reduces the user's possession of a predetermined value (e.g., in-game currency) by the amount of the price. As described above, in this embodiment, the user is able to acquire the equipment represented by the equipment image 36 generated by the image generation AI by consuming a predetermined value owned by the user. Note that the user may also be able to acquire the equipment represented by the equipment image 36 generated by the image generation AI by consuming one or more items owned by the user as the predetermined value. In other words, the equipment represented by the equipment image 36 generated by the image generation AI may be acquired by purchasing the equipment with payment of money or the like in the game, or by consuming items owned by the user in the game (e.g., by synthesis, etc.). Furthermore, the consumption of a predetermined value related to the acquisition of equipment may be performed before or after the image generation AI generates the image 36 of the equipment.For example, when an operation is performed on the creation button 33, the game control unit 212 may reduce the predetermined value owned by the user by the amount of the purchase price of the equipment based on the operation, and the image generation unit 214 may then cause the image generation AI to generate an image 36 of the equipment.

[0055] The equipment features that the user can input may be, for example, features related to the shape or color of the equipment. Furthermore, input of at least some (in other words, some or all) of the equipment features may be performed by inputting a string of characters or selecting a specific option from multiple options. That is, generation AI that generates an image based on an input of a string of characters is publicly known, and the generation of an equipment image may be performed using this type of AI. Specifically, for example, while the equipment creation screen 30 is displayed, the operation receiving unit 111 may receive an input operation by the user to input a string of characters describing the equipment features. Furthermore, as shown in FIG. 4 , the equipment creation screen 30 may display a feature entry field 38 as a UI that receives an input operation to input the string of characters. The image generation unit 214 may then cause the image generation AI to generate an equipment image 36 that reflects the equipment features input by the user based on the string of characters. Specifically, for example, if the user inputs "a blue sword with a star motif" as a string describing the characteristics of the equipment, the image generation unit 214 may input a prompt to the image generation AI instructing it to generate an image of "a blue sword with a star motif," and generate the equipment image 36. Furthermore, if the user draws an image 32 of the equipment and inputs "blue" as a string describing the characteristics (or if the user performs an operation to select blue from multiple color candidates presented to the user), the image generation unit 214 may input the image 32 created by the user and a prompt instructing it to generate an image of the "blue" equipment to the image generation AI, and generate the equipment image 36.

[0056] In this embodiment, the image 32 used to generate the equipment image 36 includes a character image 40 and an equipment image 41 drawn by the user, as shown in Figure 3. In other words, on the equipment creation screen 30, the user creates the image 32 by adding the equipment of their own imagination to the character image 40 displayed on the screen. The image generation unit 214 causes the image generation AI to generate an equipment image based on the image 32, but the image generation AI does not process the portion of the image 32 corresponding to the character, but processes the range corresponding to the equipment (in other words, by adding the equipment image to the image 32), thereby generating the equipment image 36 without generating the character image 40. In other words, in this embodiment, the input image input to the image generation AI and the output image output by the image generation AI are both a single image including a portion corresponding to a character (i.e., an image corresponding to the character) and a portion corresponding to equipment (i.e., an image corresponding to the equipment). The portion corresponding to the character is the same in the input image and the output image, while the portion corresponding to the equipment is different in the input image and the output image. AI capable of recognizing a specific object included in a specific image (e.g., a portion corresponding to a character in the image 32) is known. AI that generates an image by processing other portions of a specific image without processing a specific portion (e.g., a portion specified by a user, a portion specified in advance by a game operator, or a range determined by a computer based on predetermined conditions) is also known. The generation of the equipment image 36 based on the image 32 may be performed using this type of AI. The image generation unit 214 may also cause the AI ​​to determine the areas to be processed and the areas not to be processed by the image generation AI for the image 32 serving as the source image used to generate the image of the attached object. Furthermore, the AI ​​that identifies the areas to be processed and the areas not to be processed may be the same AI as the image generation AI, or it may be a different AI.

[0057] It should be noted that the image 32 used to generate the equipment image 36 may not include the character image 40. In other words, the image generation unit 214 may input the equipment image 32 that does not include the character image 40 to the image generation AI, and cause the image generation AI to generate the equipment image 36 based on the image 32. In other words, the image generation unit 214 may input only the equipment image 41 drawn by the user, of the character image 40 and the equipment image 41 drawn by the user shown in FIG. 3 , to the image generation AI, and cause the image generation AI to generate the equipment image 36 based on the image 32 (in other words, the equipment image 41 drawn by the user).

[0058] Furthermore, when the image generation unit 214 causes the image generation AI to generate an image of an associated object associated with a specific object, the image may be generated according to the characteristics of the associated specific object. Specifically, when the image generation unit 214 causes the AI ​​to generate an image 36 of equipment, the image may be generated according to the characteristics of the character equipped with the equipment. The characteristics of the specific object may be, for example, characteristics related to the gender, physique, species (e.g., human, monster, robot, etc.), or occupation (e.g., warrior, wizard, priest, etc.) of the specific object, or may be external characteristics (in other words, characteristics related to appearance).

[0059] The generation of an image according to the characteristics of a specific object can be performed as follows: That is, when the image generation unit 214 causes the image generation AI to generate an image based on at least one of the image diagram 32 and the character string indicating the characteristics of the equipment input by the user, the image generation unit 214 may input information indicating the characteristics of the character to the image generation AI, thereby causing the image generation AI to generate an image 36 of the equipment according to the characteristics of the character.

[0060] Specifically, for example, when the image generation unit 214 causes the image generation AI to generate an equipment image 36 based on an image 32 including a character image 40 and an equipment image 41 drawn by the user, the image generation unit 214 may instruct the image generation AI to generate an equipment image 36 that corresponds to the characteristics of the character image 40 included in the image 32 (in other words, that suits the character). In other words, the image generation unit 214 may input the character image 40 and the equipment image 41 drawn by the user to the image generation AI, and generate an equipment image 36 that corresponds to the characteristics of the character image 40. Furthermore, in this embodiment, the character image 40 and the equipment image 41 drawn by the user are input to the image generation AI as a single image (i.e., a single image including parts of the equipment drawn by the user and parts of the character not drawn by the user), and the image generation AI generates the equipment image 36 by processing this single image; however, the character image 40 and the equipment image 41 drawn by the user may each be input to the image generation AI separately. The image generation AI may then adjust and clean up the image 41 of the equipment drawn by the user so that it matches a pre-prepared image 40 of a character that is different from the image 41 (for example, so that it suits the character, and so that the drawing style, etc., matches the character image 40).

[0061] Furthermore, when the image generation unit 214 causes the image generation AI to generate an equipment image 36 based on at least one of the image 32 and a character string indicating the characteristics of the equipment input by the user, the image generation unit 214 may input a character string indicating the characteristics of the character to the image generation AI and instruct the image generation AI to generate an equipment image 36 corresponding to the character's characteristics. That is, for example, if the character used by the user is a muscular female warrior and the user creates equipment for the character, when the user draws the image 32 and operates the create button 33, the image generation unit 214 may input a prompt to the image generation AI along with the image 32, instructing the image generation AI to generate an equipment image 36 corresponding to the image 32, that is, an "equipment suitable for a muscular female warrior" image 36. Note that the character string indicating the characteristics of the character input to the image generation AI may be automatically determined by the image generation unit 214 according to the character's characteristics, or may be determined based on user input (e.g., input into a specified field).

[0062] It may also be possible to create equipment by having the image generation AI generate an equipment image 36 without drawing an image 32 (in other words, without inputting the equipment's characteristics). For example, when the user operates the create button 33 without drawing an image 32, the image generation unit 214 may input information indicating the character's characteristics (e.g., an image of the character or text indicating the character's characteristics) to the image generation AI, and generate an equipment image 36 corresponding to the character's characteristics. In other words, the image generation AI may generate the equipment image 36 from a state where a rough sketch or the like does not exist (in other words, a state where there is no image related to the equipment), rather than generating the equipment image 36 by clean-up of the image 32 created by the user. In such a configuration, the image generation unit 214 may input information about the equipment's characteristics input by the user through text input, in addition to information indicating the character's characteristics, to the image generation AI, and cause the image generation AI to generate an equipment image 36 corresponding to the character's characteristics, which reflects the equipment's characteristics input by the user. In addition, in cases where it is possible to create equipment by having the image generation AI generate an image 36 of the equipment without drawing an image diagram 32 (in other words, without inputting the characteristics of the equipment), the image generation unit 214 may have the image generation AI generate the image 36 of the equipment without inputting information indicating the characteristics of the character.

[0063] The generation of images of associated objects associated with such specific objects can also be used in game development. For example, games in which new equipment is added after release (in other words, after the start of service) are known. In this type of game, the image generation unit 214 may cause an image generation AI to generate an equipment image 36 based on a predetermined operation by the game creator or automatically at a predetermined timing, and add the equipment represented by the generated equipment image 36 as a new equipment (in other words, register it in the storage unit 220 as an equipment that can be acquired by the user).

[0064] (Variation) The image generation by the image generation AI does not have to be related to the creation of equipment. For example, the image generation unit 214 may cause the image generation AI to generate an image of an associated object associated with a specific object during the progress of a specific event using the specific object. The specific event may involve controlling a player character as a specific object to achieve a specific goal. Specifically, the specific event may involve controlling a player character to defeat a specific opponent, reach a specific destination, or obtain a specific objective. In other words, the specific event may be an in-game quest or the like. The specific event may also be a video broadcast (e.g., a live broadcast, etc.). In this case, a specific event broadcast using a character (e.g., an avatar, etc.) as a specific object in a specific service may be viewable by users of the specific service. In other words, the server 20 may function as a server providing a video broadcast service. Note that such a broadcast viewable by a user may be a broadcast provided by another user or a broadcast provided by a service provider such as a game operator.

[0065] An example of image generation by the image generation AI during the progress of a specific event will be described with reference to FIG. 5 . FIG. 5 is a diagram showing an example of an image (hereinafter referred to as an "event-related image 50") displayed on the display unit 18 during the progress of an event. The event-related image 50 includes an image 51 of a specific object (specifically, a character) used by the user and an image 52 of an associated object (specifically, equipment) associated with the specific object. During the progress of the event, the image generation unit 214 inputs an original image 54 that is the basis for the event-related image 50 into the image generation AI, causing the image generation AI to generate the event-related image 50. For example, the image generation unit 214 causes the image generation AI to generate the event-related image 50 illustrated in FIG. 5(c) based on the original image 54 illustrated in FIG. 5(a) or 5(b).

[0066] The original image 54 includes an image 51 of a specific object. In other words, the original image 54 has a portion corresponding to the specific object. The image generation unit 214 causes the image generation AI to generate an image 52 of an attached object based on the original image 54. However, the image generation AI does not process the portion of the original image 54 corresponding to the specific object, but instead adds the image 52 of the attached object to the original image 54 (in other words, processes other predetermined portions), thereby generating the image 52 of the attached object without generating the image 51 of the specific object. Note that the original image 54 may include an image showing an outline of the attached object. In other words, the original image 54 may have a portion showing an outline of the attached object. Specifically, the original image 54 illustrated in FIGS. 5( a) and 5(b) may include a rough sketch of equipment in addition to the character's face. Furthermore, the original image 54 may not have a portion related to the attached object.

[0067] For example, the image generation unit 214 may input an original image 54 including a portion corresponding to a specific object and a portion showing an outline of an associated object to an image generation AI that generates a cleaned-up image based on a rough sketch, and may cause the image generation AI to leave the portion of the original image 54 that corresponds to the specific object untouched and clean up the portion showing the outline of the associated object, thereby generating the event-related image 50. Furthermore, for example, the image generation unit 214 may input an original image 54 that includes a portion corresponding to a specific object but does not include a portion showing the outline of the associated object to the image generation AI, and may cause the image generation AI to leave the portion of the original image 54 that corresponds to the specific object untouched and add an image 52 of the associated object to the portion of the original image 54 that corresponds to the specific object, thereby generating the event-related image 50. Note that clean-up of the portion showing the outline of the associated object in the original image 54 can also be considered as adding an image 52 of the associated object to the original image 54.

[0068] Furthermore, when the image generation unit 214 causes the image generation AI to generate an image 52 of an associated object associated with a specific object, the image generation unit 214 may cause the image generation AI to generate an image according to the state of the associated specific object. Specifically, when the image generation unit 214 causes the image generation AI to generate an image 52 of an equipment item, the image generation unit 214 may cause the image generation AI to generate an image according to the state of the character equipped with the equipment item (for example, a state that changes during the progress of an event).

[0069] The generation of an image according to the state of a specific object can be performed as follows. For example, during the execution of an event in which the state of the specific object may change, the image generation unit 214 may cause the image generation AI to generate an image 52 of an attached object according to the state of the specific object. Here, the state of the specific object may be the state of a parameter of the specific object that may change during the progress of the event. Specifically, if the event is an event in which the player character fights an enemy character, the state of the specific object may be the state of a parameter such as the player character's stamina value or magical power value. Furthermore, the state of the specific object may be the state of the specific object's appearance that may change during the progress of the event. Specifically, if the event is an event in which the player character fights an enemy character, the state of the specific object may be the state of a scratch or dirt on the player character's face.

[0070] Specifically, the image generation unit 214 may input an original image 54 to the image generation AI and instruct the image generation AI to generate an image 52 of an attached object corresponding to a specific object included in the original image 54, thereby causing the AI ​​to generate an image 52 of the attached object corresponding to the state of the specific object. That is, for example, when causing the AI ​​to generate an image 52 of the attached object corresponding to the appearance state of a specific object, if the appearance state of the specific object changes as the event progresses, the image of the generated attached object may correspond to the appearance state of the specific object by instructing the AI ​​to generate an image 52 of the attached object corresponding to the specific object included in the original image 54. More specifically, for example, as shown in FIGS. 5( a) and 5(b), multiple original images 54 of a specific object with different appearance states may be stored in the storage unit 220 in advance. Then, the image generation unit 214 may determine which original image 54 of the multiple original images 54 with different appearance states to input to the image generation AI depending on the status of the event, and input the determined original image 54 to the image generation AI to generate the image 52 of the attached object. Alternatively, image generation unit 214 may use the image currently being displayed on display unit 18 as original image 54. That is, even in conventional games and video streaming, the appearance state of a character can change as the event progresses, but by inputting the image of the character currently being displayed on the screen (or scheduled to be displayed immediately thereafter) at each timing during the event as original image 54 to the image generation AI, it is possible to generate image 52 of the associated object according to the appearance state.

[0071] Furthermore, the image generation unit 214 may input the original image 54 to the image generation AI, and input a character string corresponding to the state of a specific object included in the original image 54 to the image generation AI, and cause the image generation AI to generate an image in which an image 52 of an attached object is added to an image 51 of the specific object included in the original image 54 based on the character string, thereby causing the image generation AI to generate an image 52 of the attached object corresponding to the state of the specific object. That is, for example, when causing the image generation AI to generate an image 52 of an attached object corresponding to the parameter state of a specific object, a character string corresponding to the parameter state is input to the image generation AI along with the original image 54, and the image generation AI is instructed to add an image 52 of the attached object corresponding to the character string to the original image 54, so that the generated image 52 of the attached object corresponds to the state of the specific object (even when the same original image 54 is input regardless of the state of the specific object). Specifically, when causing the AI ​​to generate an image of equipment according to the state of the player character's stamina, in a situation where the stamina is decreasing due to an attack from an enemy character, a character string indicating that the stamina is decreasing may be input to the image generation AI along with the original image 54, and the image generation AI may be instructed to add an image of equipment appropriate for the situation where the stamina is decreasing to the original image 54. Also, in a situation where the stamina is decreasing due to an attack from an enemy character, a character string indicating that the equipment has been damaged by the attack may be input to the image generation AI along with the original image 54, and the image generation AI may be instructed to add an image of the equipment damaged by the attack to the original image.

[0072] The image generation unit 214 may cause the image generation AI to generate the event-related image 50 automatically (in other words, at a predetermined timing (e.g., periodically)), or may cause the image generation AI to generate the event-related image 50 based on a predetermined operation by the user. For example, the operation reception unit 111 may be capable of receiving an operation related to changing the equipment of a character while an event is in progress, and the image generation unit 214 may cause the image generation AI to generate the event-related image 50 based on the operation.

[0073] In this way, the image generation unit 214 causes AI to generate images of a specific object and an associated object associated with the specific object displayed on one screen of the terminal device 10, but the terminal device 10 does not have to be a terminal device used by a game player. For example, the terminal device 10 may be a terminal device used by a game creator, a terminal device used by a viewer who watches a video broadcast, or a terminal device used by a broadcaster who broadcasts a video. In other words, the screen may be a screen related to game production, or a screen related to video viewing or broadcasting.

[0074] (Processing Related to Generation of Images of Associated Objects) Next, with reference to FIG. 6, an example of processing related to generation of images of associated objects associated with a specific object will be described.

[0075] First, when a predetermined condition is satisfied, the image generation unit 214 determines to execute image generation by the image generation AI (step S101). The predetermined condition is satisfied, for example, by a predetermined input operation by the user. Specifically, the predetermined condition may be satisfied, for example, by a user input operation on the equipment creation screen 30 to instruct the creation of equipment. Alternatively, the predetermined condition may be satisfied by the occurrence of a predetermined event during an event in a configuration in which image generation by the image generation AI is executed during the progress of the event. Alternatively, the predetermined condition may be satisfied by the arrival of a predetermined timing during the progress of the event.

[0076] When it is determined that the image generation AI should generate an image, the image generation unit 214 inputs input information to the image generation AI to be used for generating the images 36, 52 of the attached objects, and causes the image generation AI to generate the images 36, 52 of the attached objects based on the input information (step S102). The input information may include, for example, an image diagram 32 or an original image 54. The input information may also include information regarding the characteristics or state of a specific object. The input information may also include information regarding the characteristics of an object input by the user.

[0077] Next, the image generation unit 214 acquires (in other words, receives) the images 36, 52 of the associated objects generated by the image generation AI (step S103).

[0078] Next, the image generation unit 214 displays the images 36, 52 of the associated objects generated by the image generation AI and the images of the specific objects to which the associated objects are attached on the display unit 18 of the terminal device 10 (in other words, on one screen) (step S104). Specifically, the image generation unit 214 transmits the images 36, 52 of the associated objects generated by the image generation AI to the terminal device 10. Furthermore, the control unit 110 of the terminal device 10, which has received the images 36, 52 of the associated objects, displays the images 36, 52 of the associated objects and the images of the specific objects to which the associated objects are attached on the display unit 18. Here, the image generation unit 214 may transmit the images themselves generated by the image generation AI to the terminal device 10, or may transmit the images generated by the image generation AI to the terminal device 10 as part of a composite image synthesized with another image (e.g., an image of a specific object, etc.). The control unit 110 of the terminal device 10 may then display the composite image on the display unit 18, thereby displaying the image 36, 52 of the associated object and the image of the specific object to which the associated object is attached on the display unit 18. Furthermore, the image output by the image generation AI may itself include the image 36, 52 of the associated object and the image of the specific object to which the associated object is attached. Furthermore, the image of the specific object displayed together with the image 36, 52 of the associated object does not have to be sent from the control unit 210 at the same time that the image of the associated object is sent. The control unit 110 of the terminal device 10 may composite the image of the specific object sent from the control unit 210 at a first timing (or an image of the specific object pre-stored in the storage unit 120) with the image of the associated object sent from the control unit 210 at a second timing, and display the composite image on the display unit 18. In other words, the control performed by the information processing system 1 is sufficient as long as the images 36, 52 of the associated objects generated by the image generation AI and the images of the specific objects to which these associated objects are attached are displayed on a single screen as a result. Here, the images of the specific objects are not generated by the image generation AI.

[0079] [Second Embodiment] Next, a second embodiment of the present invention will be described. The information processing system 1 of the second embodiment may employ the contents described in the first embodiment to the extent that no contradiction occurs. For example, the information processing system 1 of the second embodiment may include part or all of the configuration of the information processing system 1 of the first embodiment. In the following, the matters described in the first embodiment will be omitted or simplified.

[0080] The image generation unit 214 may cause a predetermined AI to generate an image triggered by a specific object making a specific movement (in other words, a motion), and may display the image generated by the predetermined AI on a predetermined display means. For example, the image generation unit 214 may cause a predetermined AI to generate an image triggered by a specific character displayed on the display unit 18 of the user's terminal device 10 making a specific movement, and may display the image generated by the predetermined AI on the display unit 18 of the user's terminal device 10. In this case, the image generation unit 214 may display the image generated by the predetermined AI together with the specific character on the display unit 18. Note that the specific object may be a character (including an avatar, etc.) or an object in a virtual space other than a character (in other words, an object existing in a virtual world). The specific object may also be an object (e.g., a character) operated by a user. Furthermore, the specific movement may be any movement including a running movement, a jumping movement, a singing movement, an eating movement, a movement of performing a specific attack or defense, a movement of changing clothes, a movement of moving hands or feet, a moving movement, a falling movement, etc. In other words, the specific movement may be a specific motion of a character. Furthermore, hereinafter, the specified AI will be referred to as an image generation AI. Furthermore, an image generated by the image generation AI will be referred to as an output image. Furthermore, an image input to the image generation AI when generating an output image will be referred to as an input image.

[0081] The output image may be a background image, an image of an object that constitutes the background, an image of an object used by a specific object, etc. In other words, the output image may be an image relating to an object surrounding a specific object (e.g., a character). In other words, the output image may be an image for performing a predetermined effect in combination with a specific object.

[0082] The image generation unit 214 causes the image generation AI to generate an output image when a specific object displayed on the display unit 18 of the user's terminal device 10 makes a specific movement. The image generation unit 214 also sends this output image to the terminal device 10 and causes it to be displayed on the display unit 18. Specifically, the image generation unit 214 causes this output image to be displayed on the display unit 18 together with the specific object. That is, the control unit 110 of the terminal device 10 causes the sent output image to be displayed on the terminal device 10. In this embodiment, the image generated by the image generation AI is displayed on the display unit 18 together with the specific object. That is, on the display unit 18, a predetermined effect is produced by combining the output image and the specific object, and the predetermined effect is visually recognized by the user. That is, according to the technology of this embodiment, it is possible to realize an effect in which, when a character makes a specific movement on the screen viewed by the user, an output image generated by the image generation AI appears on the screen. Specifically, when a character makes a specific movement on the screen viewed by the user, an image of the character's background (in other words, an image of the objects surrounding the character) is generated by the image generation AI, and the character's background image is switched to the image generated by the image generation AI. Note that the output image generated by the image generation AI does not have to be displayed on the display unit 18 together with the specific object. That is, for example, when a character makes a specific movement on the screen viewed by the user and an output image generated by the image generation AI appears on the screen, the character can disappear from the screen and the output image appears instead.

[0083] In this way, the image generation unit 214 may cause the image generation AI to generate an output image triggered by a specific movement of a character displayed on the display unit 18 of the user's terminal device 10, and may cause the output image generated by the image generation AI to be displayed on the display unit 18. However, the character does not have to be a character operated by the user. For example, the user may be a viewer watching a video broadcast (e.g., a live broadcast, etc.), and the character may be a character appearing in the video broadcast. In other words, the image generation unit 214 may cause the image generation AI to generate an output image triggered by a specific movement of a character displayed on the display unit 18 of the viewer's terminal device 10, and may execute control to display the output image generated by the image generation AI on the display unit 18.

[0084] The generation of an image triggered by a specific object making a specific movement may be the generation of an image triggered by an AI capable of detecting a specific movement of a specific object detecting the specific movement. Furthermore, the generation of an image triggered by a specific object making a specific movement may be the generation of an image triggered by a user performing a predetermined operation that causes the specific object to make a specific movement.

[0085] Specifically, AI (hereinafter referred to as "detection AI") capable of detecting a specific movement (e.g., a jump by the specific object) of a specific object shown in an image (in other words, in a video) is publicly known. The image generation unit 214 may input an image displayed on the display unit 18 (in other words, the image being displayed) to this type of AI and cause it to detect the specific movement of the specific object. In other words, the image generation unit 214 may cause the detection AI to detect the specific movement of a specific object (in other words, a specific object in the image displayed on the display unit 18) during the progress of a predetermined event. Then, when the detection AI detects the specific movement of the specific object, the image generation unit 214 may cause the image generation AI to generate an image. Note that the detection AI and the image generation AI may be the same AI or different AIs.

[0086] As is well known, in games and the like, a user can make a character perform a specific movement by performing a predetermined operation. Specifically, in games and the like, operations for making the player character jump, for making the player character run, etc. are defined, and the player character moves in accordance with the operations. When the operation receiving unit 111 receives a user operation for making a specific object perform a specific movement, the image generating unit 214 may cause the image generation AI to generate an image based on the operation.

[0087] Note that the generation of an image triggered by a specific object making a specific movement may be executed after the specific object makes the specific movement on the display unit 18, or may be executed after it is determined that the specific object will make the specific movement on the display unit 18 but before the specific movement. That is, for example, when an AI detects a specific movement of a specific object from a video displayed on the display unit 18 and generates an output image, the AI ​​may be configured to be able to detect the specific movement of the specific object before a scene in the video in which the specific object makes the specific movement is displayed on the display unit 18, or may be configured to detect the specific movement of the specific object after a scene in the video in which the specific object makes the specific movement is displayed on the display unit 18. Specifically, for example, the image generation unit 214 may input the video to the detection AI prior to playback of the video on the display unit 18, and cause the detection AI to detect the specific movement prior to display on the display unit 18. Furthermore, when an image is generated based on a user performing a specified operation that causes a specific object to perform a specific movement, the image generation AI may generate an output image after the specified operation is performed and before the display of the specific object performing the specific movement is displayed on the display unit 18, or the image generation AI may generate an output image after the display of the specific object performing the specific movement is displayed on the display unit 18.

[0088] The image generation unit 214 inputs input information necessary for generating an image to the image generation AI, causing it to generate an output image. The input information may or may not include the input image. In other words, the image generation unit 214 may cause the image generation AI to generate an output image based on a predetermined input image, or may cause it to generate an output image without providing an input image. For example, there are known generation AIs that can generate output images based on prompts such as "Please generate a background image to be used in a game" or "Please generate a background image to be used in video streaming" (in other words, without requiring an input image). The image generation unit 214 may input such prompts as input information to the image generation AI and cause it to generate an output image.

[0089] Furthermore, the image generation unit 214 may cause the image generation AI to generate an output image corresponding to the movement of a specific object. For example, when a character runs, an image of a grassland is generated as the output image; when a character sings, an image of a stage or an image of a microphone is generated as the output image; and when a character eats, an image of a restaurant or an image of food is generated as the output image. In this manner, the image generation AI may generate an output image corresponding to the movement of a specific object. Regarding the generation of an output image corresponding to the movement of a specific object, the theme (i.e., the outline) of the output image may be determined by the image generation AI, or the image generation unit 214 may instruct the image generation AI. That is, the determination of what kind of output image is appropriate for various movements of the player character (for example, the determination that "an image of a grassland is appropriate" for a running movement or that "an image of a restaurant is appropriate" for an eating movement) may be performed by the image generation AI or by an AI other than the image generation AI. In addition, the correspondence between the type of movement and the theme (in other words, outline) of the output image is pre-registered in the memory unit 220, such as an image of a grassland for a running movement and an image of a restaurant for an eating movement, and when the image generation unit 214 identifies the type of movement of a specific object based on detection by the detection AI or user operation, it may instruct the image generation AI to generate an output image in line with the theme corresponding to the identified type of movement.

[0090] For example, the image generation unit 214 may input an image displayed on the display unit 18 (in other words, an image in which a specific object moves) as an input image to the image generation AI and instruct the image generation AI to generate an output image (e.g., a background image) corresponding to the movement of the specific object in the input image. The image generation AI that generates an output image corresponding to the movement of a specific object in the input image can also be generated by, for example, providing a machine learning model with a combination of the movement of the specific object and the answer to the output image as training data. The image generation AI that generates an output image corresponding to the movement of a specific object in the input image can also be generated by, for example, providing a machine learning model with an image of an object making a specific movement, including a background, as training data. The image generation AI generated in this manner can simultaneously detect that a specific object in the input image has made a specific movement, determine a theme appropriate for the specific movement, and generate an output image appropriate for the specific movement.

[0091] Furthermore, for example, the image generation unit 214 may determine a theme (in other words, an outline) of the output image according to a specific movement of a specific object detected by the detection AI or identified based on a user's operation, and instruct the image generation AI to generate an output image based on the determined theme. The image generation unit 214 may determine the theme of the output image based on a correspondence between a pre-registered type of movement and the theme. That is, the image generation unit 214 may determine a theme that is pre-set as a theme corresponding to a specific movement as the theme of the output image. Furthermore, the image generation unit 214 may instruct a specific AI to propose a theme suitable for a specific movement, and determine the proposed theme as the theme of the output image.

[0092] Furthermore, the image generation unit 214 may cause the image generation AI to generate an image corresponding to the appearance of a specific object. For example, if the equipment (in other words, the clothing) of the character is a swimsuit, a beach background image may be generated as the output image, and if the equipment of the player character is a uniform, a school background image may be generated as the output image. In this way, an output image corresponding to the appearance of a specific object may be generated by the image generation AI.

[0093] For example, the image generation unit 214 may input information regarding the appearance of a specific object as input information to the image generation AI, and cause the image generation AI to generate an output image based on the information, thereby causing the image generation AI to generate an output image corresponding to the appearance of the specific object. Specifically, the image generation unit 214 may input an image showing the appearance of a specific object, such as a display image displayed on the display unit 18, as input information to the image generation AI, and cause the image generation AI to generate an output image based on the input information, thereby causing the image generation AI to generate an output image corresponding to the appearance of the specific object. In other words, the image generation unit 214 may cause the AI ​​to detect the appearance characteristics of the specific object and cause the image generation AI to generate an output image corresponding to the detected characteristics. Note that the AI ​​that detects the appearance characteristics may be the same AI as the image generation AI or a different AI. Furthermore, the image generation unit 214 may input, as input information, character strings indicating the appearance characteristics of a specific object displayed on the display unit 18 (e.g., character strings indicating that the object is wearing a swimsuit) to the image generation AI, and cause the image generation AI to generate an output image based on the input information, thereby causing the image generation AI to generate an output image corresponding to the appearance of the specific object. In this case, the image generation unit 214 may determine the character strings to be input to the image generation AI according to the appearance of the specific object (e.g., according to equipment, etc.). For example, if a character as a specific object is wearing a swimsuit, the image generation unit 214 may input, as input information, a prompt such as "Please generate a background image to be used in the game that suits a character in a swimsuit" to the image generation AI, and cause the image generation AI to generate an output image.

[0094] (Processing Related to Image Generation Triggered by a Specific Movement) Next, with reference to FIG. 7, an example of processing related to image generation triggered by a specific object making a specific movement will be described.

[0095] First, the image generation unit 214 determines whether or not a specific object displayed on the display unit 18 of the terminal device 10 has made a specific movement (step S201). Here, the determination of whether or not a specific movement has occurred may be a determination of whether or not the specific object has made a specific movement. Alternatively, the determination of whether or not a specific movement has occurred may be a determination of whether or not the specific object is about to make a specific movement. For example, the image generation unit 214 may determine that a specific movement has occurred when a detection AI capable of detecting a specific movement of a specific object in an image displayed on the display unit 18 has detected the specific movement. Alternatively, the image generation unit 214 may determine that a specific movement has occurred when a user has performed an input operation that causes the specific object to make a specific movement.

[0096] If a specific movement of a specific object is detected, the image generation unit 214 determines to generate an image using the image generation AI (step S202).

[0097] When it is decided to execute image generation by the image generation AI, the image generation unit 214 inputs the input information required for generating the output image to the image generation AI, and causes the image generation AI to generate the output image (step S203).

[0098] Next, the image generation unit 214 acquires (in other words, receives) the output image generated by the image generation AI (step S204).

[0099] Next, the image generation unit 214 displays the output image generated by the image generation AI and the image of the specific object on the display unit 18 of the terminal device 10 (in other words, on one screen) (step S205). For example, the image generation unit 214 displays an image of a character as a specific object and a background image generated by the image generation AI (in other words, an image related to objects around the character) on one screen.

[0100] The present invention is not limited to the above-described embodiments and can be implemented in various modifications without departing from the spirit and scope of the present invention. Furthermore, the technology described herein may be applied to services other than games (in other words, applications). Furthermore, the technology described herein may be used in the development process of services such as game production. Within the scope of the present invention, the components may be freely combined, any component may be modified, any component may be replaced, any component may be omitted, or other components may be added. Furthermore, the process flow described herein is merely an example, and the order and configuration of each process may be different. Furthermore, some processes described herein may not exist. In other words, the process flow, specific determination processes, etc. may differ from those exemplified herein.

[0101] <Notes> The configuration of this embodiment may be used, for example, to prepare images in a non-traditional manner and use them to provide services. The configuration of this embodiment may also be used, for example, to enhance entertainment value. The matters described in the above embodiment may also be written as follows:

[0102] (Supplementary Note 1-1) A program that causes a computer to function as image generation means (e.g., image generation unit 214) that causes an AI to generate images of specific objects and associated objects associated with the specific objects displayed on a single screen in a game, without causing the AI ​​to generate images of the specific objects and associated objects. With this configuration, it is possible to cause the AI ​​to generate images for some of the objects displayed on a single screen, while preventing the AI ​​from generating images for other objects. Therefore, for example, the burden of preparing images to be generated by the AI ​​can be reduced. Furthermore, for example, images generated by the AI ​​can produce more unexpected images than images prepared by a human, thereby improving the entertainment value of the game. Furthermore, for example, it is possible to prepare images to be used in a game in cases where the game creator cannot predict in advance what kind of images should be prepared. Furthermore, for example, by preventing the AI ​​from generating images for some objects, the game creator can create the game more in-depth, thereby improving the entertainment value of the game.

[0103] (Supplementary Note 1-2) The program according to Supplementary Note 1-1, wherein the specific object is an object operated by a player of the game, and the auxiliary object is an accessory of the specific object. With this configuration, for example, the game creator can create the main parts such as characters and maintain the worldview of the game, while achieving the effect described in Supplementary Note 1-1.

[0104] (Supplementary Note 1-3) The program according to Supplementary Note 1-1 or 1-2, wherein the AI ​​that generates the image of the attached object generates the image of the attached object by adding the image of the attached object to the original image without processing a portion of the original image that includes the image of the specific object, the portion corresponding to the specific object identified by the AI. With this configuration, for example, by preparing an image in which a specific object is depicted, it is possible to create an image in which the attached object is added to this image.

[0105] (Supplementary Note 1-4) The program according to Supplementary Note 1-1 or 1-2, wherein the image generating means causes AI to generate an image of the associated object according to characteristics of the specific object. With this configuration, for example, the characteristics of the specific object can be reflected in the image of the associated object generated by AI.

[0106] (Supplementary Note 1-5) The program according to Supplementary Note 1-1 or 1-2, wherein the image generating means causes AI to generate an image of the associated object according to the state of the specific object. With this configuration, for example, the state of the specific object can be reflected in the image of the associated object generated by AI.

[0107] (Supplementary Note 1-6) The program according to Supplementary Note 1-1 or 1-2, wherein the image generation means causes an AI to generate an image of the attached object based on characteristics of the attached object input by a player of the game. With this configuration, it becomes possible for a user to give instructions regarding the image of the attached object to be generated.

[0108] (Supplementary Note 2-1) A program that causes a computer to function as control means (e.g., image generation unit 214) that causes AI to generate an image triggered by a specific object displayed on a specific display means making a specific movement, and controls the image generated by the AI ​​to be displayed on the specific display means. This configuration enables a previously unseen effect, for example, of displaying an image generated by AI when a specific object makes a specific movement, thereby improving the interest of the service. Furthermore, for example, the image displayed when a specific object makes a specific movement can be changed depending on the situation, thereby improving the interest of the service.

[0109] (Supplementary Note 2-2) The program according to Supplementary Note 2-1, wherein the control means causes an AI to generate the image according to the movement of the specific object. With this configuration, for example, it is possible to cause the AI ​​to generate an image that matches the movement of the specific object.

[0110] (Supplementary Note 2-3) The program according to Supplementary Note 2-1, wherein the control means causes an AI to generate the image according to the appearance of the specific object. With this configuration, for example, it is possible to cause the AI ​​to generate an image that matches the appearance of the specific object.

[0111] (Supplementary Note 2-4) The program according to any one of Supplementary Notes 2-1 to 2-3, wherein the image generated by AI is displayed on the predetermined display means together with the specific object. With this configuration, for example, when the specific object makes a specific movement, it is possible to achieve a previously unseen effect of displaying the image generated by AI together with the specific object.

[0112] (Supplementary Note 2-5) The program according to any one of Supplementary Notes 2-1 to 2-3, wherein the control means causes an AI to generate the image when the AI ​​capable of detecting the specific movement of the specific object detects the specific movement. With this configuration, for example, it is possible to determine that a specific object has made a specific movement from a predetermined image or the like, and cause the AI ​​to generate an image.

[0113] (Supplementary Note 2-6) The program according to any one of Supplementary Notes 2-1 to 2-3, wherein the control means causes AI to generate the image based on a predetermined operation by a user that causes the specific object to perform the specific movement. With this configuration, it is possible to realize image generation by AI at appropriate timing without needing to detect a specific movement of the specific object based on an image or the like, for example.

[0114] In addition, the problem-solving means constituted by the above-mentioned program (for example, each configuration described in the appendix) can be appropriately diverted to an apparatus, system, method, medium, etc.

[0115] 1 Information processing system, 10 Terminal device, 11 Processor, 12 Memory, 13 Storage, 14 Communication IF, 15 Input / output IF, 17 Input unit, 18 Display unit, 20 Server, 21 Processor, 22 Memory, 23 Storage, 24 Communication IF, 25 Input / output IF, 110 Control unit, 111 Operation acceptance unit, 112 Transmission / reception unit, 113 Game control unit, 114 Display control unit, 120 Storage unit, 210 Control unit, 211 Transmission / reception unit, 212 Game control unit, 214 Image generation unit, 220 Storage unit

Claims

1. A program that causes a computer to function as an image generation means that, for a specific object and an associated object that are displayed on one screen in a game, causes AI to generate images of the associated object without causing AI to generate images of the specific object.

2. The program according to claim 1, wherein the specific object is an object operated by a player of the game, and the accompanying object is an accessory of the specific object.

3. The program according to claim 1 or 2, wherein the AI that generates the image of the incidental object generates the image of the incidental object by adding the image of the incidental object to the original image, without processing the portion of the original image that contains the image of the specific object and that corresponds to the specific object identified by the AI.

4. The program according to claim 1 or 2, wherein the image generation means inputs information indicating at least one of the characteristics of the specific object, such as gender, physique, race, occupation, or appearance, into the AI, thereby causing the AI to generate an image of the associated object that corresponds to the characteristics of the specific object.

5. The program according to claim 1 or 2, wherein the image generation means inputs information indicating the state of the specific object that changes during the progress of a specified event into the AI, thereby causing the AI to generate an image of the associated object that corresponds to the state of the specific object that changes during the progress of the specified event.

6. The program according to claim 1 or 2, wherein the image generation means causes AI to generate an image of the attached object based on characteristics of the attached object input by a player of the game.

Images