Program

Abstract

To provide a technique that prepares an image in an unprecedented form and can be utilized for providing services.SOLUTION: A program allows a computer to function as image generation means for allowing an AI to generate an image of an attached object without allowing the AI to generate an image of a specific object for the specific object displayed on one screen in a game and the attached object attached to the specific object.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to a program. [Background technology]

[0002] AI capable of generating images is known (see, for example, Non-Patent Document 1). [Prior art documents] [Non-patent literature]

[0003] [Non-Patent Document 1] "5 Recommended Sites for Generating AI Illustrations | A Thorough Explanation of the Procedures and Tips for Automatic Generation!" [online] [Searched on January 18, 2024], Internet<https: / / www.gmosign.com / media / work-style / ai-illust / > Summary of the Invention [Problem to be solved by the invention]

[0004] Incidentally, in providing services such as games, various images are required.

[0005] An object of the present invention is to provide a technology that allows images to be prepared in a new way and used to provide services. [Means for solving the problem]

[0006] According to one embodiment shown in the present disclosure, Computer, With respect to a specific object and an associated object associated with the specific object that are displayed on one screen in a game, the image generating means causes the AI to generate an image of the associated object without causing the AI to generate an image of the specific object. Programs are offered. [Effects of the Invention]

[0007] According to the present invention, images can be prepared in a manner not previously possible and used to provide services. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating a schematic configuration of an information processing system. [Figure 2] FIG. 2 is a block diagram showing a functional configuration of the information processing system. [Figure 3] This is a diagram to explain how AI generates images based on conceptual diagrams. [Figure 4] This is a diagram to explain how AI generates an image based on a character string entered by a user. [Figure 5] FIG. 1 is a diagram for explaining image generation by AI while an event is in progress. [Figure 6] 10 is a flowchart illustrating an example of a process for generating an image of an attached object. [Figure 7] 10 is a flowchart illustrating an example of a process for generating an image triggered by a specific object making a specific movement. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0010] [First embodiment] <System hardware configuration> As shown in FIG. 1, an information processing system 1 of this embodiment includes a plurality of terminal devices 10 and a server 20.

[0011] The terminal device 10 and the server 20 are connected via a network 2. The network 2 may be configured by, for example, the Internet, a mobile communication system (e.g., 3G, 4G, 5G, LTE (Long Term Evolution), etc.), Wi-Fi (Wireless Fidelity), Bluetooth (registered trademark), other communication lines, or a combination of these. Furthermore, the connection between the terminal device 10 and the server 20 may be wired or wireless.

[0012] The server 20 (in other words, a computer, an information processing device) may be, for example, a general-purpose computer such as a workstation or a personal computer. The server 20 includes a processor 21, a memory 22, a storage 23, a communication IF (interface) 24, and an input / output IF 25. These components of the server 20 are connected to each other by a communication bus.

[0013] The processor 21 controls the overall operation of the server 20. The processor 21 may include a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), etc. The processor 21 reads a program from the storage 23 and loads it into the memory 22. The processor 21 executes the loaded program.

[0014] The memory 22 is a main storage device. The memory 22 is configured by storage devices such as a ROM (Read Only Memory) and a RAM (Random Access Memory). The memory 22 temporarily stores programs and various data that the processor 21 reads from the storage 23, thereby providing a working area for the processor 21. The memory 22 also temporarily stores various data that the processor 21 generates while operating according to the programs.

[0015] In this embodiment, the program may be a program that realizes a game by the terminal device 10. The program may also be a program that realizes the game through cooperation between the terminal device 10 and the server 20. The game realized through cooperation between the terminal device 10 and the server 20 may, for example, be a game executed on a browser launched on the terminal device 10. The program may also be a program that realizes the game through cooperation between a plurality of terminal devices 10. The various data may include, for example, data related to the game, such as user information and game information, and instructions and notifications transmitted and received between the terminal device 10 and the server 20.

[0016] The storage 23 is an auxiliary storage device. The storage 23 is configured by a storage device such as a flash memory or an HDD (Hard Disk Drive). The storage 23 stores various data related to the game.

[0017] The communication IF 24 controls transmission and reception of various data between the server 20 and the terminal device 10 and the like via the network.

[0018] The input / output IF 25 is an interface through which the server 20 receives input of data and also an interface through which the server 20 outputs data. The input / output IF 25 may include, for example, an input unit which is an information input device such as a mouse or a keyboard, and a display unit which is a device that displays and outputs images.

[0019] The terminal device 10 (in other words, a computer, an information processing device) may be, for example, a smartphone, a feature phone, a PDA (Personal Digital Assistant), a tablet computer, a personal computer, a wearable terminal, or a game device. The terminal device 10 may be a mobile terminal. The terminal device 10 may be a portable terminal that a user uses when playing a game.

[0020] The terminal device 10 includes a processor 11, a memory 12, a storage 13, a communication IF 14, an input / output IF 15, an input unit 17, and a display unit 18. These components included in the terminal device 10 are connected to each other by a communication bus.

[0021] The processor 11 controls the overall operation of the terminal device 10. The processor 11 may include a CPU, an MPU, a GPU, etc. The processor 11 reads a program from the storage 13 and loads it into the memory 12. The processor 11 executes the loaded program.

[0022] The memory 12 is a main storage device. The memory 12 is configured by storage devices such as a ROM and a RAM. The memory 12 provides a working area for the processor 11 by temporarily storing the programs and various data that the processor 11 reads from the storage 13. The memory 12 also temporarily stores various data that the processor 11 generates while operating according to the programs.

[0023] The storage 13 is an auxiliary storage device. The storage 13 is configured by a storage device such as a flash memory or a HDD. The storage 13 stores various data related to the game.

[0024] The communication IF 14 controls transmission and reception of various data between the terminal device 10 and the server 20 etc. via the network.

[0025] The input / output IF 15 is an interface through which the terminal device 10 receives input of data and also an interface through which the terminal device 10 outputs data. The input / output IF 15 may input and output data via, for example, a USB (Universal Serial Bus) or the like. The input / output IF 15 may include an input unit 17, a display unit 18, or the like.

[0026] The input unit 17 accepts input from a user. The input unit 17 may be, for example, a pointing device such as a touchpad. The display unit 18 displays images. The display unit 18 may be, for example, a liquid crystal display or an organic EL (Electro-Luminescence) display. The terminal device 10 includes, for example, a touch screen 16 which is an electronic component that combines the input unit 17 and the display unit 18.

[0027] The input unit 17 has a function of detecting a position input on the input surface by a user operation (for example, a touch operation, a tap operation, a slide operation, a swipe operation, a flick operation, etc.) and transmitting information indicating the detected position as an input signal. The touch panel serving as the input unit 17 may be of a capacitive type or a resistive type, or may be of another type.

[0028] The input unit 17 may be, for example, a keyboard, various physical buttons, various sensors (for example, an acceleration sensor, an angular velocity sensor, a magnetic sensor, a GPS sensor, a motion sensor, a gaze sensor, a bioelectric potential sensor, a fingerprint sensor, a breath sensor, a pressure sensor, or an image sensor), an operation stick, a camera, or a microphone. The display unit 18 may be, for example, a projector.

[0029] <System Functional Configuration> 2 is a block diagram showing the functional configuration of the server 20 and the terminal device 10. Each of the server 20 and the terminal device 10 may include a functional configuration (not shown) required to function as a general computer, and a functional configuration required to implement known functions in a game.

[0030] In this embodiment, the server 20 identifies each user and the terminal device 10 using a user account that is registered in advance. The method of registering the account is not particularly limited. For example, the terminal device 10 or another device such as a personal computer may transmit information required for registering a user account to the server 20 based on a user operation, and the server 20 may create and store an account for each user based on the received information.

[0031] The server 20 has a function of communicating with each terminal device 10 and supporting the terminal devices 10 in progressing through the game. If the game is a multiplayer game, the server 20 may have a function of communicating with each terminal device 10 participating in the game and mediating interactions between the terminal devices 10. The server 20 functions as a control unit 210 and a storage unit 220 through cooperation of the processor 21, memory 22, storage 23, communication IF 24, input / output IF 25, etc.

[0032] The storage unit 220 stores various types of data used by the control unit 210. Examples of the various types of data include programs, game information, and user information. The programs are programs for realizing the games. The game information and user information are data that the control unit 210 references when executing the programs.

[0033] Game information is data that the control unit 210 or 110 references when executing a program. Game information includes, for example, data such as images and sounds used in the game. User information is data managed for each user account. User information includes, for example, information about the character (hereinafter referred to as "player character") used by the user (in other words, controllable by the user), information about owned assets, and information indicating the progress of the game. Owned assets can be said to be value possessed by the user within the game (in other words, within the virtual space). Examples of such value (in other words, in-game value, owned assets) include electronic currency, items, and characters. Furthermore, examples of electronic currency include in-game currency that can be used within the game and crypto assets.

[0034] The control unit 210 controls various processes related to the game by executing programs stored in the storage unit 220. The control unit 210 includes a transmission / reception unit 211, a game control unit 212, and an image generation unit 214, for example.

[0035] The transmitting / receiving unit 211 transmits or receives various types of data. For example, the transmitting / receiving unit 211 receives requests to transmit various types of data and programs, requests for synchronization processing to support the multiplay function, data to be subjected to synchronization processing, and the like from each terminal device 10, and passes them to the game control unit 212. Furthermore, the transmitting / receiving unit 211 transmits various types of data and programs to each terminal device 10 in accordance with the control of the game control unit 212.

[0036] The game control unit 212 provides a game to the terminal device 10 by executing arithmetic processing described in a program in response to a request from the terminal device 10 or the like.

[0037] The image generation unit 214 generates images to be used in the game. In other words, the image generation unit 214 generates images to be used in providing services. Specifically, the image generation unit 214 causes the AI to generate images. The images that the image generation unit 214 causes the AI to generate may be two-dimensional images or three-dimensional images (in other words, 3D models). Furthermore, the images that the image generation unit 214 causes the AI to generate may be still images or moving images.

[0038] The terminal device 10 has, for example, a function as an input device that accepts input operations from the user, and a function as an output device that outputs images and sounds of the game.

[0039] The terminal device 10 functions as a control unit 110 and a storage unit 120 through cooperation of the processor 11, memory 12, storage 13, communication IF 14, input / output IF 15, etc. The storage unit 120 stores various data used by the control unit 110. The various data include, for example, programs, game information, and user information. The programs are programs for realizing games on the terminal device 10 side. The game information and user information are data referenced by the control unit 110 when executing the programs. The game information and user information stored in the storage unit 120 may include information similar to the game information and user information stored in the storage unit 220.

[0040] The control unit 110 executes a program stored in the storage unit 120 to control various processes related to the game executed on the terminal device 10. The control unit 110 includes, for example, an operation reception unit 111, a transmission / reception unit 112, a game control unit 113, and a display control unit 114.

[0041] The operation reception unit 111 receives an operation (hereinafter also referred to as an "input operation") input by the user via the input unit 17. Specifically, when an input operation is performed on the input unit 17, the operation reception unit 111 detects the coordinates of the input position and the type of input operation. Examples of the types of input operations include various operations performed with fingers, etc., such as a touch operation, a tap operation, a slide operation, a swipe operation, a flick operation, a pinch-in operation, and a pinch-out operation. The input operation is not limited to an operation of physically contacting the input unit 17 (for example, the touch screen 16) but may also include a non-contact operation. Note that an operation of ending a previously performed input operation, such as a touch-off operation of ending contact with the touch screen 16, can also be considered as one form of input operation.

[0042] Here, the operation reception unit 111 can also receive input operations performed using an operation device connected via the input / output IF 15 in the same way as input operations to the input unit 17 .

[0043] The transmitting / receiving unit 112 transmits or receives various types of data. For example, the transmitting / receiving unit 112 transmits game information or user information, or a synchronization request for supporting a multiplay function, to the server 20. The transmitting / receiving unit 112 also transmits operation information related to an input operation accepted by the operation accepting unit 111 to the server 20. The transmitting / receiving unit 112 also receives various types of data and programs from the server 20.

[0044] The game control unit 113 executes various processes related to the progress of the game. The game control unit 113 identifies the user's instruction content based on the user's input operation detected by the operation reception unit 111. The game control unit 113 also executes various determination processes related to the progress of the game based on the identified instruction content, etc. The game control unit 113 also progresses the game while communicating with the server 20 based on the results of the determination processes, etc. The game control unit 113 also instructs the display control unit 114 to display an image corresponding to the progress of the game on the display unit 18.

[0045] The display control unit 114 displays images related to the game on the display unit 18. The display control unit 114 generates images to be displayed on the display unit 18 using various images stored in the storage unit 220 or the storage unit 120, various images generated by the image generation unit 214, and the like, and displays the images on the display unit 18. The various images include images of objects in the game (in other words, in the virtual space) (for example, images of characters such as a player character, items, and backgrounds), as well as images related to a UI (User Interface) required for various game operations, such as icons, buttons, and menus showing various parameters. Note that the control unit 210 may perform part or all of the process of generating images to be displayed on the display unit 18 using various images.

[0046] Note that the functions of the terminal device 10 and the server 20 illustrated in FIG. 2 are merely examples. Each of the terminal device 10 and the server 20 may have at least some of the functions of the other device. In other words, the server 20 may have some or all of the functional blocks of the terminal device 10 in this embodiment, or the terminal device 10 may have some or all of the functional blocks of the server 20. Furthermore, each device, such as the terminal device 10 and the server 20, does not have to be realized by an integrated device, but may be realized, for example, by multiple devices connected via a network or the like. Furthermore, the information processing system 1 may be configured, for example, by only the terminal device 10 or the server 20. In other words, the information processing system 1 does not have to be realized by multiple devices connected via a network.

[0047] <Processing according to this embodiment> Next, processing according to this embodiment will be described. Note that in this embodiment, the processor 11 of the terminal device 10 or the processor 21 of the server 20 will be described as performing each processing described below by executing a program stored in the information processing system 1. However, at least a part of the processing described below that is performed by the processor 11 may be performed by a processor other than the processor 11. Also, at least a part of the processing described below that is performed by the processor 21 may be performed by a processor other than the processor 21. In other words, the computer that executes the program in this embodiment may be either the terminal device 10 or the server 20, or may be realized by a combination of multiple devices.

[0048] The image generation unit 214 does not cause the AI to generate an image of a specific object and an accompanying object associated with the specific object that are displayed on one screen in a game, but causes the AI to generate an image of the accompanying object. Here, the specific object may be an object operated by a user. The accompanying object may also be an accessory for the specific object. The specific object may be the face of a character (e.g., a player character), and the accompanying object may include the character's accessory or the character's body (e.g., limbs). In this embodiment, a case will be described in which the specific object is the player character and the accompanying object is the player character's accessory. The AI that generates the image of the accompanying object may be included in the information processing system 1, or an AI provided by an external service may be used. Hereinafter, the AI that generates the image of the accompanying object will be referred to as the image generation AI. The accessory includes, for example, weapons, armor, clothing, or accessories worn by a character. The accessory also includes, for example, parts attached to a vehicle or aircraft as a specific object.

[0049] The game of this embodiment may be, for example, a role-playing game, an action game, a shooting game, a racing game, or the like, in which equipment is equipped to a specific object and the player fights against a predetermined opponent (here, the "opponent" may be another user, a non-player character, or the like.) However, the technology according to this embodiment can also be applied to games other than games in which the player fights against a predetermined opponent in this way.

[0050] In the game of this embodiment, a user can purchase equipment for a player character from an in-game store. The user can also input characteristics of the equipment to be purchased and create and purchase it. In other words, the user can custom-make the equipment to be purchased. Note that if a user uses multiple characters (for example, in a game in which the user progresses using a party made up of multiple characters), the user may be able to select which of the multiple characters to create equipment for. The following describes an example in which equipment is created for a specific character used by the user. However, the technology described below can also be applied to a configuration in which equipment is created without specifying the target character.

[0051] An example of an equipment creation screen 30 as a screen for creating equipment is shown in Fig. 3. The display control unit 114 displays the equipment creation screen 30 on the display unit 18 while playing the game (for example, based on the player character visiting a shop in the game). The user can create equipment by performing a predetermined input operation on the equipment creation screen 30. The equipment creation screen 30 can also be considered a screen for inputting characteristics related to the equipment.

[0052] On the equipment creation screen 30, the user can draw an image of the equipment (in other words, an original image) 32. With the equipment creation screen 30 displayed on the display unit 18, the operation accepting unit 111 accepts an input operation by the user to draw the image of the equipment 32. Note that this input operation may be, for example, an operation of drawing a picture using a pointing device, as with well-known paint software, or the like. Alternatively, this input operation may be an operation of combining a plurality of pre-prepared parts to create the image 32. Furthermore, the equipment creation screen 30 displays a create button 33 as a UI for accepting an operation to instruct the creation of equipment. The operation accepting unit 111 accepts the user's operation on the create button 33 as an input operation to instruct the creation of equipment.

[0053] When an input operation for drawing an image 32 of the equipment and an input operation for instructing the creation of the equipment are performed, the image generation unit 214 causes the image generation AI to generate an image of the equipment based on the image. It should be noted that generation AIs that generate a clean-up image (i.e., an image in which the associated objects are drawn in detail) based on a rough sketch (the original image in this embodiment, i.e., an image showing the outline of the associated objects) are well known, and the generation of an image of the equipment based on the image may be performed using this type of AI. In other words, the image generation unit 214 may input the image 32 to the image generation AI and cause it to generate an image 36 of the equipment based on the image 32 (e.g., an image in which the image 32 is cleaned up) (see FIG. 3 ). The features of the equipment in the image 32 created by the user are reflected in the image 36 of the equipment generated by the image generation AI. In other words, the image generation unit 214 causes the image generation AI to generate an image 36 of the equipment that reflects the features of the equipment input by the user.

[0054] The user can purchase the equipment represented by the equipment image 36 generated by the image generation AI. In this embodiment, when the equipment image 36 is generated by the image generation AI, the image generation unit 214 instructs the terminal device 10, on which an input operation to instruct the creation of equipment has been performed, to display the generated equipment image 36. Based on the instruction, the control unit 110 of the terminal device 10 causes the display unit 18 to display the generated equipment image 36, as shown in FIG. 3 . The control unit 110 also causes the display unit 18 to display, together with the generated equipment image 36, a purchase button 37 as a UI for accepting an operation to instruct the purchase of the equipment. The operation acceptance unit 111 accepts a user operation on the purchase button 37 as an input operation to instruct the purchase of the equipment represented by the generated equipment image 36. Based on the instruction, the game control unit 212 provides the user with the equipment represented by the generated equipment image 36. Specifically, based on the instruction, the game control unit 212 stores the equipment shown in the generated equipment image 36 in the storage unit 220 as an item owned by the user. Furthermore, based on the instruction, the game control unit 212 causes the user to pay the price for the equipment. Specifically, based on the instruction, the game control unit 212 reduces the user's possession of a predetermined value (e.g., in-game currency) by the amount of the price. As described above, in this embodiment, the user is able to acquire the equipment shown in the equipment image 36 generated by the image generation AI by consuming a predetermined value that the user possesses. Note that the user may also be able to acquire the equipment shown in the equipment image 36 generated by the image generation AI by consuming one or more items that represent the predetermined value that the user possesses. In other words, the equipment shown in the equipment image 36 generated by the image generation AI may be acquired by purchasing the equipment with payment of money or the like in the game, or by consuming (e.g., combining) items that the user possesses in the game. Furthermore, the consumption of a predetermined value related to the acquisition of the equipment may be performed before or after the image generation AI generates the image 36 of the equipment.For example, when an operation is performed on the create button 33, the game control unit 212 may reduce the predetermined value owned by the user by the amount of the purchase price of the equipment based on the operation, and the image generation unit 214 may then cause the image generation AI to generate an image 36 of the equipment.

[0055] The equipment features that the user can input may be, for example, features related to the shape or color of the equipment. Furthermore, input of at least some (in other words, some or all) of the equipment features may be performed by inputting a string of characters or selecting a specific option from multiple options. That is, a generation AI that generates an image based on an input of a string of characters is publicly known, and the generation of an equipment image may be performed using this type of AI. Specifically, for example, while the equipment creation screen 30 is displayed, the operation accepting unit 111 may accept an input operation by the user to input a string of characters describing the equipment features. Furthermore, as shown in FIG. 4 , the equipment creation screen 30 may display a feature entry field 38 as a UI that accepts an input operation to input the string of characters. Then, the image generating unit 214 may cause the image generating AI to generate an equipment image 36 that reflects the equipment features input by the user, based on the string of characters. Specifically, for example, if the user inputs "a blue sword with a star motif" as a character string describing the characteristics of the equipment, the image generation unit 214 may input a prompt to the image generation AI instructing it to generate an image of "a blue sword with a star motif," and generate the equipment image 36. Furthermore, if the user draws an image 32 of the equipment and inputs "blue" as a character string describing the characteristics (or if the user performs an operation to select blue from multiple color candidates presented to the user), the image generation unit 214 may input the image 32 created by the user and a prompt instructing it to generate an image of "blue" equipment, and generate the equipment image 36.

[0056] In this embodiment, the image 32 used to generate the equipment image 36 includes a character image 40 and an equipment image 41 drawn by the user, as shown in Fig. 3. In other words, on the equipment creation screen 30, the user creates the image 32 by adding the equipment of their own imagination to the character image 40 displayed on the screen. The image generation unit 214 causes the image generation AI to generate an equipment image based on the image 32, but the image generation AI does not process the portion of the image 32 corresponding to the character, but processes the range corresponding to the equipment (in other words, by adding the equipment image to the image 32), thereby generating the equipment image 36 without generating the character image 40. In other words, in this embodiment, the input image input to the image generation AI and the output image output by the image generation AI are both a single image including a portion corresponding to a character (i.e., an image corresponding to the character) and a portion corresponding to equipment (i.e., an image corresponding to the equipment). The portion corresponding to the character is the same in the input image and the output image, while the portion corresponding to the equipment is different in the input image and the output image. AIs capable of recognizing a specific object included in a specific image (e.g., a portion corresponding to a character in the image 32) are well known, and generation AIs that generate an image by processing other portions without processing a specific portion of a specific image (e.g., a portion specified by a user, a portion specified in advance by a game operator, or a range determined by a computer based on predetermined conditions) are well known. Therefore, the generation of the equipment image 36 based on the image 32 may be performed using this type of AI. The image generation unit 214 may cause an AI to specify the areas to be processed and the areas not to be processed by the image generation AI for the image 32 serving as the source image used to generate the image of the attached object. Furthermore, the AI that identifies the areas to be processed and the areas not to be processed may be the same AI as the image generation AI, or it may be a different AI.

[0057] Note that the image 32 used to generate the equipment image 36 may not include the character image 40. In other words, the image generation unit 214 may input the equipment image 32 that does not include the character image 40 to the image generation AI, and cause the image generation AI to generate the equipment image 36 based on the image 32. In other words, the image generation unit 214 may input only the equipment image 41 drawn by the user, of the character image 40 and the equipment image 41 drawn by the user shown in FIG. 3, to the image generation AI, and cause the image generation AI to generate the equipment image 36 based on the image 32 (in other words, the equipment image 41 drawn by the user).

[0058] Furthermore, when the image generation unit 214 causes the image generation AI to generate an image of an associated object associated with a specific object, the image generation unit 214 may cause the AI to generate an image according to the characteristics of the associated specific object. Specifically, when the image generation unit 214 causes the AI to generate an image 36 of equipment, the image generation unit 214 may cause the AI to generate an image according to the characteristics of the character equipped with the equipment. The characteristics of the specific object may be, for example, characteristics related to the gender, physique, species (e.g., human, monster, robot, etc.), or occupation (e.g., warrior, wizard, priest, etc.) of the specific object, or may be external characteristics (in other words, characteristics related to appearance).

[0059] The generation of an image according to the characteristics of a specific object can be performed as follows: That is, when the image generation unit 214 causes the image generation AI to generate an image based on at least one of the image diagram 32 and the character string indicating the characteristics of the equipment input by the user, the image generation unit 214 may input information indicating the characteristics of the character to the image generation AI, thereby causing the image generation AI to generate an image 36 of the equipment according to the characteristics of the character.

[0060] Specifically, for example, when the image generation unit 214 causes the image generation AI to generate an equipment image 36 based on an image 32 including a character image 40 and an equipment image 41 drawn by the user, the image generation unit 214 may instruct the image generation AI to generate an equipment image 36 that corresponds to the characteristics of the character image 40 included in the image 32 (in other words, that suits the character). In other words, the image generation unit 214 may input the character image 40 and the equipment image 41 drawn by the user to the image generation AI, and generate the equipment image 36 that corresponds to the characteristics of the character image 40. Furthermore, in this embodiment, the character image 40 and the equipment image 41 drawn by the user are input to the image generation AI as a single image (i.e., a single image including parts of the equipment drawn by the user and parts of the character not drawn by the user), and the image generation AI generates the equipment image 36 by processing this single image; however, the character image 40 and the equipment image 41 drawn by the user may each be input to the image generation AI separately. The image generation AI may then adjust and clean up the image 41 of the equipment drawn by the user so that it matches a pre-prepared image 40 of a character that is different from the image 41 (for example, so that it suits the character, and so that the drawing style, etc., matches the character image 40).

[0061] Furthermore, when the image generation unit 214 causes the image generation AI to generate an equipment image 36 based on at least one of the image 32 and a character string indicating the characteristics of the equipment input by the user, the image generation unit 214 may input the character string indicating the characteristics of the character to the image generation AI and instruct the image generation AI to generate an equipment image 36 corresponding to the character's characteristics. That is, for example, if the character used by the user is a muscular female warrior and the user creates equipment for the character, when the user draws the image 32 and operates the create button 33, the image generation unit 214 may input, along with the image 32, a prompt instructing the image generation AI to generate an image of "equipment suitable for a muscular female warrior," and cause the image generation AI to generate an equipment image 36 corresponding to the image 32, that is, an image 36 of "equipment suitable for a muscular female warrior." The character string indicating the characteristics of the character input to the image generation AI may be automatically determined by the image generation unit 214 according to the character's characteristics, or may be determined based on a user's input (e.g., input into a predetermined entry field).

[0062] It may also be possible to create equipment by having the image generation AI generate an equipment image 36 without drawing an image 32 (in other words, without inputting the equipment's characteristics). For example, when the user operates the create button 33 without drawing an image 32, the image generation unit 214 may input information indicating the character's characteristics (e.g., an image of the character or text indicating the character's characteristics) to the image generation AI, and generate an equipment image 36 corresponding to the character's characteristics. In other words, the image generation AI may generate the equipment image 36 from a state where a rough sketch or the like does not exist (in other words, a state where there is no image related to the equipment), rather than generating the equipment image 36 by clean-up of the image 32 created by the user. In this configuration, the image generation unit 214 may input information about the equipment's characteristics input by the user through text input to the image generation AI, in addition to the information indicating the character's characteristics, and cause the image generation AI to generate an equipment image 36 corresponding to the character's characteristics, which reflects the equipment's characteristics input by the user. In addition, in cases where it is possible to create equipment by having the image generation AI generate an image 36 of the equipment without drawing an image diagram 32 (in other words, without inputting the characteristics of the equipment), the image generation unit 214 may have the image generation AI generate the image 36 of the equipment without inputting information indicating the characteristics of the character.

[0063] The generation of images of associated objects associated with such specific objects can also be used in game development. For example, games in which new equipment is added after release (in other words, after the start of service) are known. In this type of game, the image generation unit 214 may cause an image generation AI to generate an equipment image 36 based on a predetermined operation by the game creator or automatically at a predetermined timing, and may add the equipment shown in the generated equipment image 36 as a new equipment (in other words, register it in the storage unit 220 as an equipment that can be acquired by the user).

[0064] (Variation) The image generation by the image generation AI does not have to be related to the creation of equipment. For example, the image generation unit 214 may cause the image generation AI to generate an image of an associated object associated with a specific object during the progress of a specific event using the specific object. The specific event may involve controlling a player character as a specific object to achieve a specific goal. Specifically, the specific event may involve controlling a player character to defeat a specific opponent, reach a specific destination, or obtain a specific objective. In other words, the specific event may be an in-game quest, etc. The specific event may also be a video broadcast (e.g., a live broadcast, etc.). In this case, a specific event broadcast using a character (e.g., an avatar, etc.) as a specific object in a specific service can be viewed by users of the specific service. That is, the server 20 may function as a server providing a video broadcast service. Note that such a broadcast available to users may be a broadcast provided by another user or a broadcast provided by a service provider such as a game operator.

[0065] An example of image generation by the image generation AI while a predetermined event is in progress will be described with reference to FIG. 5. FIG. 5 is a diagram showing an example of an image (hereinafter referred to as an "event-related image 50") displayed on the display unit 18 while an event is in progress. The event-related image 50 includes an image 51 of a specific object (specifically, a character) used by the user and an image 52 of an accompanying object (specifically, equipment) accompanying the specific object. While the event is in progress, the image generation unit 214 inputs an original image 54 that is the basis of the event-related image 50 into the image generation AI, causing the image generation AI to generate the event-related image 50. For example, the image generation unit 214 causes the image generation AI to generate the event-related image 50 illustrated in FIG. 5(c) based on the original image 54 illustrated in FIG. 5(a) or 5(b).

[0066] The original image 54 includes an image 51 of a specific object. In other words, the original image 54 has a portion corresponding to the specific object. The image generation unit 214 causes the image generation AI to generate an image 52 of an attached object based on the original image 54. However, the image generation AI does not process the portion of the original image 54 corresponding to the specific object, but instead generates the image 52 of the attached object by adding the image 52 of the attached object to the original image 54 (in other words, by processing other predetermined portions). Note that the original image 54 may include an image showing an outline of the attached object. In other words, the original image 54 may have a portion showing an outline of the attached object. Specifically, the original image 54 illustrated in FIGS. 5(a) and 5(b) may include a rough sketch of equipment in addition to the character's face. Furthermore, the original image 54 does not have to have a portion related to the attached object.

[0067] For example, the image generation unit 214 may input an original image 54 including a portion corresponding to a specific object and a portion showing an outline of an associated object to an image generation AI that generates a cleaned-up image based on a rough sketch, and may cause the image generation AI to leave the portion of the original image 54 that corresponds to the specific object untouched and clean up the portion showing the outline of the associated object, thereby generating the event-related image 50. Alternatively, for example, the image generation unit 214 may input an original image 54 that includes a portion corresponding to a specific object but does not include a portion showing the outline of the associated object to the image generation AI, and may cause the image generation AI to leave the portion of the original image 54 that corresponds to the specific object untouched and add an image 52 of the associated object to the portion of the original image 54 that corresponds to the specific object, thereby generating the event-related image 50. Note that clean-up of the portion showing the outline of the associated object in the original image 54 can also be considered as adding an image 52 of the associated object to the original image 54.

[0068] Furthermore, when the image generation unit 214 causes the image generation AI to generate an image 52 of an associated object associated with a specific object, the image generation unit 214 may cause the image generation AI to generate an image according to the state of the associated specific object. Specifically, when the image generation unit 214 causes the image generation AI to generate an image 52 of an accessory, the image generation unit 214 may cause the image generation AI to generate an image according to the state of the character equipped with the accessory (for example, a state that changes during the progress of an event).

[0069] The generation of an image according to the state of a specific object can be performed as follows. For example, during the execution of an event in which the state of the specific object may change, the image generation unit 214 may cause the image generation AI to generate an image 52 of an associated object according to the state of the specific object. Here, the state of the specific object may be the state of a parameter of the specific object that may change during the progress of the event. Specifically, if the event is an event in which the player character fights an enemy character, the state of the specific object may be the state of a parameter such as the player character's stamina value or magical power value. Furthermore, the state of the specific object may be the state of the appearance of the specific object that may change during the progress of the event. Specifically, if the event is an event in which the player character fights an enemy character, the state of the specific object may be the state of a scratch or dirt on the player character's face.

[0070] Specifically, the image generation unit 214 may input an original image 54 to the image generation AI and instruct the image generation AI to generate an image 52 of an attached object corresponding to a specific object included in the original image 54, thereby causing the AI to generate an image 52 of the attached object corresponding to the state of the specific object. That is, for example, when causing the AI to generate an image 52 of an attached object corresponding to the appearance state of a specific object, if the appearance state of the specific object changes as the event progresses, the image of the generated attached object may correspond to the appearance state of the specific object by instructing the AI to generate an image 52 of the attached object corresponding to the specific object included in the original image 54. More specifically, for example, as shown in FIGS. 5( a) and 5(b), multiple original images 54 of a specific object with different appearance states may be stored in the storage unit 220 in advance. Then, the image generation unit 214 may determine which original image 54 from the multiple original images 54 with different appearance states to input to the image generation AI depending on the status of the event, and input the determined original image 54 to the image generation AI to generate an image 52 of the attached object. Alternatively, image generation unit 214 may use the image currently being displayed on display unit 18 as original image 54. That is, even in conventional games and video streaming, the appearance state of a character can change as the event progresses, but by inputting the image of the character currently being displayed on the screen (or scheduled to be displayed immediately thereafter) at each timing during the event as original image 54 to the image generation AI, it is possible to generate image 52 of the accompanying object according to the appearance state.

[0071] Furthermore, the image generation unit 214 may input the original image 54 to the image generation AI, and also input a character string corresponding to the state of a specific object included in the original image 54 to the image generation AI, and cause the image generation AI to generate an image in which an image 52 of an attached object is added to an image 51 of the specific object included in the original image 54 based on the character string, thereby causing the image generation AI to generate an image 52 of the attached object corresponding to the state of the specific object. That is, for example, when causing the image generation AI to generate an image 52 of an attached object corresponding to the parameter state of a specific object, a character string corresponding to the parameter state is input to the image generation AI along with the original image 54, and the image generation AI is instructed to add an image 52 of the attached object corresponding to the character string to the original image 54, so that the generated image 52 of the attached object corresponds to the state of the specific object (even when the same original image 54 is input regardless of the state of the specific object). Specifically, when causing an AI to generate an image of equipment according to the state of the player character's stamina, in a situation where the stamina is decreasing due to an attack from an enemy character, a character string indicating that the stamina is decreasing may be input to the image generation AI along with the original image 54, and the image generation AI may be instructed to add an image of equipment appropriate for the situation where the stamina is decreasing to the original image 54. Also, in a situation where the stamina is decreasing due to an attack from an enemy character, a character string indicating that the equipment has been damaged by the attack may be input to the image generation AI along with the original image 54, and the image generation AI may be instructed to add an image of the equipment damaged by the attack to the original image.

[0072] The image generation unit 214 may cause the image generation AI to generate the event-related image 50 automatically (in other words, at a predetermined timing (for example, periodically)), or may cause the image generation AI to generate the event-related image 50 based on a predetermined operation by the user. For example, the operation reception unit 111 may be capable of receiving an operation related to changing the equipment of a character while an event is in progress, and the image generation unit 214 may cause the image generation AI to generate the event-related image 50 based on the operation.

[0073] In this way, the image generation unit 214 causes the AI to generate images of a specific object and an associated object associated with the specific object that are displayed on one screen of the terminal device 10, but the terminal device 10 does not have to be a terminal device used by a game player. For example, the terminal device 10 may be a terminal device used by a game creator, a terminal device used by a viewer who watches a video broadcast, or a terminal device used by a broadcaster who broadcasts a video. In other words, the screen may be a screen related to game production, or a screen related to video viewing or broadcasting.

[0074] (Processing related to the generation of images of attached objects) Next, with reference to FIG. 6, an example of processing related to generation of an image of an associated object associated with a specific object will be described.

[0075] First, when a predetermined condition is satisfied, the image generation unit 214 determines to execute image generation by the image generation AI (step S101). The predetermined condition is satisfied, for example, when a predetermined input operation is performed by the user. Specifically, the predetermined condition may be satisfied, for example, when a user performs an input operation to instruct the creation of equipment on the equipment creation screen 30. Furthermore, the predetermined condition may be satisfied when a predetermined event occurs during an event in a configuration in which image generation by the image generation AI is executed during the progress of the event. Furthermore, the predetermined condition may be satisfied when a predetermined timing arrives during the progress of the event.

[0076] When it is determined that the image generation AI should generate an image, the image generation unit 214 inputs input information to the image generation AI to be used for generating the images 36, 52 of the attached objects, and causes the image generation AI to generate the images 36, 52 of the attached objects based on the input information (step S102). The input information may include, for example, an image 32 or an original image 54. The input information may also include information regarding the characteristics or state of a specific object. The input information may also include information regarding the characteristics of an object input by the user.

[0077] Next, the image generating unit 214 acquires (in other words, receives) the images 36, 52 of the attached objects generated by the image generating AI (step S103).

[0078] Next, the image generation unit 214 displays the images 36, 52 of the associated objects generated by the image generation AI and the images of the specific objects associated with the associated objects on the display unit 18 of the terminal device 10 (in other words, on one screen) (step S104). Specifically, the image generation unit 214 transmits the images 36, 52 of the associated objects generated by the image generation AI to the terminal device 10. Furthermore, upon receiving the images 36, 52 of the associated objects, the control unit 110 of the terminal device 10 displays the images 36, 52 of the associated objects and the images of the specific objects associated with the associated objects on the display unit 18. Here, the image generation unit 214 may transmit the images themselves generated by the image generation AI to the terminal device 10, or may transmit the images generated by the image generation AI to the terminal device 10 as part of a composite image obtained by combining the images with another image (for example, an image of a specific object, etc.). The control unit 110 of the terminal device 10 may then display the composite image on the display unit 18, thereby displaying the image 36, 52 of the associated object and the image of the specific object to which the associated object is attached on the display unit 18. Furthermore, the image itself output by the image generation AI may include the image 36, 52 of the associated object and the image of the specific object to which the associated object is attached. Furthermore, the image of the specific object displayed together with the image 36, 52 of the associated object does not have to be sent from the control unit 210 at the same timing as the image of the associated object is sent. The control unit 110 of the terminal device 10 may composite the image of the specific object sent from the control unit 210 at a first timing (or an image of the specific object pre-stored in the storage unit 120) with the image of the associated object sent from the control unit 210 at a second timing, and display the composite image on the display unit 18. In other words, the control performed by the information processing system 1 may be such that the image 36, 52 of the associated object generated by the image generation AI and the image of the specific object to which the associated object is attached are displayed on a single screen as a result. Here, the image of a specific object is not generated by image generation AI.

[0079] [Second embodiment] Next, a second embodiment of the present invention will be described. The information processing system 1 of the second embodiment may employ the contents described in the first embodiment to the extent that no contradiction occurs. For example, the information processing system 1 of the second embodiment may include part or all of the configuration of the information processing system 1 of the first embodiment. In the following, the matters described in the first embodiment will be omitted or simplified.

[0080] The image generation unit 214 may cause a predetermined AI to generate an image triggered by a specific object making a specific movement (in other words, a motion), and may display the image generated by the predetermined AI on a predetermined display means. For example, the image generation unit 214 may cause a predetermined AI to generate an image triggered by a specific character displayed on the display unit 18 of the user's terminal device 10 making a specific movement, and may display the image generated by the predetermined AI on the display unit 18 of the user's terminal device 10. In this case, the image generation unit 214 may display the image generated by the predetermined AI together with the specific character on the display unit 18. Note that the specific object may be a character (including an avatar, etc.) or an object in a virtual space other than a character (in other words, an object existing in the virtual world). The specific object may also be an object (e.g., a character) operated by a user. The specific movement may be any movement including a running movement, a jumping movement, a singing movement, an eating movement, a movement of performing a specific attack or defense, a changing movement, a movement of moving hands or feet, a moving movement, a falling movement, etc. In other words, the specific movement may be a specific motion of the character. In the following, the specified AI will be referred to as an image generation AI. The image generated by the image generation AI will be referred to as an output image. The image input to the image generation AI when generating the output image will be referred to as an input image.

[0081] The output image may be a background image, an image of an object that constitutes the background, an image of an object used by a specific object, etc. In other words, the output image may be an image relating to an object around a specific object (for example, a character). In other words, the output image may be an image for performing a predetermined effect in combination with a specific object.

[0082] The image generation unit 214 causes the image generation AI to generate an output image when a specific object displayed on the display unit 18 of the user's terminal device 10 makes a specific movement. The image generation unit 214 also sends this output image to the terminal device 10 and causes it to be displayed on the display unit 18. Specifically, the image generation unit 214 causes this output image to be displayed on the display unit 18 together with the specific object. That is, the control unit 110 of the terminal device 10 causes the sent output image to be displayed on the terminal device 10. In this embodiment, the image generated by the image generation AI is displayed on the display unit 18 together with the specific object. That is, on the display unit 18, a predetermined effect is produced by combining the output image and the specific object, and the predetermined effect is visually recognized by the user. That is, according to the technology of this embodiment, it is possible to realize an effect in which, when a character makes a specific movement on the screen viewed by the user, an output image generated by the image generation AI appears on the screen. Specifically, when a character makes a specific movement on the screen viewed by the user, an image of the character's background (in other words, an image of the object surrounding the character) is generated by the image generation AI, and the image of the character's background is switched to the image generated by the image generation AI. Note that the output image generated by the image generation AI does not have to be displayed on the display unit 18 together with the specific object. That is, for example, when a character makes a specific movement on the screen viewed by the user and an output image generated by the image generation AI appears on the screen, the character can disappear from the screen and the output image appears instead.

[0083] In this way, the image generation unit 214 may cause the image generation AI to generate an output image triggered by a specific movement of a character displayed on the display unit 18 of the user's terminal device 10, and may cause the output image generated by the image generation AI to be displayed on the display unit 18. However, the character does not have to be a character operated by the user. For example, the user may be a viewer watching a video stream (e.g., a live stream), and the character may be a character appearing in the video stream. In other words, the image generation unit 214 may cause the image generation AI to generate an output image triggered by a specific movement of a character displayed on the display unit 18 of the viewer's terminal device 10, and may execute control to display the output image generated by the image generation AI on the display unit 18.

[0084] The generation of an image triggered by a specific object making a specific movement may be the generation of an image triggered by an AI capable of detecting a specific movement of a specific object detecting the specific movement. Furthermore, the generation of an image triggered by a specific object making a specific movement may be the generation of an image triggered by a user performing a predetermined operation that causes the specific object to make a specific movement.

[0085] Specifically, AI (hereinafter referred to as "detection AI") capable of detecting a specific movement (e.g., a jump by the specific object) of a specific object shown in an image (in other words, in a video) is publicly known, and the image generation unit 214 may input an image displayed on the display unit 18 (in other words, the image being displayed) to this type of AI and cause it to detect a specific movement of the specific object. In other words, the image generation unit 214 may cause the detection AI to detect a specific movement of a specific object (in other words, a specific object in the image displayed on the display unit 18) while a predetermined event is in progress. Then, when the detection AI detects a specific movement of the specific object, the image generation unit 214 may cause the image generation AI to generate an image. Note that the detection AI and the image generation AI may be the same AI or different AIs.

[0086] As is well known, in games and the like, a user can make a character perform a specific movement by performing a predetermined operation. Specifically, in games and the like, operations for making a player character jump, an operation for making a player character run, etc. are defined, and the player character moves in accordance with the operation. When the operation receiving unit 111 receives a user operation for making a specific object perform a specific movement, the image generating unit 214 may cause the image generation AI to generate an image based on the operation.

[0087] Note that image generation triggered by a specific object making a specific movement may be executed after the specific object makes the specific movement on display unit 18, or may be executed after it is determined that the specific object will make the specific movement on display unit 18 but before the specific movement. That is, for example, when an AI detects a specific movement of a specific object from a video displayed on display unit 18 and generates an output image, the AI may be configured to be able to detect the specific movement of the specific object before a scene in the video in which the specific object makes the specific movement is displayed on display unit 18, or may be configured to detect the specific movement of the specific object after a scene in the video in which the specific object makes the specific movement is displayed on display unit 18. Specifically, for example, image generation unit 214 may input the video to detection AI prior to playback of the video on display unit 18, and cause detection of the specific movement by the detection AI to be executed prior to display on display unit 18. Furthermore, when an image is generated based on a user performing a specified operation that causes a specific object to perform a specific movement, the image generation AI may generate an output image after the specified operation is performed and before a display of the specific object performing a specific movement is displayed on the display unit 18, or the image generation AI may generate an output image after a display of the specific object performing a specific movement is displayed on the display unit 18.

[0088] The image generation unit 214 inputs input information necessary for generating an image to the image generation AI, causing it to generate an output image. The input information may or may not include the input image. In other words, the image generation unit 214 may cause the image generation AI to generate an output image based on a predetermined input image, or may cause it to generate an output image without being given an input image. For example, there are known generation AIs that can generate output images based on prompts such as "Please generate a background image to be used in a game" or "Please generate a background image to be used in video streaming" (in other words, without requiring an input image). The image generation unit 214 may input such prompts as input information to the image generation AI, causing it to generate an output image.

[0089] Furthermore, the image generation unit 214 may cause the image generation AI to generate an output image corresponding to the movement of a specific object. For example, when a character runs, an image of a grass field is generated as the output image; when a character sings, an image of a stage or an image of a microphone is generated as the output image; when a character eats, an image of a restaurant or an image of food is generated as the output image; and so on. Regarding the generation of an output image corresponding to the movement of a specific object, the theme (in other words, the outline) of the output image may be determined by the image generation AI, or the image generation unit 214 may instruct the image generation AI. In other words, the determination of what kind of output image is appropriate for various movements of the player character (for example, the determination that "an image of a grass field is appropriate" for the movement of running, or the determination that "an image of a restaurant is appropriate" for the movement of eating) may be performed by the image generation AI, or by an AI other than the image generation AI. In addition, the correspondence between the type of movement and the theme (in other words, outline) of the output image is pre-registered in the memory unit 220, such as an image of a grassland for a running movement and an image of a restaurant for an eating movement, and when the image generation unit 214 identifies the type of movement of a specific object based on detection by the detection AI or user operation, it may instruct the image generation AI to generate an output image in line with the theme corresponding to the identified type of movement.

[0090] For example, the image generation unit 214 may input an image displayed on the display unit 18 (in other words, an image in which a specific object moves) as an input image to the image generation AI and instruct the image generation AI to generate an output image (e.g., a background image) corresponding to the movement of the specific object in the input image. An image generation AI that generates an output image corresponding to the movement of a specific object in the input image in this manner can also be generated by, for example, providing a machine learning model with a combination of the movement of the specific object and the answer to the output image as training data. An image generation AI that generates an output image corresponding to the movement of a specific object in the input image can also be generated by, for example, providing a machine learning model with an image of an object making a specific movement, including a background, as training data. The image generation AI generated in this manner can simultaneously detect that a specific object in the input image has made a specific movement, determine a theme appropriate for the specific movement, and generate an output image appropriate for the specific movement.

[0091] Furthermore, for example, the image generation unit 214 may determine a theme (in other words, an outline) of an output image according to a specific movement of a specific object identified based on detection by the detection AI or a user operation, and instruct the image generation AI to generate an output image with the determined theme. The image generation unit 214 may determine the theme of the output image based on a correspondence between pre-registered types of movement and themes. That is, the image generation unit 214 may determine, as the theme of the output image, a theme that is pre-set as a theme corresponding to a specific movement. Furthermore, the image generation unit 214 may instruct a predetermined AI to propose a theme suitable for a specific movement, and determine the proposed theme as the theme of the output image.

[0092] Furthermore, the image generation unit 214 may cause the image generation AI to generate an image according to the appearance of a specific object. For example, if the equipment (in other words, the clothing) of the character is a swimsuit, a background image of a beach may be generated as the output image, and if the equipment of the player character is a uniform, a background image of a school may be generated as the output image. In this way, an output image according to the appearance of a specific object may be generated by the image generation AI.

[0093] For example, the image generation unit 214 may input information about the appearance of a specific object to the image generation AI as input information, and cause the image generation AI to generate an output image based on the information, thereby causing the image generation AI to generate an output image corresponding to the appearance of the specific object. Specifically, the image generation unit 214 may input an image showing the appearance of a specific object, such as a display image displayed on the display unit 18, as input information to the image generation AI, and cause the image generation AI to generate an output image based on the input information, thereby causing the image generation AI to generate an output image corresponding to the appearance of the specific object. In other words, the image generation unit 214 may cause the AI to detect appearance characteristics of the specific object and generate an output image corresponding to the detected characteristics. Note that the AI that detects the appearance characteristics may be the same AI as the image generation AI or a different AI. Furthermore, the image generation unit 214 may input, as input information, character strings indicating the appearance characteristics of a specific object displayed on the display unit 18 (e.g., character strings indicating that the character is wearing a swimsuit) to the image generation AI, and cause the image generation AI to generate an output image based on the input information, thereby causing the image generation AI to generate an output image corresponding to the appearance of the specific object. In this case, the image generation unit 214 may determine the character strings to input to the image generation AI according to the appearance of the specific object (e.g., according to equipment, etc.). For example, if a character as a specific object is wearing a swimsuit, the image generation unit 214 may input, as input information, a prompt such as "Please generate a background image to be used in the game that suits a character in a swimsuit" to the image generation AI, and cause the image generation AI to generate an output image.

[0094] (Processing related to the generation of images triggered by specific movements) Next, with reference to FIG. 7, an example of processing for generating an image triggered by a specific object making a specific movement will be described.

[0095] First, the image generation unit 214 determines whether or not a specific object displayed on the display unit 18 of the terminal device 10 has made a specific movement (step S201). Here, the determination of whether or not a specific movement has occurred may be a determination of whether or not the specific object has made a specific movement. Alternatively, the determination of whether or not a specific movement has occurred may be a determination of whether or not the specific object is about to make a specific movement. For example, the image generation unit 214 may determine that a specific movement has occurred when a detection AI capable of detecting a specific movement of a specific object in an image displayed on the display unit 18 has detected the specific movement. Alternatively, the image generation unit 214 may determine that a specific movement has occurred when a user has performed an input operation that causes the specific object to make a specific movement.

[0096] If a specific object has a specific movement, the image generation unit 214 determines to generate an image using the image generation AI (step S202).

[0097] When it is decided to execute image generation by the image generation AI, the image generation unit 214 inputs input information required for generating an output image to the image generation AI, and causes the image generation AI to generate the output image (step S203).

[0098] Next, the image generation unit 214 acquires (in other words, receives) the output image generated by the image generation AI (step S204).

[0099] Next, the image generation unit 214 displays the output image generated by the image generation AI and the image of the specific object on the display unit 18 of the terminal device 10 (in other words, on one screen) (step S205). For example, the image generation unit 214 displays the image of the character as the specific object and the background image generated by the image generation AI (in other words, an image related to objects around the character) on one screen.

[0100] The present invention is not limited to the above-described embodiments and can be modified and implemented in various ways without departing from the spirit and scope of the present invention. Furthermore, the technology described herein may be applied to services other than games (in other words, applications). Furthermore, the technology described herein may also be used in the development process of services such as game production. Within the scope of the present invention, the components may be freely combined, any component may be modified, any component may be replaced, any component may be omitted, or other components may be added. Furthermore, the process flow described herein is merely an example, and the order and configuration of each process may be different. Furthermore, some processes described herein may not exist. In other words, the process flow, specific determination processes, etc. may differ from those exemplified herein.

[0101] <Additional Notes> The configuration of this embodiment may be used, for example, to prepare images in a non-traditional manner and use them in providing services. The configuration of this embodiment may also be used, for example, to enhance entertainment value. The matters described in the above embodiment may also be written as follows:

[0102] (Appendix 1-1) Computer, With respect to a specific object and an associated object associated with the specific object that are displayed on one screen in a game, the image generating unit 214 functions as an image generating means (for example, an image generating unit 214) that causes the AI to generate an image of the associated object without causing the AI to generate an image of the specific object. program. With this configuration, it is possible to have AI generate images for some of the objects displayed on a single screen, and not have AI generate images for other objects. Therefore, for example, the burden of preparing images in advance for AI generation can be reduced. Furthermore, for example, the images generated by AI can produce unexpected images compared to images prepared by humans in advance, thereby improving the entertainment value of the game. Furthermore, for example, in cases where the game creator cannot predict in advance what kind of images should be prepared, it becomes possible to prepare images to be used in the game. Furthermore, for example, by not having AI generate images for some objects, the game creator can create the images themselves, improving the entertainment value of the game.

[0103] (Appendix 1-2) the specific object is an object operated by a player of the game, The accompanying object is an accessory of the specific object. The program described in Appendix 1-1. With this configuration, for example, the game creator can create the main parts such as characters and maintain the game's worldview, while still achieving the effects described in Appendix 1-1.

[0104] (Appendix 1-3) The AI that generates the image of the associated object generates the image of the associated object by adding the image of the associated object to the original image without processing the portion of the original image that includes the image of the specific object and corresponds to the specific object identified by the AI. The program described in Appendix 1-1 or 1-2. According to this configuration, for example, by preparing an image depicting a specific object, it is possible to create an image in which an additional object is added to this image.

[0105] (Appendix 1-4) The image generating means causes an AI to generate an image of the associated object according to the characteristics of the specific object. The program described in Appendix 1-1 or 1-2. According to this configuration, for example, the characteristics of a specific object can be reflected in the image of the associated object generated by AI.

[0106] (Appendix 1-5) The image generating means causes an AI to generate an image of the associated object according to the state of the specific object. The program described in Appendix 1-1 or 1-2. According to this configuration, for example, the state of a specific object can be reflected in the image of the associated object generated by AI.

[0107] (Appendix 1-6) The image generation means causes an AI to generate an image of the attached object based on characteristics of the attached object input by a player of the game. The program described in Appendix 1-1 or 1-2. According to this configuration, the user can give instructions regarding the image of the attached object to be generated.

[0108] (Appendix 2-1) Computer, The AI is made to generate an image triggered by a specific object being displayed on a predetermined display means making a specific movement, and the AI is made to function as a control means (for example, the image generation unit 214) that controls the display of the image generated by the AI on the predetermined display means. program. This configuration makes it possible to create unprecedented effects, such as displaying an image generated by AI when a specific object makes a specific movement, thereby improving the interest of the service. Also, for example, the image displayed when a specific object makes a specific movement can be changed depending on the situation, thereby improving the interest of the service.

[0109] (Appendix 2-2) The control means causes the AI to generate the image according to the movement of the specific object. The program described in Appendix 2-1. With this configuration, for example, it is possible to have the AI generate images that match the movement of a specific object.

[0110] (Appendix 2-3) The control means causes the AI to generate the image according to the appearance of the specific object. The program described in Appendix 2-1. With this configuration, for example, it is possible to have the AI generate an image that matches the appearance of a specific object.

[0111] (Appendix 2-4) The image generated by AI is displayed on the predetermined display means together with the specific object. A program described in any one of Appendices 2-1 to 2-3. With this configuration, it becomes possible to create an unprecedented effect, for example, by displaying an image generated by AI together with a specific object when the specific object is making a specific movement.

[0112] (Appendix 2-5) The control means causes an AI capable of detecting the specific movement of the specific object to generate the image when the AI detects the specific movement. A program described in any one of Appendices 2-1 to 2-3. With this configuration, for example, it is possible to determine that a specific object has made a specific movement from a predetermined image, and then generate the image using AI.

[0113] (Appendix 2-6) The control means causes the AI to generate the image based on a predetermined operation performed by a user to cause the specific object to perform the specific movement. A program described in any one of Appendices 2-1 to 2-3. With this configuration, for example, it is possible to realize the generation of images by AI at appropriate timing without the need to detect specific movements of specific objects based on images, etc.

[0114] The problem-solving means constituted by the above-mentioned program (for example, each configuration described in the appendix) can be appropriately diverted to an apparatus, system, method, medium, etc. [Explanation of symbols]

[0115] 1 Information processing system, 10 Terminal device, 11 Processor, 12 Memory, 13 Storage, 14 Communication IF, 15 Input / output IF, 17 Input unit, 18 Display unit, 20 Server, 21 Processor, 22 Memory, 23 Storage, 24 Communication IF, 25 Input / output IF, 110 Control unit, 111 Operation acceptance unit, 112 Transmission / reception unit, 113 Game control unit, 114 Display control unit, 120 Memory unit, 210 Control unit, 211 Transmission / reception unit, 212 Game control unit, 214 Image generation unit, 220 Memory unit

Claims

1. Computer, With respect to a specific object and an associated object associated with the specific object that are displayed on one screen in a game, the image generating means functions as an image generating means that causes the AI to generate an image of the associated object without causing the AI to generate an image of the specific object. program.

2. the specific object is an object operated by a player of the game, The accompanying object is an accessory of the specific object. The program according to claim 1.

3. The AI that generates the image of the associated object does not process the portion of the original image that includes the image of the specific object and corresponds to the specific object identified by the AI, and generates the image of the associated object by adding the image of the associated object to the original image. The program according to claim 1 or 2.

4. The image generating means causes AI to generate an image of the associated object according to the characteristics of the specific object. The program according to claim 1 or 2.

5. The image generating means causes an AI to generate an image of the associated object according to the state of the specific object. The program according to claim 1 or 2.

6. The image generation means causes an AI to generate an image of the attached object based on characteristics of the attached object input by a player of the game. The program according to claim 1 or 2.

Images