Computer system and communication control method

Abstract

When a communication event in which a target character (7) communicates with an opponent character (8) occurs during content provision, a server system (1100) sets background information (728) based on at least one of the status of content, the status of the target character (7), the status of the opponent character (8), and the relationship between the target character (7) and the opponent character (8). The server system (1100) generates comprehensive generation instruction information (730) on the basis of communication transmission information and the background information (728), imparts the comprehensive generation instruction information (730) to a server-side generation AI (20), and causes the server-side generation AI (20) to generate expression information for causing the target character (7) to express communication.

Description

Computer System and Communication Control Method

[0001] The present invention relates to a computer system and the like.

[0002] Communication with NPCs (Non Player Characters) that appear in video games is an important factor affecting the charm of the game world. For example, various technologies have been devised regarding speech, which is a representative example of communication.

[0003] Patent Document 1 describes a technique in which a plurality of lines and a plurality of display conditions are associated and stored in advance, and even if the user does not input a line, a line that conforms to the display conditions is automatically selected according to the game situation at that time and displayed within the game screen.

[0004] Japanese Patent Application Laid-Open No. 2010-131082

[0005] In recent years, the use of a generation unit represented by generative AI (Artificial Intelligence) in video games has been explored.

[0006] The problem to be solved by the present invention is to realize the control when an NPC communicates by using a generation unit.

[0007] The first disclosure is a transmission information setting unit that sets transmission information, which is information transmitted when a target character communicates with a given partner character in content where a plurality of characters appear; a background information setting unit that sets background information based on at least one of the situation of the content, the situation of the target character, the situation of the partner character, and the relationship between the target character and the partner character; a representation information acquisition control unit that generates generation instruction information based on the transmission information and the background information and gives the generation instruction information to a given generation unit to perform control to acquire representation information when the target character communicates; and a communication control execution unit that executes the communication control based on the representation information, and is a computer system including these components.

[0008] In this context, "communication" refers to the use of expressions (such as speech, gestures, musical performance, singing, hand signals, etc.) by a target character to convey information to another character. In the case of a conversation, one utterance from the target character to the other character constitutes one instance of communication.

[0009] A generation unit, such as a generation AI, is trained to generate data in a format specified by the generation instruction information, according to the information contained in that instruction information. According to the first disclosure, a computer system can provide the generation unit with generation instruction information that includes at least one of the following: the state of the content, the state of the target character, the state of the opponent character, and the relationship between the target character and the opponent character. The generation unit generates representation information corresponding to these, so the computer system can make the NPC perform communication according to at least one of the following: the state of the content, the state of the target character, the state of the opponent character, and the relationship between the target character and the opponent character. In other words, control over communication between NPCs appearing in a video game can be realized using the generation unit.

[0010] The second disclosure is a computer system in which, in the above-mentioned computer system, the communication information setting unit sets the communication information when the conditions for the occurrence of the communication based on the progress status, which is the status of the content and / or the status of the target character, are met, and the background information setting unit sets the background information when the conditions for the occurrence are met.

[0011] According to the second disclosure, the computer system will be able to set communication information and background information when the progress status, which is the status of the content and / or the status of the target character, satisfies the conditions for occurrence.

[0012] The third disclosure is a computer system further comprising a satisfaction monitoring unit that defines preconditions for satisfying the occurrence requirements and monitors whether the occurrence requirements are satisfied when the preconditions are met.

[0013] According to the third disclosure, for example, a computer system uses conditions concerning past circumstances from the present as preconditions and monitors whether the occurrence requirements are met when these preconditions are met. In situations where the preconditions are not met, it is not necessary to monitor whether the occurrence requirements are met.

[0014] The fourth disclosure is a computer system in which, in the above-mentioned computer system, the expression information acquisition control unit variably controls the amount of information of the generation instruction information based on the billing information of the user playing the content.

[0015] According to the fourth disclosure, the computer system will be able to variably control the amount of information in the generation instruction information based on the billing information.

[0016] The fifth disclosure is a computer system in which the background information includes at least the history of the status of the content and / or the history of the status of the target character.

[0017] According to the fifth disclosure, the computer system will be able to set background information, including the history of the content's situation and the history of the target character's situation.

[0018] The sixth disclosure is a computer system in which, in the above-mentioned computer system, the background information setting unit determines the scope of the circumstances to be included in the background information.

[0019] According to the sixth disclosure, the computer system will be able to determine the scope of the contextual history to be included in the background information.

[0020] The seventh disclosure is a computer system in which, in the above-mentioned computer system, the candidate control items for the communication control include the lines of the target character, the voice of the target character, the motion of the target character, and the performance during communication.

[0021] According to the seventh disclosure, the computer system will be able to control communication using any of the following: the target character's lines, the target character's spoken voice, the target character's motion, or the presentation during communication.

[0022] The eighth disclosure is a computer system in which, in the above-mentioned computer system, the communication control execution unit executes the communication control by including at least the lines of the target character as control items from among the candidate control items.

[0023] According to the eighth disclosure, the computer system will be able to enable communication, at least by having the target character speak.

[0024] The ninth disclosure is a computer system in which, in the above-described computer system, the representation information acquisition control unit acquires the representation information for the control items by generating the generation instruction information, which includes item specification information that specifies the candidate control items to be used as control items, and provides it to the generation unit, and the communication control execution unit executes the communication control by controlling the control items based on the representation information.

[0025] According to the ninth disclosure, the computer system will be able to specify the representation information to be generated by the generation unit using control item specification information.

[0026] The tenth disclosure is a computer system in which, in the above-mentioned computer system, the expression information acquisition control unit variably determines the item designation information according to the number of target characters.

[0027] According to the tenth disclosure, the computer system can change the representation information generated by the generation unit according to the number of target characters.

[0028] The eleventh disclosure is a computer system in which the generation unit comprises a control item-specific generation unit for each of the control item candidates, and a control unit that causes the control item-specific generation unit to generate representation information relating to the control item based on the generation instruction information.

[0029] According to the eleventh disclosure, the computer system will be able to generate representation information using a generation unit having a control item generation unit and a control unit.

[0030] The twelfth disclosure is a computer system in which, in the above-mentioned computer system, the control unit variably determines the generation order and causes the control item generation unit to generate representation information related to the control item according to the said generation order.

[0031] According to the twelfth disclosure, the computer system will be able to change the order in which it generates representation information.

[0032] The thirteenth disclosure is a computer system further comprising a control time length determination unit that determines the length of the communication control, wherein the expression information acquisition control unit provides the generation unit with the control time length included in the generation instruction information.

[0033] According to the 13th disclosure, the computer system will be able to determine the control time length for communication control.

[0034] The fourteenth disclosure is a computer system further comprising a control time length determination unit that determines the length of the communication control, wherein the expression information acquisition control unit provides the control time length to the control unit including the control time length in the generation instruction information, the control unit determines candidate control items to be the control items based on the control time length, and causes the control item generation unit corresponding to the candidate control item to generate expression information related to the control item.

[0035] According to the 14th disclosure, the computer system can cause the generation unit to generate representation information of control items according to the control time length of the communication.

[0036] The 15th disclosure is a computer system in which, in the above-mentioned computer system, the control unit causes the control item generation unit to regenerate the expression information related to the control item, based on the expression information related to the control item generated by the control item generation unit, in order to modify the expression information.

[0037] According to the 15th disclosure, the computer system will be able to regenerate the representation information generated by the control item generation unit.

[0038] The sixteenth disclosure is a computer system in which the generation unit comprises a generation unit on the server system side that provides the content and a generation unit on the user terminal side of the content.

[0039] According to the sixteenth disclosure, the computer system will be able to generate representation information using both the generation unit on the server system side and the generation unit on the terminal side.

[0040] The seventeenth disclosure is a computer system in which the generation unit on the server system side has a control unit that determines, based on the generation instruction information, whether to generate the representation information in the generation unit on the server system side or to generate the representation information in the generation unit on the user terminal side.

[0041] According to the seventeenth disclosure, the computer system will be able to decide whether to generate the representation information in the generation unit on the server system side or in the generation unit on the user terminal side.

[0042] The 18th disclosure is a communication control method that a computer system can execute, comprising: setting communication transmission information for a given opponent character in content featuring multiple characters; setting background information based on at least one of the following: the state of the content, the state of the target character, the state of the opponent character, and the relationship between the target character and the opponent character; generating generation instruction information based on the transmission information and the background information, and providing the generation instruction information to a given generation unit to control the acquisition of expression information when the target character engages in the communication; and executing the communication control based on the expression information.

[0043] According to the 18th disclosure, a communication control method can be realized that produces effects similar to those of the first disclosure.

[0044] A system configuration diagram showing an example of the content provision system configuration. A diagram to explain an example of content. A diagram to explain the overview of communication control related to communication events. A diagram to explain a series of communications. A diagram showing an example of the data configuration of character initial setting data. A diagram showing an example of the data configuration of communication event definition data. A diagram to explain the situation history range setting function. A diagram showing an example of comprehensive generation instruction information written in natural language. A diagram to explain an example of the configuration of the server-side generation AI and the generation of expression information for communication control. A diagram to explain the machine learning of the overall AI. A diagram to explain an example of the configuration when the overall AI is composed of multiple AIs and the machine learning of each. A diagram to explain the machine learning of the scenario generation AI. A diagram showing an example of generation instruction information by control item for scenario generation written in natural language. A diagram to explain the generation of expression information from scenario text data. A diagram to explain the machine learning of the speech voice generation AI. A diagram showing an example of generation instruction information by control item for speech voice generation written in natural language. A diagram showing an example of the data configuration of expression information for speech voice. A diagram to explain the machine learning of the motion generation AI. A diagram showing an example of motion generation instruction information by control item described in natural language. A diagram showing an example of the data structure of motion expression information. A diagram to explain the machine learning of VFX generation AI. A diagram showing an example of VFX generation instruction information by control item described in natural language. A diagram showing an example of the data structure of VFX expression information. A diagram to explain the machine learning of SE generation AI. A diagram showing an example of SE generation instruction information by control item described in natural language. A diagram showing an example of the data structure of SE expression information. A diagram showing an example of programs and data stored by the server system. A diagram showing an example of the functional configuration of the server processing unit. A diagram showing an example of the data structure of communication generation management data. A flowchart to explain the processing flow related to content provision executed by the server system. A flowchart continuing from Figure 30. A flowchart to explain the pass / fail judgment processing flow. A diagram showing an example of prerequisite evaluation instruction information described in natural language. A diagram showing an example of transmission information evaluation instruction information described in natural language. A diagram showing an example of impression evaluation instruction information described in natural language.Diagram for explaining a modified example.

[0045] Hereinafter, examples of embodiments of the present invention will be described. Needless to say, the forms to which the present invention can be applied are not limited to the following embodiments.

[0046] FIG. 1 is a system configuration diagram showing a configuration example of a content providing system according to the present embodiment. The content providing system 1000 is a computer system that provides content for virtual experiences in virtual spaces such as video games, virtual activities, shopping, etc. to a plurality of registered users; that is, the content providing system 1000 enables the provision of virtual experiences to users.

[0047] The content providing system  1000 is a computer system including a server system 1100 and user terminals 1500 for each user, which are connected via a network 9 so as to be capable of data communication.

[0048] The network 9 means a communication path capable of data communication. That is, the network 9 includes, in addition to a dedicated line (dedicated cable) for direct connection and a LAN (Local Area Network) such as Ethernet (registered trademark), a telephone communication network, a cable network, the Internet, etc. <00,00097>

[0049] The server system 1100 is a computer system that performs various processes such as management control of information of registered users and various controls related to content provision (for example, game progress control), and has a database 1140.

[0050] The server system 1100 has a control board 1150 mounted on the main unit 1101. The control board 1150 is equipped with various microprocessors such as a CPU (Central Processing Unit) 1151, a GPU (Graphics Processing Unit), and a DSP (Digital Signal Processor), various IC memories 1152 such as VRAM, RAM, and ROM, and a communication device 1153. Some or all of the functions mounted on the control board 1150 may be implemented by an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or a SoC (System on a Chip).

[0051] Although Figure 1 depicts the server system 1100 as a single server device, it may also be implemented using multiple devices. For example, the server system 1100 may be configured with multiple servers, each responsible for a specific function, connected to each other via an internal bus or network 9 for data communication.

[0052] The server system 1100 has a server-side generation AI 20. The server-side generation AI 20 is implemented using a machine learning AI model based on hardware employing a multicore architecture (e.g., a group of GPUs and memory, a group of AI chips, etc.). The hardware of the server-side generation AI 20 is not limited to being exclusive to the server system 1100. The server-side generation AI 20 may be implemented as a single multimodal generation AI model, or it may be configured as an AI group having one or more generation AIs for each type of data to be generated (e.g., text, voice, motion, etc.). In other words, the server-side generation AI 20 is the generation unit 230 on the server system side.

[0053] The user terminal 1500 serves as a man-machine interface (MMIF) for user 2 to play content as a player. For example, if the content to be played is a game, the user terminal 1500 functions as a gameplay terminal for user 2, who is the player. Although only one user terminal 1500 is depicted in Figure 1, in actual operation, it is common for multiple user terminals 1500 to communicate with the server system 1100 simultaneously.

[0054] The user terminal 1500 is a computer system that can connect to the network 9, such as a personal computer, smartphone, wearable computer, portable game console, home game console, or tablet computer.

[0055] The user terminal 1500 is a computer comprising an operation input device, an image display device, a communication device, and a control board 1550 for performing calculations. Examples of the operation input device include a touch panel 1506, a keyboard, a game controller, and a mouse. Examples of the image display device include a touch panel 1506, a head-mounted display, and a glasses-type display.

[0056] The control board 1550 is equipped with a CPU 1551, various microprocessors such as a GPU and DSP, various IC memories 1552 such as VRAM, RAM, and ROM, and a communication module 1553 connected to the network 9. These elements mounted on the control board 1550 are electrically connected via bus circuits and the like, enabling data reading and writing, and signal transmission and reception. Part or all of the control board 1550 may be an ASIC, FPGA, or SoC.

[0057] The control board 1550 stores programs and various data necessary to realize the functions of the user terminal 1500 in the IC memory 1552. The user terminal 1500 realizes the functions of a play terminal for playing content by executing a predetermined application program.

[0058] The user terminal 1500 has a terminal-side generation AI 30. The terminal-side generation AI 30 is implemented by a machine learning-based AI model on hardware employing a multi-core architecture (e.g., a group of GPUs and memory, a group of AI chips, etc.). The hardware of the terminal-side generation AI 30 is not limited to being exclusive to the user terminal 1500. The terminal-side generation AI 30 may be implemented as a single multimodal generation AI model, or it may be configured as an AI group having one or more generation AIs for each type of data to be generated (e.g., text, voice, motion, etc.). In other words, the terminal-side generation AI 30 is the user terminal-side generation unit 230t. In this embodiment, the terminal-side generation AI 30 is assumed to be a single generation AI that generates scenario text including character dialogue text.

[0059] Figure 2 is a diagram illustrating an example of content. The content provision system 1000 provides a video game as content in which a player character 4 and NPCs 5 (5a, 5b, ...) appear in a game space constructed in a virtual three-dimensional space. The game genre can be set as appropriate, but for example, as shown in the example of game screen W2, it may be an action RPG (Role Playing Game) in which the story unfolds as the player character 4 and NPCs 5 fight together as allies against enemy NPCs 6.

[0060] Figure 3 is a diagram illustrating the overview of communication control related to a communication event, which is an in-game event. When a communication event occurs during gameplay, a series of communications take place between multiple NPCs 5 within that event. In the example in Figure 3, as shown in the example of event screen W4, NPC 5a and NPC 5b encounter and fight an enemy NPC 6d while separated from the player character 4. Before the battle begins, NPC 5a and NPC 5b communicate with each other to confirm their intention to fight.

[0061] Figure 4 is a diagram illustrating a series of communications. A series of communications consists of a sequence of N individual communications (the parts enclosed by dotted lines in Figure 4) that are executed according to a given execution order (where N is an integer greater than or equal to 1). The number of individual communications that make up a series of communications is determined according to the status of the content at that time and the status of the communicating NPC 5 (details will be described later).

[0062] Focusing on individual communication, there is a target character 7 that transmits the information in that individual communication, and a counterpart character 8 that receives the information. In individual communication, there is one target character 7, but there may be one counterpart character 8 or multiple counterpart characters depending on the progress of the game.

[0063] The information to be conveyed is the content and information that you want to communicate to the other party. This information is conveyed through various forms of communication by the target character 7. Examples of forms of communication include the display of dialogue text, the emission of spoken voice lines reading the dialogue text, and the motion of the target character 7 (including gestures, hand signs, etc.). Other forms of expression include the display of visual effects (VFX) and the emission of sound effects (SE; BGM). The choice of which form of expression to adopt will be determined according to the content situation and the situation of the NPC at that time (details will be described later).

[0064] The server system 1100, for each individual communication, has the server-side AI 20 generate and acquire expression information for the target character 7, which is the NPC 5, to express the communication information. Then, it uses the acquired expression information to cause the target character 7 to express the communication. This is called communication control to the target character 7.

[0065] Returning to Figure 3, the server system 1100 instructs the server-side generation AI 20 and the terminal-side generation AI 30 to generate representation information to represent that NPC 5a and NPC 5b are communicating. To this end, the server system 1100 generates comprehensive generation instruction information 730 to be given to the server-side generation AI 20, and in doing so, includes (or attaches) background information 728 to the comprehensive generation instruction information 730.

[0066] Background information 728 is information about the factors that the server-side generated AI 20 uses to decide how to express the content to be conveyed in communication, and it is information about various backgrounds in which communication takes place. Background information 728 is set based on at least one of the following: the content situation, the situation of the target character 7, the situation of the other character 8, the personality of the target character 7, the personality of the other character 8, the relationship between the target character 7 and the other character 8, and information about the communication event that occurred.

[0067] In this embodiment, the content status corresponds to the game progress. The content status is indicated by the content status log 706, which the server system 1100 continuously records at predetermined intervals or after each game operation, starting from the start of content provision. The content status log 706 may also be replay data that allows the game to be reproduced.

[0068] A single content status log 706 stores various data describing the game's progress at the time of recording. For example, a content status log 706 includes the play time at the time of recording (e.g., elapsed time since the start of play), the game world date and time, the game progress, the game stage ID and event ID being played, and data on game world background objects. Of course, other data may also be included as appropriate.

[0069] The character status log 708 is a log related to the content status, but it is a character-specific log prepared for each character appearing (player character 4, NPC 5, enemy NPC 6), and stores various information indicating the latest status of the character at the time of recording. The status of target character 7 and the status of opponent character 8 will be shown in the character status log 708 corresponding to those characters.

[0070] A single character status log 708 may include, for example, the character ID, the time of play at the time of recording, the character's position coordinates, the character's level, and ability parameter values ​​(e.g., HP, MP, skill points, etc.). Other information such as status ailments, equipment information, and the name of the group the character belongs to may also be included as appropriate.

[0071] The personality of target character 7, the personality of opponent character 8, and the relationship between target character 7 and opponent character 8 are all described in the personality information 530 of the character initial setup data 520 prepared for each NPC 5.

[0072] Figure 5 shows an example of the data structure of the character initial setup data 520. The character initial setup data 520 includes the character ID 522, character model data 524, personality information 530, and character relationship information 535. Of course, other data may be included as appropriate.

[0073] Personality information 530 includes basic setting information 531, personality description text 532, speech pattern description text 533, and gesture characteristic description text 534. Of course, other data may be included as appropriate.

[0074] Basic setting information 531 stores information such as the character's name, age, and race. Personality description text 532 is a natural language description of the character's personality. Speech style description text 533 is a natural language description of the character's speech style. Gesture characteristic description text 534 is a natural language description of the character's gestures, body language, and mannerisms.

[0075] The character relationship information 535 is various information that indicates the relationship between the character in question and the related character (player character 4, other NPC 5). For example, one character relationship information 535 stores the related character ID and the relationship description text in association. The relationship description text is a natural language explanation that describes the relationship between the character in question and the related character (what the character thinks).

[0076] Information about the communication events that occur is predefined by communication event definition data 550, which is prepared for each event, as shown in Figure 6.

[0077] A single communication event definition data 550 includes an event ID 552, a target character ID 554, and event occurrence requirements 556. It also includes background information 560, expression form information 562, transmission information 564, and performance policy information 566. Of course, other data may be included as appropriate.

[0078] The starting character ID 554 indicates which NPC 5 will be the target character 7 in the first individual communication.

[0079] The event occurrence requirement 556 specifies the conditions that must be met for the communication event to occur. This requirement is described by combining one or more subconditions 557 with AND or OR. Examples of subconditions 557 may include a pre-content status condition 557a, a pre-target character status condition 557b, a current content status condition 557c, a current target character status condition 557d, a current opponent character status condition 557e, a character relationship condition 557f, and so on.

[0080] Pre-content status condition 557a and pre-target character status condition 557b indicate conditions that must be met regarding the past content status and the past target character status, respectively. For example, pre-content status condition 557a could be "battling in a dungeon" or "the event in the dungeon where the boss character appears has not occurred." For example, pre-target character status condition 557b could be "was inside a dungeon" or "target character 7 used a predetermined number of recovery items." In other words, each sub-condition 557 is set as a condition that must be met regarding the circumstances leading up to the current situation.

[0081] The extent to which the historical context needs to be considered to determine whether sub-condition 557 is met is determined each time using a predetermined historical context range setting function 580, such as the one shown in Figure 7.

[0082] The situation history range setting function 580 uses parameter values ​​that describe the game situation as variables to calculate log reference range specification values ​​(for example, past range of play time, number of logs to go back in time, etc.) that refer to the content situation log 706 and character situation log 708 (see Figure 3). The parameter values ​​that describe the game situation here may be, for example, content progress (game progress, number of game stages cleared, etc.), character level of target character 7, number of opponent characters 8, intimacy level between target character 7 and opponent character 8, etc.

[0083] Returning to Figure 6, the current content status condition 557c, the current target character status condition 557d, and the current opponent character status condition 557e indicate the conditions that must be met for the current content status, the status of target character 7, and the status of opponent character 8, respectively. For example, the content status condition 557c could be "an event has occurred in a village under attack by enemies" or "target character 7 and opponent character 8 are alone together." The current target character status condition 557d could be "reached within a predetermined distance from the village under attack by enemies." The opponent character status condition 557e could be "HP and MP are both below half."

[0084] Character relationship condition 557f specifies the conditions that must be met regarding the relationship between target character 7 and opponent character 8.

[0085] Furthermore, these sub-conditions 557 may effectively be treated as "not specified" or "unlimited" in some cases.

[0086] The background situation information 560 is text data that describes the sequence of events, the situation in which the target character 7 and the opponent character 8 are located, etc., in natural language.

[0087] The expression form information 562 is text data that describes in natural language which character communicates in what form of expression during the communication event. The expression form information 562 also describes the correspondence between the type of character and the communication information (first communication information and second communication information in the example in Figure 6).

[0088] The communication information 564 is text data that describes the content that the initiating character 7 wants to convey to the other character 8 in a communication event, with the first communication information being the content that the other character 8 wants to convey to the initiating character 7, and the second communication information being the content that the other character 8 wants to convey to the initiating character 7. The communication information 564 may not be specific text data, but may also contain predetermined data that means "not set". In this case, the conversation in the communication event corresponds to ad-libs generated by the server-side AI 20.

[0089] The production policy information 566 is information that indicates how the communication event should be produced and is written in natural language. The production policy information 566 includes, for example, the control time length that can be used for a series of communications in the communication event, the number of times individual communications should be performed, and instructions regarding VFX and SE.

[0090] Figure 8 shows an example of a comprehensive generation instruction information 730 written in natural language. The comprehensive generation instruction information 730 includes a generation purpose description 731, a prerequisite situation description 732, an expression form description 733, a production policy description 735, reference information 736, and setting communication information 737. Of course, other descriptions may also be included as appropriate. The prerequisite situation description 732 to the reference information 736 constitute background information 728.

[0091] The generation purpose description 731 is a common template. The prerequisite situation description 732 is a copy of the prerequisite situation information 560 (see Figure 6) of the communication event that will occur. The expression form description 733 is a copy of the expression form information 562 (see Figure 6) of the communication event that will occur. The expression form description 733 also serves as item specification information 734, which specifies candidate control items that should be used as control items for the target character 7 in individual communication.

[0092] The production policy description 735 is a copy of the production policy information 566 (see Figure 6) for the communication events that will occur.

[0093] Reference information 736 includes the following information (or address information): (1) A copy 736a of the personality information 530 (see Figure 5) of the initiating character (NPC 5 with initiating character ID 554 of the communication event that occurs) and the other character 8. (2) A copy 734b of the character relationship information 535 from the perspective of the initiating character to the other character 8 and the character relationship information 535 (see Figure 5) from the perspective of the other character 8 to the initiating character. (3) A copy 734dc of the log within the status sequence range from the content status log 706 and the character status log 708 (see Figure 3).

[0094] The setting transmission information 737 is a copy of the transmission information 564 (see Figure 6) of the communication event that occurred, and indicates the transmission information set for that event.

[0095] Figure 9 is a diagram illustrating an example configuration of the server-side generated AI 20 and the generation of representation information for communication control. The server-side generated AI 20 includes a general AI 21 and control item-specific generated AIs 23 (23a, 746b, ...) prepared for each control item.

[0096] Control items are control items in communication control, and represent the types of forms of communication expression. Control items include dialogue text (including narration), spoken voice of a character reading the dialogue text, character motion, visual effects (VFX), and auditory effects (SE, BGM).

[0097] Therefore, the server-side generation AI 20 includes a scenario generation AI 23a that generates a scenario for a communication event including dialogue text, a speech voice generation AI 23b that generates spoken audio, and a motion generation AI 23c that generates motion. It also includes a VFX generation AI 23d that generates VFX, and a SE generation AI 23e that generates SE and BGM.

[0098] The overall AI 21 determines, in the order of execution of individual communications, which control item-specific generation AI 23 will be assigned to generate the control items related to each individual communication, and in what order. It then generates control item-specific generation instruction information for the assigned generation AI and provides it to each assigned generation AI, and obtains control item-specific expression information 766 (756a, 756b, ...) based on the generated data. It can be said that the overall AI 21 is in charge of supervision or production, causing the various control item-specific generation AIs 23 to generate the expression information 766.

[0099] The generated representation information 766 is associated with the individual communication execution order 762 and the target character ID 764 that will perform the individual communication, and is stored as a single communication dataset 760. The communication dataset 760 is then applied to the NPC 5 indicated by the target character ID 764 in the communication control of the individual communication execution order 762.

[0100] The overall AI 21 sets the assigned generation AI from among the control item-specific generation AIs of the server-side generation AI 20 and the control item-specific generation AIs of the terminal-side generation AI 30. In this embodiment, the terminal-side generation AI 30 is limited to the scenario generation AI 33a only. Therefore, in this embodiment, the overall AI 21 sets the assigned generation AI for a scenario including dialogue text to either the server-side scenario generation AI 23a or the terminal-side scenario generation AI 33a. Specifically, the former may be set as the assigned generation AI if the amount of information in the transmission information included in the overall generation instruction information 730 reaches a predetermined threshold, i.e., if it is likely to be a long line of dialogue; otherwise, the latter may be set as the assigned generation AI. Of course, the terminal-side generation AI 30 may also have a configuration in which it has multiple control item-specific generation AIs, similar to the server-side generation AI 20.

[0101] Figure 10 is a diagram illustrating the machine learning of the integrated AI 21. The integrated AI 21 receives the comprehensive generation instruction information 730 prepared for training, a list of available control item-specific generation AIs, load information for each control item-specific generation AI, and annotations as input. It is pre-trained to output a generation order generation control item list for each individual communication and generation instruction information for each generation item for each individual communication, and it supports generation instructions in natural language.

[0102] As mentioned above, the comprehensive generation instruction information 730 includes various types of information used for communication control, such as the control time length, content status, character status, transmission information, and production policy.

[0103] The list of generation order control items for each individual communication shows the control items for communication control in the order they are generated, corresponding to the execution order of the N individual communications that make up the series of communications performed by the communication event that occurred.

[0104] Candidate control items for individual communication include dialogue text (including narration), spoken voice of the character reading the dialogue text, character motion, visual effects (VFX), and auditory effects (SE, BGM). Which of these control items is applied is determined by the overall AI 21 based on various information included in the comprehensive generation instruction information 730, such as control time length, content status, character status, communication information settings, and performance policy settings.

[0105] For example, if, as the first individual communication, target character 7 mutters without moving, the dialogue text and spoken audio are selected as control items. If the control items include dialogue text, the overall AI 21 prioritizes the generation order of the dialogue text. For the second and subsequent generation orders, the control items may be assigned in order of how long they are expected to take to generate.

[0106] Figure 11 is a diagram illustrating an example configuration of the overall AI 21 when it is composed of multiple AIs, and the machine learning processes of each. The overall AI 21 may include a control item setting AI 21a, a generation 담당 setting AI 21b, and a generation instruction information generation AI 21c.

[0107] The control item setting AI 21a is pre-trained to take the comprehensive generation instruction information 730 prepared for learning and annotations as input and output a list of generation control items in the order of generation for each individual communication, and it supports generation instructions in natural language. Based on the description of the control time length included in the performance policy description 735 of the comprehensive generation instruction information 730, the control item setting AI 21a determines the control items for each individual communication so that the series of communications is completed within the given time limit.

[0108] The generation-responsible AI 21b is pre-trained to take in a list of generation control items in the order of generation for each individual communication, a list of available generation AIs for each control item, load information for each generation AI for each control item, and annotations, and to output a list of generation AIs responsible for each control item. The list of generation control items in the order of generation is a list for each individual communication output from the control item setting AI 21a, which was prepared for training. The list of generation AIs responsible for each control item is a list of generation AIs responsible for generating each input control item. Furthermore, the generation-responsible AI 21b supports generation instructions in natural language.

[0109] The generation instruction information generation AI 21c is pre-trained to take the comprehensive generation instruction information prepared for training, the list of generation AIs responsible for each control item output by the generation assignment setting AI 21b, and annotations as input, and to output generation instruction information for each control item corresponding to the input generation AI. Furthermore, the generation instruction information generation AI 21c supports generation instructions in natural language.

[0110] Figure 12 is a diagram illustrating the machine learning of the scenario generation AI 23a. The scenario generation AI 23a is implemented, for example, as a Large Language Model (LLM) of the Generative Pretrained Transformer (GPT) type.

[0111] The scenario generation AI 23a is pre-trained to output scenario text data by inputting control item-specific generation instruction information, comprehensive generation instruction information 730, and annotations prepared for training, and supports generation instructions in natural language.

[0112] In generating a scenario, the scenario generation AI 23a determines the content of individual communications so that a series of communications are completed within the control time length included in the production policy description 735 of the overall generation instruction information 730. Then, the scenario generation AI 23a outputs scenario text data that includes the determined content of individual communications.

[0113] Furthermore, the scenario generation AI 23a has been reinforced to output a classification of the series of communications depicted in a given scenario, based on pre-training. In other words, the scenario generation AI 23a can estimate the personalities of the characters involved, based on the preconditions under which the series of communications depicted in the scenario take place, and output the classification result.

[0114] Furthermore, the scenario generation AI 23a has been reinforced through prior training so that when the text to be evaluated and the reference text are input, it can output an evaluation of whether the reference text can be considered to contain the text to be evaluated. In other words, the scenario generation AI 23a can compare and evaluate the semantic content of the text to be evaluated (e.g., scenario text data) with the semantic content of the reference document (e.g., communication information 564 in the communication event that occurred; see Figure 6).

[0115] Furthermore, the scenario generation AI 23a has been reinforced through prior training so that, when the text to be evaluated and the reference text are input, it can output an evaluation of whether the impression given to the reader of the text to be evaluated matches the impression specified by the reference text. In other words, the scenario generation AI 23a can compare the impression evaluation of the content of the text to be evaluated (e.g., scenario text data) with the impression evaluation of the content of the reference text (e.g., communication direction policy information 568 in the communication event that occurred; see Figure 6).

[0116] Figure 13 shows an example of control item-specific generation instruction information 742a for scenario generation, which is provided to a scenario generation AI 23a written in natural language. For the content enclosed in angle brackets <> in the text of the control item-specific generation instruction information 742a, the scenario generation AI 23a refers to the overall generation instruction information 730 (see Figure 8), which is provided together with the control item-specific generation instruction information 742a for scenario generation.

[0117] Figure 14 is a diagram illustrating the generation of representation information 766 from scenario text data. The scenario generation AI 23a generates scenario text data 750, detects and separates character-specific lines in the scenario individually (for example, as a single unit of quotation marks in the scenario), and generates individual line data 752. The scenario generation AI 23a also detects and separates character-specific action descriptions (silent gestures, silent body language) from the stage directions of the scenario individually, and generates action description data 754 without dialogue.

[0118] The individual dialogue data 752 stores the dialogue character ID indicating the target character 7 that speaks the dialogue, the order in which the individual communication is performed, and the dialogue text data in association with each other. The individual dialogue data 752 becomes the expression information 766a of the dialogue text.

[0119] The action description data 754 without dialogue includes a dialogue character ID indicating the target character 7 performing the action without dialogue, the order in which individual communications are executed, and the action description text.

[0120] The motion expression information 766c is generated based on the motion description data 754, which does not include dialogue. The motion description text is included in the control item-specific generation instruction information 742 and provided to the motion generation AI 23c, which then determines what type of motion the motion generation AI 23c will generate.

[0121] Figure 15 is a diagram illustrating the machine learning of the speech generation AI 23b. The speech generation AI 23b is pre-trained to receive generation instruction information for each control item of speech generation prepared for training, as well as annotations, and to output speech representation information 766b, and it supports generation instructions in natural language.

[0122] Figure 16 shows an example of control item-specific generation instruction information 742b for speech generation, which is provided to a speech generation AI 23b written in natural language. The control item-specific generation instruction information 742b for speech generation includes preconditions, the dialogue text to be converted into speech, the production policy, and information about the personality and tone of voice of the target character 7 to speak.

[0123] Regarding the prerequisites and production policy, the prerequisite situation description 732 and production policy description 735 (see Figure 8) of the comprehensive generation instruction information 730 are copied. The dialogue text to be converted into voice is copied from the expression information 766a of the dialogue text. Regarding the personality and tone of voice of the target character 7, information about the personality and tone of voice of the target character 7 is copied from the reference information 736 (see Figure 8) of the comprehensive generation instruction information 730.

[0124] Figure 17 shows an example of the data structure of the speech expression information 766b. The speech expression information 766b includes the target character ID, the order of individual communication execution, and the generated speech data. The speech data is the audio data in which the speech generation AI 23b pronounces the input dialogue text in the input tone, in the input context, and with the input personality.

[0125] Figure 18 is a diagram illustrating the machine learning of the motion generation AI 23c. The motion generation AI 23c is pre-trained to take control item-specific generation instruction information and annotations prepared for training as input and output motion data representation information 766c, and it supports generation instructions in natural language.

[0126] Figure 19 shows an example of motion generation instruction information 742c for control items, which is given to a motion generation AI 23c written in natural language. The motion generation instruction information 742c for control items includes information on the dialogue text or action description without dialogue to match the motion, and the status of the target character 7. It also includes information on the personality of the target character 7 that will perform the motion, the gesture characteristics of the target character 7 that will perform the motion, and the direction policy.

[0127] For dialogue text, the expression information 766a of the dialogue text is copied (see Figure 14). For action descriptions without dialogue, the action description data 754 without dialogue is copied (see Figure 14). For the situation of the target character 7, the information regarding the situation history of the target character 7 from the reference information 736 of the comprehensive generation instruction information 730 (see Figure 8) is copied. For the personality and gesture characteristics of the target character 7, the information on the personality of the initial target character from the reference information 736 of the comprehensive generation instruction information 730 is copied. For the direction policy, the direction policy description 735 of the comprehensive generation instruction information 730 (see Figure 8) is copied.

[0128] Figure 20 shows an example of the data structure of motion representation information 766c. Motion representation information 766c includes the target character ID, the order of individual communication execution, and the generated motion data. The motion data is a motion used when the target character 7 speaks dialogue text or a motion that performs an action description without dialogue, and is a motion that is in line with the direction policy and the personality and gesture characteristics of the target character 7.

[0129] Figure 21 is a diagram illustrating the machine learning of the VFX generation AI 23d. The VFX generation AI 23d is pre-trained to take in VFX generation control item-specific generation instruction information and annotations prepared for training, and to output VFX representation information 766d, and it supports generation instructions in natural language.

[0130] Figure 22 shows an example of control item-specific generation instruction information 742d for VFX generation, which is provided to the VFX generation AI 23d written in natural language. The control item-specific generation instruction information 742d for VFX generation includes information on dialogue text or action descriptions without dialogue, and a direction policy. For dialogue text, the expression information 766a of the dialogue text is copied (see Figure 14). For action descriptions without dialogue, the action description data 754 without dialogue is copied (see Figure 14). For direction policies, the direction policy description 735 of the comprehensive generation instruction information 730 (see Figure 8) is copied.

[0131] Figure 23 shows an example of the data structure of VFX expression information 766d. The VFX expression information 766d includes the target character ID, the order of individual communication execution, and the generated VFX data. The VFX data is data for displaying when the target character 7 speaks dialogue text or performs actions without dialogue, and is data for executing visual effects in accordance with the production policy.

[0132] Figure 24 is a diagram illustrating the machine learning of the SE generation AI 23e. The SE generation AI 23e is pre-trained to take in SE generation instruction information for each control item and annotations prepared for training, and output SE representation information 766e, and it supports generation instructions in natural language.

[0133] Figure 25 shows an example of control item-specific generation instruction information 742e for SE generation provided to SE generation AI 23e written in natural language. The control item-specific generation instruction information 742e for SE generation includes information on dialogue text or action description without dialogue, and a production policy. For dialogue text, the expression information 766a of the dialogue text is copied. For action description without dialogue, the action description data 754 without dialogue is copied. For production policy, the production policy description 735 of the comprehensive generation instruction information 730 is copied.

[0134] Figure 26 shows an example of the data structure of SE expression information 766e. SE expression information 766e includes the target character ID, the order of individual communication execution, and the generated SE data and BGM data. SE data and BGM data are sound data emitted when the target character 7 speaks dialogue text or performs actions without dialogue, and are data for executing auditory effects in accordance with the production policy.

[0135] Figure 27 shows an example of programs and data stored by the server system 1100. The server system 1100 stores the server program 501, the distribution client program 503, the trained AI model 508, user information 600 for each user 2, and play data 700 in the IC memory 1152. It also stores content initial setup data 510 in the database 1140. Of course, other data may be stored as appropriate.

[0136] The server system 1100 performs the server program 501 on the CPU 1151, thereby realizing the function of a server processing unit 200s, as shown in Figure 28. The server program 501 may include a generation AI program 502 for realizing the functions of a server-side generation AI 20 and a control item-specific generation AI 23. Alternatively, the generation AI program 502 may be stored separately.

[0137] The server processing unit 200s performs various controls related to content provision. Specifically, the server processing unit 200s includes a user information management unit 202, a billing control unit 204, a content provision control unit 206, a sufficiency monitoring unit 210, a transmission information setting unit 212, a background information setting unit 214, and an expression information acquisition control unit 216. It also includes a communication control execution unit 218, a control time length determination unit 220, a generation unit 230, an available generation unit monitoring unit 236, a processing load monitoring unit 238, and a timing unit 290.

[0138] The user information management unit 202 executes a prescribed player registration procedure (user registration procedure) and controls the registration and management of user information 600 for each user 2.

[0139] The billing control unit 204 performs billing processing to process payments for content. For example, it processes payments for playing content and for purchasing paid items usable in the content. Once the billing control unit 204 has processed a payment, it causes the user information management unit 202 to update the billing information contained in the user information 600.

[0140] The content provision control unit 206 controls the progress of the content and provides it to the user terminal 1500. In this embodiment, the content is a video game, so the control will be for the progress of gameplay.

[0141] The satisfaction monitoring unit 210 has defined preconditions for satisfying the event occurrence requirements 556 (see Figure 6) for each communication event, and monitors whether the occurrence requirements are satisfied when the preconditions are met. Specifically, if the event occurrence requirements 556 include preconditions for content status 557a and preconditions for target character status 557b, the satisfaction monitoring unit 210 monitors whether the event occurrence requirements 556 are satisfied, including whether these conditions are met during content provision.

[0142] The communication information setting unit 212 sets the communication information for individual communications. Specifically, the communication information setting unit 212 refers to the communication information 564 of the communication event definition data 550 that satisfies the event occurrence requirement 556 (see Figure 6).

[0143] The background information setting unit 214 sets background information 728 based on at least one of the following: the status of the content, the status of the target character 7, the status of the opponent character 8, and the relationship between the target character 7 and the opponent character 8 (see Figure 3).

[0144] The expression information acquisition control unit 216 generates generation instruction information based on the transmission information 564 and background information 728, and provides this generation instruction information to a given generation AI (Artificial Intelligence) to perform control to acquire expression information 766 when the target character 7 engages in individual communication.

[0145] The communication control execution unit 218 performs communication control based on the representation information 766.

[0146] The control time length determination unit 220 determines the control time length, which is the length of the communication control. Specifically, the control time length determination unit 220 refers to the time length specified in the performance policy information 566 of the communication event definition data 550 (see Figure 6).

[0147] The generation unit 230 performs various generation processes related to the acquisition of representation information 766. The server-side generation AI 20 corresponds to this (see Figure 9). The generation unit 230 includes a control item-specific generation unit 232 for each candidate control item, and a general unit 234 that causes the control item-specific generation unit 232 to generate representation information 766 based on the overall generation instruction information 730.

[0148] The available generation unit monitoring unit 236 monitors the available control item generation unit 232.

[0149] The processing load monitoring unit 238 monitors the processing load status for each control item generation unit 232.

[0150] The timing unit 290 uses the system clock to determine the current date and time 900, as well as various times related to the provision of content.

[0151] Returning to Figure 27, the distribution client program 503 is downloaded and executed by the user terminal 1500, thereby enabling the user terminal 1500 to function as a human-machine interface for various control and content provision systems 1000 as a game client.

[0152] A pre-trained AI model 508 is prepared for each AI (overall AI 21, control item-specific generation AI 23) that constitutes the server-side generation A20.

[0153] The content initial setup data 510 stores various initial setup data necessary for the execution of the content. For example, the content initial setup data 510 includes character initial setup data 520 (see Figure 5), communication event definition data 550 (see Figure 6), and a situation history range setting function 580 (see Figure 7).

[0154] User information 600 is prepared for each user 2 who has completed the prescribed registration procedure, and stores various information associated with that user. One user information 600 includes, for example, a user account, content save data, and billing information (for example, billing history that associates billing date and time with billing amount, statistical values ​​of billing history such as cumulative billing amount, number of billings, and billing frequency).

[0155] The play data 700 stores various information related to the provision of content and is updated by the content provision control unit 206. The play data 700 includes game world background object control data 702 for each object that constitutes the background of the game world, such as the terrain of the game world, and character control data 704 for each character, such as player character 4 and NPC 5. It also includes content status log 706 and character status log 708 (see Figure 3), generated AI monitoring data 710, and communication generation management data 720.

[0156] The generated AI monitoring data 710 is prepared separately for the server-side generated AI 20 and the terminal-side generated AI 30, and stores a availability flag for the AI ​​and processing load status information (e.g., CPU usage, memory usage, etc.).

[0157] The communication generation and management data 720 stores various data related to the generation and acquisition of expression information 766 and other data related to a series of communications performed in a communication event.

[0158] For example, as shown in Figure 29, the communication generation management data 720 includes an event ID 722 indicating the communication event that occurred, a target character ID 724, a partner character ID 726, and background information 728. The communication generation management data 720 also includes overall generation instruction information 730, a list of generation order control items 740, generation instruction information for each control item 742, scenario text data 750, and individual dialogue data 752 (see Figure 14).

[0159] Furthermore, the communication generation and management data 720 includes action description data 754 without dialogue (see Figure 14) and communication datasets 760 for each individual communication (see Figure 9).

[0160] Figures 30 and 31 are flowcharts illustrating the processing flow related to content provision executed by the server system 1100.

[0161] The server system 1100 begins processing and providing content (step S10). If a communication event occurs during content provision (YES in step S12), the server system 1100 determines the target character 7 and the other character 8 for the first individual communication (step S14). The former is the NPC 5 of the target character ID 554 that initiated the event. The latter is another NPC 5 located within a predetermined range from the NPC 5 of the target character ID 554 (see Figure 6).

[0162] Next, the server system 1100 sets the status and timeline range (step S22) and sets the background information 728 (step S24; see Figure 3). Then, the server system 1100 reads the transmission information 564 from the communication event definition data 550 (see Figure 6) of the event that occurred and sets the setting transmission information 737 (see Figure 8) (step S25). Finally, it creates a comprehensive generation instruction information 730 that includes the setting transmission information 737 and the background information 728 (step S26; see Figure 8).

[0163] Next, the server system 1100 provides the overall generation instruction information 730, the list of available control item-specific generation AIs, and the load information for each control item-specific generation AI to the overall AI 21 (step S28). At this time, depending on the data size of the background information 728, the background information 728 may not be included in the overall generation instruction information 730, and some or all of it may be provided as separate data from the overall generation instruction information 730.

[0164] When the overall generation instruction information 730 is provided to the overall AI 21, it outputs a list of generation order control items 740 for each individual communication that constitutes a series of communications in the event that occurred. It also assigns a responsible generation AI to each control item and outputs control item-specific generation instruction information 742 to be given to the responsible generation AI. In other words, the server system 1100 acquires the generation order control item list 740 and the control item-specific generation instruction information 742 (step S28).

[0165] Next, the server system 1100 provides the scenario generation AI 23a, which has become the assigned generation AI, with control item-specific generation instruction information 742 and overall generation instruction information 730, causing it to generate scenario text data 750 (step S40; see Figure 14). Then, it performs a pass / fail judgment process on the generated scenario text data 750 (step S42).

[0166] Figure 32 is a flowchart illustrating the flow of the pass / fail judgment process. In the pass / fail judgment process, the server system 1100 instructs the scenario generation AI 23a to estimate the preconditions under which the series of communications depicted in the generated scenario are carried out. The server system 1100 then calculates the similarity between the result of the estimated classification (hereinafter referred to as "estimated classification") and the classification of the situation described in the precondition situation information 560 (see Figure 6) of the event that occurred (step S60). Specifically, the server system 1100 creates precondition evaluation instruction information 770 written in natural language, as shown in Figure 33, and provides it to the scenario generation AI 23a.

[0167] Returning to Figure 32, if the calculated similarity of the situations meets a predetermined passing standard (YES in step S62), the server system 1100 instructs the scenario generation AI 23a to evaluate whether the communication information 564 (see Figure 6) in the event that occurred can be considered to be included in the generated scenario (step S64). Specifically, the server system 1100 creates communication information evaluation instruction information 772 written in natural language, as shown in Figure 34, and provides it to the scenario generation AI 23a.

[0168] Returning to Figure 32, if it can be considered that the communication information 564 in the event that occurred is included in the dialogue (YES in step S66), the server system 1100 has the scenario generation AI 23a estimate and classify the impression (performance effect) that the generated scenario will give to the reader. Then, it has the AI ​​23a calculate the similarity between the result of the estimation and classification and the "performance policy" indicated in the event's performance policy information 566 (see Figure 6) (step S68). Specifically, the server system 1100 creates impression evaluation instruction information 774 written in natural language, as shown in Figure 35, and provides it to the scenario generation AI 23a.

[0169] Returning to Figure 32, if the calculated similarity reaches the predetermined passing standard (YES in step S70), the server system 1100 considers that the scenario conforms to the production policy for the event in which the scenario occurred, and determines that the scenario is acceptable (step S72).

[0170] If any of steps S62, S66, or S70 is negative, the server system 1100 determines the scenario to be unsuccessful (step S74).

[0171] Returning to Figure 31, if the scenario is unsuccessful (NO in step S90), the server system 1100 discards the scenario text data 750 (step S92) and regenerates the scenario text data 750 (step S94). At this time, the randomness parameter value included in the control item-specific generation instruction information 742 for scenario generation may be slightly changed to increase the randomness before regeneration.

[0172] If the scenario is approved (YES in step S90), the server system 1100 separates individual lines of dialogue from action descriptions without dialogue from the scenario text data 750. Then, it creates individual line of dialogue data 752 and action description data without dialogue 754 (step S96; see Figure 14). The individual line of dialogue data 752 becomes the expression information 766a of the dialogue text.

[0173] Moving to Figure 31, the server system 1100 executes Loop A in the order of execution of the individual communications (steps S100 to S106). In Loop A, the server system 1100 refers to the list of generation order control items 740 for the individual communications to be processed, for control items other than the dialogue text in the individual communications to be processed. Then, according to that generation order, it generates and obtains the respective expression information (step S102).

[0174] Next, the server system 1100 creates a communication dataset 760 for the individual communication to be processed (step S104; see Figure 9), and terminates loop A (step S106).

[0175] Once Loop A has been executed for all individual communications, the server system 1100 applies the communication dataset 760 to the individual communication execution sequence 762. Then, it performs communication control to realize the series of communications (step S108).

[0176] If the content provision is not finished (NO in step S120), the process returns to step S12. If the content provision is finished (YES in step S120), the server system 1100 saves the data (step S124) and terminates the series of processes.

[0177] As described above, according to this embodiment, control over NPC communication can be realized using the generation unit.

[0178] In other words, the server system 1100 automatically generates and acquires expression information 766 from the generation unit 230 based on at least one of the following: the status of the content, the status of the target character 7, the status of the opponent character 8, and the relationship between the target character 7 and the opponent character 8. This reduces the effort and time required for content creation.

[0179] [Modifications] Although examples of embodiments to which the present invention is applied have been described above, the forms to which the present invention can be applied are not limited to the above forms, and components can be added, omitted, or modified as appropriate.

[0180] (Modification 1) For example, the content provision system 1000 may be implemented using a P2P (Peer to Peer) architecture with multiple user terminals 1500. In this case, programs and data corresponding to the division of functions are stored in the user terminals 1500, and functions corresponding to the server processing unit 200s in the above embodiment are distributed and implemented by the user terminals 1500, which act as P2P nodes. The same effects as in the above embodiment can be obtained with this configuration as well.

[0181] (Modification 2) For example, the above embodiment may be modified to change the amount of information in the comprehensive generation instruction information 730 based on the user 2's billing information. Specifically, as shown in Figure 36, when the server system 1100 creates the comprehensive generation instruction information 730, it refers to the billing information in the user information 600 of user 2 and determines the amount of information in the comprehensive generation instruction information 730 using a predefined information amount setting function 536. Then, it applies this to the amount of information in the newly created comprehensive generation instruction information 730.

[0182] The information quantity setting function 536 is a function that calculates information quantities that have a positive relationship with variables such as the total billing amount and the billing frequency.

[0183] (Modification 3) In the above embodiment, regarding the communication control of individual communication, there were cases in which the control items included dialogue text and cases in which they did not. Specifically, an example of the latter case is the communication control of individual communication using action description data 754 (see Figure 14) that does not include dialogue.

[0184] However, it is also possible to omit the separation of the action description data 754 that does not include dialogue. In this configuration, communication control will be executed by including at least the dialogue of the target character 7 among the candidate control items. This configuration is suitable for providing content intended for users who cannot understand gesture-based communication.

[0185] (Modification 4) In the above embodiment, the expression form description 733 (see Figure 8) also serves as the item specification information 734, thereby fixing the control items related to the communication control of individual communications in the communication event, but the embodiment is not limited to this.

[0186] For example, the above embodiment may be modified to include a configuration in which the item specification information 734 is variably determined according to the number of target characters 7. Specifically, the number of opponent characters 8 plus the number of initiating target characters is considered to be the "number of target characters 7" as referred to here. Then, in the expression form information 562 (see Figure 6), descriptions are made to use different control items (expression forms) depending on the range of the "number of target characters 7". For example, if the "number of target characters 7" is "5" or more, the description is limited to one of the control items (expression forms), and if it is less than "5", the description uses multiple control items.

[0187] (Modification #5) In the above embodiment, the content provision system 1000 may be implemented not as a client-server type, but as a single computer system which was the user terminal 1500 in the above embodiment.

[0188] Specifically, the user terminal 1500 stores all the data that the server system 1100 in the above embodiment is supposed to store (see Figure 27). However, instead of the server program 501 and the distribution client program 503, a content provision program is provided as an application program for the user terminal 1500.

[0189] In the above embodiment, the content provision program implements all of the functional units of the server system 1100 (see Figure 28) on the user terminal 1500. In this modified example, the content provision program is executed on the user terminal 1500. The processing flow in the above embodiment (see Figures 31 to 32) can be interpreted by replacing the execution entity from the server system 1100 to the user terminal 1500.

[0190] 5...NPC 7...Target character 8...Opponent character 20...Server-side generated AI 21...Overall AI 23...Control item-specific generated AI 30...Terminal-side generated AI 200s...Server processing unit 210...Fulfillment monitoring unit 212...Transmission information setting unit 214...Background information setting unit 216...Expression information acquisition control unit 218...Communication control execution unit 220...Control time length determination unit 230...Generation unit 230t...User terminal-side generation unit 232...Control item-specific generation unit 234...Overall unit 501...Server program 508...Trained AI model 510...Content initial setting data 520...Character initial setting data 530...Personality information 535...Character relationship information 536...Information amount setting function 550...Communication event definition data 556...Event occurrence requirements 557a...Pre-content status conditions 557b...Pre-target character status conditions 557c...Content status conditions 557d...Current target character status conditions 557f...Character relationship conditions 560...Prerequisite status information 562...Expression form information 564...Transmission information 566...Direction policy information 568...Transmission direction policy information 580...Status history range setting function 700...Play data 706...Content status log 708...Character status log 720...Communication generation management data 728...Background information 730...Overall generation instruction information 734...Item specification information 735...Direction policy description 736...Reference information 737...Setting transmission information 740...Generation order control item list 742...Generation instruction information by control item 750...Scenario text data 762...Individual communication execution order 766...Expression information

Claims

1. A computer system comprising: a transmission information setting unit that sets transmission information which is information that a target character communicates to a given other character in content in which multiple characters appear; a background information setting unit that sets background information based on at least one of the following: the state of the content, the state of the target character, the state of the other character, and the relationship between the target character and the other character; an expression information acquisition control unit that generates generation instruction information based on the transmission information and the background information, and controls the acquisition of expression information when the target character communicates by providing the generation instruction information to a given generation unit; and a communication control execution unit that executes communication control based on the expression information.

2. The computer system according to claim 1, wherein the communication information setting unit sets the communication information when the conditions for the occurrence of the communication based on the progress status, which is the status of the content and / or the status of the target character, are met, and the background information setting unit sets the background information when the conditions for the occurrence are met.

3. The computer system according to claim 2, further comprising: a precondition for satisfying the occurrence requirements, and a satisfaction monitoring unit that monitors whether the occurrence requirements are satisfied when the precondition is met.

4. The computer system according to any one of claims 1 to 3, wherein the expression information acquisition control unit controls the amount of information in the generation instruction information in a variable manner based on the billing information of the user playing the content.

5. The computer system according to any one of claims 1 to 4, wherein the background information includes at least a history of the circumstances of the content and / or the circumstances of the target character.

6. The computer system according to claim 5, wherein the background information setting unit determines the range of the circumstances and history to be included in the background information.

7. The computer system according to any one of claims 1 to 6, wherein the candidate control items for the communication control include the lines of the target character, the voice of the target character, the motion of the target character, and the performance during communication.

8. The computer system according to claim 7, wherein the communication control execution unit performs the communication control by including at least the lines of the target character among the candidate control items as control items.

9. The computer system according to claim 7 or 8, wherein the representation information acquisition control unit acquires representation information for the control items by generating generation instruction information including item specification information that specifies the candidate control items to be the control items and providing it to the generation unit, and the communication control execution unit performs the communication control by controlling the control items based on the representation information.

10. The computer system according to claim 9, wherein the representation information acquisition control unit variably determines the item designation information according to the number of target characters.

11. The computer system according to any one of claims 7 to 10, wherein the generation unit comprises a control item-specific generation unit for each of the control item candidates, and a control unit that causes the control item-specific generation unit to generate representation information relating to the control item based on the generation instruction information.

12. The computer system according to claim 11, wherein the control unit variably determines the generation order and causes the control item generation unit to generate representation information relating to the control item according to the generation order.

13. A computer system according to any one of claims 1 to 12, further comprising: a control time length determination unit that determines the control time length which is the length of the communication control, wherein the expression information acquisition control unit provides the generation unit with the control time length included in the generation instruction information.

14. The computer system according to claim 11 or 12, further comprising: a control time length determination unit that determines the length of the communication control, wherein the expression information acquisition control unit provides the control time length to the control unit including the control time length in the generation instruction information, and the control unit determines the candidate control item to be the control item based on the control time length, and causes the control item-specific generation unit corresponding to the candidate control item to generate expression information relating to the control item.

15. The computer system according to claim 11 or 12, wherein the control unit causes the control item generation unit to regenerate the control item generation unit in order to modify the expression information related to the control item generated by the control item generation unit.

16. The computer system according to any one of claims 1 to 15, wherein the generation unit comprises a generation unit on the server system side that provides the content, and a generation unit on the user terminal side of the content.

17. The computer system according to claim 16, wherein the generation unit on the server system side has a control unit that determines, based on the generation instruction information, whether to generate the representation information in the generation unit on the server system side or in the generation unit on the user terminal side.

18. A communication control method executed by a computer system, comprising: setting communication information which is information that a target character communicates to a given other character in content in which multiple characters appear; setting background information based on at least one of the following: the state of the content, the state of the target character, the state of the other character, and the relationship between the target character and the other character; generating generation instruction information based on the communication information and the background information, and providing the generation instruction information to a given generation unit to perform control to acquire expression information when the target character communicates; and executing the communication control based on the expression information.

Images