Character control device, terminal device, and virtual space provisioning system

Abstract

The objective of the present invention is to cause a computer character to perform operations appropriate for a user.　In a dialog generating server 100 according to the present disclosure, upon accepting a predetermined operation for a plurality of computer characters C1 from a user character C2 operated by a user in a virtual space, an operation determining unit 102 determines a computer character C11 from among the plurality of computer characters C1 that is to respond to the predetermined operation, and determines an operation of the computer character C11 on the basis of an estimated response time required to respond to the predetermined operation. The operation here includes an intervention process for reducing stress on the user related to waiting, such as a gesture, as well as operations such as passing the conversation to another computer character C12. A character control unit 103 then causes a user terminal 200 of the user to display the determined operation of the computer character C11.

Description

[Technical Field]

[0001] The present invention relates to a character control device, a terminal device, and a virtual space providing system for controlling a character in a virtual space. [Background Art]

[0002] Patent Document 1 describes that an NPC object is presented in a virtual space, and the behavior of the NPC object is presented in the virtual space in response to a user's action. [Prior Art Documents] [Patent Documents]

[0003] [Patent Document 1] Japanese Unexamined Patent Publication No. 2019-106220 [Summary of the Invention] [Problem to be Solved by the Invention]

[0004] In the technique described in Patent Document 1, the action of an NPC in accordance with a user's action may be delayed. In such a case, the user cannot achieve smooth communication with a computer character. For example, in a virtual space, while a user is having a conversation with a computer character (e.g., an NPC (Non Player Character)), the computer character needs to think about what kind of response it should give in the conversation with the user. The occurrence of waiting time for the user due to such thinking causes a problem that the waiting time becomes a stress for the user.

[0005] Accordingly, an object of the present invention is to provide a character control device, a terminal device, and a virtual space providing system that can cause a computer character to perform appropriate actions for a user. [Means for Solving the Problem]

[0006] The character control device of the present invention includes an action determination unit that, upon receiving a predetermined action from a user character operated by a user in a virtual space to a plurality of computer characters, determines a response computer character to respond to the predetermined action from among the plurality of computer characters, and determines the action of the response computer character based on the response estimation time for the response to the predetermined action; and a character control unit that displays the determined action of the computer character on the user's user terminal. [Effects of the Invention]

[0007] According to the present invention, it is possible to make a computer character perform actions that are appropriate for the user. [Brief explanation of the drawing]

[0008] [Figure 1] This figure shows the system configuration including the dialogue generation server 100, which is a character control device of this disclosure. [Figure 2] This is a schematic diagram of the virtual space in this disclosure. [Figure 3] This diagram shows the functional configuration of the dialogue generation server 100 and user terminal 200 as disclosed herein. [Figure 4] This figure shows the processing sequence in the dialogue generation server 100 and user terminal 200 of this disclosure. [Figure 5] This flowchart shows the detailed processing steps S103 and S104. [Figure 6] This flowchart shows the detailed processing for determining and controlling the operation of the computer character in process S208. [Figure 7] This figure shows a conversation between user character C2, computer characters C11 and C12 in a virtual space. [Figure 8] This figure shows an example of the hardware configuration of a dialogue generation server 100 according to one embodiment of the present disclosure. [Modes for carrying out the invention]

[0009] Embodiments of this disclosure will be described with reference to the attached drawings. Where possible, the same parts will be denoted by the same reference numerals, and redundant descriptions will be omitted.

[0010] Figure 1 shows a system configuration including a dialogue generation server 100, which is a character control device according to this disclosure. As shown in the figure, the dialogue generation server 100 includes a user information DB 100a and a virtual space information DB 100b. The dialogue generation server 100 generates a virtual space by referring to the virtual space information DB 100b and transmits it to the user terminal 200.

[0011] The user terminal 200 is a terminal device such as a smartphone or VR goggles, and is operated by the user. When the user terminal 200 receives a virtual space from the dialogue generation server 100, it displays user characters and computer characters (so-called NPCs) in that virtual space. User characters and computer characters are characters generated by the dialogue generation server 100.

[0012] Figure 2 is a schematic diagram of the virtual space in this disclosure. As shown in the figure, computer character C1 and user character C2 are placed in the virtual space. In this disclosure, the premise for control is that there are many (N) computer characters C1 and one user character C2, but in a virtual space, there may naturally be multiple user characters.

[0013] Figure 3 is a block diagram showing the functional configuration of the dialogue generation server 100 and user terminal 200 of this disclosure. As shown in the figure, Figure 3(a) is a block diagram showing the functional configuration of the dialogue generation server 100. This dialogue generation server 100 is composed of a communication unit 101, an operation determination unit 102, a character control unit 103, a virtual space provision unit 104, a user information DB 100a, and a virtual space information DB 100b.

[0014] The communication unit 101 is a part that communicates with a user terminal 200. The communication unit 101 receives, from the user terminal 200, information (for example, voice) related to the motion of a user character operated by a user.

[0015] The motion determination unit 102 is a part that determines the motion of a computer character C1 based on information related to motion and user information. Prior to determining the motion, the motion determination unit 102 estimates a response time based on the information related to motion. For example, the motion determination unit 102 calculates the response time of calculation processing for dialogue generation obtained through preliminary verification, and uses this as the response time. For example, for a plurality of conversations in advance, the time required for a computer character to respond to each conversation is calculated through experiments or the like, and the response time is calculated for each conversation. The method of calculating the response time is not limited to the above, and other known methods may also be used.

[0016] Furthermore, the motion determination unit 102 calculates the response time based on a network congestion degree obtained from the network bandwidth between the server and the user terminal. Specifically, the motion determination unit 102 estimates the response time according to the network congestion degree by a method using packets (for example, transmitting a ping and measuring its response time).

[0017] Regarding the calculation of the response time described above, the two examples (delay in conversation content determination, NW delay) have been given, but the calculation is not limited to these, and other events that require response time may also be taken into consideration. Furthermore, the response time is determined based on whichever is the longest among the estimated time until determination of conversation content, the NW delay time, and the delay time caused by other events. In the processing flow described below, for convenience of explanation, the response time based on the estimated time until determination of conversation content and the NW delay time is used, but other delay times may naturally be taken into consideration.

[0018] Then, the motion determination unit 102 determines the motion (intervention process) of the computer character C1 based on the response time. For example, the motion determination unit 102 performs an intervention process using an appropriate user stress relief measure based on the response time. Details of the intervention process and the relationship between the response time and user information will be described later.

[0019] The character control unit 103 is a section that controls the computer character C1 to perform the motion determined by the motion determination unit 102.

[0020] The virtual space providing unit 104 is a section that provides (transmits) a virtual space to the user terminal 200. This virtual space includes a user character C2 and the computer character C1, and the computer character C1 is controlled to operate in accordance with the determined motion, respectively. The user character C2 is controlled to operate in accordance with an operation from the user terminal 200.

[0021] The virtual space information DB 100b is a section that stores information for constructing a virtual space to be provided to the user terminal 200. This virtual space information DB 100b stores, as information for constructing a virtual space, information regarding the virtual space, a specific area arranged therein, and a computer character that operates in the specific area. The specific area is, for example, an area such as a store or a facility where a user character can perform an action such as shopping in the virtual space. It should be noted that, of course, the present invention is not limited thereto, and information for constructing other facilities existing in the real world in the virtual space may also be stored.

[0022] The user information DB 100a is a section that stores user information regarding a user of the user terminal 200. The user information is, for example, user characteristics. In the present disclosure, in particular, the user characteristics include information indicating an acceptance level for a motion (intervention measure) of a computer character, and may include neuroticism, extraversion, openness, agreeableness, conscientiousness, and the like.

[0023] In addition, user information may include at least one piece of information about the user, such as location, time of day, display method of the user character (the character of the speaking user), or the state of the user operating user character C2.

[0024] Figure 3(b) is a block diagram showing the functional configuration of the user terminal 200. As shown in the figure, the user terminal 200 consists of a communication unit 201, a display unit 202, a microphone 203, an operation unit 204, and a speaker 205. This user terminal 200 could take the form of, for example, a VR goggles, but it may also take other forms.

[0025] The communication unit 201 is the part that receives information about the virtual space from the dialogue generation server 100, or transmits user operation information to the dialogue generation server 100.

[0026] The display unit 202 is the part that displays the virtual space, the computer character C1 and user character C2 included in the virtual space, etc.

[0027] Microphone 203 is the part that receives the user's voice for the user character C2 to speak to the computer character C1 in the virtual space.

[0028] The control unit 204 is the part that receives input from the user character C2 in the virtual space. It may also be equipped with a keyboard or similar for text-based communication via chat, etc.

[0029] Speaker 205 is the part that outputs sound from virtual computer characters such as C1.

[0030] Figure 4 shows the processing sequence in the dialogue generation server 100 and user terminal 200 of this disclosure.

[0031] As shown in the diagram, in the virtual space displayed on the user terminal 200, the user (user character C2) speaks to the computer character C1 (S101). Then, the voice data is sent from the user terminal 200 to the dialogue generation server 100 (S102).

[0032] In the dialogue generation server 100, the operation determination unit 102 determines the response computer character and estimates the response time based on the network congestion level and the time required to make an appropriate response to the utterance (S103). Then, the operation determination unit 102 determines the operation of the computer character based on the response time (S104). The response computer character is the character selected by the operation of the computer character and is the character that responds to the user character. In Figure 4, the response computer characters are computer character C11 and computer character C12. Here, one computer character C11 is selected, but multiple computer characters may be selected. Also, one or more computer characters may be selected as the other computer character C12.

[0033] The character control unit 103 transmits character operation control information indicating the character's actions to the user terminal 200 via the virtual space provision unit 104 (S105). At the user terminal 200, the computer character C11 performs an action to select another response computer character C12 to respond to the user character C2, in accordance with the character operation control information (S106). For example, computer character C11 selects computer character C12 by performing an action such as initiating a conversation with computer character C12. As described above, depending on the response time, the user may be kept waiting and stressed. Therefore, the actions here are simple (such as calling out the name of computer character C12), but of course, they are not limited to that.

[0034] Subsequently, in the dialogue generation server 100, the operation decision unit 102 determines the response content according to the utterance of user character C2 (S107). Then, the virtual space provision unit 104 transmits the response content, along with the identification information of the previously determined response computer character, to the user terminal 200 (S108). Then, in the user terminal 200, the computer character C12 selected as another response computer character gives a response to user character C2 according to the response content (S109).

[0035] Figure 5 is a flowchart showing the process of providing the virtual space, and the detailed processing of processes S103 and S104 in Figure 4.

[0036] In the dialogue generation server 100, the virtual space provision unit 104 obtains the time zone, location, and other virtual space information of the virtual space (including the virtual store) from the virtual space information DB 100b and provides that virtual space to the user terminal 200 (S201).

[0037] The communication unit 101 acquires the location information of the user character from the user terminal 200 (S202). The virtual space provision unit 104 also acquires the location information of the computer character (S203). In this way, the virtual space provision unit 104 represents the user character C2 and the computer character C1 in the virtual space and provides them to the user terminal 200.

[0038] The communication unit 101 then acquires user character operation control information from the user terminal 200 (S204). The operation determination unit 102 identifies the response computer character to be controlled based on the operation of user character C2 (including the content of the conversation) (S205). For example, if user character C2 speaks to computer character C11, a response computer character C12 is identified based on user character C2's position, attributes, conversation content, etc. In this disclosure, attributes indicate the gender and age of user character C2. Other attributes include information such as the user's hobbies and preferences and favorite characters. For example, if user character C2 is in a store and the conversation content is such that it is directed at a store clerk (computer character C11), the nearest store clerk computer character C11 is identified as the responding computer character. Furthermore, in this disclosure, other computer characters C12 (such as store clerk characters) that are near computer character C11 may be identified as other responding computer characters. In addition, depending on the gender (attribute) of the user character, for example, if the character is female, a female store clerk computer character may be directed to respond.

[0039] The operation determination unit 102 then calculates the control content for the computer character's actions in accordance with the user character's actions (S206) and estimates the response time (estimated response time) (S207). If the response time is longer than a predetermined time, the operation determination unit 102 determines the computer character's actions according to that time and performs the control (S208). For example, to avoid stressing the user who is waiting for the response time until the control content is determined, the operation determination unit 102 selects a predetermined action (gesture, nod, etc.) or another response computer character, and performs control to cause the other response computer character to perform the predetermined action.

[0040] Subsequently, once the control content is determined, the operation determination unit 102 performs control to operate a computer character corresponding to that control content (S209).

[0041] In Figure 5, the actions of the user and computer character include actions such as speech and gestures.

[0042] Figure 6 is a flowchart showing the detailed processing of the computer character operation determination and control in process S208. The operation determination unit 102 obtains user information (user characteristics, user status, operation information) about the user of the user terminal 200 from the user information DB 100a (S208a). The operation determination unit 102 determines the user's tolerance level based on the above user information (S208b). For example, the user's tolerance level is a value that indicates how much time the user can tolerate waiting, and the larger the value, the greater the tolerance for waiting time. Note that the value may be controlled to increase or decrease depending on the time of day, and may be a value that indicates that people are in a hurry in the morning (low tolerance level) and not in a hurry in the afternoon (high tolerance level).

[0043] Then, the operation determination unit 102 acquires the user's operation status (S208c). The operation determination unit 102 may acquire the user's operation status, such as the speaker volume, or it may acquire the user's operation or setting, such as the user character appearing embarrassed or fidgeting.

[0044] The operation determination unit 102 further acquires information on the perceived distance from the user, the location and closing time of the virtual store, and calculates at least one of the following in addition to the response time: perceived distance from the user, location and closing time of the virtual store, operation state, and acceptance level (S208d). The perceived distance from the user is information based on the positions of the user character and the computer character, and is a virtual distance in the virtual space. The location and closing time of the virtual store are information obtained from the virtual space information DB 100b. In addition to this information, the virtual space information DB 100b may also store the congestion status in the virtual space (or virtual store).

[0045] Then, the action determination unit 102 selects another response computer character according to the degree of acceptance (for example, if the degree of acceptance is low) (S208e). For example, the action determination unit 102 selects another response computer character that is close to the response computer character that was spoken to. Alternatively, it may select another response computer character that is not close to the response computer character in question. As will be described later, the other response computer character may be selected to match the attributes of the user character, etc.

[0046] Here, the operation determination unit 102 selects another response computer character based on the degree of acceptance. However, without performing these processes, it may select another response computer character if the response time exceeds a predetermined amount (i.e., if it takes a long time), or it may select a response computer character according to other factors such as the distance from the user or the location of the virtual store.

[0047] Next, we will explain the selection patterns when one response computer character selects another response computer character.

[0048] The action determination unit 102 selects another computer character to which computer character C1, who has been addressed by the user character, should initiate a conversation, based on the positional relationship or attributes of that other computer character. For example, the action determination unit 102 may select another computer character that is close to the computer character C1 that has been addressed, or a computer character that seems to be good at conversation. Whether a computer character is good at conversation or not is determined based on predetermined setting information for each computer character. In this disclosure, the computer characters operating in the virtual space are set to be various characters such as store clerks working in a virtual store or mere passersby. In this disclosure, each character is controlled to perform actions according to their personality, attributes, characteristics, etc.

[0049] Furthermore, the action determination unit 102 may control the computer character to perform gestures that match the appearance of other selected response computer characters. For example, it is considered good user support to have computer characters behave according to their attributes, such as age and gender, such as an elderly character or a female character.

[0050] Furthermore, the operation determination unit 102 may determine a response computer character based on a specific area in the virtual space where the user character exists (either inside the store or by store type), or based on the user character. For example, the operation determination unit 102 may determine a computer character modeled after a successful businessman, a grandfather, a grandmother, etc., to match the user character who is listening. For example, if the user character is an elderly woman, the operation determination unit 102 may select a computer character modeled after a female store clerk.

[0051] In addition, the following methods can also be considered.

[0052] When a user character (user) has not yet entered into a specific contract (e.g., a point card, a credit card, etc.), and speaks to a computer character advertising such a contract (e.g., a store clerk in charge of credit card contracts), the computer character may direct the conversation to another computer character in charge of the same contract.

[0053] Additionally, if a computer character not intended for customer interaction (for example, a work avatar) is addressed by a user character, the system may direct the conversation to a computer character intended for customer interaction (a customer service avatar).

[0054] Alternatively, a computer character modeled after the user's favorite character can be summoned from a staff-only room in the virtual space (virtual store), and the user can initiate a conversation with this computer character. This user's favorite character can be inferred from user attributes, etc., or it can be set as preference information for each user.

[0055] Figure 7 shows a conversation between user character C2, computer characters C11 and C12 in a virtual space to which the technology of this disclosure is applied. In Figure 7(a), user character C2 asks computer character C11, "What kind of place is Akasaka?"

[0056] Computer character C1 responds with, "Well, um... I guess..." Here, the action decision unit 102 calculates the response time required for responding to the content of user character C2's conversation and determines that the response time is long (more than the predetermined time), so computer character C11 responds with the above content for the time being. Then, the action decision unit 102 further responds with, "Mr. / Ms. XX, you know Akasaka well, don't you?" and turns the conversation to computer character C12. These actions constitute intervention processing to alleviate stress for the user. Note that if the response time is short (within the predetermined time), the action decision unit 102 may have computer character C1 respond only with, "Well, um... I guess..."

[0057] Then, computer character C12 responds, "I know all about it! I went to a sweets shop in Akasaka with a friend the other day, and it was really delicious! Shall we go now?" The action determination unit 102 calculates the content of the computer character's response and the response time, and if the response time is longer than a predetermined time, it causes computer character C11 to initiate a conversation with computer character C12 as a delay mitigation measure.

[0058] In this way, the operation determination unit 102 determines a stress-relieving action (intervention process) according to the response time of computer character C11 or C12, thereby enabling stress relief for the user waiting for a response. Furthermore, depending on the time, it may act to switch the conversation to another computer character C12, thereby further reducing stress for the user waiting for a response.

[0059] Furthermore, depending on the user's situation, the computer character can be made to perform actions appropriate for the user. In this disclosure, it may be possible to have a smoother conversation if computer character C12 responds rather than computer character C11. For example, if computer character C12 is given a more detailed characterization (setting) of Akasaka than computer character C11, it may be more natural to have computer character C12 respond.

[0060] Next, other switching patterns for operation depending on the response time of this disclosure will be described. Figure 7 above is an example of an intervention process, and various other intervention processes are conceivable. In addition, in this disclosure, if the response time of the computer character to which the user character has spoken is long, the computer character may be made to perform a simple action in order to reduce user stress.

[0061] The action determination unit 102, if the response time (delay time) is short, causes the computer character C1 to perform a predetermined gesture. For example, the action determination unit 102 may cause the computer character C1 to perform gestures that indicate deep thought. This ensures that the computer character performs at least some action, thereby reducing the user's stress regarding response time (delay time).

[0062] Furthermore, if the response time is short, the operation determination unit 102 may perform an intervention process that does not create a period of silence, such as by using filler words like "um," or "well," to avoid making the response time (delay time) feel like a delay.

[0063] Furthermore, if the response time is short, the action determination unit 102 may repeat the response, for example, "So you mean (the question)?" This allows for intervention processing that does not give the impression of a long response time.

[0064] Furthermore, if the response time (delay time) is long, the operation determination unit 102 may display a related site or video viewer, and may perform intervention processing to make the user feel that the response time (delay time) is not noticeable depending on the viewing time.

[0065] Furthermore, in addition to considering the above response time, the operation determination unit 102 can determine the operation of the computer character C1 based on user information.

[0066] For example, the action determination unit 102 determines the gesture type based on the distance between computer character C1 and user character C2, based on the location indicated in the user information (in this case, the user information includes location information). The gesture type is a predetermined gesture, but it may also be a large gesture, a small gesture, etc., indicating the size of the body movement. Furthermore, if the location indicated in the user information is in a predetermined store (a crowded store), the action determination unit 102 may determine a gesture based on the store type (high or low level of crowding). The store type and level of crowding may be stored in the virtual space information DB 100b.

[0067] Furthermore, the operation determination unit 102 may determine the type of gesture according to the degree of congestion, not only based on the user's presence in a designated store, but also on information regarding whether the store is crowded or not. Information regarding congestion may be obtained from the virtual space information DB 100b or other devices, or it may be measured. As for the measurement method, for example, the number of user characters displayed in the store may be measured, and if there are more than a predetermined number of user characters, it may be determined that the store is crowded. Alternatively, if a predetermined number of user characters are within a certain distance from the user's user character, it may be determined that the store is crowded, and the gesture of the computer character that the user is speaking to may be made smaller. In addition, if a store in a virtual space merged with the real world is assumed, the actual degree of congestion in the store may be reflected. Other conventional general methods may also be used.

[0068] Furthermore, if the user information indicates a time of day, the action determination unit 102 may determine a quiet gesture if it is a predetermined time of day, such as when the user is sleeping. Also, if the user is in a predetermined store, the action determination unit 102 may determine a gesture that conveys a sense of urgency by speaking a little faster, if it is a busy time before the store closes.

[0069] Furthermore, if the user information includes the display manner of the user character (speaker user), the action determination unit 102 determines the type of gesture corresponding to that display manner. For example, if the speaker user's user character is fidgeting, the action determination unit 102 determines a gesture to make the speaker speak a little faster and appear to be in a hurry. Also, if the speaker user appears embarrassed, the action determination unit 102 determines an action to speak in a low voice or with small gestures.

[0070] Furthermore, if the user information includes the state of the user controlling the user character, the action determination unit 102 determines a gesture to intervene at a normal speed if the conversation is conducted via text, and to intervene quickly if the conversation is conducted via voice. In addition, if the user terminal 200 is set to turn off the speaker (or set the volume to 0 or low), the computer character may operate in a way that can be understood through gestures rather than voice.

[0071] The above user information is set on the user terminal 200, and the user's user character may operate according to that setting, or it may operate according to the user's actions. Furthermore, the user character's actions may be automatically controlled based on information about the computer character. Information about the computer character includes attributes such as gender and age. It is assumed that when the user's user character is facing the computer character, it will operate automatically based on this information without user intervention. For example, if the computer character is set to be a celebrity in the virtual space, the user's user character may act embarrassed in accordance with that attribute. This action is intended to mimic real-world behavior.

[0072] Next, the effects of the dialogue generation server 100 and user terminal 200 of this disclosure will be explained. Although the dialogue generation server 100 functions as a character control device, this character control device does not necessarily have to be a server. A terminal device may function as a character control device. In that case, the terminal device will need the function of generating and providing a virtual space to the user.

[0073] When the dialogue generation server 100 of this disclosure receives a predetermined action from a user character C2 operated by the user in a virtual space to a plurality of computer characters C1, the action determination unit 102 determines at least one response computer character (e.g., computer character C11) to respond to the predetermined action from the plurality of computer characters C1, and determines the action of the at least one response computer character (computer character C11) based on the response estimate time required for the response to the predetermined action. The actions here include intervention processing to reduce user stress from waiting, such as gestures, as well as actions such as shifting the conversation to another computer character C12.

[0074] The character control unit 103 then displays the determined actions of at least one computer character C11 on the user's user terminal 200.

[0075] This configuration allows for the determination of the computer character C11's actions based on the estimated response time, thereby reducing user stress related to waiting for a response. Furthermore, it is possible to determine the optimal computer character C11 from among multiple computer characters C1 based on the user character's actions. In other words, the computer character can be made to perform actions appropriate to the user's situation, enabling smooth operation. While this disclosure focuses on conversation as an action, the above process enables smooth conversation. Of course, it is not limited to conversation; other actions such as gestures and body language may also be used.

[0076] Furthermore, if the operation determination unit 102 of this disclosure selects a plurality of response computer characters (for example, computer characters C11 and C12), it may control one response computer character (computer character C11) to cause the other response computer characters (computer character C12) to perform a response operation to the user character.

[0077] For example, computer character C11 may initiate a conversation with computer character C12, prompting it to respond to a user's question. This allows computer character C12 to take over the action according to the user's situation and other circumstances, enabling smooth operation.

[0078] Furthermore, the operation determination unit 102 may select one response computer character (computer character C11) based on a predetermined operation, and select another computer character (computer character C12) based on the response estimation time.

[0079] Furthermore, the operation determination unit 102 may determine the operation of one computer character C11 (response computer character) or another computer character C12 (response computer character) based on the response estimation time.

[0080] This allows the system to perform actions that might occur in the real world, such as switching the conversation to another computer character C12, thereby reducing user stress from waiting for responses and enabling smoother operation.

[0081] Furthermore, the operation determination unit 102 may determine at least one response computer character based on the conversation content in a predetermined operation of the user character.

[0082] Furthermore, the operation determination unit 102 may determine at least one response computer character based on information regarding the user character.

[0083] Furthermore, the user terminal 200 of this disclosure includes a display unit 202 that displays a virtual space including a user character operated by the user and a computer character controlled by the computer.

[0084] When a predetermined action is performed by a user character C2 operated by the user in the virtual space to a plurality of computer characters C1, the display unit 202 determines a computer character C11 (responding computer character) that will respond to the predetermined action from the plurality of computer characters C1, and displays the action of the responding computer character determined based on the response time (response estimation time) required for the response to the predetermined action.

[0085] Furthermore, the virtual space provision system disclosed herein is a virtual space provision system that includes a user terminal 200, which is a terminal device operated by the user, and a dialogue generation server 100, which is a server device that provides a virtual space to the user terminal 200.

[0086] In the dialogue generation server 100, when the action determination unit 102 receives a predetermined action from a user character C2 operated by the user in the virtual space to a plurality of computer characters C1, it determines which computer character C11 (responding computer character) will respond to the predetermined action from the plurality of computer characters C1, and determines the action of computer character C11 or C12 (responding computer character) based on the response time (estimated response time) required for the predetermined action to be responded to. The character control unit 103 then displays the determined action of the computer character on the user's user terminal 200.

[0087] The user terminal 200 includes a display unit 202 that displays the virtual space, which includes user characters operated by the user and computer characters controlled by the computer.

[0088] The dialogue generation server 100, user terminal 200, and character control system operating as a character control device of the present invention have the following configuration.

[0089] [1] An action determination unit, upon receiving a predetermined action from a user character operated by a user in a virtual space to multiple computer characters, determines at least one response computer character to respond to the predetermined action from among the multiple computer characters, and determines the action of the at least one response computer character based on the response estimation time for the response to the predetermined action. A character control unit that causes the user to present the determined behavior of the at least one response computer character, A character control device equipped with the following features.

[0090] [2] The aforementioned operation determination unit, When multiple response computer characters are selected, one response computer character controls the other response computer characters to perform response actions toward the user character. [1] The character control device described above.

[0091] [3] The aforementioned operation determination unit, Based on the predetermined operation, select one response computer character, Based on the estimated response time, select the other response computer character. [2] The character control device described above.

[0092] [4] The aforementioned operation determination unit, Based on the response estimation time, the operation of one response computer character or the other response computer character is determined. The character control device described in [2] or [3].

[0093] [5] The operation determination unit determines the at least one response computer character based on the conversation content in the predetermined operation. A character control device as described in any one of [1] to [4].

[0094] [6] The operation determination unit determines the at least one response computer character based on the information regarding the user character. A character control device as described in any one of [1] to [5].

[0095] [7] It comprises a display unit that displays a virtual space including user characters operated by the user and computer characters controlled by the computer, The aforementioned display unit is When a predetermined action is performed by a user character operated by a user in the virtual space on multiple computer characters, at least one response computer character is determined from the multiple computer characters to respond to the predetermined action, and the action of the at least one response computer character determined based on the response estimation time for the response to the predetermined action is displayed. Terminal device.

[0096] [8] In a virtual space provision system including a terminal device operated by a user and a server device that provides a virtual space to the terminal device, The server device is An action determination unit, upon receiving a predetermined action from a user character operated by a user in a virtual space to multiple computer characters, determines at least one response computer character to respond to the predetermined action from among the multiple computer characters, and determines the action of the at least one response computer character based on the response estimation time for the response to the predetermined action. A character control unit that displays the determined actions of the computer character on the user's terminal, Equipped with, The aforementioned terminal device is A display unit that displays the virtual space including user characters operated by the user and computer characters controlled by the computer, Equipped with A virtual space provision system.

[0097] The block diagram used in the description of the above embodiment shows functional units. These functional blocks (components) are realized by any combination of at least one of hardware and software. Furthermore, the method of realizing each functional block is not particularly limited. That is, each functional block may be realized using one device that is physically or logically coupled, or it may be realized using two or more physically or logically separated devices that are directly or indirectly connected (for example, using wired or wireless connections). A functional block may be realized by combining the above one device or the above multiple devices with software.

[0098] Functions include, but are not limited to, judgment, decision, judgment, calculation, calculation, processing, derivation, investigation, exploration, confirmation, reception, transmission, output, access, resolution, selection, selection, establishment, comparison, assumption, expectation, assumption, broadcasting, notifying, communicating, forwarding, configuring, reconfiguring, allocating (mapping), and assigning. For example, a functional block (configuration part) that enables transmission is called a transmitting unit or transmitter. As mentioned above, the method of implementation is not particularly limited.

[0099] For example, the dialogue generation server 100 in one embodiment of the present disclosure may function as a computer that processes the dialogue generation method of the present disclosure. Figure 8 is a diagram showing an example of the hardware configuration of the dialogue generation server 100 according to one embodiment of the present disclosure. The above-described dialogue generation server 100 may be physically configured as a computer device including a processor 1001, memory 1002, storage 1003, communication device 1004, input device 1005, output device 1006, bus 1007, etc.

[0100] In the following explanation, the term "device" can be replaced with "circuit," "device," "unit," etc. The hardware configuration of the dialogue generation server 100 may include one or more of the devices shown in the figure, or it may be configured to omit some of the devices.

[0101] Each function in the dialogue generation server 100 is realized by loading predetermined software (programs) onto hardware such as the processor 1001 and memory 1002, which causes the processor 1001 to perform calculations, control communication by the communication device 1004, and control at least one of the reading and writing of data in the memory 1002 and storage 1003.

[0102] The processor 1001 controls the entire computer, for example, by running the operating system. The processor 1001 may be composed of a central processing unit (CPU) that includes interfaces with peripheral devices, control devices, arithmetic units, registers, etc. For example, the operation determination unit 102 and character control unit 103 described above may be implemented by the processor 1001.

[0103] Furthermore, the processor 1001 reads programs (program code), software modules, data, etc., from at least one of the storage 1003 and the communication device 1004 into the memory 1002 and executes various processes accordingly. The program used is one that causes the computer to execute at least a part of the operations described in the above embodiment. For example, the operation determination unit 102 and the character control unit 103 may be implemented by a control program stored in the memory 1002 and running on the processor 1001, and other functional blocks may be implemented similarly. The above-described various processes have been explained as being executed by one processor 1001, but they may be executed simultaneously or sequentially by two or more processors 1001. The processor 1001 may be implemented by one or more chips. The program may also be transmitted from a network via a telecommunications line.

[0104] Memory 1002 is a computer-readable recording medium and may consist of at least one of the following: ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable ROM), RAM (Random Access Memory), etc. Memory 1002 may also be called a register, cache, main memory, etc. Memory 1002 can store executable programs (program code), software modules, etc., for carrying out the interaction generation method according to one embodiment of the present disclosure.

[0105] Storage 1003 is a computer-readable recording medium and may consist of at least one of the following: an optical disc such as a CD-ROM (Compact Disc ROM), a hard disk drive, a flexible disk, a magneto-optical disk (e.g., a compact disc, a digital multipurpose disc, a Blu-ray® disc), a smart card, flash memory (e.g., a card, a stick, a key drive), a floppy® disk, a magnetic strip, etc. Storage 1003 may also be called an auxiliary storage device. The above-mentioned storage medium may be, for example, a database, server, or other suitable medium including at least one of memory 1002 and storage 1003.

[0106] The communication device 1004 is hardware (transmitting / receiving device) for communicating between computers via at least one of a wired network and a wireless network, and is also referred to as a network device, network controller, network card, communication module, etc. The communication device 1004 may be configured to include high-frequency switches, duplexers, filters, frequency synthesizers, etc., in order to implement at least one of frequency division duplex (FDD) and time division duplex (TDD). For example, the communication unit 101 and virtual space provision unit 104 described above may be implemented by the communication device 1004. The communication device 1004 may be implemented with physically or logically separated transmitting and receiving units.

[0107] The input device 1005 is an input device that accepts input from an external source (e.g., a keyboard, mouse, microphone, switch, button, sensor, etc.). The output device 1006 is an output device that outputs to an external source (e.g., a display, speaker, LED lamp, etc.). The input device 1005 and the output device 1006 may be configured as an integrated unit (e.g., a touch panel).

[0108] Furthermore, each device, such as the processor 1001 and memory 1002, is connected by a bus 1007 for communicating information. The bus 1007 may be configured using a single bus, or different buses may be configured for each device.

[0109] Furthermore, the dialogue generation server 100 may be configured to include hardware such as a microprocessor, a digital signal processor (DSP), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), or an FPGA (Field Programmable Gate Array), and some or all of each functional block may be realized by such hardware. For example, the processor 1001 may be implemented using at least one of these hardware components.

[0110] Information notification is not limited to the embodiments described herein and may be carried out by other means. For example, information notification may be carried out by physical layer signaling (e.g., DCI (Downlink Control Information), UCI (Uplink Control Information)), upper layer signaling (e.g., RRC (Radio Resource Control) signaling, MAC (Medium Access Control) signaling, broadcast information (MIB (Master Information Block), SIB (System Information Block))), other signals, or combinations thereof. RRC signaling may also be called RRC messages, and may be, for example, RRC Connection Setup messages, RRC Connection Reconfiguration messages, etc.

[0111] The processing procedures, sequences, flowcharts, etc., of each aspect / embodiment described herein may be reordered, provided they are consistent with each other. For example, the methods described herein present various step elements in an exemplary order and are not limited to that specific order.

[0112] Input and output information may be stored in a specific location (e.g., memory) or managed using a management table. Input and output information may be overwritten, updated, or appended to. Output information may be deleted. Input information may be transmitted to other devices.

[0113] The determination may be made by a value represented by 1 bit (0 or 1), by a boolean value (true or false), or by a numerical comparison (for example, a comparison with a predetermined value).

[0114] Each aspect / embodiment described herein may be used individually, in combination, or switched between as needed during implementation. Furthermore, notification of specific information (e.g., notification that "X is") is not limited to explicit notification, but may also be implicit (e.g., by not providing such notification).

[0115] Although the present disclosure has been described in detail above, it will be clear to those skilled in the art that the present disclosure is not limited to the embodiments described herein. The present disclosure can be implemented in modified and altered forms without departing from the intent and scope of the present disclosure as defined by the claims. Accordingly, the descriptions in the present disclosure are illustrative and not intended to be restrictive in any way.

[0116] Software should be broadly interpreted to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, execution threads, procedures, functions, and so on, whether they are called software, firmware, middleware, microcode, hardware description languages, or by any other name.

[0117] Furthermore, software, instructions, information, etc., may be transmitted and received via a transmission medium. For example, if software is transmitted from a website, server, or other remote source using at least one of wired technologies (such as coaxial cable, fiber optic cable, twisted pair, or digital subscriber line (DSL)) and wireless technologies (such as infrared or microwave), then at least one of these wired and wireless technologies is included in the definition of a transmission medium.

[0118] The information, signals, etc. described in this disclosure may be represented using any of the various different techniques. For example, the data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description may be represented by voltage, current, electromagnetic waves, magnetic fields or magnetic particles, optical fields or photons, or any combination thereof.

[0119] In addition, terms used in this disclosure and terms necessary for understanding this disclosure may be replaced with terms that have the same or similar meaning.

[0120] Furthermore, the information, parameters, etc., described in this disclosure may be expressed using absolute values, relative values ​​from a given value, or other corresponding information. For example, wireless resources may be indicated by an index.

[0121] The names used for the parameters mentioned above are not restrictive in any way.

[0122] In this disclosure, terms such as "Mobile Station (MS)," "user terminal," "User Equipment (UE)," and "terminal" may be used interchangeably.

[0123] A mobile station may also be referred to by those skilled in the art as a subscriber station, mobile unit, subscriber unit, wireless unit, remote unit, mobile device, wireless device, wireless communication device, remote device, mobile subscriber station, access terminal, mobile terminal, wireless terminal, remote terminal, handset, user agent, mobile client, client, or some other appropriate term.

[0124] As used in this disclosure, the terms “determining” and “determining” may encompass a wide variety of actions. “Determining” may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up, searching, or inquiring (e.g., searching in a table, database, or other data structure), or ascertaining. “Determining” may also include, for example, receiving (e.g., receiving information), transmitting (e.g., sending information), inputting, outputting, or accessing (e.g., accessing data in memory). Furthermore, "judgment" and "decision" can include considering something as having been "judged" or "decided" after resolving, selecting, choosing, establishing, comparing, etc. In other words, "judgment" and "decision" can include considering something as having been "judged" or "decided" after some action. Also, "judgment (decision)" can be reinterpreted as "assuming," "expecting," or "considering."

[0125] The terms “connected,” “coupled,” or any variation thereof, mean any direct or indirect connection or coupling between two or more elements, and may include the presence of one or more intermediate elements between two elements that are “connected” or “coupled” with each other. The coupling or connection between elements may be physical, logical, or a combination thereof. For example, “connection” may be reinterpreted as “access.” As used in this disclosure, two elements may be considered to be “connected” or “coupled” with each other using at least one of one or more wires, cables, and printed electrical connections, and, in some non-limiting and non-exclusive examples, electromagnetic energy having wavelengths in the radio frequency domain, microwave domain, and optical (both visible and invisible) domain.

[0126] In this disclosure, the phrase "based on" does not mean "based solely on" unless otherwise specified. In other words, the phrase "based on" means both "based solely on" and "based at least on."

[0127] Any reference to elements using designations such as “first,” “second,” etc., as used in this disclosure does not generally limit the quantity or order of those elements. These designations may be used in this disclosure as a convenient way to distinguish between two or more elements. Accordingly, references to first and second elements do not imply that only two elements may be adopted, or that the first element must precede the second element in any way.

[0128] Where the terms “include,” “including,” and their variations are used in this disclosure, these terms are intended to be inclusive, as is the term “comprising.” Furthermore, the term “or” as used in this disclosure is not intended to mean exclusive OR.

[0129] In this disclosure, if articles are added by translation, such as a, an, and the in English, this disclosure may include the fact that the noun following these articles is plural.

[0130] In this disclosure, the term "A and B are different" may mean "A and B are different from each other." The term may also mean "A and B are each different from C." Terms such as "separate" and "combine" may be interpreted similarly to "different." [Explanation of Symbols]

[0131] 101...Communication unit, 102...Operation determination unit, 103...Character control unit, 104...Virtual space provision unit, 100a...User information DB, 100b...Virtual space information DB, 201...Communication unit, 202...Display unit, 203...Microphone, 204...Operation unit, 205...Speaker.

Claims

1. An action determination unit, upon receiving a predetermined action from a user character operated by a user in a virtual space to multiple computer characters, determines at least one response computer character from the multiple computer characters to respond to the predetermined action, and determines the action of the at least one response computer character based on the response estimation time for the response to the predetermined action. A character control unit that presents the determined behavior of the at least one response computer character to the user, Equipped with, The aforementioned operation determination unit, When multiple response computer characters are selected, one response computer character controls the other response computer characters to perform response actions toward the user character. CHARGE control device.

2. The aforementioned operation determination unit, Based on the predetermined operation, select one response computer character, Based on the estimated response time, select the other response computer character. The character control device according to claim 1.

3. The aforementioned operation determination unit, Based on the response estimation time, the operation of one response computer character or the other response computer character is determined. The character control device according to claim 1.

4. When a user character operated by a user in a virtual space receives a predetermined action from a plurality of computer characters, the action determination unit determines at least one response computer character to respond to the predetermined action from the plurality of computer characters, and determines the action of the at least one response computer character based on the response estimation time for the response to the predetermined action, The system comprises a character control unit that presents the determined behavior of the at least one response computer character to the user, The operation determination unit determines the at least one response computer character based on the conversation content in the predetermined operation. CHARGE control device.

5. When a user character operated by a user in a virtual space receives a predetermined action from a plurality of computer characters, the action determination unit determines at least one response computer character to respond to the predetermined action from the plurality of computer characters, and determines the action of the at least one response computer character based on the response estimation time for the response to the predetermined action, The system comprises a character control unit that presents the determined behavior of the at least one response computer character to the user, The operation determination unit determines the at least one response computer character based on the information regarding the user character. CHARGE control device.

6. It comprises a display unit that displays a virtual space including user characters operated by the user and computer characters controlled by the computer, The aforementioned display unit is When a predetermined action is performed by a user character operated by the user in the virtual space on multiple computer characters, at least one response computer character that responds to the predetermined action is determined from among the multiple computer characters, and the action of the at least one response computer character determined based on the response estimation time for the response to the predetermined action is displayed. If multiple response computer characters are selected, one response computer character will indicate an action to cause the other response computer characters to perform a response action to the user character. Terminal device.

7. In a virtual space provision system including a terminal device operated by a user and a server device that provides a virtual space to the terminal device, The server device is An action determination unit, upon receiving a predetermined action from a user character operated by a user in a virtual space to multiple computer characters, determines at least one response computer character from the multiple computer characters to respond to the predetermined action, and determines the action of the at least one response computer character based on the response estimation time for the response to the predetermined action. A character control unit that displays the determined actions of the computer character on the user's terminal device, Equipped with, The aforementioned operation determination unit, When multiple response computer characters are selected, one response computer character controls the other response computer characters to perform response actions toward the user character. The aforementioned terminal device is A display unit that displays the virtual space including user characters operated by the user and computer characters controlled by the computer, Equipped with A virtual space provision system.

8. A display unit that displays a virtual space including a user character operated by a user and a computer character controlled by a computer, The aforementioned display unit is When a predetermined action is performed by a user character operated by the user in the virtual space on multiple computer characters, at least one response computer character that responds to the predetermined action is determined from among the multiple computer characters, and the action of the at least one response computer character determined based on the response estimation time for the response to the predetermined action is displayed. Based on the conversation content in the predetermined operation, the at least one response computer character is determined. Terminal device.

9. A virtual space provision system including a terminal device operated by a user and a server device that provides a virtual space to the terminal device, The server device is An action determination unit, upon receiving a predetermined action from a user character operated by a user in a virtual space to multiple computer characters, determines at least one response computer character from the multiple computer characters to respond to the predetermined action, and determines the action of the at least one response computer character based on the response estimation time for the response to the predetermined action. A character control unit that displays the determined actions of the computer character on the user's terminal device, Equipped with, The operation determination unit determines the at least one response computer character based on the conversation content in the predetermined operation. The aforementioned terminal device is A display unit that displays the virtual space including user characters operated by the user and computer characters controlled by the computer, Equipped with A virtual space provision system.

10. A display unit that displays a virtual space including a user character operated by a user and a computer character controlled by a computer, The aforementioned display unit is When a predetermined action is performed by a user character operated by the user in the virtual space on multiple computer characters, at least one response computer character that responds to the predetermined action is determined from among the multiple computer characters, and the action of the at least one response computer character determined based on the response estimation time for the response to the predetermined action is displayed. Based on the information regarding the user character, the at least one response computer character is determined. Terminal device.

11. A virtual space provision system including a terminal device operated by a user and a server device that provides a virtual space to the terminal device, The server device is An action determination unit, upon receiving a predetermined action from a user character operated by a user in a virtual space to multiple computer characters, determines at least one response computer character from the multiple computer characters to respond to the predetermined action, and determines the action of the at least one response computer character based on the response estimation time for the response to the predetermined action. A character control unit that displays the determined actions of the computer character on the user's terminal device, Equipped with, The operation determination unit determines the at least one response computer character based on the information regarding the user character, The aforementioned terminal device is A display unit that displays the virtual space including user characters operated by the user and computer characters controlled by the computer, Equipped with A virtual space provision system.

Images