Character control device, terminal device, and virtual space providing system

Abstract

The objective of the present invention is to cause a computer character to perform operations appropriate for a user.　In a dialog generating server 100 according to the present disclosure, upon accepting a predetermined operation for a plurality of computer characters C1 from a user character C2 operated by a user in a virtual space, an operation determining unit 102 determines a computer character C11 from among the plurality of computer characters C1 that is to respond to the predetermined operation, and determines an operation of the computer character C11 on the basis of an estimated response time required to respond to the predetermined operation. The operation here includes an intervention process for reducing stress on the user related to waiting, such as a gesture, as well as operations such as passing the conversation to another computer character C12. A character control unit 103 then causes a user terminal 200 of the user to display the determined operation of the computer character C11.

Description

Character control device, terminal device, and virtual space providing system

[0001] The present invention relates to a character control device for controlling a character in a virtual space, a terminal device, and a virtual space providing system.

[0002] Patent Document 1 describes presenting an NPC object in a virtual space, and presenting the behavior of the NPC object in the virtual space in response to an action by a user.

[0003] Japanese Patent Application Laid-Open No. 2019-106220

[0004] In the technology described in Patent Document 1, there are cases where the action of an NPC in response to a user's action is delayed. In such cases, the user is unable to communicate smoothly with a computer character. For example, in a virtual space, while the user is having a conversation with a computer character (e.g., an NPC (Non-Player Character)), the user needs to think about how the computer character should respond to the conversation. The waiting time caused by this thinking can be stressful for the user, which can be a problem.

[0005] Therefore, an object of the present invention is to provide a character control device, a terminal device, and a virtual space providing system that can cause a computer character to perform appropriate actions for a user.

[0006] The character control device of the present invention comprises an action determination unit that, when it receives a predetermined action from a user character operated by a user in a virtual space for multiple computer characters, determines a responding computer character from the multiple computer characters that will respond to the predetermined action, and determines the action of the responding computer character based on an estimated response time required to respond to the predetermined action, and a character control unit that displays the determined action of the computer character on the user terminal of the user.

[0007] According to the present invention, it is possible to make a computer character perform an action that is appropriate for the user.

[0008] FIG. 1 is a diagram illustrating a system configuration including a dialogue generation server 100, which is a character control device of the present disclosure. FIG. 2 is a schematic diagram of a virtual space in the present disclosure. FIG. 3 is a block diagram illustrating the functional configuration of the dialogue generation server 100 and a user terminal 200 of the present disclosure. FIG. 4 is a diagram illustrating a processing sequence in the dialogue generation server 100 and a user terminal 200 of the present disclosure. FIG. 5 is a flowchart illustrating detailed processing of processes S103 and S104. FIG. 6 is a flowchart illustrating detailed processing of determining and controlling the action of a computer character in process S208. FIG. 7 is a diagram illustrating a conversation between a user character C2 and computer characters C11 and C12 in a virtual space. FIG. 8 is a diagram illustrating an example of the hardware configuration of the dialogue generation server 100 according to an embodiment of the present disclosure.

[0009] The present disclosure will be described with reference to the accompanying drawings. Whenever possible, the same parts are designated by the same reference numerals and redundant description will be omitted.

[0010] 1 is a diagram showing a system configuration including a dialogue generation server 100, which is a character control device according to the present disclosure. As shown in the figure, the dialogue generation server 100 includes a user information DB 100a and a virtual space information DB 100b. The dialogue generation server 100 generates a virtual space by referring to the virtual space information DB 100b, and transmits the virtual space to a user terminal 200.

[0011] The user terminal 200 is a terminal device such as a smartphone or VR goggles, and is a terminal operated by a user. When the user terminal 200 receives a virtual space from the dialogue generation server 100, it displays a user character and a computer character (so-called NPC) in the virtual space. The user character and the computer character are characters generated by the dialogue generation server 100.

[0012] 2 is a schematic diagram of a virtual space in the present disclosure. As shown in the figure, a computer character C1 and a user character C2 are placed in the virtual space. In the present disclosure, the premise of the control is that there are many (N) computer characters C1 and one user character C2, but naturally, there may be multiple user characters in the virtual space.

[0013] 3 is a block diagram showing the functional configuration of the dialogue generation server 100 and the user terminal 200 of the present disclosure. As shown in the figure, Fig. 3(a) is a block diagram showing the functional configuration of the dialogue generation server 100. This dialogue generation server 100 is configured to include a communication unit 101, an action determination unit 102, a character control unit 103, a virtual space providing unit 104, a user information DB 100a, and a virtual space information DB 100b.

[0014] The communication unit 101 is a part that communicates with the user terminal 200. The communication unit 101 receives, from the user terminal 200, information (for example, voice) relating to the actions of the user character operated by the user.

[0015] The action determination unit 102 is a part that determines the action of the computer character C1 based on information about the action and user information. Prior to determining the action, the action determination unit 102 estimates a response time based on information about the action. For example, the action determination unit 102 calculates the response time of the calculation process for dialogue generation obtained through pre-verification, and sets this as the response time. For example, for each of a plurality of conversations, the time required for the computer character to respond to that conversation is calculated in advance through experiments or the like, and the response time is calculated for each conversation. The method of calculating the response time is not limited to the above, and other known methods may also be used.

[0016] The operation determination unit 102 also calculates the response time based on the network congestion level determined by the network bandwidth between the server and the user terminal. Specifically, the operation determination unit 102 estimates the response time according to the network congestion level using a packet-based method (for example, by sending a ping and measuring the response time).

[0017] Although the above two examples (delay in determining the conversation content and network delay) have been given for calculating the response time, the present invention is not limited to these examples, and other events that require a long response time may also be taken into consideration. Furthermore, the response time is determined based on the longer of the estimated time until the conversation content is determined, the network delay, and the delay due to other events. For the sake of convenience, the processing flow described below uses the response time based on the estimated time until the conversation content is determined and the network delay, but naturally, other delays may also be taken into consideration.

[0018] The action determination unit 102 then determines the action (intervention process) of the computer character C1 based on the response time. For example, the action determination unit 102 performs intervention process using an appropriate stress relief measure for the user based on the response time. The details of the intervention process and the relationship between the response time and the user information will be described later.

[0019] The character control unit 103 is a part that controls the computer character C1 so that the computer character C1 performs the action determined by the action determination unit 102.

[0020] The virtual space providing unit 104 is a part that provides (transmits) a virtual space to the user terminal 200. This virtual space includes a user character C2 and a computer character C1, and the computer character C1 is controlled to move in a predetermined manner. The user character C2 is controlled to move in accordance with an operation from the user terminal 200.

[0021] The virtual space information DB 100b is a section that stores information for constructing a virtual space to be provided to the user terminal 200. This virtual space information DB 100b stores information for constructing the virtual space, such as information about the virtual space, specific areas to be placed within the virtual space, and computer characters operating in the specific areas. Specific areas are, for example, areas such as stores and facilities where user characters can perform actions such as shopping within the virtual space. Naturally, the information is not limited to these, and other information for constructing facilities that exist in the real world in the virtual space may also be stored.

[0022] The user information DB 100a is a section that stores user information related to the user of the user terminal 200. The user information is, for example, user characteristics. In the present disclosure, the user characteristics particularly include information indicating the degree of receptivity to the actions (interventions) of the computer character, and may include neuroticism, extroversion, openness, cooperativeness, conscientiousness, etc.

[0023] In addition, the user information may include at least one piece of information about the user, such as location, time of day, display mode of the user character (character of the speaking user), or status of the user operating user character C2.

[0024] 3(b) is a block diagram showing the functional configuration of the user terminal 200. As shown in the figure, the user terminal 200 includes a communication unit 201, a display unit 202, a microphone 203, an operation unit 204, and a speaker 205. This user terminal 200 may be configured as, for example, a VR goggle type, but may also be configured in other ways.

[0025] The communication unit 201 is a part that receives information about the virtual space from the dialogue generation server 100 or transmits user operation information to the dialogue generation server 100 .

[0026] The display unit 202 is a part that displays the virtual space, the computer character C1 included in the virtual space, the user character C2, and the like.

[0027] The microphone 203 is a part that receives the user's voice so that the user character C2 can speak to the computer character C1 in the virtual space.

[0028] The operation unit 204 is a part that accepts operations of the user character C2 in the virtual space. Note that a keyboard or the like may be provided for text-based communication such as chat.

[0029] The speaker 205 is a part that outputs sounds from the computer character C1 in the virtual space.

[0030] FIG. 4 is a diagram showing a processing sequence in the dialogue generation server 100 and the user terminal 200 of the present disclosure.

[0031] As shown in the figure, a user (user character C2) speaks to a computer character C1 (S101) in a virtual space displayed on a user terminal 200. Then, the user terminal 200 transmits the speech data to the dialogue generation server 100 (S102).

[0032] In the dialogue generation server 100, the action determination unit 102 determines a responding computer character and estimates a response time based on the degree of network congestion and the time required to make an appropriate response to the utterance content (S103). The action determination unit 102 then determines the action of the computer character based on the response time (S104). The responding computer character is a character selected by the action of a computer character and is a character that is caused to respond to the user character. In FIG. 4, the responding computer characters are computer character C11 and computer character C12. Here, one computer character C11 is selected, but multiple computer characters may be selected. Furthermore, one or multiple computer characters may be selected as the other computer character C12.

[0033] The character control unit 103 transmits character movement control information indicating the character's movement to the user terminal 200 via the virtual space providing unit 104 (S105). In the user terminal 200, the computer character C11 performs an action to select another responding computer character C12 to respond to the user character C2 in accordance with the character movement control information (S106). For example, the computer character C11 selects the computer character C12 by taking an action such as turning the conversation to the computer character C12. As described above, depending on the response time, the user may be kept waiting and experience stress. Therefore, the action here is assumed to be a simple action (such as calling the name of the computer character C12), but it is not limited thereto.

[0034] Thereafter, in the dialogue generation server 100, the action determination unit 102 determines a response content according to the utterance content of the user character C2 (S107). Then, the virtual space providing unit 104 transmits the response content together with the identification information of the previously determined responding computer character to the user terminal 200 (S108). Then, in the user terminal 200, the computer character C12 selected as the other responding computer character replies to the user character C2 in accordance with the response content (S109).

[0035] FIG. 5 is a flowchart showing the virtual space providing process and the detailed processes of steps S103 and S104 in FIG.

[0036] In the dialogue generation server 100, the virtual space providing unit 104 acquires the time period, location, and other virtual space information of the virtual space (including the virtual store) from the virtual space information DB 100b, and provides the virtual space to the user terminal 200 (S201).

[0037] The communication unit 101 acquires position information of the user character from the user terminal 200 (S202). The virtual space providing unit 104 acquires position information of the computer character (S203). In this way, the virtual space providing unit 104 represents the user character C2 and the computer character C1 in the virtual space and provides them to the user terminal 200.

[0038] The communication unit 101 then acquires user character motion control information from the user terminal 200 (S204). The motion determination unit 102 identifies a responding computer character to be controlled based on the motion of the user character C2 (including the content of the conversation) (S205). For example, if the user character C2 speaks to a computer character C11, a responding computer character C12 is identified based on the user character C2's position, attributes, the content of the conversation, and the like. In the present disclosure, attributes indicate the user character C2's gender and age. Other attributes include information such as the user's hobbies, preferences, and favorite characters. For example, if the user character C2 is in a store and the content of the conversation involves speaking to a store clerk (computer character C11), the nearest store clerk computer character C11 is identified as the responding computer character. Furthermore, in the present disclosure, another computer character C12 (e.g., a store clerk character) near the computer character C11 may be identified as another responding computer character. Also, depending on the gender (attributes) of the user character, for example, if the character is female, a female store clerk computer character may respond.

[0039] The action determination unit 102 then calculates the control content for the action of the computer character corresponding to the action of the user character (S206) and estimates the response time (estimated response time) (S207). If the response time is equal to or longer than a predetermined time, the action determination unit 102 determines the action of the computer character corresponding to that time and performs the control (S208). For example, the action determination unit 102 selects a predetermined action (gesture, nod, etc.) or another responding computer character and controls the other responding computer character to perform the predetermined action so as not to stress the user who is waiting for the response time until the control content is determined.

[0040] After that, when the control content is determined, the action determination unit 102 controls the computer character to move in accordance with the control content (S209).

[0041] In FIG. 5, the actions of the user and computer characters include actions such as speech and gestures.

[0042] 6 is a flowchart showing detailed processing for determining and controlling the computer character's action in process S208. The action determination unit 102 acquires user information (user characteristics, user status, and operation information) related to the user of the user terminal 200 from the user information DB 100a (S208a). The action determination unit 102 determines the user's acceptance level based on the user information (S208b). For example, the user's acceptance level is a value indicating how much waiting time the user can tolerate, with a higher value indicating a higher acceptance level for waiting time. Note that the value may be controlled to increase or decrease depending on the time of day, and may indicate that the user is in a hurry in the morning (low acceptance level) and is not in a hurry in the afternoon (high acceptance level).

[0043] Then, the action determination unit 102 acquires the user's operation state (S208c). The action determination unit 102 may acquire the user's operation state such as the speaker volume, or may acquire that the user's operation or setting is such that the user character looks embarrassed or is fidgeting.

[0044] The action determination unit 102 further acquires information on the sense of distance from the user and the location and closing time of the virtual store, and calculates at least one of the sense of distance from the user, the location and closing time of the virtual store, the operation status, and the acceptability, in addition to the response time (S208d). Note that the sense of distance from the user is information based on the positions of the user character and the computer character, and is a virtual distance in the virtual space. The location and closing time of the virtual store are information acquired from the virtual space information DB 100b. Note that in addition to this information, the virtual space information DB 100b may also store the congestion status in the virtual space (or virtual store).

[0045] Then, the action determination unit 102 selects another responding computer character according to the acceptance level (for example, if the acceptance level is low) (S208e). For example, the action determination unit 102 selects another responding computer character that is near the responding computer character that was spoken to. Note that another responding computer character that is not near the responding computer character may also be selected. As will be described later, the other responding computer character may be selected to match the attributes, etc., of the user character.

[0046] Here, the action determination unit 102 selects another responding computer character based on the acceptance level, but it may also be configured to select another responding computer character if the response time is longer than a predetermined time (if it takes a long time) without performing these processes, or to select a responding computer character based on the distance to other users, the location of the virtual store, etc.

[0047] Next, a selection pattern when one responding computer character selects another responding computer character will be explained.

[0048] The action determination unit 102 selects another computer character to whom the computer character C1, when spoken to by the user character, will initiate a conversation based on the positional relationship or attributes of the other computer character. For example, the action determination unit 102 selects another computer character that is close to the spoken computer character C1, or selects a computer character that appears to be a good talker. Whether a computer character is a good talker or not is determined based on setting information predetermined for each computer character. In the present disclosure, various computer characters are set as computer characters operating in the virtual space, such as clerks working in a virtual store or simple passersby. In the present disclosure, each character is controlled to perform an action according to its personality, attributes, characteristics, etc.

[0049] The action determination unit 102 may also control the selected other responding computer character to perform a gesture that matches its appearance. For example, it may be considered appropriate to respond to the user by making the computer character behave in accordance with its attributes, such as age or gender, such as an elderly character or a female character.

[0050] Furthermore, the action determination unit 102 may determine the responding computer character based on a specific area of ​​the virtual space in which the user character exists (whether inside the store or the store type) or the user character. For example, the action determination unit 102 may determine a computer character modeled after a successful businessman, a grandfather, a grandmother, or the like, to match the user character who is the listener. For example, if the user character is an elderly woman, the action determination unit 102 may select a computer character modeled after a female store clerk.

[0051] In addition, the following methods can be considered:

[0052] When a user character (user) has not yet signed a specified contract (for example, a point card, a credit card, etc.), and speaks to a computer character (for example, a store clerk in charge of credit card contracts) who is advertising for the contract, the conversation may be turned to another computer character in charge of the same contract.

[0053] Furthermore, when a computer character that is not for customer service (for example, a work avatar) is approached by a user character, the conversation may be diverted to a computer character that is for customer service (a customer service avatar).

[0054] In addition, a computer character modeled after a user character's (user's) favorite character may be summoned from a staff-only room in the virtual space (virtual store) and a conversation may be initiated with the computer character. The user's favorite character may be inferred from the user's attributes, or may be set as preference information for each user.

[0055] 7A and 7B are diagrams illustrating a conversation between a user character C2 and computer characters C11 and C12 in a virtual space to which the technology of the present disclosure is applied. In Fig. 7A, the user character C2 asks the computer character C11, "What kind of place is Akasaka?"

[0056] The computer character C1 responds with, "Well, you know... well, I guess you could say." Here, the action determination unit 102 calculates the response time required to respond to the conversation content of the user character C2 and determines that the response time is long (longer than a predetermined time), so the computer character C11 responds with the above content for the time being. Then, the action determination unit 102 further replies with, "Mr. / Ms. XX, you know a lot about Akasaka, don't you?" and turns the conversation to the computer character C12. These actions constitute an intervention process to relieve stress for the user. Note that if the response time is short (within a predetermined time), the action determination unit 102 may have the computer character C1 respond only with, "Well, you know... well, I guess you could say."

[0057] Then, computer character C12 responds, "I know a lot about it! I went to a sweets shop in Akasaka with a friend the other day and it was delicious! Do you want to go now?" The action determination unit 102 calculates the content of the computer character's response and its response time, and if the response time is equal to or longer than a predetermined time, causes computer character C11 to take an action of passing the conversation to computer character C12 as an additional measure to mitigate delay.

[0058] In this way, the action determination unit 102 determines the stress-relieving action (intervention process) according to the response time of the computer character C11 or C12, thereby enabling stress relief for the user waiting for a response. Furthermore, depending on the time, the action determination unit 102 may turn the conversation to another computer character C12, thereby enabling stress relief for the user waiting for a response.

[0059] Furthermore, the computer character can be made to perform actions appropriate for the user depending on the situation the user is in. In the present disclosure, having the computer character C12 respond rather than the computer character C11 may result in a smoother conversation. For example, if the computer character C12 is characterized (set) as knowing more about Akasaka than the computer character C11, having the computer character C12 respond may result in a more natural conversation.

[0060] Next, other patterns of switching behavior according to response time in the present disclosure will be described. Figure 7 above is an example of an intervention process, and various other intervention processes are possible. Furthermore, in the present disclosure, if the response time of a computer character spoken to by a user character is long, the computer character may be made to perform a simple behavior to reduce user stress.

[0061] If the response time (delay time) is short, the action determination unit 102 causes the computer character C1 to perform a predetermined gesture. For example, the action determination unit 102 may cause the computer character C1 to make a gesture as if it is pondering. This causes the computer character to perform at least some action, thereby reducing the stress the user feels due to the response time (delay time).

[0062] In addition, when the response time is short, the operation determination unit 102 may perform an intervention process that does not create a silent period by using filler words such as "umm," "well, you know," etc., and does not make the response time (delay time) noticeable.

[0063] Furthermore, if the response time is short, the operation determination unit 102 may repeat, for example, "So you mean (question content), right?" This allows intervention processing to be performed without the user noticing the response time.

[0064] Furthermore, if the response time (delay time) is long, the operation determination unit 102 may perform intervention processing such that a related site or video view is displayed, so that the response time (delay time) is not noticeable depending on the viewing time.

[0065] Furthermore, in addition to taking the response time into consideration, the action determination unit 102 can determine the action of the computer character C1 based on user information.

[0066] For example, the action determination unit 102 determines the gesture type based on the distance between the computer character C1 and the user character C2, based on the position indicated by the user information (in this case, the user information includes position information). The gesture type is a predetermined gesture, but may also be a large or small gesture, such as a large gesture or a small gesture. Furthermore, if the position indicated by the user information is in a specific store (a crowded store), the action determination unit 102 may determine the gesture based on the store type (large or small congestion level). The store type and congestion level may be stored in the virtual space information DB 100b.

[0067] The action determination unit 102 may determine a gesture type according to the degree of congestion based on information on whether the store is crowded, not just whether the user is in a specific store. The information on whether the store is crowded may be acquired from the virtual space information DB 100b or another device, or may be measured. For example, the measurement method may be to count the number of user characters displayed in the store, and determine that the store is crowded if a predetermined number or more of user characters are present. Alternatively, if a predetermined number of user characters are present within a certain distance from the user's user character, the store may be determined to be crowded, and the gesture of the computer character to which the user is speaking may be reduced. Furthermore, when a store is imagined in a virtual space integrated with the real world, the degree of congestion in the actual store may be reflected. Other conventional methods may also be used.

[0068] Furthermore, when the user information indicates a time period, the operation determination unit 102 may determine a quiet gesture when it is a predetermined time period such as when the user is sleeping. Furthermore, when the user is in a predetermined store, the operation determination unit 102 may determine a gesture that speaks a little faster to create the impression of being in a hurry during a busy time period before the store closes.

[0069] Furthermore, when the user information includes a display mode of the user character (speaker user), the action determination unit 102 determines a gesture type according to the display mode. For example, when the user character of the speaker user is fidgeting, the action determination unit 102 determines a gesture that speaks a little faster to give the appearance of being in a hurry. When the speaker user looks embarrassed, the action determination unit 102 determines an action that speaks in a low voice or with small gestures.

[0070] Furthermore, when the user information includes the state of the user operating the user character, the action determination unit 102 determines a gesture to perform an intervention process at a normal speed when the conversation is being conducted via text, and to perform an intervention process at a fast speed when the conversation is being conducted via voice. Furthermore, when the speaker is turned off (or the volume is set to 0 or low) in the settings of the user terminal 200, the computer character may perform an action that is recognizable by gestures rather than voice.

[0071] The user information is set in the user terminal 200, and the user's user character may act according to the setting or may act through user operation. The user character's actions may also be automatically controlled based on information about the computer character. The information about the computer character is the computer character's attributes, such as its gender and age. It is assumed that when the user's user character is facing the computer character, it will automatically act based on the information, without user operation. For example, if the computer character is set as being a celebrity in the virtual space, the user's user character may act in an embarrassing manner in accordance with the attribute. This action is assumed to be similar to that in the real world.

[0072] Next, the effects of the dialogue generation server 100 and the user terminal 200 of the present disclosure will be described. Note that although the dialogue generation server 100 functions as a character control device, this character control device does not need to be a server. A terminal device may function as a character control device. In this case, the terminal device needs to have a function to generate a virtual space and provide it to the user.

[0073] When the dialogue generation server 100 of the present disclosure receives a predetermined action from a user character C2 operated by a user in a virtual space toward multiple computer characters C1, the action determination unit 102 determines at least one responding computer character (e.g., computer character C11) that will respond to the predetermined action from the multiple computer characters C1, and determines an action for the at least one responding computer character (computer character C11) based on an estimated response time required to respond to the predetermined action. The actions here include intervention processes such as gestures to reduce stress caused by waiting for the user, as well as actions such as passing the conversation to another computer character C12.

[0074] Then, the character control unit 103 displays the determined action of at least one computer character C11 on the user terminal 200 of the user.

[0075] According to this configuration, the behavior of the computer character C11 is determined based on the estimated response time, thereby reducing the user's stress caused by waiting for a response. Furthermore, the optimal computer character C11 can be determined from multiple computer characters C1 based on the behavior of the user character. In other words, the computer character can be made to perform an appropriate behavior for the user depending on the situation the user is in, enabling smooth behavior. In this disclosure, the behavior is described focusing on conversation, but the above processing enables smooth conversation. Naturally, the behavior is not limited to conversation, and other behaviors such as gestures and hand movements may also be used.

[0076] In addition, when multiple response computer characters (e.g., computer characters C11 and C12) are selected, the action determination unit 102 of the present disclosure may control one response computer character (computer character C11) to cause another response computer character (computer character C12) to perform a response action toward the user character.

[0077] For example, the computer character C11 may initiate a conversation with the computer character C12 to prompt the computer character C12 to respond to a question from the user. This allows the computer character C12 to take over the action depending on the user's situation and other circumstances, enabling smooth operation.

[0078] Furthermore, the action determination unit 102 may select one responding computer character (computer character C11) based on a predetermined action, and select another computer character (computer character C12) based on an estimated response time.

[0079] Furthermore, the action determination unit 102 may determine the action of one computer character C11 (responding computer character) or another computer character C12 (responding computer character) based on the estimated response time.

[0080] This allows the computer character C12 to take actions that would occur in the real world, such as passing the conversation to another computer character C12, thereby reducing the stress of waiting for the user's response and enabling smoother operation.

[0081] The action determination unit 102 may also determine at least one responding computer character based on the content of the conversation during a predetermined action of the user character.

[0082] The action determination unit 102 may also determine at least one responding computer character based on information about the user character.

[0083] The user terminal 200 of the present disclosure also includes a display unit 202 that displays a virtual space including a user character operated by a user and a computer character controlled by a computer.

[0084] When a user character C2 controlled by a user in a virtual space performs a predetermined action on a plurality of computer characters C1, the display unit 202 determines a computer character C11 (responding computer character) that responds to the predetermined action from the plurality of computer characters C1, and displays the action of the responding computer character determined based on the response time (estimated response time) required to respond to the predetermined action.

[0085] Furthermore, the virtual space providing system of the present disclosure is a virtual space providing system that includes a user terminal 200, which is a terminal device operated by a user, and a dialogue generation server 100, which is a server device that provides a virtual space to the user terminal 200.

[0086] In the dialogue generation server 100, when a predetermined action is received from a user character C2 operated by a user in a virtual space toward multiple computer characters C1, the action determination unit 102 determines a computer character C11 (responding computer character) that will respond to the predetermined action from the multiple computer characters C1, and determines the action of the computer character C11 or C12 (responding computer character) based on the response time (estimated response time) required to respond to the predetermined action. The character control unit 103 then displays the determined action of the computer character on the user terminal 200 of the user.

[0087] The user terminal 200 includes a display unit 202 that displays the virtual space including a user character operated by a user and a computer character controlled by a computer.

[0088] The dialogue generation server 100, user terminal 200, and character control system that operate as the character control device of the present invention have the following configurations.

[0089] [1] A character control device comprising: an action determination unit that, when a predetermined action is received from a user character operated by a user in a virtual space for a plurality of computer characters, determines at least one responding computer character from the plurality of computer characters that will respond to the predetermined action, and determines an action for the at least one responding computer character based on an estimated response time required to respond to the predetermined action; and a character control unit that causes the user to present the determined action of the at least one responding computer character.

[0090] [2] The character control device according to [1], wherein when multiple response computer characters are selected, the action determination unit controls one response computer character to cause the other response computer characters to perform a response action toward the user character.

[0091] [3] The character control device according to [2], wherein the action determination unit selects the one responding computer character based on the predetermined action, and selects the other responding computer character based on the estimated response time.

[0092] [4] The character control device according to [2] or [3], wherein the action determination unit determines an action of the one responding computer character or the other responding computer character based on the estimated response time.

[0093] [5] The character control device according to any one of [1] to [4], wherein the action determination unit determines the at least one responding computer character based on the content of the conversation in the predetermined action.

[0094] [6] The character control device according to any one of [1] to [5], wherein the action determination unit determines the at least one responding computer character based on information about the user character.

[0095] [7] A terminal device comprising: a display unit that displays a virtual space including a user character operated by a user and a computer character controlled by a computer, wherein when a predetermined action is performed by the user character operated by the user on a plurality of computer characters in the virtual space, the display unit determines at least one responding computer character from the plurality of computer characters that will respond to the predetermined action, and displays the action of the at least one responding computer character determined based on an estimated response time required to respond to the predetermined action.

[0096] [8] A virtual space provision system including a terminal device operated by a user and a server device that provides a virtual space to the terminal device, wherein the server device comprises: an action determination unit that, when it receives a predetermined action from a user character operated by a user in the virtual space toward a plurality of computer characters, determines at least one responding computer character from the plurality of computer characters that will respond to the predetermined action, and determines an action for the at least one responding computer character based on an estimated response time required to respond to the predetermined action; and a character control unit that displays the determined action of the computer characters on the user terminal of the user; and the terminal device comprises: a display unit that displays the virtual space including the user character operated by the user and the computer character controlled by a computer.

[0097] The block diagrams used to explain the above embodiments show functional blocks. These functional blocks (components) are realized by any combination of hardware and / or software. Furthermore, the method for realizing each functional block is not particularly limited. That is, each functional block may be realized using a single device that is physically or logically coupled, or may be realized using two or more physically or logically separated devices that are connected directly or indirectly (e.g., via wire, wirelessly, etc.) and these multiple devices. The functional block may also be realized by combining the single device or multiple devices with software.

[0098] Functions include, but are not limited to, judgment, determination, assessment, calculation, computation, processing, derivation, investigation, search, confirmation, reception, transmission, output, access, resolution, selection, selection, establishment, comparison, assumption, expectation, consideration, broadcasting, notifying, communicating, forwarding, configuring, reconfiguring, allocating, mapping, and assignment. For example, a functional block (component) that performs transmission is called a transmitting unit or transmitter. As mentioned above, there are no particular limitations on how these functions are implemented.

[0099] For example, the dialogue generation server 100 according to an embodiment of the present disclosure may function as a computer that performs processing of the dialogue generation method of the present disclosure. Fig. 8 is a diagram showing an example of the hardware configuration of the dialogue generation server 100 according to an embodiment of the present disclosure. The dialogue generation server 100 described above may be physically configured as a computer device including a processor 1001, a memory 1002, a storage 1003, a communication device 1004, an input device 1005, an output device 1006, a bus 1007, etc.

[0100] In the following description, the term "device" can be interpreted as a circuit, a device, a unit, etc. The hardware configuration of the dialogue generation server 100 may be configured to include one or more of the devices shown in the figure, or may be configured to exclude some of the devices.

[0101] Each function of the dialogue generation server 100 is realized by loading specific software (programs) onto hardware such as a processor 1001 and memory 1002, causing the processor 1001 to perform calculations, control communications via the communication device 1004, and control at least one of reading and writing data from and to the memory 1002 and storage 1003.

[0102] The processor 1001 controls the entire computer by running, for example, an operating system. The processor 1001 may be configured as a central processing unit (CPU) including an interface with peripheral devices, a control device, an arithmetic unit, a register, etc. For example, the above-mentioned action determination unit 102, character control unit 103, etc. may be realized by the processor 1001.

[0103] The processor 1001 also loads programs (program codes), software modules, data, etc. from at least one of the storage 1003 and the communication device 1004 into the memory 1002 and executes various processes in accordance with these. The programs used are those that cause a computer to execute at least some of the operations described in the above-described embodiments. For example, the action determination unit 102 and the character control unit 103 may be implemented by a control program stored in the memory 1002 and running on the processor 1001, and similar implementations may be used for other functional blocks. While the above-described various processes have been described as being executed by a single processor 1001, they may also be executed simultaneously or sequentially by two or more processors 1001. The processor 1001 may be implemented by one or more chips. The programs may also be transmitted from a network via a telecommunications line.

[0104] The memory 1002 is a computer-readable recording medium and may be configured by, for example, at least one of a read-only memory (ROM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a random access memory (RAM), etc. The memory 1002 may also be called a register, a cache, a main memory (primary storage device), etc. The memory 1002 can store executable programs (program codes), software modules, etc. for implementing the dialogue generation method according to one embodiment of the present disclosure.

[0105] Storage 1003 is a computer-readable recording medium, and may be composed of at least one of, for example, an optical disk such as a CD-ROM (Compact Disc ROM), a hard disk drive, a flexible disk, a magneto-optical disk (e.g., a compact disk, a digital versatile disk, a Blu-ray (registered trademark) disk), a smart card, a flash memory (e.g., a card, a stick, a key drive), a floppy (registered trademark) disk, a magnetic strip, etc. Storage 1003 may also be referred to as an auxiliary storage device. The above-mentioned storage medium may be, for example, a database, a server, or other appropriate medium including at least one of memory 1002 and storage 1003.

[0106] The communication device 1004 is hardware (transmission / reception device) for communicating between computers via at least one of a wired network and a wireless network, and is also referred to as, for example, a network device, a network controller, a network card, or a communication module. The communication device 1004 may be configured to include a high-frequency switch, a duplexer, a filter, a frequency synthesizer, etc. to realize at least one of frequency division duplex (FDD) and time division duplex (TDD). For example, the communication unit 101 and the virtual space providing unit 104 described above may be realized by the communication device 1004. The communication device 1004 may be implemented with a transmitter and a receiver that are physically or logically separated from each other.

[0107] The input device 1005 is an input device (e.g., a keyboard, a mouse, a microphone, a switch, a button, a sensor, etc.) that accepts input from the outside. The output device 1006 is an output device (e.g., a display, a speaker, an LED lamp, etc.) that outputs to the outside. Note that the input device 1005 and the output device 1006 may be integrated into one device (e.g., a touch panel).

[0108] Furthermore, each device, such as the processor 1001 and the memory 1002, is connected by a bus 1007 for communicating information. The bus 1007 may be configured using a single bus, or may be configured using different buses between each device.

[0109] The dialogue generation server 100 may also be configured to include hardware such as a microprocessor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a programmable logic device (PLD), or a field programmable gate array (FPGA), and some or all of the functional blocks may be realized by the hardware. For example, the processor 1001 may be implemented using at least one of these pieces of hardware.

[0110] The notification of information is not limited to the aspects / embodiments described in the present disclosure and may be performed using other methods. For example, the notification of information may be performed by physical layer signaling (e.g., Downlink Control Information (DCI) and Uplink Control Information (UCI)), higher layer signaling (e.g., Radio Resource Control (RRC) signaling, Medium Access Control (MAC) signaling, broadcast information (Master Information Block (MIB) and System Information Block (SIB))), other signals, or a combination thereof. Furthermore, the RRC signaling may be referred to as an RRC message, and may be, for example, an RRC Connection Setup message, an RRC Connection Reconfiguration message, or the like.

[0111] The order of the procedures, sequences, flowcharts, etc. of each aspect / embodiment described in this disclosure may be changed unless it is consistent. For example, the methods described in this disclosure present elements of various steps using an example order, and are not limited to the particular order presented.

[0112] Input and output information may be stored in a specific location (for example, memory) or may be managed using a management table. Input and output information may be overwritten, updated, or added to. Output information may be deleted. Input information may be sent to another device.

[0113] The determination may be made based on a value represented by one bit (0 or 1), a Boolean value (true or false), or a numerical comparison (e.g., comparison with a predetermined value).

[0114] The aspects / embodiments described in this disclosure may be used alone, in combination, or switched depending on the implementation. Notification of predetermined information (e.g., notification that "X is true") is not limited to explicit notification, but may be implicit (e.g., not notifying the predetermined information).

[0115] Although the present disclosure has been described in detail above, it is clear to those skilled in the art that the present disclosure is not limited to the embodiments described herein. The present disclosure can be implemented in modified and altered forms without departing from the spirit and scope of the present disclosure as defined by the claims. Therefore, the description of the present disclosure is intended to be illustrative and does not have any limiting meaning on the present disclosure.

[0116] Software shall be construed broadly to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, threads of execution, procedures, functions, etc., whether referred to as software, firmware, middleware, microcode, hardware description language, or otherwise.

[0117] Software, instructions, information, etc. may also be transmitted or received over a transmission medium. For example, if software is transmitted from a website, server, or other remote source using wired technologies (such as coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL)), and / or wireless technologies (such as infrared, microwave), then these wired and / or wireless technologies are included within the definition of transmission media.

[0118] The information, signals, etc. described in this disclosure may be represented using any of a variety of different technologies. For example, data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description may be represented by voltages, currents, electromagnetic waves, magnetic fields or magnetic particles, optical fields or photons, or any combination thereof.

[0119] In addition, terms explained in this disclosure and terms necessary for understanding this disclosure may be replaced with terms having the same or similar meanings.

[0120] Furthermore, the information, parameters, etc. described in the present disclosure may be expressed using absolute values, relative values ​​from a predetermined value, or other corresponding information. For example, a radio resource may be indicated by an index.

[0121] The names used for the parameters above are not limiting in any way.

[0122] In this disclosure, the terms "Mobile Station (MS)," "user terminal," "User Equipment (UE)," "terminal," and the like may be used interchangeably.

[0123] A mobile station may also be referred to by those skilled in the art as a subscriber station, mobile unit, subscriber unit, wireless unit, remote unit, mobile device, wireless device, wireless communication device, remote device, mobile subscriber station, access terminal, mobile terminal, wireless terminal, remote terminal, handset, user agent, mobile client, client, or some other suitable terminology.

[0124] As used in this disclosure, the terms "determining" and "determining" may encompass a wide variety of actions. "Determining" and "determining" may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up, searching, inquiring (e.g., searching in a table, database, or other data structure), ascertaining, and the like. "Determining" and "determining" may also include receiving (e.g., receiving information), transmitting (e.g., sending information), input, output, accessing (e.g., accessing data in memory), and the like. Furthermore, "judgment" and "decision" can include regarding resolving, selecting, choosing, establishing, comparing, etc. as having been "judged" or "decided." In other words, "judgment" and "decision" can include regarding some action as having been "judged" or "decided." Furthermore, "judgment (decision)" can be interpreted as "assuming," "expecting," "considering," etc.

[0125] The terms "connected," "coupled," or any variation thereof, refer to any direct or indirect connection or coupling between two or more elements, and may include the presence of one or more intermediate elements between two elements that are "connected" or "coupled" to each other. The coupling or connection between elements may be physical, logical, or a combination thereof. For example, "connected" may be read as "access." As used in this disclosure, two elements may be considered to be "connected" or "coupled" to each other using one or more wires, cables, and / or printed electrical connections, as well as electromagnetic energy having wavelengths in the radio frequency range, microwave range, and optical (both visible and invisible) range, as some non-limiting and non-exhaustive examples.

[0126] As used in this disclosure, the phrase "based on" does not mean "based only on," unless expressly stated otherwise. In other words, the phrase "based on" means both "based only on" and "based at least on."

[0127] As used in this disclosure, any reference to an element using a designation such as "first," "second," etc. does not generally limit the quantity or order of those elements. These designations may be used in this disclosure as a convenient method of distinguishing between two or more elements. Thus, a reference to a first and a second element does not imply that only two elements may be employed or that the first element must in some way precede the second element.

[0128] When the terms "include," "including," and variations thereof are used in this disclosure, these terms are intended to be inclusive, similar to the term "comprising." Furthermore, when the term "or" is used in this disclosure, it is not intended to be an exclusive or.

[0129] In this disclosure, where articles are added by translation, such as a, an, and the in English, the disclosure may include that the nouns following these articles are in the plural form.

[0130] In the present disclosure, the term "A and B are different" may mean "A and B are different from each other." The term may also mean "A and B are each different from C." Terms such as "separate" and "coupled" may also be interpreted in the same way as "different."

[0131] 101...communication unit, 102...action determination unit, 103...character control unit, 104...virtual space providing unit, 100a...user information DB, 100b...virtual space information DB, 201...communication unit, 202...display unit, 203...microphone, 204...operation unit, 205...speaker.

Claims

1. A character control device comprising: an action determination unit that, when it receives a predetermined action for a plurality of computer characters from a user character controlled by a user in a virtual space, determines at least one responding computer character from the plurality of computer characters that will respond to the predetermined action, and determines an action for the at least one responding computer character based on an estimated response time required to respond to the predetermined action; and a character control unit that presents the determined action of the at least one responding computer character to the user.

2. The character control device according to claim 1, wherein, when multiple response computer characters are selected, the action determination unit controls one response computer character to cause the other response computer characters to perform a response action toward the user character.

3. The character control device according to claim 2, wherein the action determination unit selects one of the responding computer characters based on the predetermined action, and selects another of the responding computer characters based on the estimated response time.

4. The character control device according to claim 2, wherein the action determination unit determines an action of the one responding computer character or the other responding computer character based on the estimated response time.

5. The character control device according to claim 1, wherein the action determination unit determines the at least one responding computer character based on the content of the conversation in the predetermined action.

6. The character control device according to claim 1, wherein the action determination unit determines the at least one responding computer character based on information about the user character.

7. A terminal device comprising: a display unit that displays a virtual space including a user character operated by a user and a computer character controlled by a computer, wherein when a predetermined action is performed by the user character operated by the user in the virtual space on a plurality of computer characters, the display unit determines at least one responding computer character from the plurality of computer characters that responds to the predetermined action, and displays an action of the at least one responding computer character determined based on an estimated response time required to respond to the predetermined action.

8. A virtual space providing system including a terminal device operated by a user and a server device that provides a virtual space to the terminal device, wherein the server device comprises: an action determination unit that, when it receives a predetermined action from a user character operated by a user in a virtual space for multiple computer characters, determines at least one responding computer character from the multiple computer characters that will respond to the predetermined action, and determines an action for the at least one responding computer character based on an estimated response time required to respond to the predetermined action; and a character control unit that displays the determined action of the computer characters on the user terminal of the user; and the terminal device comprises: a display unit that displays the virtual space including the user character operated by the user and the computer character controlled by a computer.

Images