Character control device, terminal device, and virtual space providing system
Patent Information
- Application Number
- PCT/JP2024/028110
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-08-16
- Filing Date
- 2024-08-06
- Publication Date
- 2025-02-20
Smart Images

Figure JP2024028110_20022025_PF_FP_ABST
Abstract
Description
Character control device, terminal device, and virtual space providing system
[0001] The present invention relates to a character control device for controlling a character in a virtual space, a terminal device, and a virtual space providing system.
[0002] Patent Document 1 describes presenting an NPC object in a virtual space, and presenting the behavior of the NPC object in the virtual space in response to an action by a user.
[0003] Japanese Patent Application Laid-Open No. 2019-106220
[0004] In the technology described in Patent Document 1, the actions of an NPC (Non-Player Character) object (hereinafter referred to as a computer character) in response to a user's actions may be delayed. In such cases, the user is unable to communicate smoothly with the computer character. For example, in a virtual space, while the user is having a conversation with a computer character, the computer character needs to think about how to respond to the user. This thinking creates a waiting time for the user, which can be stressful for the user. In addition, it may be desirable to have the computer character perform an action appropriate for the user depending on the user's situation.
[0005] Therefore, an object of the present invention is to provide a character control device, a terminal device, and a virtual space providing system that can cause a computer character to perform appropriate actions for a user.
[0006] The character control device of the present invention includes an action determination unit that, when it receives a predetermined action for a computer character from a user character operated by a user in a virtual space, determines the action of the computer character based on user information about the user and an estimated response time required to respond to the predetermined action, and a character control unit that displays the determined action of the computer character on the user terminal of the user.
[0007] According to the present invention, it is possible to make a computer character perform an action that is appropriate for the user.
[0008] FIG. 1 is a diagram illustrating a system configuration including a dialogue generation server 100 which is a character control device of the present disclosure. FIG. 2 is a schematic diagram of a virtual space in the present disclosure. FIG. 3 is a block diagram illustrating the functional configuration of the dialogue generation server 100 and a user terminal 200 of the present disclosure. FIG. 4 is a diagram illustrating a processing sequence in the dialogue generation server 100 and a user terminal 200 of the present disclosure. FIG. 5 is a flowchart illustrating detailed processing of processes S103 and S104. FIG. 6 is a flowchart illustrating detailed processing of determining and controlling the action of a computer character in process S208. FIG. 7 is a diagram illustrating a conversation between a user character C2 and a computer character C1 in the virtual space of the present disclosure. FIG. 8 is a diagram illustrating an example of the hardware configuration of the dialogue generation server 100 according to an embodiment of the present disclosure.
[0009] The present disclosure will be described with reference to the accompanying drawings. Whenever possible, the same parts are designated by the same reference numerals and redundant description will be omitted.
[0010] 1 is a diagram showing a system configuration including a dialogue generation server 100, which is a character control device according to the present disclosure. As shown in the figure, the dialogue generation server 100 includes a user information DB 100a and a virtual space information DB 100b. The dialogue generation server 100 generates a virtual space by referring to the virtual space information DB 100b, and transmits the virtual space to a user terminal 200.
[0011] The user terminal 200 is a terminal device such as a smartphone or VR goggles, and is a terminal operated by a user. When the user terminal 200 receives a virtual space from the dialogue generation server 100, it displays a user character and a computer character (so-called NPC) in the virtual space. The user character and the computer character are characters generated by the dialogue generation server 100.
[0012] 2 is a schematic diagram of a virtual space in the present disclosure. As shown in the figure, a computer character C1 and a computer character C2 are placed in the virtual space. In the present disclosure, as a premise for control, there is one computer character C1 and one user character C2, but in the virtual space, there are multiple computer characters C1 and C2.
[0013] 3 is a block diagram showing the functional configuration of the dialogue generation server 100 and the user terminal 200 of the present disclosure. As shown in the figure, Fig. 3(a) is a block diagram showing the functional configuration of the dialogue generation server 100. This dialogue generation server 100 is configured to include a communication unit 101, an action determination unit 102, a character control unit 103, a virtual space providing unit 104, a user information DB 100a, and a virtual space information DB 100b.
[0014] The communication unit 101 is a part that communicates with the user terminal 200. The communication unit 101 receives, from the user terminal 200, information (for example, voice) relating to the actions of the user character operated by the user.
[0015] The action determination unit 102 is a part that determines the action of the computer character C1 based on information about the action and user information. Prior to determining the action, the action determination unit 102 estimates a response time based on information about the action. For example, the action determination unit 102 calculates the response time of the calculation process for dialogue generation obtained through pre-verification, and sets this as the response time. For example, for each of a plurality of conversations, the time required for the computer character to respond to that conversation is calculated in advance through experiments or the like, and the response time is calculated for each conversation. The method of calculating the response time is not limited to the above, and other known methods may also be used.
[0016] The operation determination unit 102 also calculates the response time based on the network congestion level determined by the network bandwidth between the server and the user terminal. Specifically, the operation determination unit 102 estimates the response time according to the network congestion level using a packet-based method (e.g., sending a ping and measuring the response time).
[0017] Although the above two examples (delay in determining the conversation content and network (NW) delay) have been given for calculating the response time, the present invention is not limited to these examples, and other events that require a long response time may also be taken into consideration. Furthermore, the response time is determined based on the longer of the estimated time until the conversation content is determined, the NW delay, and the delay due to other events. For the sake of convenience, the processing flow described below uses the response time based on the estimated time until the conversation content is determined and the NW delay, but naturally, other delay times may also be taken into consideration.
[0018] The action determination unit 102 then determines the action (intervention process) of the computer character C1 based on the response time. For example, the action determination unit 102 performs intervention process using an appropriate stress relief measure for the user based on the response time. The details of the intervention process and the relationship between the response time and the user information will be described later.
[0019] The character control unit 103 is a part that controls the computer character C1 so that the computer character C1 performs the action determined by the action determination unit 102.
[0020] The virtual space providing unit 104 is a part that provides (transmits) a virtual space to the user terminal 200. This virtual space includes a user character C2 and a computer character C1, and the computer character C1 is controlled to move in a predetermined manner. The user character C2 is controlled to move in accordance with an operation from the user terminal 200.
[0021] The virtual space information DB 100b is a section that stores information for constructing a virtual space to be provided to the user terminal 200. This virtual space information DB 100b stores information for constructing the virtual space, such as information about the virtual space, specific areas to be placed within the virtual space, and computer characters operating in the specific areas. Specific areas are, for example, areas such as stores and facilities where user characters can perform actions such as shopping within the virtual space. Naturally, the information is not limited to these, and other information for constructing facilities that exist in the real world in the virtual space may also be stored.
[0022] The user information DB 100a is a section that stores user information related to the user of the user terminal 200. User information related to the user is any information related to the user, including, for example, user characteristics. It also includes information other than user characteristics, such as the user's location and time of day. In the present disclosure, user characteristics particularly include information indicating the degree of receptivity to the computer character's actions (intervention measures), and possible characteristics include neuroticism, extroversion, openness, cooperativeness, conscientiousness, etc.
[0023] In addition, the user information may include at least one piece of information about the user, such as location, time of day, display mode of the user character (character of the speaking user), or status of the user operating user character C2.
[0024] 3(b) is a block diagram showing the functional configuration of the user terminal 200. As shown in the figure, the user terminal 200 includes a communication unit 201, a display unit 202, a microphone 203, an operation unit 204, and a speaker 205. This user terminal 200 may be configured as, for example, a VR goggle type, but may also be configured in other ways.
[0025] The communication unit 201 is a part that receives information about the virtual space from the dialogue generation server 100 or transmits user operation information to the dialogue generation server 100 .
[0026] The display unit 202 is a part that displays the virtual space, the computer character C1 included in the virtual space, the user character C2, and the like.
[0027] The microphone 203 is a part that receives the user's voice so that the user character C2 can speak to the computer character C1 in the virtual space.
[0028] The operation unit 204 is a part that accepts operations of the user character C2 in the virtual space. Note that a keyboard or the like may be provided for text-based communication such as chat.
[0029] The speaker 205 is a part that outputs sounds from the computer character C1 in the virtual space.
[0030] FIG. 4 is a diagram showing a processing sequence in the dialogue generation server 100 and the user terminal 200 of the present disclosure.
[0031] As shown in the figure, a user (user character C2) speaks to a computer character C1 (S101) in a virtual space displayed on a user terminal 200. Then, the user terminal 200 transmits the speech data to the dialogue generation server 100 (S102).
[0032] In the dialogue generation server 100, the action determination unit 102 estimates a response time based on the degree of network congestion and the time required to make an appropriate response to the utterance content (S103).The action determination unit 102 then determines the action of the character based on the response time (S104).
[0033] The character control unit 103 transmits character movement control information indicating the character's movements to the user terminal 200 via the virtual space providing unit 104 (S105). In the user terminal 200, the computer character C1 performs movements in accordance with the character movement control information (S106). As mentioned above, depending on the response time, the user may be kept waiting and stressed. Therefore, the movements here are simple movements (such as nodding), but of course, they are not limited to these.
[0034] Thereafter, in the dialogue generation server 100, the action determination unit 102 determines a response content according to the utterance content of the user character C2 (S107), and the virtual space providing unit 104 transmits the response content to the user terminal 200 (S108). Then, in the user terminal 200, the computer character C1 replies to the user character C2 in accordance with the response content (S109).
[0035] FIG. 5 is a flowchart showing the virtual space providing process and the detailed processes of steps S103 and S104 in FIG.
[0036] In the dialogue generation server 100, the virtual space providing unit 104 acquires the time period, location, and other virtual space information of the virtual space (including the virtual store) from the virtual space information DB 100b, and provides the virtual space to the user terminal 200 (S201).
[0037] The communication unit 101 acquires position information of the user character from the user terminal 200 (S202). The virtual space providing unit 104 acquires position information of the computer character (S203). In this way, the virtual space providing unit 104 represents the user character and the computer character in the virtual space and provides them to the user terminal 200.
[0038] The communication unit 101 then acquires the user character's actions from the user terminal 200 (S204). The action determination unit 102 identifies the computer character to be controlled based on the user character's actions (including the content of the conversation) (S205). For example, if the user character speaks to a computer character, the computer character is identified based on the user character's position and the content of the speech. The content of the speech is the content of the speech that the user character (user) spoke to the computer character. Depending on the content of the speech, it can be determined whether the user spoke to a store clerk (computer character) in the virtual space or a passerby (computer character), for example.
[0039] Then, the action determination unit 102 calculates the control content for the action of the computer character corresponding to the action of the user character (S206), and estimates the response time (estimated response time) (S207). If the response time is equal to or longer than a predetermined time, the action determination unit 102 determines the action of the computer character corresponding to that time and performs the control (S208). For example, the action determination unit 102 determines a predetermined gesture and controls the computer character to perform that gesture so as not to cause stress to the user who is waiting for the response time until the control content is determined.
[0040] After that, when the control content is determined, the action determination unit 102 controls the computer character to move in accordance with the control content (S209).
[0041] In FIG. 5, the actions of the user and computer characters include actions such as speech and gestures.
[0042] 6 is a flowchart showing detailed processing for determining and controlling the computer character's action in step S208. The action determination unit 102 acquires user information (user characteristics, user status, and operation information) related to the user of the user terminal 200 from the user information DB 100a (S208a). The action determination unit 102 determines the user's acceptance level based on the user information (S208b). For example, the user's acceptance level is a value indicating how much waiting time the user can tolerate, with a higher value indicating a higher acceptance level for waiting time. Note that the value may be controlled to increase or decrease depending on the time of day, and may indicate that the user is in a hurry in the morning (low acceptance level) and is not in a hurry in the afternoon (high acceptance level).
[0043] Then, the action determination unit 102 acquires the user's operation state (S208c). The action determination unit 102 may acquire the user's operation state such as the speaker volume, or may acquire that the user's operation or setting is such that the user character looks embarrassed or is fidgeting.
[0044] The action determination unit 102 further acquires information on the sense of distance from the user and the location and closing time of the virtual store, and determines control content according to at least one of the sense of distance from the user, the location and closing time of the virtual store, the operation status, and the acceptability, in addition to the response time (S208d). Note that the sense of distance from the user is information based on the positions of the user character and the computer character, and is a virtual distance in the virtual space. The location and closing time of the virtual store are information acquired from the virtual space information DB 100b. Note that in addition to this information, the virtual space information DB 100b may also store the congestion status in the virtual space (or virtual store).
[0045] 7A and 7B are diagrams illustrating a conversation between a user character C2 and a computer character C1 in a virtual space to which the technology of the present disclosure is applied. In Fig. 7A, the user character C2 asks the computer character C1, "What kind of place is Akasaka?"
[0046] The computer character C1 responds with, "Well, you know... well, I guess you could say." Here, the action determination unit 102 calculates the response time required to respond to the conversation content of the user character C2 and determines that the response time is long (longer than a predetermined time), so the computer character C1 responds with the above content for the time being. The action determination unit 102 then further derives the response content, "This is what it says on the Internet. (Show site)," and causes the computer character C1 to perform this action. Here, a simple Internet site is presented. These actions constitute an intervention process to relieve stress for the user. Note that if the response time is short (within a predetermined time), the action determination unit 102 may cause the computer character C1 to respond only with, "Well, you know... well, I guess you could say."
[0047] 7B shows a specific example. After the stress relief intervention, the action determination unit 102 generates a response such as "There's a quiet area with Hikawa Shrine and so on..." After that, when the user character C2 continues the conversation with "There are lots of restaurants, aren't there?", the action determination unit 102 calculates the response time and determines that it is short, and generates a response such as "Oh, by the way, the other day my friend and I..."
[0048] In this way, stress reduction intervention can be performed on the user based on the response time in the conversation between the user character C2 and the computer character C1.
[0049] Next, a description will be given of a pattern of switching actions according to response time in the present disclosure. FIG. 7 above is an example of an intervention process, and various other intervention processes are conceivable. When the response time (delay time) is short, the action determination unit 102 causes the computer character C1 to perform a predetermined gesture. For example, the action determination unit 102 may cause the computer character C1 to make a gesture that appears to be deep in thought. This allows the computer character to perform at least some action, thereby reducing the user's stress caused by the response time (delay time).
[0050] In addition, when the response time is short, the operation determination unit 102 may perform an intervention process that does not create a silent period by using filler words such as "umm," "well, you know," etc., and does not make the response time (delay time) noticeable.
[0051] Furthermore, if the response time is short, the operation determination unit 102 may repeat, for example, "So you mean (question content), right?" This allows intervention processing to be performed without the user noticing the response time.
[0052] Furthermore, if the response time (delay time) is long, the operation determination unit 102 may perform intervention processing to display a related site or video view, thereby making the response time (delay time) less noticeable depending on the viewing time.
[0053] Furthermore, in addition to taking the response time into consideration, the action determination unit 102 can determine the action of the computer character C1 based on user information.
[0054] For example, the action determination unit 102 determines the gesture type based on the distance between the computer character C1 and the user character C2, based on the position indicated by the user information (in this case, the user information includes position information). The gesture type is a predetermined gesture, but may also be a large or small gesture, such as a large gesture or a small gesture. Furthermore, if the position indicated by the user information is in a specific store (a crowded store), the action determination unit 102 may determine the gesture based on the store type (large or small congestion level). The store type and congestion level may be stored in the virtual space information DB 100b.
[0055] The action determination unit 102 may determine a gesture type according to the degree of congestion based on information on whether the store is crowded, not just whether the user is in a specific store. The information on whether the store is crowded may be acquired from the virtual space information DB 100b or another device, or may be measured. For example, the measurement method may be to count the number of user characters displayed in the store, and determine that the store is crowded if a predetermined number or more of user characters are present. Alternatively, if a predetermined number of user characters are present within a certain distance from the user's user character, the store may be determined to be crowded, and the gesture of the computer character to which the user is speaking may be reduced. Furthermore, when a store is imagined in a virtual space integrated with the real world, the degree of congestion in the actual store may be reflected. Other conventional methods may also be used.
[0056] Furthermore, when the user information indicates a time period, the operation determination unit 102 may determine a quiet gesture when it is a predetermined time period such as when the user is sleeping. Furthermore, when the user is in a predetermined store, the operation determination unit 102 may determine a gesture that speaks a little faster to create the impression of being in a hurry during a busy time period before the store closes.
[0057] Furthermore, when the user information includes a display mode of the user character (speaker user), the action determination unit 102 determines a gesture type according to the display mode. For example, when the user character of the speaker user is fidgeting, the action determination unit 102 determines a gesture that speaks a little faster to give the appearance of being in a hurry. When the speaker user looks embarrassed, the action determination unit 102 determines an action that speaks in a low voice or with small gestures.
[0058] Furthermore, when the user information includes the state of the user operating the user character, the action determination unit 102 determines a gesture to perform an intervention process at a normal speed when the conversation is being conducted via text, and to perform an intervention process at a fast speed when the conversation is being conducted via voice. Furthermore, when the speaker is turned off (or the volume is set to 0 or low) in the settings of the user terminal 200, the computer character may perform an action that is recognizable by gestures rather than voice.
[0059] The user information is set in the user terminal 200, and the user's user character may act according to the setting or may act through user operation. The user character's actions may also be automatically controlled based on information about the computer character. The information about the computer character is the computer character's attributes, such as its gender and age. It is assumed that when the user's user character is facing the computer character, it will automatically act based on the information, without user operation. For example, if the computer character is set as being a celebrity in the virtual space, the user's user character may act in an embarrassing manner in accordance with the attribute. This action is assumed to be similar to that in the real world.
[0060] Next, the effects of the dialogue generation server 100 and the user terminal 200 of the present disclosure will be described. Note that although the dialogue generation server 100 functions as a character control device, this character control device does not need to be a server. A terminal device may function as a character control device. In this case, the terminal device needs to have a function to generate a virtual space and provide it to the user.
[0061] In the dialogue generation server 100 of the present disclosure, when the action determination unit 102 receives from the user terminal 200 a predetermined action from a user character operated by a user in a virtual space provided to the user terminal 200 to a computer character, the action determination unit 102 determines an action of the computer character based on user information about the user and a response time (estimated response time) required to respond to the predetermined action. The character control unit 103 displays the determined action of the computer character on the user terminal 200.
[0062] According to this configuration, the computer character can perform an action determined based on the user information and the response time, thereby reducing the stress on the user caused by waiting for a response time.
[0063] Furthermore, according to the present disclosure, by taking into consideration not only response time but also user information, it is possible to determine more appropriate actions for a computer character.
[0064] For example, the user information may include information regarding the user's acceptance of the response time (estimated response time) of the computer character.
[0065] The user waits for the computer character to act (converse) until the response time has elapsed, but the user's tolerance for this varies depending on the user's personality. In the present disclosure, for example, the computer character's behavior can be changed depending on whether the user's tolerance for waiting time is high or low.
[0066] The user information may also include information regarding the positions of the user character and the computer character in the virtual space.
[0067] Furthermore, this position information may indicate a specific area in the virtual space where the user character and the computer character are located. An example of a specific area is a store in the virtual space. A computer character is located in the store in the virtual space, and the user (user character) may take action (talk to) the computer character. It may be beneficial for the user if the computer character behaves appropriately depending on the situation in the specific area (such as how crowded it is).
[0068] The user information may also include information about the time period in which the action was received from the user character. Having the computer character perform an appropriate action depending on the time period may contribute to reducing stress for the user.
[0069] The time period may also be related to the state of a specific area in the virtual space that the user character is located in. For example, if the specific area is a store, causing the computer character to take an appropriate action when the store is about to close can contribute to reducing stress for the user.
[0070] The user information may also include information regarding the display mode of the user character. For example, the user character may fidget or look embarrassed depending on the user's operation or character settings, and the computer character's behavior may be determined based on the display mode. This allows the computer character to perform appropriate behavior according to the user's display mode.
[0071] The user information may also be the operation state of the user character by the user. For example, the operation state may be whether the conversation is conducted by text or by voice, and the behavior of the computer character may be determined according to the operation state. This allows the computer character to perform an appropriate behavior according to the user's operation state.
[0072] The user terminal 200 of the present disclosure includes a display unit 202 that displays a virtual space including a user character operated by a user and a computer character controlled by a computer.
[0073] When a user character performs a predetermined action on a computer character in the virtual space, this display unit 202 displays the action of the computer character determined based on user information about the user and the response time required to respond to the predetermined action.
[0074] Furthermore, the virtual space providing system of the present disclosure is a virtual space providing system including a user terminal 200 operated by a user and an interaction generation server 100 that provides a virtual space to the user terminal 200.
[0075] As described above, the dialogue generation server 100 includes an action determination unit 102 that, when it receives a predetermined action from a user character operated by a user in a virtual space to a computer character, determines the action of the computer character based on user information about the user and the response time required to respond to the predetermined action, and a character control unit 103 that displays the determined action of the computer character on the user terminal.
[0076] The user terminal 200 also includes a display unit 202 that displays the virtual space including a user character operated by a user and a computer character controlled by a computer.
[0077] The dialogue generation server 100, user terminal 200, and character control system that operate as the character control device of the present invention have the following configurations.
[0078] [1] A character control device comprising: an action determination unit that, when a predetermined action for a computer character is received from a user character operated by a user in a virtual space, determines an action for the computer character based on user information about the user and an estimated response time required to respond to the predetermined action; and a character control unit that presents the determined action of the computer character to the user.
[0079] [2] The character control device according to [1], wherein the user information is information relating to the user's tolerance for response delays of the computer character.
[0080] [3] The character control device according to [1] or [2], wherein the user information is information relating to positions of the user character and the computer character in a virtual space.
[0081] [4] The character control device according to [3], wherein the information about the position indicates a specific area in the virtual space in which the user character and the computer character are located.
[0082] [5] The character control device according to any one of [1] to [4], wherein the user information is information relating to a time period in which the action was accepted from the user character.
[0083] [6] The character control device according to [5], wherein the time period is related to the state of a specific area in the virtual space in which the user character is located.
[0084] [7] The character control device according to any one of [1] to [6], wherein the user information is information relating to a display mode of the user character.
[0085] [8] The character control device according to any one of [1] to [7], wherein the user information is an operation state of the user character by the user.
[0086] [9] A terminal device comprising: a display unit that displays a virtual space including a user character operated by a user and a computer character controlled by a computer, wherein when the user character performs a predetermined action on the computer character in the virtual space, the display unit displays a display in accordance with the action of the computer character determined based on user information about the user and an estimated response time required to respond to the predetermined action.
[0087]
[10] A virtual space provision system including a terminal device operated by a user and a server device that provides a virtual space to the terminal device, wherein the server device comprises: an action determination unit that, when receiving a predetermined action from a user character operated by a user in the virtual space for a computer character, determines an action for the computer character based on user information about the user and an estimated response time required to respond to the predetermined action; and a character control unit that displays the determined action of the computer character on the user terminal; and the terminal device comprises: a display unit that displays the virtual space including the user character operated by the user and the computer character controlled by a computer.
[0088] The block diagrams used to explain the above embodiments show functional blocks. These functional blocks (components) are realized by any combination of hardware and / or software. Furthermore, the method for realizing each functional block is not particularly limited. That is, each functional block may be realized using a single device that is physically or logically coupled, or may be realized using two or more physically or logically separated devices that are connected directly or indirectly (e.g., via wire, wirelessly, etc.) and these multiple devices. The functional block may also be realized by combining the single device or multiple devices with software.
[0089] Functions include, but are not limited to, judgment, determination, assessment, calculation, computation, processing, derivation, investigation, search, confirmation, reception, transmission, output, access, resolution, selection, selection, establishment, comparison, assumption, expectation, consideration, broadcasting, notifying, communicating, forwarding, configuring, reconfiguring, allocating, mapping, and assignment. For example, a functional block (component) that performs transmission is called a transmitting unit or transmitter. As mentioned above, there are no particular limitations on how these functions are implemented.
[0090] For example, the dialogue generation server 100 according to an embodiment of the present disclosure may function as a computer that performs processing of the dialogue generation method of the present disclosure. Fig. 8 is a diagram showing an example of the hardware configuration of the dialogue generation server 100 according to an embodiment of the present disclosure. The dialogue generation server 100 described above may be physically configured as a computer device including a processor 1001, a memory 1002, a storage 1003, a communication device 1004, an input device 1005, an output device 1006, a bus 1007, etc.
[0091] In the following description, the term "device" can be interpreted as a circuit, a device, a unit, etc. The hardware configuration of the dialogue generation server 100 may be configured to include one or more of the devices shown in the figure, or may be configured to exclude some of the devices.
[0092] Each function of the dialogue generation server 100 is realized by loading specific software (programs) onto hardware such as a processor 1001 and memory 1002, causing the processor 1001 to perform calculations, control communications via the communication device 1004, and control at least one of reading and writing data from and to the memory 1002 and storage 1003.
[0093] The processor 1001 controls the entire computer by running, for example, an operating system. The processor 1001 may be configured as a central processing unit (CPU) including an interface with peripheral devices, a control device, an arithmetic unit, a register, etc. For example, the above-mentioned action determination unit 102, character control unit 103, etc. may be realized by the processor 1001.
[0094] The processor 1001 also loads programs (program codes), software modules, data, etc. from at least one of the storage 1003 and the communication device 1004 into the memory 1002 and executes various processes in accordance with these. The programs used are those that cause a computer to execute at least some of the operations described in the above-described embodiments. For example, the action determination unit 102 and the character control unit 103 may be implemented by a control program stored in the memory 1002 and running on the processor 1001, and similar implementations may be used for other functional blocks. While the above-described various processes have been described as being executed by a single processor 1001, they may also be executed simultaneously or sequentially by two or more processors 1001. The processor 1001 may be implemented by one or more chips. The programs may also be transmitted from a network via a telecommunications line.
[0095] The memory 1002 is a computer-readable recording medium and may be configured by, for example, at least one of a read-only memory (ROM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a random access memory (RAM), etc. The memory 1002 may also be called a register, a cache, a main memory (primary storage device), etc. The memory 1002 can store executable programs (program codes), software modules, etc. for implementing the dialogue generation method according to one embodiment of the present disclosure.
[0096] Storage 1003 is a computer-readable recording medium, and may be composed of at least one of, for example, an optical disk such as a CD-ROM (Compact Disc ROM), a hard disk drive, a flexible disk, a magneto-optical disk (e.g., a compact disk, a digital versatile disk, a Blu-ray (registered trademark) disk), a smart card, a flash memory (e.g., a card, a stick, a key drive), a floppy (registered trademark) disk, a magnetic strip, etc. Storage 1003 may also be referred to as an auxiliary storage device. The above-mentioned storage medium may be, for example, a database, a server, or other appropriate medium including at least one of memory 1002 and storage 1003.
[0097] The communication device 1004 is hardware (transmission / reception device) for communicating between computers via at least one of a wired network and a wireless network, and is also referred to as, for example, a network device, a network controller, a network card, or a communication module. The communication device 1004 may be configured to include a high-frequency switch, a duplexer, a filter, a frequency synthesizer, etc. to realize at least one of frequency division duplex (FDD) and time division duplex (TDD). For example, the communication unit 101 and the virtual space providing unit 104 described above may be realized by the communication device 1004. The communication device 1004 may be implemented with a transmitter and a receiver that are physically or logically separated from each other.
[0098] The input device 1005 is an input device (e.g., a keyboard, a mouse, a microphone, a switch, a button, a sensor, etc.) that accepts input from the outside. The output device 1006 is an output device (e.g., a display, a speaker, an LED lamp, etc.) that outputs to the outside. Note that the input device 1005 and the output device 1006 may be integrated into one device (e.g., a touch panel).
[0099] Furthermore, each device, such as the processor 1001 and the memory 1002, is connected by a bus 1007 for communicating information. The bus 1007 may be configured using a single bus, or may be configured using different buses between each device.
[0100] The dialogue generation server 100 may also be configured to include hardware such as a microprocessor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a programmable logic device (PLD), or a field programmable gate array (FPGA), and some or all of the functional blocks may be realized by the hardware. For example, the processor 1001 may be implemented using at least one of these pieces of hardware.
[0101] The notification of information is not limited to the aspects / embodiments described in the present disclosure and may be performed using other methods. For example, the notification of information may be performed by physical layer signaling (e.g., Downlink Control Information (DCI) and Uplink Control Information (UCI)), higher layer signaling (e.g., Radio Resource Control (RRC) signaling, Medium Access Control (MAC) signaling, broadcast information (Master Information Block (MIB) and System Information Block (SIB))), other signals, or a combination thereof. Furthermore, the RRC signaling may be referred to as an RRC message, and may be, for example, an RRC Connection Setup message, an RRC Connection Reconfiguration message, or the like.
[0102] The order of the procedures, sequences, flowcharts, etc. of each aspect / embodiment described in this disclosure may be changed unless it is consistent. For example, the methods described in this disclosure present elements of various steps using an example order, and are not limited to the particular order presented.
[0103] Input and output information may be stored in a specific location (for example, memory) or may be managed using a management table. Input and output information may be overwritten, updated, or added to. Output information may be deleted. Input information may be sent to another device.
[0104] The determination may be made based on a value represented by one bit (0 or 1), a Boolean value (true or false), or a numerical comparison (e.g., comparison with a predetermined value).
[0105] The aspects / embodiments described in this disclosure may be used alone, in combination, or switched depending on the implementation. Notification of predetermined information (e.g., notification that "X is true") is not limited to explicit notification, but may be implicit (e.g., not notifying the predetermined information).
[0106] Although the present disclosure has been described in detail above, it is clear to those skilled in the art that the present disclosure is not limited to the embodiments described herein. The present disclosure can be implemented in modified and altered forms without departing from the spirit and scope of the present disclosure as defined by the claims. Therefore, the description of the present disclosure is intended to be illustrative and does not have any limiting meaning on the present disclosure.
[0107] Software shall be construed broadly to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, threads of execution, procedures, functions, etc., whether referred to as software, firmware, middleware, microcode, hardware description language, or otherwise.
[0108] Software, instructions, information, etc. may also be transmitted or received over a transmission medium. For example, if software is transmitted from a website, server, or other remote source using wired technologies (such as coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL)), and / or wireless technologies (such as infrared, microwave), then these wired and / or wireless technologies are included within the definition of transmission media.
[0109] The information, signals, etc. described in this disclosure may be represented using any of a variety of different technologies. For example, data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description may be represented by voltages, currents, electromagnetic waves, magnetic fields or magnetic particles, optical fields or photons, or any combination thereof.
[0110] In addition, terms explained in this disclosure and terms necessary for understanding this disclosure may be replaced with terms having the same or similar meanings.
[0111] Furthermore, the information, parameters, etc. described in the present disclosure may be expressed using absolute values, may be expressed using relative values from a predetermined value, or may be expressed using other corresponding information. For example, a radio resource may be indicated by an index.
[0112] The names used for the parameters above are not limiting in any way.
[0113] In this disclosure, the terms "Mobile Station (MS)," "user terminal," "User Equipment (UE)," "terminal," and the like may be used interchangeably.
[0114] A mobile station may also be referred to by those skilled in the art as a subscriber station, mobile unit, subscriber unit, wireless unit, remote unit, mobile device, wireless device, wireless communication device, remote device, mobile subscriber station, access terminal, mobile terminal, wireless terminal, remote terminal, handset, user agent, mobile client, client, or some other suitable terminology.
[0115] As used in this disclosure, the terms "determining" and "determining" may encompass a wide variety of actions. "Determining" and "determining" may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up, searching, inquiring (e.g., searching in a table, database, or other data structure), ascertaining, and the like. "Determining" and "determining" may also include receiving (e.g., receiving information), transmitting (e.g., sending information), input, output, accessing (e.g., accessing data in memory), and the like. Furthermore, "judgment" and "decision" can include regarding resolving, selecting, choosing, establishing, comparing, etc. as having been "judged" or "decided." In other words, "judgment" and "decision" can include regarding some action as having been "judged" or "decided." Furthermore, "judgment (decision)" can be interpreted as "assuming," "expecting," "considering," etc.
[0116] The terms "connected," "coupled," or any variation thereof, refer to any direct or indirect connection or coupling between two or more elements, and may include the presence of one or more intermediate elements between two elements that are "connected" or "coupled" to each other. The coupling or connection between elements may be physical, logical, or a combination thereof. For example, "connected" may be read as "access." As used in this disclosure, two elements may be considered to be "connected" or "coupled" to each other using one or more wires, cables, and / or printed electrical connections, as well as electromagnetic energy having wavelengths in the radio frequency range, microwave range, and optical (both visible and invisible) range, as some non-limiting and non-exhaustive examples.
[0117] As used in this disclosure, the phrase "based on" does not mean "based only on," unless expressly stated otherwise. In other words, the phrase "based on" means both "based only on" and "based at least on."
[0118] As used in this disclosure, any reference to an element using a designation such as "first," "second," etc. does not generally limit the quantity or order of those elements. These designations may be used in this disclosure as a convenient method of distinguishing between two or more elements. Thus, a reference to a first and a second element does not imply that only two elements may be employed or that the first element must in some way precede the second element.
[0119] When the terms "include," "including," and variations thereof are used in this disclosure, these terms are intended to be inclusive, similar to the term "comprising." Furthermore, when the term "or" is used in this disclosure, it is not intended to be an exclusive or.
[0120] In this disclosure, where articles are added by translation, such as a, an, and the in English, the disclosure may include that the nouns following these articles are in the plural form.
[0121] In the present disclosure, the term "A and B are different" may mean "A and B are different from each other." The term may also mean "A and B are each different from C." Terms such as "separate" and "coupled" may also be interpreted in the same way as "different."
[0122] 101...communication unit, 102...action determination unit, 103...character control unit, 104...virtual space providing unit, 100a...user information DB, 100b...virtual space information DB, 201...communication unit, 202...display unit, 203...microphone, 204...operation unit, 205...speaker.
Claims
1. A character control device comprising: an action determination unit that, when a predetermined action for a computer character is received from a user character controlled by a user in a virtual space, determines an action for the computer character based on user information about the user and an estimated response time required to respond to the predetermined action; and a character control unit that presents the determined action of the computer character to the user.
2. The character control device according to claim 1, wherein the user information is information relating to the user's acceptance of the estimated response time of the computer character.
3. The character control device according to claim 1, wherein the user information is information relating to positions of the user character and the computer character in a virtual space.
4. The character control device according to claim 3, wherein the information relating to the position indicates a specific area in the virtual space in which the user character and the computer character are located.
5. The character control device according to claim 1, wherein the user information is information relating to a time period during which the action was accepted from the user character.
6. The character control device according to claim 5, wherein the time period is related to the state of a specific area in the virtual space in which the user character is located.
7. The character control device according to claim 1, wherein the user information is information relating to a display mode of the user character.
8. The character control device according to claim 1, wherein the user information is an operation state of the user character by the user.
9. A terminal device comprising: a display unit that displays a virtual space including a user character operated by a user and a computer character controlled by a computer, wherein when the user character performs a predetermined action on the computer character in the virtual space, the display unit displays a display in accordance with the action of the computer character determined based on user information about the user and an estimated response time required to respond to the predetermined action.
10. A virtual space providing system including a terminal device operated by a user and a server device that provides a virtual space to the terminal device, wherein the server device comprises: an action determination unit that, when it receives a predetermined action from a user character operated by a user in the virtual space for a computer character, determines an action of the computer character based on user information about the user and an estimated response time required to respond to the predetermined action; and a character control unit that displays the determined action of the computer character on the user terminal; and the terminal device comprises: a display unit that displays the virtual space including the user character operated by the user and the computer character controlled by a computer.
Citation Information
Patent Citations
Predictive injection of conversation fillers for assistant systems
US11245646B1