Character control device, terminal device, and virtual space provisioning system
Patent Information
- Application Number
- JP2025540660
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2023-08-16
- Filing Date
- 2024-08-06
- Publication Date
- 2026-09-01
- Estimated Expiration
- 2044-08-06
Smart Images

Figure 0007914362000001 
Figure 0007914362000002 
Figure 0007914362000003
Abstract
Description
[[Technical Field]]
[0001] The present invention relates to a character control device, a terminal device, and a virtual space providing system for controlling a character in a virtual space. [[Background Art]]
[0002] Patent Document 1 describes that an NPC object is presented in a virtual space, and the behavior of the NPC object is presented in the virtual space in response to an action by a user. [[Prior Art Literature]] [[Patent Literature]]
[0003] [[Patent Document 1]] Japanese Unexamined Patent Application Publication No. 2019-106220 [[Summary of the Invention]] [[Problem to be Solved by the Invention]]
[0004] In the technology described in Patent Document 1, the motion of an NPC (Non Player Character) object (hereinafter referred to as a computer character) may be delayed depending on a user's motion. In such a case, the user cannot achieve smooth communication with the computer character. For example, in a virtual space, while the user is having a conversation with the computer character, the computer character needs to think about what kind of response it should give in the conversation with the user. The occurrence of waiting time for the user due to this thinking causes a problem that it becomes a stress for the user. In addition, there may be cases where it is preferable to cause the computer character to perform an action appropriate for the user depending on the situation the user is placed in.
[0005] Therefore, an object of the present invention is to provide a character control device, a terminal device, and a virtual space providing system that can cause a computer character to perform an appropriate action for a user. [Means for solving the problem]
[0006] The character control device of the present invention includes: an action determination unit that, upon receiving a predetermined action from a user character operated by a user in a virtual space, determines the action of the computer character based on user information relating to the user and the estimated response time for the predetermined action; and a character control unit that displays the determined action of the computer character on the user's user terminal. [Effects of the Invention]
[0007] According to the present invention, it is possible to make a computer character perform actions that are appropriate for the user. [Brief explanation of the drawing]
[0008] [Figure 1] This figure shows the system configuration including the dialogue generation server 100, which is a character control device of this disclosure. [Figure 2] This is a schematic diagram of the virtual space in this disclosure. [Figure 3] This diagram shows the functional configuration of the dialogue generation server 100 and user terminal 200 as disclosed herein. [Figure 4] This figure shows the processing sequence in the dialogue generation server 100 and user terminal 200 of this disclosure. [Figure 5] This flowchart shows the detailed processing steps S103 and S104. [Figure 6] This flowchart shows the detailed processing for determining and controlling the operation of the computer character in process S208. [Figure 7] This figure shows a conversation between user character C2 and computer character C1 in the virtual space of this disclosure. [Figure 8] This figure shows an example of the hardware configuration of a dialogue generation server 100 according to one embodiment of the present disclosure. [Modes for carrying out the invention]
[0009] Embodiments of this disclosure will be described with reference to the attached drawings. Where possible, the same parts will be denoted by the same reference numerals, and redundant descriptions will be omitted.
[0010] Figure 1 shows a system configuration including a dialogue generation server 100, which is a character control device according to this disclosure. As shown in the figure, the dialogue generation server 100 includes a user information DB 100a and a virtual space information DB 100b. The dialogue generation server 100 generates a virtual space by referring to the virtual space information DB 100b and transmits it to the user terminal 200.
[0011] The user terminal 200 is a terminal device such as a smartphone or VR goggles, and is operated by the user. When the user terminal 200 receives a virtual space from the dialogue generation server 100, it displays user characters and computer characters (so-called NPCs) in that virtual space. User characters and computer characters are characters generated by the dialogue generation server 100.
[0012] Figure 2 is a schematic diagram of the virtual space in this disclosure. As shown in the figure, computer character C1 and computer character C2 are placed in the virtual space. In this disclosure, it is assumed that there is one computer character C1 and one user character C2 for control purposes, but in the virtual space, there may be multiple of each.
[0013] Figure 3 is a block diagram showing the functional configuration of the dialogue generation server 100 and user terminal 200 of this disclosure. As shown in the figure, Figure 3(a) is a block diagram showing the functional configuration of the dialogue generation server 100. This dialogue generation server 100 is composed of a communication unit 101, an operation determination unit 102, a character control unit 103, a virtual space provision unit 104, a user information DB 100a, and a virtual space information DB 100b.
[0014] The communication unit 101 is a part that communicates with the user terminal 200. The communication unit 101 receives, from the user terminal 200, information (e.g., voice) related to the motion of a user character operated by a user.
[0015] The motion determination unit 102 is a part that determines the motion of the computer character C1 based on information related to motion and user information. Prior to the motion determination, the motion determination unit 102 estimates a response time based on the information related to motion. For example, the motion determination unit 102 calculates the response time of computational processing for dialogue generation obtained through prior verification, and uses this as the response time. For example, for a plurality of conversations in advance, the time required for the computer character to respond to each conversation is calculated through experiments or the like, and the response time is calculated for each conversation. The method for calculating the response time is not limited to the above, and other known methods may also be used.
[0016] Further, the motion determination unit 102 calculates the response time based on a network congestion degree obtained from the network bandwidth between the server and the user terminal. Specifically, the motion determination unit 102 estimates the response time according to the network congestion degree by a method using packets (e.g., transmitting a ping and measuring the response time thereof).
[0017] Regarding the calculation of the response time described above, the two examples (delay in conversation content determination and NW (network) delay) have been given above, but the calculation is not limited to these, and other events that require response time may also be taken into consideration. Further, the response time is determined based on whichever is the longest among the estimated time until determination of conversation content, NW delay time, and delay time caused by other events. In the processing flow described below, for convenience of explanation, the response time based on the estimated time until determination of conversation content and the NW delay time is used, but it is naturally possible to take other delay times into consideration.
[0018] Then, the motion determination unit 102 determines the motion (intervention process) of the computer character C1 based on the response time. For example, the motion determination unit 102 performs an intervention process using an appropriate user stress relief measure based on the response time. Details of the intervention process and the relationship between the response time and user information will be described later.
[0019] The character control unit 103 is a part that controls the computer character C1 to perform the motion determined by the motion determination unit 102.
[0020] The virtual space providing unit 104 is a part that provides (transmits) a virtual space to the user terminal 200. This virtual space includes a user character C2 and a computer character C1, and the computer character C1 is controlled to move in accordance with the determined motion, respectively. The user character C2 is controlled to perform a motion in accordance with an operation from the user terminal 200.
[0021] The virtual space information DB 100b is a part that stores information for constructing a virtual space to be provided to the user terminal 200. The virtual space information DB 100b stores, as information for constructing a virtual space, information about the virtual space, a specific area arranged therein, and a computer character that operates in the specific area. The specific area is, for example, an area such as a store or a facility where a user character can perform actions such as shopping in the virtual space. It should be noted that, of course, the present invention is not limited thereto, and information for constructing other facilities existing in the real world in the virtual space may also be stored.
[0022] The user information DB 100a is a part that stores user information regarding the user of the user terminal 200. The user information regarding the user is any information related to the user, and includes, for example, user characteristics. In addition, it includes information other than user characteristics such as the position where the user is located and the time zone. In the present disclosure, in particular, the user characteristics include information indicating the degree of acceptance of the motion (intervention measure) of the computer character, and may include neuroticism, extraversion, openness, agreeableness, conscientiousness, and the like.
[0023] In addition, user information may include at least one piece of information about the user, such as location, time of day, display method of the user character (the character of the speaking user), or the state of the user operating user character C2.
[0024] Figure 3(b) is a block diagram showing the functional configuration of the user terminal 200. As shown in the figure, the user terminal 200 consists of a communication unit 201, a display unit 202, a microphone 203, an operation unit 204, and a speaker 205. This user terminal 200 could take the form of, for example, a VR goggles, but it may also take other forms.
[0025] The communication unit 201 is the part that receives information about the virtual space from the dialogue generation server 100, or transmits user operation information to the dialogue generation server 100.
[0026] The display unit 202 is the part that displays the virtual space, the computer character C1 and user character C2 included in the virtual space, etc.
[0027] Microphone 203 is the part that receives the user's voice for the user character C2 to speak to the computer character C1 in the virtual space.
[0028] The control unit 204 is the part that receives input from the user character C2 in the virtual space. It may also be equipped with a keyboard or similar for text-based communication via chat, etc.
[0029] Speaker 205 is the part that outputs sound from virtual computer characters such as C1.
[0030] Figure 4 shows the processing sequence in the dialogue generation server 100 and user terminal 200 of this disclosure.
[0031] As shown in the diagram, in the virtual space displayed on the user terminal 200, the user (user character C2) speaks to the computer character C1 (S101). Then, the voice data is sent from the user terminal 200 to the dialogue generation server 100 (S102).
[0032] In the dialogue generation server 100, the action determination unit 102 estimates the response time based on the network congestion level and the time required to make an appropriate response to the utterance (S103). Then, the action determination unit 102 determines the character's action based on the response time (S104).
[0033] The character control unit 103 transmits character motion control information indicating the character's movements to the user terminal 200 via the virtual space provision unit 104 (S105). At the user terminal 200, the computer character C1 performs actions according to the character motion control information (S106). As described above, depending on the response time, the user may be kept waiting and stressed. Therefore, the actions here are simple actions (such as nodding in agreement), but of course, they are not limited to these.
[0034] Subsequently, in the dialogue generation server 100, the operation decision unit 102 determines the response content according to the utterance of user character C2 (S107), and the virtual space provision unit 104 transmits the response content to the user terminal 200 (S108). Then, in the user terminal 200, computer character C1 gives a response to user character C2 according to the response content (S109).
[0035] Figure 5 is a flowchart showing the process of providing the virtual space, and the detailed processing of processes S103 and S104 in Figure 4.
[0036] In the dialogue generation server 100, the virtual space provision unit 104 obtains the time zone, location, and other virtual space information of the virtual space (including the virtual store) from the virtual space information DB 100b and provides that virtual space to the user terminal 200 (S201).
[0037] The communication unit 101 acquires the location information of the user character from the user terminal 200 (S202). The virtual space provision unit 104 also acquires the location information of the computer character (S203). In this way, the virtual space provision unit 104 represents the user character and the computer character in the virtual space and provides them to the user terminal 200.
[0038] The communication unit 101 then acquires the user character's actions from the user terminal 200 (S204). The action determination unit 102 identifies the computer character to be controlled based on the user character's actions (including the content of the conversation) (S205). For example, if the user character speaks to a computer character, the computer character is identified based on the user character's position and the content of their speech. The content of the speech is what the user character (user) said to the computer character. Depending on the content of the speech, it is possible to determine, for example, whether the user spoke to a store clerk (computer character) in a virtual space or to a passerby (computer character).
[0039] The operation determination unit 102 then calculates the control content for the computer character's actions in accordance with the user character's actions (S206) and estimates the response time (estimated response time) (S207). If the response time is longer than a predetermined time, the operation determination unit 102 determines the computer character's actions according to that time and performs the control (S208). For example, the operation determination unit 102 determines a predetermined gesture and performs control to make the computer character perform that gesture, so as not to stress the user who is waiting for the response time until the control content is determined.
[0040] Subsequently, once the control content is determined, the operation determination unit 102 performs control to operate a computer character corresponding to that control content (S209).
[0041] In Figure 5, the actions of the user and computer character include actions such as speech and gestures.
[0042] Figure 6 is a flowchart showing the detailed processing of the computer character operation determination and control in process S208. The operation determination unit 102 obtains user information (user characteristics, user status, operation information) about the user of the user terminal 200 from the user information DB 100a (S208a). The operation determination unit 102 determines the user's tolerance level based on the above user information (S208b). For example, the user's tolerance level is a value that indicates how much time the user can tolerate waiting, and the larger the value, the greater the tolerance for waiting time. Note that the value may be controlled to increase or decrease depending on the time of day, and may be a value that indicates that people are in a hurry in the morning (low tolerance level) and not in a hurry in the afternoon (high tolerance level).
[0043] Then, the operation determination unit 102 acquires the user's operation status (S208c). The operation determination unit 102 may acquire the user's operation status, such as the speaker volume, or it may acquire the user's operation or setting, such as the user character appearing embarrassed or fidgeting.
[0044] The operation determination unit 102 further acquires information on the perceived distance from the user, the location and closing time of the virtual store, and determines control content according to at least one of the perceived distance from the user, the location and closing time of the virtual store, the operation state, and the level of acceptance, in addition to the response time (S208d). The perceived distance from the user is information based on the positions of the user character and the computer character, and is a virtual distance in the virtual space. The location and closing time of the virtual store are information acquired from the virtual space information DB 100b. In addition to this information, the virtual space information DB 100b may also store the congestion status in the virtual space (or virtual store).
[0045] Figure 7 shows a conversation between a user character C2 and a computer character C1 in a virtual space to which the technology of this disclosure is applied. In Figure 7(a), user character C2 asks computer character C1, "What kind of place is Akasaka?"
[0046] Computer character C1 responds with, "Well, um... I guess..." Here, the action decision unit 102 calculates the response time required for responding to the content of user character C2's conversation and determines that the response time is long (more than the predetermined time), so computer character C1 responds with the above content for the time being. Then, the action decision unit 102 further derives the response content, "It says this on the internet (website presentation)," and instructs computer character C1 to act. Here, a simple website from the internet is presented. These actions constitute intervention processing to alleviate stress for the user. Note that if the response time is short (within the predetermined time), the action decision unit 102 may have computer character C1 respond only with, "Well, um... I guess..."
[0047] Figure 7(b) shows a specific example. After the stress relief intervention, the action decision unit 102 generates and responds with the content, "There's a quiet area with Hikawa Shrine and such..." Then, when user character C2 continues the conversation with, "There are lots of restaurants there," the action decision unit 102 calculates the response time and, judging it to be short, generates and responds with the content, "Oh, that reminds me, the other day with a friend..."
[0048] In this way, stress reduction interventions can be performed for the user based on the response time in the conversation between user character C2 and computer character C1.
[0049] Next, the switching patterns of actions according to the response time of this disclosure will be described. Figure 7 above is an example of an intervention process, and various other intervention processes are possible. If the response time (delay time) is short, the action determination unit 102 causes the computer character C1 to perform a predetermined gesture. For example, the action determination unit 102 may cause the computer character C1 to make gestures that indicate deep thought. As a result, the computer character performs at least some action, which reduces the user's stress regarding the response time (delay time).
[0050] Furthermore, if the response time is short, the operation determination unit 102 may perform an intervention process that does not create a period of silence, such as by using filler words like "um," or "well," to avoid making the response time (delay time) feel like a delay.
[0051] Furthermore, if the response time is short, the action determination unit 102 may repeat the response, for example, "So you mean (the question)?". This allows for intervention processing that does not give the impression of a long response time.
[0052] Furthermore, if the response time (delay time) is long, the operation determination unit 102 may display a related site or video viewer, and perform intervention processing to make the user feel that the response time (delay time) is not noticeable depending on the viewing time.
[0053] Furthermore, in addition to considering the above response time, the operation determination unit 102 can determine the operation of the computer character C1 based on user information.
[0054] For example, the action determination unit 102 determines the gesture type based on the distance between computer character C1 and user character C2, based on the location indicated in the user information (in this case, the user information includes location information). The gesture type is a predetermined gesture, but it may also be a large gesture, a small gesture, etc., indicating the size of the body movement. Furthermore, if the location indicated in the user information is in a predetermined store (a crowded store), the action determination unit 102 may determine a gesture based on the store type (high or low level of crowding). The store type and level of crowding may be stored in the virtual space information DB 100b.
[0055] Furthermore, the operation determination unit 102 may determine the type of gesture according to the degree of congestion, not only based on the user's presence in a designated store, but also on information regarding whether the store is crowded or not. Information regarding congestion may be obtained from the virtual space information DB 100b or other devices, or it may be measured. As for the measurement method, for example, the number of user characters displayed in the store may be measured, and if there are more than a predetermined number of user characters, it may be determined that the store is crowded. Alternatively, if a predetermined number of user characters are within a certain distance from the user's user character, it may be determined that the store is crowded, and the gesture of the computer character that the user is speaking to may be made smaller. In addition, if a store in a virtual space merged with the real world is assumed, the actual degree of congestion in the store may be reflected. Other conventional general methods may also be used.
[0056] Furthermore, if the user information indicates a time of day, the action determination unit 102 may determine a quiet gesture if it is a predetermined time of day, such as when the user is sleeping. Also, if the user is in a predetermined store, the action determination unit 102 may determine a gesture that conveys a sense of urgency by speaking a little faster, if it is a busy time before the store closes.
[0057] Furthermore, if the user information includes the display manner of the user character (speaker user), the action determination unit 102 determines the type of gesture corresponding to that display manner. For example, if the speaker user's user character is fidgeting, the action determination unit 102 determines a gesture to make the speaker speak a little faster and appear to be in a hurry. Also, if the speaker user appears embarrassed, the action determination unit 102 determines an action to speak in a low voice or with small gestures.
[0058] Furthermore, if the user information includes the state of the user controlling the user character, the action determination unit 102 determines a gesture to intervene at a normal speed if the conversation is conducted via text, and to intervene quickly if the conversation is conducted via voice. In addition, if the user terminal 200 is set to turn off the speaker (or set the volume to 0 or low), the computer character may operate in a way that can be understood through gestures rather than voice.
[0059] The above user information is set on the user terminal 200, and the user's user character may operate according to that setting, or it may operate according to the user's actions. Furthermore, the user character's actions may be automatically controlled based on information about the computer character. Information about the computer character includes attributes such as gender and age. It is assumed that when the user's user character is facing the computer character, it will operate automatically based on this information without user intervention. For example, if the computer character is set to be a celebrity in the virtual space, the user's user character may act embarrassed in accordance with that attribute. This action is intended to mimic real-world behavior.
[0060] Next, the effects of the dialogue generation server 100 and user terminal 200 of this disclosure will be explained. Although the dialogue generation server 100 functions as a character control device, this character control device does not necessarily have to be a server. A terminal device may function as a character control device. In that case, the terminal device will need the function of generating and providing a virtual space to the user.
[0061] In the dialogue generation server 100 of this disclosure, when the operation determination unit 102 receives a predetermined operation from the user terminal 200 to the computer character from the user character operated by the user in the virtual space provided to the user terminal 200, it determines the operation of the computer character based on user information about the user and the response time (estimated response time) for the response to the predetermined operation. The character control unit 103 displays the determined operation of the computer character on the user terminal 200.
[0062] This configuration allows for the operation of a computer character determined according to user information and response time, thereby reducing user stress caused by waiting for response times.
[0063] Furthermore, according to this disclosure, by considering not only the response time but also user information, it is possible to determine more appropriate computer character behavior.
[0064] For example, user information may include information about the user's tolerance for the response time (estimated response time) of computer characters.
[0065] The user will have to wait for the computer character's actions (conversation) until the response time has elapsed, but the user's tolerance for this will vary depending on their personality. In this disclosure, for example, the computer character's actions can be changed depending on whether the user's tolerance for the waiting time is high or low.
[0066] Furthermore, user information may include information regarding the virtual space positions of the user character and the computer character.
[0067] Furthermore, this location information may indicate a specific area in the virtual space where the user character and computer character are located. A specific area could be, for example, a store in the virtual space. Computer characters are placed in the store in the virtual space, and the user (user character) may take action (talk to) these computer characters. Depending on the situation in that specific area (such as congestion), it may be beneficial for the user if the computer characters behave appropriately.
[0068] Furthermore, user information may include information about the time period during which the user character initiated the action. Having the computer character perform appropriate actions depending on the time of day may contribute to reducing user stress.
[0069] Furthermore, that time period may be related to the state of a specific area in the virtual space where the user character is located. For example, if a store is assumed to be the specific area, having the computer character perform appropriate actions based on the store's closing time may contribute to reducing user stress.
[0070] Furthermore, user information may include information regarding the display manner of the user character. For example, depending on user actions or character settings, the user character may fidget or appear embarrassed, and the computer character's actions may be determined according to such display manners. This allows for appropriate actions according to the user's display manner.
[0071] Furthermore, user information may also represent the user's operation status of the user character. For example, the operation status could be whether the user is communicating via text or voice, and the computer character's actions may be determined according to such a status. This allows for appropriate actions to be performed according to the user's operation status.
[0072] The user terminal 200 of this disclosure includes a display unit 202 that displays a virtual space including a user character operated by the user and a computer character controlled by the computer.
[0073] When a predetermined action is performed by a user character in the virtual space, the display unit 202 displays information about the user and the response time for the predetermined action, in accordance with the operation of the computer character determined based on the user information and the response time for the predetermined action.
[0074] Furthermore, the virtual space provision system described herein is a virtual space provision system that includes a user terminal 200 operated by the user and a dialogue generation server 100 that provides a virtual space to the user terminal 200.
[0075] As described above, the dialogue generation server 100 includes an action determination unit 102 that, upon receiving a predetermined action from a user character operated by a user in a virtual space, determines the action of the computer character based on user information about the user and the response time required for the predetermined action, and a character control unit 103 that displays the determined action of the computer character on the user terminal.
[0076] Furthermore, the user terminal 200 includes a display unit 202 that displays the virtual space, which includes user characters operated by the user and computer characters controlled by the computer.
[0077] The dialogue generation server 100, user terminal 200, and character control system operating as a character control device of the present invention have the following configuration.
[0078] [1] When a predetermined action is received from a user character operated by a user in a virtual space, the action determination unit determines the action of the computer character based on user information about the user and the response estimation time for the response to the predetermined action. A character control unit that presents the determined actions of the computer character to the user, A character control device equipped with the following features.
[0079] [2] The user information is information relating to the user's tolerance for the response delay of the computer character. [1] The character control device described above.
[0080] [3] The user information is information relating to the virtual space positions of the user character and the computer character. The character control device described in [1] or [2].
[0081] [4] The position information indicates a specific area in the virtual space where the user character and the computer character are located. [3] The character control device described above.
[0082] [5] The user information is information regarding the time period during which the action was received from the user character. A character control device as described in any one of [1] to [4].
[0083] [6] The aforementioned time period is related to the state of a specific area in the virtual space where the user character is located. [5] The character control device described above.
[0084] [7] The user information is information relating to the display manner of the user character. A character control device as described in any one of [1] to [6].
[0085] [8] The user information is the operation status of the user character by the user. A character control device as described in any one of [1] to [7].
[0086] [9] It comprises a display unit that displays a virtual space including user characters operated by the user and computer characters controlled by the computer, The aforementioned display unit is In the virtual space, when a predetermined action is performed by the user character on the computer character, a display is made according to the computer character's action, which is determined based on user information about the user and the estimated response time for the predetermined action. Terminal device.
[0087]
[10] In a virtual space provision system including a terminal device operated by a user and a server device that provides a virtual space to the terminal device, The server device is In a virtual space, when a predetermined action is received from a user character operated by a user, an action determination unit determines the action of the computer character based on user information about the user and the estimated response time for the response to the predetermined action. A character control unit that displays the determined actions of the computer character on a user terminal, Equipped with, The aforementioned terminal device is A display unit that displays the virtual space including user characters operated by the user and computer characters controlled by the computer, Equipped with A virtual space provision system.
[0088] The block diagram used in the description of the above embodiment shows functional units. These functional blocks (components) are realized by any combination of at least one of hardware and software. Furthermore, the method of realizing each functional block is not particularly limited. That is, each functional block may be realized using one device that is physically or logically coupled, or it may be realized using two or more physically or logically separated devices that are directly or indirectly connected (for example, using wired or wireless connections). A functional block may be realized by combining the above one device or the above multiple devices with software.
[0089] Functions include, but are not limited to, judgment, decision, judgment, calculation, calculation, processing, derivation, investigation, exploration, confirmation, reception, transmission, output, access, resolution, selection, selection, establishment, comparison, assumption, expectation, assumption, broadcasting, notifying, communicating, forwarding, configuring, reconfiguring, allocating (mapping), and assigning. For example, a functional block (configuration part) that enables transmission is called a transmitting unit or transmitter. As mentioned above, the method of implementation is not particularly limited.
[0090] For example, the dialogue generation server 100 in one embodiment of the present disclosure may function as a computer that processes the dialogue generation method of the present disclosure. Figure 8 is a diagram showing an example of the hardware configuration of the dialogue generation server 100 according to one embodiment of the present disclosure. The above-described dialogue generation server 100 may be physically configured as a computer device including a processor 1001, memory 1002, storage 1003, communication device 1004, input device 1005, output device 1006, bus 1007, etc.
[0091] In the following explanation, the term "device" can be replaced with "circuit," "device," "unit," etc. The hardware configuration of the dialogue generation server 100 may include one or more of the devices shown in the figure, or it may be configured to omit some of the devices.
[0092] Each function in the dialogue generation server 100 is realized by loading predetermined software (programs) onto hardware such as the processor 1001 and memory 1002, which causes the processor 1001 to perform calculations, control communication by the communication device 1004, and control at least one of the reading and writing of data in the memory 1002 and storage 1003.
[0093] The processor 1001 controls the entire computer, for example, by running the operating system. The processor 1001 may be composed of a central processing unit (CPU) that includes interfaces with peripheral devices, control devices, arithmetic units, registers, etc. For example, the operation determination unit 102 and character control unit 103 described above may be implemented by the processor 1001.
[0094] Furthermore, the processor 1001 reads programs (program code), software modules, data, etc., from at least one of the storage 1003 and the communication device 1004 into the memory 1002 and executes various processes accordingly. The program used is one that causes the computer to execute at least a part of the operations described in the above embodiment. For example, the operation determination unit 102 and the character control unit 103 may be implemented by a control program stored in the memory 1002 and running on the processor 1001, and other functional blocks may be implemented similarly. The above-described various processes have been explained as being executed by one processor 1001, but they may be executed simultaneously or sequentially by two or more processors 1001. The processor 1001 may be implemented by one or more chips. The program may also be transmitted from a network via a telecommunications line.
[0095] Memory 1002 is a computer-readable recording medium and may consist of at least one of the following: ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable ROM), RAM (Random Access Memory), etc. Memory 1002 may also be called a register, cache, main memory, etc. Memory 1002 can store executable programs (program code), software modules, etc., for carrying out the interaction generation method according to one embodiment of the present disclosure.
[0096] Storage 1003 is a computer-readable recording medium and may consist of at least one of the following: an optical disc such as a CD-ROM (Compact Disc ROM), a hard disk drive, a flexible disk, a magneto-optical disk (e.g., a compact disc, a digital multipurpose disc, a Blu-ray® disc), a smart card, flash memory (e.g., a card, a stick, a key drive), a floppy® disk, a magnetic strip, etc. Storage 1003 may also be called an auxiliary storage device. The above-mentioned storage medium may be, for example, a database, server, or other suitable medium including at least one of memory 1002 and storage 1003.
[0097] The communication device 1004 is hardware (transmitting / receiving device) for communicating between computers via at least one of a wired network and a wireless network, and is also referred to as a network device, network controller, network card, communication module, etc. The communication device 1004 may be configured to include high-frequency switches, duplexers, filters, frequency synthesizers, etc., in order to implement at least one of frequency division duplex (FDD) and time division duplex (TDD). For example, the communication unit 101 and virtual space provision unit 104 described above may be implemented by the communication device 1004. The communication device 1004 may be implemented with physically or logically separated transmitting and receiving units.
[0098] The input device 1005 is an input device that accepts input from an external source (e.g., a keyboard, mouse, microphone, switch, button, sensor, etc.). The output device 1006 is an output device that outputs to an external source (e.g., a display, speaker, LED lamp, etc.). The input device 1005 and the output device 1006 may be configured as an integrated unit (e.g., a touch panel).
[0099] Furthermore, each device, such as the processor 1001 and memory 1002, is connected by a bus 1007 for communicating information. The bus 1007 may be configured using a single bus, or different buses may be configured for each device.
[0100] Furthermore, the dialogue generation server 100 may be configured to include hardware such as a microprocessor, a digital signal processor (DSP), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), or an FPGA (Field Programmable Gate Array), and some or all of each functional block may be realized by such hardware. For example, the processor 1001 may be implemented using at least one of these hardware components.
[0101] Information notification is not limited to the embodiments described herein and may be carried out by other means. For example, information notification may be carried out by physical layer signaling (e.g., DCI (Downlink Control Information), UCI (Uplink Control Information)), upper layer signaling (e.g., RRC (Radio Resource Control) signaling, MAC (Medium Access Control) signaling, broadcast information (MIB (Master Information Block), SIB (System Information Block))), other signals, or combinations thereof. RRC signaling may also be called RRC messages, and may be, for example, RRC Connection Setup messages, RRC Connection Reconfiguration messages, etc.
[0102] The processing procedures, sequences, flowcharts, etc., of each aspect / embodiment described herein may be reordered, provided they are consistent with each other. For example, the methods described herein present various step elements in an exemplary order and are not limited to that specific order.
[0103] Input and output information may be stored in a specific location (e.g., memory) or managed using a management table. Input and output information may be overwritten, updated, or appended to. Output information may be deleted. Input information may be transmitted to other devices.
[0104] The determination may be made by a value represented by 1 bit (0 or 1), by a boolean value (true or false), or by a numerical comparison (for example, a comparison with a predetermined value).
[0105] Each aspect / embodiment described herein may be used individually, in combination, or switched between as needed during implementation. Furthermore, notification of specific information (e.g., notification that "X is") is not limited to explicit notification, but may also be implicit (e.g., by not providing such notification).
[0106] Although the present disclosure has been described in detail above, it will be clear to those skilled in the art that the present disclosure is not limited to the embodiments described herein. The present disclosure can be implemented in modified and altered forms without departing from the intent and scope of the present disclosure as defined by the claims. Accordingly, the descriptions in the present disclosure are illustrative and not intended to be restrictive in any way.
[0107] Software should be broadly interpreted to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, execution threads, procedures, functions, and so on, whether they are called software, firmware, middleware, microcode, hardware description languages, or by any other name.
[0108] Furthermore, software, instructions, information, etc., may be transmitted and received via a transmission medium. For example, if software is transmitted from a website, server, or other remote source using at least one of wired technologies (such as coaxial cable, fiber optic cable, twisted pair, or digital subscriber line (DSL)) and wireless technologies (such as infrared or microwave), then at least one of these wired and wireless technologies is included in the definition of a transmission medium.
[0109] The information, signals, etc. described in this disclosure may be represented using any of the various different techniques. For example, the data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description may be represented by voltage, current, electromagnetic waves, magnetic fields or magnetic particles, optical fields or photons, or any combination thereof.
[0110] In addition, terms used in this disclosure and terms necessary for understanding this disclosure may be replaced with terms that have the same or similar meaning.
[0111] Furthermore, the information, parameters, etc., described in this disclosure may be expressed using absolute values, relative values from a given value, or other corresponding information. For example, wireless resources may be indicated by an index.
[0112] The names used for the parameters mentioned above are not restrictive in any way.
[0113] In this disclosure, terms such as "Mobile Station (MS)," "user terminal," "User Equipment (UE)," and "terminal" may be used interchangeably.
[0114] A mobile station may also be referred to by those skilled in the art as a subscriber station, mobile unit, subscriber unit, wireless unit, remote unit, mobile device, wireless device, wireless communication device, remote device, mobile subscriber station, access terminal, mobile terminal, wireless terminal, remote terminal, handset, user agent, mobile client, client, or some other appropriate term.
[0115] As used in this disclosure, the terms “determining” and “determining” may encompass a wide variety of actions. “Determining” may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up, searching, or inquiring (e.g., searching in a table, database, or other data structure), or ascertaining. “Determining” may also include, for example, receiving (e.g., receiving information), transmitting (e.g., sending information), inputting, outputting, or accessing (e.g., accessing data in memory). Furthermore, "judgment" and "decision" can include considering something as having been "judged" or "decided" after resolving, selecting, choosing, establishing, comparing, etc. In other words, "judgment" and "decision" can include considering something as having been "judged" or "decided" after some action. Also, "judgment (decision)" can be reinterpreted as "assuming," "expecting," or "considering."
[0116] The terms “connected,” “coupled,” or any variation thereof, mean any direct or indirect connection or coupling between two or more elements, and may include the presence of one or more intermediate elements between two elements that are “connected” or “coupled” with each other. The coupling or connection between elements may be physical, logical, or a combination thereof. For example, “connection” may be reinterpreted as “access.” As used in this disclosure, two elements may be considered to be “connected” or “coupled” with each other using at least one of one or more wires, cables, and printed electrical connections, and, in some non-limiting and non-exclusive examples, electromagnetic energy having wavelengths in the radio frequency domain, microwave domain, and optical (both visible and invisible) domain.
[0117] In this disclosure, the phrase "based on" does not mean "based solely on" unless otherwise specified. In other words, the phrase "based on" means both "based solely on" and "based at least on."
[0118] Any reference to elements using designations such as “first,” “second,” etc., as used in this disclosure does not generally limit the quantity or order of those elements. These designations may be used in this disclosure as a convenient way to distinguish between two or more elements. Accordingly, references to first and second elements do not imply that only two elements may be adopted, or that the first element must precede the second element in any way.
[0119] Where the terms “include,” “including,” and their variations are used in this disclosure, these terms are intended to be inclusive, as is the term “comprising.” Furthermore, the term “or” as used in this disclosure is not intended to mean exclusive OR.
[0120] In this disclosure, if articles are added by translation, such as a, an, and the in English, this disclosure may include the fact that the noun following these articles is plural.
[0121] In this disclosure, the term "A and B are different" may mean "A and B are different from each other." The term may also mean "A and B are each different from C." Terms such as "separate" and "combine" may be interpreted similarly to "different." [Explanation of Symbols]
[0122] 101...Communication unit, 102...Operation determination unit, 103...Character control unit, 104...Virtual space provision unit, 100a...User information DB, 100b...Virtual space information DB, 201...Communication unit, 202...Display unit, 203...Microphone, 204...Operation unit, 205...Speaker.
Claims
1. When a predetermined action is received from a user character operated by a user in a virtual space, the action determination unit determines the action of the computer character based on user information about the user and the estimated response time for the predetermined action. A character control unit that presents the determined actions of the computer character to the user, Equipped with, The user information is information relating to the virtual space positions of the user character and the computer character. CHARGE control device.
2. The user information further includes information regarding the user's tolerance of the computer character's response estimation time. The character control device according to claim 1.
3. The position information indicates a specific area in the virtual space where the user character and the computer character are located. The character control device according to claim 1.
4. When a predetermined action is received from a user character operated by a user in a virtual space, the action determination unit determines the action of the computer character based on user information relating to the user and the response estimation time for the response to the predetermined action, A character control unit that presents the determined actions of the computer character to the user, Equipped with, The user information is information relating to the time period during which the predetermined action was received from the user character. CHARGE control device.
5. The aforementioned time period is related to the state of a specific area in the virtual space where the user character is located. The character control device according to claim 4.
6. When a predetermined action is received from a user character operated by a user in a virtual space, the action determination unit determines the action of the computer character based on user information relating to the user and the response estimation time for the response to the predetermined action, A character control unit that presents the determined actions of the computer character to the user, Equipped with, The user information is information relating to the display manner of the user character. CHARGE control device.
7. When a predetermined action is received from a user character operated by a user in a virtual space, the action determination unit determines the action of the computer character based on user information relating to the user and the response estimation time for the response to the predetermined action, A character control unit that presents the determined actions of the computer character to the user, Equipped with, The user information is the operation status of the user character by the user. CHARGE control device.
8. It comprises a display unit that displays a virtual space including user characters operated by the user and computer characters controlled by the computer, The aforementioned display unit is In the virtual space, when a predetermined action is performed by the user character on the computer character, a display is made according to the computer character's actions, which are determined based on user information about the user and the estimated response time for the predetermined action. The user information is information relating to the virtual space positions of the user character and the computer character. Terminal device.
9. In a virtual space provision system including a terminal device operated by a user and a server device that provides a virtual space to the terminal device, The server device is In a virtual space, when a predetermined action is received from a user character operated by a user, an action determination unit determines the action of the computer character based on user information about the user and the response estimation time for the response to the predetermined action. A character control unit that displays the determined actions of the computer character on the terminal device, Equipped with, The aforementioned terminal device is A display unit that displays the virtual space including user characters operated by the user and computer characters controlled by the computer, Equipped with, The user information is information relating to the virtual space positions of the user character and the computer character. A virtual space provision system.
10. A display unit that displays a virtual space including a user character operated by a user and a computer character controlled by a computer, The aforementioned display unit is In the virtual space, when a predetermined action is performed by the user character on the computer character, a display is made according to the computer character's actions, which are determined based on user information about the user and the estimated response time for the predetermined action. The user information is information relating to the time period during which the predetermined action was received from the user character. Terminal device.
11. A virtual space provision system including a terminal device operated by a user and a server device that provides a virtual space to the terminal device, The server device is In a virtual space, when a predetermined action is received from a user character operated by a user, an action determination unit determines the action of the computer character based on user information about the user and the response estimation time for the response to the predetermined action. A character control unit that displays the determined actions of the computer character on the terminal device, Equipped with, The aforementioned terminal device is A display unit that displays the virtual space including user characters operated by the user and computer characters controlled by the computer, Equipped with, The user information is information relating to the time period during which the predetermined action was received from the user character. A virtual space provision system.
12. A display unit that displays a virtual space including a user character operated by a user and a computer character controlled by a computer, The aforementioned display unit is In the virtual space, when a predetermined action is performed by the user character on the computer character, a display is made according to the computer character's actions, which are determined based on user information about the user and the estimated response time for the predetermined action. The user information is information relating to the display manner of the user character. Terminal device.
13. A virtual space provision system including a terminal device operated by a user and a server device that provides a virtual space to the terminal device, The server device is In a virtual space, when a predetermined action is received from a user character operated by a user, an action determination unit determines the action of the computer character based on user information about the user and the response estimation time for the response to the predetermined action. A character control unit that displays the determined actions of the computer character on the terminal device, Equipped with, The aforementioned terminal device is A display unit that displays the virtual space including user characters operated by the user and computer characters controlled by the computer, Equipped with, The user information is information relating to the display manner of the user character. A virtual space provision system.
14. A display unit that displays a virtual space including a user character operated by a user and a computer character controlled by a computer, The aforementioned display unit is In the virtual space, when a predetermined action is performed by the user character on the computer character, a display is made according to the computer character's actions, which are determined based on user information about the user and the estimated response time for the predetermined action. The user information is the operation status of the user character by the user. Terminal device.
15. A virtual space provision system including a terminal device operated by a user and a server device that provides a virtual space to the terminal device, The server device is In a virtual space, when a predetermined action is received from a user character operated by a user, an action determination unit determines the action of the computer character based on user information about the user and the response estimation time for the response to the predetermined action. A character control unit that displays the determined actions of the computer character on the terminal device, Equipped with, The aforementioned terminal device is A display unit that displays the virtual space including user characters operated by the user and computer characters controlled by the computer, Equipped with, The user information is the operation status of the user character by the user. A virtual space provision system.
Citation Information
Patent Citations
Program executed by computer to provide virtual space via head mount device, method, and information processing device
JP2019106220A
Predictive injection of conversation fillers for assistant systems
US11245646B1