Character interaction system and character interaction method

Abstract

To allow a user to easily interact in presentation of information.SOLUTION: A character interaction system includes a response processing unit for responding to an input from a user. The response processing unit acquires at least position information of the user and position information of at least one display device provided in an input / output device. The response processing unit is connected to the input / output device so as to respond to the user through a character displayed on the display device having position information corresponding to the position information of the user.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The technology disclosed herein relates to user interaction. [Background technology]

[0002] 2. Description of the Related Art Conventionally, there have been information providing systems capable of centrally managing and processing information inside and outside a building and providing the information in real time (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2023-26205 Summary of the Invention [Problem to be solved by the invention]

[0004] The technology described in Patent Document 1 conveys information about inside and outside the building to the user, but it is specialized in one-way content display and does not function sufficiently as a target for user interaction.

[0005] The technology disclosed in this specification has been made in consideration of the problems described above, and is a technology for making it easier for users to interact when presenting information. [Means for solving the problem]

[0006] A character interaction system which is a first aspect of the technology disclosed in the present specification includes a response processing unit for responding to input from a user, the response processing unit acquiring at least location information of the user and location information of at least one display device provided in an input / output device, and the response processing unit is connected to the input / output device so as to respond to the user through a character displayed on the display device having location information corresponding to the location information of the user. Effect of the Invention

[0007] According to at least the first aspect of the technology disclosed in the present specification, a character is displayed when facility information is presented, making it easier for users to interact with the character.

[0008] Furthermore, objects, features, aspects and advantages associated with the technology disclosed herein will become more apparent from the detailed description set forth below and the accompanying drawings. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram conceptually illustrating an example of the configuration of a character interaction system according to an embodiment. [Diagram 2] FIG. 2 is a diagram conceptually illustrating an example of the configuration of an input / output device. [Diagram 3] FIG. 13 is a diagram showing an example of a character. [Figure 4] FIG. 2 is a diagram showing an example of the relationship between a moving object and a processing unit in a character interaction system. [Diagram 5] FIG. 2 is a diagram showing an example of the relationship between a building control panel and a processing unit in a character interaction system. [Figure 6] 13 is a diagram showing an example in which information is acquired from a building control panel by a processing unit, and a character displayed on a display device provides information to a user based on the acquired information. FIG. [Figure 7]FIG. 11 is a diagram showing another example in which information is acquired from a building control panel by a processing unit, and a character displayed on a display device provides information to a user based on the acquired information. [Figure 8] FIG. 11 is a diagram showing another example in which information is acquired from a building control panel by a processing unit, and a character displayed on a display device provides information to a user based on the acquired information. [Figure 9] FIG. 11 is a diagram showing another example in which information is acquired from a building control panel by a processing unit, and a character displayed on a display device provides information to a user based on the acquired information. [Figure 10] 1 is a diagram showing an example of the relationship between an Internet communication unit and a processing unit in a character interaction system. FIG. [Figure 11] 1 is a diagram showing an example of the relationship between an Internet communication unit, an operator, and a processing unit in a character interaction system. FIG. [Figure 12] FIG. 1 is a diagram conceptually illustrating an example of the configuration of a character interaction system according to an embodiment of the present invention. [Figure 13] FIG. 13 is a diagram showing an example in which characters displayed sequentially on a plurality of display devices provide information to a user. [Figure 14] 13A and 13B are diagrams showing another example in which characters displayed sequentially on a plurality of display devices provide information to a user. [Figure 15] 13A and 13B are diagrams showing another example in which characters displayed sequentially on a plurality of display devices provide information to a user. [Figure 16] 13A and 13B are diagrams showing another example in which characters displayed sequentially on a plurality of display devices provide information to a user. [Figure 17] 13A and 13B are diagrams showing another example in which characters displayed sequentially on a plurality of display devices provide information to a user. [Figure 18] 2 is a diagram illustrating a schematic example of a hardware configuration when the character interaction system illustrated in FIG. 1 is actually operated. FIG. [Figure 19]2 is a diagram illustrating a schematic example of a hardware configuration when the character interaction system illustrated in FIG. 1 is actually operated. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, the embodiments will be described with reference to the accompanying drawings. In the following embodiments, detailed features are shown for the purpose of explaining the technology, but they are merely examples and are not necessarily essential features for enabling the embodiments to be implemented.

[0011] The drawings are schematic, and for the sake of convenience, configurations may be omitted or simplified as appropriate. The size and positional relationship of the configurations shown in different drawings are not necessarily described accurately, and may be changed as appropriate. Hatching may be used in drawings such as plan views that are not cross-sectional views to facilitate understanding of the contents of the embodiments.

[0012] In the following description, the same components are denoted by the same reference numerals, and their names and functions are also the same. Therefore, detailed descriptions thereof may be omitted to avoid duplication.

[0013] Furthermore, in the description in this specification, when a certain component is described as "comprising," "including," or "having," unless otherwise specified, this is not an exclusive expression that excludes the presence of other components.

[0014] Furthermore, even if ordinal numbers such as "first" or "second" are used in the description of this specification, these terms are used for convenience to facilitate understanding of the contents of the embodiments, and the contents of the embodiments are not limited to the orders that may result from these ordinal numbers.

[0015] <First embodiment> The character interaction system and the character interaction method according to this embodiment will be described below.

[0016] <Character interaction system configuration> Fig. 1 is a diagram conceptually illustrating an example of the configuration of a character interaction system according to the present embodiment. As illustrated in Fig. 1, the character interaction system 1 includes a limited space 100, a processing unit 110, and an input / output device 120 that displays a character 130. The character interaction system 1 performs smooth interaction with a user 140 via the input / output device 120.

[0017] The limited space 100 is a space that is highly public and has a manager, such as a building, an underground mall, or an amusement facility. In such a limited space 100, there are many facilities and consideration is given to making the user 140 comfortable.

[0018] The processing unit 110 includes an information processing unit 111 and a response processing unit 112. The information processing unit 111 processes facility information related to facilities installed in the limited space 100, and displays the facility information on the input / output device 120. Specifically, the information processing unit 111 manages, acquires, and sends (transmits) data of the facility information (visual information or audio information) displayed on the input / output device 120. The response processing unit 112 refers to the facility information, analyzes the instruction content and reply content to the user 140, and generates the response content.

[0019] Fig. 2 is a diagram conceptually illustrating an example of the configuration of the input / output device 120. As illustrated in the example of Fig. 2, the input / output device 120 includes a display device 121, an audio output 122, an audio input 123, a video input 124, and other sensor inputs / outputs 125.

[0020] The input / output device 120 conveys information to the user 140 via a display device 121 or an audio output 122. The input / output device 120 also receives voice instructions from the user 140 via an audio input 123.

[0021] The input / output device 120 transmits the contents of the speech of the user 140 to the processing unit 110 in FIG. 1 via the audio input 123 or the video input 124, and also outputs the video data or audio data returned from the processing unit 110 on the display device 121 or the audio output 122.

[0022] In addition, the input / output device 120 may input and output data using a radio frequency identification (RFID), Bluetooth low energy (BLE; Bluetooth is a registered trademark), or Wi-Fi location information system built into an additional electronic device such as a smartphone or smartwatch owned by the user 140, other sensor input / output 125 that inputs and outputs sensor information, and video data or audio data returned from the processing unit 110.

[0023] The other sensor input / output 125 may be a light detection and ranging (LiDAR) or a human presence sensor installed in the external environment. By using the other sensor input / output 125, it is possible to identify the position or individual of the user 140, so that it is possible to provide services tailored to the individual even in a public space.

[0024] The character 130 is an animal, a person, a virtual creature, or the like that has a target face and is suitable as an interaction target. The response processing unit 112 conveys facility information to the user 140 through the character 130 displayed on the display device 121.

[0025] 3 is a diagram showing an example of the character 130. The character 130 may be animated so that the mouth moves in response to conversation, or the character 130 may be changeable in expression or clothing. The character 130 may be selected according to the time, place, and occasion, such as for emergencies or for children. The character 130 may also be given individual characteristics such as reliability, tolerance, or cuteness.

[0026] 4 is a diagram showing an example of the relationship between the moving object 150 and the processing unit 110 in the character interaction system. As shown in the example in FIG. 4, the processing unit 110 performs intermediate processing for exchanging information with the moving object 150.

[0027] The moving body 150 may be an elevator itself, a service robot that cleans, guards, or transports, or a communication robot, etc. The moving body 150 can communicate with the processing unit 110 (information processing unit 111) and can receive tasks such as movement from the processing unit 110, and can exchange facility information of the moving body 150 (including information about functions installed in the moving body 150) with the character interaction system 1 or indirectly with the user 140 through the processing unit 110 (information processing unit 111).

[0028] Here, the processing unit 110 may be interposed between the user 140 and the moving object 150 to allow the user 140 to control the moving object 150, or may provide information regarding the expected behavior of the moving object 150 using the character 130 displayed on the display device 121. It is difficult for a simple moving object 150 alone that does not have a voice recognition function or a voice production function to perform a natural interaction at a level that allows it to converse with a human. However, by displaying a character 130 with high interaction ability on the display device 121 and having it intervene, it becomes possible to perform a natural interaction at a level similar to that of a conversation with a human.

[0029] 5 is a diagram showing an example of the relationship between a building management panel 151 and a processing unit 110 in a character interaction system. As shown in the example in FIG. 5, the processing unit 110 may exchange information with the building management panel 151.

[0030] In this way, the processing unit 110 can obtain information about facilities installed in the building, such as elevator operation information, congestion information about stores in the building, images from environmental cameras, building management information obtained from an entrance / exit management device (not shown here), etc. In this way, the processing unit 110 can convey to the user 140 via the input / output device 120 information such as the fact that the elevator is crowded and difficult to get on, an approximate value of the waiting time in the elevator or store, the optimal route for the user 140, a place the user 140 should stop by, the fact that the robot can be made to wait and the entrance / exit management device (not shown here) can be used to go ahead, or an episode about the robot.

[0031] 6 is a diagram showing an example in which information is acquired from the building management panel 151 by the processing unit 110, and based on the acquired information, the character 130 displayed on the display device 121 provides information to the user 140. In Fig. 6a, the character 130 displayed on the display device 121 of the character interaction system 1 notifies (conversationally communicates) the user 140, who is unsure whether to pass through the entrance / exit management system 202, that the robot 200 is in a standby state, thereby appropriately guiding the user 140, who would otherwise be unable to make a decision based on the notification from the robot 200 itself.

[0032] FIG. 7 is a diagram showing another example in which information from the building management panel 151 is acquired by the processing unit 110, and the character 130 displayed on the display device 121 provides information to the user 140 based on the acquired information. In FIG. 7, the character 130 displayed on the display device 121 of the character interaction system 1 notifies the user 140 located near the robot 204 of the operation content (episode) of the robot 204 (conversationally). In addition, the character 130 displayed on the display device 121 of the character interaction system 1 notifies the user 140 located near the robot 206 of information about the building near the robot 206 (conversationally). In addition, the character 130 displayed on the display device 121 of the character interaction system 1 notifies the user 140 located near the elevator 208 of the waiting time for the elevator 208 (conversationally).

[0033] Fig. 8 is a diagram showing another example in which information is acquired from the building management panel 151 by the processing unit 110, and based on the acquired information, the character 130 displayed on the display device 121 provides information to the user 140. In Fig. 8, the character 130 displayed on the display device 121 of the character interaction system 1 notifies the user 140, who is waiting in front of the elevator, that the robot 210 will come out of the elevator (communicating in a conversational format).

[0034] Fig. 9 is a diagram showing another example in which information is acquired from the building control panel 151 by the processing unit 110, and based on the acquired information, the character 130 displayed on the display device 121 provides information to the user 140. In Fig. 9, the character 130 displayed on the display device 121 of the character interaction system 1 notifies the user 140, who is waiting in the elevator, that the robot 212 is waiting outside the elevator (conversationally informing the user 140).

[0035] Also, by communicating the work that the user 140 would like the robot to do to the processing unit 110 via the character 130, the user 140 can transport an object or request confirmation of a specific location. Furthermore, when the user 140 is about to get into an elevator, the processing unit 110 can indicate the direction in which the robot will emerge via the character 130, thereby avoiding a collision between the two.

[0036] 10 is a diagram showing an example of the relationship between the Internet communication unit 152 and the processing unit 110 in the character interaction system. As shown in the example in FIG. 10, the processing unit 110 may exchange information with the Internet communication unit 152.

[0037] In this way, the processing unit 110 can obtain a wider range of information, such as weather or local information, in addition to information about the limited space 100. In addition, the processing unit 110 can call a taxi or a shared car to a specific location outside the limited space 100, or accept a service request at a specific location outside the limited space 100.

[0038] 11 is a diagram showing an example of a relationship between the Internet communication unit 152, the operator 153, and the processing unit 110 in the character interaction system. As shown in the example in FIG. 11, the processing unit 110 may communicate with the Internet communication unit 152 and the operator 153.

[0039] In this way, when an abnormality occurs, the operator 153 can remotely take over input / output at the input / output device 120, and can return a response that was not determined in advance to the user 140. The operator 153 may communicate with the processing unit 110 directly, or may be connected to the processing unit 110 from the outside via the Internet communication unit 152.

[0040] When a character 130 having a face is displayed on the display device 121 and speaks, the attention of the user 140 is directed toward the display device 121, and the user 140 tries to converse in that direction. Therefore, by increasing the sensitivity of the microphone in the direction (toward the display device 121) when the character 130 is displayed, it is possible to improve noise resistance and the accuracy of verbal communication.

[0041] Furthermore, when a character 130 having a face is displayed on the display device 121 and speaks, if the direction in which the user 140 is located is not known, the character 130 may speak facing a direction different from the direction in which the user 140 is located, which may cause the user 140 to feel uncomfortable. In such a case, the character 130 can turn its gaze and face in various directions, making the user 140 feel as if the user 140 is speaking to the character 130. Furthermore, by measuring the position of the user 140 in the other sensor input / output 125 and turning the face of the character 130 in that direction, or by using the audio output 122 with added directionality to direct the audio output to the position of the user 140, it is possible to carry out effective verbal communication.

[0042] Furthermore, the processing unit 110 is capable of simulating the responses of the mobile object 150 or the building control panel 151, which are systems used within the space, by an AI model constructed by incorporating all source codes and carrying out machine learning. Therefore, the processing unit 110 is capable of automatically updating the model when the source codes of the systems used within the space are changed.

[0043] When the user 140 loads the current state, movement route, or task of the mobile object 150 or the building control panel 151 into the above AI model, the processing unit 110 can estimate the arrival time of the mobile object 150 or the break time for charging, etc. Furthermore, the processing unit 110 can respond to unexpected questions from the user 140 using the above AI model, and the number of conversation patterns can be increased by increasing the amount of information that can be conveyed.

[0044] <Second embodiment> A character interaction system and a character interaction method according to the present embodiment will be described. In the following description, components similar to those described in the above embodiment will be illustrated with the same reference numerals, and detailed description thereof will be omitted as appropriate.

[0045] <Character interaction system configuration> Fig. 12 is a diagram conceptually illustrating an example of the configuration of a character interaction system according to this embodiment. As illustrated in Fig. 12, the character interaction system 1A includes a processing unit 110 and an input / output device 120A that displays a character 130. The input / output device 120A includes a plurality of display devices 121A, 121B, and 121C.

[0046] Display device 121A, display device 121B, and display device 121C are directly connected to each other, or are connected via processing unit 110. Character 130 displayed on input / output device 120A can be displayed by moving between display device 121A, display device 121B, and display device 121C, and can provide a service to user 140 continuously across multiple display devices. At this time, processing unit 110 needs to acquire position information of display device 121A, display device 121B, display device 121C, and user 140 (and further mobile object 150).

[0047] For example, in a service such as navigation, the same character 130 can provide services such as route guidance, introduction of exhibits, or a request to stop a robot that is not visible to the user 140 according to its movement, in accordance with the movement of the robot. Note that the number of display devices does not need to be limited to three, such as display device 121A, display device 121B, and display device 121C, and may be more than ten.

[0048] Fig. 13 is a diagram showing an example in which characters 130 displayed in sequence on a plurality of display devices provide information to a user 140. In Fig. 13, characters 130 displayed in the order of display device 121D, display device 121A, display device 121B, and display device 121C of the character interaction system 1 introduce exhibits at each location (communicating in a conversational format) in accordance with the movement of the user 140.

[0049] Fig. 14 is a diagram showing another example in which characters 130 displayed in sequence on a plurality of display devices provide information to a user 140. In Fig. 14, characters 130 displayed in the order of display device 121A and display device 121B of the character interaction system 1 in accordance with the movement of the user 140 notify (conversationally communicate) that a robot 214 located in the blind spot of the user 140 will pass in front of the user 140.

[0050] 15, 16, and 17 are diagrams showing another example in which a character 130 displayed sequentially on a plurality of display devices provides information to a user 140. In FIG. 15, 16, and 17, it is assumed that a microphone 221A is mounted on the display device 121A, and a microphone 221B is mounted on the display device 121B (the mounting positions in the figures are examples). In FIG. 15, 16, and 17, a character 130 displayed on the display device 121A and then on the display device 121B of the character interaction system 1 guides the user in accordance with the user's movement. In this case, the character 130 is displayed by fading in and out sequentially on each display device so that it appears to move continuously between the display device 121A and the display device 121B (depending on the arrangement of the display devices, it may be displayed while temporarily straddling a plurality of display devices).

[0051] When character 130 having a face is displayed on display device 121A, display device 121B, or display device 121C and speaks, user 140's attention is directed to the display device on which character 130 is displayed, and user 140 tries to talk in that direction. Therefore, by increasing the sensitivity of the microphone in a specific direction (the direction toward the display device on which character 130 is displayed) when character 130 is displayed, it is possible to increase noise resistance and improve the accuracy of verbal communication.

[0052] For example, when character 130 is displayed on display device 121A, the sensitivity of microphone 221A close to the position of user 140 can be increased based on the position information of display device 121A and the position information of user 140. Thereafter, when character 130 displayed on display device 121A moves to display device 121B, the sensitivity of microphone 221B close to the position of user 140 can be increased based on the position information of display device 121B and the position information of user 140.

[0053] The display device may be a display screen of a smartphone carried by the user 140. In this case, by linking the location information of the user 140 with the movement of the mobile object 150 using an app on the smartphone, it is possible to stop the service of the mobile object 150 when the user 140 focuses on the smartphone, or conversely, to stop the movement of the smartphone when the user 140 focuses on the mobile object 150.

[0054] <Hardware configuration for the character interaction system> 18 and 19 are diagrams illustrating schematic examples of hardware configurations when the character interaction system shown in FIG. 1 is actually operated.

[0055] Note that the hardware configurations illustrated in Figures 18 and 19 may not match the configuration illustrated in Figure 1 in terms of numbers, etc., but this is because the configuration illustrated in Figure 1 shows conceptual units.

[0056] Therefore, at least the following cases can be envisaged: a configuration illustrated in FIG. 1 is composed of multiple hardware configurations illustrated in FIG. 18 and FIG. 19; a configuration illustrated in FIG. 1 corresponds to a part of a hardware configuration illustrated in FIG. 18 and FIG. 19; and further, a case in which multiple configurations illustrated in FIG. 1 are provided in a single hardware configuration illustrated in FIG. 18 and FIG. 19.

[0057] In Fig. 18, as the hardware configuration for realizing the processing unit 110 and the input / output device 120 in Fig. 1, a processing circuit 1102A that performs calculations, a storage device 1103 that can store information, an input device 1104A that can input information such as a mouse, a keyboard, a touch panel, or various switches, and an output device 1105A that can output information such as a display, a liquid crystal display device, or a lamp (including the case where it is shared with the input device 1104A) are shown. This configuration is the same in any of the above embodiments.

[0058] 19 shows a processing circuit 1102B that performs calculations, an input device 1104B that can input information such as a mouse, a keyboard, a touch panel, or various switches, and an output device 1105B (including cases where it is shared with the input device 1104B) that can output information such as a display, a liquid crystal display device, or a lamp, as a hardware configuration for realizing the processing unit 110 and the input / output device 120 in FIG. 1. This configuration is the same in any of the above embodiments.

[0059] The storage device 1103 may be, for example, a memory (recording medium) including a hard disk drive (i.e., HDD), random access memory (i.e., RAM), read only memory (i.e., ROM), flash memory, volatile or non-volatile semiconductor memory such as erasable programmable read only memory (EPROM) and electrically erasable programmable read-only memory (EEPROM), a magnetic disk, a flexible disk, an optical disk, a compact disk, a mini disk, or a DVD, or any recording medium to be used in the future.

[0060] The processing circuit 1102A may execute a program stored in the storage device 1103, an external CD-ROM, an external DVD-ROM, or an external flash memory, etc. That is, it may be, for example, a central processing unit (CPU), a microprocessor, a microcomputer, or a digital signal processor (DSP).

[0061] When the processing circuit 1102A executes a program stored in the storage device 1103, an external CD-ROM, an external DVD-ROM, an external flash memory, or the like, the processing unit 110 and the input / output device 120 are realized by software, firmware, or a combination of software and firmware, in which the program stored in the storage device 1103 is executed by the processing circuit 1102A. Note that the functions of the processing unit 110 and the input / output device 120 may be realized, for example, by cooperation between a plurality of processing circuits.

[0062] The software and firmware may be written as a program and stored in the storage device 1103. In this case, the processing circuit 1102A realizes the above-mentioned functions by reading and executing the program stored in the storage device 1103. In other words, the storage device 1103 may store a program that, when executed by the processing circuit 1102A, results in the above-mentioned functions being realized.

[0063] The processing circuitry 1102B may also be dedicated hardware, i.e., a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or a combination thereof, for example.

[0064] When the processing circuit 1102B is a dedicated hardware, the processing unit 110 and the input / output device 120 are realized by the operation of the processing circuit 1102B. Note that the functions of the processing unit 110 and the input / output device 120 may be realized by separate circuits or by a single circuit.

[0065] In addition, the functions of the processing unit 110 and the input / output device 120 may be partially realized in a processing circuit 1102A that executes a program stored in a memory device 1103, and partially realized in a processing circuit 1102B that is dedicated hardware.

[0066] Furthermore, the input / output device 120 is realized by the input device 1104A or the input device 1104B.

[0067] Furthermore, the input / output device 120 is realized by the output device 1105A or the output device 1105B (which may be shared with the input device).

[0068] <Effects of the above-described embodiments> Next, examples of effects produced by the above-described embodiments are shown. In the following description, the effects are described based on the specific configurations shown as examples in the above-described embodiments, but may be replaced with other specific configurations shown as examples in this specification as long as the same effects are produced. In other words, for convenience, only one of the corresponding specific configurations may be described as a representative below, but the representatively described specific configuration may be replaced with another corresponding specific configuration.

[0069] Furthermore, the replacement may be made across a number of embodiments, that is, configurations shown as examples in different embodiments may be combined to produce the same effect.

[0070] According to the embodiment described above, the character interaction system includes an information processing unit 111 and a response processing unit 112. The information processing unit 111 processes facility information, which is information related to facilities provided within a limited space. The response processing unit 112 provides the facility information in response to an input from a user 140. The response processing unit 112 is connected to the input / output device 120 (or the input / output device 120A) so as to convey the facility information to the user 140 through a character 130 displayed on at least one display device 121 (or the display device 121A, the display device 121B, or the display device 121C) provided in the input / output device 120 (or the input / output device 120A).

[0071] Furthermore, according to the embodiment described above, the character interaction system includes an input device 1104A, an output device 1105A, a processing circuit 1102A that executes a program, and a storage device 1103 that stores the program to be executed. The processing circuit 1102A executes the program to realize the following operations.

[0072] That is, facility information, which is information about facilities installed within a limited space, is processed. Then, the facility information is provided in response to an input from the user 140. Here, the facility information is provided so as to convey the facility information to the user 140 through the character 130 displayed on at least one display device 121 (or display device 121A, display device 121B, display device 121C) provided in the input / output device 120 (or input / output device 120A).

[0073] Furthermore, according to the embodiment described above, the character interaction system includes an input device 1104B, an output device 1105B, and a processing circuit 1102B that is a dedicated hardware. The processing circuit 1102B that is a dedicated hardware performs the following operations.

[0074] That is, the processing circuit 1102B, which is dedicated hardware, processes facility information, which is information related to facilities provided within a limited space. Then, the facility information is provided in response to an input from the user 140. Here, the facility information is provided so as to convey the facility information to the user 140 through the character 130 displayed on at least one display device 121 (or display device 121A, display device 121B, display device 121C) provided in the input / output device 120 (or input / output device 120A).

[0075] According to this configuration, the character 130 is displayed when facility information is presented, so that the user 140 can easily recognize the character 130 as an interface and interact with it. Since the character 130 has a face, the user 140 can recognize the face of the character 130 as a target, lowering the barrier to interaction.

[0076] Furthermore, the same effect can be achieved even if other configurations, examples of which are shown in this specification, are appropriately added to the above configuration, i.e., even if other configurations in this specification that were not mentioned as the above configuration are appropriately added.

[0077] Furthermore, according to the embodiment described above, the information processing unit 111 communicates with the mobile object 150 and processes facility information of the facility installed in the mobile object 150. According to such a configuration, although it is difficult for a mobile object such as an elevator or a robot to interact with the user 140, by using the character 130 as an interface intermediary for interaction, the threshold for interaction is effectively lowered and the user 140 can easily grasp the status of the mobile object.

[0078] Furthermore, according to the embodiment described above, the character interaction system includes the input / output device 120 (or the input / output device 120A). With this configuration, the character 130 is displayed when facility information is presented, so that the user 140 can easily recognize the character 130 as an interface and interact with it.

[0079] Furthermore, according to the embodiment described above, the information processing unit 111 communicates with the building management panel 151 to process facility information of facilities installed in the building. With such a configuration, information about the inside of the building, including the elevator, the robot's position, or the service status, can be effectively provided to the user 140 via the character 130.

[0080] Further, according to the embodiment described above, a plurality of display devices 121A (or display devices 121B, 121C) are provided in the input / output device 120A. The response processing unit 112 transmits facility information to the user 140 by continuously displaying the characters 130 between the plurality of display devices 121A (or display devices 121B, 121C). According to such a configuration, by displaying the characters 130 in cooperation with the plurality of display devices, the user 140 can easily understand the connection between the display devices through the characters 130. As a result, it is possible to provide the user 140 with a continuous and consistent service within a large space, and it is also possible to give the user 140 the illusion that the characters 130 are present in a real three-dimensional space. Therefore, it is possible to deepen the user 140's understanding, particularly in spatial navigation. Furthermore, by linking the characteristics of the display devices at different spatial positions and continuously displaying them on a signage reflected in the field of view of the user 140, the user 140 can recognize that the same character 130 has moved smoothly between them.

[0081] According to the embodiment described above, the response processing unit 112 can be remotely operated by an operator. With such a configuration, in an emergency, in a character interaction system via the character 130, it is possible to switch between an automatic response and a response by a manned operator, thereby increasing the flexibility of responses in an emergency.

[0082] Furthermore, according to the embodiment described above, the display device 121 (or the display device 121A, the display device 121B, or the display device 121C) is equipped with the microphone 221A (or the microphone 221B). Then, the response processing unit 112 increases the sensitivity of the microphone 221A (or the microphone 221B) in the vicinity where the character 130 is displayed. With this configuration, when the character 130 having a face speaks, it is possible to induce the user 140 to turn towards the character 130 and interact with it. Therefore, information can be effectively provided to the user 140 even in a high-noise environment.

[0083] Furthermore, according to the embodiment described above, the response processing unit 112 displays the character 130 on the display device 121 to turn its line of sight and face in multiple directions when conversing with the user 140. With this configuration, regardless of the direction in which the user 140 is facing, the line of sight and face of the character 130 can be directed in various ways to mislead the user 140 into thinking that the interaction has been successful.

[0084] Furthermore, according to the embodiment described above, the response processing unit 112 outputs facility information as a response provided in response to an input from the user 140, using a trained model generated by machine learning. With such a configuration, it is possible to improve the accuracy of the response. Also, by creating a trained model using the source code (machine language) of the system as is, it is possible to reduce the update cost of the trained model and also to increase the number of responses to questions from the user 140.

[0085] Furthermore, according to the embodiment described above, the response processing unit 112 acquires at least the location information of the user 140 and the location information of the display device 121. Then, the response processing unit 112 displays the character 130 on the display device 121 having the corresponding location information based on the location information of the user 140. According to such a configuration, the content of the facility information to be provided can be changed according to the location of the user 140, and various services can be provided.

[0086] According to the embodiment described above, in the character interaction method, facility information, which is information related to facilities installed within a limited space, is processed. Then, the facility information is provided in response to an input from the user 140. Here, the facility information is provided so as to convey the facility information to the user 140 through the character 130 displayed on at least one display device 121 (or display device 121A, display device 121B, display device 121C) installed in the input / output device 120 (or input / output device 120A).

[0087] According to such a configuration, the character 130 is displayed when the facility information is presented, so that the user 140 can easily recognize the character 130 as an interface and interact with it.

[0088] Unless otherwise specified, the order in which the processes are performed may be changed.

[0089] Furthermore, even if other configurations, examples of which are shown in this specification, are appropriately added to the above configuration, i.e., other configurations in this specification that were not mentioned as the above configuration are appropriately added, the same effect can be produced.

[0090] <Modifications of the above-described embodiments> In the embodiments described above, the dimensions, shapes, relative positional relationships, and implementation conditions of each component may be described, but these are merely examples in all aspects and are not limiting.

[0091] Therefore, countless modifications and equivalents not shown as examples are assumed within the scope of the technology disclosed in the present specification, including, for example, modifying, adding, or omitting at least one component, and further, extracting at least one component in at least one embodiment and combining it with a component in another embodiment.

[0092] Furthermore, unless a contradiction arises, when it is stated in the above-described embodiments that "one" component is provided, "one or more" of that component may be provided.

[0093] Furthermore, the descriptions in this specification are incorporated by reference for all purposes related to the present technology, and none of them are admitted to be prior art.

[0094] Furthermore, each of the components described in the above embodiments is envisioned as either software or firmware, or as corresponding hardware, and as software, is referred to as, for example, a "unit," and as hardware, is referred to as, for example, a "processing circuit" (circuitry).

[0095] Furthermore, the technology disclosed in this specification may also be implemented in a form in which each component is distributed across multiple devices, that is, in a form such as a system that is a combination of multiple devices. [Explanation of symbols]

[0096] 1 Character interaction system, 1A character interaction system, 100 space, 110 processing section, 111 information processing section, 112 response processing section, 120 input / output device, 120A input / output device, 121 display device, 121A display device, 121B display device, 121C display device, 121D display device, 122 audio output, 123 audio input, 124 video input, 125 sensor input / output, 130 character, 140 user, 150 moving object, 151 building management panel, 152 Internet communication section, 153 operator, 200 robot, 202 entrance / exit management system, 204 robot, 206 robot, 208 elevator, 210 robot, 212 robot, 214 robot, 221A microphone, 221B microphone, 1102A processing circuit, 1102B Processing circuit, 1103 memory device, 1104A input device, 1104B input device, 1105A output device, 1105B output device.

Claims

1. a response processing unit for responding to an input from a user; the response processing unit acquires at least location information of the user and location information of at least one display device provided in the input / output device; The response processing unit is connected to the input / output device so as to respond to the user through a character displayed on the display device having location information corresponding to the location information of the user. Character interaction system.

2. 2. A character interaction system according to claim 1, Further comprising an information processing unit for processing equipment information which is information related to the equipment, The response processing unit provides the facility information in response to the input from the user, The response processing unit transmits the facility information to the user through the character. Character interaction system.

3. 3. A character interaction system according to claim 1 or 2, The response processing unit is connected to the input / output device so as to convey the facility information to the user through characters successively displayed among the plurality of display devices provided in the input / output device. Character interaction system.

4. The computer Perform steps in response to input from a user; the step of responding to an input from the user is performed to obtain at least position information of the user and position information of at least one display device provided in an input / output device; Responding to the input from the user is performed by responding to the user through a character displayed on the display device having position information corresponding to the position information of the user. Character interaction methods.

Images