System and the like

Abstract

To provide a technique related to an output of information associated with a character.SOLUTION: A system includes a display unit capable of displaying a character, and control means having a function for changing experience information of the character and a function for changing an action mode of the character according to the experience information. When a user feeds the character, the experience information increases, and when the experience information increases, intimacy of the character increases.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to a system and the like.

Background Art

[0002] Patent Document 1 describes a stereoscopic video display device that does not use special glasses. This stereoscopic video display device includes a light source, a liquid crystal display panel, and a parallax barrier disposed on the observer side of the liquid crystal display panel.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] One object of the present invention is to provide a technique related to the output of information associated with a character.

[0005] The object of the invention of the present application is not limited to this, and the applicant also has the intention of obtaining rights by means of divisional application, amendment, etc. for a configuration aimed at obtaining an effect resulting from a part of the configuration disclosed in this specification and drawings, etc. For example, the problem of reading the part described as "can be" in this specification as "is a problem" is disclosed in this specification. The problems are described as independent ones, and the applicant also has the intention of obtaining rights by means of divisional application, amendment, etc. alone for the configuration for solving each problem. Even if the problem is implicitly grasped from the description of the specification, the applicant has the intention of making a part of the configuration described in this specification the scope of claims by amendment or divisional application. In addition, a configuration for solving a problem combining these independent problems is also disclosed, and the applicant has the intention of obtaining rights.

Means for Solving the Problems

[0006] It is preferable to provide a system including a display unit capable of displaying a character, control means having a function of changing the experience information of the character, and a function of changing the operation mode of the character according to the experience information. The change in the experience information of the character is, for example, an increase in the experience information, but the experience information may also decrease.

[0007] In this way, it is possible to enjoy the process in which the operation mode of the character virtually displayed changes according to the experience information of the character.

[0008] (2) The control means preferably has a function of displaying an operation mode as if the character acts according to a virtual instinct function possessed by the character.

[0009] In this way, an operation mode as if the character is acting as if it has a virtual instinct function is displayed, and it is possible to enjoy the daily life with a character having a reality as if it actually exists.

[0010] (3) The character imitates an animal, and the control means preferably has a function of displaying an operation mode as if the character performs a warning action or a threatening action according to a virtual instinct function possessed by the character.

[0011] In this way, it is possible to realistically express through the character as if the character has the instinct function possessed by the animal.

[0012] (4) The control means preferably has a function of displaying a three-dimensional virtual space on the display unit and a function of displaying an operation mode in which the character moves within the virtual space.

[0013] In this way, it is possible to display an operation mode in which the character moves in a three-dimensional virtual space, and it is possible to create a sense of presence as if the character virtually displayed actually exists in reality.

[0014] (5) The control means preferably has a function of dividing into a plurality of areas with different distance perceptions and displaying on the display unit, and a function of displaying an operation mode in which the character moves between the plurality of areas.

[0015] In this way, since the character moves between a plurality of areas with different distance perceptions when viewed from the front, for example, it can be displayed as if it moves away from or approaches the user of the system, and a more realistic character can be displayed.

[0016] (6) The control means preferably has a function of displaying the character so as to move between a first position that is the farthest and a second position that is the nearest when looking at the display unit within the range where the character can be displayed.

[0017] In this way, it becomes possible to clearly grasp the mode in which the character moves away from or approaches the user.

[0018] (7) The control means preferably has a function of changing the experience information when the user takes an action, and a function of controlling to change the action pattern of the character when the experience information is changed. The action taken by the user is, for example, giving food to the character, but it may also be the number of times the user has taken an action such as the time the user has used the present system 1, the number of times of use, the number of times of speaking to the character, etc., or a combination thereof. Also, the action pattern of the character is, for example, to change when the experience information becomes large, but it may also change when the experience information becomes small, or a combination thereof.

[0019] In this way, when the user takes an action, the value of the experience information is changed upward, and when the value of the experience information above is changed upward, a display indicating that the intimacy of the character has increased is performed. By doing so, it becomes possible to give the user a sense of closeness to the character.

[0020] Incidentally, it is preferable that the control means has a function of displaying such that when the user takes an action, the frequency (for example, probability) of the character moving between a relatively distant position and a relatively close position changes when the display unit is viewed. The action taken by the user is, as described above, for example, feeding the character, but it may be the number of times the user has taken an action, such as the time the user has used the present system 1, the number of times of use, the number of times of speaking to the character, or the like, or a combination thereof. Further, when the user takes an action, if the action taken by the user is something the character likes, for example, the probability of the character moving from a relatively distant position to a relatively close position is increased, but if the action taken by the user is not something the character likes, for example, the probability of the character moving from a relatively close position to a relatively distant position can be increased.

[0021] In this way, if the action taken by the user is something the character likes, the character is displayed as approaching a position closer to the user, while if the action taken by the user is not something the character likes, the character is displayed as moving away to a position farther from the user, making it possible to create a more realistic experience.

[0022] Note that the value of the experience information may be changed upward by the control means of the system, or may be changed upward by, for example, an external server or the like provided separately from the system.

[0023] (8) When the value of the experience information is the initial value, it is preferable that the control means has a function of displaying the character staying at a first position that is the farthest when the display unit is viewed within the range where the character can be displayed.

[0024] In this way, it is possible to start by getting an unfamiliar character used to the situation.

[0025] (9) In the first stage where the value of the experience information is from the initial value to the first specified value, the control means preferably has a function of making the movement ratio of the character to the first position, which is the farthest when looking at the display unit among the ranges where the character can be displayed, higher than the movement ratio of the character to the second position, which is the closest when looking at the display unit.

[0026] In this way, in the first stage where the value of the experience information reaches from the initial value to the first specified value, the ratio of the character staying at the first position can be made higher than the ratio of the character staying at the second position. By doing so, it is possible to make the user realize that the character is not yet familiar for some time from the initial value.

[0027] Note that the first stage corresponds to, for example, "low intimacy" in the specification, the first specified value corresponds to, for example, "30" in the specification, the first position corresponds to, for example, "area 5" in the specification, and the second position corresponds to, for example, "area 1" in the specification. The same applies hereinafter.

[0028] (10) In the first stage where the value of the experience information is from the initial value to the first specified value, the control means preferably has a function of reducing the movement ratio of the character to the first position, which is the farthest when looking at the display unit among the ranges where the character can be displayed, along with the change in the value of the experience information. The movement ratio of the character to the first position decreases, for example, along with the increase in the value of the experience information, but can also decrease along with the decrease in the value of the experience information, for example, when using a parameter such as aloofness.

[0029] In this way, in the first stage, the movement ratio of the character to the first position can be reduced as the value of the experience information changes. By doing so, it is possible to make the user realize the process in which the character's wariness is dispelled and it becomes familiar as the value of the experience information changes.

[0030] (11) In the first stage where the value of the experience information ranges from the initial value to the first specified value, the control means has a function of increasing the moving ratio of the character to the second position closest to the display unit among the range where the character can be displayed, in accordance with the change in the value of the experience information. is preferable.

[0031] In this way, in the first stage, as the experience information changes, the process of the character getting used to it can be embodied to the user by the moving ratio of the character to the first position.

[0032] (12) In the first stage, it is preferable that the control means has a function of increasing the degree of increase in the moving ratio of the character to the second position in accordance with the change in the value of the experience information.

[0033] In this way, until the value of the experience information changes from the initial value to the first specified value, as the experience information changes, the process of the character getting used to it can be embodied to the user by the moving ratio of the character to the first position.

[0034] (13) In the second stage where the value of the experience information ranges from the first specified value greater than the initial value to the second specified value, the control means has a function of decreasing the moving ratio of the character to the first position farthest from the display unit among the range where the character can be displayed, in accordance with the change in the value of the experience information.

[0035] In this way, in the second stage, as the value of the experience information changes, the moving ratio of the character to the first position can be decreased. By doing so, the process of the character's wariness fading can be embodied to the user by the moving ratio of the character to the first position.

[0036] Note that the second stage corresponds to, for example, "Medium Intimacy" in the specification, and the second specified value corresponds to, for example, "60" in the specification. The same applies hereinafter.

[0037] (14) In the second stage where the value of the experience information is from a first specified value greater than the initial value to a second specified value, it is preferable that the control means has a function of increasing the movement ratio of the character to the second position closest to the display unit among the ranges where the character can be displayed, in accordance with the change in the value of the experience information.

[0038] In this way, in the second stage, as the value of the experience information changes, the movement ratio of the character to the second position can be increased. By doing so, the process of the character getting used to it can be embodied to the user by the movement ratio of the character to the second position.

[0039] (15) In the second stage, it is preferable that the control means has a function of increasing the degree of increase in the movement ratio of the character to the second position in accordance with the change in the value of the experience information.

[0040] In this way, in the second stage, the process of the degree of the character getting used to it accelerating can be embodied to the user by the movement ratio of the character to the second position.

[0041] (16) In a specific stage where the value of the experience information exceeds a specific specified value, the control means decreases the movement ratio of the character to the first position farthest from the display unit among the ranges where the character can be displayed, in accordance with the change in the value of the experience information, and has a function of reducing the degree of decrease in the movement ratio of the character to the first position in accordance with the change in the value of the experience information.

[0042] In this way, in the specific stage, the degree of decrease in the movement ratio of the character to the first position can be made slower, and a more realistic movement of the character can be displayed.

[0043] (17) When the value of the experience information exceeds a specific specified value at a specific stage, the control means increases the movement ratio of the character to the second position closest to the display unit when viewing the display unit among the ranges where the character can be displayed, along with the change in the value of the experience information, and has a function of reducing the degree of increase in the movement ratio of the character to the second position accompanying the change in the value of the experience information.

[0044] In this way, at a specific stage, the degree of increase in the movement ratio of the character to the second position can be made less sharp, and a more realistic movement of the character can be displayed.

[0045] (18) The control means preferably has a function of determining whether or not to move the position of the character.

[0046] In this way, the movement timing of the character can be made random, and a movement as if the character is moving with its own will can be displayed.

[0047] (19) The control means preferably has a function of determining the timing of moving the character by lottery.

[0048] In this way, the movement timing of the character can be made more random.

[0049] (20) It is provided with a sensor capable of detecting that a person has approached, and when the sensor is detected, the control means has a function of moving the character to a position relatively far when viewing the display unit among the ranges where the character can be displayed.

[0050] In this way, when a person approaches, a display can be made as if the character is running away, and by such movement of the character, a greater sense of reality can be achieved.

[0051] (21) The control means may have a function of downwardly changing the experience information.

[0052] In this way, since the experience information may decrease instead of unidirectionally increasing, a higher degree of realism can be achieved.

[0053] (22) The value of the experience information represents the intimacy of the character, and the control means has a function of increasing the frequency of moving the character to a relatively closer position when viewing the display unit within the displayable range of the character as the value of the experience information indicates a higher intimacy.

[0054] In this way, since the higher the intimacy, the higher the frequency of moving the character to a relatively closer position to the user, a higher degree of realism can be achieved.

[0055] (23) The control means has a storage means for storing a preset language, a language recognition function for recognizing an external language, and a counting function for counting the number of times the language recognized by the language recognition function is stored in the storage means. When the count value counted by the counting function reaches a specified value, the response by the character may be permitted.

[0056] In this way, when the count value counted by the counting function reaches the specified value, the character can respond, enabling communication with the character.

[0057] Note that when the count value counted by the counting function reaches the specified value, the response by the character may be permitted by the control means of the system, or data may be transmitted and received between, for example, an external server provided separately from the system, and this external server may permit the response.

[0058] When the counted value counted by the counting function reaches a specified value and the value of the experience information reaches a predetermined specified value, it is preferable to permit the response by the character.

[0059] In this way, even if the counted value counted by the counting function reaches the specified value, if the value of the experience information does not reach the predetermined specified value, the response by the character is not permitted. By doing so, communication can be achieved only with familiar characters.

[0060] (25) The control means preferably has a function of causing the character to make a response at a position relatively close when the display unit is viewed within the range where the character can be displayed.

[0061] In this way, since the character makes a response at a relatively close position, a sense of familiarity with the character can be given to the user.

[0062] (26) The control means preferably has a repeating function of causing the character to repeat the language when the language recognized by the language recognition function is the language stored in the storage means.

[0063] In this way, since the language recognized by the language recognition function can be repeated by the character, a sense of familiarity with the character can be given to the user.

[0064] (27) The repeating function preferably has a function of causing the character to repeat the language at a position relatively close when the display unit is viewed within the range where the character can be displayed.

[0065] In this way, since the character makes a response at a relatively close position, a greater sense of familiarity with the character can be given to the user.

[0066] (28) When the value of the experience information reaches a predetermined specified value, the control means may enable the repeat function.

[0067] In this way, if the value of the experience information does not reach the predetermined specified value, the response by the character is not permitted. By doing so, the bond between the user and JUNO can be further deepened.

[0068] (29) The control means may have a function of communicating and connecting with an external mobile terminal, and a function of setting up a connection with the mobile terminal by receiving a connection request from the mobile terminal.

[0069] In this way, the convenience of the user can be enhanced.

[0070] (30) The control means may have a function of communicating and connecting with an external mobile terminal, and a function of operating the character based on the instruction information when receiving the instruction information from the mobile terminal.

[0071] In this way, the user can operate the character by giving an instruction from the mobile terminal, and the convenience can be enhanced.

[0072] (31) The control means may have an alarm function of performing an alarm operation according to settings, and a function of executing the alarm operation by the operation of the character.

[0073] In this way, since an alarm operation with high convenience in daily life can be executed by the operation of the character, the convenience can be enhanced while enjoying the daily life with the character.

[0074] (32) The control means may have a home appliance control function of executing home appliance control in response to a request, and a function of executing the home appliance control by the operation of the character.

[0075] By doing so, home appliance control with high convenience in daily life can be executed by the operation of the character, so that while enjoying the daily life with the character, the convenience can be enhanced.

[0076] (A1) It is preferable that a display device is provided, which has a light-shielded video display space inside and an observation area for the video is provided on the first direction side of the video display space, and a video display unit for forming a virtual image in the video display space.

[0077] By doing so, since the virtual image combined with the video display space is displayed in a relatively dark space as viewed from the observation side, the three-dimensional effect of the virtual image that can be given to the observer can be enhanced. Therefore, the visual effect of the display device can be enhanced.

[0078] (A2) It is preferable that a display device is provided, which has a light-reducing member for reducing external light entering the video display space from the observation area.

[0079] By doing so, since the external light entering the video display space is reduced by the light-reducing member, the video display space can be maintained in a dark state, and the three-dimensional effect of the virtual image that can be given to the observer can be enhanced.

[0080] (A3) The video display unit includes a first display unit that emits first image light and an optical system that forms the virtual image based on the first image light, and is a display device having a light-shielding member on the optical path of the reflected light of the first image light reflected by the light-reducing member and between the light-reducing member and the optical system.

[0081] By doing so, it is possible to suppress the video displayed in the video display space from being observed by the observer due to the reflection of the first image light by the light-reducing member.

[0082] (A4) It is preferable that the light-shielding member is provided at a position that does not overlap the observation area as viewed from the first direction side.

[0083] In this way, even when an observer peeks into the video display space from the observation area, it is possible to suppress the video displayed in the video display space from being observed by the observer due to the first image light being reflected by the light dimming member.

[0084] (A5) The video display unit includes a first display unit that emits first image light and an optical system that forms the aerial video based on the first image light. The optical system is preferably a display device arranged so as to avoid an area on the optical path of the reflected light reflected by the light dimming member among the first image light.

[0085] In this way, it is possible to suppress the video displayed in the video display space from being observed by the observer due to the first image light being reflected by the light dimming member.

[0086] (A6) The optical system includes an optical member having a first surface on which the first image light is incident and a second surface facing the first surface. The optical member is preferably a display device that reflects the first image light toward the first direction side and transmits the light incident on the second surface toward the first surface side.

[0087] In this way, since the second surface side of the optical member can be observed by the observer superimposed on the aerial video combined using the optical member, the three-dimensional feeling of the aerial video that can be given to the observer can be further enhanced.

[0088] (A7) The display device preferably has a second display unit that emits second image light that overlaps the aerial video when viewed from the first direction side.

[0089] In this way, the degree of freedom in selecting the video to be observed by the observer superimposed on the aerial video can be increased.

[0090] (A8) The display device preferably has a higher emission luminance of the first display unit than that of the second display unit.

[0091] By doing so, the difference in the emission luminance between the first display unit and the second display unit can enhance the three-dimensional effect of the aerial image that can be given to the observer.

[0092] (A9) The first display unit may be a display device that is arranged such that the display surface faces downward above the observation area and is inclined so that the second direction side opposite to the first direction is lower than the first direction side.

[0093] By doing so, an aerial image can be formed using an optical member by the first display unit arranged above the observation area.

[0094] (A10) The display surface of the first display unit may be a display device that is inclined at approximately 20 degrees with respect to the horizontal direction.

[0095] By doing so, the three-dimensional effect of the aerial image that can be given to the observer can be enhanced, and the image displayed in the image display space by the reflection of the first image light by the light attenuation member can be made less observable.

[0096] (A11) The second display unit may be a display device that is arranged such that the display surface faces upward below the observation area.

[0097] By doing so, since the image displayed on the second display surface appears to be located below the aerially imaged image, the three-dimensional effect of the aerial image that can be given to the observer can be enhanced.

[0098] (A12) The first display unit may be a display device that emits the first image light so that the aerial image is observed on the second display surface.

[0099] By doing so, since the aerial image is observed to be located above the image displayed on the second display surface, the three-dimensional effect of the aerial image that can be given to the observer can be enhanced.

[0100] (A13) The housing may have a first accommodation space above the first display unit and have a processing board disposed on the second direction side in the first accommodation space, to form a display device.

[0101] In this way, among the first accommodation spaces secured above the first display unit, the processing board can be disposed in a region with a relatively large margin in the dimension in the height direction.

[0102] (A14) The processing board may have a mounting unit for detachable attachment of an external device, and the mounting unit may be provided on the housing such that it is exposed to the outside of the housing from the second direction side of the housing, to form a display device.

[0103] In this way, it is possible to make it difficult for an observer to observe the portion of the mounting unit for detachable attachment of the external device that is exposed to the outside of the housing.

[0104] (A15) The display device may have a sensor provided below the observation region, and the processing board may execute processing according to information measured by the sensor.

[0105] In this way, it is possible to suppress the observation of the aerial image from being obstructed by the configuration related to the sensor.

[0106] (A16) The display device may have a sensor board on which the sensor is mounted, and the sensor board may be provided on the portion of the housing on the first direction side.

[0107] In this way, it is possible to suppress the observation of the aerial image from being obstructed by the configuration related to the sensor.

[0108] (A17) The display device may include a sensor for detecting a gesture.

[0109] In this way, when the observer makes a gesture, it is possible to suppress the observation of the aerial image from being obstructed by the body part of the observer.

[0110] (A18) It is preferable that the housing has a second accommodation space below the video display space, and is provided with a control board in the second accommodation space for supplying a signal from the sensor to the processing board, to form a display device.

[0111] In this way, compared with the case where the control board is accommodated in the first accommodation space above the first display unit, it is possible to suppress the increase in the dimension above the observation area of the housing.

[0112] (A19) It is preferable that the display device has a wiring part for electrically connecting the control board and the processing board, and a partition member for partitioning so that the wiring part cannot be observed from the video display space side.

[0113] In this way, it is possible to suppress the wiring part for electrically connecting the control board and the processing board from being observed.

[0114] (A20) It is preferable that the processing board is a display device for controlling the display of the first display unit according to the information measured by the sensor.

[0115] In this way, the aerial video can be changed according to the information measured by the sensor.

[0116] (A21) It is preferable that the display device has a viewing angle control member provided on the display surface of the first display unit for narrowing the viewing angle in the first direction side.

[0117] In this way, it is possible to suppress the image displayed on the first display surface from being directly observed by the observer.

[0118] (A22) It is preferable that the first image light is the image light of an image recognized as a two-dimensional image, to form a display device.

[0119] In this way, even when the first display unit for displaying an image recognized as a two-dimensional image is used, it is possible to give the observer a sense of three-dimensionality of the aerial video.

[0120] (A23) The housing may be configured such that a plurality of parts are coupled by a fixture, and the fixture may be a display device that is not exposed at least from the first direction side.

[0121] In this way, it is possible to suppress the fixing member from being observed by an observer, and the aesthetic appearance of the display device can be enhanced.

[0122] (A24) The display device may be such that a process for reducing light reflection is performed on at least a part of the portion facing the video display space.

[0123] In this way, it becomes easier to maintain the video display space in a dark state, so that the three-dimensional effect of the aerial video that can be given to the observer can be further enhanced.

[0124] (A25) The housing may be a display device having a portion surrounding the periphery of the observation region when viewed from the first direction side.

[0125] In this way, the three-dimensional effect of the aerial video that can be given to the observer can be further enhanced by the combination of the aerial video displayed in the video display space and the housing located on the front side thereof.

[0126] (A26) The video display unit may be a display device that displays a video of a character showing a cat.

[0127] In this way, it is possible to display a video of a character showing a three-dimensional cat.

[0128] (A27) The video display unit may be a display device that changes the video based on a communication function that reproduces communication between the character and an observer observing the character.

[0129] In this way, it is possible to change the video of the character showing a cat based on the communication function.

[0130] An odor sensor for detecting an odor in (A28), a display output operation for displaying, on the video display unit, a video in which a character performs a movement according to a detection result by the odor sensor, and a voice output operation for outputting, as a voice uttered by the character displayed on the video display unit, a voice according to a detection result by the odor sensor, and an operation control means for executing at least one of the above operations may be further provided.

[0131] In this way, communication regarding an odor between the character displayed on the video display unit and the user can be reproduced. For example, when an odor is detected by the odor sensor, a voice output operation in which the character utters a voice such as "Something smells" or a display output operation of a video in which the character performs an action of smelling the odor can be controlled to be performed. Therefore, more diverse communication can be achieved between the character and the user.

[0132] (A29) The display output operation is an operation of displaying, on the video display unit, a video in which the character displayed on the video display unit performs a movement according to the detected type of odor, and the voice output operation is an operation of outputting, as a voice uttered by the character displayed on the video display unit, a voice according to the detected type of odor.

[0133] In this way, communication regarding the type of odor between the character displayed on the video display unit and the user can be reproduced. For example, when the odor of tobacco is detected, a display output operation of displaying a video in which the character performs a movement of craving for a cigarette or a voice output operation of uttering words concerned about the user's health can be executed. Also, when the odor of a fragrance such as aromatherapy oil is detected, a voice output operation of uttering a question regarding the fragrance can be executed. By performing such control, the range of communication between the character displayed on the video display unit and the user can be widened, and the user's affection for the character can be increased.

[0134] (A30) It further includes voice detection means capable of detecting voice and detection means capable of detecting the presence of a person in the detection target area. When the presence of a person in the detection target area is detected, the voice detection means may enable voice recognition for interacting with the character displayed on the video display unit.

[0135] In this way, when interacting with the character displayed on the video display unit, for example, the user does not need to utter a trigger word to enable voice recognition, and can communicate more naturally.

[0136] (A31) It further includes wind detection means for detecting wind, display output operation for displaying on the video display unit a video in which a character performs a movement according to the detection result of the wind detection means, and operation control means for performing at least one of voice output operation for outputting, as the voice uttered by the character displayed on the video display unit, a voice according to the detection result of the wind detection sensor.

[0137] In this way, communication regarding the wind given to the display device can be reproduced between the character displayed on the video display unit and the user. The wind may be, for example, artificially created by the user, such as the wind generated by moving a body part such as waving a hand towards the display device or the wind generated by blowing.

[0138] (A32) The operation control means may perform the display output operation or the voice output operation according to the breath blown by the user based on the detection result of the wind detection means.

[0139] In this way, communication according to the breath blown on the display device can be reproduced between the character displayed on the video display unit and the user.

[0140] The inventions described in (1) to (32) above and the inventions described in (A1) to (A32) above can be arbitrarily combined. For example, it is preferable to add at least a part of the configuration of at least one of the inventions after (2) to all or a part of the configuration of the invention described in (1). In particular, it is preferable to be an invention in which at least a part of the configuration of at least one of the inventions after (2) is added to the invention described in (1). Further, an arbitrary configuration may be extracted from the inventions described in (1) to (32), and the extracted configurations may be combined. The applicant of the present application has the intention of obtaining rights for inventions including these configurations. Further, even if there is a description such as "in the case of ~" or "when ~", it is not described as a configuration limited to that case or that time. These show examples of better configurations, and the applicant also has the intention of obtaining rights for configurations other than these cases and times. Also, the order in the descriptions with an order is not limited to this order. The applicant also discloses configurations in which some parts are deleted or the order is changed, and has the intention of obtaining rights.

Effects of the Invention

[0141] According to the present invention, it is possible to provide a technology related to the output of information associated with a character.

[0142] The effects of the invention of the present application are not limited to this, and the effects exerted by the parts of the configurations disclosed in this specification and the drawings and the like are also disclosed, and the applicant also has the intention of obtaining rights for the configurations that exert the effects by divisional applications, amendments, etc. For example, the parts described as "can ~" in this specification are descriptions that clearly show the effects exerted, and even if there is no description of "can ~", there are parts that show the effects. Further, even if there is no such description, there are effects grasped by the configuration.

Brief Description of the Drawings

[0143]

Figure 1A

Figure 1B

Figure 1C

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Figure 22

Figure 23

Figure 24

Figure 25

Figure 26

Figure 27

Figure 28

Figure 29

Figure 30

Figure 31

Figure 32

Figure 33

Figure 34

Figure 35

Figure 36

Figure 37

Figure 38

Figure 39

Figure 40

Figure 41

Figure 42

Figure 43

Figure 44

Figure 45

Figure 46

Figure 47

Figure 48

Figure 49

Figure 50

Figure 51

Figure 52

Figure 53

Figure 54

Figure 55

Figure 56

Figure 57

Figure 58A

Figure 58B

Figure 59

Figure 60

Figure 61

Figure 62

Figure 63

Figure 64

Figure 65A

Figure 65B

Figure 66A

Figure 66B

Figure 67A

Figure 67B

Figure 67C

Figure 68A

Figure 68B

Figure 68C

Figure 69A

Figure 69B

Figure 70A

Figure 70B

Figure 71

Figure 72

Figure 73

Figure 74

Figure 75

Figure 76

Figure 77A

Figure 77B

Figure 78A

Figure 78B

Figure 79A

Figure 79B

Figure 80A

Figure 80B

Figure 80C

Figure 81A

Figure 81B

Figure 82

Figure 83A

Figure 83B

Figure 84A

Figure 84B

Figure 85A

Figure 85B

Figure 86A

Figure 86B

Figure 87A

Figure 87B

Figure 88A

Figure 88B

Figure 89

Figure 90A

Figure 90B

Figure 90C

Figure 90D

Figure 91

Figure 92A

Figure 92B

Figure 93A

Figure 93B

Figure 93C

Figure 94

Figure 95

Figure 96A

Figure 96B

Figure 97A

Figure 97B

Figure 97C

Figure 97D

Figure 97E

Figure 98A

Figure 98B

Figure 98C

Figure 99A

Figure 99B

Figure 100

Figure 101A

Figure 101B

Figure 101C

Figure 101D

Figure 102A

Figure 102B

Figure 102C

Figure 103

Figure 104A

Figure 104B

Figure 105A

Figure 105B

Figure 105C

Figure 106

Figure 107A

Figure 107B

Figure 107C

Figure 108A

Figure 108B

Figure 108C

Figure 108D

Figure 109

Figure 110

Figure 111A

Figure 111B

Figure 111C

Figure 112A

Figure 112B

Figure 113A

Figure 113B

Figure 113C

Figure 113D

Figure 113E

Figure 114

Figure 115

Figure 116

Figure 117

Figure 118

Figure 119

Figure 120

Figure 121

Figure 122

Figure 123

Figure 124

Figure 125

Figure 126

Figure 127

Figure 128A

Figure 128B

Figure 129A

Figure 129B

Figure 129C

Figure 130

Modes for Carrying Out the Invention

[0144] Hereinafter, embodiments will be described in detail with reference to the drawings. The following embodiments are examples of the embodiments of the present disclosure, and the present disclosure is not limited to these embodiments. In the drawings referred to in the present embodiment, the same parts or parts having the same function are denoted by the same reference numerals or similar reference numerals (reference numerals with A, B, etc. added after the numbers), and the repeated description thereof may be omitted. Also, in each of the drawings referred to in the following description, the scale may be different from the actual one in order to make each member, each region, etc. recognizable in size.

[0145] <1. Overview of the display device 1> FIG. 1A and FIG. 1B are diagrams for explaining an overview of a display device according to an embodiment of the present invention. The display device 1 displays an image so that an observer can observe the image through an observation area SC. In the present embodiment, "observation" may be interpreted to mean "seeing" or "visually observing". The observer is a user who uses the display device 1, for example, a person who observes an image displayed on the display device 1. The observation area SC is an area provided on the front side of the display device 1, and here it is a rectangular area. The display device 1 displays an image by aerial imaging. Aerial imaging refers to forming an image in the air by using, for example, reflection of light. Aerial imaging may be adopted to give the observer a feeling that the image floats in a predetermined space. The image displayed by aerial imaging is called an aerial image.

[0146] In the case shown in FIG. 1A, the display device 1 displays a character 1100 as an aerial image. The character 1100 is a female character. The display device 1 further displays a stage image 2100 meaning a stage under the character 1100. The stage image 2100 shows a magic circle here. An observer who sees such a display can receive an impression that the character 1100 is standing on the stage. The colors of the character 1100 and the stage image 2100 are not particularly limited. For example, the skin of the character 1100 is skin-colored. The hair color and the upper body clothing of the character 1100 are relatively light blue colors (for example, light blue), the decoration applied to the knees is a darker blue color (for example, blue), and the skirt and shoes are white. The stage image 2100 is a relatively dark blue color (for example, dark light blue).

[0147] In the case shown in FIG. 1B(a), the display device 1 displays the character 1200 as an aerial image. The character 1200 is a cat character. In the case shown in FIG. 1B(b), the display device 1 displays a stage image 2200 meaning a stage under the character 1200. Here, the stage image 2200 has strings of the characters "Yupiteru" and "Juno" (referred to as "Juno"), which is the name of the character 1200, alternately written along the outer periphery of the circular stage.

[0148] The colors of the character 1200 and the stage video 2200 are not particularly limited. Here, the character 1200 and the stage video 2200 will be described in more detail with reference to FIG. 1C. The character 1200 is roughly classified into a character body 1210 and a collar 1220. The character body 1210 is the cat character itself, whose name is "Juno" here. The character body 1210 includes parts shown in white on the body parts, for example, the parts around the eyebrows, nose and mouth, abdomen, and the front side parts of the feet correspond to this. Among the body parts of the character body 1210, the parts shown in light gray are in a relatively light brown color system (for example, loess color), for example, the parts above and beside the eyes on the face, the upper part of the torso, and the parts of the feet other than the front side correspond to this. Among the body parts of the character body 1210, the parts shown in darker gray are in a darker brown color system (for example, brown), for example, the face, head, torso, and the striped parts shown by thin lines on the feet correspond to this. The collar 1220 means the collar displayed at the position of the neck of the character body 1210. The collar 1220 is in a red color system (for example, red). Among the collar 1220, a tag 1221 is attached at the position under the face of the character body 1210. The tag 1221 is circular and has a predetermined logo marked on it. The logo is a logo in which a "●" (a circle filled inside) is arranged below a "V" - shaped symbol, and each is marked in a red color system (for example, red). The logo marked on the tag 1221 may also function as a trademark indicating the origin of the display device 1. The stage video 2200 is entirely in a brown color system. The circle and the character string are in a relatively dark brown color (for example, brown), and the image imitating the smoke inside the circle is in a lighter brown color system (for example, loess color).

[0149] In FIGS. 1A, 1B, and 1C, the backgrounds of the characters 1100 and 1200 are shown in black, but it is not limited to pure black, and a relatively dark background (for example, black or other dark color systems) may also be used.

[0150] The characters shown in FIGS. 1A, 1B, and 1C are examples. When the display device 1 displays a humanoid character, it is not limited to a female character, and a male character may be displayed. The display device 1 may display any of an actual person (for example, a family member), a person who actually existed in the past (for example, a historical figure), or a fictional character (for example, a character appearing in a fictional work such as a comic or an anime). When displaying a non-humanoid animal character, the display device 1 is not limited to a cat character, and may display any of a character of an animal that can be raised in a general household such as a dog or a hamster, a character of an animal such as a horse or a cow other than that, and a fictional animal character (for example, a character appearing in a comic, an anime, or other fictional works). Further, the display device 1 may display another character having the collar 1220.

[0151] Based on the communication function, the display device 1 moves the body parts of the character or outputs a voice imitating the speech of the character. The communication function is a function for reproducing the communication between the observer and the character or a function for reproducing a pseudo-communication. In the communication function, the character moves in response to the behavior of the observer (for example, speech or body movement). For example, the character 1100 performs an action that reproduces an action that a human usually performs, such as moving the whole body like dancing or changing the expression (for example, expressing emotions of joy, anger, sorrow, and pleasure). For example, the character 1200 makes a movement that reproduces an action that an animal usually performs (for example, yawning, wagging its tail, walking, etc.). Further, the display device 1 outputs, for example, a singing voice as if the character 1100 is singing or a voice related to the dialogue with the observer in accordance with the action of the character 1100. The display device 1 outputs, for example, a voice meaning a meow of a cat or a voice related to the dialogue with the observer in accordance with the action of the character 1200. Such output of video and audio is not limited to the communication function, and may be performed by various functions of the display device 1.

[0152] The interaction with the user in the communication function may be realized, for example, by the cooperation of a voice recognition application (an application having the function of a voice recognition engine) incorporated in the display device 1, an external voice recognition server (not shown), and an external dialogue server (not shown). For example, when the operation unit 2214 described later is pressed, the voice recognition application is activated, and voice recognition for interacting with the character is enabled. Enabling voice recognition means, in this embodiment, operating the voice recognition function, for example, turning on the voice recognition engine to wait for voice input. Then, the voice uttered by the user (also referred to as user voice) is transmitted from the communication control circuit 706 of the processing board 224 described later to the voice recognition server, and the voice recognition server executes voice recognition processing on the user voice and outputs a voice recognition result. For example, in the dialogue server, for each inputtable character string, the voices (also referred to as character voices) uttered by the characters (for example, character 1100) displayed on the display device 1 (for example, the video display unit described later) are registered in advance in association with each other. Then, the voice recognition result (for example, the voice recognition result indicated by a character string) by the voice recognition server is input to the dialogue server, and the character voice corresponding to the voice recognition result is output from the dialogue server. Then, the character voice output by the dialogue server is output from the display device 1. In this way, response processing for the voice by the user is executed, and the dialogue between the user and the character is reproduced.

[0153] The display device 1 is used by the general public, for example, as an entertainment display device. In this case, the display device 1 is used, for example, at a residence such as the user's home. However, it is not limited to this, and the display device 1 may be used for commercial purposes (for example, for advertising) or other purposes. For example, in the case of commercial use, the display device 1 is installed in a public place such as a store or other commercial facility. The display device 1 may display a video in which a character introduces or advertises a product or service at a venue such as an exhibition of products or services. The use of the display device 1 may be other uses than these.

[0154] <2. External Configuration of Display Device 1> Figures 2, 3, and 4 are perspective views showing the external configuration of the display device 1. Figure 2 is a view of the display device 1 seen from the front right obliquely. Figure 3 is a view of the display device 1 seen from slightly above on the front left obliquely side. Figure 4 is a view of the display device 1 seen from slightly below on the front right obliquely. Figure 5 is a front view of the display device 1. Figure 6 is a right side view of the display device 1. Figure 7 is a front side view of the display device 1. Figure 8 is a plan view (top view) of the display device 1. Figure 9 is a bottom view of the display device 1. Figure 10 is a rear view of the display device 1.

[0155] The display device 1 has a rectangular parallelepiped appearance. The display device 1 has a housing 100. The housing 100 is a box-shaped member that forms the outer shape of the display device 1. The housing 100 is rectangular parallelepiped-shaped. The housing 100 is longer in the height direction (also referred to as the up-down direction) than in the width direction (also referred to as the left-right direction). The lengths of the width direction and the depth direction (also referred to as the front-back direction) of the housing 100 are substantially the same. The ratio of the lengths of the width direction, height direction, and depth direction (also referred to as the front-back direction) of the display device 1 is approximately 2:3:2. In the following description, among the depth direction of the display device 1, the side located on the observer side is referred to as the "front side" (corresponding to the first direction side), and the opposite side is referred to as the "rear side" (corresponding to the second direction side).

[0156] The housing 100 has R-shaped corners. As shown in FIG. 5, when the display device 1 is viewed from the front side, the four corners of the housing 100 are each rounded. The surface of the housing 100 is preferably processed to give a texture by means of a matte finish. In this way, a rectangular parallelepiped-shaped display device 1 with excellent design is provided. The housing 100 is preferably formed of a resin material, but may also be formed of metal or other materials. The housing 100 has a light-shielded video display space inside. The video display space is a space inside the housing 100 where aerial video is displayed (formed). The video display space is formed entirely or mostly of light-shielding members. Therefore, the members constituting the housing 100 prevent external light from entering the video display space. The housing 100 may be formed, for example, entirely of a material that blocks external light, or the outer surface or the surface facing the video display space may be covered with a material that blocks light. The color of the outer surface of the housing 100 is not limited, but it is preferably white or black, etc., which gives a sense of luxury or simplicity. The display device 1 preferably has dimensions and a weight such that a person such as an observer can carry it alone.

[0157] The portions of the housing 100 that are exposed on the outside are divided into a right panel 101, a front panel 102, a left panel 103, a rear panel 104, an upper lid portion 105, and a lower lid portion 106. The right panel 101, the front panel 102, the left panel 103, the rear panel 104, the upper lid portion 105, and the lower lid portion 106 are plate-shaped members. The right panel 101 is a panel located on the right side surface of the housing 100 when viewed from the front side. The left panel 103 is a panel located on the left side surface of the housing 100 when viewed from the front side. The right panel 101 and the left panel 103 have the same shape and the same dimensions. Also, the right panel 101 and the left panel 103 are symmetric in the height direction, and the molds for forming the right panel 101 and the left panel 103 can be shared. For this reason, the right panel 101 and the left panel 103 can use common members, and an effect of reducing costs and the labor of assembly work can be expected.

[0158] The front panel 102 is located on the front side of the display device 1. The front panel 102 has an opening 110 where the light reduction member 200 can be mounted. The observation area SC is provided on the front panel 102. The observation area SC is the area that an observer who views the video displayed on the display device 1 observes. The observation area SC is also the area where the opening 110 formed in the housing 100 exists. The light reduction member 200 is provided in the observation area. The light reduction member 200 is provided vertically so as to close the opening 110. The light reduction member 200 and the opening 110 are provided above the center in the height direction of the housing 100 when viewed from the front side of the display device 1. The light reduction member 200 and the opening 110 are square or rectangular.

[0159] The light reduction member 200 includes a first region 210 which is a rectangle (which may be square) used for observing the video, and a second region 220 surrounding the periphery of the first region 210. Since the second region 220 is an area not used for observing the image at the edge portion, it may be an area that does not transmit light. Therefore, the observation area SC can also be said to be the area where the first region 210 exists. In the following description, when referring to the light reduction member 200, it may be regarded as the first region 210.

[0160] The light reduction member 200 is an optical member that reduces external light entering the video display space from the observation area SC. The light reduction member 200 is provided to maintain the video display space in a dark state. The light reduction member 200 is provided to suppress the occurrence of reflection where the observer himself / herself is reflected in the observation area SC and to make the internal components of the video display space less visible to the observer. The light reduction member 200 is a plate-shaped (including panel-shaped) member, but may also be a member called a sheet-shaped or film-shaped member. The light reduction member 200 may be a member called a smoke panel or a smoke film. For example, the light reduction member 200 has a light transmittance of 24% and a thickness of about 2 mm. The light reduction member 200 has a light transmittance that does not prevent the observation of the video displayed in the video display space of the display device 1. The light reduction member 200 is a semi-transparent member in a dark color system such as black, but may also be in a blue color system or other colors.

[0161] The information area ST is provided below the observation area SC (light reduction member 200 and opening 110) in the front panel 102. The information area ST is located in an opening formed in the front panel 102. The information area ST is an area for collecting predetermined information using a sensor or presenting predetermined information to an observer. As electronic components provided in the information area ST, there are a first sensor 2331, a second sensor 2332, a microphone 2333, and a light emitting unit 2334. The first sensor 2331 is a gesture sensor that detects gestures made by an observer. The second sensor 2332 includes one or more sensors other than the gesture sensor. Examples of the sensors of the second sensor 2332 include a gas sensor (odor sensor), a temperature sensor, and an illuminance sensor. The microphone 2333 picks up sound and converts the picked-up sound into an audio signal. The light emitting unit 2334 presents predetermined information by emitting light. The light emitting unit 2334 includes, for example, a light emitter (e.g., a light emitting diode) that emits light in a predetermined color and a light guiding member that guides the light emitted by the light emitter. In the present embodiment, the light guiding member of the light emitting unit 2334 is arranged so as to surround the area where the first sensor 2331, the second sensor 2332, and the microphone 2333 are provided. The light emitting unit 2334 emits light in, for example, a blue-based color (e.g., light blue), but may be configured to emit light in one or more colors such as a green-based color, a red-based color, or other colors. The light emitting unit 2334 is not limited to a configuration having a light guiding member, and may emit light in a predetermined area, for example, by a configuration having a plurality of light emitters.

[0162] The operation area OT is provided on the upper lid portion 105. The operation area OT is an area that receives operations performed by an observer. The operation area OT is an area where the operation units 2211, 2212, 2213, and 2214 are provided. The operation units 2211, 2212, 2213, and 2214 are switches that receive pressing operations respectively. The operation unit 2211 is operated when instructing to turn on or off the power of the display device 1. The operation unit 2212 is operated when instructing to increase the volume. The operation unit 2213 is operated when instructing to decrease the volume. The operation unit 2214 is operated when instructing to execute a predetermined function. The operation unit 2214 may be an operation unit called a special key, for example. The operation unit 2214 may be operated, for example, when instructing the start of voice recognition on the display device 1. An opening is provided on the upper lid portion 105 corresponding to the position where each of the operation units 2211, 2212, 2213, and 2214 is provided. The operation units 2211, 2212, 2213, and 2214 are exposed to the outside by being located in the respective openings. Note that the number of operation units described here, the functions assigned to the operation units, and the acceptable operation methods are examples.

[0163] The human presence sensor 234 is provided on the lower lid portion 106. The human presence sensor 234 is exposed to the outside by being located in the opening of the lower lid portion 106. The human presence sensor 234 is a detection unit that detects the presence of a person (moving body) in the detection target space. In the present embodiment, the human presence sensor 234 is a microwave Doppler sensor, which emits microwaves and detects the presence of a person in the detection target space based on the reception intensity of the microwaves, which are the reflected waves. For example, the human presence sensor 234 detects whether a person is present on the front side of the display device 1.

[0164] On the back panel 104 of the display device 1, a power jack 2311 and a rear cover portion 1041 are provided. The power jack 2311 is a jack to which a power cord is connected. The power jack 2311 receives power supply from an external power source or the like via the power cord. The rear cover portion 1041 is a removable cover portion. When the rear cover portion 1041 is removed, as shown in FIG. 11, the slot 222 and the USB (Universal Serial Bus) connector 223 are exposed. The slot 222 is a mounting portion where an external storage medium is mounted. The external storage medium corresponds to, for example, the microSD (registered trademark) standard, but may also correspond to standards related to microSDHC or other SD cards or other standards. The USB connector 223 is a mounting portion where a USB cable or a USB port of an external device corresponding to the USB standard is mounted. In the display device 1, data can be input and output with an external device via the slot 222 and the USB connector 223. The number of mounting portions may be even more. Since the portions of the slot 222 and the USB connector 223 that are exposed outside the housing are on the back side of the display device 1, they can be made difficult to observe by an observer. Also, the number of mounting portions where external devices are mounted and the corresponding standards are not particularly limited.

[0165] The housing 100 is configured by combining a right side panel 101, a front side panel 102, a left side panel 103, a back side panel 104, an upper cover portion 105, and a lower cover portion 106. In this embodiment, as a coupling method, screwing using screws, which are an example of a fixture, is adopted. However, there are no screwed portions on the front side panel 102 and the upper cover portion 105.

[0166] On the right panel 101, it is screwed at two upper and lower positions on the front side by screws 710 and 720. On the left panel 103 of the housing 100, it is screwed at two upper and lower positions on the front side by screws 730 and 740. On the rear panel 104, it is screwed at three upper positions by screws 751, 752, and 753, screwed at two positions near the center in the height direction by screws 754 and 755, and screwed at three lower positions by screws 756, 757, and 758. On the lower cover part 106, it is screwed at two positions on the front side by screws 761 and 762. The front panel 102 and the upper cover part 105 are parts that are relatively easy to observe by an observer using the display device 1. On the other hand, other parts are parts that are relatively difficult to observe by an observer using the display device 1. Therefore, according to the display device 1, it is possible to suppress the screwing positions from being observed by the observer and maintain the aesthetic appearance of the display device 1. Doing so can also contribute to giving the observer a sense of immersion in the video.

[0167] FIG. 12 is a diagram for explaining an example of how the display device 1 is used by an observer. FIG. 12 shows the positional relationship between the display device 1 and the observer U using it as seen from the left side surface of the display device 1. The display device 1 is placed on the desk 3000. A chair 3100 is arranged on the front side (frontward side) of the display device 1. The observer U is seated on the chair 3100 facing the display device 1. In this example, the position of the observer U's eyes is higher than the upper surface of the display device 1. For this reason, the observer U observes by looking down at the observation area SC at an angle θ. The angle θ is the angle between the horizontal direction and the line-of-sight direction of the observer U. The angle θ is within the range of θ1 or more and θ2 or less. The angle θ is, for example, 15 degrees. The horizontal distance between the observer U and the observation area SC is approximately 50 cm.

[0168] <3. Principle Regarding the Display of the Display Device 1> FIG. 13 is a diagram for explaining the principle related to the display of the display device 1. FIG. 13 shows a schematic diagram when the inside of the display device 1 is viewed from the left side of the display device 1. In the video display space S1 inside the housing 100, a first display unit 310, an optical member 320, and a second display unit 330 are provided. A video display unit that forms a virtual image in the video display space S1 is configured by the cooperation of the first display unit 310 and the optical member 320.

[0169] The first display unit 310 and the second display unit 330 are display units that display images. The first display unit 310 and the second display unit 330 are display units having light sources, and for example, are liquid crystal displays. The light source is a backlight. The first display unit 310 and the second display unit 330 display color (multi-color) images based on the three primary colors of red (R), green (G), and blue (B). In the present embodiment, the first display unit 310 and the second display unit 330 display images recognized as two-dimensional images.

[0170] The first display unit 310 is an 8-inch liquid crystal display. For example, in this case, the first display unit 310 includes a backlight which is an example of a light source, and a display body in which liquid crystal elements which are examples of display elements are two-dimensionally arranged. The light source is, for example, a white light source. The liquid crystal element modulates the light from the backlight in pixel units. The liquid crystal element has, for example, a configuration in which liquid crystal molecules are sandwiched between a pixel electrode provided in pixel units and a common electrode common to a plurality of pixels. The first display unit 310 has a first display surface 311 that emits the first image light L1. The first display unit 310 emits image light for displaying the characters 1100 and 1200 in FIGS. 1A to 1C. The first display unit 310 is arranged to be inclined such that one end on the observation region SC side is located above the observation region SC and the back side is lower. This inclination is equal to the inclination of the first display surface 311 and is approximately 20 degrees with respect to the horizontal plane. By inclining approximately 20 degrees in this way, the inventor has obtained the knowledge that the three-dimensional effect of the aerial image that can be given to the observer can be enhanced, and the virtual image formed in the image display space by the first image light L1 being reflected by the light attenuation member 200 can be made less observable. The basis for this will be described later. However, this angle is an example. In the width direction of the display device 1, the height of each position of the first display surface 311 is the same.

[0171] The optical member 320 is an example of an optical system that forms a virtual image in the air based on the first image light L1 from the first display unit 310. The optical member 320 has light transmissivity and reflectivity. The optical member 320 is plate-shaped. Here, the optical member 320 is a half mirror. The optical member 320 is made of acrylic mirror and has a light transmittance of about 30%. The thickness of the optical member 320 is about 2 mm. The light transmittance is only an example and may be 6%, for example, as long as the transmittance is ensured to the extent that an observer can observe the virtual image displayed in the video display space S1. The optical member 320 is disposed obliquely with respect to the opening 110 and the first display surface 311 in the video display space S1. The tip of the optical member 320 on the observation region SC side is located below the observation region SC and is inclined so that the back side is at a higher position. This inclination is 35 degrees with respect to the horizontal plane. However, this angle is only an example. In the width direction of the display device 1, the height of each position of the optical member 320 is the same.

[0172] The second display unit 330 is a 7-inch liquid crystal display. The second display unit 330 has a second display surface 331 that emits second image light L2 of the displayed image. In FIGS. 1A and 1B, the second display unit 330 displays a video V2 corresponding to the stage videos 2100 and 2200. The second display unit 330 is disposed such that the normal direction of the second display surface 331 faces upward. The second display surface 331 is located on the back side of one end on the lower side of the optical member 320. A pedestal portion 400 is provided on the front side of the second display surface 331. The pedestal portion 400 is a part of the member that constitutes the video display space S1 of the housing 100. The upper surface of the pedestal portion 400 is located at approximately the same height as the second display surface 331, but the second display surface 331 may be slightly lower.

[0173] Under the above configuration, the first image light L1 emitted by the first display unit 310 is incident on the first surface 321 of the optical member 320 at a predetermined angle. The incident first image light L1 is reflected by the optical member 320 toward the front side of the display device 1 at the predetermined angle. The aerial image V1 is recognized in the video display space S1 of the housing 100 by this reflected light L1r. The aerial image V1 is a virtual image recognized below the tip of the back side of the first display surface 311, for example, below the position of the intersection of the first display surface 311 and the optical member 320.

[0174] The second image light L2 emitted by the second display unit 330 is incident on the second surface 332 of the optical member 320 and transmitted to the first surface 321 side. The second image light L2 directly enters the eyes of the observer. The video V2 on the second display surface 331 is a real image recognized as being located below the aerial image V1. For example, the aerial image V1 is recognized at the center in the front-rear direction of the second display surface 331. In this way, the aerial image V1 is recognized as the characters 1100 and 1200 shown in FIGS. 1A to 1C, and the video V2 is recognized as the stage videos 2100 and 2200 shown in FIGS. 1A to 1C. According to the display device 1, by allowing the observer to observe the aerial image V1 combined using the optical member 320, a three-dimensional effect of the video can be given to the observer, and further, by allowing the observer to observe the video V2 below it, the three-dimensional effect can be enhanced. Also, by using the second display unit 330, the degree of freedom in selecting the video to be observed by the observer together with the aerial image can be increased compared to the case where a light emitter and a light guide member are combined to emit light in a pattern of a predetermined pattern.

[0175] It is desirable to provide a viewing angle control member 312 for narrowing the viewing angle toward the front side on the first display surface 311 of the first display unit 310. In this way, even when the observer approaches the observation area SC and looks up, it is possible to suppress the image displayed on the first display surface 311 from being directly observed by the observer. Regarding the second display surface 331, a viewing angle control member for narrowing the viewing angle toward the front side is not provided so that the observer can easily observe the video V2.

[0176] The basic display principle of the display device 1 is as described above. Furthermore, as a configuration for enhancing its visual effect, the display device 1 has a light dimming member 200 and a light shielding member 500. Their actions and effects will be described later.

[0177] <4. Internal Configuration of Display Device 1> Next, the internal configuration of the display device 1 will be described. FIGS. 14, 15, 16, 17, and 18 are views showing a state in which the right panel 101, the front panel 102, the left panel 103, and the rear panel 104 of the housing 100 are removed. As shown in FIG. 14, when the right panel 101 is removed, the right internal panel 107 is exposed. As shown in FIG. 15, when the front panel 102 is removed, the front internal panel 108 is exposed. As shown in FIG. 16, when the left panel 103 is removed, the left internal panel 109 is exposed. As shown in FIG. 16, when the rear panel 104 is removed, the wiring portion 800 and the partition member 900 are exposed.

[0178] The right internal panel 107 and the left internal panel 109 hold the first display portion 310 and the optical member 320 described in FIG. 13 by sandwiching them from both the left and right sides.

[0179] The screws 710 and 720 shown in FIGS. 2, 4, and 6 sequentially pass through the holes H1 and H2 passing through the right panel 101, the front internal panel 108, and the right internal panel 107 to couple them. The screws 730 and 740 shown in FIGS. 3 and 7 sequentially pass through the holes H3 and H4 passing through the left panel 103, the front internal panel 108, and the left internal panel 109 to couple them. The screws 751, 752, and 753 shown in FIG. 10 fix the rear panel 104 and the upper lid portion 105. The screw 754 couples the rear panel 104 and the right panel 101. The screw 755 fixes the rear panel 104 and the left panel 103. The screws 765, 765, and 757 fix the rear panel 104 and the lower lid portion 106.

[0180] Figures 19, 20, 21, 22, 23, and 24 are views showing a state in which the right internal panel 107 and the left internal panel 109 are further removed. FIG. 19 is a view showing how the display device 1 is seen from the right side. FIG. 20 is a view showing how the display device 1 is seen from the left side. FIG. 21 is a view showing how the display device 1 is seen from diagonally below on the right side. FIG. 22 is a view showing how the display device 1 is seen from diagonally above on the right side. FIG. 23 is a view showing how the display device 1 is seen from diagonally below on the left side. FIG. 24 is a view showing how the display device 1 is seen from diagonally above on the left side.

[0181] Inside the housing 100, a first display unit 310, an optical member 320, a second display unit 330, a pedestal unit 400, and a light-shielding member 500 are provided. The first display unit 310, the optical member 320, the second display unit 330, and the pedestal unit 400 have the configurations as described with reference to FIG. 13.

[0182] The light-shielding member 500 is provided on the optical path of the reflected light reflected from the light-reducing member 200 among the first image light L1 from the first display unit 310. The light-shielding member 500 covers one end side of the optical member 320 on the side of the light-reducing member 200 (observation region SC), in other words, one end side far from the first display unit 310, so as to prevent this reflected light from entering the optical member 320. The light-shielding member 500 is, for example, a member that absorbs visible light, but any member that can prevent the transmission of the first image light L1 may be used. The light-shielding member 500 is preferably, for example, black or other dark colors, but other colors may also be used. The reason for this will be described later, but it is to suppress the situation where the image (virtual image) formed in the video display space S1 by the first image light L1 being reflected by the light-reducing member 200 is observed by the observer. In particular, it suppresses the observation of an image that may be observed when the observer observes the video by peeking into the video display space S1 from the observation region SC. In addition to this image, it also suppresses the observation of external objects such as the ceiling. The upper surface of the light-shielding member 500 is substantially horizontal, but it is not limited to this.

[0183] Above the first display unit 310, a first plate 601 is provided, and above the first plate 601, a first accommodation space S2 (see FIGS. 19 and 20) for accommodating various components is formed. Also, below the second display unit 330, a second plate 602 is provided, and below the pedestal portion 400 and the second plate 602, a second accommodation space S3 (see FIGS. 25 to 27) for various components is formed.

[0184] As shown in FIGS. 17 to 24, the first accommodation space S2 is a space separated from the video display space S1 by the first plate 601 provided on the first display unit 310. The first plate 601 is coupled to the right inner panel 107 using screws 791, 792, 793 and is coupled to the left inner panel 109 using screws 794, 795, 796. In the first accommodation space S2, an operation substrate 221, a processing substrate 224, speakers 2251, 2252, and a holding portion 226 are provided. The operation substrate 221 is a substrate on which operation portions 2211, 2212, 2213, 2214 are mounted on the surface. The operation substrate 221 supplies signals corresponding to the operations of the operation portions 2211, 2212, 2213, 2214 to the processing substrate 224. The processing substrate 224 functions as a processing substrate that controls the display device 1. The processing substrate 224 may be referred to as a main substrate. The processing substrate 224 is electrically connected to the operation substrate 221 and the speakers 225A, 225B, for example, via a printed wiring board (for example, FPC). The processing substrate 224 is located on the back side of the first accommodation space S2 in the depth direction of the display device 1. The processing substrate 224 is a so-called SoC substrate and operates a processor and an OS (Operating System). The processing substrate 224 reads signals from sensors mounted on the sensor substrate 233 and voice signals from the microphone 2333 by the OS, or acquires signals corresponding to the operations of the operation portions 2211, 2212, 2213 from the operation substrate 221. The processing substrate 224 performs control for displaying video on the first display unit 310 and the second display unit 330. Slots 222 and USB connectors 223 are mounted on the processing substrate 224 and are exposed from the back side of the display device 1.

[0185] Speakers 2251 and 2252 are provided on both the left and right sides when viewed from the front side, and emit sound to the outside through openings 1051 and 1052 formed in the upper cover portion 105. It is desirable that speakers 2251 and 2252 are not placed too far from the processing substrate 224. It is desirable that speakers 2251 and 2252 are spaced apart so that their sounds do not interfere with each other as much as possible.

[0186] The holding portion 226 is provided at a position overlapping the processing substrate 224 and holds the processing substrate 224 on its lower surface. A heat sink 2261 for heat dissipation or heat absorption is provided on the upper surface of the holding portion 226 on the side opposite to the side holding the processing substrate 224. The first display portion 310 and the first plate 601 are inclined so as to descend from the front side to the back side. For this reason, the first accommodation space S2 has gradually increasing dimensions in the height direction from the front side to the back side, and there is more margin in the height direction on the back side. By utilizing this, members having a thickness such as the processing substrate 224 and the holding portion 226 are accommodated. In this way, it is possible to suppress the upper housing portion from becoming longer than the observation region SC, contributing to weight reduction and miniaturization of the display device 1, and also being desirable in terms of design.

[0187] Figures 25, 26, and 27 are diagrams showing the internal configuration of the display device 1 when the lower cover portion 106 is removed. A second plate 602 is provided below the pedestal portion 400 and the second display portion 330. A second accommodation space S3 is formed between the second plate 602 and the lower cover portion 106. The second accommodation space S3 is provided with a control substrate 231, wiring 232, a sensor substrate 233, and a human sensor 234. The front-side internal panel 108 is coupled to the second plate 602 using screws 771, 772, 773, and 774. The front-side internal panel 108 is coupled to the lower cover portion 106 using screws 775, 776, and 777. The front-side internal panel 108 is fixed using screws 771 to 777, but in the situation where the display device 1 is used, since it is covered by the front-side panel 102, screws 771 to 777 are not exposed on the front side.

[0188] The control board 231 controls the supply of power and signals to the display device 1. The control board 231 is electrically connected to the processing board 224 via the wiring section 800, and exchanges various signals and supplies power to the processing board 224. The control board 231 is electrically connected to the sensor board 233 and the human presence sensor 234 via the wiring 232. The wiring 232 is, for example, a printed wiring board (e.g., FPC).

[0189] The sensor board 233 is a board on which the first sensor 2331, the second sensor 2332, and the microphone 2333 are mounted. The sensor board 233 is provided in a region below the light reduction member 200 (observation region SC) on the back side of the front side inner panel 108. The sensor board 233 is vertically erected so that its board surface extends in the height direction and the width direction. The sensors on the sensor board 233 may be those that detect predetermined information. The first sensor 2331 is an optical sensor that emits light (e.g., infrared light) to the front side and detects the gesture of an observer by receiving the reflected light. The microphone 2333 picks up sound and outputs a sound signal indicating the picked-up sound. The gas sensor as the second sensor 2332 detects odors such as gas odor and burning odor. The temperature sensor detects temperature. The illuminance sensor detects illuminance. The first sensor 2331 is located approximately at the center in the width direction of the information region ST. The sensor board 233 outputs signals from the first sensor 2331, the second sensor 2332, and the microphone 2333 to the control board 231 via the wiring 232. The processing board 224 controls the light emission of the light emitting unit 2334 when voice recognition is possible via the wiring section 800 and the control board 231.

[0190] The human presence sensor 234 is arranged at a predetermined interval of about 30 cm or the like on the back side of the front side inner panel 108 so as not to contact the front side inner panel 108. Doing so is desirable for ensuring the detection sensitivity of the human presence sensor 234. The human presence sensor 234 is provided slightly on the front side from the middle in the depth direction. The human presence sensor 234 outputs a signal indicating the detection result to the control board 231.

[0191] The wiring section 800 includes a power line 810, a signal line 820, and a signal line 830. The wiring section 800 is routed from the lower side to the upper side of the housing 100. The wiring section 800 passes between the rear panel 104 and the partition member 900. The control board 231 supplies power to the processing board 224 via the power line 810. The control board 231 exchanges signals with the processing board 224 via the signal line 820. The processing board 224 supplies signals (e.g., driving signals and video signals) for driving the second display section 330 via the signal line 830. The power line 810, the signal line 820, and the signal line 830 are provided so as to pass through the space region between the partition member 900 and the rear panel 104. A background plate 910 is provided on the front side of the partition member 900. The background plate 910 is, for example, a dark color such as black. The partition member 900 is formed in a plate shape using, for example, a resin material and is a member that does not transmit light. In this way, the wiring section 800 is not observed from the video display space S1 side.

[0192] The processing board 224 functions as operation control means for controlling the displays of the first display unit 310 and the second display unit 330 or controlling the audio outputs from the speakers 2251 and 2252 based on the communication function. For example, the processing board 224 controls the displays of the first display unit 310 and the second display unit 330 or controls the audio outputs from the speakers 2251 and 2252 according to the information measured by the sensor board 233 and the human presence sensor 234. For example, when the processing board 224 detects the presence of a person based on the human presence sensor 234, it may cause the character to make a greeting gesture or output the voice of that character. When the processing board 224 detects a gesture such as waving the hand left and right, up and down, goodbye, or forward and backward with the first sensor 2331, it controls the display of the first display unit 310 or controls the audio output from the speakers 2251 and 2252. For example, the processing board 224 rotates the character in that direction according to the left-right or up-down hand wave. When the processing board 224 detects a goodbye gesture, it causes the character to make a goodbye motion. When the processing board 224 detects a gesture of moving the hand forward and backward, it returns the display of the character to the default (for example, FIGS. 1A to 1C). The processing board 224 changes the display of at least one of the first display unit 310 and the second display unit 330 according to the illuminance measured by the illuminance sensor. For example, the processing board 224 may darken the display when the surroundings of the display device 1 become dark. The processing board 224 may also perform controls such as moving the eyes of the character based on the illuminance sensor. The processing board 224 controls the display of the first display unit 310 or controls the audio output from the speakers 2251 and 2252 according to the temperature detected by the temperature sensor. The processing board 224 changes the speech content of the character according to whether the surroundings of the display device 1 are hot or cold. In addition, the processing board 224 controls the light emission of the light emitting unit 2334. The processing board 224 changes the volume according to the operations of the operation units 2211, 2212, 2213, and 2214. Note that the voice engine may be realized by the function of the processing board 224 or may be realized by an external recognition server.In the latter case, the processing substrate may have a communication module that performs wireless LAN or network communication such as Wi-Fi, and communicate with the voice recognition server via the communication module.

[0193] The processing substrate 224 makes the emission luminance of the light source of the first display unit 310 brighter than the emission luminance of the light source of the second display unit 330. The reason is that the inventor has obtained the knowledge that by doing so, the three-dimensional effect of the aerial image that can be given to the observer can be further enhanced due to the difference between the emission luminance of the first display unit 310 and the emission luminance of the second display unit 330. Since the three-dimensional effect may be impaired if the video display space S1 is bright, the emission luminance of the second display unit 330 is lowered.

[0194] The first display unit 310 is inclined at approximately 20 degrees with respect to the horizontal direction. This is to prevent the situation where the observer may assume a posture of peering in when sitting on a chair, or to prevent display defects from occurring in combination with the display of the second display unit 330. By doing so, the entire display device 1 can be seen even when the observer views it from slightly above. Therefore, the observer does not need to assume a posture of peering in.

[0195] By doing so, it is possible to prevent the ceiling from being reflected by the optical member 320 and being observed by the observer, or from overlapping the image on the second display surface 331 and making the aerial image look less clear. The operation will be described. As shown in FIG. 28, it is assumed that the first image lights L31 and L32 are incident on the light attenuation member 200. In this case, the respective reflected waves L31r and L32r of the first image lights L31 and L32 are emitted from the light attenuation member 200 and further reflected by the optical member 320, so that the observer observes the video V3 that is a virtual image. For example, when the first display unit 310 displays an image of a character, the lower part of the character, for example, the image near the feet, may be observed. Also, as shown in FIG. 29, light L4 is incident on the light attenuation member 200 from the ceiling, lighting, etc., passes through it, and is further reflected by the optical member 320, so that the reflection of the ceiling occurs near the lower end of the optical member 320. In this way, the display quality of the display device 1 may be affected by the observation of images other than the original aerial image V1.

[0196] Therefore, by disposing the light shielding member 500 on the optical path of the reflected light in the light dimming member 200 and on the optical path of the light L4 from the ceiling, lighting, etc., the display of the video V3 and the reflection of the ceiling, etc. are suppressed. As shown in FIG. 30, by providing the light shielding member 500, the reflection in the optical member 320 is suppressed, so that the display of the video V3 and the reflection of the ceiling are suppressed. Since the light shielding member 500 is below the observation region SC and the light dimming member 200 also exists, it is difficult for the observer to recognize the existence of the light shielding member 500. For example, assuming that the horizontal distance between the observer and the observation region SC is 50 cm and the angle θ at which the observer's line of sight is incident is 35 degrees, the light shielding member 500 is provided on the optical path of the light related to the video V3 and the reflection. As shown in FIG. 31, if the inclination angle of the first display unit 310 is 10 degrees, the position of the video V3 is displayed more on the back side, and the video V3 becomes easier to observe. To suppress this, it is necessary to extend the light shielding member 500 further to the back side, which is not desirable. Therefore, it is desirable that the inclination angle of the first display unit 310 be 20 degrees.

[0197] According to such a concept, even without using the light shielding member 500, the optical member 320 may be disposed while avoiding the region on the optical path of the reflected light reflected by the light dimming member 200 in the first image light L1. In this way, it is possible to suppress the virtual image formed in the video display space by the first image light L1 being reflected by the light dimming member from being observed by the observer.

[0198] In addition, the observer makes a gesture near the first sensor 2331 which is a gesture sensor. In this case, if the first sensor 2331 is above the observation region SC, the hand making the gesture may get in the way, and the observation of the video via the observation region SC may be hindered. In the present embodiment, since sensors such as the first sensor 2331 are provided below the observation region SC, even when making a gesture while observing the observation region SC, it is possible to suppress the observation from being hindered.

[0199] The reason for darkening the image display space S1 is to make the aerial image appear more three-dimensional. For example, when a specific character is displayed, a sense of floating of the character can be obtained due to the darkness of the surroundings. Also, when viewed from the front side, the periphery of the observation region SC is surrounded by the housing 100 (front panel 102). By doing so, the three-dimensional effect of the aerial image that can be given to the observer can be enhanced by combining the aerial image displayed in the image display space and the housing located in front of it.

[0200] The part facing the image display space S1 is subjected to a process for reducing light reflection (for example, matte finish). By doing so, even if external light or other light enters the image display space S1, reflection is suppressed, so it is easy to maintain a dark state. It is possible to prevent the internal space from becoming bright. Such a process may be performed on part or all of the background plate 910, the pedestal portion 400, and the frames of the first display portion 310 and the second display portion 330.

[0201] Also, when a coupling method using fixtures such as screws is adopted, the front panel 102 and the front-side internal panel 108 can be easily removed compared to the case of adhesion or the like. Therefore, dust that has entered the image display space can also be removed using an air blower or a soft cloth. On the other hand, since the front panel 102 is not fixed with fixtures such as screws, it is prevented from being observed by the observer and causing the observer to be startled.

[0202] <5. Detailed Configuration of the Processing Substrate 224> FIG. 33 is a control block diagram of a processing substrate 224 included in the display device 1 according to an embodiment. As shown in FIG. 33, the processing substrate 224 is a controller having a memory including a CPU 701 that functions as an arithmetic processing unit that executes arithmetic processing and the like, a RAM 703 used as a work area, and a ROM 702 that stores control programs and the like. Note that the processing substrate 224 may be read as, for example, a control unit (an example of an operation control unit). Various programs are stored in the ROM 702 of the processing substrate 224, and the processing substrate 224 realizes various functions by executing these programs. For example, an audio recognition application for reproducing the interaction between the user and the character is stored in the ROM 702, and the processing substrate 224 executes the audio recognition application based on input signals from various sensors 234, 2331 to 2332 or a GPS receiver 60 or the like, thereby reproducing the interaction between the user and the character. Further, the processing substrate 224 includes a display control circuit 704 that controls an image or the like displayed on the display device 1 (specifically, a video display unit), and an audio control circuit 705 that controls audio output from speakers 2551 and 2552. Further, the processing substrate 224 includes a communication control circuit 706 that controls communication with other devices (for example, an external audio recognition server (also referred to as an audio recognition engine) not shown and an external dialogue server (also referred to as a dialogue engine) not shown).

[0203] <6. Communication function related to the character 1100> Hereinafter, various controls for reproducing the communication between the character 1100 displayed on the display device 1 (for example, a video display unit) and the user will be sequentially described with reference to FIGS. 34 to 40.

[0204] <Regarding the communication function related to ni oini> For example, an odor sensor for detecting an odor may be provided in the display device 1 as the second sensor 2332, and the processing board 224 may execute a voice output operation of outputting voice corresponding to the detection result by the odor sensor as the character voice of the character 1100. The odor sensor outputs a signal that changes according to, for example, the intensity of a certain odor, or outputs a signal that changes according to the components (odor components) contained in the odor. The odor sensor outputs a signal that changes according to, for example, the type of odor. The odor sensor is configured to be able to detect the concentration of specific odor components (tar, ammonia, alcohol, carbon dioxide, etc.) using, for example, a deodorizing filter or the like. In this way, the processing board 224 can reproduce communication regarding odor between the character displayed on the video display unit of the display device 1 and the user, and can reproduce more diverse communication between the character and the user.

[0205] For example, the processing board 224 may execute a voice output operation of outputting voice corresponding to the detected type of odor as the character voice of the character 1100. Note that a single sensor capable of identifying a plurality of types of odor components may be configured as the odor sensor, or a plurality of sensors capable of identifying different types of odor components may be configured as the odor sensor.

[0206] FIG. 34(A) is a flowchart for reproducing communication regarding smell, and FIG. 34(B) is a diagram showing a voice management table (also referred to as a voice management list) regarding smell. The voice management table is stored, for example, in the processing board 224 of the display device 1 or in the dialogue server. As shown in FIG. 34(B), in the voice management table, for each type of smell component (also referred to as a smell substance) detectable by the smell sensor, the type of smell mainly containing the smell component and the voice (referred to as a character voice) emitted by the character 1100 are registered in advance. For example, in the voice management table, the smell of tobacco mainly containing tar is registered in association with tar, and as the character voice when the smell of tobacco is detected, words such as "Smoking too much is not good for your health~" that show concern for the user's health are registered.

[0207] Then, first, in step S11, the processing substrate 224 (which may also be read as the control unit) determines whether an odor has been detected. For example, when the concentration of the odor component detected by the odor sensor exceeds a predetermined threshold value (reference value) for a specific odor, the processing substrate 224 determines that the odor component has been detected. In step S12, the processing substrate 224 determines the type of odor registered in the voice management table in association with the detected odor component. For example, when tar with a concentration exceeding a predetermined threshold value is detected, it is determined that the smell of tobacco has been detected. Then, the processing substrate 224 outputs a character voice corresponding to the detected odor type from the speakers 2551 and 2552. For example, when it is determined that the smell of tobacco has been detected, the processing substrate 224 executes a voice output operation of outputting a voice of words concerned about the user's health (here, "Smoking too much is not good~") as the character voice. As other examples, the following can be mentioned. For example, when the concentration of a specific main component contained in a fragrance such as aromatic oil or food exceeds a predetermined reference value, the processing substrate 224 determines that an odor such as a fragrance or food has been detected and outputs a voice asking a question about the source of the odor as the character voice. Also, when alcohol exceeding a predetermined reference value is detected, the processing substrate 224 determines that the smell of alcohol has been detected and outputs voices such as "It smells like alcohol~" or "You've been drinking again. Cut it out." as the character voice of the character 1100. Also, when a bad breath component (for example, hydrogen sulfide, methyl mercaptan, dimethyl sulfide, etc.) exceeding a predetermined reference value is detected, the processing substrate 224 determines that bad breath has been detected and outputs voices such as "You have a bit of bad breath. Have you brushed your teeth?" or "Pay attention to periodontal abscess." as the character voice of the character 1100. Also, when an odor component contained in gaseous fuel such as tertiary butyl mercaptan, dimethyl sulfide, or tetrahydrothiophene is detected, the processing substrate 224 determines that the odor of gaseous fuel has been detected and outputs a voice such as "It smells like gas!" as the character voice of the character 1100.

[0208] In this way, the processing substrate 224 may execute control to output, as the character voice of the character 1100, voice corresponding to the detected type of odor. By performing such control, the scope of communication between the character displayed on the video display unit and the user can be widened, and the user's affection for the character can be increased.

[0209] The display device 1 is not limited to identifying the voice output based on the voice management table. For example, the display device 1 may identify the voice to be output according to a scenario in which the speech content of the character changes based on the content of past conversations (conversation history). This scenario may define a branching scenario in which data for identifying the voice output by the character is managed in a tree structure.

[0210] Here, although the voice output operation of voice according to the detection result by the odor sensor is illustrated, it is not limited thereto. The processing board 224 may execute a display output operation of displaying, on the video display unit, a video in which a character makes a movement according to the detection result by the odor sensor. For example, similar to the voice management table, a display management table (not shown) may be provided in advance, and the processing board 224 may execute a display output operation of displaying, on the video display unit, a video in which the character 1100 makes a movement according to the detected type of odor. The display management table may be, for example, a table in which data defining the character 1100 is registered in association with the odor component and the type of odor. The data defining the character 1100 may be data indicating the video of the character 1100 to be displayed, or may be data defining the content of the movement of the character 1100. For example, when any odor component is detected, the processing board 224 may display, on the video display unit, a video in which the character 1100 makes a movement of smelling the odor. Further, when the processing board 224 determines that, for example, the smell of tobacco is detected, the processing board 224 may display, on the video display unit, a video in which the character 1100 makes a movement of disliking it. At this time, the processing board 224 may display a video imitating smoke on the video display unit. Furthermore, the processing board 224 may execute both the voice output operation and the display output operation as described above. For example, when any odor component is detected by the odor sensor, the processing board 224 may display, on the video display unit, a video in which the character 1100 makes a movement of smelling the odor, and output, from the speakers 2551 and 2552, a voice such as "Something smells" as the character voice of the character 1100.

[0211] Furthermore, the processing board 224 may control so that the reaction of the character 1100 changes according to the concentration of the odor component (also referred to as detection intensity) detected by the odor sensor. For example, the processing board 224 may selectively display any one of a plurality of videos of movements (for example, "frowning (showing a displeased expression)", "sweating coldly", "turning pale", and "fainting", etc.) provided step by step according to the concentration of the odor component.

[0212] The display device 1 may be able to detect that the user is smoking, for example, by combining a smoke sensor that detects smoke, a camera image (e.g., an image captured by the imaging unit 227), an image from a thermal camera, or other sensors, as a method for distinguishing between the smell of tobacco and other odors (scents).

[0213] When the processing board 224 detects that the user is smoking, it may display an image simulating smoke (a video reproducing the appearance of smoke billowing) overlaid on the character 1100 (in front of the character 1100). At this time, the processing board 224 may protrude the face of the character 1100 forward to enlarge the face and give it a disgusted expression. The processing board 224 may change the degree of disgust shown by the character 1100 according to the degree of intimacy, which is the degree of intimacy between the user and the character 1100. For example, when the degree of intimacy is equal to or greater than a predetermined value, the processing board 224 may make the expression of the character 1100 such that it says "I love you so I'll forgive you", and when it is less than the predetermined value, make the character 1100 show an unhappy expression. The processing board 224 may specify the degree of intimacy according to, for example, the usage record of the display device 1 by the user (e.g., past usage time and past conversation content). The algorithm for specifying the degree of intimacy is not limited to this.

[0214] <Regarding the communication function based on the user's location information> Also, for example, the display device 1 may have a GPS (Global Positioning System) receiver 60 (see FIG. 33), and the following control may be executed based on the user's location information. For example, the processing board 224 may acquire the location information of the display device 1 carried (held) by the user as the user's own location information based on the signal from the GPS receiver 60, and execute the following control based on the acquired location information.

[0215] For example, it may be controlled such that a voice corresponding to the stay frequency (also referred to as the visit frequency) at a location specified based on the user's location information is output as a character voice. FIG. 35 is a flowchart for reproducing communication regarding the stay frequency.

[0216] For example, in step S21, the processing board 224 determines whether the user's location information has been received from the GPS receiver 60. When the user's location information is received, in step S22, the processing board 224 determines whether the number of stays (also referred to as the number of visits, etc.) of the user at the location specified based on the user's location information is equal to or greater than a predetermined value (for example, "2"). Note that the stay frequency is the number of times the user has stayed at a single location within a predetermined period (for example, one day or one week, etc.). For example, the processing board 224 searches for and specifies the user's stay location using a network or the like based on the location information (for example, the user's current location information) acquired from the GPS receiver 60. Then, the processing board 224 calculates the user's stay frequency based on the number of stays of the user at the specified location, and determines whether the user's stay frequency is equal to or greater than the predetermined value. For example, when the user's stay frequency is equal to or greater than the predetermined value, in step S23, the processing board 224 controls such that a predetermined character voice registered in advance regarding the user's stay frequency is output from the speakers 2551 and 2552. For example, when the user visits the same location twice on the same day, the processing board 224 determines that the user's stay frequency is equal to or greater than the predetermined value, and outputs a character voice such as "Hey, you were here just now".

[0217] In addition, the processing board 224 may be controlled to output a voice corresponding to the location specified based on the acquired location information as a character voice of the character 1100. FIG. 36(A) is a flowchart for reproducing communication regarding the stay location, and FIG. 36(B) is a diagram showing a voice management table of character voices regarding the stay location.

[0218] For example, in step S31, the processing board 224 determines whether the user's location information has been received from the GPS receiver 60. When the user's location information is received, in step S32, the processing board 224 searches for and identifies the user's staying location by using a network or the like based on the user's location information. Then, in step S33, the processing board 224 outputs, from the speakers 2551 and 2552, a character voice corresponding to the identified location based on the voice management table of FIG. 36(B). For example, when the user goes to a supermarket, the processing board 224 outputs, as the character voice of the character 1100, a character voice such as "What should I cook for dinner today?", or when the user goes to a hospital, a voice such as "Are you okay? Do you not feel well?". Also, for example, when the user goes to an amusement park, the processing board 224 outputs a character voice such as "You had a great time playing".

[0219] Further, the processing board 224 may be controlled to output, as the character voice of the character 1100, a voice corresponding to the number of stays (also referred to as the number of visits, etc.) of the user at the location identified based on the acquired location information. FIG. 37(A) is a flowchart for reproducing the communication regarding the number of stays, and FIG. 37(B) is a diagram showing the voice management table of the character voice regarding the number of stays.

[0220] Steps S41 and S42 in Fig. 37(A) are the same as steps S31 and S32 in Fig. 36(A), so the description thereof will be omitted. In step S43, the processing board 224 acquires the number of times the user has stayed at the location specified in step S42. Then, in step S44, the processing board 224 outputs, from the speakers 2551 and 2552, character voices corresponding to the number of times the user has stayed based on the voice management table in Fig. 37(B). For example, when the user visits a certain game center for the first time, the processing board 224 outputs character voices such as "It was fun playing games". Then, when the user visits the certain game center again, the processing board 224 outputs character voices such as "I really wanted to come again". Further, when the user visits the certain game center a predetermined number of times or more (for example, 10 times or more), the processing board 224 outputs character voices such as "Going to play games again~".

[0221] Also, the processing board 224 may be controlled to output, as the character voice of the character 1100, a voice corresponding to the staying time of the user at the location specified based on the acquired position information. Fig. 38(A) is a flowchart for reproducing the communication regarding the staying time, and Fig. 38(B) is a diagram showing the voice management table of the character voice regarding the staying time.

[0222] Steps S51 and S52 in Fig. 38(A) are the same as steps S31 and S32 in Fig. 36(A), so the description thereof will be omitted. In step S53, the processing substrate 224 acquires the user's staying time at the location specified in step S52. Then, in step S54, the processing substrate 224 outputs, from the speakers 2551 and 2552, character voices corresponding to the user's staying time based on the voice management table in Fig. 38(B). For example, when the user's staying time at a convenience store is within 5 minutes, the processing substrate 224 outputs character voices such as "You were quick. I'm glad I waited for you." Also, when the user's staying time at a convenience store is 5 minutes or more and less than 10 minutes (5 - 10 minutes), the processing substrate 224 outputs character voices such as "What did you buy?" Further, when the user's staying time at a convenience store exceeds 10 minutes, the processing substrate 224 outputs character voices such as "You were late. I was worried."

[0223] The processing substrate 224 may perform the above control based on the user's position information acquired using a GPS receiver 60 or the like. In this way, the user can get the feeling that the character shows a reaction according to his / her actions, and the user's attachment to the character increases.

[0224] Note that the display device 1 is installed, for example, at the user's home, and the display device 1 (specifically, the communication control circuit 706) may communicate with the user's smartphone (a smartphone equipped with a GPS receiver) or the like to acquire the position information of the user while out (the position information of the smartphone held by the user). Then, when communicating with the character 1100 after the user returns home or the like, the processing substrate 224 may be controlled to execute the above operations. Note that the content of the character voices and movements at this time may be changed as appropriate.

[0225] <Regarding the communication function related to the user's behavior pattern> Also, when it is determined that the user's behavior pattern matches a predetermined behavior pattern, it may be controlled so that voice corresponding to the predetermined behavior pattern is output as the character voice of the character 1100. FIG. 39(A) is a flowchart for reproducing communication regarding the behavior pattern, and FIG. 39(B) is a diagram showing a voice management table of character voices regarding the behavior pattern.

[0226] For example, on the processing board 224, the day of the week when the user goes to work (for example, Monday to Friday), the time of going to work (for example, 8:30), and the specific route used when going to work are pre-registered by the user as the "behavior pattern when going to work". Then, for example, when the position information of the user is received from the GPS receiver 60 (step S61), the processing board 224 determines whether the user's behavior pattern matches a predetermined behavior pattern based on the position information of the user (step S62). For example, when the user passes through a specific route at 8:30 on Tuesday, the processing board 224 determines that the user's behavior pattern matches the "behavior pattern when going to work". Then, in step S63, the processing board 224 outputs, from the speakers 2551 and 2552, as the character voice of the character 1100, the voice (for example, "Do your best at work") registered in association with the "behavior pattern when going to work" based on the voice management table in FIG. 39(B). In this way, by having the character show a reaction according to the user's behavior, the user's attachment to the character can be increased. Note that it is not essential that a predetermined behavior pattern (for example, the behavior pattern when going to work) be pre-registered by the user. For example, the processing board 224 may have a learning function, and the predetermined behavior pattern may be registered by learning the user's behavior pattern.

[0227] <Regarding the communication function for detecting a suspicious person> Also, when it is determined that a person detected in the detection target space is a suspicious person, a predetermined operation may be executed. Then, after the predetermined operation is executed, when a user of the display device 1 is detected, a voice regarding the detection of the suspicious person may be output as the character voice of the character 1100. FIG. 40 is a flowchart for realizing an operation regarding the detection of a suspicious person.

[0228] For example, in the display device 1, as shown in FIG. 32, a photographing unit 227 (for example, a camera) for photographing an observer (user or the like) is provided on the front side of the display device 1, and the photographing unit 227 (specifically, the sensor included in the photographing unit 227) may be used as a detection means for detecting the presence of a person in the detection target space. As the "detection target space", for example, the angle-of-view range (photographable range) of the photographing unit 227 in the space where the display device 1 is placed (for example, the user's home) can be mentioned. The photographing unit 227 includes, for example, a lens and an image sensor (for example, a CCD or a CMOS), and photographs a multi-color image. The lens of the photographing unit 227 is provided at a position where an observer (especially the face) can be photographed. In the example shown in FIG. 32, the lens of the photographing unit 227 is provided above the observation region SC and near the center in the width direction of the display device 1 in the front side panel 102 arranged on the front side of the housing 100. The photographing unit 227 outputs, for example, image signals of the respective color components of R, G, and B to the processing board 224. The processing board 224 processes this image signal to generate a photographed image.

[0229] The processing board 224 monitors the detection target space using the imaging unit 227 (step S71). Then, when the presence of a person is detected in the detection target space, in step S72, the processing board 224 performs user authentication such as face authentication, for example, and in step S73, determines whether the detected person is a registered user of the display device 1. If the processing board 224 determines that the person photographed by the imaging unit 227, for example, is a registered user of the display device 1, it determines that the person is not a suspicious person. On the other hand, if it is determined that the person photographed by the imaging unit 227 is an unregistered user, in step S74, the processing board 224 determines that the person is a suspicious person and executes a predetermined operation. Examples of the "predetermined operation" include an operation to start recording by the imaging unit 227, an operation to issue an alarm at a relatively high volume, an operation to notify a pre-registered security company, and the like. Alternatively, the "predetermined operation" may be an operation in which the character 1100 addresses the suspicious person (for example, "Who!? Say the password!"). Then, if there is no reply from the person determined to be a suspicious person, or if the password is incorrect, the above-described recording start operation or the like may be executed. When the password is incorrect, the processing board 224 outputs a voice such as "That's wrong!? Say it again" as the character voice of the character 1100, and when it is determined again that the password is incorrect, the above-described recording start operation or the like may be executed. By doing so, for example, a suspicious person can be made to retreat from the detection target space, and the crime prevention performance in the detection target space can be enhanced.

[0230] After executing the predetermined operation, when a user of the display device 1 is detected, the processing board 224 may output a voice related to the detection of a suspicious person as the character voice of the character 1100. Examples of the "voice related to the detection of a suspicious person" include "That was scary~". By doing so, the user's attachment to the character displayed on the video display unit can be increased.

[0231] Also, when the detection target space is being monitored using the display device 1, not limited to the detection of a suspicious person, the following operations may be performed.

[0232] For example, the display device 1 may be arranged in the reception space of a company, and the character 1100 may be displayed to perform reception work as a so-called receptionist. Specifically, when the approach of a person in the detection target space (for example, the reception space) is detected by a microwave Doppler sensor (an example of the detection means), the processing board 224 may output voices such as "Welcome. Which department can I help you?" as the character voice of the character 1100. Then, the processing board 224 may be controlled to call the department desired by the visitor based on the response from the detected person (the visitor).

[0233] <Regarding the communication function related to the startup time of the display device 1> In addition, the processing board 224 may be controlled such that the content of the communication changes according to the startup time (for example, the cumulative startup time) of the display device 1 from a predetermined time point (for example, the first startup time) with respect to the choice of words in the character voice of the character 1100. For example, as described below, the processing board 224 may be controlled such that the longer the startup time of the display device 1, the more familiar the character 1100 speaks to the user.

[0234] For example, for various character voices as described above, it is preferable that three patterns of character voices, namely, a polite tone, a speech tone as if the user is in a friendly relationship, and a speech tone as if the user is in a romantic relationship, are registered in the voice management table in advance. Then, for example, when the startup time of the display device 1 from a predetermined point in time is less than 100 hours, the processing board 224 outputs a character voice with a polite tone among the three patterns of character voices registered in the voice management table. Also, when the startup time is 100 hours or more and less than 1000 hours, the processing board 224 outputs a character voice with a speech tone as if the user is in a friendly relationship among the three patterns of character voices registered in the voice management table. Further, when the startup time exceeds 1000 hours, the processing board 224 outputs a character voice with a speech tone as if the user is in a romantic relationship among the three patterns of character voices registered in the voice management table.

[0235] By doing so, the user can feel that the relationship (e.g., intimacy) with the character has changed due to the change in the character's way of speaking to the user himself / herself.

[0236] Note that the processing board 224 may be controlled to reduce the intimacy of the character 1100 with respect to the user depending on the elapsed time since the previous startup. For example, even when the cumulative startup time of the display device 1 exceeds 100 hours, when one week has elapsed since the previous startup, the processing board 224 may output a character voice with a polite tone instead of a speech tone equal to that of the user. In this way, the user will come into contact with the character displayed on the video display unit without leaving an interval as much as possible in order to maintain the intimacy with the character, and the attachment to the character can be further increased.

[0237] In addition, when the processing substrate 224 is started up for the first time, it outputs a greeting voice such as "Nice to meet you" as a character voice, and when a predetermined period (for example, a convenient period such as one month) has elapsed since the first startup, it outputs a voice of content indicating a commemorative day (for example, "It's been one month since we met") as a character voice. By doing so, the attachment to the character 1100 can be further increased.

[0238] <Communication function by cooperation with other devices> Also, for example, when the display device 1 is installed at the user's home or the like, the following operations may be executed by cooperation with other devices. For example, when the user visits a place where a device capable of communicating with the display device 1 (hereinafter referred to as other device) is installed, the other device may identify the user and automatically guide information suitable for the user (for example, gourmet information or event information) as follows. For example, the face image of the user of the cooperation system between the display device and the other device and the display device (for example, IP address or the like) owned by the user are associated and registered in advance in an external server or the like. When a person is detected by a sensor of the imaging unit provided in the other device, for example, the control unit of the other device identifies the user of the display device 1 by comparing the face image of the person detected in the captured image with the face image of the user registered in the external server. Then, the control unit of the other device specifies the display device 1 (for example, the IP address of the display device 1 or the like) registered in association with the user in the external server, and transmits information indicating that the user of the display device 1 has been detected to the display device 1. "Information suitable for the user" (for example, gourmet information or event information) is registered in advance in the processing board 224 of the display device 1, and the processing board 224 transmits the registered "information suitable for the user" to the other device in response to the reception of a signal from the other device. Then, the control unit of the other device outputs the "information suitable for the user" received from the display device 1 (for example, voice output). When guiding the "information suitable for the user", the other device may display the character 1100 on its display screen. Further, information or the like guided to the user may be transmitted from the other device to the display device 1 and accumulated as user information in the processing board 224 of the display device 1. Then, for example, when the display device 1 is installed at the user's home and the user's return home is detected, the processing board 224 may output voices such as "You went there, how was it?" as the character voice of the character 1100. In this way, the user's attachment to the character displayed on the video display unit can be increased.

[0239] <Regarding Other Communication Functions> Furthermore, the following control may be performed based on detection results by various sensors.

[0240] For example, a wind detection means (e.g., a wind sensor) capable of detecting wind (e.g., wind speed) may be provided on the front panel 102 of the display device 1, and the following control may be performed based on the detection result by the wind sensor. The wind may be, for example, assumed to be caused artificially by the user, such as wind generated by moving a body part such as waving a hand toward the display device 1 or wind generated by blowing breath (exhalation). For example, when wind with a wind speed equal to or higher than a predetermined value is detected by the wind sensor, the processing board 224 may display and output an image in which the hair (e.g., hair) or clothes (e.g., skirt) of the character (e.g., character 1100) displayed on the video display unit flutter. Also, for example, when an image of a lit candle is being displayed on the video display unit and wind is detected by the wind sensor, the processing board 224 may switch to an image in which the flame of the candle goes out. Furthermore, when the detected wind is stronger than a predetermined threshold (wind speed is greater than a predetermined threshold), the processing board 224 may switch the image according to the intensity of the detected wind (e.g., wind speed), such as the clothes of the character 1100 fluttering more strongly.

[0241] Further, for example, object detection means (e.g., an ultrasonic sensor) capable of detecting the presence or absence of an object and the distance to the object may be installed in the display device 1, and the following control may be performed based on the detection result by the ultrasonic sensor. For example, when the processing board 224 determines, based on the detection result by the ultrasonic sensor, that the observer's hand is touching the character 1100 recognized as a stereoscopic video, the processing board 224 may display and output a video in which the character 1100 shows a reaction. Further, the processing board 224 may perform display control so as to show different reactions according to the part of the character 1100 touched by the observer. The part of the character 1100 touched by the observer may be, for example, a part of the body such as the head, chest, abdomen, buttocks, or legs. Also, the part of the character 1100 touched by the observer may be the clothing (e.g., a dress, a skirt) or ornaments (e.g., accessories) of the character 1100.

[0242] Further, for example, earthquake detection means (e.g., a seismic sensor) capable of detecting an earthquake and measuring the seismic intensity may be provided in the display device 1, and when an earthquake is detected by the seismic sensor, the processing board 224 may issue an earthquake warning.

[0243] Further, for example, a weather sensor capable of measuring the weather may be provided in the display device 1, and the processing board 224 may notify changes in the weather, weather forecasts, etc. based on the measurement result by the weather sensor. The weather sensor may have, for example, a barometric pressure sensor, a temperature sensor, and a humidity sensor, and may be configured to measure the weather based on the detection results of each sensor.

[0244] Further, the processing board 224 may display a video in which the expression and movement (also referred to as motion) of the character displayed on the video display unit change according to the temperature detected by the temperature sensor or / and the humidity detected by the humidity sensor.

[0245] Further, the processing substrate 224 may display a video in which the expression and movement of the character displayed on the video display unit change according to the detection result (for example, the distance between the display device 1 and the observer) by a human presence sensor such as a microwave Doppler sensor.

[0246] Further, the processing substrate 224 may use a humidity sensor to determine whether or not the user has blown air. Furthermore, the processing substrate 224 may also use a temperature sensor to determine the type of air blown by the user. Note that these sensors may be provided in the display device 1 as, for example, the second sensor 2332.

[0247] Here, there are two types of air blown by the user, for example, the air blown with "whoosh" and the air blown with "ha". Generally, when blowing cold air, the air is blown quickly with "whoosh", so here, the air blown with "whoosh" is referred to as "cold air". Also, generally, when blowing warm air, the air is blown slowly with "ha", so here, the air blown with "ha" is referred to as "warm air".

[0248] Regarding these two types of air, the inventor of the present application obtained the following findings through experiments and the like. Specifically, first, regarding humidity, when blowing "whoosh" air toward the temperature and humidity sensor (for example, a sensor in which a temperature sensor and a humidity sensor are integrated) at a position a certain distance away from the temperature and humidity sensor, a measurement result was obtained that the humidity rapidly increases from the steady state immediately thereafter. Also, thereafter, the humidity monotonically increases while blowing air, and when the blowing of air stops, it takes several tens of seconds to return to the original steady state, as measured. The same measurement results were obtained when blowing "ha" air toward the temperature and humidity sensor under the same conditions. On the other hand, regarding temperature, when blowing "whoosh" air, the temperature slightly decreases from the steady state or remains almost horizontal, and when blowing "ha" air, the temperature rises, as measured. Note that the air blown by the user onto the display device 1 is an example of the wind hitting the display device 1.

[0249] In consideration of such findings, etc., for example, in the display device 1 provided with a humidity sensor, when the humidity sensor detects that the humidity has rapidly increased from a steady state, the processing substrate 224 may determine (also referred to as a decision) that the observer has blown air. Further, when it is subsequently detected that the humidity no longer increases monotonically, the processing substrate 224 may determine that the blowing of air has stopped. Alternatively, when a predetermined time (for example, the time required to exhale normal breath (for example, about 3 seconds)) has elapsed since the rapid increase in humidity was detected, the processing substrate 224 may determine that the blowing of air has stopped regardless of the humidity detection result at that time.

[0250] Furthermore, when the humidity sensor detects a rapid increase in humidity and, at the same time (for example, at approximately the same timing), the temperature sensor detects that the temperature has increased from a steady state, the processing substrate 224 may determine that the type of breath blown by the observer is "warm breath". Conversely, when the humidity sensor detects a rapid increase in humidity and the temperature sensor detects that the temperature has not changed from a steady state or has decreased from a steady state, the processing substrate 224 may determine that the type of breath blown by the observer is "cold breath".

[0251] Then, the processing substrate 224 may output video and audio corresponding to the detection of the blowing of air as the movement of the character and the character voice displayed on the video display unit. Also, the processing substrate 224 may output video and audio corresponding to the type of breath blown as the movement of the character and the character voice displayed on the video display unit. For example, when the type of breath blown by the observer is "cold breath", the processing substrate 224 may display and output a video of the character's clothes fluttering, and when the type of breath blown by the observer is "warm breath", the processing substrate 224 may display and output a video of the character making a movement to avoid the breath.

[0252] In addition, the inventor of the present application has also obtained the following findings using various gas sensors. Specifically, when blowing air towards the gas sensor at a position approximately a certain distance (e.g., about 10 cm) away from the gas sensor, the output value of the gas sensor decreases immediately after that, and when the blowing stops, the output value of the gas sensor immediately turns upward. On the contrary, when blowing air towards the gas sensor with a "ha" sound, the output value of the gas sensor increases immediately after that, and when the blowing stops, the output value of the gas sensor immediately turns downward. Also, for example, when the air sent from a blower (e.g., a fan) hits the gas sensor, the output value of the gas sensor decreases, and when the air from the fan no longer hits the gas sensor, the output value of the gas sensor increases.

[0253] In consideration of such findings, for example, in the display device 1 provided with a gas sensor, when the output value of the gas sensor rapidly decreases from the steady state, it may be determined that the type of breath blown by the observer is "cold breath". On the contrary, when the output value of the gas sensor rapidly increases from the steady state, it may be determined that the type of breath blown by the observer is "warm breath".

[0254] It is also possible to adopt a configuration that detects breath using a wind sensor. The inventor of the present application has confirmed that according to the wind sensor, it is sometimes possible to detect a relatively weak wind such as the wind when lying on paper, and when blowing breath on the wind sensor, it immediately reaches a peak, and the responsiveness when the wind starts blowing is good. However, if blowing breath continuously, it immediately drops from the peak. It is conceivable that a strong wind such as a puff of breath cools the heater and takes time to recover.

[0255] Regarding the configuration for detecting breath using a wind sensor, the following configuration may be adopted.

[0256] When the processing substrate 224 continuously detects a predetermined air volume by the wind sensor, it may perform processing in a direction where it is not being blown on. The processing in a direction where it is not being blown on is, for example, processing to determine that no breath is being blown. In this case, when the time from the start to the end of wind detection by the wind sensor is within the time when blowing is possible, the processing substrate 224 may perform processing in the direction where it is being blown on.

[0257] In this case, the wind sensor may be a sensor that detects wind by electrically measuring the heat taken away by the wind. In this sensor, the wind received by the sensor corresponds to the air volume of the blown breath. This sensor is set to drop to a value less than the actual air volume during the duration when the wind received by the sensor lasts for a time corresponding to the time of the blown breath, and it is preferably set so that this drop is less likely to occur when the wind received by the sensor is less than the air volume of the blown breath.

[0258] In the display device 1, a flow path for allowing the inflow of wind with a common breath inflow path may be provided for a plurality of wind sensors as the wind sensors. The flow path may be configured such that wind enters different wind sensors at a predetermined ratio that is not 1:1. The processing substrate 224 may determine the magnitude and time of the blown breath based on the ratio and the differences in the characteristics of the plurality of wind sensors. The display device 1 includes a plurality of wind sensors with different timings of dropping to a value less than the actual air volume during the duration, and the processing substrate 224 may determine the magnitude and time of the blown breath based on the outputs of the plurality of wind sensors. The display device 1 may at least include a wind sensor that is not a gas sensor and a gas sensor as the plurality of wind sensors.

[0259] Also, it is preferable to use a gas sensor for detecting a predetermined gas as the wind sensor. As the wind sensor, it is preferable to use a gas sensor for detecting a predetermined gas and including a heater. In this case, the gas sensor including the heater outputs in a direction in which the gas detection amount increases when the degree of blowing is relatively small (as a result of detecting the gas contained in the breath), while outputs in a direction in which the gas detection amount decreases when the degree of blowing is relatively large (due to the cooling of the heater by the wind of the breath).

[0260] When the processing substrate 224 determines that breath is being blown, when the strength is relatively large (for example, when the air volume is equal to or greater than the threshold), an animation that moves the clothes, hair, etc. of the character 1100 is displayed, while when the strength is relatively small, an animation different from the animation that moves the clothes, hair, etc. of the character 1100 is displayed.

[0261] By the way, when using a gas sensor for detecting breath, the gas sensor outputs the above output value in response to a component (for example, carbon dioxide) contained in human breath. The reason why the output value of the gas sensor is different when "hoo" breath is blown and when "haa" breath is blown is that when "hoo" breath is blown, the speed of the blown breath is high and it easily diffuses around immediately after colliding with the gas sensor, while when "haa" breath is blown, the speed of the blown breath is low and the components of the breath tend to remain at the place after colliding with the gas sensor.

[0262] Furthermore, the processing substrate 224 may determine whether the detected wind is caused by the observer's blowing or by a blower, for example, using the detection result of humidity by a humidity sensor. For example, in the display device 1, when the output value of the gas sensor rapidly decreases from the steady state and the humidity sensor detects that the humidity has rapidly increased from the steady state, the processing substrate 224 may determine that the user has blown air. On the other hand, when the output value of the gas sensor rapidly decreases from the steady state but the humidity remains in the steady state, the processing substrate 224 may determine that the air is being sent by the blower. Furthermore, when it is determined that the user has blown air, the processing substrate 224 may also use the detection result of temperature by a temperature sensor to determine the type of the breath. Also, when the increase and decrease of the output value of the gas sensor are repeated within a relatively short fixed period, the processing substrate 224 may determine that the air is hitting the swinging fan.

[0263] Note that the wind sensor, humidity sensor, temperature sensor, temperature and humidity sensor, and gas sensor used for detecting wind are examples of wind detection means. The display device 1 may have a barometric pressure sensor as a sensor for detecting wind. This is because a change in barometric pressure can occur due to the generation of wind and its intensity.

[0264] Various controls as described above can be executed. Note that the above-described control is not limited to the character 1100, and may be performed on the communication function related to other characters (for example, the character 1200).

[0265] <7. Specific examples of the video displayed by the display device 1> Next, with reference to FIGS. 41 to 55, a specific example of the video displayed by the display device 1 will be described. FIGS. 41 to 55 are diagrams showing an example of a character (a video including the character 1200 described in FIGS. 1B and 1C) displayed on the display device 1. Each video shown in FIGS. 41 to 55 is an image that is displayed on the display device 1 and can be observed by an observer through the observation region SC. Although the stage video 2200 is displayed in FIGS. 41 to 55, the character 1200 may be displayed without displaying this.

[0266] FIGS. 41 to 47 are displays performed by the display device 1 during a period of waiting for the operation of the observer based on the communication function. The display device 1 (specifically, the processing substrate 224) performs the following-described displays by switching them regularly or randomly. For example, as shown in FIG. 41(a), the character 1200 is displayed in a posture standing facing the front side (observation side) of the display device 1. The display device 1 may use this posture as a basic posture and also as a display during a period when communication based on the communication function is not being performed. For example, as shown in FIG. 41(b), the character 1200 makes an action of licking its front leg. For example, as shown in FIGS. 41(c) and 42(a), the character 1200 makes an action of alternately looking left and right of itself. For example, as shown in FIG. 42(b), the character 1200 makes an action of facing the direction of the ground. For example, as shown in FIG. 42(c), the character 1200 makes an action of stretching while sitting. For example, as shown in FIG. 43(a), the character 1200 makes an action of peeking into the ground. Further, for example, as shown in FIGS. 43(b) and 43(c), the character 1200 makes an action of walking on the front side. When the display device 1 causes the character 1200 to make a walking action, it may display a video in which the character 1200 stamps its feet on the spot and does not substantially move the overall position of the character 1200 without displaying the stage video. When the character 1200 performs an action other than the walking action, the display device 1 may display the stage video at the feet of the character 1200.

[0267] For example, as shown in FIG. 44(a), the character 1200 makes a motion of peering into its own abdomen. For example, as shown in FIG. 44(b), the character 1200 makes a motion of tilting its neck. For example, as shown in FIG. 44(c), the character 1200 makes a motion of rubbing its own eyes. For example, as shown in FIG. 45(a), the character 1200 makes a motion of yawning. For example, as shown in FIG. 45(b), the character 1200 makes a motion of licking its front legs while sitting. For example, as shown in FIG. 45(c), the character 1200 makes a motion of looking diagonally forward to its left. As shown in FIGS. 46(a) and (b), the character 1200 makes a stretching motion. For example, as shown in FIG. 46(c), the character 1200 makes a motion of peering into the ground. As shown in FIG. 47(a), the character 1200 faces in the direction diagonally forward to the right of the display device 1, and then as shown in FIG. 47(b), it faces forward. As shown in FIG. 47(c), the character 1200 makes a motion of licking its front legs.

[0268] FIGS. 48 to 55 are an example of the display of the character 1200 performed by the display device 1 (specifically, the processing substrate 224) during the dialogue processing in the communication function. The character strings shown in FIGS. 48 to 55 are character strings recognizable by voice recognition and are displayed above the character 1200. It is preferable that the phrase (sentence) recognized by voice recognition is displayed for a predetermined time after the voice recognition and is made non-displayed after the elapse of the predetermined time. Then, it is preferable that the character 1200 is controlled to speak after the phrase (voice recognition result) is made non-displayed.

[0269] FIG. 48(a) is what is displayed when the display device 1 recognizes the observer's speech of "come here, come here~", and in response to this, voice is output. FIGS. 48(b) to 49(b) are what are displayed when the display device 1 recognizes the observer's speech of "sit down", and in response to this, voice is output. FIG. 49(c) is what is displayed when the display device 1 recognizes the observer's speech of "are you hungry?", and in response to this, voice is output. FIG. 50(a) is what is displayed when the display device 1 recognizes the observer's speech of "policeman", and in response to this, voice is output. FIGS. 50(b) and (c) are what are displayed when the display device 1 recognizes the observer's speech of "it's snack time", and in response to this, voice is output. FIG. 51(a) is what is displayed when the display device 1 recognizes the observer's speech of "hand", and in response to this, voice is output. FIGS. 51(b) to 52(b) are what are displayed when the display device 1 recognizes the observer's speech of "so cute", and in response to this, voice is output. When the display device 1 displays the character 1200 at a position other than the center of the stage video (for example, a position on the front side), when rotating the character 1200, the stage video 2200 may be rotated in the same manner as the character 1200. Further, the display device 1 may display a stage video 2200 having a shape with a relatively large distance in the depth direction, and display a video (for example, a video in which a cat character walks along the outer edge of a circular stage) in which the character 1200 is moved along the outer edge of the stage video 2200 inside such a stage video 2200.

[0270] FIG. 52(c) is what is displayed when the display device 1 recognizes the observer's utterance of "Hello", and in response, voice is output. FIG. 53(a) is what is displayed when the display device 1 recognizes the observer's utterance of "Eat rice", and in response, voice is output. FIGS. 53(b) and (c) are what are displayed when the display device 1 recognizes the observer's utterance of "Is it a girl?", and in response, voice is output. FIG. 54(a) is what is displayed when the display device 1 recognizes the observer's utterance of "Wait", and in response, voice is output. FIG. 54(b) is what is displayed when the display device 1 recognizes the observer's utterance of "What a good child~", and in response, voice is output. FIGS. 54(c) and 55 are what are displayed when the display device 1 recognizes the observer's utterance of "Uno", and in response, voice is output.

[0271] <8. More detailed description of character 1200> The character 1200 described with reference to FIGS. 1B, 1C, and FIGS. 41 to 55 will be described in more detail. In the following description, for the description with the display device 1 as the processing subject, it may be regarded as the processing performed by the processing board 224. The character 1200 is preferably drawn at approximately life size. By doing so, it has been found that the sense of depth is particularly emphasized. The display device 1 preferably draws the character 1200 such that, when viewed from the side (horizontal side), in the vertical direction, the head occupies approximately one-third, the torso occupies one-third, and the legs occupy one-third of the height. For the character 1200 except for the tail, the display device 1 preferably draws it such that, when viewed from the side in the left-right direction, the head occupies approximately one-third and the torso occupies two-thirds.

[0272] The display device 1 has a function of drawing a displacement between a state where the tail is not visible and a state where the tail is visible with a face in the front. It is preferable that the time when the tail is visible is shorter than the time when the tail is not visible. The tail will be drawn on the back side of the head, but sometimes the visibility of the tail can greatly enhance the sense of three-dimensionality, and constantly feeling a strong sense of three-dimensionality can prevent eye and head fatigue. In particular, the display device 1 preferably performs such drawing processing in the voice recognition standby state. When the display device 1 is displaced to the state where the tail is visible, it is preferable that the display device 1 has a function of drawing the tail emerging from the top of the head. In this way, usually, when the observer's line of sight is on the eyes of the face and the tail suddenly pops out above the head from the upper center thereof, it can give a sense of surprise and interest.

[0273] The display device 1 may be provided with a flat portion on the top of the head of the character 1200 when viewed from the front, and in particular, the head portion between the left and right ears may be drawn flat when viewed from the front. By doing so, a tail with a three-dimensional effect suddenly appears from the flat top of the head with a weak three-dimensional effect, which can provide more surprise and interest. Also, after drawing the tail so that it appears from above the head, the display device 1 may perform drawing to move the portion closer to the tip of the tail. By doing so, the viewpoint can be focused on the portion of the tail behind the face, and a stronger three-dimensional effect can be felt. The display device 1 may similarly draw the tail so that it appears from the left and right sides of the body. When the display device 1 causes the tail to appear from the left and right sides, the length and / or time of the appearance of the tail may be shortened compared to the case where the tail appears from above the head. When the display device 1 causes the tail to appear from the left and right sides, it may perform drawing so that the tail appears intermittently. The display device 1 may also perform drawing to move the line of sight to the back side from time to time, which can make the three-dimensional effect more perceptible. While the tail appears from above the head during voice recognition, the display device 1 may perform drawing so that the tail appears from either the left or right direction when outputting voice from the cat. The display device 1 may be provided with a portion on the tail that has a drawing mode different from other portions at predetermined intervals in the longitudinal direction. For example, a pattern with a predetermined width may be attached in a circular or arc shape on the cylindrical surface of the tail at regular intervals. By doing so, the inventors have found that the movement of the tail can be felt to move more dynamically in three-dimensional space.

[0274] When performing voice recognition, the display device 1 may perform drawing to change the current posture to the same posture when there is a change from a state where voice recognition is not being performed to a state where voice recognition is in progress so as to be in the same posture. Before starting voice recognition, the display device 1 may cause the character to say "Let's talk, nya". The display device 1 may be equipped with a function (such as a sensor or a switch) for detecting the actions of the observer, and may be equipped with a function of saying "What's that, nya?" when detecting an action from the observer. Both functions may be continuously executed in the form of "What's that, nya?" and "Let's talk, nya", and then the process may be performed to enter the voice recognition state.

[0275] The display device 1 has information on phrases such as "so cute" that are praised as speech recognition phrases. When a phrase of praised content is recognized, it is advisable to change the body posture. Furthermore, it is even better to move the position of the cat itself, such as walking. By doing so, since the observer wants to see the changes in the cat's posture and movement, they will take praising actions and words, and excellent effects of therapy such as improving actions and words can be obtained.

[0276] The display device 1 has a speech recognition phrase corresponding to giving food. When the phrase is recognized, it is advisable to perform a drawing of wagging the tail faster than in other cases. By doing so, it is possible to give the observer a feeling as if the cat is more actually alive.

[0277] The display device 1 may perform drawing processing with the outline of the cat's eyes generally circular and the black eye part vertically elongated elliptical. The display device 1 may draw the black eye part with a shading gradient in the vertical direction and draw it in a lighter color as it goes downward. The display device 1 may provide a part darker than the periphery of a generally circular or elliptical shape at the center of the black eye. The display device 1 may provide and draw a crescent-shaped or semi-circular white area along the outer edge of the black eye at the outer part of the face near the upper part of the black eye part. On the other hand, the display device 1 may provide and draw a circular white area at the position near the center of the face below the black eye. The display device 1 may continue to draw this white area even when there is a change in the position of the character 1200 (such as a change in posture), or a change in the position of the camera or light. Usually, highlights are often entered by calculation as reflections of light or the like. However, by doing so, the individuality of the cat's eyes, which is most seen during speech recognition conversations, can be emphasized, and as an individual cat, an impression can be made in a short time of performing speech recognition.

[0278] The display device 1 takes a state where the face is facing forward and a state where the face is facing downward. When the face is facing forward, the outline of the eyes is drawn generally circular, while when the face is facing downward, the eyes are drawn horizontally elongated elliptical.

[0279] The display device 1 takes two states: one where the upper end of the face is above the upper end of the body, and the other where the upper end of the face is below the upper end of the body. When the upper end of the face is above the upper end of the body, the outline of the eyes is generally drawn in a circular shape, while when the upper end of the face is below the upper end of the body, the eyes may be drawn in a horizontally elongated elliptical shape. The display device 1 has a function of drawing a state of yawning with the mouth open, and when drawing this, it is advisable to draw the eyes closed.

[0280] The display device 1 may prepare a plurality of patterns of standby motions for the character 1200 and repeat the process of selecting one pattern from these patterns and drawing it. Examples of standby motions include motions of licking the feet, stroking the face with the hand, licking the buttocks, facing forward, looking around left and right, licking the ground, stretching, yawning, walking motions, etc.

[0281] The display device 1 may draw the ears so that they move with a delay relative to the movement of the face. For example, even when the face starts to move, the ears may be drawn to maintain their position for a while. The display device 1 may be equipped with a function of simultaneously performing a motion of wagging the tail from side to side when performing a licking motion. When the character 1200 is viewed from the front, the pattern on the body of the display device 1 may be asymmetrical left and right. In this way, it becomes easier to remember as an individual cat, and it also becomes easier to determine whether the right side or the left side is visible. This is particularly useful when providing a scene where the overall image of the character 1200 is enlarged so that it cannot be seen in its entirety. In particular, the pattern is preferably that of a calico cat, and especially that of a tiger cat. The inventors have found that this makes it particularly easy to grasp the three-dimensional effect. In particular, the pattern on the head is provided in the front-rear direction, while the pattern on the body is provided in the up-down direction, etc., and the directions of the patterns may be different. In this way, even when the position of the camera or the cat changes in any direction, it becomes easier to recognize.

[0282] The display device 1 is configured to have a function of emitting a meowing sound, and the meowing sound includes multiple intonations, and different motions are associated with each meowing sound. It is preferable that among the intonations, there is an interrogative intonation, and as a motion, it is preferable to have a motion of tilting the head.

[0283] <9. Regarding the communication function of Character 1200> Supplement regarding the communication function of Character 1200. By doing the following, a higher-quality communication function with Character 1200 can be provided to the observer. Here, the actions of the person until they get used to the pet and the outline of the action story with Character 1200 will be described. In this embodiment, as shown in FIG. 32, a photographing unit 227 for photographing the observer is provided on the front side of the display device 1.

[0284] (9-1) First step: The stage until getting used to Normally, there are various types of cats such as stray cats that run away just by seeing a person or run away when a person approaches. At that time, the cat's behavior seems to run away while looking at the person while looking back several times. Here, the processing board 224 recognizes the presence of the observer based on the photographed image taken by the photographing unit 227, and when the intensity (received intensity) of the microwave measured by the human sensor 234 exceeds the threshold value, a video showing the Character 1200 performing an escaping motion is displayed. This is to consider that a person has approached the cat. Recognizing the observer by the photographing unit 227 is to show the observer the scene where the Character 1200 runs away. That is, unless the observer approaches the display device 1 from the front side, the Character 1200 is prevented from performing an escaping motion.

[0285] Next, it is considered that a person calls out to a cat, saying "Squat down (lower your eye level)", "Come here, come here", etc. Sometimes, there is a cat that stops and observes the situation. However, when a person approaches, the cat runs away. This is repeated several times. With such human behavior, it is thought that the cat will not get used to it. Therefore, during the period when the character 1200 is shown running away on the display of the processing board 224, when the intensity of the microwave measured by the human sensor 234 is equal to or less than a certain threshold value, and when a word indicating calling out to the character 1200, such as "Come here", is recognized by voice recognition, a video showing an action for the character 1200 to stop is displayed. Here, the condition that the intensity of the microwave is equal to or less than the threshold value is because a state where a human stops is assumed.

[0286] Next, it may be considered that a person gives food to a stationary cat. However, when a person approaches the cat, the cat runs away, so it is considered that the only option is to place food in a place where the cat often comes. Therefore, the display device 1 has a function of displaying an image in which food is placed within the video display space. For example, when the processing board 224 receives a predetermined operation using the operation area OT (for example, an operation of the operation unit 2214), or when a predetermined gesture indicating to place food is detected by the first sensor 2231, it is assumed that food has been placed, and an image showing the food is displayed in the video. This video may be displayed using either the first display unit 310 or the second display unit 330. In this way, the observer will, for example, place food every day. At this time, the processing board 224 may preferably display a scene where the character 1200 is looking at the situation from a distance. When the processing board 224 does not recognize the presence of the observer using the human sensor 234 and the observer is not photographed by the photographing unit 227, the processing board 224 displays an image in which the character 1200 eats the food. Here, a situation where the cat does not eat the food in front of people is reproduced. From the perspective of the observer, a situation is created where the food has disappeared without them noticing. The processing board 224 counts the number of times the observer has given food and stores it. This state continues for a while, but the processing board 224 may preferably display an image that gradually reduces the distance between the observer, the character 1200, and the person (the distance felt by the observer) according to the number of times food has been given. For example, when starting to give food, as the number of times food has been given increases, the processing board 224 may display the character 1200 larger to reproduce the reduction in distance (that is, the person is getting a bit more used to it). Furthermore, when the number of times food has been given increases and reaches a predetermined threshold, assuming the cat has become accustomed, even when the observer is looking at the character, that is, when the processing board 224 recognizes the presence of the observer using the human sensor 234 and the observer is photographed by the photographing unit 227, the processing board 224 displays an image in which the character 1200 eats the food. Only at this time can the observer observe the character 1200 eating the food.

[0287] However, it is not uncommon for people not to know when a cat eats its food. Therefore, the processing board 224 may determine the time period (alternatively, it may be a specific moment in time) when the character 1200 eats its food, and cause the character 1200 to perform the action of eating its food during that time period. This is to make the observer notice that it seems the character eats its food during this time period. When it is detected that the observer tries to touch the character 1200, the processing board 224 causes the character 1200 to output a voice of a predetermined utterance content "shar" or "shar shar", and causes the character 1200 to perform an escaping action. The fact that the observer tries to touch the character 1200 may be identified by the intensity of the microwave detected by the human sensor 234 exceeding a threshold value when the character 1200 is performing the action of eating its food, or by the first sensor 2331 detecting a predetermined gesture.

[0288] Such a situation continues for a while, but the processing board 224 may gradually reduce the distance at which the observer's hand can approach the character 1200. When it gets close to a predetermined distance, the processing board 224 may display an image of the character performing an action of grooming or relaxing in front of people, assuming that the character 1200 has become accustomed to the observer. Specifically, the processing board 224 increases the threshold value for the intensity of the microwave, or increases the threshold value for the distance from the display device 1 when a gesture is performed. In this way, the processing board 224 reduces the detection sensitivity, dulls the reaction of the character 1200 to the movement of the observer, and stops causing the character 1200 to make utterances such as "shar" or "shar shar".

[0289] The cat is always vigilant, but also engages in actions such as grooming, lying down, scratching its claws, and wiping its face. As the cat gradually gets used to people and human hands, people will be able to touch the cat with their hands. Therefore, the processing board 224 may not reflect the microwave detection result by the human sensor 234 in the operation of the character 1200. The processing board 224 may function the first sensor 2331 as a motion sensor and display an image that makes the character 1200 seem comfortable when stroked according to the detection result of gestures in the up, down, left, right, front, and back directions of the observer. The processing board 224 may further recognize the voice of the observer by the microphone 2333 and display an image in which the character 1200 reacts to this. For example, the processing board 224 may make the character utter a meowing sound of "nya" as the uttered content regardless of what words are recognized.

[0290] As time passes, the processing board 224 may display an image in which the character 1200 begs for food. When the imaging unit 227 recognizes the presence of the observer and the human sensor 234 detects the presence of the observer, the processing board 224 may determine a time zone (for example, morning, noon, evening) and make the character utter a meowing sound of "nya-nya" and display an image of the character rubbing its face. Further, when the observer talks to the character 1200, the processing board 224 may reproduce the state in which the character 1200 remembers its own name. For example, the processing board 224 may react only to the word "Yuno" and make the character utter a meowing sound of "nya", or react to calls such as "Yuno" and "There's food" and display an image of the character acting coquettishly or rubbing itself happily.

[0291] (9-2) Second step: The stage of learning the language (Japanese) When the processing board 224 recognizes a call from an observer named "Uno" at a certain time, it outputs a voice showing a response of "What?". From here, it enters the stage where the character 1200 learns words. The processing board 224 counts the number of times it has been called, takes the cumulative average per day, and makes a response according to a value calculated by the cumulative average per day of the number of times food has been given × the cumulative average of the number of times it has been called × a random coefficient (hereinafter referred to as the "cumulative average value"). This call is a predetermined call such as "Good morning", "Hello", "Good evening", "Are you okay?", "Do you want food?", etc. The processing board 224 stops responding (that is, reproduces the situation where the character 1200 has forgotten words) or increases the words it responds with according to the cumulative average value. For example, the processing board 224 may decrease the words it responds with as the cumulative average value gets smaller, and increase the words it responds with as the cumulative average value gets larger. The cumulative average value is calculated based on the number of times it has been called from the start time of using the display device 1 to the current time, but it may also be calculated based on the number of times it has been called from a time point retroactively a predetermined period in the past to the current time. The predetermined period may be fixed, such as one month, or when the display device 1 has not been used for a certain period, it may be the period after the start of use after that period. At the beginning when the use of the display device 1 starts, the cumulative average value can change greatly. For example, if the observer does not call even once a day, the character 1200 may stop responding, but as the number of calls increases, the cumulative average value changes less. In this way, it is possible to reproduce the state where it takes time for the character 1200 to forget words. The random coefficient used in calculating the cumulative average value is a value for reproducing the capriciousness of a cat and may be called a capriciousness coefficient. The random coefficient may be changed by the actions of the character 1200 and the observer, such as giving food or not giving food when the character 1200 begs for food, or taking actions such as calling or touching to wake up when the character 1200 is sleeping.

[0292] When the cumulative average value further exceeds a certain threshold, the processing substrate 224 may be configured to start a conversation with the observer from the character 1200 or respond to questions regarding predetermined information such as weather, news, etc. Of course, when the number of times the observer feeds the character decreases, the cumulative average value also decreases, so the processing substrate 224 may reduce the type of response or stop responding altogether. That is, if the observer feeds the character haphazardly or does not appropriately initiate a conversation, the function for the character 1200 to respond may not be maintained, or even if it is maintained, there may be cases where the character does not respond "erratically" as described above. In this way, a higher-quality communication function with the character 1200 can be provided to the observer.

[0293] [Other Embodiments] The present disclosure is not limited to the above-described embodiments and can be appropriately modified without departing from the spirit thereof.

[0294] The display device 1 may include an operation reception means such as a touch sensor, proximity sensor, or other means for receiving operations from the observer in the observation area SC. In this way, the observer can perform operations using the observation area SC. For example, if such an operation method is adopted in the communication function, it is expected to enhance the quality of communication with the character that can be observed through the observation area SC.

[0295] The first display unit 310 may display an image recognized as a three-dimensional video (stereoscopic video). In this way, it is expected to further enhance the stereoscopic effect given to the observer. As the display method, in addition to the autostereoscopic display methods such as the lenticular lens method and the parallax barrier method, a display method that can be recognized as a three-dimensional video using glasses may also be used.

[0296] The display device is not limited to a rectangular parallelepiped shape, and may be a cube, a cylinder, other polyhedra, a spherical shape, or other shapes. Also, the shapes, structures, dimensions, colors, patterns, etc. of the respective components of the display device 1 described above are merely examples. Also, some of the components included in the display device 1 described above may be omitted, or other components may be added. For example, the second display unit 330 may be omitted, or the second display unit 330 that emits the second image light L2 in the first direction side may be arranged in a standing state instead of the background plate 910. Also, aerial imaging may be realized using an optical system other than that described with reference to FIG. 13. Also, the configuration of the present invention may be applied to a display device of a display method or a projector method instead of the aerial imaging method. In the case of the display method, a display such as a liquid crystal display, an organic EL display, or other display methods is used as the video display unit. For example, as the video display unit, a display unit provided inside the video display space and having a display surface (for example, a display surface parallel to the observation region SC) facing the direction of the observation region SC may be used. This display unit may have the same configuration as the first display unit 310 or the second display unit 330 and may be provided on the back surface portion of the video display space. In the case of the projector method, a projection surface and projection means for projecting an image thereon may be used. Also, the light shielding member 200 may be arranged on the front side or the back side of the opening 110 to reduce the light entering the video display space from the outside. Also, if the video display space S1 is maintained in a relatively dark state, a configuration in which the light shielding member 200 is not provided may also be considered.

[0297] Also, in the above embodiment, voice recognition for interacting with the character displayed on the video display unit is activated in response to the pressing operation of the operation unit 2214, but it is not limited to this. For example, when the presence of a person is detected in the detection target area of a human sensor (an example of detection means) such as an omnidirectional microwave Doppler sensor, the processing board 224 may activate the voice recognition. In this way, when the user interacts with the character displayed on the video display unit, for example, there is no need to perform an operation for activating the voice recognition or to utter a trigger word, and communication can be reproduced more naturally.

[0298] At this time, for example, it is preferable that both voice recognition in the voice recognition application in the display device 1 and voice recognition in the voice recognition server are enabled. However, as described below, the activation of voice recognition in the voice recognition application in the display device 1 and the activation of voice recognition in the voice recognition server may be executed step by step. For example, when the presence of a person is detected in the detection target area such as the human sensor, voice recognition in the voice recognition application in the display device 1 is activated, and then, when a greeting or a call by an observer is detected by the voice recognition application, voice recognition in the voice recognition server may be activated.

[0299] In addition, when the display device 1 includes an imaging unit (an example of a detection unit) such as a camera, a detection target space is provided on the front side of the display device 1, and the processing board 224 may be configured to activate voice recognition when the presence of a person is detected on the front side of the display device 1. In this way, it is possible to more reliably determine that the observer is trying to talk to the character displayed on the video display unit and then activate voice recognition.

[0300] Furthermore, after a person is detected in the detection target area, it is preferable that the processing board 224 is configured to activate the voice recognition on the condition that user authentication is successful. Note that the authentication method for user authentication may be, for example, an authentication method that does not require a user's manual operation (such as face authentication or vocal cord authentication). In this way, for example, when user authentication is performed on a person other than the registered user registered in the display device 1 and the user authentication fails, voice recognition is not activated and the user cannot talk to the character displayed on the video display unit. Conversely, for a person other than the registered user, the character displayed on the video display unit does not show a reaction. Thereby, the user's attachment to the character can be increased.

[0301] In addition, when voice other than the words pre-registered in the display device 1 or the dialogue server mounted on the external server is detected, voice recognition may not be activated.

[0302] In addition, as a means for enabling voice recognition, a smell sensor may be used. For example, the smell of the registered user of the display device 1 may be registered in the display device 1 in advance, and when the smell of the registered user is detected by the smell sensor, voice recognition may be enabled.

[0303] Also, even if voice recognition is enabled in this way, for example, instead of immediately outputting the voice of the character (e.g., character 1100) displayed on the video display unit, it is preferable that the voice of the character is not output unless there is an utterance from the user. For example, in response to the activation of voice recognition, the processing board 224 does not immediately output a character voice such as "Welcome home", but outputs a character voice such as "Welcome home" on the condition that a user voice such as "I'm home" is detected while voice recognition is enabled. Furthermore, for example, in an interactive system, it is preferable that a branching scenario for reproducing the following interaction between an observer and a character (e.g., character 1100) is created. For example, on weekdays, User: I'm home Character: Welcome home~ User: Achoo Character: You must be tired in the hot weather An interaction like this is reproduced, and on holidays, User: I'm home Character: Ah, welcome home User: Achoo Character: Don't complain since you went out in the hot weather User: It's work, it's work Character: If that's really the case, sorry, you must be tired It is preferable that a branching scenario is created so that an interaction like this is reproduced.

[0304] Also, a branching scenario according to the detection result by the smell sensor may be created. For example, User: I made delicious food~ Character: "Hmmm, let me smell. Kun kun. It has a nice smell!" or "Hmmm!? Isn't it too salty? Be careful with your body!" Dialogue like this may be reproduced.

[0305] Also, as another example, when a smell is detected by a smell sensor, Character: Kun kun, hmm? What's this smell? User: I burned some aromatherapy. Character: Ah, no wonder I thought I'd feel relaxed. Dialogue like this may be reproduced. If the observer's response content to the question about the type of smell is not registered in the branching scenario, for example, a voice such as "Oh, really!" may be uniformly output as the character voice.

[0306] Also, the processing board 224 may always record the voice for a recent predetermined time (for example, about 15 seconds), and when the voice of a trigger word for enabling voice recognition is detected, enable the voice recognition. For example, the voice recognition application of the display device 1 may be always (or in response to a pressing operation of the operation unit 41, etc.) enabled, and the voice recognition by the voice recognition server may be enabled by the detection of the trigger word. At this time, the processing board 224 may transmit the voice data of the voice excluding the voice of the trigger word from the detected voice (for example, the voice detected between the detection start time and the detection end time) detected by the microphone 2333 (an example of a voice detection means) to the voice recognition server. For example, assume that user voice such as "I'm going to Tokyo tomorrow, but please tell me the weather, Raytan" is detected. Here, "Raytan", which is the pet name of the character 1100, is the trigger word. In this case, the processing board 224 transmits the voice "I'm going to Tokyo tomorrow, but please tell me the weather, Raytan" excluding the voice of the trigger word "Raytan" from the detected voice "I'm going to Tokyo tomorrow, but please tell me the weather, Raytan" to the voice recognition server.

[0307] Here, for example, if the detected voice such as "I'm going to Tokyo tomorrow. Please tell me the weather, Raytan" is sent to the speech recognition server as it is, due to the inclusion of "Raytan" in the speech recognition result, the character voice corresponding to the speech recognition result may not be accurately extracted in the dialogue server, and there is a risk that the dialogue with the user will not mesh properly. On the other hand, if it is done as described above, even when the trigger word is uttered in the middle of a sentence, the voice data of the voice excluding the trigger word is sent to the speech recognition server. Therefore, it is possible to suppress the situation where the dialogue with the user does not mesh properly due to speech recognition being performed with the trigger word included in the middle of a sentence.

[0308] Also, when realizing the dialogue between the user and the character displayed on the video display unit through the cooperation of the speech recognition server and the dialogue server, the following operations may be executed according to the configuration of the speech recognition server.

[0309] For example, when the speech recognition server is configured to start the speech recognition process after receiving the voice data file, the processing board 224 may individually send each voice data file of the voice before and after the voice of the trigger word among the detected voices by the microphone 2333 to the speech recognition server. For example, among the detected voices from the detection start time to the detection end time, the voice data file of the user voice detected before the voice of the trigger word (also referred to as the first half of the user voice) may be sent to the speech recognition server ahead of the voice data file of the user voice detected after the voice of the trigger word (also referred to as the second half of the user voice).

[0310] In this way, in the voice recognition server, the voice recognition process for the first half of the user voice starts without waiting for the reception completion of the voice data file of the second half of the user voice. Therefore, compared with the case of transmitting the voice data file of the voice combining the first half of the user voice and the second half of the user voice to the voice recognition server, the voice recognition process can be efficiently performed. As a result, the display device 1 can receive the character voice from the dialogue server earlier, and the waiting time of the user until being responded to the user's voice can be shortened.

[0311] Also, for example, when the voice recognition server is configured to perform the voice recognition process in real time by streaming and playing back the voice data from the display device 1, when the first half of the voice data is transmitted to the voice recognition server in real time, it is preferable to control the playback speed T1 of the first half of the user voice to be faster than the standard playback speed T0 (T1>T0). For example, the processing board 224 changes the setting so that the first half of the user voice is played back 25% faster than the standard playback speed T0 in the voice recognition server and transmits the first half of the voice data. In this way, in the voice recognition server, compared with the case where the first half of the user voice is played back at the standard playback speed T0, the voice recognition process for the first half of the user voice can be terminated earlier, and the voice recognition process for the second half of the user voice can be started earlier. As a result, the display device 1 can receive the character voice from the dialogue server earlier, and the waiting time of the user until being responded to the user's voice can be shortened.

[0312] Furthermore, when the voice data of the latter half of the user voice is transmitted to the voice recognition server in real time, it is preferably controlled such that the playback speed T2 of the latter half of the voice is faster than the standard playback speed T0 and slower than the playback speed T1 of the former half of the user voice (that is, the relationship of T0 < T2 < T1 is satisfied). For example, the processing board 224 changes the setting so that the latter half of the user voice is played back 10% faster than the standard playback speed T0 in the voice recognition server and transmits the voice data of the latter half. In this way, both the former half of the user voice and the latter half of the user voice are streamed and played back faster than the standard playback speed T0, and voice recognition processing is executed in the voice recognition server. As a result, the waiting time of the user until a response is made to the user's voice can be further shortened. On the other hand, the latter half of the user voice is played back at a speed that is faster than the standard playback speed T0 but slower than the playback speed T1 of the former half of the user voice. Therefore, a decrease in the voice recognition accuracy in the voice recognition system can be suppressed. Therefore, it is possible to further shorten the waiting time of the user while suppressing a decrease in the voice recognition accuracy.

[0313] In addition, when voice recognition processing by streaming playback of voice data is executed in real time in the voice recognition server, for example, although the user voice detected by the microphone 2333 is transmitted to the voice recognition server in real time, it is preferably controlled so that voice recognition in the voice recognition server is not started until the voice of the trigger word is detected.

[0314] <10. Details of the communication function related to the character 1200> Next, the details of the communication function related to the character 1200 described above will be described below. In the following, in particular, the stage until domestication in the first step described above and the stage of learning the language in the second step will be described. In addition, the function of the character 1200 that has learned the language in the second step to transmit or respond to predetermined information such as weather and news will also be described in detail.

[0315] Note that, compared with the above-described display device 1, for example, since the communication function and the like have been improved and it exceeds the scope of the functions expressed as "display device", hereinafter, it shall be referred to as system 1 instead of the above-described display device 1. However, since the external configuration, the principle related to display, the internal configuration (structure), etc. of the system 1 are the same as those of the above-described display device 1, the description thereof will be omitted.

[0316] In addition, in the description of the display device 1, the person observing the video displayed on the display device 1 was expressed as an "observer". However, as described above, since the system 1 exceeds the scope of the display device, hereinafter, it shall be referred to as a "user" instead of an "observer".

[0317] (Concept of System 1) First, the concept of the system 1 will be briefly described with reference to FIG. 56. FIG. 56 is a diagram briefly explaining an example of the development concept of the system 1 according to an embodiment.

[0318] Similar to the above-described display device 1, in the video display space S1 of the system 1, for example, a character such as an animal is virtually displayed. In this embodiment, a cat is displayed as an example of the character virtually displayed in the video display space S1 of the system 1. The name of this cat is JUNO (also referred to as JUNO) as described above.

[0319] As shown in FIG. 56, JUNO is realized by software control as a character who wants to get along well with, for example, a user who is the owner of System 1, but who is initially a bit nervous and unable to communicate well at first. For example, JUNO virtually and pseudo-reproduces having instincts such as innate qualities and characteristics as if it were a real living being such as an animal. Through such software control, JUNO has an animal-like quality and exhibits animal-specific behavior patterns due to changes in the environment and the like. In the following description, when it is stated that JUNO has a virtual instinct function, it means that it is realized by software control so that JUNO behaves as if it had instincts. The same shall apply to various other actions performed by JUNO (such as utterances and other behaviors). Whether artificial intelligence technology is used or not in software control does not matter, and the specific implementation method is not questioned.

[0320] For example, in the initial setting, it is set to be highly vigilant (that is, the intimacy with the user is low) and unable or difficult to communicate well with the user, and in some cases, it may be set to perform intimidating actions towards the user. Then, when the user takes actions such as feeding JUNO food such as rice every day, JUNO's vigilance begins to subside, and the intimacy between the user and JUNO increases. As the intimacy between the user and JUNO increases, there are changes in JUNO's behavior pattern, and it may be set so that JUNO performs actions that startle the user. When the intimacy between the user and JUNO becomes strong, for example, it becomes possible to have daily conversations with the user, and it may be set so that the user can spend a relaxing and healing time with JUNO.

[0321] In this way, if the initial settings are such that, for example, the character's wariness is increased, or it is unable to communicate well with the user, or it performs intimidating actions towards the user, then, for example, the instinctive functions of living beings can be realistically expressed. And as the intimacy between the user and JUNO increases, JUNO, as if having virtual instinctive functions, can, for example, communicate with the user. JUNO is a character modeled after a living being (for example, a life form such as an animal, and in the embodiment of this system, a cat). By doing so, it becomes possible to enjoy the daily life with a character 1200 (virtual animal) that seems to actually exist, with a sense of reality. Note that the character 1200 can be, for example, a human, an animal other than a human, a fictional creature, a non-existent character, etc., as long as it can express a sense of reality as if it actually exists.

[0322] (Character behavior patterns that change according to intimacy) First, an example of the behavior pattern of JUNO according to the intimacy between the user and JUNO will be briefly described. As a mode of expressing the intimacy between the user and JUNO, for example, there is the sense of distance between the user and JUNO. If the intimacy between the user and JUNO is low, JUNO is considered not to try to approach the user as a virtual instinctive function and to keep a certain distance from the user. On the other hand, if the intimacy between the user and JUNO increases, JUNO's wariness towards the user weakens, and it may approach the user. Therefore, in this system 1, the behavior pattern of JUNO is configured such that the distance between the two can change according to the intimacy between the user and JUNO.

[0323] The distance between the user and JUNO can be changed, for example, according to the display position of JUNO in the three-dimensional video display space S1. Hereinafter, the display position of JUNO in the video display space S1 will be described with reference to FIG. 57. FIG. 57 is a diagram showing an example of a display form in the video display space S1 of the system 1 according to an embodiment. If JUNO can move freely within the three-dimensional video display space S1 with a sense of depth, it is possible to create a sense of presence as if the virtually displayed JUNO actually exists.

[0324] As shown in FIG. 57, in the video display space S1 of the system 1, as a three-dimensional virtual space video, for example, a plurality of areas and the like are displayed in the depth direction. These plurality of areas are displayed such that the sense of distance in the front view varies according to the area. In this embodiment, for example, as a plurality of areas where JUNO can be displayed, an area 1 on the front side, which is the side closest to the user, an area 5 on the back side, which is the side farthest from the user, and areas 2 to 4, which are in the middle between area 1 and area 5, are partitioned. Among areas 2 to 4, in the order of proximity to the user, they are area 2, area 3, and area 4. Also, although not normally displayed, it is also possible to display an area 0 on the side closer to the user than area 1 as an area used, for example, when performing a zoom display described later. However, in this embodiment, area 0 is not an area where JUNO can be displayed, but JUNO may be displayed.

[0325] Among the plurality of areas displayed in the depth direction of the video display space S1 of the system 1, in area 1, which is the side closest to the user (the lower side of the display screen), for example, an image of a character or the like is displayed the largest, and in area 5, which is the side farthest from the user (the upper side of the display screen), for example, an image of a character or the like is displayed the smallest. Then, an image of a character or the like is displayed so as to gradually become smaller from area 1 toward area 5. By doing so, it is possible to further emphasize the sense of perspective.

[0326] The processing substrate 224 is configured to be controllable such that JUNO moves in areas 1 to 5 according to the intimacy between the user and JUNO in the video display space S1 of the system 1. In this embodiment, the intimacy is abstract and conceptual, and an empirical value is used as a parameter for directly or indirectly specifying the intimacy. Instead of the empirical value, the intimacy may be used as a parameter. The empirical value is an example of the empirical information of the present invention. The intimacy serves as an index of the degree of intimacy between the user and JUNO. The higher the empirical value, the higher the degree of intimacy, and the lower the empirical value, the lower the degree of intimacy. The empirical value is an index value indicating how much JUNO has experienced the actions (behaviors) performed by the user on JUNO, and for example, it changes according to the results of those actions. The results of the actions are specified, for example, by the number or frequency of the actions, but it is even better if the specific content of the actions is also taken into account. Typically, as JUNO experiences the actions from the user on JUNO, the empirical value increases, and accordingly, the intimacy changes in the direction of increasing. In general human relationships and the relationship between humans and animals, the more actively communication is carried out, the more the relationship between the two changes in the direction of increasing intimacy, so it can be said that this is a pseudo-expression of this. The empirical value may not only change in the increasing direction but also in the decreasing direction. In this case, the intimacy changes in the decreasing direction. For example, as JUNO stops experiencing the actions from the user on JUNO, for example, as the number or frequency of those actions decreases, the intimacy should be decreased. The specific content of the actions may also be taken into account. For example, even when the user takes an action on JUNO, if it is not something that JUNO likes, the intimacy may be decreased. In this case, it can be understood that there is a lack of experience of the actions that JUNO likes and the intimacy is decreasing. In general human relationships and the relationship between humans and animals, if good communication is not experienced, the degree of intimacy between the two decreases, so it can be said that this is a pseudo-expression of this. In this embodiment, the action on JUNO is realized by the user inputting information into the system 1.Next, the relationship between the user's actions and the experience value or the intimacy grasped therefrom, and the operation of System 1 related thereto will be described.

[0327] For example, when the intimacy between the user and JUNO is low, the ratio (i.e., probability) of JUNO moving to an area relatively far from the user is high, and as the intimacy between the user and JUNO increases, the probability of JUNO moving to an area relatively close to the user increases. By doing so, JUNO can be displayed as if it actively moves away from or approaches the user based on the virtual instinct function, and it becomes possible to further give JUNO a sense of reality.

[0328] (Regarding intimacy) When the processing board 224 has a preset condition, for example, when JUNO has a specific experience or the like, the experience value is incremented by a predetermined value. When this experience value increases, the processing board 224 controls JUNO to perform a behavior pattern as if the intimacy between the user, which is an abstract concept, and JUNO has increased. In this embodiment, for example, as a parameter of the experience value, the number of times (days) the user has fed JUNO is used. When the number of times (days) the user has fed JUNO is used as a parameter of the experience value, when the user feeds JUNO, the experience value is incremented by 1. In this embodiment, the upper limit of the experience value added per day is 1. That is, even if the user feeds JUNO multiple times in one day, the added experience value is only 1. By doing so, it becomes possible to have the user use the present system 1 over a long period of time. However, the upper limit of the experience value added when the user feeds JUNO is not limited to 1 as long as it is a value within a range that allows the user to use the present system 1 over a long period of time. For example, it may be 2, 3, etc., or the experience value may be added by the number of times the user has fed JUNO. Also, if the number of days the user does not feed JUNO exceeds a preset number of days, for example, the experience value is decremented by a predetermined value (for example, 1). The process of incrementing and decrementing the experience value is both performed by a cloud server described later, but it may also be performed by the processing board 224. The method by which the user feeds JUNO will be described later. Note that the food is an example of an item given to JUNO, and it may be replaced with or combined with a ball, a toy, or other items. Also, using the number of times (days) the user has fed JUNO as a parameter of the experience value is just an example. For example, the number of times the user has performed an action, such as the time the user has used the system, the number of times of use, the number of times of speaking to JUNO, etc., can be used as a parameter of the experience value, or these can be combined. Also, when using, for example, a rudeness parameter as a parameter of the experience value, when the rudeness parameter is added, the intimacy decreases.Also, although the experience value was described above as an example of the experience information of the present invention, as a concept higher than the experience information, it can be a parameter related to the usage record of the communication function between the user and JUNO.

[0329] In addition, in view of the fact that depending on the user's preference, there may be users who desire to increase the experience value in a short period of time, the upper limit of the experience value added when the user feeds JUNO may be set to a relatively large value such as 5 or 10, or the experience value may increase by the number of times the user feeds without setting an upper limit. Furthermore, if the user can set the upper limit of the experience value added when the user feeds JUNO, it becomes possible to provide the system 1 capable of setting the increase speed of the experience value according to the user's preference.

[0330] In this embodiment, for example, when the number of times (days) the user feeds JUNO is 0 or more and less than 30, the intimacy is defined as low, when the number of times (days) the user feeds JUNO is 30 or more and less than 60, the intimacy is defined as medium, and when the number of times (days) the user feeds JUNO is 60 or more, the intimacy is defined as high.

[0331] (Character area movement) As described above, when the intimacy between the user and JUNO is low, the probability that JUNO moves to an area relatively far from the user is high, and as the intimacy between the user and JUNO increases, the probability that JUNO moves to an area relatively close to the user increases. Therefore, the probability that JUNO moves to each area according to the intimacy will be described with reference to FIGS. 58A to 62.

[0332] FIG. 58A is a table showing an example of an equation for obtaining the probability that JUNO (character) moves to areas 1 and 2 according to the number of times (days) the user has fed JUNO in system 1 according to one embodiment. FIG. 58B is a table showing an example of an equation for obtaining the probability that JUNO moves to areas 3 to 5 according to the number of times (days) the user has fed JUNO in system 1 according to one embodiment. FIG. 59 is a table showing an equation for obtaining the probability that JUNO moves to each area (areas 1 to 5) according to the number of times (days) the user has fed JUNO in system 1 according to one embodiment. The equations shown in FIGS. 58A, 58B, and 59 are tables showing the same basic equation in different expression methods. Specifically, FIGS. 58A and 58B are tables showing, for each level of intimacy, the basic equation for obtaining the movement probability to each area and the equations for obtaining the coefficients a, b, and c included in the basic equation. On the other hand, FIG. 59 is a table showing the basic equation for obtaining the movement probability to each area and the equation obtained by substituting the equations for obtaining the coefficients a, b, and c for each level of intimacy into the basic equation.

[0333] FIG. 60(A) is a table showing an example of numerical values substituted for coefficients X (X1, X2, X3) included in the equations for obtaining coefficients a, b, and c in system 1 according to an embodiment, and is used for classifying low intimacy, medium intimacy, and high intimacy. In this embodiment, as described above, when the number of times (days) the user feeds JUNO is 0 or more and less than 30, it is defined as low intimacy, when the number of times (days) the user feeds JUNO is 30 or more and less than 60, it is defined as medium intimacy, and when the number of times (days) the user feeds JUNO is 60 or more, it is defined as high intimacy. Therefore, as shown in FIG. 60(A), in any case of low intimacy, medium intimacy, and high intimacy, the upper limit of the number of times (days) the user feeds JUNO is, for example, 30 days. Thus, for example, when the number of times (days) the user feeds JUNO is 0 or more and less than 45 days, it is defined as low intimacy, when the number of times (days) the user feeds JUNO is 45 days or more and less than 90 days, it is defined as medium intimacy, and when the number of times (days) the user feeds JUNO is 90 days or more, it is defined as high intimacy. In this case, as shown in FIG. 60(A), X1 = 45, X2 = 45, and X3 = 45. In the case of high intimacy, for the convenience of calculation, the upper limit of the number of times (days) the user feeds JUNO is set to, for example, 30 days. However, even when the number of times (days) the user feeds JUNO exceeds 30 days, the transition probability to each area is determined using the same equation as in the case of high intimacy.

[0334] FIG. 60(B) is an example of a table in which the upper and lower limits of the probability of moving to each area are set for each intimacy level (low intimacy, medium intimacy, high intimacy) in system 1 according to an embodiment. For example, in the case of medium intimacy, the upper limit of the probability of moving to area 1 is, for example, 0.3 (30%), and the lower limit is, for example, 0.05 (5%).

[0335] FIG. 61 is a table showing coefficients included in a basic formula indicating the probability of moving to area 1 according to the degree of intimacy (low degree of intimacy, medium degree of intimacy, high degree of intimacy) in the system 1 according to an embodiment, and is (A) an example of a table showing coefficient a, (B) an example of a table showing coefficient b, and (C) an example of a table showing coefficient c. For example, as shown in FIG. 61(A), the value of coefficient a in the case of a high degree of intimacy is set to 10.9091.

[0336] FIG. 62 is a table showing coefficients included in a basic formula indicating the probability of moving to areas 2 to 4 according to the degree of intimacy (low degree of intimacy, medium degree of intimacy, high degree of intimacy) in the system 1 according to an embodiment, and is (A) an example of a table showing coefficient A and (B) an example of a table showing coefficient B. For example, as shown in FIG. 62(A), the value of coefficient A included in the basic formula indicating the probability of moving to area 3 in the case of a medium degree of intimacy is set to 0.20. Also, as shown in FIG. 62(B), coefficient B included in the basic formula indicating the probability of moving to area 2 in the case of a high degree of intimacy is set to 0.05.

[0337] By doing so, as the number of times (days) the user feeds JUNO increases, the probability that JUNO moves to area 1 (including the probability of staying in area 1) increases, and JUNO is displayed as approaching the user. However, when the user takes an action that JUNO does not like against JUNO, it is also possible to increase the probability that JUNO moves to area 5, for example, or to decrease the probability that JUNO moves to area 1 (including the probability of staying in area 1).

[0338] Next, the concept of the probability of moving to Area 1 will be explained. For example, when raising an animal that is not at all accustomed to humans, such as a stray cat, it is considered that it would start by getting the animal accustomed to humans first. Even if the animal starts receiving food, it is likely not getting accustomed linearly but rather gradually. Therefore, in this embodiment, when the intimacy level is low, the rate of change of the change in JUNO getting accustomed is not constant, and the probability of moving to Area 1 increases as time passes. That is, as an experience value parameter, when using the number of times (days) the user has given food to JUNO, when the intimacy level is low and the number of times (days) of giving food is less than, for example, 30 days, as the number of times (days) of giving food increases, the amount of change in the probability of moving to Area 1 with respect to the increase in the number of times (days) of giving food becomes larger. By doing this, not only can a sense of familiarity with JUNO be given to the user, but the process of accelerating the degree to which JUNO gets accustomed can be embodied to the user by the ratio of JUNO's movement to Area 1. The equation showing that as the number of times (days) of giving food increases, the amount of change in the probability of moving to Area 1 with respect to the increase in the number of times (days) of giving food becomes larger is the equation for the case of low intimacy level shown in the column of Area 1 in FIG. 59 (hereinafter, this equation is referred to as the "first equation"). Note that as the number of times (days) of giving food increases, the amount of change in the probability of moving to Area 1 with respect to the increase in the number of times (days) of giving food becomes larger, but this is just an example. When using, for example, a parameter of aloofness as an experience value parameter, it is also possible to make the amount of change in the probability of moving to Area 1 with respect to the decrease in the value of the experience value larger.

[0339] However, for example, animals do not become accustomed indefinitely. Instead, they reach a plateau at some point, and the rate of habituation approaches zero asymptotically (approaching the asymptote of y = 1). That is, when the number of times (days) the user feeds JUNO is, for example, 60 days or more and the intimacy is high, as the number of times (days) the user feeds JUNO increases, the change amount of the movement probability to area 1 with respect to the increase in the number of times (days) the user feeds JUNO becomes smaller. The equation representing this is the equation for the case of high intimacy shown in the column of area 1 in FIG. 58A (hereinafter, this equation is referred to as the "third equation").

[0340] By the way, for example, it is considered that when an animal starts to get used to something, the change of getting used to it becomes larger. However, at some point, it reaches the maximum change rate, and then the change rate becomes smaller and leads to the third equation. That is, it is necessary to smoothly connect the first equation and the third equation.

[0341] In addition, in this embodiment, as shown in FIGS. 58A, 59B, and 59, the movement probability to area 1 in the medium intimacy is the same equation as the first equation showing the movement probability to area 1 in the low intimacy. However, hereinafter, for convenience of explanation, the equation showing the movement probability to area 1 in the medium intimacy is referred to as the second equation.

[0342] Also, in this embodiment, an explanation will be given on how to easily, that is, without imposing a load on the software, use the above first formula, second formula, and third formula to vary the probability of JUNO moving to area 1 according to the intimacy. In the sense of not imposing a load on the software, it is preferable not to use trigonometric functions, exponential functions, and logarithmic functions, and it is preferable to use only arithmetic operations. Further, instead of changing the mathematical formulas in three cases for the above first formula, second formula, and third formula, they are expressed by one formula, and the values of the derivative coefficients are made equal at "x = any specified point", and the various formulas are connected smoothly. By doing so, the program can be simplified. If the coefficients are determined by the number of times (days) the user feeds JUNO in each of the three cases of low intimacy, medium intimacy, and high intimacy, for example, all the coefficients can be determined by simply inputting three parameters of 30 / 30 / 30 such as 30 days / 30 days / 30 days. This is for easy debugging.

[0343] Next, when the probability of JUNO moving to each area according to the intimacy obtained by the arithmetic operations described with reference to FIGS. 58A to 62 is presented in a graph and a table, it becomes as shown in FIGS. 63 and 64. FIG. 63 is a graph showing the relationship between the passage of time, and thus the number of times (days) the user feeds JUNO, and the probability of moving to each area in the system 1 according to one embodiment. FIG. 64 is an example of a table showing, for each intimacy (low intimacy, medium intimacy, high intimacy), the data of the graph shown in FIG. 63, that is, the data of the number of times (days) the user feeds JUNO and the probability of moving to each area. Note that 0 to 30 shown in the vertical column of "days" for each intimacy in FIG. 64 is not the cumulative number of days the user feeds JUNO, but the number of times (days) the user feeds JUNO at each intimacy. For example, when the "days" for medium intimacy is "20", the number of times (days) the user feeds JUNO in medium intimacy is 20 days, and the cumulative number of times (cumulative days) the user feeds JUNO is 50 days. Hereinafter, the amount of change in the probability of moving to each area with respect to the number of times (days) the user feeds JUNO will be described with reference to FIGS. 63 and 64.

[0344] (Change amount of movement probability to each area when the intimacy is low) As shown in FIGS. 63 and 64, when the number of times (days) the user feeds JUNO is 0 to 30 and the intimacy is low, the change amount of the movement probability to areas 1 to 4 with respect to the number of times (days) the user feeds JUNO increases significantly in the positive direction as the number of times (days) the user feeds JUNO increases (hereinafter, the change amount in the positive direction is referred to as the "positive change amount"). However, among areas 1 to 4, the positive change amount of the movement probability to areas 1 to 4 with respect to the number of times (days) the user feeds JUNO is the largest in the order of area 4, area 3, area 2, and area 1. That is, among the positive change amounts of the movement probability to areas 1 to area 4 with respect to the number of times (days) the user feeds JUNO, the positive change amount of the movement probability to area 1 is the smallest. On the other hand, the change amount of the movement probability to area 5 with respect to the number of times (days) the user feeds JUNO increases significantly in the negative direction as the number of times (days) the user feeds JUNO increases (hereinafter, the change amount in the positive direction is referred to as the "negative change amount"). Thus, when the intimacy is low, as the number of times (days) the user feeds JUNO increases, the positive change amount becomes larger in the order of area 4, area 3, area 2, and area 1, while the negative change amount of the movement probability to area 5 becomes larger. Note that the movement probability to each area when the intimacy is low is high in the order of the movement probability to area 5, the movement probability to area 4, the movement probability to area 3, the movement probability to area 2, and the movement probability to area 1. By doing so, it is possible to make the user perceive at the position where JUNO is displayed that JUNO is not accustomed and not familiar with the user in the initial state. And for a while from the initial state, the character is not accustomed, and the process in which the user's vigilance is released and the user gets accustomed as the number of times (days) the user feeds JUNO increases can be embodied to the user in terms of the ratio, that is, the ratio of the position where the character stays.

[0345] (Change amount of movement probability to each area when the intimacy is medium) Next, during the medium intimacy level where the number of days the user fed JUNO is between 30 and 60 days, the change in the probability of moving to areas 1 to 3 with respect to the number of days the user fed JUNO increases significantly in the positive direction as the number of days the user fed JUNO increases. However, unlike in the case of low intimacy, among areas 1 to 3, the positive change in the probability of moving to areas 1, 2, and 3 with respect to the number of days the user fed JUNO is large in the order of area 1, area 2, and area 3. That is, among the positive changes in the probability of moving to areas 1 to 3 with respect to the number of days the user fed JUNO, the positive change in the probability of moving to area 1 is the largest. Also, the change in the probability of moving to area 4 with respect to the number of days the user fed JUNO is 0. Furthermore, the change in the probability of moving to area 5 with respect to the number of days the user fed JUNO is still large in the negative direction. Note that the probability of moving to each area during medium intimacy is high in the order of the probability of moving to area 5, the probability of moving to area 4, the probability of moving to area 3, the probability of moving to area 2, and the probability of moving to area 1 from the first half to the middle of medium intimacy, and in the order of the probability of moving to area 1, the probability of moving to area 4, the probability of moving to area 3, the probability of moving to area 2, and the probability of moving to area 5 in the second half of medium intimacy. Note that as the number of days the user fed JUNO increases, the differences in the probability of moving to area 2, area 3, and area 4 become smaller, and at the boundary connecting medium intimacy and high intimacy (for example, when the number of days the user fed JUNO is the 60th day), the probability of moving to area 2, area 3, and area 4 is the same or almost the same probability (in this embodiment, for example, 0.20).

[0346] (Change in the probability of moving to each area in the case of high intimacy) Next, when the intimacy level is high, where the number of days the user has fed JUNO is 60 days or more, the change in the probability of moving to Areas 1 and 2 with respect to the number of days the user has fed JUNO increases significantly in the positive direction as the number of days the user has fed JUNO increases. However, the positive change in the probability of moving to Areas 1 and 2 with respect to the number of days the user has fed JUNO decreases as the number of days the user has fed JUNO increases. Also, the change in the probability of moving to Areas 3 to 5 with respect to the number of days the user has fed JUNO increases significantly in the negative direction as the number of days the user has fed JUNO increases, and the negative change in the probability of moving to Areas 3 to 5 with respect to the number of days the user has fed JUNO decreases as the number of days the user has fed JUNO increases. That is, when the intimacy level is high, for the probability of moving to any of Areas 1 to 5, the rate of change becomes less sharp as the number of days the user has fed JUNO increases. In particular, the graph showing the probability of moving to Area 5 approaches the asymptote of y = 1. By doing so, it is possible to create a sense of reality through the movement of JUNO. Note that the probability of moving to each area when the intimacy level is high is high in the order of the probability of moving to Area 1, the probability of moving to Area 2, the probability of moving to Area 3, the probability of moving to Area 4, and the probability of moving to Area 5.

[0347] In this way, by changing the amount of change in the probability of moving to each of Areas 1 to 5 according to the number of days the user has fed JUNO, it becomes possible to control the behavior pattern of JUNO to change among the cases of low intimacy level, medium intimacy level, and high intimacy level. By doing so, it becomes possible to form a virtual instinct function such that JUNO as Character 1200 behaves as if based on instinct.

[0348] <11. Functions of this System> Next, the functions (such as states, behavior patterns, etc.) of Character 1200 (JUNO imitating a cat in this embodiment) according to the intimacy level (low intimacy level, medium intimacy level, high intimacy level) will be described.

[0349] In the system 1 according to this embodiment, according to the above-described intimacy, JUNO as the character 1200 is displayed in a behavior pattern as if it has emotions. For example, at the initial setting, JUNO stays at the position farthest from the user (for example, area 5). Also, when the intimacy is low including at the initial setting, the character 1200 has a sense of vigilance (hereinafter referred to as "virtual vigilance"). Therefore, when the intimacy is low, as described above, the processing board 224 controls so that JUNO does not approach the user easily (for example, does not approach area 1), and JUNO often stays in an area far from the user, such as area 5. Further, the processing board 224 controls so that a behavior pattern is displayed as if JUNO recognizes area 5 as its own territory. Also, even when JUNO is displayed in areas 1 to 4, the processing board 224 controls so that a behavior pattern is displayed as if JUNO has virtual vigilance.

[0350] (11-1. When the intimacy is low) FIG. 65A is an example of a diagram for explaining the state and behavior pattern of JUNO when the intimacy is low in the system 1 according to an embodiment. Also, FIG. 65B is an example of an image displayed in the video display space S1 of the system 1 when the intimacy is low in the system 1 according to an embodiment. Hereinafter, in this specification, the expression of the character 1200 will be uniformly described as JUNO.

[0351] Also, as shown in FIG. 65A, a fixed position is set as the behavior policy of JUNO. The fixed position of JUNO when the intimacy is low is, for example, area 5 where the distance from the user is the farthest, and JUNO is mainly in area 5. Also, regardless of the presence or absence of human detection described later, JUNO is in area 5. JUNO is mainly located in area 5 and is vigilant when moving to other areas or when in other areas.

[0352] As shown in FIG. 65B, a food feeder is displayed in area 1. A nail file is displayed in area 3. Also, JUNO is displayed in area 5. Area 5 is a range that is not affected by external influences. External influences refer to human detection and the like, which will be described later. Note that the food feeder and the nail file will also be described later.

[0353] FIG. 66A is an example of an explanatory diagram of movement to other areas when the intimacy is low in the system 1 according to an embodiment. FIG. 66B is an example of an image for explaining movement to other areas when the intimacy is low in the system 1 according to an embodiment.

[0354] The processing board 224 performs movement lottery, for example, at a predetermined cycle. Based on the result of this movement lottery, there are cases where JUNO moves to other areas and cases where JUNO moves to other areas based on event detection.

[0355] When JUNO moves to other areas based on the result of the movement lottery performed at a predetermined cycle as shown in FIGS. 66A and 66B, the movement lottery performed at a predetermined cycle is performed, for example, with the movement probabilities shown in FIGS. 63 and 64 described above. Note that the above-mentioned predetermined cycle is performed, for example, at a cycle of about 1 to 10 minutes. Also, when JUNO selected in the movement lottery moves to other areas, the processing board 224 determines the cycle for performing the movement lottery by lottery after the movement. In this case, the areas where JUNO can move are, for example, any of areas 1 to 5. In this way, JUNO can be moved between areas based on the result of the movement lottery performed at a predetermined cycle or event detection. That is, JUNO can be moved between areas at random timing, and movements as if JUNO is moving with its own will can be displayed.

[0356] Also, as shown in FIG. 66B, when the intimacy is low, the probability that JUNO moves to Area 1 based on the result of the movement lottery is 0 to 5%. Similarly, the probability that JUNO moves to Area 2 is, for example, 0 to 10%, the probability that JUNO moves to Area 3 is, for example, 0 to 15%, the probability that JUNO moves to Area 4 is, for example, 0 to 20%, and the probability that JUNO moves to Area 5 is, for example, 100 to 50%.

[0357] Next, regarding the movement to other areas based on event detection, it will be described with reference to FIGS. 67A to 69B. Examples of event detection include, for example, feeding event detection, random nail trimming event detection, human detection event detection, and the like.

[0358] (When a feeding event is detected) FIG. 67A is an example of an explanatory diagram of movement to other areas when a feeding event is detected in System 1 according to an embodiment when the intimacy is low. FIG. 67B is an example of an image showing the movement from Area 5 to Area 1 when a feeding event is detected in System 1 according to an embodiment when the intimacy is low. FIG. 67C is an example of an image showing the movement from Area 1 or 2 to Area 5 when a feeding event is detected in System 1 according to an embodiment when the intimacy is low.

[0359] FIG. 67A describes, for example, movement start conditions, conditions for escaping to Area 5, JUNO's behavior after escaping to Area 5, JUNO's behavior after finishing eating the food, and the like. In particular, when JUNO escapes, by escaping from Area 1, which is the closest area to the user, to Area 5, which is the farthest area from the user, it becomes possible to clearly grasp that JUNO has moved away from the user.

[0360] When the user feeds (i.e., when food appears), a feeding event is detected. When a feeding event is detected, the processing board 224 calculates the probability that JUNO will eat the food. Although it is described in FIG. 67A as "calculating the probability of eating from the intimacy sheet", for example, the movement probability to area 1 shown in FIG. 64 is used for the intimacy sheet. For example, when the number of days (days) that the user has fed JUNO is the 50th day, the processing board 224 determines whether to satisfy the movement start condition with a probability of 0.1500 (15%), which is the probability described in the column of "20" in the intimacy corresponding to the 50th day in the table shown in FIG. 64.

[0361] When the movement start condition is satisfied, the processing board 224 determines to start the action for JUNO to eat the food. Then, when it is determined to start the action for JUNO to eat the food, the processing board 224 displays an action pattern in which JUNO starts moving while being vigilant to eat the food. For example, as shown in FIG. 67B, JUNO moves from area 5 to area 1 where the food bowl is placed.

[0362] The condition for JUNO to escape back to area 5 from an area other than area 5 (for example, area 1 or area 2), for example, during the movement to area 1 or when JUNO is eating food, etc., may be satisfied when external detection (for example, proximity detection (i.e., when a person is detected, for example, when the user approaches JUNO), gesture detection, call detection, or detection of a large sound above a predetermined decibel, etc.) is detected. For example, when the above proximity detection occurs during the movement to area 1 or when JUNO is eating food, etc., the processing board 224 displays an action pattern in which JUNO moves to escape back to area 5 from an area other than area 5, for example, as shown in FIG. 67C. In this way, when there is proximity detection, by having JUNO move to escape back to an area relatively far from the user, such as area 5, etc., the movement of JUNO can create a greater sense of reality.

[0363] After JUNO escapes to Area 5, the processing board 224 performs a fear motion playback indicating what JUNO fears, and then displays a behavior pattern as if it were on the alert, and starts measuring with a timer. Note that after the movement to Area 5 is completed, the processing board 224 determines the period for performing the above-described movement lottery. The period for performing the movement lottery may be, for example, a period of about 1 to 10 minutes. When the period for performing the movement lottery arrives, the processing board 224 performs the movement lottery.

[0364] On the other hand, when JUNO finishes eating the bait, the processing board 224 displays a behavior pattern in which JUNO is on the alert and performs a movement lottery at a predetermined period. If the processing board 224 wins this movement lottery, it displays a behavior pattern of moving to another area. The destination area is determined based on the movement probabilities shown in FIGS. 63 and 64 described above. Note that until the movement lottery is performed, the processing board 224 displays a behavior pattern in which JUNO stays in Area 1.

[0365] (When a claw sharpening event is detected) FIG. 68A is an example of an explanatory diagram of movement to another area when a claw sharpening event is detected when the intimacy level is low in the system 1 according to one embodiment. FIG. 68B is an example of an image showing movement from Area 5 to Area 3 when a claw sharpening event is detected when the intimacy level is low in the system 1 according to one embodiment. FIG. 68C is an example of an image showing movement from Area 5 to Area 3 when a claw sharpening event is detected when the intimacy level is low in the system 1 according to one embodiment.

[0366] FIG. 68A describes, for example, movement start conditions, conditions for JUNO to escape to Area 5, JUNO's behavior after JUNO escapes to Area 5, JUNO's behavior after claw sharpening, and the like.

[0367] The claw sharpening event occurs randomly, for example. When the claw sharpening event is detected, the movement start condition is satisfied. The claw sharpening event can be made to occur randomly, for example, by starting the measurement with a timer based on external detection (for example, proximity detection (i.e., when a person is detected, for example, when the user approaches JUNO), gesture detection, call detection, or detection of a large sound of a predetermined decibel or more, etc.) and causing it to occur when no proximity detection is detected for a predetermined time (for example, 5 minutes). Note that, for example, the claw sharpening event may be made to occur randomly by lottery or the like.

[0368] When the movement start condition is satisfied, the processing board 224 determines that JUNO starts an action to sharpen its claws. Then, when it is determined that JUNO starts an action to sharpen its claws, the processing board 224 displays an action pattern in which JUNO starts moving while being vigilant to sharpen its claws. For example, as shown in FIG. 68B, JUNO moves from area 5 to area 3 where the claw sharpening board is placed.

[0369] The condition for JUNO to flee back to area 5 can be satisfied, for example, during the movement to area 3 or during the claw sharpening, as shown in FIG. 68C, by external detection (for example, proximity detection (i.e., when a person is detected, for example, when the user approaches JUNO), gesture detection, call detection, or detection of a large sound of a predetermined decibel or more, etc.). For example, when the above proximity detection occurs during the movement to area 3 or during the claw sharpening, the processing board 224 displays an action pattern in which JUNO moves so as to flee back to area 5.

[0370] After JUNO has fled to area 5, the processing board 224 performs motion playback in which JUNO shows actions such as anger and turning away. Also, on that day, JUNO may not perform claw sharpening.

[0371] On the one hand, when JUNO finishes sharpening its claws, the processing board 224 displays a behavior pattern of being vigilant and conducts a movement lottery at a predetermined cycle. If it wins this movement lottery, the processing board 224 displays a behavior pattern of moving to another area. The destination area is determined based on the movement probabilities shown in FIGS. 63 and 64 described above. Note that until the movement lottery is conducted, the processing board 224 displays a behavior pattern in which JUNO stays in Area 3.

[0372] (When a human detection event is detected) FIG. 69A is an example of an explanatory diagram regarding movement to another area when a human detection event is detected in the system 1 according to an embodiment in the case of low intimacy. FIG. 69B is an example of an image for explaining movement from Area 1 or Area 3 to Area 5 when a human detection event is detected in the system 1 according to an embodiment in the case of low intimacy.

[0373] In FIG. 69A, for example, the movement start condition, JUNO's behavior after returning to Area 5, and behavior after fleeing to Area 5 are described.

[0374] A human detection event occurs, for example, when a human is detected while JUNO is in any of Areas 1 to 4. When a human detection event is detected, the movement start condition is satisfied. When the movement start condition is satisfied, the processing board 224 displays a behavior pattern in which JUNO moves (flees back) to Area 5. Human detection corresponds to, for example, external detection (for example, proximity detection (that is, for example, when a human is detected because the user approaches JUNO), gesture detection, call detection, or detection of a large sound of a predetermined decibel or more).

[0375] After JUNO returns to Area 5 as shown in FIG. 69B, the processing substrate 224 performs motion reproduction that shows actions such as anger and turning away, and conducts a movement lottery at a predetermined cycle. If the processing substrate 224 wins this movement lottery, it displays an action pattern of moving to another area. The destination area is determined based on the movement probabilities shown in FIGS. 63 and 64 described above. Note that until the movement lottery is conducted, the processing substrate 224 displays an action pattern in which JUNO stays in Area 5.

[0376] (Communication function) Next, the communication function of JUNO when the intimacy level is low will be described. FIGS. 70A and 70B are examples of diagrams for explaining the communication function of JUNO when the intimacy level is low in the system 1 according to an embodiment.

[0377] As shown in FIG. 70A, JUNO does not respond to a call from the user. Also, when the user calls JUNO and JUNO is in Areas 1 to 4, JUNO moves (runs away) to Area 5. Note that when JUNO moves to Area 5, the motion reproduced depends on the situation and the like.

[0378] Also, as shown in FIG. 70B, when the intimacy level is low, JUNO does not make spontaneous utterances. Area movement is performed according to the result of a movement lottery (cycle determination) conducted at a predetermined cycle. Also, the home appliance control function, alarm function, and timer function described later cannot be used.

[0379] An example of the motion of JUNO reproduced when JUNO moves from any one of Areas 1 to 4 to Area 5 when the intimacy level is low will be briefly described below with reference to FIG. 70A.

[0380] When an event (e.g., a call) is detected while JUNO is waiting in any of Areas 1 to 4 (i.e., while the waiting motion is being played), the processing board 224 displays JUNO's action pattern in the order of interrupting the waiting motion, playing a motion in which the ears react, playing a 180-degree turn motion, and moving (running, walking, etc.) towards Area 5. Also, when JUNO arrives at Area 5, the processing board 224 makes it turn 180 degrees and starts the waiting motion, and as an action derivative, it performs an action of only turning the head while walking and moves to Area 5. Then, the processing board 224 displays an action pattern in which it makes JUNO turn 180 degrees and starts the waiting motion when it arrives at Area 5.

[0381] Also, when an event (e.g., a call) is detected during the playback of a short motion such as just before starting to move to another area while JUNO is in any of Areas 1 to 4, the processing board 22 displays JUNO's action pattern in the order of completing the short motion playback, playing a motion in which the ears react, playing a 180-degree turn motion, and moving (running, walking, etc.) towards Area 5. Also, when JUNO arrives at Area 5, the processing board 224 makes it turn 180 degrees and starts the waiting motion, and as an action derivative, it performs an action of only turning the head while walking and moves to Area 5. Then, the processing board 224 displays an action pattern in which it makes JUNO turn 180 degrees and starts the waiting motion when it arrives at Area 5.

[0382] Also, when JUNO is in any of Areas 1 to 4 and, for example, the movement start condition is satisfied and an event (e.g., a call) is detected during the area movement, the processing board 224 stops the area movement and displays JUNO's action pattern in the order of playing a motion that makes the ears react, playing a 180-degree turn motion, and moving (running, walking, etc.) toward Area 5. Further, when JUNO arrives at Area 5, the processing board 224 makes JUNO turn 180 degrees and start a standby motion, and as an action derivative, performs an action of only turning the head while walking and moves to Area 5. Then, the processing board 22 displays an action pattern of making JUNO turn 180 degrees and start a standby motion when arriving at Area 5.

[0383] Even if an event (e.g., a call) occurs when JUNO is in Area 5, the processing board 224 displays an action pattern indicating that JUNO is unresponsive.

[0384] Also, when the intimacy level is low, JUNO does not spontaneously talk. Further, the processing board 224 performs a movement lottery at a predetermined cycle and displays JUNO's area movement based on the result of this movement lottery. In addition to the movement lottery performed at a predetermined cycle, when the above-described feeding event is detected (when the user gives food), when a randomly occurring nail trimming event is detected, or when a person detection event is detected (when a person is detected), the processing board 224 can also display an action pattern of moving to another area. Note that when the intimacy level is low, other functions (home appliance control function, alarm function, timer function) described later cannot be used.

[0385] In this way, the processing board 224 can display an action pattern as if JUNO has a virtual instinct function when the intimacy level is low.

[0386] (Other motion examples when the intimacy level is low) As described above, the motion of JUNO is as described above, but the motion of JUNO is not limited to the above examples, and various motion reproductions may be performed. Examples of the reproduction motion of JUNO are shown in FIGS. 71 to 76.

[0387] FIG. 71 is a diagram showing an example of a reproduction motion when JUNO runs away when an event is detected in the system 1 according to an embodiment. Since the specific operation of JUNO is as shown in FIG. 71, detailed description thereof will be omitted.

[0388] FIG. 72 is a diagram showing an example of a reproduction motion when JUNO turns and runs away while moving in an area in the system 1 according to an embodiment. Since the specific operation of JUNO is as shown in FIG. 72, detailed description thereof will be omitted.

[0389] FIG. 73 is a diagram showing an example of a reproduction motion when JUNO turns and runs away while waiting in the system 1 according to an embodiment. Since the specific operation of JUNO is as shown in FIG. 73, detailed description thereof will be omitted.

[0390] FIG. 74 is a diagram showing an example of a reproduction motion when an event is detected while JUNO is eating food in the system 1 according to an embodiment. Since the specific operation of JUNO is as shown in FIG. 74, detailed description thereof will be omitted.

[0391] FIG. 75 is a diagram showing an example of a reproduction motion when an event is detected while JUNO is scratching its claws in the system 1 according to an embodiment. Since the specific operation of JUNO is as shown in FIG. 75, detailed description thereof will be omitted.

[0392] FIG. 76 is a diagram showing an example of a reproduction motion when an event is detected while JUNO is sleeping and it runs away in the system 1 according to an embodiment. Since the specific operation of JUNO is as shown in FIG. 76, detailed description thereof will be omitted.

[0393] Note that the examples of the playback motion shown in FIGS. 71 to 76 should be used not only when the intimacy is low, but also when the intimacy is medium or high.

[0394] (11-2. When the intimacy is medium) FIG. 77A is an example of a diagram for explaining the state and behavior pattern of JUNO when the intimacy is medium in the system 1 according to an embodiment. FIG. 77B is an example of an image displayed in the video display space S1 of the system 1 when the intimacy is medium in the system 1 according to an embodiment.

[0395] As shown in FIG. 77A, the state and mood of JUNO when the intimacy is medium are as follows. That is, JUNO has started to get used to the environment and has started to understand what is where. Further, as a behavior pattern of JUNO, the processing board 224 displays as if it can freely move within the area regardless of the presence or absence of human detection. That is, there is no fixed position as if JUNO recognizes area 5 as its own territory as in the case of low intimacy. Also, when the intimacy is medium, JUNO does not escape based on the occurrence of an external event. However, since JUNO still has a part that is not used to people, the processing board 224 is often controlled to ignore the call from the user.

[0396] Also, as a behavior policy of JUNO shown in FIG. 77A, it is set so that there is no bias in the fixed position. When the intimacy is medium, JUNO freely moves between area 1 and area 5 regardless of the presence or absence of human detection as a behavior pattern indicating that it has gradually gotten used to it.

[0397] As shown in FIG. 77B, food feeding is displayed in area 1, and a nail file is displayed in area 3. Also, when the intimacy is medium, JUNO can freely move between area 1 and area 5 regardless of human detection. Note that area 5 is a range that is not affected by the outside.

[0398] FIG. 78A is an example of an explanatory diagram of movement to another area when the intimacy level is medium in the system 1 according to an embodiment. FIG. 78B is an example of an image for explaining movement to another area when the intimacy level is medium in the system 1 according to an embodiment.

[0399] Also, similar to the case of low intimacy, the processing board 224 performs movement lottery, for example, at a predetermined cycle, and based on the result of this movement lottery, there are cases where JUNO moves to another area and cases where JUNO moves to another area based on event detection.

[0400] Also, as shown in FIGS. 78A and 78B, when JUNO moves to another area based on the result of the movement lottery performed at a predetermined cycle, the movement lottery performed at a predetermined cycle is performed with the same movement probability as in the case of low intimacy, for example, as shown in FIGS. 63 and 64 described above. Note that the above-mentioned predetermined cycle is performed, for example, at a cycle of about 1 to 10 minutes. Also, when JUNO that has won the movement lottery moves to another area, the processing board 224 determines the cycle for performing the movement lottery by lottery after the movement. In this case, the areas where JUNO can move are, for example, any of areas 1 to 5.

[0401] As shown in FIG. 78B, when the intimacy level is medium, the probability that JUNO moves to area 1 based on the result of the movement lottery is, for example, 5 to 30%. Similarly, the probability that JUNO moves to area 2 is, for example, 10 to 20%, the probability that JUNO moves to area 3 is, for example, 15 to 20%, the probability that JUNO moves to area 4 is, for example, 20%, and the probability that JUNO moves to area 5 is, for example, 50 to 10%.

[0402] Next, movement to another area based on event detection will be described with reference to FIGS. 79A to 80C. For event detection, similar to the case of low intimacy, there are, for example, food feeding event detection that may occur when the user feeds food, and detection of nail trimming events that may occur randomly. Note that when the intimacy level is medium, even if there are event detections such as human detection events that may occur when a human is detected as in the case of low intimacy, it is preferable that movement to another area is not performed.

[0403] (When a feeding event is detected) FIG. 79A is an example of an explanatory diagram of movement to another area when a feeding event is detected while the intimacy level is medium in the system 1 according to one embodiment. FIG. 79B is an example of an image showing movement from area 5 to area 1 when a feeding event is detected while the intimacy level is medium in the system 1 according to one embodiment.

[0404] In FIG. 79A, for example, the movement start condition, the condition of escaping to area 5, the behavior of JUNO after finishing eating the bait, etc. are described.

[0405] When the user gives bait (that is, when bait is generated), a feeding event is detected. When a feeding event is detected, the processing board 224 obtains the probability that JUNO eats the bait. Although it is described in FIG. 79A as "calculating the probability of eating from the intimacy sheet", the intimacy sheet uses, for example, the movement probability to area 1 shown in FIG. 64, similar to the case of low intimacy.

[0406] When the movement start condition is satisfied, the processing board 224 determines to start the action for JUNO to eat the bait. Then, when it is determined to start the action for JUNO to eat the bait, the processing board 224 displays an action pattern of starting to move while being vigilant for JUNO to eat the bait. For example, as shown in FIG. 79B, JUNO moves from area 5 to area 1 where the bait is placed. Note that during the intimacy level, conditions such as the condition of escaping to area 5 are not set. Also, even if an external event is detected, it will not escape.

[0407] When JUNO finishes eating, the processing board 224 displays a behavior pattern in which JUNO guards the surroundings and conducts a movement lottery at a predetermined cycle. If it wins this movement lottery, the processing board 224 displays a behavior pattern of moving to another area. The destination area is determined based on the movement probabilities shown in FIGS. 63 and 64 described above. Note that until the movement lottery is conducted, the processing board 224 displays a behavior pattern in which JUNO stays in Area 1.

[0408] (When a claw sharpening event is detected) FIG. 80A is an example of an explanatory diagram of movement to another area when a claw sharpening event is detected while the intimacy level is in progress in the system 1 according to one embodiment. FIG. 80B is an example of an image showing movement from Area 5 to Area 3 when a claw sharpening event is detected while the intimacy level is in progress in the system 1 according to one embodiment.

[0409] In FIG. 80A, for example, the movement start condition, the condition for JUNO to escape to Area 5, the behavior of JUNO after claw sharpening, etc. are described.

[0410] Similar to the case of low intimacy, the claw sharpening event occurs randomly, for example. When a claw sharpening event is detected, the movement start condition is satisfied. The claw sharpening event can be made to occur randomly, for example, by starting measurement with a timer based on external detection (for example, when external detection such as proximity detection (that is, when a person is detected, for example, because the user approaches JUNO), gesture detection, call detection, or detection of a loud sound of a predetermined decibel or more) and generating it when no external detection is detected for a predetermined time (for example, 5 minutes). Note that, for example, the claw sharpening event may be made to occur randomly by lottery or the like. Note that during the intimacy level, conditions such as the condition to escape to Area 5 are not set. Also, even if an external event is detected, it will not escape.

[0411] When the movement start condition is satisfied, the processing board 224 determines that JUNO starts an action to sharpen its claws. Then, when it is determined that JUNO starts an action to sharpen its claws, the processing board 224 displays an action pattern in which JUNO starts moving while being vigilant to sharpen its claws. For example, as shown in FIG. 80B, JUNO moves from area 5 to area 3 where the nail file is placed.

[0412] When JUNO finishes sharpening its claws, the processing board 224 conducts a movement lottery at a predetermined cycle. If winning this movement lottery, the processing board 224 displays an action pattern of moving to another area. The destination area is determined based on the movement probability shown in FIGS. 63 and 64 described above. Note that until the movement lottery is conducted, the processing board 224 displays an action pattern in which JUNO stays in area 3.

[0413] (When a human detection event is detected) FIG. 80C is an example of an explanatory diagram of movement to another area when a human detection event is detected while the intimacy level is medium in the system 1 according to an embodiment.

[0414] As shown in FIG. 80C, even when a human detection event is detected while the intimacy level is medium, unlike when the intimacy level is low, JUNO does not move (escape) to area 5.

[0415] (Communication function) Next, the communication function of JUNO when the intimacy level is medium will be described with reference to FIGS. 81A and 81B. FIGS. 81A and 81B are an example of diagrams for explaining the communication function of JUNO when the intimacy level is medium in the system 1 according to an embodiment.

[0416] When the intimacy level is medium, JUNO can respond to a call by the user. However, as shown in FIG. 81A, the response varies depending on the area where JUNO is located.

[0417] For example, when JUNO is in area 1, JUNO responds to the user's Japanese. Also, in response to the user's call, JUNO responds, for example, only with motion without speaking. Also, when JUNO is in areas 2 to 4, JUN responds, for example, with motion etc.

[0418] Also, when the user makes a call, the processing board 224 performs response lottery. The probability that JUNO responds to the user's call is set according to the area where JUNO stays, as shown in, for example, FIG. 81B. When JUNO is in area 1, for example, the probability of being in area 1 (that is, the probability of 5 to 30% which is the movement probability to area 1 shown in FIG. 64) is diverted, and when JUNO is in area 2, for example, the probability of being in area 2 (that is, the probability of 10 to 20% which is the movement probability to area 2 shown in FIG. 64) is diverted. In addition, when the response lottery fails, the processing board 224 displays a behavior pattern in which JUNO ignores the user's call.

[0419] When the above response with motion is performed, the processing board 224 displays a behavior pattern in which JUNO reacts with, for example, ears. For example, as shown in FIG. 81B, when JUNO is in areas 1 to 4, the processing board 224 displays a behavior pattern in which JUNO reacts to the user's call and performs an action of twitching its ears.

[0420] Note that even if an event (for example, a call) occurs when JUNO is in area 5, the processing board 224 displays a behavior pattern indicating that JUNO is unresponsive.

[0421] (Other, summary) Next, with reference to FIG. 82, other outlines during the intimacy will be described. FIG. 82 is an example of a diagram for explaining other states and actions of JUNO when in the intimacy in the system 1 according to an embodiment.

[0422] As shown in FIG. 82, during the period of high intimacy, JUNO does not initiate conversations spontaneously. Also, the processing board 224 conducts a movement lottery at a predetermined cycle and performs an area movement display of JUNO based on the result of this movement lottery. In addition to the movement lottery conducted at a predetermined cycle, when the above-described feeding event is detected (when the user feeds the pet), or when a randomly occurring nail trimming event is detected, the processing board 224 can also display a behavior pattern of moving to another area. During the period of high intimacy, other functions described later (home appliance control function, alarm function, timer function) cannot be used.

[0423] In this way, during the period of high intimacy, the processing board 224 can display a behavior pattern as if JUNO has a virtual instinct function.

[0424] (11-3. When the intimacy is high) FIG. 83A is an example of a diagram for explaining the state and behavior pattern of JUNO when the intimacy is high in the system 1 according to an embodiment. FIG. 83B is an example of an image displayed in the video display space S1 of the system 1 when the intimacy is high in the system 1 according to an embodiment.

[0425] As shown in Fig. 83A, the state and mood of JUNO when the intimacy level is high are as follows. That is, JUNO trusts the owner (user) and has become completely accustomed to the surrounding environment, being in a state without wildness. As an action pattern of JUNO, the processing board 224 displays it without a sense of vigilance and almost in the direction in front of the display area. In this embodiment, as shown in Fig. 64 above, in the case of a high intimacy level, from 60 days to 90 days (in Fig. 64, for the sake of convenience, it is shown as 0 to 30 days), the ratio of JUNO being in Area 1 or Area 2 (that is, the probability obtained by adding the movement probability to Area 1 and the movement probability to Area 2) is, for example, 50% or more. When the number of days the user has fed JUNO exceeds 90 days, the ratio of being in Area 1 (that is, the movement probability to Area 1) exceeds, for example, 50%. Also, when the intimacy level is high, JUNO trusts the owner (user) and starts to take positive actions. However, the processing board 224 may, for example, set a whim coefficient or the like so that JUNO's reaction may be displayed as in the case of a low or medium intimacy level.

[0426] Also, as shown in Fig. 83A, a fixed position is set as JUNO's action policy. The fixed position of JUNO when the intimacy level is low is, for example, Area 1 which is the area closest to the user, and JUNO has the highest probability of being in Area 1 among Areas 1 to 5. Also, although JUNO is mainly in Area 1, even when it is in an area other than Area 1, it moves to Area 1 in response to human detection. In this way, by having JUNO move to Area 1 which is the area closest to the user, the process of JUNO getting accustomed and the process of getting familiar with the user can be embodied. In particular, when moving from Area 5 which is the farthest from the user to Area 1 which is the closest to the user, the movement distance of JUNO is large, and it becomes possible to clearly understand that JUNO has approached the user, that is, JUNO has become familiar with the user.

[0427] Also, as shown in FIG. 83B, feeding and JUNO are displayed in area 1, and a nail file is displayed in area 3. Also, area 5 is a range that is not affected by external influences.

[0428] FIG. 84A is an example of an explanatory diagram of movement to other areas in the system 1 according to an embodiment when the intimacy level is high. FIG. 84B is an example of an image for explaining movement to other areas in the system 1 according to an embodiment when the intimacy level is high.

[0429] Also, similar to the cases of low and medium intimacy levels, the processing substrate 224 performs movement lottery, for example, at a predetermined cycle, and based on the result of this movement lottery, there are cases where JUNO moves to other areas and cases where JUNO moves to other areas based on event detection.

[0430] Also, as shown in FIGS. 84A and 84B, when JUNO moves to other areas based on the result of the movement lottery performed at a predetermined cycle, the movement lottery performed at a predetermined cycle is performed with the same movement probabilities as in the cases of low and medium intimacy levels, for example, as shown in FIGS. 63 and 64 above. The above-mentioned predetermined cycle is performed, for example, at a cycle of about 1 to 10 minutes. Also, when JUNO that has won the movement lottery moves to other areas, the processing substrate 224 determines the cycle for performing the movement lottery by lottery after the movement. In this case, the areas where JUNO can move are, for example, any of areas 1 to 5.

[0431] As shown in FIG. 84B, when the intimacy level is high, the probability that JUNO moves to area 1 based on the result of the movement lottery is, for example, 30 to 50%. Similarly, the probability that JUNO moves to area 2 is, for example, 20 to 30%, the probability that JUNO moves to area 3 is, for example, 20 to 10%, the probability that JUNO moves to area 4 is, for example, 20 to 7%, and the probability that JUNO moves to area 5 is, for example, 10 to 3%.

[0432] Next, the movement to other areas based on event detection will be described. For event detection, for example, there are feeding event detections that may occur when the user feeds, nail trimming event detections that may occur randomly, human detection event detections that may occur by human detection, and the like.

[0433] (When a feeding event is detected) FIG. 85A is an example of an explanatory diagram of movement to other areas when a feeding event is detected in the system 1 according to an embodiment in the case of high intimacy. FIG. 85B is an example of an image showing an example when a feeding event is detected in the system 1 according to an embodiment in the case of high intimacy.

[0434] In FIG. 85A, for example, the movement start condition, the condition for escaping to area 5, the behavior of JUNO after finishing eating the bait, and the like are described.

[0435] When the user feeds (that is, when the bait appears), a feeding event is detected. When a feeding event is detected, the processing board 224 obtains the probability that JUNO eats the bait. Although it is described in FIG. 85A as "calculating the probability of eating from the intimacy sheet", the intimacy sheet is the same as in the case of low or medium intimacy, and for example, the movement probability to area 1 shown in FIG. 64 is diverted.

[0436] When the movement start condition is satisfied, the processing board 224 determines to start the behavior for JUNO to eat the bait. Then, when it is determined to start the behavior for JUNO to eat the bait, the processing board 224 displays the behavior pattern of starting to move while being vigilant for JUNO to eat the bait. For example, as shown in FIG. 85B, JUNO moves from the current area to area 1 where the bait is placed. However, in the case of high intimacy, JUNO is often in area 1, and when a feeding event occurs when JUNO is in area 1, JUNO starts eating the bait in area 1. Note that in the case of high intimacy, conditions such as escaping to area 5 are not set. Also, even if an external event is detected, it will not escape.

[0437] After JUNO finishes eating the bait, the processing substrate 224 conducts a movement lottery at a predetermined cycle. If it wins this movement lottery, the processing substrate 224 displays an action pattern of moving to another area. The destination area is determined based on the movement probabilities shown in FIGS. 63 and 64 described above. Note that until the movement lottery is conducted, the processing substrate 224 displays an action pattern in which JUNO stays in Area 1.

[0438] (When a nail trimming event is detected) FIG. 86A is an example of an explanatory diagram regarding movement to another area when a nail trimming event is detected in the system 1 according to an embodiment in the case of a high intimacy. FIG. 86B is an example of an image showing movement from Area 1 to Area 3 when a nail trimming event is detected in the system 1 according to an embodiment in the case of a high intimacy.

[0439] In FIG. 86A, for example, the movement start condition, the condition for JUNO to escape to Area 5, the behavior of JUNO after nail trimming, etc. are described.

[0440] Similar to the cases of low or medium intimacy, the nail trimming event occurs randomly, for example. When the nail trimming event is detected, the movement start condition is satisfied. The nail trimming event can be made to occur randomly, for example, by starting measurement with a timer based on external detection (for example, proximity detection (i.e., when a person is detected, for example, because the user approaches JUNO), gesture detection, call detection, or detection of a large sound of a predetermined decibel or more, etc.) and generating it when no external detection is detected for a predetermined time (for example, 5 minutes). Note that, for example, the nail trimming event may be made to occur randomly by lottery or the like. Note that in the case of high intimacy, conditions such as the condition to escape to Area 5 are not set. Also, even if an external event is detected, it will not escape.

[0441] When the movement start condition is satisfied, the processing board 224 determines that JUNO starts an action to sharpen its claws. Then, when it is determined that JUNO starts an action to sharpen its claws, the processing board 224 displays an action pattern in which JUNO starts moving while being vigilant to sharpen its claws. For example, as shown in FIG. 86B, for example, JUNO moves from area 1 to area 3 where the claw sharpener is placed.

[0442] When JUNO finishes claw sharpening, the processing board 224 conducts a movement lottery at a predetermined cycle. If winning this movement lottery, the processing board 224 displays an action pattern of moving to another area. The destination area is determined based on the movement probability shown in FIGS. 63 and 64 described above. Note that until the movement lottery is conducted, the processing board 224 displays an action pattern in which JUNO stays in area 3.

[0443] (When a human detection event is detected) FIG. 87A is an example of an explanatory diagram of movement to another area when a human detection event is detected in the system 1 according to an embodiment and the intimacy is high. FIG. 87B is an example of an image for explaining movement from an area other than area 1 to area 1 when a human detection event is detected in the system 1 according to an embodiment and the intimacy is high.

[0444] FIG. 87A describes, for example, the movement start condition, the actions of JUNO after moving to area 1, and the like.

[0445] As shown in FIGS. 87A and 87B, a human detection event occurs, for example, when externally detected when JUNO is in any of areas 1 to 4. When a human detection event is detected, the movement start condition is satisfied. When the movement start condition is satisfied, the processing board 224 displays an action pattern in which JUNO moves (approaches) to area 1. External detection corresponds to proximity detection (that is, for example, when a user approaches JUNO and is detected as a human), gesture detection, call detection, or when external detection such as detection of a sound greater than a predetermined decibel is detected).

[0446] After JUNO moves to Area 1, the processing substrate 224 conducts a movement lottery at a predetermined cycle. If it wins this movement lottery, the processing substrate 224 displays an action pattern of moving to another area. The destination area is determined based on the movement probabilities shown in FIGS. 63 and 64 described above. Note that until the movement lottery is conducted, the processing substrate 224 displays a staying action pattern in which JUNO is in Area 1.

[0447] (Communication function) Next, the communication function of JUNO in the case of high intimacy will be described with reference to FIGS. 88A and 88B. FIG. 88A is an example of a diagram for explaining a call response, which is an example of the communication function of JUNO in the case of high intimacy in the system 1 according to an embodiment. FIG. 88B is an example of an image for explaining area movement when there is a call in the case of high intimacy in the system 1 according to an embodiment.

[0448] As shown in FIG. 88A, when the response condition is satisfied, the processing substrate 224 can be controlled such that JUNO responds to a call from the user, for example, in Japanese. Further, the processing substrate 224 can be controlled such that the response content varies depending on the area where JUNO is located. Note that the response condition corresponds to, for example, the case where a call from the user is detected.

[0449] As shown in FIG. 88A, for a person detection event, when JUNO is in any of Areas 1 to 4, the processing substrate 224 can be controlled such that JUNO responds to a call from the user, for example, in Japanese or with a motion. Further, when JUNO is in Areas 2 to 4, the processing substrate 224 can be controlled such that JUNO responds to a call from the user, for example, with a motion.

[0450] When JUNO is in Area 1 and has not acquired Japanese, the processing board 224 controls as follows. That is, for example, when an event such as a call from the user is detected, the processing board 224 controls JUNO to respond with motion in accordance with the event detection.

[0451] Also, when JUNO is in Area 1 and has acquired Japanese, the processing board 224 controls as follows. That is, for example, when an event such as a call from the user is detected, if JUNO remembers the called Japanese (that is, if the called Japanese has been acquired), the processing board 224 controls JUNO to respond in Japanese. On ...

Claims

1. A display unit, control means having a function of displaying characters on the display unit, and the control means, when the character is displayed in the first display area, moves and displays the character in response to detecting a person, and when the character is displayed in the second display area, has a function of not moving the character even when a person is detected. A system characterized by the above.

2. The control means has a function of moving and displaying the character to the second display area in response to detecting a person when the character is displayed in the first display area. The system according to claim 1, characterized by the above.

3. The control means has a function of moving and displaying the character based on not detecting a person for a predetermined time when the character is displayed in the second display area. The system according to claim 1 or 2, characterized by the above.

4. The control means has a function of moving and displaying the character to the second display area based on not detecting a person for a predetermined time when the character is displayed in the second display area. The system according to any one of claims 1 to 3, characterized by the above.

5. A program for causing a computer to realize the functions of the control means according to any one of claims 1 to 4.

Images