Display device

Abstract

To enhance the visual effect of a display device.SOLUTION: A display device 1 is provided, comprising a housing 100 having a shielded image display space therein and an image viewing area SC provided on a first direction side of the image display space, and an image display unit configured to form a floating image in the image display space.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to a display device and the like. [Background technology]

[0002] Patent Document 1 describes a stereoscopic image display device that does not require special glasses. This stereoscopic image display device includes a light source, a liquid crystal display panel, and a parallax barrier disposed on the viewer's side of the liquid crystal display panel. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2003-295113 Summary of the Invention [Problem to be solved by the invention]

[0004] One of the objects of the present invention is to enhance the visual effect of a display device.

[0005] The purpose of the present invention is not limited to this, and the applicant intends to obtain rights for configurations that aim to achieve the effects achieved by the components disclosed in the specification and drawings, etc., through divisional applications, amendments, etc. For example, this specification discloses problems in which the phrase "can be" is read as "the problem is...." Each problem is described as an independent problem, and the applicant intends to obtain rights for configurations that solve each problem separately through divisional applications, amendments, etc. Even if the problem is implicitly understood from the description in the specification, the applicant intends to include part of the configuration described in this specification in the scope of the patent claim through amendments or divisional applications. Furthermore, the applicant has disclosed configurations that solve problems that combine these independent problems, and the applicant intends to obtain rights for these configurations. [Means for solving the problem]

[0006] (1) It is desirable to provide a display device having a housing with a light-shielded image display space inside and an image observation area on a first direction side of the image display space, and an image display unit that forms an aerial image in the image display space.

[0007] In this way, the floating image combined with the image display space is displayed in a relatively dark space as seen from the observer's side, thereby enhancing the three-dimensional effect of the floating image given to the observer, thereby enhancing the visual effect of the display device.

[0008] (2) It is preferable to provide a display device having a light-reducing member that reduces external light that enters the image display space from the observation area.

[0009] In this way, the light-reducing member reduces the amount of external light entering the image display space, so the image display space can be kept dark, and the three-dimensional effect of the aerial image that can be given to the viewer can be enhanced.

[0010] (3) The image display unit may include a first display unit that emits first image light and an optical system that forms the aerial image based on the first image light, and may be a display device that has a shading element between the dimming element and the optical system on the optical path of the reflected light of the first image light that is reflected by the dimming element.

[0011] In this way, it is possible to prevent the image displayed in the image display space due to the first image light being reflected by the light reducing member from being observed by the viewer.

[0012] (4) The display device may be such that the light blocking member is provided at a position that does not overlap the observation area when viewed from the first direction side.

[0013] In this way, even if an observer looks into the image display space from the observation area, the first image light is reflected by the dimming member, thereby preventing the observer from observing the image displayed in the image display space.

[0014] (5) The image display unit may include a first display unit that emits first image light and an optical system that forms the aerial image based on the first image light, and the optical system may be a display device that is positioned to avoid an area on the optical path of the reflected light of the first image light reflected by the dimming element.

[0015] In this way, it is possible to prevent the image displayed in the image display space due to the first image light being reflected by the light reducing member from being observed by the viewer.

[0016] (6) The optical system may include an optical element having a first surface onto which the first image light is incident and a second surface opposite the first surface, and the optical element may be a display device that reflects the first image light toward the first direction and transmits light incident on the second surface toward the first surface.

[0017] In this way, the second surface of the optical element can be superimposed on the aerial image combined using the optical element, allowing the viewer to observe the second surface, thereby further enhancing the three-dimensional effect of the aerial image that can be given to the viewer.

[0018] (7) The display device may include a second display unit that emits second image light that overlaps the aerial image when viewed from the first direction.

[0019] This increases the degree of freedom in selecting the image that the viewer can view by superimposing it on the floating image.

[0020] (8) The display device may be configured such that the luminance of the first display section is higher than the luminance of the second display section.

[0021] In this way, the difference in luminance between the first display section and the second display section can further enhance the three-dimensional effect of the aerial image that can be given to the viewer.

[0022] (9) The first display unit may be a display device that is positioned above the observation area with the display surface facing downward and is inclined so that a second direction side opposite the first direction is lower than the first direction side.

[0023] In this way, an aerial image can be formed using the optical member on the first display unit disposed above the observation area.

[0024] (10) The display surface of the first display unit may be a display device that is inclined at an angle of approximately 20 degrees relative to the horizontal.

[0025] In this way, the three-dimensional effect of the aerial image that can be given to the observer can be further enhanced, and the first image light can be reflected by the dimming member, making it more difficult to observe the image displayed in the image display space.

[0026] (11) The second display unit may be a display device that is disposed below the observation area with its display surface facing upward.

[0027] In this way, the image displayed on the second display screen appears to be located below the aerial image, thereby further enhancing the three-dimensional effect of the aerial image that can be given to the viewer.

[0028] (12) The first display unit may be a display device that emits the first image light so that the aerial image can be observed on the second display surface.

[0029] In this way, the floating image is observed as if it were positioned above the image displayed on the second display screen, and the three-dimensional effect of the floating image that can be imparted to the viewer can be further enhanced.

[0030] (13) The housing may be a display device having a first housing space above the first display unit, and a processing board disposed on the second direction side of the first housing space.

[0031] In this way, the processing substrate can be placed in an area of ​​the first housing space that is secured above the first display unit and that has a relatively large margin in the height direction.

[0032] (14) The processing board may have a mounting portion to which an external device can be attached and detached, and the mounting portion may be a display device exposed to the outside of the housing from the second direction side of the housing.

[0033] In this way, the part of the mounting section to which the external device can be detachably attached that is exposed to the outside of the housing can be made less visible to the viewer.

[0034] (15) The display device may have a sensor provided below the observation area, and the processing substrate may be a display device that performs processing in accordance with information measured by the sensor.

[0035] This prevents the sensor configuration from interfering with the observation of the aerial image.

[0036] (16) The display device may include a sensor substrate on which the sensor is mounted, the sensor substrate being provided on the first direction side of the housing.

[0037] In this way, it is possible to prevent the sensor configuration from interfering with the observation of the aerial image.

[0038] (17) The sensor may be a display device including a sensor for detecting gestures.

[0039] In this way, when the observer makes a gesture, it is possible to prevent parts of the observer's body from interfering with the observation of the aerial image.

[0040] (18) The housing may have a second housing space below the image display space, and the display device may have a control board provided in the second housing space that supplies a signal from the sensor to the processing board.

[0041] This arrangement makes it possible to prevent the dimensions of the housing above the observation area from becoming larger than when the control board is housed in the first housing space above the first display unit.

[0042] (19) The display device may preferably have a wiring section that electrically connects the control board and the processing board, and a partition member that separates the wiring section so that it cannot be observed from the image display space side.

[0043] This arrangement makes it possible to prevent the wiring portion electrically connecting the control board and the processing board from being seen.

[0044] (20) The processing board may be a display device that controls the display of the first display unit in accordance with information measured by the sensor.

[0045] In this way, the aerial image can be changed according to the information measured by the sensor.

[0046] (21) The display device may include a viewing angle control member provided on the display surface of the first display portion, the viewing angle being narrowed in the first direction.

[0047] This makes it possible to prevent the image displayed on the first display surface from being directly viewed by the viewer.

[0048] (22) The first image light may be image light of an image that is recognized as a two-dimensional image.

[0049] In this way, even when the first display unit that displays an image that is recognized as a two-dimensional image is used, it is possible to give the observer a three-dimensional feeling of the floating image.

[0050] (23) The housing may have a configuration in which a plurality of parts are joined by fasteners, and the fasteners may be a display device that is not exposed at least from the first direction side.

[0051] This can prevent the fixing member from being seen by the viewer, thereby improving the aesthetic appearance of the display device.

[0052] (24) It is preferable that at least a part of the portion of the display device facing the image display space is treated to reduce light reflection.

[0053] This makes it easier to maintain the image display space in a dark state, thereby further enhancing the three-dimensional effect of the aerial image that can be given to the viewer.

[0054] (25) The housing may be a display device having a portion that surrounds the observation area when viewed from the first direction side.

[0055] In this way, the floating image displayed in the image display space and the housing located in front of it can be combined to further enhance the three-dimensional effect of the floating image that can be given to the viewer.

[0056] (26) The image display unit may be a display device that displays an image of a character representing a cat.

[0057] In this way, it is possible to display a three-dimensional image of a character representing a cat.

[0058] (27) The image display unit may be a display device that changes the image based on a communication function that reproduces communication between the character and an observer who observes the character.

[0059] In this way, the image of the character representing the cat can be changed based on the communication function.

[0060] (28) It is preferable that the device further include an odor sensor that detects odors, and operation control means that executes at least one of a display output operation that displays on the video display unit an image of a character performing a movement corresponding to the detection result by the odor sensor, and an audio output operation that outputs audio corresponding to the detection result by the odor sensor as audio emitted by the character displayed on the video display unit.

[0061] In this way, it is possible to reproduce communication related to odors between the character displayed on the video display unit and the user. For example, when an odor is detected by the odor sensor, the character may be controlled to output a sound such as "I smell something," or to display an image of the character sniffing an odor. This allows for more diverse communication between the character and the user.

[0062] (29) The display output operation may be an operation of displaying on the video display unit an image of a character displayed on the video display unit performing an action corresponding to the type of odor detected, and the audio output operation may be an operation of outputting an audio corresponding to the type of odor detected as an audio emitted by the character displayed on the video display unit.

[0063] In this way, communication regarding the type of odor can be reproduced between the character displayed on the video display unit and the user. For example, when a cigarette odor is detected, a display output operation may be performed in which an image of the character making a fussy motion or a voice output operation may be performed in which words expressing concern for the user's health are spoken. Furthermore, when the odor of a fragrance such as aroma oil is detected, a voice output operation may be performed in which a question regarding the fragrance is spoken. By performing such control, the range of communication between the character displayed on the video display unit and the user can be expanded, and the user's attachment to the character can be increased.

[0064] (30) The device may further include a voice detection means capable of detecting voice and a detection means capable of detecting the presence of a person in the detection target area, and when the voice detection means detects the presence of a person in the detection target area, the voice detection means may enable voice recognition to enable a dialogue with a character displayed on the video display unit.

[0065] In this way, when the user interacts with the character displayed on the video display unit, the user does not need to utter a trigger word to activate voice recognition, for example, and communication can be more natural.

[0066] (31) It is preferable that the device further include a wind detection means for detecting wind, and an operation control means for executing at least one of a display output operation for displaying on the video display unit an image of a character performing a movement corresponding to the detection result by the wind detection means, and an audio output operation for outputting audio corresponding to the detection result by the wind detection sensor as audio uttered by the character displayed on the video display unit.

[0067] In this way, it is possible to reproduce communication between the character displayed on the video display unit and the user through wind applied to the display device. The wind may be generated artificially by the user, for example, by moving a body part such as waving a hand towards the display device, or by blowing air onto the display device.

[0068] (32) The operation control means may perform the display output operation or the audio output operation in response to the breath blown by the user, based on the detection result by the wind detection means.

[0069] In this way, communication can be reproduced between the character displayed on the video display unit and the user in response to the breath blown onto the display device.

[0070] The inventions described in (1) to (32) above can be combined in any way. For example, it is desirable to combine all or part of the invention described in (1) with at least part of the structure of at least one of the inventions described in (2) and subsequent paragraphs. In particular, it is desirable to combine the invention described in (1) with at least part of the structure of at least one of the inventions described in (2) and subsequent paragraphs. Furthermore, it is also possible to extract any structure from the inventions described in (1) to (32) and combine the extracted structures. The applicant of this application intends to obtain rights to inventions including these structures. Furthermore, even if a description is made of "in the case of..." or "when...," it is not intended to describe a structure limited to that case or time. These are merely examples of better structures, and the applicant intends to obtain rights to structures other than these cases or times. Furthermore, any descriptions that specify an order are not limited to this order. The applicant also discloses structures in which some parts have been deleted or the order has been changed, and the applicant intends to obtain rights to such structures. [Effects of the Invention]

[0071] According to the present invention, the visual effect of the display device can be improved.

[0072] The effects of the present invention are not limited to these, and the effects achieved by the components disclosed in the specification and drawings, etc. are also disclosed, and the applicant intends to obtain rights to the components that achieve these effects through divisional applications, amendments, etc. For example, in this specification, a phrase such as "can..." clearly states the effect achieved, and there are parts that demonstrate the effect even without the phrase "can...". Furthermore, there are effects that can be understood from the configuration even without such a phrase. [Brief explanation of the drawings]

[0073] [Figure 1A] 1 is a diagram illustrating an overview of a display device according to an embodiment. [Figure 1B] 1 is a diagram illustrating an overview of a display device according to an embodiment. [Figure 1C]FIG. 1 is a diagram illustrating a character according to an embodiment. [Figure 2] 1 is a diagram showing an external configuration of a display device according to an embodiment; [Figure 3] 1 is a diagram showing an external configuration of a display device according to an embodiment; [Figure 4] 1 is a diagram showing an external configuration of a display device according to an embodiment; [Figure 5] 1 is a front view of a display device according to an embodiment; [Figure 6] FIG. 2 is a right side view of the display device according to the embodiment. [Figure 7] FIG. 1 is a left side view of a display device according to an embodiment. [Figure 8] 1 is a plan view (top view) of a display device according to an embodiment. [Figure 9] FIG. 2 is a rear view of the display device according to the embodiment. [Figure 10] FIG. 2 is a bottom view of the display device according to the embodiment. [Figure 11] 1 is a rear view of a display device according to an embodiment with a rear cover removed. FIG. [Figure 12] FIG. 1 is a diagram illustrating an example of how a display device according to an embodiment is used. [Figure 13] 1A and 1B are diagrams illustrating the principle of display on a display device according to an embodiment. [Figure 14] FIG. 1 is a diagram illustrating an internal configuration of a display device according to an embodiment. [Figure 15] FIG. 1 is a diagram illustrating an internal configuration of a display device according to an embodiment. [Figure 16] FIG. 1 is a diagram illustrating an internal configuration of a display device according to an embodiment. [Figure 17] FIG. 1 is a diagram illustrating an internal configuration of a display device according to an embodiment. [Figure 18] FIG. 1 is a diagram illustrating an internal configuration of a display device according to an embodiment. [Figure 19] FIG. 1 is a diagram illustrating an internal configuration of a display device according to an embodiment. [Figure 20]FIG. 1 is a diagram illustrating an internal configuration of a display device according to an embodiment. [Figure 21] FIG. 1 is a diagram illustrating an internal configuration of a display device according to an embodiment. [Figure 22] FIG. 1 is a diagram illustrating an internal configuration of a display device according to an embodiment. [Figure 23] FIG. 1 is a diagram illustrating an internal configuration of a display device according to an embodiment. [Figure 24] FIG. 1 is a diagram illustrating an internal configuration of a display device according to an embodiment. [Figure 25] FIG. 1 is a diagram illustrating an internal configuration of a display device according to an embodiment. [Figure 26] FIG. 1 is a diagram illustrating an internal configuration of a display device according to an embodiment. [Figure 27] FIG. 1 is a diagram illustrating an internal configuration of a display device according to an embodiment. [Figure 28] 1A and 1B are diagrams illustrating a cause of a virtual image being displayed on a display device according to an embodiment. [Figure 29] 1A and 1B are diagrams illustrating causes of reflection in a display device according to an embodiment. [Figure 30] 1A to 1C are diagrams illustrating the principle of displaying a virtual image and suppressing reflections in a display device according to an embodiment. [Figure 31] 1A and 1B are diagrams illustrating a cause of a virtual image being displayed on a display device. [Figure 32] 1 is a front view of a display device according to an embodiment; [Figure 33] FIG. 2 is a control block diagram of a display device according to an embodiment. [Figure 34] FIG. 1A is a flowchart for reproducing communication related to smells, and FIG. 1B is a diagram showing a voice management table related to smells. [Figure 35] This is a flowchart for reproducing communication regarding frequency of stay. [Figure 36] FIG. 10A is a flowchart for reproducing communication related to a place of stay, and FIG. 10B is a diagram showing a voice management table related to a place of stay. [Figure 37] FIG. 10A is a flowchart for reproducing communication related to the number of visits, and FIG. 10B is a diagram showing a voice management table related to the number of visits. [Figure 38] FIG. 10A is a flowchart for reproducing communication related to stay time, and FIG. 10B is a diagram showing a voice management table related to stay time. [Figure 39] 1A is a flowchart for reproducing communication related to behavioral patterns, and FIG. 1B is a diagram showing a voice management table related to behavioral patterns. [Figure 40] 10 is a flowchart for reproducing an operation relating to the detection of a suspicious person. [Figure 41] FIG. 10 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. [Figure 42] FIG. 10 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. [Figure 43] FIG. 10 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. [Figure 44] FIG. 10 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. [Figure 45] FIG. 10 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. [Figure 46] FIG. 10 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. [Figure 47] FIG. 10 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. [Figure 48] FIG. 10 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. [Figure 49] FIG. 10 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. [Figure 50] FIG. 10 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. [Figure 51] FIG. 10 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. [Figure 52] FIG. 10 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. [Figure 53] FIG. 10 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. [Figure 54] FIG. 10 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. [Figure 55] FIG. 10 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0074] Hereinafter, embodiments will be described in detail with reference to the drawings. The embodiments described below are examples of embodiments of the present disclosure, and the present disclosure is not limited to these embodiments. In the drawings referred to in the present embodiments, identical parts or parts having similar functions are designated with the same or similar symbols (symbols consisting of a number followed by A, B, etc.), and repeated explanations may be omitted. In addition, in each of the drawings referred to in the following description, the scale may be different from the actual scale in order to make each component, region, etc. recognizable.

[0075] <1. Overview of Display Device 1> 1A and 1B are diagrams illustrating an overview of a display device according to one embodiment of the present invention. The display device 1 displays an image so that an observer can observe the image through an observation area SC. In this embodiment, observation may be interpreted as meaning to look or to visually inspect. The observer is a user of the display device 1, for example, a person who observes an image displayed on the display device 1. The observation area SC is an area provided on the front side of the display device 1, and is a rectangular area in this case. The display device 1 displays an image by aerial imaging. Aerial imaging refers to forming an image in the air, for example, by utilizing light reflection. Aerial imaging is sometimes employed to give the observer the sensation that the image is floating in a predetermined space. An image displayed by aerial imaging is called an aerial image.

[0076] In the case shown in FIG. 1A, the display device 1 displays a character 1100 as an aerial image. The character 1100 is a female character. The display device 1 further displays a stage image 2100, which represents a stage, below the character 1100. In this case, the stage image 2100 represents a magic circle. An observer who sees such a display can get the impression that the character 1100 is standing on a stage. The colors of the character 1100 and the stage image 2100 are not particularly important. For example, the skin of the character 1100 is flesh-colored. The hair color and the clothing on the upper body of the character 1100 are a relatively light bluish color (e.g., light blue), the accessories held to the knees are a darker bluish color (e.g., blue), and the skirt and shoes are white. The stage image 2100 is a relatively dark bluish color (e.g., dark light blue).

[0077] In the case shown in FIG. 1B(a), the display device 1 displays a character 1200 as an aerial image. The character 1200 is a cat character. In the case shown in FIG. 1B(b), the display device 1 displays a stage image 2200, which indicates a stage, below the character 1200. In this case, the stage image 2200 displays the character string "Yupiteru" and the character string "Juno" (pronounced "Yuno"), which is the name of the character 1200, alternately along the periphery of a circular stage.

[0078] The colors of the character 1200 and the stage image 2200 are not particularly important. The character 1200 and the stage image 2200 will now be described in more detail with reference to FIG. 1C . The character 1200 is broadly divided into a character main body 1210 and a collar 1220. The character main body 1210 is the cat character named "Juno" here. The character main body 1210 includes body parts shown in white, such as the area between the eyebrows, around the nose and mouth, the abdomen, and the front parts of the legs. The body parts of the character main body 1210 shown in light gray are a relatively light brown color (e.g., ochre), such as the areas above and beside the eyes on the face, the upper part of the torso, and the parts of the legs other than the front parts. Among the body parts of the character main body 1210, parts shown in darker gray are an even darker brown color (e.g., brown), such as the parts with thin stripes on the face, head, torso, and legs. Collar 1220 refers to a collar displayed on the neck of character main body 1210. Collar 1220 is a reddish color (e.g., red). A tag 1221 is attached to the collar 1220 below the face of character main body 1210. Tag 1221 is circular and bears a predetermined mark. The mark is a "V"-shaped symbol with a "●" (a circle with a filled-in interior) below it, and each mark is written in a reddish color (e.g., red). The mark written on tag 1221 may function as a trademark indicating the source of display device 1. The stage image 2200 is generally brown in color, with the circle and text being a relatively dark brown (e.g., brown), and the image resembling smoke inside the circle being a lighter brown (e.g., ochre).

[0079] In Figures 1A, 1B and 1C, the background of characters 1100, 1200 is shown as black, but it is not limited to pure black and may be a relatively dark background (for example, black or other dark colors).

[0080] The characters shown in FIGS. 1A, 1B, and 1C are examples. When displaying a humanoid character, the display device 1 is not limited to a female character and may display a male character. The display device 1 may display any of real people (e.g., family members), real people who existed in the past (e.g., historical figures), and fictional characters (e.g., characters appearing in fictional works such as manga and anime). When displaying a non-humanoid animal character, the display device 1 is not limited to a cat character and may display any of animal characters that can be kept in an ordinary household, such as a dog or a hamster, other animal characters such as a horse or a cow, and fictional animal characters (e.g., characters appearing in fictional works such as manga, anime, and others). The display device 1 may also display other characters having a collar 1220.

[0081] Based on the communication function, the display device 1 moves body parts of the character or outputs sounds that imitate the character's speech. The communication function is a function that reproduces communication between an observer and a character, or a function that reproduces pseudo-communication. In the communication function, the character moves in response to the behavior of the observer (e.g., speech or body movements). For example, the character 1100 performs movements that reproduce normal human actions, such as moving the entire body, such as dancing, or changing facial expressions (e.g., expressing emotions such as joy, anger, sadness, and happiness). For example, the character 1200 performs movements that reproduce normal animal actions (e.g., yawning, moving its tail, walking, etc.). Furthermore, the display device 1 outputs, for example, a singing sound that makes the character 1100 sound as if it were singing, or outputs sounds related to a conversation with the observer, in accordance with the movement of the character 1100. For example, the display device 1 outputs sounds that represent the meowing of a cat, or sounds related to a conversation with the observer, in accordance with the movement of the character 1200. Such output of video and audio is not limited to the communication function, and may be performed by various functions of the display device 1.

[0082] Dialogue with a user in the communication function may be realized, for example, by cooperation between a voice recognition application (an application having the function of a voice recognition engine) incorporated in the display device 1, an external voice recognition server (not shown), and an external dialogue server (not shown). For example, when an operation unit 2214 (described later) is pressed, the voice recognition application is started and voice recognition for dialogue with a character is enabled. In this embodiment, enabling voice recognition means operating the voice recognition function, for example, turning on the voice recognition engine and putting the device into a state waiting for voice input. Then, voice uttered by the user (also referred to as user voice) is transmitted from a communication control circuit 706 of a processing board 224 (described later) to the voice recognition server, which then performs voice recognition processing on the user voice and outputs the voice recognition result. For example, the dialogue server pre-registers voices (also referred to as character voices) uttered by characters (e.g., character 1100) displayed on the display device 1 (e.g., a video display unit (described later)) for each character string that can be input, in association with each other. Then, the speech recognition result by the speech recognition server (for example, the speech recognition result shown as a character string) is input to the dialogue server, and the character's voice corresponding to the speech recognition result is output from the dialogue server. The character's voice output by the dialogue server is then output from the display device 1. In this way, a response process to the user's voice is executed, and the dialogue between the user and the character is reproduced.

[0083] The display device 1 is used by a general user, for example, as a display device for entertainment. In this case, the display device 1 is used, for example, in the user's residence, such as the user's home. However, the display device 1 may be used for commercial purposes (for example, advertising) or other purposes. For example, in the case of commercial use, the display device 1 is installed in a public place such as a store or other commercial facility. The display device 1 may display video in which a character introduces or advertises a product or service at a venue such as an exhibition of the product or service. The display device 1 may also be used for purposes other than these.

[0084] <2. External Configuration of Display Device 1> 2, 3, and 4 are perspective views showing the external configuration of the display device 1. FIG. 2 is a view of the display device 1 as seen from diagonally forward right. FIG. 3 is a view of the display device 1 as seen from slightly above diagonally forward left. FIG. 4 is a view of the display device 1 as seen from slightly below diagonally forward right. FIG. 5 is a front view of the display device 1. FIG. 6 is a right side view of the display device 1. FIG. 7 is a front side view of the display device 1. FIG. 8 is a plan view (top view) of the display device 1. FIG. 9 is a bottom view of the display device 1. FIG. 10 is a rear view of the display device 1.

[0085] The display device 1 has a rectangular parallelepiped appearance. The display device 1 has a housing 100. The housing 100 is a box-shaped component that forms the outer shape of the display device 1. The housing 100 is rectangular parallelepiped. The housing 100 is longer in the height direction (also referred to as the up-down direction) than in the width direction (also referred to as the left-right direction). The width and depth directions (also referred to as the front-rear direction) of the housing 100 are approximately the same length. The ratio of the width, height, and depth directions (also referred to as the front-rear direction) of the display device 1 is approximately 2:3:2. In the following description, the side of the depth direction of the display device 1 where the viewer is located will be referred to as the "front side" (corresponding to the first direction side), and the opposite side will be referred to as the "rear side" (corresponding to the second direction side).

[0086] The housing 100 has rounded corners. As shown in FIG. 5, when the display device 1 is viewed from the front, each of the four corners of the housing 100 is rounded. The surface of the housing 100 may be matte-finished to enhance its texture. This provides a rectangular parallelepiped display device 1 with excellent design. The housing 100 is preferably formed from a resin material, but may also be formed from metal or other materials. The housing 100 has a light-shielding image display space inside. The image display space is the space inside the housing 100 where an aerial image is displayed (formed). The image display space is entirely or largely formed from a light-shielding material. Therefore, the materials constituting the housing 100 prevent external light from entering the image display space. For example, the entire housing 100 may be formed from a material that blocks external light, or the outer surface or the surface facing the image display space may be covered with a light-shielding material. The color of the outer surface of the housing 100 is not important, but it is preferable to use white or black, which give off a sense of luxury or simplicity. The display device 1 should be small enough and light enough for a person such as an observer to carry it by itself.

[0087] The portions of the housing 100 that are exposed to the outside are divided into a right panel 101, a front panel 102, a left panel 103, a rear panel 104, an upper cover 105, and a lower cover 106. The right panel 101, the front panel 102, the left panel 103, the rear panel 104, the upper cover 105, and the lower cover 106 are plate-shaped members. The right panel 101 is a panel located on the right side of the housing 100 when viewed from the front. The left panel 103 is a panel located on the left side of the housing 100 when viewed from the front. The right panel 101 and the left panel 103 have the same shape and dimensions. Furthermore, the right panel 101 and the left panel 103 are symmetrical in the height direction, and the same mold can be used to form the right panel 101 and the left panel 103. Therefore, the right panel 101 and the left panel 103 can use the same material, which is expected to reduce costs and the effort required for assembly.

[0088] The front panel 102 is located on the front side of the display device 1. The front panel 102 has an opening 110 into which a dimming member 200 can be attached. An observation area SC is provided in the front panel 102. The observation area SC is an area observed by an observer who views an image displayed on the display device 1. The observation area SC is also an area where the opening 110 formed in the housing 100 exists. The dimming member 200 is provided in the observation area. The dimming member 200 is provided standing in the vertical direction so as to cover the opening 110. The dimming member 200 and the opening 110 are provided above the center of the height direction of the housing 100 when viewed from the front side of the display device 1. The dimming member 200 and the opening 110 are square or rectangular.

[0089] The light-reducing member 200 includes a rectangular (or square) first region 210 used for observing an image, and a second region 220 surrounding the first region 210. The second region 220 is an edge portion that is not used for observing an image, and therefore may be a region that does not transmit light. Therefore, the observation region SC can also be said to be the region where the first region 210 exists. In the following description, when the light-reducing member 200 is referred to, it may be thought of as the first region 210.

[0090] The light-reducing member 200 is an optical member that reduces external light entering the image display space from the observation area SC. The light-reducing member 200 is provided to maintain the image display space in a dark state. The light-reducing member 200 is provided to suppress the occurrence of reflections of the observer in the observation area SC and to make it difficult for the observer to observe components inside the image display space. The light-reducing member 200 is a plate-shaped (including panel-shaped) member, but may also be a sheet-shaped or film-shaped member. The light-reducing member 200 may also be a member called a smoke panel or smoke film. The light-reducing member 200 has, for example, a light transmittance of 24% and a thickness of approximately 2 mm. The light-reducing member 200 is translucent enough to not interfere with the observation of the image displayed in the image display space of the display device 1. The light-reducing member 200 is a dark-colored, e.g., black, translucent member, but may also be blue or other colors.

[0091] The information area ST is provided on the front panel 102 below the observation area SC (the light-reducing member 200 and the opening 110). The information area ST is located in an opening in the front panel 102. The information area ST is an area where sensors are used to collect and present predetermined information to the observer. Electronic components provided in the information area ST include a first sensor 2331, a second sensor 2332, a microphone 2333, and a light-emitting unit 2334. The first sensor 2331 is a gesture sensor that detects gestures made by the observer. The second sensor 2332 includes one or more sensors other than a gesture sensor. Examples of the second sensor 2332 include a gas sensor (odor sensor), a temperature sensor, and an illuminance sensor. The microphone 2333 collects sound and converts the collected sound into an audio signal. The light-emitting unit 2334 emits light to present predetermined information. The light-emitting unit 2334 includes, for example, a light-emitting body (e.g., a light-emitting diode) that emits light in a predetermined color, and a light-guiding member that guides the light emitted by the light-emitting body. In this embodiment, the light-guiding member of the light-emitting unit 2334 is arranged so as to surround the area where the first sensor 2331, the second sensor 2332, and the microphone 2333 are provided. The light-emitting unit 2334 emits light in, for example, a bluish color (e.g., light blue), but may be configured to emit light in one or more colors such as greenish, reddish, or other colors. The light-emitting unit 2334 is not limited to a configuration including a light-guiding member, and may emit light in a predetermined area by, for example, a configuration including a plurality of light-emitting bodies.

[0092] An operation area OT is provided on the top cover 105. The operation area OT is an area that accepts operations performed by a viewer. The operation area OT is an area in which operation units 2211, 2212, 2213, and 2214 are provided. The operation units 2211, 2212, 2213, and 2214 are switches that accept press operations. The operation unit 2211 is operated to instruct the display device 1 to power on or off. The operation unit 2212 is operated to instruct the volume to be increased. The operation unit 2213 is operated to instruct the volume to be decreased. The operation unit 2214 is operated to instruct the execution of a predetermined function. The operation unit 2214 may be, for example, an operation unit called a special key. The operation unit 2214 may be operated, for example, to instruct the display device 1 to start voice recognition. Openings are provided in top cover 105 corresponding to the positions where operation units 2211, 2212, 2213, and 2214 are provided. Operation units 2211, 2212, 2213, and 2214 are exposed to the outside by being positioned in each opening. Note that the number of operation units, functions assigned to the operation units, and acceptable operation methods described here are merely examples.

[0093] A human presence sensor 234 is provided on the lower cover 106. The human presence sensor 234 is exposed to the outside by being located in the opening of the lower cover 106. The human presence sensor 234 is a detection unit that detects the presence of a person (moving object) in the detection target space. In this embodiment, the human presence sensor 234 is a microwave Doppler sensor that emits microwaves and detects the presence of a person in the detection target space based on the reception intensity of the microwaves that are reflected waves. For example, the human presence sensor 234 detects whether a person is present in front of the display device 1.

[0094] The rear panel 104 of the display device 1 is provided with a power jack 2311 and a back cover 1041. The power jack 2311 is a jack to which a power cord is connected. The power jack 2311 receives power from an external power source or the like via the power cord. The back cover 1041 is a removable cover. When the back cover 1041 is removed, a slot 222 and a USB (Universal Serial Bus) connector 223 are exposed, as shown in FIG. 11 . The slot 222 is an attachment port into which an external storage medium is attached. The external storage medium is compatible with, for example, the microSD (registered trademark) standard, but may also be compatible with microSDHC or other SD card standards or other standards. The USB connector 223 is an attachment port into which a USB cable or a USB port of an external device compatible with the USB standard is attached. The display device 1 can input and output data to and from external devices via the slot 222 and the USB connector 223. The number of attachment ports may be greater than or equal to the number of attachment ports. The portions of the slot 222 and the USB connector 223 that are exposed to the outside of the housing are on the rear side of the display device 1, so they can be made less visible to the viewer. In addition, the number of attachment parts to which external devices are attached and the corresponding standards are not particularly important.

[0095] The housing 100 is configured by joining together a right panel 101, a front panel 102, a left panel 103, a rear panel 104, an upper cover 105, and a lower cover 106. In this embodiment, the joining method is screw fastening using screws, which are an example of fasteners. However, there are no screwed portions on the front panel 102 or the upper cover 105.

[0096] The right panel 101 is fastened with screws 710 and 720 at two locations, top and bottom, on the front side. The left panel 103 of the housing 100 is fastened with screws 730 and 740 at two locations, top and bottom, on the front side. The rear panel 104 is fastened with screws 751, 752, and 753 at three locations on the upper side, screws 754 and 755 at two locations near the center in the height direction, and screws 756, 757, and 758 at three locations on the lower side. The lower cover 106 is fastened with screws 761 and 762 at two locations on the front side. The front panel 102 and the upper cover 105 are parts that are relatively easily observed by an observer using the display device 1. On the other hand, the other parts are parts that are relatively difficult to observe by an observer using the display device 1. Therefore, the display device 1 can prevent the screw fastening points from being seen by the viewer, thereby maintaining the aesthetic appearance of the display device 1. This can also contribute to giving the viewer a sense of immersion in the image.

[0097] FIG. 12 is a diagram illustrating an example of how the display device 1 is used by an observer. FIG. 12 shows the positional relationship between the display device 1 and an observer U using it, as viewed from the left side of the display device 1. The display device 1 is placed on a desk 3000. A chair 3100 is placed in front of (on the forward side of) the display device 1. The observer U is seated in the chair 3100, facing the display device 1. In this example, the position of the observer U's eyes is higher than the top surface of the display device 1. Therefore, the observer U observes the observation area SC by looking down at an angle θ. The angle θ is the angle between the horizontal direction and the line of sight of the observer U. The angle θ is within a range of angles θ1 to θ2. The angle θ is, for example, 15 degrees. The horizontal distance between the observer U and the observation area SC is approximately 50 cm.

[0098] <3. Principles of display on the display device 1> Fig. 13 is a diagram illustrating the principles of display on display device 1. Fig. 13 shows a schematic diagram of the interior of display device 1 as viewed from the left side of display device 1. First display unit 310, optical member 320, and second display unit 330 are provided in image display space S1 inside housing 100. First display unit 310 and optical member 320 work together to form an image display unit that focuses an aerial image in image display space S1.

[0099] The first display unit 310 and the second display unit 330 are display units that display images. The first display unit 310 and the second display unit 330 are display units that have a light source, such as a liquid crystal display. The light source is a backlight. The first display unit 310 and the second display unit 330 display color (multicolor) images based on the three primary colors of red (R), green (G), and blue (B). In this embodiment, the first display unit 310 and the second display unit 330 display images that are recognized as two-dimensional images.

[0100] The first display unit 310 is an 8-inch liquid crystal display. In this case, for example, the first display unit 310 includes a backlight, which is an example of a light source, and a display body in which liquid crystal elements, which are an example of display elements, are arranged two-dimensionally. The light source is, for example, a white light source. The liquid crystal elements modulate light from the backlight on a pixel-by-pixel basis. The liquid crystal elements are configured, for example, by sandwiching liquid crystal molecules between a pixel electrode provided for each pixel and a common electrode shared by multiple pixels. The first display unit 310 has a first display surface 311 that emits first image light L1. The first display unit 310 emits image light for displaying characters 1100 and 1200, as shown in FIGS. 1A to 1C. The first display unit 310 is inclined so that one end on the observation area SC side is located above the observation area SC and the back side is lower. This inclination is equal to the inclination of the first display surface 311, which is approximately 20 degrees with respect to the horizontal plane. The inventors have found that if the tilt is set to approximately 20 degrees in this way, the three-dimensional effect of the aerial image that can be given to the viewer can be enhanced, and that it can be made more difficult to observe a virtual image formed in the image display space by the first image light L1 being reflected by the dimming member 200. The basis for this will be described later. However, this angle is just one example. In the width direction of the display device 1, the height of each position on the first display surface 311 is the same.

[0101] The optical element 320 is an example of an optical system that forms an aerial image based on the first image light L1 from the first display unit 310. The optical element 320 is optically transmissive and reflective. The optical element 320 is plate-shaped. In this example, the optical element 320 is a half mirror. The optical element 320 is made of an acrylic mitre and has a light transmittance of approximately 30%. The thickness of the optical element 320 is approximately 2 mm. The light transmittance is merely an example and may be, for example, 6%. Any light transmittance may be ensured that the observer can observe the aerial image displayed in the image display space S1. The optical element 320 is disposed in the image display space S1 at an angle relative to the opening 110 and the first display surface 311. The optical element 320 is inclined so that its tip on the observation area SC side is located below the observation area SC and is higher toward the rear side. This angle is 35 degrees relative to the horizontal plane. However, this angle is merely an example. In the width direction of the display device 1, the height of each position on the optical member 320 is the same.

[0102] The second display unit 330 is a 7-inch liquid crystal display. The second display unit 330 has a second display surface 331 that emits second image light L2 of the displayed image. The second display unit 330 displays an image V2 that corresponds to the stage images 2100 and 2200 in FIGS. 1A and 1B. The second display unit 330 is positioned so that the normal direction of the second display surface 331 faces upward. The second display surface 331 is located behind one end of the lower side of the optical member 320. A base 400 is provided closer to the front than the second display surface 331. The base 400 forms part of the components that form the image display space S1 of the housing 100. The top surface of the base 400 is located at approximately the same height as the second display surface 331, although the second display surface 331 may be slightly lower.

[0103] With the above configuration, first image light L1 emitted by first display unit 310 is incident on first surface 321 of optical member 320 at a predetermined angle. The incident first image light L1 is reflected by optical member 320 toward the front side of display device 1 at the predetermined angle. This reflected light L1r causes aerial image V1 to be recognized in image display space S1 of housing 100. Aerial image V1 is a virtual image recognized below the tip of the rear side of first display surface 311, for example, at a position below the intersection of first display surface 311 and optical member 320.

[0104] Second image light L2 emitted by second display unit 330 is incident on second surface 332 of optical member 320 and transmitted to first surface 321. Second image light L2 enters the viewer's eyes directly. Image V2 on second display surface 331 is a real image perceived as being located below aerial image V1. For example, aerial image V1 is perceived as being at the center of second display surface 331 in the front-to-back direction. In this manner, aerial image V1 is perceived as characters 1100 and 1200 in FIGS. 1A to 1C, and image V2 is perceived as stage images 2100 and 2200 in FIGS. 1A to 1C. Display device 1 provides a three-dimensional effect to the viewer by allowing the viewer to observe aerial image V1 combined using optical member 320, and the three-dimensional effect can be further enhanced by allowing the viewer to observe image V2 below it. Furthermore, by using the second display unit 330, the freedom of selection of the image that the observer can view along with the aerial image can be increased compared to when a light-emitting body and a light-guiding member are combined to emit light in a predetermined pattern.

[0105] It is desirable to provide a viewing angle control member 312 that narrows the viewing angle to the front side on the first display surface 311 of the first display unit 310. This prevents the viewer from directly observing the image displayed on the first display surface 311, even if the viewer approaches the observation area SC and looks up. The second display surface 331 is not provided with a viewing angle control member that narrows the viewing angle to the front side, so that the viewer can easily observe the image V2.

[0106] The above is the basic display principle of the display device 1. Furthermore, the display device 1 has a light reducing member 200 and a light blocking member 500 as components for enhancing the visual effect. The action and effect thereof will be described later.

[0107] <4. Internal configuration of display device 1> Next, the internal configuration of the display device 1 will be described. FIGS. 14, 15, 16, 17, and 18 are diagrams showing a state in which the right panel 101, the front panel 102, the left panel 103, and the rear panel 104 of the housing 100 have been removed. As shown in FIG. 14, removing the right panel 101 exposes the right inner panel 107. As shown in FIG. 15, removing the front panel 102 exposes the front inner panel 108. As shown in FIG. 16, removing the left panel 103 exposes the left inner panel 109. As shown in FIG. 16, removing the rear panel 104 exposes the wiring section 800 and the partition member 900.

[0108] The right inner panel 107 and the left inner panel 109 hold the first display unit 310 and the optical member 320 described in FIG. 13 by sandwiching them from both the left and right sides.

[0109] Screws 710 and 720 shown in Figures 2, 4, and 6 pass through holes H1 and H2 that pass through the right panel 101, front inner panel 108, and right inner panel 107 in sequence to connect them together. Screws 730 and 740 shown in Figures 3 and 7 pass through holes H3 and H4 that pass through the left panel 103, front inner panel 108, and left inner panel 109 in sequence to connect them together. Screws 751, 752, and 753 shown in Figure 10 secure the rear panel 104 and the top cover 105 together. Screw 754 secures the rear panel 104 and the right panel 101 together. Screw 755 secures the rear panel 104 and the left panel 103 together. Screws 765, 765, and 757 secure the rear panel 104 and the bottom cover 106 together.

[0110] 19, 20, 21, 22, 23, and 24 are views showing a state in which the right inner panel 107 and the left inner panel 109 have been removed. FIG. 19 is a view showing the display device 1 as viewed from the right side. FIG. 20 is a view showing the display device 1 as viewed from the left side. FIG. 21 is a view showing the display device 1 as viewed from diagonally below the right side. FIG. 22 is a view showing the display device 1 as viewed from diagonally above the right side. FIG. 23 is a view showing the display device 1 as viewed from diagonally below the left side. FIG. 24 is a view showing the display device 1 as viewed from diagonally above the left side.

[0111] Provided inside the housing 100 are a first display unit 310, an optical member 320, a second display unit 330, a base unit 400, and a light-blocking member 500. The first display unit 310, the optical member 320, the second display unit 330, and the base unit 400 have the same configuration as described with reference to FIG.

[0112] The light-shielding member 500 is provided on the optical path of the first image light L1 from the first display unit 310 that is reflected by the light-reducing member 200. The light-shielding member 500 covers one end of the optical member 320 that faces the light-reducing member 200 (observation region SC), in other words, one end that faces away from the first display unit 310, so as to prevent the reflected light from entering the optical member 320. The light-shielding member 500 is, for example, a member that absorbs visible light, but may be any member that blocks the transmission of the first image light L1. The light-shielding member 500 may be, for example, black or another dark color, but may be any other color. The reason for this, which will be described later, is to prevent the viewer from viewing an image (virtual image) that is formed in the image display space S1 when the first image light L1 is reflected by the light-reducing member 200. In particular, the light blocking member 500 prevents an observer from observing an image that may be observed when the observer views the image by peering into the image display space S1 from the observation area SC. In addition to this image, the light blocking member 500 also prevents an observer from observing external objects such as the ceiling. The upper surface of the light blocking member 500 is substantially horizontal, but is not limited to this.

[0113] A first plate 601 is provided above the first display unit 310, and a first storage space S2 (see FIGS. 19 and 20) for storing various components is formed above the first plate 601. A second plate 602 is provided below the second display unit 330, and a second storage space S3 (see FIGS. 25 to 27) for storing various components is formed below the base unit 400 and the second plate 602.

[0114] As shown in FIGS. 17 to 24, the first housing space S2 is a space separated from the image display space S1 by a first plate 601 provided on the first display unit 310. The first plate 601 is connected to the right inner panel 107 using screws 791, 792, and 793, and to the left inner panel 109 using screws 794, 795, and 796. An operation board 221, a processing board 224, speakers 2251 and 2252, and a holder 226 are provided in the first housing space S2. The operation board 221 is a board on which operation units 2211, 2212, 2213, and 2214 are mounted on its surface. The operation board 221 supplies signals corresponding to operations of the operation units 2211, 2212, 2213, and 2214 to the processing board 224. The processing board 224 functions as a processing board that controls the display device 1. The processing board 224 may be referred to as a main board. The processing board 224 is electrically connected to the operation board 221 and the speakers 225A and 225B via, for example, a printed circuit board (e.g., FPC). The processing board 224 is located on the rear side of the first housing space S2 in the depth direction of the display device 1. The processing board 224 is a so-called SoC board, and runs a processor and an OS (Operating System). The processing board 224 reads signals from sensors mounted on the sensor board 233 and audio signals from the microphone 2333 via the OS, and acquires signals corresponding to operations of the operation units 2211, 2212, and 2213 from the operation board 221. The processing board 224 performs control to display images on the first display unit 310 and the second display unit 330. A slot 222 and a USB connector 223 are mounted on the processing board 224 and are exposed from the rear side of the display device 1.

[0115] The speakers 2251 and 2252 are provided on both the left and right sides when viewed from the front side, and emit sound to the outside through openings 1051 and 1052 opened in the top cover 105. It is desirable that the speakers 2251 and 2252 are not too far away from the processing board 224. It is desirable that the speakers 2251 and 2252 are spaced apart so that the sounds from each other do not interfere with each other as much as possible.

[0116] The holder 226 is positioned so as to overlap the process substrate 224 and holds the process substrate 224 on its lower surface. A heat sink 2261 for heat dissipation or absorption is provided on the upper surface of the holder 226, opposite the side holding the process substrate 224. The first display unit 310 and the first plate 601 are inclined downward from the front side to the rear side. Therefore, the height dimension of the first housing space S2 gradually increases from the front side to the rear side, with more room in the height dimension toward the rear side. This allows for the housing to accommodate thick components such as the process substrate 224 and the holder 226. This prevents the housing portion above the observation area SC from becoming longer, contributing to the lighter and more compact display device 1 and also favorable in terms of design.

[0117] 25, 26, and 27 are diagrams showing the internal configuration of the display device 1 when the bottom cover 106 is removed. A second plate 602 is provided below the base 400 and the second display unit 330. A second housing space S3 is formed between the second plate 602 and the bottom cover 106. A control board 231, wiring 232, a sensor board 233, and a motion sensor 234 are provided in the second housing space S3. The front-side inner panel 108 is connected to the second plate 602 using screws 771, 772, 773, and 774. The front-side inner panel 108 is connected to the bottom cover 106 using screws 775, 776, and 777. The front-side inner panel 108 is fixed using screws 771 to 777, but since the front-side panel 102 covers the front-side panel 102 when the display device 1 is in use, the screws 771 to 777 are not exposed to the front side.

[0118] The control board 231 controls the supply of power and signals to the display device 1. The control board 231 is electrically connected to the processing board 224 via a wiring section 800, and sends and receives various signals and supplies power to the processing board 224. The control board 231 is electrically connected to the sensor board 233 and the human sensor 234 via wiring 232. The wiring 232 is, for example, a printed wiring board (for example, an FPC).

[0119] The sensor board 233 is a board on which a first sensor 2331, a second sensor 2332, and a microphone 2333 are mounted. The sensor board 233 is provided on the rear surface of the front-side inner panel 108, in an area below the light-reducing member 200 (observation area SC). The sensor board 233 is erected vertically so that its board surface extends in the height and width directions. The sensors of the sensor board 233 may be any sensors that detect predetermined information. The first sensor 2331 is an optical sensor that emits light (e.g., infrared light) toward the front side and detects the observer's gestures by receiving the reflected light. The microphone 2333 collects sound and outputs a sound signal indicative of the collected sound. The gas sensor serving as the second sensor 2332 detects odors such as gas and burnt food. The temperature sensor detects temperature. The illuminance sensor detects illuminance. The first sensor 2331 is located approximately at the center of the information area ST in the width direction. The sensor board 233 outputs signals from the first sensor 2331, the second sensor 2332, and the microphone 2333 to the control board 231 via the wiring 232. The processing board 224 controls, via the wiring unit 800 and the control board 231, to cause the light emitting unit 2334 to emit light when voice recognition is possible.

[0120] The human presence sensor 234 is disposed at a predetermined distance, such as about 30 cm, behind the front internal panel 108 so as not to come into contact with the front internal panel 108. This is desirable in order to ensure the detection sensitivity of the human presence sensor 234. The human presence sensor 234 is disposed slightly forward from the center in the depth direction. The human presence sensor 234 outputs a signal indicating the detection result to the control board 231.

[0121] The wiring section 800 includes a power line 810, a signal line 820, and a signal line 830. The wiring section 800 is routed from the bottom to the top of the housing 100. The wiring section 800 passes between the rear panel 104 and the partition member 900. The control board 231 supplies power to the processing board 224 via the power line 810. The control board 231 exchanges signals with the processing board 224 via the signal line 820. The processing board 224 supplies signals (e.g., drive signals and video signals) that drive the second display unit 330 via the signal line 830. The power line 810, the signal line 820, and the signal line 830 are arranged to pass through the spatial region between the partition member 900 and the rear panel 104. A background plate 910 is provided on the front side of the partition member 900. The background plate 910 is a dark color, such as black. The partition member 900 is formed in a plate shape using, for example, a resin material, and is a member that does not transmit light, so that the wiring section 800 cannot be observed from the image display space S1 side.

[0122] The processing board 224 functions as an operation control means that controls the display of the first display unit 310 and the second display unit 330 and controls the audio output from the speakers 2251 and 2252 based on the communication function. For example, the processing board 224 controls the display of the first display unit 310 and the second display unit 330 and controls the audio output from the speakers 2251 and 2252 according to information measured by the sensor board 233 and the human presence sensor 234. For example, when the processing board 224 detects the presence of a person based on the human presence sensor 234, it may cause a displayed character to perform a greeting action or output the character's voice. When the first sensor 2331 detects a hand gesture such as a left-right, up-down, bye-bye, or forward-backward movement, the processing board 224 controls the display of the first display unit 310 and controls the audio output from the speakers 2251 and 2252. For example, the processing board 224 rotates the character in the direction of a left-right or up-down hand gesture. When a bye-bye gesture is detected, the processing board 224 causes the character to perform a bye-bye motion. When a hand gesture of moving back and forth is detected, the processing board 224 returns the character's display to the default (e.g., FIGS. 1A to 1C). The processing board 224 changes the display of at least one of the first display unit 310 and the second display unit 330 according to the illuminance measured by the illuminance sensor. For example, the processing board 224 may darken the display when the surroundings of the display device 1 become dark. The processing board 224 may also perform control such as moving the character's eyes based on the illuminance sensor. The processing board 224 controls the display of the first display unit 310 according to the temperature detected by the temperature sensor, or controls the audio output from the speakers 2251 and 2252. The processing board 224 changes the character's speech according to whether the surroundings of the display device 1 are hot or cold. Furthermore, the processing board 224 controls the light emission of the light emitting unit 2334. The processing board 224 changes the volume in response to the operation of the operation units 2211, 2212, 2213, and 2214. The voice engine may be realized by the function of the processing board 224, or may be realized by an external recognition server.In the latter case, the processing board may have a communication module for wireless LAN such as Wi-Fi or network communication, and may communicate with the voice recognition server via the communication module.

[0123] Processing board 224 makes the emission luminance of the light source of first display unit 310 brighter than the emission luminance of the light source of second display unit 330. This is because the inventors have found that doing so can further enhance the three-dimensional effect of the aerial image that can be imparted to the viewer due to the difference in emission luminance between first display unit 310 and second display unit 330. If image display space S1 is bright, the three-dimensional effect may be impaired, so the emission luminance of second display unit 330 is lowered.

[0124] The first display unit 310 is tilted at an angle of approximately 20 degrees from the horizontal. This is to prevent the viewer from sitting in a chair and peering into it, which can cause display problems when combined with the display on the second display unit 330. This allows the viewer to see the entire display even when looking at the display device 1 from slightly above. Therefore, the viewer does not need to peer into it.

[0125] This prevents the ceiling from being reflected by the optical member 320 and being observed by the observer, and prevents the ceiling from overlapping with the image on the second display surface 331, making it difficult to clearly see the aerial image. The operation of this configuration will now be described. As shown in FIG. 28, assume that first image light L31 and L32 are incident on the light-attenuating member 200. In this case, reflected waves L31r and L32r of the first image light L31 and L32, respectively, are emitted from the light-attenuating member 200 and are further reflected by the optical member 320, resulting in a virtual image V3 being observed by the observer. For example, when the first display unit 310 displays an image of a character, an image of the lower part of the character, such as the vicinity of the feet, may be observed. Furthermore, as shown in FIG. 29, light L4 from the ceiling, lighting, etc. is incident on the light-attenuating member 200, passes through it, and is further reflected by the optical member 320, causing the ceiling to be reflected near the bottom end of the optical member 320. In this way, an image other than the original aerial image V1 may be observed, which may result in a deterioration in the display quality of display device 1.

[0126] Therefore, by disposing the light-shielding member 500 on the optical path of light reflected by the light-reducing member 200 and on the optical path of light L4 from the ceiling, lighting, etc., the display of the image V3 and the reflection of the ceiling, etc. are suppressed. As shown in FIG. 30, the provision of the light-shielding member 500 suppresses reflection from the optical member 320, thereby suppressing the display of the image V3 and the reflection of the ceiling. Because the light-shielding member 500 is located below the observation area SC and the light-reducing member 200 is also present, the presence of the light-shielding member 500 is unlikely to be noticed by the observer. For example, assuming that the horizontal distance between the observer and the observation area SC is 50 cm and the angle θ of the observer's line of sight is 35 degrees, the light-shielding member 500 is provided on the optical path of the light related to the image V3 and the reflection. As shown in FIG. 31, if the tilt angle of the first display unit 310 is 10 degrees, the position of the image V3 will be displayed further back, making the image V3 easier to observe. To prevent this, it is necessary to extend the light blocking member 500 further to the rear side, which is undesirable. Therefore, it is desirable to set the tilt angle of the first display portion 310 to 20 degrees.

[0127] According to this concept, the optical member 320 may be arranged to avoid an area on the optical path of the first image light L1 reflected by the light attenuation member 200, without using the light blocking member 500. In this way, it is possible to prevent a virtual image formed in the video display space by the first image light L1 being reflected by the light attenuation member from being observed by the viewer.

[0128] Furthermore, the viewer makes a gesture near the first sensor 2331, which is a gesture sensor. In this case, if the first sensor 2331 is located above the observation area SC, the hand making the gesture may get in the way, which may interfere with the observation of the image through the observation area SC. In this embodiment, sensors such as the first sensor 2331 are provided below the observation area SC, so that even if the viewer makes a gesture while observing the observation area SC, the observation is not obstructed.

[0129] The video display space S1 is darkened to make the floating image appear more three-dimensional. For example, when a specific character is displayed, the dark surroundings give the character a sense of floating. Furthermore, when viewed from the front, the observation area SC is surrounded by the housing 100 (front panel 102). In this way, the floating image displayed in the video display space, combined with the housing located in front of it, can further enhance the three-dimensional effect of the floating image that can be given to the viewer.

[0130] The portions facing the image display space S1 are treated to reduce light reflection (for example, matte finish). This reduces reflection even when external light or other light enters the image display space S1, making it easier to maintain a dark state. This prevents the interior space from becoming too bright. This treatment may be applied to some or all of the frames of the background board 910, the base 400, the first display unit 310, and the second display unit 330.

[0131] Furthermore, when a joining method using fasteners such as screws is adopted, the front panel 102 and the front inner panel 108 can be removed more easily than when adhesives are used, and therefore dust that has entered the image display space can be removed with an air blower or a soft cloth. On the other hand, because the front panel 102 is not fixed with fasteners such as screws, it is possible to prevent the viewer from noticing this and disappointing the viewer.

[0132] 5. Detailed Configuration of Processing Board 224 FIG. 33 is a control block diagram of a processing board 224 included in a display device 1 according to an embodiment. As shown in FIG. 33, the processing board 224 is a controller having a CPU 701 that functions as an arithmetic processing device for executing arithmetic processing and memories including a RAM 703 used as a work area and a ROM 702 that stores control programs and the like. The processing board 224 may also be interpreted as, for example, a control unit (an example of an operation control means). Various programs are stored in the ROM 702 of the processing board 224, and the processing board 224 executes these programs to realize various functions. For example, a voice recognition application for reproducing a dialogue between a user and a character is stored in the ROM 702, and the processing board 224 executes the voice recognition application based on input signals from various sensors 234, 2331-2332 or the GPS receiver 60, thereby reproducing the dialogue between the user and the character. The processing board 224 also has a display control circuit 704 that controls images and the like displayed on the display device 1 (more specifically, the video display unit), and a voice control circuit 705 that controls voices output from the speakers 2551 and 2552. The processing board 224 also has a communication control circuit 706 that controls communication with other devices (for example, an external voice recognition server (also referred to as a voice recognition engine) not shown, and an external dialogue server (also referred to as a dialogue engine) not shown, etc.).

[0133] <6. About the communication function for Character 1100> Various controls for reproducing communication between the user and the character 1100 displayed on the display device 1 (for example, the video display unit) will be described below in order with reference to FIGS.

[0134] <About the smell-related communication function> For example, an odor sensor that detects an odor may be provided in the display device 1 as the second sensor 2332, and the processing board 224 may execute a voice output operation to output a voice corresponding to the detection result of the odor sensor as the character voice of the character 1100. Some odor sensors output signals that vary depending on the intensity of an odor, or on the components (odor components) contained in the odor. For example, some odor sensors output signals that vary depending on the type of odor. For example, some odor sensors are configured to detect the concentration of specific odor components (tar, ammonia, alcohol, carbon dioxide, etc.) using a deodorizing filter or the like. In this way, the processing board 224 can reproduce odor-related communication between the character displayed on the video display unit of the display device 1 and the user, thereby enabling a wider variety of communications to be reproduced between the character and the user.

[0135] The processing board 224 may, for example, perform a sound output operation that outputs a sound corresponding to the type of detected odor as the character voice of the character 1100. Note that the odor sensor may be configured as a single sensor that can distinguish between multiple types of odor components, or as a plurality of sensors that can distinguish between different types of odor components.

[0136] FIG. 34(A) is a flowchart for reproducing communication related to odors, and FIG. 34(B) is a diagram showing a voice management table (also referred to as a voice management table) related to odors. The voice management table is stored, for example, in the processing board 224 of the display device 1 or in the dialogue server. As shown in FIG. 34(B), the voice management table pre-registers, for each type of odor component (also referred to as an odor substance) that can be detected by the odor sensor, the type of odor that mainly contains that odor component and the voice (referred to as a character voice) that the character 1100 will emit. For example, in the voice management table, a tobacco odor that mainly contains tar is registered in association with tar, and words of concern for the user's health, such as "Smoking too much is not good," are registered as the character voice to be emitted when a tobacco odor is detected.

[0137] First, in step S11, the processing board 224 (which may also be read as the control unit) determines whether an odor has been detected. For example, if the concentration of an odor component detected by the odor sensor exceeds a predetermined threshold (reference value) for a specific odor, the processing board 224 determines that the odor component has been detected. In step S12, the processing board 224 determines the type of odor registered in association with the detected odor component in the voice management table. For example, if a concentration of tar exceeding a predetermined threshold is detected, it is determined that a tobacco odor has been detected. Then, the processing board 224 outputs a character voice corresponding to the type of odor detected from the speakers 2551, 2552. For example, if it is determined that a tobacco odor has been detected, the processing board 224 executes a voice output operation to output a character voice that expresses concern for the user's health (here, "Smoking too much is not good"). Other examples include the following: For example, if the concentration of a specific main component contained in a fragrance such as an aroma oil or in food exceeds a predetermined reference value, the processing board 224 determines that the odor of the fragrance or food has been detected, and outputs a voice as the character voice asking a question about the source of the odor. Also, if alcohol exceeding a predetermined reference value is detected, the processing board 224 determines that an alcohol odor has been detected, and outputs a voice such as "You smell like alcohol" or "You've been drinking again, stop it already" as the character voice of the character 1100. Also, if bad breath components (e.g., hydrogen sulfide, methyl mercaptan, dimethyl sulfide, etc.) exceeding a predetermined reference value are detected, the processing board 224 determines that bad breath has been detected, and outputs a voice such as "Your breath stinks a bit. Have you brushed your teeth?" or "Please use a periodontal treatment." Furthermore, when odor components contained in gas fuel, such as tertiary butyl mercaptan, dimethyl sulfide, or tetrahydrothiophene, are detected, the processing board 224 determines that the odor of gas fuel has been detected and outputs a voice such as "It smells like gas!" as the character voice of the character 1100.

[0138] In this way, the processing board 224 may execute control to output a sound corresponding to the type of detected odor as the character voice of the character 1100. By executing such control, it is possible to widen the scope of communication between the character displayed on the video display unit and the user, and to increase the user's attachment to the character.

[0139] The display device 1 is not limited to a device that specifies the voice to be output based on a voice management table. The display device 1 may specify the voice to be output according to a scenario in which the content of a character's utterance changes based on the content of past dialogues (dialogue history), for example. This scenario may define a branching scenario in which data specifying the voice to be output by a character is managed in a tree structure.

[0140] Here, an audio output operation of a sound corresponding to the detection result by the odor sensor is exemplified, but the present invention is not limited thereto. The processing board 224 may also execute a display output operation of displaying on the video display unit an image of a character performing a movement corresponding to the detection result by the odor sensor. For example, similar to the audio management table, a display management table (not shown) may be provided in advance, and the processing board 224 may execute a display output operation of displaying on the video display unit an image of the character 1100 performing a movement corresponding to the type of odor detected. The display management table may be, for example, a table in which data defining the character 1100 is registered in association with the odor component and the type of odor. The data defining the character 1100 may be data showing an image of the character 1100 to be displayed, or may be data defining the content of the movement of the character 1100. For example, when some odor component is detected, the processing board 224 may display on the video display unit an image of the character 1100 performing a movement to sniff the odor. Furthermore, when the processing board 224 determines that, for example, a cigarette odor has been detected, it may display on the video display unit an image of the character 1100 making a motion as if it were smelling smoke. At this time, the processing board 224 may also display an image imitating smoke on the video display unit. Furthermore, the processing board 224 may execute both the audio output operation and the display output operation as described above. For example, when some odor component is detected by the odor sensor, the processing board 224 may display on the video display unit an image of the character 1100 making a motion as if it were smelling an odor, while outputting a voice such as "I smell something" from the speakers 2551, 2552 as the character voice of the character 1100.

[0141] Furthermore, the processing board 224 may control the character 1100 to change its reaction depending on the concentration (also called detection intensity) of the odor component detected by the odor sensor. For example, the processing board 224 may selectively display one of a number of stepwise motion images (for example, "grimacing (making a disgusted expression)," "breaking into a cold sweat," "turning pale," and "fainting," etc.) depending on the concentration of the odor component.

[0142] The display device 1 may be capable of detecting that the user is smoking by combining with other sensors, such as a smoke sensor that detects smoke, camera images (e.g., images captured by the image capturing unit 227), or images from a thermal camera, as a method of distinguishing between tobacco odor and odors (odors) other than tobacco odor.

[0143] When the processing board 224 detects that the user is smoking, it may display an image simulating smoke (a video recreating the appearance of billowing smoke) superimposed on the character 1100 (in front of the character 1100). At this time, the processing board 224 may push the face of the character 1100 forward, close up the face, and make the character 1100 look displeased. The processing board 224 may display the character 1100 with varying degrees of displeasure depending on the intimacy, which is the degree of intimacy between the user and the character 1100. For example, if the intimacy is equal to or greater than a predetermined value, the processing board 224 may make the character 1100 look as if it loves the user and forgives them, and if the intimacy is less than the predetermined value, the processing board 224 may make the character 1100 look displeased. The processing board 224 may determine the degree of intimacy based on, for example, the user's usage history of the display device 1 (e.g., the amount of time used in the past and the content of past conversations). The algorithm for determining the intimacy is not limited to this.

[0144] <About the communication function based on user location information> Also, for example, the display device 1 may have a GPS (Global Positioning System) receiver 60 (see FIG. 33), and the following control may be performed based on the user's location information. Then, for example, the processing board 224 may acquire location information of the display device 1 held (carried) by the user as the user's own location information based on a signal from the GPS receiver 60, and perform the following control based on the acquired location information.

[0145] For example, it is preferable to control the output of the character voice to correspond to the frequency of stay (also referred to as visit frequency) of the user at a location specified based on the user's location information. Fig. 35 is a flowchart for reproducing communication related to frequency of stay.

[0146] For example, in step S21, the processing board 224 determines whether or not user location information has been received from the GPS receiver 60. When the user location information is received, in step S22, the processing board 224 determines whether or not the number of stays (also referred to as the number of visits) the user has stayed at a location identified based on the user location information is equal to or greater than a predetermined value (e.g., "2"). The stay frequency is the number of times the user has stayed at a location during a predetermined period (e.g., one day or one week). For example, the processing board 224 searches for and identifies the user's stay location using a network or the like based on the location information (e.g., the user's current location information) acquired from the GPS receiver 60. Then, the processing board 224 calculates the user's stay frequency based on the number of stays the user has stayed at the identified location, and determines whether or not the user's stay frequency is equal to or greater than a predetermined value. For example, if the user's visit frequency is equal to or greater than a predetermined value, in step S23, the processing board 224 controls so that a predetermined character voice registered in advance regarding the user's visit frequency is output from the speakers 2551, 2552. For example, if the user goes to the same place twice on the same day, the processing board 224 determines that the user's visit frequency is equal to or greater than a predetermined value, and outputs a character voice such as, "Hey, you were there just now."

[0147] Furthermore, the processing board 224 may perform control so that a sound corresponding to the location identified based on the acquired position information is output as the character sound of the character 1100. Fig. 36(A) is a flowchart for reproducing communication related to the place of stay, and Fig. 36(B) is a diagram showing a sound management table of the character sound related to the place of stay.

[0148] For example, in step S31, the processing board 224 determines whether or not user location information has been received from the GPS receiver 60. When the user location information is received, in step S32, the processing board 224 searches for and identifies the user's location using a network or the like based on the user's location information. Then, in step S33, the processing board 224 outputs a character voice corresponding to the identified location from the speakers 2551, 2552 based on the voice management table of FIG. 36(B). For example, when the user goes to a supermarket, the processing board 224 outputs a character voice such as "What should we make for dinner tonight?", or when the user goes to a hospital, the processing board 224 outputs a character voice such as "Are you OK? Are you feeling unwell?" as the character voice of the character 1100. Furthermore, when the user goes to an amusement park, the processing board 224 outputs a character voice such as "You had a lot of fun."

[0149] Furthermore, the processing board 224 may be controlled to output a voice corresponding to the number of stays (also referred to as the number of visits) that the user has stayed at a location identified based on the acquired location information as the character voice of the character 1100. Fig. 37(A) is a flowchart for reproducing communication related to the number of stays, and Fig. 37(B) is a diagram showing a voice management table of character voices related to the number of stays.

[0150] Steps S41 and S42 in FIG. 37(A) are similar to steps S31 and S32 in FIG. 36(A), and therefore description thereof will be omitted. In step S43, the processing board 224 acquires the number of times the user has stayed at the location identified in step S42. Then, in step S44, the processing board 224 outputs character voices corresponding to the number of times the user has stayed from the speakers 2551 and 2552 based on the voice management table in FIG. 37(B). For example, when the user visits a certain game center for the first time, the processing board 224 outputs character voices such as "The game was fun." Then, when the user visits the certain game center again, the processing board 224 outputs character voices such as "I've been wanting to go again." Furthermore, when the user has visited the certain game center a predetermined number of times or more (for example, 10 times or more), the processing board 224 outputs character voices such as "Let's play games again."

[0151] Furthermore, the processing board 224 may be controlled to output a voice corresponding to the length of time the user has stayed at a location identified based on the acquired position information as the character voice of the character 1100. Fig. 38(A) is a flowchart for reproducing communication related to the length of time the user has stayed, and Fig. 38(B) is a diagram showing a voice management table of the character voice related to the length of time the user has stayed.

[0152] Steps S51 and S52 in FIG. 38(A) are similar to steps S31 and S32 in FIG. 36(A), and therefore description thereof will be omitted. In step S53, the processing board 224 acquires the user's stay time at the location identified in step S52. Then, in step S54, the processing board 224 outputs character voices corresponding to the user's stay time from the speakers 2551 and 2552 based on the voice management table in FIG. 38(B). For example, when the user's stay time at the convenience store is within five minutes, the processing board 224 outputs character voices such as "You were quick. I was waiting, so I'm happy." Furthermore, when the user's stay time at the convenience store is between five and ten minutes (5 to 10 minutes), the processing board 224 outputs character voices such as "What did you buy?" Furthermore, when the user's stay time at the convenience store exceeds ten minutes, the processing board 224 outputs character voices such as "You were late. I was worried about you."

[0153] The processing board 224 may perform the above control based on the user's location information acquired using the GPS receiver 60, etc. In this way, the user can get the feeling that the character is responding to the user's actions, and the user's attachment to the character increases.

[0154] The display device 1 may be installed, for example, in the user's home, and the display device 1 (more specifically, the communication control circuit 706) may communicate with the user's smartphone (a smartphone equipped with a GPS receiver) or the like to acquire location information of the user while out (location information of the smartphone carried by the user). Then, when the user communicates with the character 1100 after returning home, the processing board 224 may perform control to execute the above-described operations. The content of the character's voice and movement at this time may be changed as appropriate.

[0155] <About communication functions related to user behavior patterns> Furthermore, when it is determined that the user's behavior pattern matches a predetermined behavior pattern, it is preferable that control be performed so that a voice corresponding to the predetermined behavior pattern is output as the character voice of the character 1100. Fig. 39(A) is a flowchart for reproducing communication related to behavior patterns, and Fig. 39(B) is a diagram showing a voice management table of character voices related to behavior patterns.

[0156] For example, the user pre-registers the day of the week (e.g., Monday to Friday) on which the user goes to work, the time the user goes to work (e.g., 8:30 a.m.), and a specific route the user uses when going to work as a "workday behavior pattern" in the processing board 224. Then, for example, when the user's location information is received from the GPS receiver 60 (step S61), the processing board 224 determines whether the user's behavior pattern matches a predetermined behavior pattern based on the user's location information (step S62). For example, if the user travels a specific route at 8:30 a.m. on Tuesday, the processing board 224 determines that the user's behavior pattern matches the "workday behavior pattern." Then, in step S63, the processing board 224 outputs a voice (e.g., "Good luck at work") registered in association with the "workday behavior pattern" as the character voice of the character 1100 from the speakers 2551 and 2552 based on the voice management table of FIG. 39(B). In this way, the character reacts to the user's actions, which increases the user's attachment to the character. Note that it is not essential that the user pre-registers a predetermined behavioral pattern (for example, a behavioral pattern when going to work). For example, the processing board 224 may have a learning function and register a predetermined behavioral pattern by learning the user's behavioral patterns.

[0157] <Communication function for detecting suspicious individuals> Furthermore, if a person detected in the detection target space is determined to be a suspicious person, a predetermined action may be executed. Then, if the user of the display device 1 is detected after the predetermined action is executed, a sound related to the detection of the suspicious person may be output as a character sound of the character 1100. Fig. 40 is a flowchart for realizing the action related to the detection of the suspicious person.

[0158] For example, as shown in FIG. 32, the display device 1 may be provided with a photographing unit 227 (e.g., a camera) on the front side of the display device 1 for photographing an observer (e.g., a user), and the photographing unit 227 (more specifically, a sensor included in the photographing unit 227) may be used as a detection unit for detecting the presence of a person in a detection target space. The "detection target space" may be, for example, the field of view (captureable range) of the photographing unit 227 in a space (e.g., the user's home) in which the display device 1 is installed. The photographing unit 227 includes, for example, a lens and an image sensor (e.g., a CCD or CMOS) and captures multicolor images. The lens of the photographing unit 227 is provided at a position where it can capture an image of the observer (especially the face). In the example shown in FIG. 32, the lens of the photographing unit 227 is provided above the observation area SC on the front panel 102 disposed on the front side of the housing 100, near the center in the width direction of the display device 1. The photographing unit 227 outputs image signals of, for example, R, G, and B color components to the processing board 224. The processing board 224 processes this image signal to generate a captured image.

[0159] The processing board 224 monitors the detection target space using the photographing unit 227 (step S71). When the processing board 224 detects the presence of a person in the detection target space, it performs user authentication, such as facial recognition, in step S72, and determines whether the detected person is a registered user of the display device 1 in step S73. For example, if the processing board 224 determines that the person photographed by the photographing unit 227 is a registered user of the display device 1, it determines that the person is not a suspicious person. On the other hand, if it determines that the person photographed by the photographing unit 227 is an unregistered user, the processing board 224 determines that the person is a suspicious person in step S74 and executes a predetermined action. Examples of the "predetermined action" include an action of starting recording by the photographing unit 227, an action of sounding an alarm at a relatively loud volume, and an action of notifying a pre-registered security company. Alternatively, the "predetermined action" may be an action of the character 1100 calling out to the suspicious person (for example, "Who are you? Say the password!"). Then, if there is no reply from the person determined to be suspicious, or if the password is incorrect, the above-mentioned recording start operation, etc. may be executed. If the password is incorrect, the processing board 224 may output a voice such as "That's not right! Say it again" as the character voice of the character 1100, and when it is determined again that the password is incorrect, the above-mentioned recording start operation, etc. may be executed. By doing this, for example, it is possible to make the suspicious person retreat from the detection target space, thereby improving the security of the detection target space.

[0160] Then, after the execution of the predetermined operation, when the user of the display device 1 is detected, the processing board 224 may output a voice regarding the detection of a suspicious person as the character voice of the character 1100. An example of the "voice regarding the detection of a suspicious person" is "That was scary." In this way, the user's attachment to the character displayed on the video display unit can be increased.

[0161] Furthermore, when a detection target space is being monitored using the display device 1, the following operations may be performed in addition to the detection of suspicious individuals.

[0162] For example, the display device 1 may be placed in a reception space of a company, and the character 1100 may be displayed as performing reception duties as a so-called receptionist. Specifically, when a microwave Doppler sensor (an example of a detection means) detects the approach of a person in a detection target space (e.g., a reception space), the processing board 224 may output a voice such as "Welcome. Which department would you like to work for?" as the character voice of the character 1100. Then, based on a response from the detected person (visitor), the processing board 224 may perform control so as to make a call to the department desired by the visitor.

[0163] <Communication function regarding the startup time of Display Device 1> Furthermore, the processing board 224 may control the language used in the character voice of the character 1100 so that the content of communication changes depending on the startup time (e.g., cumulative startup time) of the display device 1 from a predetermined point in time (e.g., the time of initial startup). For example, as will be described below, the processing board 224 may control the character 1100 to speak to the user in more familiar language as the startup time of the display device 1 becomes longer.

[0164] For example, for the various character voices described above, three patterns of character voices may be registered in advance in the voice management table: a polite tone, a tone of speech that suggests a friendly relationship with the user, and a tone of speech that suggests a romantic relationship with the user. For example, when the startup time of the display device 1 from a predetermined point in time is less than 100 hours, the processing board 224 outputs the polite tone character voice from the three patterns of character voices registered in the voice management table. Furthermore, when the startup time is greater than or equal to 100 hours but less than 1000 hours, the processing board 224 outputs the friendly tone character voice from the three patterns of character voices registered in the voice management table. Furthermore, when the startup time exceeds 1000 hours, the processing board 224 outputs the romantic tone character voice from the three patterns of character voices registered in the voice management table.

[0165] In this way, the user can sense a change in the relationship (for example, intimacy) with the character due to a change in the way the character speaks to the user.

[0166] The processing board 224 may perform control to reduce the intimacy of the character 1100 with the user depending on the time that has elapsed since the previous startup. For example, even if the cumulative startup time of the display device 1 exceeds 100 hours, if one week has passed since the previous startup, the processing board 224 may output the character's voice in a polite tone rather than speaking in an equal tone with the user. In this way, the user will interact with the character displayed on the video display unit as quickly as possible to maintain the intimacy with the character, and the user's attachment to the character can be further increased.

[0167] Furthermore, the processing board 224 may output a greeting voice such as "Nice to meet you" as the character voice when the device is first started, and after a predetermined period of time (for example, a convenient period such as one month) has passed since the device was first started, output a voice indicating an anniversary (for example, "It's been one month since we met") as the character voice. This can further increase the attachment to the character 1100.

[0168] <About communication functions that link with other devices> Furthermore, for example, when the display device 1 is installed in a user's home or the like, the following operation may be performed in cooperation with another device. For example, when a user visits a location where a device capable of communicating with the display device 1 (hereinafter referred to as the other device) is installed, the other device may identify the user and automatically provide information suitable for the user (e.g., gourmet information or event information) as described below. For example, a facial image of a user using a system for linking a display device and another device and a display device owned by the user (e.g., an IP address, etc.) are associated and registered in advance in an external server or the like. When a person is detected by a sensor in a photographing unit provided in the other device, the control unit of the other device compares the facial image of the person detected in the photographed image with the facial image of the user registered in the external server, thereby identifying the user of the display device 1. Then, the control unit of the other device identifies the display device 1 registered in the external server in association with the user (e.g., the IP address, etc. of the display device 1) and transmits information indicating that the user of the display device 1 has been detected to the display device 1. The processing board 224 of the display device 1 is pre-registered with "information suitable for the user" (e.g., gourmet information or event information), and the processing board 224 transmits the registered "information suitable for the user" to the other device in response to receiving a signal from the other device. The control unit of the other device then outputs (e.g., outputs audio) the "information suitable for the user" received from the display device 1. When providing the "information suitable for the user," the other device may display a character 1100 on its display screen. The information provided to the user may be transmitted from the other device to the display device 1 and stored as user information in the processing board 224 of the display device 1. For example, if the display device 1 is installed in the user's home, upon detecting the user's return, the processing board 224 may output a voice such as "You went to **, right? How was it?" as the character voice of the character 1100. This can increase the user's attachment to the character displayed on the video display unit.

[0169] <Other communication features> Furthermore, the following control may be performed based on the detection results from various sensors.

[0170] For example, a wind detection means (e.g., a wind sensor) capable of detecting wind (e.g., wind speed) may be provided on the front panel 102 of the display device 1, and the following control may be performed based on the detection results of the wind sensor. The wind may be generated artificially by the user, for example, by moving a body part such as waving a hand toward the display device 1, or by blowing breath (exhalation). For example, when the wind sensor detects wind with a wind speed equal to or greater than a predetermined value, the processing board 224 may display and output an image of the fluttering hair (e.g., hair) or clothes (e.g., skirt) of a character (e.g., character 1100) displayed on the video display unit. Also, for example, when an image of a lit candle is displayed on the video display unit, if the wind sensor detects wind, the processing board 224 may switch to an image of the candle going out. Furthermore, the processing board 224 may switch the image according to the strength of the detected wind (e.g., wind speed), such that when the detected wind is stronger than a predetermined threshold (wind speed is greater than a predetermined threshold), the clothing of the character 1100 flutters more.

[0171] Furthermore, for example, an object detection means (e.g., an ultrasonic sensor) capable of detecting the presence or absence (existence) of an object and the distance to the object may be installed in the display device 1, and the following control may be performed based on the detection result of the ultrasonic sensor. For example, when the processing board 224 determines, based on the detection result of the ultrasonic sensor, that the observer's hand is touching the character 1100 recognized as a three-dimensional image, the processing board 224 may display and output an image in which the character 1100 shows a reaction. Furthermore, the processing board 224 may perform display control so that the character 1100 shows a different reaction depending on the part of the character 1100 touched by the observer. The part of the character 1100 that can be touched by the observer may be, for example, a body part such as the head, chest, abdomen, buttocks, or legs. Furthermore, the part of the character 1100 that can be touched by the observer may be the character's 1100's clothing (e.g., clothes, skirt) or ornaments (e.g., accessories).

[0172] Furthermore, for example, the display device 1 may be provided with earthquake detection means (for example, a seismic sensor) that can sense an earthquake and measure the seismic intensity, and the processing board 224 may issue an earthquake alarm when the seismic sensor detects an earthquake.

[0173] Also, for example, a weather sensor capable of measuring the weather may be provided in the display device 1, and the processing board 224 may notify the user of weather changes and weather forecasts based on the measurement results of the weather sensor. The weather sensor may have, for example, an air pressure sensor, a temperature sensor, and a humidity sensor, and may be configured to be able to measure the weather based on the detection results of each sensor.

[0174] In addition, the processing board 224 may display an image in which the facial expression and movement (also called motion) of a character displayed on the image display unit changes depending on the temperature detected by the temperature sensor and / or the humidity detected by the humidity sensor.

[0175] In addition, the processing board 224 may display an image in which the facial expression and movement of a character displayed on the image display unit changes depending on the detection results (e.g., the distance between the display device 1 and the observer) of a human presence sensor such as a microwave Doppler sensor.

[0176] The processing board 224 may also use a humidity sensor to determine whether or not the user has blown on the display device 1. Furthermore, the processing board 224 may also use a temperature sensor to determine the type of breath blown on the display device 1. These sensors may be provided in the display device 1 as the second sensor 2332, for example.

[0177] Here, there are two types of breath blown by the user: a breath blown with a "huffing" sound, and a breath blown with a "haf" sound. Generally, when blowing cold breath, the breath is blown quickly with a "huffing" sound, and therefore, the breath blown with a "huffing" sound is referred to as a "cold breath." Generally, when blowing warm breath, the breath is blown slowly with a "haf" sound, and therefore, the breath blown with a "haf" sound is referred to as a "warm breath."

[0178] Regarding these two types of breath, the inventors of the present application have obtained the following findings through experiments and the like. Specifically, first, with regard to humidity, measurements have shown that when a user blows a breath toward a temperature and humidity sensor (e.g., a sensor combining a temperature sensor and a humidity sensor) at a position a predetermined distance from the sensor, the humidity rises sharply from a steady state immediately thereafter. Further, measurements have shown that the humidity increases monotonically while the user is breathing, and that it takes several tens of seconds for the humidity to return to its steady state once the user stops breathing. Similar measurements have also been obtained when a user blows a breath toward the temperature and humidity sensor under the same conditions. Meanwhile, with regard to temperature, measurements have shown that when a user blows a breath, the temperature drops slightly from the steady state or remains roughly flat, whereas when a user blows a breath, the temperature rises. The breath a user blows toward the display device 1 is an example of wind that strikes the display device 1.

[0179] Taking such knowledge into consideration, for example, in a display device 1 provided with a humidity sensor, when the humidity sensor detects that the humidity has risen sharply from a steady state, the processing board 224 may determine (also referred to as "decision") that the observer has blown on the display device 1. Furthermore, when the monotonous increase in humidity is no longer detected thereafter, the processing board 224 may determine that the observer has stopped blowing on the display device 1. Alternatively, when a predetermined time (for example, the time required to normally exhale (for example, about 3 seconds)) has elapsed since the sudden rise in humidity was detected, the processing board 224 may determine that the observer has stopped blowing on the display device 1, regardless of the humidity detection result at that time.

[0180] Furthermore, when a sudden increase in humidity is detected by the humidity sensor, and the temperature sensor detects (for example, at approximately the same time) that the temperature has increased from the steady state, the processing board 224 may determine that the type of breath blown by the observer is "warm breath." Conversely, when a sudden increase in humidity is detected by the humidity sensor, and the temperature sensor detects that the temperature has not changed from the steady state or has decreased from the steady state, the processing board 224 may determine that the type of breath blown by the observer is "cold breath."

[0181] The processing board 224 may then output video and audio corresponding to the detection of the blowing of breath as the movement and sound of a character displayed on the video display unit. The processing board 224 may also output video and audio corresponding to the type of breath blown as the movement and sound of a character displayed on the video display unit. For example, if the type of breath blown by the observer is "cold breath," the processing board 224 may display and output a video of the character's clothes fluttering, and if the type of breath blown by the observer is "warm breath," the processing board 224 may display and output a video of the character making a movement to avoid the breath.

[0182] The inventors of the present application also obtained the following findings using various gas sensors. Specifically, measurements have shown that when a person blows a breath toward a gas sensor from a position a predetermined distance (for example, about 10 cm) away from the gas sensor, the output value of the gas sensor decreases immediately thereafter, and when the person stops blowing, the output value of the gas sensor begins to increase immediately thereafter. Conversely, measurements have shown that when a person blows a breath toward the gas sensor, the output value of the gas sensor increases immediately thereafter, and when the person stops blowing, the output value of the gas sensor begins to decrease immediately thereafter. Furthermore, measurements have shown that when air blown from a blower (for example, an electric fan) hits the gas sensor, the output value of the gas sensor decreases, and when the air from the electric fan no longer hits the gas sensor, the output value of the gas sensor increases.

[0183] Taking into consideration such findings, for example, in a display device 1 provided with a gas sensor, if the output value of the gas sensor drops sharply from a steady state, the type of breath blown by the observer may be determined to be "cold breath." Conversely, if the output value of the gas sensor rises sharply from the steady state, the type of breath blown by the observer may be determined to be "warm breath."

[0184] A wind sensor can also be used to detect breath. The inventors of the present application have confirmed that the wind sensor can sometimes detect a relatively weak wind, such as that caused by blowing on a piece of paper, and that it quickly peaks when breathing on the wind sensor, providing good response when the wind begins to blow. However, if you continue to breathe, the wind will quickly drop from its peak. It is thought that a strong wind, such as a quick whoosh, will cool the heater, and it will take time for it to recover.

[0185] In relation to the configuration for detecting breath using a wind sensor, the following configuration may be adopted.

[0186] When the wind sensor continuously detects a predetermined wind volume, the processing board 224 may process the direction as not being breathed upon. Processing the direction as not being breathed upon is, for example, processing to determine that no breath is being blown upon. In this case, the processing board 224 may process the direction as being breathed upon when the time from when the wind sensor starts to detect the wind to when it ends is within the time period in which breathing is possible.

[0187] In this case, the wind sensor may be a sensor that detects wind by electrically measuring heat removed by the wind. In this sensor, the wind received by the sensor corresponds to the volume of air blown on the sensor. The sensor is preferably configured so that when the wind received by the sensor continues for a period of time equivalent to the time of the breath being blown on the sensor, the volume of air drops to a value smaller than the actual volume of air during that period, and so that this drop is unlikely to occur when the volume of air received by the sensor is smaller than the volume of air blown on the sensor.

[0188] The display device 1 may be provided with a flow path for introducing air into a plurality of wind sensors, which share a common breath inflow path. The flow path may be configured so that air enters the different wind sensors at a predetermined ratio that is not 1:1. The processing board 224 may determine the magnitude and duration of the breath based on the ratio and differences in the characteristics of the plurality of wind sensors. The display device 1 may be provided with a plurality of wind sensors that have different timings at which the volume of air drops to a value lower than the actual volume during the duration, and the processing board 224 may determine the magnitude and duration of the breath based on the outputs of the plurality of wind sensors. The display device 1 may be provided with at least a wind sensor that is not a gas sensor and a gas sensor as the plurality of wind sensors.

[0189] The wind sensor may be a gas sensor for detecting a predetermined gas. The wind sensor may be a gas sensor for detecting a predetermined gas, the gas sensor including a heater. In this case, the gas sensor including a heater may have the following characteristics: when the degree of breathing is relatively small, the output signal indicates a larger amount of detected gas (as a result of detecting the gas contained in the breath), and when the degree of breathing is relatively large, the output signal indicates a smaller amount of detected gas (due to cooling of the heater by the wind from the breath).

[0190] When the processing board 224 determines that a breath is being blown, if the strength of the blowing is relatively strong (for example, if the air volume is above a threshold), it may display an animation that moves the clothes, hair, etc. of the character 1100, but if the strength of the blowing is relatively weak, it may display a different animation from the animation that moves the clothes, hair, etc. of the character 1100.

[0191] When a gas sensor is used to detect breath, the gas sensor reacts to components contained in human breath (e.g., carbon dioxide) to produce the output value. The reason why the output value of the gas sensor differs between a "puff" and an "exhale" is thought to be that when a "puff" is blown, the speed of the blown breath is high and it tends to diffuse into the surrounding area immediately after hitting the gas sensor, whereas when a "exhale" is blown, the speed of the blown breath is low and the components of the breath tend to remain in place even after hitting the gas sensor.

[0192] Furthermore, the processing board 224 may also use the humidity detection result from, for example, a humidity sensor to determine whether the detected wind is due to the viewer blowing on the display device 1 or a fan. For example, in the display device 1, when the humidity sensor detects that the output value of the gas sensor has suddenly dropped from a steady state and that the humidity has suddenly increased from the steady state, the processing board 224 may determine that the user has blown on the display device 1. On the other hand, when the output value of the gas sensor has suddenly dropped from a steady state but the humidity remains steady, the processing board 224 may determine that the fan is blowing on the display device 1. Furthermore, when the processing board 224 determines that the user has blown on the display device 1, it may also use the temperature detection result from a temperature sensor to determine the type of breath. Furthermore, when the output value of the gas sensor repeatedly rises and falls within a relatively short fixed period of time, the processing board 224 may determine that the display device 1 is being blown on by a fan.

[0193] Note that wind sensors, humidity sensors, temperature sensors, temperature and humidity sensors, and gas sensors used to detect wind are examples of wind detection means. The display device 1 may also have a barometric pressure sensor as a sensor for detecting wind. This is because changes in barometric pressure can occur depending on the occurrence and strength of wind.

[0194] The above-mentioned various controls can be executed. Note that the above-mentioned controls are not limited to the character 1100, and may be executed for the communication functions related to other characters (for example, the character 1200).

[0195] <7. Specific examples of images displayed by the display device 1> Next, specific examples of images displayed by the display device 1 will be described with reference to Figs. 41 to 55. Figs. 41 to 55 are diagrams showing examples of characters (images including the character 1200 described in Figs. 1B and 1C) displayed on the display device 1. Each of the images shown in Figs. 41 to 55 is an image that is displayed on the display device 1 and can be observed by an observer through the observation area SC. Although stage image 2200 is displayed in Figs. 41 to 55, character 1200 may be displayed without this being displayed.

[0196] 41 to 47 show displays that the display device 1 performs while waiting for an observer's action based on the communication function. The display device 1 (specifically, the processing board 224) performs the displays described below by regularly or randomly switching between them. For example, as shown in FIG. 41(a), the character 1200 is displayed standing and facing the front side (observation side) of the display device 1. The display device 1 may use this posture as a basic posture and display the display during periods when communication based on the communication function is not being performed. For example, as shown in FIG. 41(b), the character 1200 performs an action of licking its front paws. For example, as shown in FIG. 41(c) and FIG. 42(a), the character 1200 performs an action of looking alternately to the left and right. For example, as shown in FIG. 42(b), the character 1200 performs an action of facing the ground. For example, as shown in FIG. 42(c), the character 1200 performs an action of stretching while sitting. For example, as shown in FIG. 43(a), character 1200 performs an action of peering down at the ground. Furthermore, as shown in FIG. 43(b) and FIG. 43(c), character 1200 performs an action of walking forward. When character 1200 performs a walking action, display device 1 may not display a stage image, but may display an image in which character 1200 steps in place, with the overall position of character 1200 remaining substantially unchanged. When character 1200 performs an action other than walking, display device 1 may display a stage image at the feet of character 1200.

[0197] For example, as shown in FIG. 44(a), the character 1200 makes a motion as if peering into its own abdomen. For example, as shown in FIG. 44(b), the character 1200 makes a motion as if tilting its head. For example, as shown in FIG. 44(c), the character 1200 makes a motion as if rubbing its own eyes. For example, as shown in FIG. 45(a), the character 1200 makes a motion as if yawning. For example, as shown in FIG. 45(b), the character 1200 makes a motion as if licking its front paws while sitting. For example, as shown in FIG. 45(c), the character 1200 makes a motion as if looking diagonally forward and to the left. As shown in FIGS. 46(a) and 46(b), the character 1200 makes a motion as if stretching. For example, as shown in FIG. 46(c), the character 1200 makes a motion as if peering into the ground. As shown in FIG. 47(a), the character 1200 faces diagonally forward and to the right of the display device 1, and then faces forward as shown in FIG. 47(b). As shown in FIG. 47(c), the character 1200 makes the motion of licking its front paws.

[0198] 48 to 55 are examples of the display of the character 1200 performed by the display device 1 (more specifically, the processing board 224) during dialogue processing in the communication function. The character strings shown in FIGS. 48 to 55 are character strings that can be recognized by voice recognition and are displayed above the character 1200. This is preferably done so that a phrase (sentence) recognized by voice recognition is displayed for a predetermined time after voice recognition and is made invisible after the predetermined time has elapsed. Then, the character 1200 is preferably controlled to start speaking after the phrase (voice recognition result) is made invisible.

[0199] FIG. 48(a) is displayed when the display device 1 recognizes the observer's utterance of "Come on, come on," and audio is output in response. FIGS. 48(b) to 49(b) are displayed when the display device 1 recognizes the observer's utterance of "Sit," and audio is output in response. FIG. 49(c) is displayed when the display device 1 recognizes the observer's utterance of "I wonder if I'm hungry," and audio is output in response. FIG. 50(a) is displayed when the display device 1 recognizes the observer's utterance of "Policeman," and audio is output in response. FIGS. 50(b) and 50(c) are displayed when the display device 1 recognizes the observer's utterance of "It's snack time," and audio is output in response. FIG. 51(a) is displayed when the display device 1 recognizes the observer's utterance of "Shake your hand," and audio is output in response. 51(b) to 52(b) are displayed when the display device 1 recognizes an utterance of "cute" from an observer, and sound is output in response. When the display device 1 displays the character 1200 at a position other than the center of the stage image (for example, a position toward the front), it is preferable that when rotating the character 1200, the display device 1 also rotates the stage image 2200 in the same manner as the character 1200. Furthermore, it is preferable that the display device 1 displays the stage image 2200 having a shape with a relatively large distance in the depth direction, and displays an image of the character 1200 moving inside the stage image 2200 along the outer edge of the stage image 2200 (for example, an image of a cat character walking along the outer edge of a circular stage).

[0200] FIG. 52(c) is displayed when the display device 1 recognizes the observer's utterance of "Hello," and audio is output in response. FIG. 53(a) is displayed when the display device 1 recognizes the observer's utterance of "Eat dinner," and audio is output in response. FIGS. 53(b) and (c) are displayed when the display device 1 recognizes the observer's utterance of "I wonder if it's a girl," and audio is output in response. FIG. 54(a) is displayed when the display device 1 recognizes the observer's utterance of "Wait," and audio is output in response. FIG. 54(b) is displayed when the display device 1 recognizes the observer's utterance of "Good boy," and audio is output in response. FIGS. 54(c) and 55 are displayed when the display device 1 recognizes the observer's utterance of "Yunho," and audio is output in response.

[0201] <8. More detailed explanation of character 1200> The character 1200 described in FIGS. 1B and 1C and FIGS. 41 to 55 will be described in more detail. In the following description, when the display device 1 is the processing subject, the processing may be performed by the processing board 224. It is particularly preferable for the character 1200 to be drawn with a body proportion of approximately 3:1. It has been found that doing so particularly emphasizes the sense of depth. The display device 1 should draw the character 1200 so that, when viewed from the side (beside), the head occupies approximately one-third of the height, the torso one-third, and the feet one-third of the height in the vertical direction. The display device 1 should draw the character 1200 so that, except for the tail, the head occupies approximately one-third of the height and the torso two-thirds of the height in the horizontal direction when viewed from the side.

[0202] The display device 1 may have a function for alternately drawing a tail between a visible and invisible state when the face is in front of the display device, and the time when the tail is visible may be shorter than the time when the tail is invisible. The tail is drawn further back than the head, but occasionally being visible can enhance the sense of three-dimensionality, and constantly exposing the tail to a strong sense of three-dimensionality can prevent eye and brain fatigue. In particular, the display device 1 may perform such drawing processing while in a voice recognition standby state. The display device 1 may have a function for drawing the tail so that it appears from the top of the head when the tail is visible. In this way, the viewer's line of sight is normally directed at the eyes of the face, and the tail suddenly pops out above the head from the center above, providing a sense of surprise and interest.

[0203] The display device 1 may provide a flat portion on top of the character 1200's head when viewed from the front, and particularly may render the head portion between the left and right ears as flat when viewed from the front. This allows a three-dimensional tail to suddenly appear above the head from the flat top of the head, which has a weak three-dimensional appearance, creating a more surprising and entertaining effect. The display device 1 may also render the tail as if it were appearing from above the head, and then move the portion of the tail near the tip. This allows the viewpoint to be focused on the tail portion behind the face, creating a stronger sense of three-dimensionality. The display device 1 may similarly render the tail as if it were appearing from the left and right sides of the body. When tails are made to appear from the left and right sides, the display device 1 may shorten the length and / or duration of the tail's appearance compared to when the tail appears from above the head. When tails are made to appear from the left and right sides, the display device 1 may render them as if they were flickering. The display device 1 may also render the tail as if the viewpoint were occasionally moved to the back, creating a stronger sense of three-dimensionality. The display device 1 may preferably render the tail appearing from above the head during voice recognition, and may render the tail appearing from either the left or right side when the cat outputs a voice. The display device 1 may preferably provide portions of the tail at predetermined intervals along its length that have a different rendering pattern from the other portions. For example, it may be possible to provide circular or arc-shaped patterns with a predetermined width on the cylindrical surface of the tail at regular intervals. The inventors have found that this approach makes the tail appear to move more dynamically in three-dimensional space.

[0204] The display device 1 may be configured to change its current posture to the same posture when there is a change from a non-voice recognition state to a voice recognition state, so that the posture remains the same during voice recognition. The display device 1 may be configured to say "Let's talk" before starting voice recognition. The display device 1 may be provided with a function to detect the observer's movements (e.g., a sensor or switch), and a function to say "What's that?" when it detects a movement from the observer. Both functions may be executed consecutively in the form of "What's that?" and "Let's talk," and then processing may be performed to enter the voice recognition state.

[0205] The display device 1 is provided with information on phrases that are praiseworthy, such as "cute," as speech recognition phrases, and when it recognizes a phrase that is praiseworthy, it should change its body posture. It is even better to move the cat's position, such as by walking. In this way, the observer, wanting to see the cat's changes in posture and movement, will be more likely to use praiseworthy words and actions, which will result in excellent therapeutic effects such as improvements in behavior and speech.

[0206] The display device 1 may be provided with a voice recognition phrase corresponding to feeding, and when the phrase is recognized, the tail may be drawn wagging faster than in other cases, which gives the viewer a more realistic feeling that the cat is actually alive.

[0207] The display device 1 may render the outline of the cat's eye as a roughly circular shape, and the pupil as a vertically elongated oval. The display device 1 may render the pupil with a vertical gradation of light and dark, with the color becoming brighter as it moves downward. The display device 1 may provide a roughly circular or oval-shaped area in the center of the pupil that is darker than the surrounding area. The display device 1 may render a crescent- or half-moon-shaped white area along the outer edge of the pupil above the pupil toward the outer edge of the face. In contrast, the display device 1 may render a circular white area below the pupil toward the center of the face. The display device 1 may continue to render this white area even when the position of the character 1200 changes (such as a change in posture) or the position of the camera or light changes. Typically, highlights are added by calculation to reflect light, etc. However, by doing so, the cat's individuality can be emphasized in the eye area, which is most visible when speaking using voice recognition, and the cat can be made to look unique in the short time it takes for voice recognition to be performed.

[0208] The display device 1 can be in a state where the face is facing forward and a state where the face is facing downward, and when the face is facing forward, the outline of the eyes is drawn in a roughly circular shape, while when the face is facing downward, the eyes are drawn in a horizontally elongated oval shape.

[0209] The display device 1 may take a state in which the top of the face is above the top of the torso and a state in which the top of the face is below the top of the torso, and when the top of the face is above the top of the torso, the outline of the eyes may be drawn in a roughly circular shape, while when the top of the face is below the top of the torso, the eyes may be drawn in a horizontally elongated oval shape. The display device 1 has a function for drawing a state in which the mouth is open and the eyes may be drawn closed when drawing this state.

[0210] The display device 1 may prepare a plurality of standby motion patterns for the character 1200, and repeatedly select one of these patterns to draw. The standby motions include a motion to lick a foot, a motion to stroke a face with a hand, a motion to lick a buttocks, a motion to look forward, a motion to look left and right, a motion to lick the ground, a motion to stretch, a motion to yawn, a motion to walk, and the like.

[0211] The display device 1 may be configured to draw the ears so that they move with a lag behind the movement of the face. For example, the ears may be drawn so that they remain in position for a while even after the face starts moving. The display device 1 may be provided with a function for simultaneously performing a tail-wagging motion from side to side when performing a licking motion. The display device 1 may be configured to have an asymmetrical pattern on the body of the character 1200 when viewed from the front. This makes the character 1200 easier to remember as a unique cat and makes it easier to distinguish whether the right or left side is being viewed. This is particularly useful when creating a scene where the entire character 1200 is enlarged so that it cannot be seen. In particular, the pattern should be that of a calico cat, and more particularly, a tabby cat. The inventors have found that this makes it easier to grasp the three-dimensional effect. In particular, it is advantageous to have the pattern on the head in the front-to-back direction, while the pattern on the body in the up-to-down direction, so that the directions of the patterns are different. This makes it easier to recognize changes in the position of the camera or the cat, regardless of the direction of movement.

[0212] The display device 1 has a function of emitting the meow sound "meow," and the meow sound can have multiple intonations, with different motions corresponding to each meow. The intonations can include a questioning intonation, and the motion can include a head tilting motion.

[0213] <9. About the communication function for Character 1200> A supplementary explanation will be given regarding the communication function relating to the character 1200. By doing the following, it is possible to provide the observer with a higher quality communication function with the character 1200. Here, an outline of the actions of the person involved in taming the character and the story of their actions with the character 1200 will be explained. In this embodiment, as shown in FIG. 32, a photographing unit 227 for photographing the observer is provided on the front side of the display device 1.

[0214] (9-1) First step: Taming Usually, there are various types of cats, such as stray cats, that run away just by seeing a person, or that run away when a person approaches. In such cases, the cat's behavior appears to be running away while repeatedly looking back to check the person's movements. Here, the processing board 224 recognizes the presence of an observer based on the captured image taken by the image capture unit 227, and when the microwave intensity (received intensity) measured by the human sensor 234 exceeds a threshold, it displays an image of the character 1200 making a running-away motion. This is to determine that a person has approached the cat. The reason for recognizing the observer with the image capture unit 227 is to allow the observer to see the character 1200 running away. In other words, the character 1200 will not make a running-away motion unless the observer approaches the display device 1 from the front.

[0215] Next, the person is likely to call out to the cat, such as "Squat down (lowering the eyes)" or "Come on, come on." Some cats may stop and watch the person. However, when the person approaches, the cat will run away. This happens several times. It is likely that the cat will not get used to this type of human behavior. Therefore, if the microwave intensity measured by the human sensor 234 is below a certain threshold while the video of the character 1200 running away is displayed, and if the processing board 224 recognizes a voice recognition of a word, such as "Come on," that indicates a call to the character 1200, then it displays a video of the character 1200 making an action as if it is stopping. Here, the condition that the microwave intensity is below the threshold is set because it is assumed that a human will stop.

[0216] Next, a person might feed a cat that has stopped by. However, if a person approaches a cat, the cat will run away, so the only option is to leave food in a place where the cat often visits. Therefore, the display device 1 has a function to display an image of food being placed in the image display space. For example, when the processing board 224 receives a predetermined operation using the operation area OT (e.g., an operation on the operation unit 2214) or when the first sensor 2231 detects a predetermined gesture instructing the placing of food, the processing board 224 determines that food has been placed and displays an image of the food in the image. This image may be displayed using either the first display unit 310 or the second display unit 330. In this way, the observer will place food, for example, every day. At this time, the processing board 224 may display a character 1200 watching the behavior from a distance. When the processing board 224 does not recognize the presence of an observer using the human sensor 234 and the observer is not photographed by the photographing unit 227, it displays an image of the character 1200 eating the food. This simulates a situation in which a cat refuses to eat food in front of a person. From the observer's perspective, this creates a situation in which the food supply is emptied before the observer even notices. The processing board 224 counts and stores the number of times the observer feeds the cat. This state continues for a while, but the processing board 224 may display a picture in which the distance between the observer, the character 1200, and the person (the distance perceived by the observer) gradually decreases depending on the number of times the observer feeds the cat. For example, the processing board 224 may start feeding the cat and display the character 1200 larger as the number of times the observer feeds the cat, thereby replicating the decrease in the distance (i.e., the cat becoming somewhat accustomed to the person). Furthermore, when the number of times the cat is fed increases and reaches a predetermined threshold, the processing board 224 determines that the cat has become accustomed to the person and displays an image of the character 1200 eating the food, even if the observer is looking at the character, i.e., even if the processing board 224 recognizes the presence of the observer using the human sensor 234 and the observer is being photographed by the photographing unit 227. Only then can the observer observe the character 1200 eating the food.

[0217] However, it is often the case that people do not know when a cat will eat its food. Therefore, the processing board 224 may determine a time period (or alternatively, a specific time) when the character 1200 will eat its food, and may make the character 1200 perform the action of eating food during that time period. This is to make the observer aware that the character 1200 appears to be eating its food during that time period. When the processing board 224 detects that the observer is attempting to touch the character 1200, it causes the character 1200 to output a predetermined voice message, such as "hiss" or "hiss," and causes the character 1200 to perform an action of running away. The observer's attempt to touch the character 1200 may be identified when the microwave intensity detected by the human sensor 234 exceeds a threshold value while the character 1200 is performing the action of eating food, or when the first sensor 2331 detects a predetermined gesture.

[0218] This situation continues for a while, and the processing board 224 may gradually reduce the distance at which the observer's hand can approach the character 1200. When the observer approaches the character 1200 to a predetermined distance, the processing board 224 may determine that the character 1200 has become accustomed to the observer and display an image of the character grooming itself or relaxing in public. Specifically, the processing board 224 may increase the threshold for microwave intensity or the threshold for the distance from the display device 1 when a gesture is made. In this way, the processing board 224 reduces the detection sensitivity, slowing the character 1200's reaction to the observer's movements and preventing it from making utterances such as "hiss" or "hiss hiss."

[0219] Although cats are always alert, they will gradually begin to groom themselves, lie down, scratch their claws, wipe their faces, and perform other actions. As cats gradually become accustomed to people and their hands, people will be able to touch them with their hands. Therefore, the processing board 224 may prevent the microwave detection results from the human sensor 234 from being reflected in the behavior of the character 1200. The processing board 224 may cause the first sensor 2331 to function as a motion sensor, and may display an image of the character 1200 appearing to feel comfortable when petted, based on the detection results of the observer's up / down, left / right, and forward / backward gestures. The processing board 224 may further recognize the observer's voice using the microphone 2333 and display an image of the character 1200 responding to the voice. For example, the processing board 224 may be configured to emit a "meow" sound as the spoken content, regardless of the words it recognizes.

[0220] The processing board 224 may further display an image of the character 1200 begging for food as time passes. The processing board 224 may recognize the presence of an observer using the image capture unit 227, and when the presence of the observer is detected using the human sensor 234, may determine a time period (e.g., morning, afternoon, or evening) and display an image of the character 1200 making a meowing sound and rubbing its face against the observer. Furthermore, the processing board 224 may reproduce a state in which the character 1200 learns its own name as the observer calls out to the character 1200. For example, the processing board 224 may make a meowing sound only in response to the word "Yuno," or may display an image of the character behaving in a pampered manner or rubbing its face happily in response to calls such as "Yuno" or "Here's some food."

[0221] (9-2) Second step: Learning the language (Japanese) When the processing board 224 recognizes an observer's call to "Yunho," it outputs a voice indicating a response of "What?" From this point on, the character 1200 begins to learn words. The processing board 224 counts the number of times it is called out, calculates the cumulative average per day, and responds according to a value calculated by multiplying the cumulative average number of times it is fed per day by the cumulative average number of times it is called out by a random coefficient (hereinafter referred to as the "cumulative average"). This call is, for example, a predetermined call such as "Good morning," "Hello," "Good evening," "How are you?", or "Do you want some food?" Depending on the cumulative average value, the processing board 224 may stop responding (i.e., reproduce the character 1200's forgetting of words) or increase the number of words it responds with. For example, the processing board 224 may reduce the number of words it responds with as the cumulative average value decreases, and increase the number of words it responds with as the cumulative average value increases. The cumulative average value is calculated based on the number of times the display device 1 has been called from the start of use to the present time, but it may also be calculated based on the number of times the display device 1 has been called from a predetermined period of time prior to the present time. The predetermined period may be a fixed period, such as one month, or, if the display device 1 has not been used for a certain period of time, it may be the period from the start of use after that period. The cumulative average value may fluctuate significantly when the display device 1 is first used. For example, if the observer does not call out to the character 1200 even once a day, the character 1200 may stop responding. However, as the number of times the character 1200 is called out increases, the cumulative average value does not change significantly. This makes it possible to reproduce the behavior of the character 1200 taking time to forget words. The random coefficient used in calculating the cumulative average value is a value used to reproduce the capriciousness of a cat and may be called a capricious coefficient. The random coefficient can be varied depending on the actions of the character 1200 and the observer, such as giving or not giving food when the character 21200 begs for food, or waking up the character 1200 by talking to or touching it when it is sleeping.

[0222] Furthermore, when the cumulative average value exceeds a certain threshold, the processing board 224 may have the character 1200 speak to the observer or respond to questions about predetermined information such as the weather or the news. Of course, if the observer reduces the number of times they feed the character, the cumulative average value will decrease, and the processing board 224 will reduce the number of responses or stop responding altogether. In other words, if the observer is careless in feeding the character or does not speak to the character appropriately, the character 1200 may not maintain its ability to respond, or even if it does, it may not respond due to "whims." In this way, a higher quality communication function with the character 1200 can be provided to the observer.

[0223] [Other embodiments] The present disclosure is not limited to the above-described embodiments, and can be modified as appropriate within the scope of the present disclosure.

[0224] The display device 1 may have an operation receiving means for receiving operations from the observer, such as a touch sensor or a proximity sensor, in the observation area SC. In this way, the observer can perform operations using the observation area SC. For example, if such an operation method is adopted in a communication function, it can be expected to have the effect of improving the quality of communication with characters that can be observed through the observation area SC.

[0225] The first display unit 310 may display an image that is recognized as a three-dimensional image (stereoscopic image). This is expected to further improve the stereoscopic effect given to the viewer. The display method may be a naked-eye stereoscopic method such as a lenticular lens method or a parallax barrier method, or a display method that allows the viewer to recognize the image as a three-dimensional image using glasses.

[0226] The display device is not limited to a rectangular parallelepiped shape, and may be a cube, a cylinder, other polyhedrons, a sphere, or other shapes. The shapes, structures, dimensions, colors, patterns, etc. of the components of the display device 1 described above are merely examples. Some of the components included in the display device 1 described above may be omitted, or other components may be added. For example, the second display unit 330 may be omitted, or the second display unit 330 emitting the second image light L2 toward the first direction may be disposed upright instead of the background plate 910. Aerial imaging may also be achieved using an optical system other than that described in FIG. 13 . The configuration of the present invention may be applied to a display device using a display system or a projector system, rather than an aerial imaging system. In the case of a display system, a liquid crystal display, an organic EL display, or other display system may be used as the image display unit. For example, the image display unit may be a display unit provided inside the image display space and having a display surface facing the observation area SC (e.g., a display surface parallel to the observation area SC). This display unit may have the same configuration as the first display unit 310 or the second display unit 330 and may be provided on the rear side of the image display space. In the case of a projector system, a projection surface and projection means for projecting an image onto the projection surface may be used. The light-reducing member 200 may be provided on the front side or rear side of the opening 110 to reduce light entering the image display space from the outside. If the image display space S1 is to be maintained in a relatively dark state, a configuration without the light-reducing member 200 may be considered.

[0227] Furthermore, in the above embodiment, voice recognition for interacting with a character displayed on the video display unit is enabled in response to a pressing operation of the operation unit 2214, but this is not limiting. For example, when the presence of a person is detected in a detection target area of ​​a human presence sensor (an example of a detection means) such as an omnidirectional microwave Doppler sensor, the processing board 224 may enable the voice recognition. In this way, when the user interacts with a character displayed on the video display unit, for example, the user does not need to perform an operation to enable voice recognition or utter a trigger word, and communication can be reproduced more naturally.

[0228] In this case, for example, it is preferable that both the voice recognition in the voice recognition application in the display device 1 and the voice recognition in the voice recognition server are enabled. However, as will be described below, the enabling of the voice recognition in the voice recognition application in the display device 1 and the enabling of the voice recognition in the voice recognition server may be performed in stages. For example, when the presence of a person is detected in the detection target area of ​​the human presence sensor or the like, the voice recognition in the voice recognition application in the display device 1 may be enabled, and thereafter, when the voice recognition application detects a call or greeting from an observer, the voice recognition in the voice recognition server may be enabled.

[0229] Furthermore, if the display device 1 is equipped with a photographing unit (an example of a detection means) such as a camera, a detection target space may be provided on the front side of the display device 1, and the processing board 224 may be configured to enable voice recognition when it detects the presence of a person on the front side of the display device 1. In this way, it is possible to enable voice recognition after more reliably determining that the viewer is trying to speak to the character displayed on the video display unit.

[0230] Furthermore, after a person is detected in the detection target area, the processing board 224 may be configured to enable the voice recognition on the condition that user authentication is successful. The authentication method for user authentication may be, for example, an authentication method that does not require manual operation by the user (such as face recognition or vocal cord recognition). In this way, for example, when user authentication is performed on a person other than a registered user registered in the display device 1 and the user authentication fails, voice recognition is not enabled and the user cannot interact with the character displayed on the video display unit. Conversely, the character displayed on the video display unit does not respond to people other than the registered user. This can increase the user's attachment to the character.

[0231] Furthermore, if a voice containing a phrase other than the phrases pre-registered in the dialogue server installed in the display device 1 or the external server is detected, the voice recognition may not be enabled.

[0232] An odor sensor may also be used as a means for activating voice recognition. For example, the odors of registered users of the display device 1 may be registered in advance in the display device 1, and voice recognition may be activated when the odor of the registered user is detected by the odor sensor.

[0233] Furthermore, even if voice recognition is enabled in this manner, it is preferable that the voice of a character (e.g., character 1100) displayed on the video display unit is not output immediately, but that the voice of the character is not output unless the user speaks to it. For example, the processing board 224 does not immediately output the character's voice saying "Welcome back" in response to the voice recognition being enabled, but rather outputs the character's voice saying "Welcome back" on the condition that the user's voice saying "I'm home" is detected while the voice recognition is enabled. Furthermore, for example, in the dialogue system, a branching scenario may be created to reproduce the following dialogue between the observer and a character (e.g., character 1100). For example, on a weekday, User: I'm home Character: Welcome back~ User: Atchi Character: I'm tired in this heat. The following dialogue is reproduced, and if it is a holiday, User: I'm home Character: Ah, welcome back User: Atchi Character: I went out in the heat so I won't complain User: Work, work. Character: Sorry if that's true, thank you for your hard work. It is advisable to create a branching scenario that reproduces the following dialogue:

[0234] In addition, a branching scenario may be created according to the detection result of the odor sensor. For example, User: The meal was delicious! Character: "Well, let me smell it. Sniff sniff. It smells good!" or "Hmm? Isn't that a lot of salt? Take care!" A dialogue such as the following may be reproduced.

[0235] As another example, when an odor is detected by an odor sensor, Character: Sniff sniff, huh? What's that smell? User: I lit some aroma Character: Ah, that's why I thought it was relaxing. If the observer's response to the question about the type of smell is not registered in the branching scenario, a voice such as "Oh, I see!" may be uniformly output as the character's voice.

[0236] Furthermore, the processing board 224 may continuously record voice for a predetermined period of time (e.g., about 15 seconds) in the recent past, and activate the voice recognition when a trigger word for activating the voice recognition is detected. For example, the voice recognition application of the display device 1 may be constantly activated (or activated in response to a pressing operation of the operation unit 41, etc.), and the voice recognition by the voice recognition server may be activated upon detection of a trigger word. In this case, the processing board 224 may transmit voice data of the voice detected by the microphone 2333 (an example of a voice detection means) (e.g., voice detected between the start and end of detection) excluding the voice of the trigger word to the voice recognition server. For example, assume that a user voice saying, "I'm going to Tokyo tomorrow. Can you tell me the weather, Rei-tan?" is detected. In this case, the trigger word is "Rei-tan," the nickname of the character 1100. In this case, the processing board 224 transmits the detected voice "I'm going to Tokyo tomorrow, Rei-tan, tell me the weather", excluding the trigger word voice "Rei-tan", to the voice recognition server.

[0237] Here, for example, if the detected voice as described above, "I'm going to Tokyo tomorrow, so please tell me the weather, Rei-tan," is sent as is to the voice recognition server, the voice of the character corresponding to the voice recognition result may not be accurately extracted in the dialogue server due to the inclusion of "Rei-tan" in the voice recognition result, and the dialogue with the user may not flow smoothly. In contrast, by doing as described above, even if a trigger word is uttered in the middle of a sentence, the voice data of the voice excluding the trigger word is sent to the voice recognition server. Therefore, it is possible to prevent the dialogue with the user from becoming unsuccessful due to voice recognition being performed with the trigger word included in the middle of a sentence.

[0238] Furthermore, when realizing a dialogue between a user and a character displayed on the video display unit through cooperation between a voice recognition server and a dialogue server, the following operations may be performed depending on the configuration of the voice recognition server.

[0239] For example, if the voice recognition server is configured to start voice recognition processing after completing reception of the voice data file, the processing board 224 may individually transmit to the voice recognition server each voice data file of the voice before and after the voice of the trigger word among the voices detected by the microphone 2333. For example, among the voices detected between the detection start time and the detection end time, the voice data file of the user voice detected before the voice of the trigger word (also referred to as the first half of the user voice) may be transmitted to the voice recognition server prior to the voice data file of the user voice detected after the voice of the trigger word (also referred to as the second half of the user voice).

[0240] In this way, the voice recognition server starts voice recognition processing for the first half of the user voice without waiting for the completion of reception of the voice data file for the second half of the user voice. Therefore, voice recognition processing can be performed more efficiently than when a voice data file combining the first half and second half of the user voice is transmitted to the voice recognition server. As a result, the display device 1 can receive the character voice from the dialogue server earlier, thereby shortening the user's waiting time until a response to the user's voice is received.

[0241] Furthermore, for example, if the voice recognition server is configured to stream voice data from the display device 1 and perform voice recognition processing in real time, when the first half of the voice data is transmitted to the voice recognition server in real time, the playback speed T1 of the user voice for the first half of the voice may be controlled to be faster than the standard playback speed T0 (T1>T0). For example, the processing board 224 may change the settings of the voice recognition server so that the first half of the user voice is reproduced 25% faster than the standard playback speed T0, and then transmit the first half of the voice data. In this way, the voice recognition server can complete the voice recognition processing for the first half of the user voice earlier and start the voice recognition processing for the second half of the user voice earlier, compared to when the first half of the user voice is reproduced at the standard playback speed T0. As a result, the display device 1 can receive the character voice from the dialogue server earlier, thereby shortening the user's waiting time for a response to the user's voice.

[0242] Furthermore, when the voice data of the latter half of the user voice is transmitted to the voice recognition server in real time, it is preferably controlled such that the playback speed T2 of the voice in the latter half is faster than the standard playback speed T0 and slower than the playback speed T1 of the user voice in the first half (that is, it satisfies the relationship of T0 < T2 < T1). For example, the processing board 224 changes the setting so that the user voice in the latter half is played back 10% faster than the standard playback speed T0 in the voice recognition server and transmits the voice data of the latter half. In this way, both the user voice in the first half and the user voice in the latter half are streamed and played back faster than the standard playback speed T0, and voice recognition processing is executed in the voice recognition server. As a result, the waiting time of the user until a response is made to the user's voice can be further shortened. On the other hand, the user voice in the latter half is played back at a speed that is faster than the standard playback speed T0 but slower than the playback speed T1 of the user voice in the first half. Therefore, a decrease in the voice recognition accuracy in the voice recognition system can be suppressed. Thus, it is possible to further shorten the waiting time of the user while suppressing a decrease in the voice recognition accuracy.

[0243] In addition, when voice recognition processing by streaming playback of voice data is executed in real time in the voice recognition server, for example, although the user voice detected by the microphone 2333 is transmitted to the voice recognition server in real time, it is preferably controlled such that voice recognition in the voice recognition server is not started until the voice of the trigger word is detected.

[0244] The scope of the present invention is not limited to the configurations explicitly described in the specification, but also includes combinations of various aspects of the present invention disclosed in this specification within its scope. Among the present invention, the configuration for which a patent is sought is specified in the appended claims, but even a configuration that is not currently specified in the claims has the intention of being the subject of future claims with the configurations disclosed in this specification.

[0245] The present invention is not limited to the configurations described in the above-described embodiments. The components of each of the above-described embodiments and variations may be arbitrarily selected and combined. Furthermore, any component of each embodiment or variation may be arbitrarily combined with any component described in the Summary for Solving the Problems of the Invention or any component embodying any component described in the Summary for Solving the Problems of the Invention. The present invention also intends to obtain rights to these configurations through amendments or divisional applications of this application. Even if a description is made of "in the case of..." or "when...," this does not mean that the configuration is limited to that case or time. Configurations that are not limited to those cases or times are also disclosed, and the present invention intends to obtain rights to them. Furthermore, any descriptions that specify an order are not limited to this order. Configurations in which some parts are deleted or the order is changed are also disclosed, and the present invention intends to obtain rights to them.

[0246] Furthermore, we intend to obtain rights to the entire design or partial design by converting the application to a design registration. If the device displays an image, we intend to obtain rights to the design including the entire image or a portion of that image. The drawings depict the entire device using solid lines, but they also include partial designs claimed for parts of the device. For example, a partial design may be a partial design for a part of the device, or a part of that part. A partial design may be a part of the device, or a part of that part. We intend to obtain rights to not only the entire design, but also partial designs in which any part of the solid line portion of the drawing is drawn with a dashed line. Furthermore, all of the modules, components, and parts inside the device's casing shown in the drawings are subject to independent commerce, and we intend to similarly obtain rights to them by converting the application to a design registration. [Explanation of symbols]

[0247] 1:Display device 100: Housing 101: Right panel 102: Front panel 103: Left panel 104: Rear panel 105: Top cover 106: Lower lid part 107: Right inner panel 108: Front inner panel 109: Left side inner panel 110: Opening 200: Light-reducing material 210: 1st area 220:Second area 221: Operation board 222: Slot 223: USB connector 224: Processing substrate 226: Holding part 227: Photography Department 231: Control board 232: Wiring 233: Sensor board 234: Human Sensor 310: 1st display section 311: 1st display screen 312: Viewing angle control member 320: Optical components 321: 1st page 330:Second display 331: 2nd display screen 400: Base 500: Light blocking material 601: First plate 602: Second plate 800: Wiring section 810: Power line 820: Signal line 830: Signal line 900: Partition material 910:Background board 1041: Rear lid part 1051: Opening 1052: Opening 1100: Character 1200: Character 1210: Character body 1220: Collar 1221: Bills 2100: Stage footage 2200: Stage footage 2211 :Operation unit 2212 :Operation unit 2213 :Operation unit 2214 :Operation unit 2251: Speaker 2252: Speaker 2261: Heat sink 2311: Power jack 2331: First sensor 2332: Second sensor 2333: Microphone 2334: Light-emitting part

Claims

1. A display device that displays a character on a video display unit and can output the character's voice from a speaker, Based on the detected voice detected by the microphone, a process of detecting a voice of a trigger word for enabling voice recognition is performed; transmitting voice data of the detected voice excluding the voice of the trigger word to a voice recognition server; controlling the speaker to output the character voice received from the dialogue server based on the speech recognition result by the speech recognition server; Processing Board A display device comprising:

2. 2. The display device according to claim 1, When the processing board is configured to start the voice recognition process after the voice recognition server has completed receiving the voice data file, transmit, to the voice recognition server, a voice data file of a first half of the detected voice, which is the user voice detected before the voice of the trigger word, and a voice data file of a second half of the detected voice, which is the user voice detected after the voice of the trigger word, separately; transmitting the voice data file of the first half of the user voice to the voice recognition server prior to the voice data file of the second half of the user voice; A display device characterized by:

3. 2. The display device according to claim 1, When the processing board is configured such that the voice recognition server streams voice data from the display device and executes voice recognition processing in real time, When the voice data of the first half of the user voice is transmitted to the voice recognition server in real time, a playback speed T1 of the first half of the user voice is controlled to be faster than a standard playback speed T0. A display device characterized by:

4. 4. The display device according to claim 3, the processing board controls the playback speed T2 of the user voice in the latter half portion to be faster than the standard playback speed T0 and slower than the playback speed T1 of the user voice in the former half portion when the voice data of the user voice in the latter half portion is transmitted to the voice recognition server in real time; A display device characterized by:

5. 2. The display device according to claim 1, the processing board controls so that voice data of the voice excluding the trigger word is transmitted to the voice recognition server even if the trigger word is uttered in the middle of a sentence. A display device characterized by:

Images