Indicator devices, etc.

Abstract

To provide a display device and the like that can obtain high visibility about a display image.SOLUTION: A display device 1 includes a housing 10, an image display unit 20, and a light reducing member 30. The housing 10 includes an opening 5 through which an image is viewed in a first direction side in an internal space 100 where light is blocked. The image display unit 20 is disposed in the internal space 100. The light reducing member 30 is disposed apart from the image display unit 20 on the first direction side relative to the image display unit 20.SELECTED DRAWING: Figure 6

Description

Technical Field

[0001] For example, the present invention relates to a display device or the like capable of displaying an image. Background Art

[0002] There are display devices that include an image display unit and display two-dimensional images and three-dimensional images on the image display unit. For example, Patent Document 1 discloses a display device that displays a three-dimensional image on an image display unit. Prior Art Documents Patent Documents

[0003] Patent Document 1 Japanese Unexamined Patent Publication No. 2003-295113 Summary of the Invention Problem to be Solved by the Invention

[0004] However, the inventor of the present application has found that in a display device such as that described in Patent Document 1, depending on the configuration of the display device, for example, image light from the image display unit and external light may combine to reduce the visibility of a displayed image.

[0005] An object of the present invention is to provide a display device or the like that can achieve high visibility of a displayed image.

[0006] The object of the present invention is not limited thereto, and the applicant intends to obtain rights through divisional applications, amendments, etc., for configurations that aim to obtain the effects derived from the components of the configuration disclosed in this specification and the drawings, etc. For example, problems that can be described as "can be achieved" in this specification are disclosed here by reinterpreting them as "the problem is...". Each problem is described independently, and the applicant intends to obtain rights to each configuration for solving each problem individually through divisional applications, amendments, etc. Even if a problem is implicitly understood from the description in the specification, the applicant intends to include a part of the configuration described in this specification in the claims through amendment or divisional application. Furthermore, configurations that solve problems by combining these independent problems are also disclosed, and the applicant intends to obtain rights to them. [Means for solving the problem]

[0007] The object of the present invention can be achieved, for example, by the following embodiments (1) to (23).

[0008] (1) A display device for displaying an image, comprising: a housing having an opening for viewing the image on the first direction side in a light-shielded internal space; an image display unit disposed in the internal space; and a light-reducing member disposed on the first direction side of the image display unit, at a distance from the image display unit.

[0009] This method suppresses the intrusion of external light into the internal space of the enclosure, and also prevents the image light from the image display unit from directly reaching the viewer's eyes. Therefore, it is possible to suppress the difficulty in viewing the image perceived in the internal space of the enclosure due to the combined effect of image light from the image display unit and external light, thereby providing a display device that can achieve high visibility of the displayed image.

[0010] (2) The light-reducing member may be placed between the opening and the image display unit.

[0011] In this way, a spatial area is formed inside the housing on the side of the light-reducing member where the image is viewed, and this spatial area can be used for a predetermined purpose.

[0012] (3) The surface of the dimming member on the first direction side may be inclined with respect to the display surface of the image display unit.

[0013] In this way, when a viewer looks at the image display unit through the light-reducing member, the reflection of the viewer's face on the light-reducing member can be reduced.

[0014] (4) The image display unit may display a first image which is recognized as a three-dimensional image and in which at least a portion of it is recognized as being on the side of the opening rather than the light-reducing member.

[0015] In this way, the viewer can get the sensation of being able to touch an image that can be recognized as a three-dimensional image.

[0016] (5) The image display unit may selectively display one of a plurality of images, including the first image and a second image which is recognized as existing on the first side of the first direction or on the second side opposite to the first direction, as images recognized as three-dimensional images.

[0017] In this way, it is possible to selectively display one of several images, including a first image and a second image, which are perceived as three-dimensional by the viewer at different positions, thereby changing the sense of depth given to the viewer.

[0018] (6) The housing further comprises an audio output section, wherein the audio output section is provided on the first surface of the housing facing the internal space, on the first direction side of the light-reducing member, and at a position where the distance from the light-reducing member is smaller than the distance from the opening.

[0019] With this arrangement, the sound output from the sound output section may be reflected by the dimming member and transmitted to the viewer, so that the viewer can be made to feel as if the sound is coming from the image itself displayed on the image display section, for example. In addition, since the sound output section is disposed at a position that is difficult for a viewer to see, the design of the display device can be improved.

[0020] (7) An upper end portion of the opening is provided further upward than an upper end portion of the display surface of the image display section, and an upper surface of the internal space is preferably inclined downward toward the upper end portion of the display surface from the upper end portion of the opening.

[0021] With this arrangement, the viewer can view the image displayed on the image display section while looking down thereon, so it is easy for the viewer to view the image in a natural posture.

[0022] (8) The image display section preferably includes a light source and a display body that displays an image by modulating light from the light source.

[0023] In an image display section that displays an image by modulating light from a light source, when light leaks from the light source and the position of the light source is recognized by a viewer, there is a risk that the floating feeling of an image seeming to emerge in an internal space may be impaired. The presence of the dimming member makes it difficult for the light leaking from the light source to be visually recognized, so that a higher floating feeling of the image can be provided.

[0024] (9) An upper end portion of the opening preferably protrudes toward the first direction side more than a lower end portion of the opening.

[0025] With this arrangement, it is possible to suppress a reduction in the visibility of the image on the image display section caused by reflection of light from above the display device by the dimming member.

[0026] (10) The housing has a cover portion on an upper surface of the housing, and an accommodation space is provided between the cover portion and the upper surface of the inner peripheral surface of the housing, and a control unit related to the display device may be disposed in the accommodation space.

[0027] With this configuration, maintenance of the control unit related to the display device can be performed by removing the cover portion provided on the upper surface of the housing. Therefore, the maintainability of the display device can be improved.

[0028] (11) A power supply unit provided below the internal space of the housing is preferably provided, and a connection cord that electrically connects the power supply unit and the control unit is preferably wired so as to pass through a gap area secured between an outer peripheral wall of the housing and the internal space.

[0029] With this configuration, the power supply unit is disposed at a position that is not easily noticeable, the center of gravity of the display device can be lowered, and the posture of the display device can be easily stabilized. Further, the connection cord connecting the power supply unit and the control unit can be wired so as not to be visible to an observer.

[0030] (12) The cover portion is attached to a main body portion of the housing at a plurality of attachment positions, the cover portion and the main body portion are coupled using a first fixing member at a first attachment position on a first direction side among the plurality of attachment positions, at a position inside an outer peripheral wall of the housing, and are preferably coupled using a second fixing member from an outside of the outer peripheral wall of the housing at a second attachment position on a second direction side opposite to the first direction with respect to the first attachment position of the display device.

[0031] With this configuration, at the second attachment position which is not easily visible to an observer, the cover portion and the main body portion are coupled from the outside of the outer peripheral wall using the second fixing member that can be attached and detached from the outside of the outer peripheral wall, and at the first attachment position which is easily visible to an observer, the cover portion and the main body portion are coupled using the first fixing member at a position that is not easily visible to the observer, so that the design performance of the display device can be enhanced.

[0032] (13) The display device may further include an operating section provided in the lower part of the housing on the side of the opening in the first direction.

[0033] In this way, when a user operates the control unit, their hand will not overlap with the image displayed on the image display unit, allowing the user to operate the control unit while viewing the image displayed on the image display unit. Therefore, it becomes easier for the user to operate the control unit, thus improving the usability of the display device.

[0034] (14) It is preferable that a plurality of the light-reducing members be provided in a detachable manner.

[0035] In this way, the brightness of the image displayed on the image display unit can be adjusted without the need for a separate adjustment component.

[0036] (15) The image display unit may further include motion detection means capable of detecting the movements of a viewer, and motion control means that controls the movements of the specific character according to the detection result by the motion detection means.

[0037] In this way, when a viewer's movement is detected, a specific character will move according to the detection result, thus recreating communication between the viewer and that specific character.

[0038] (16) The motion detection means is a motion detection sensor capable of detecting the behavior of an object, and the motion detection sensor is preferably arranged to detect a gesture made in the internal space of the housing.

[0039] In this way, the behavior detection sensor can detect, for example, a person's gestures within the internal space of the enclosure. Therefore, compared to when the behavior detection sensor is located on the outer surface of the enclosure, the decrease in the sensitivity of the behavior detection sensor can be suppressed.

[0040] (17) The behavior detection sensor may be located on the upper surface of the inner circumferential surface of the housing.

[0041] In this way, the motion detection sensor is installed on the inner surface of the housing where external light is less likely to penetrate, thus suppressing a decrease in the sensitivity of the motion detection sensor.

[0042] (18) The behavior detection sensor emits light and receives the reflected light to detect the gesture, and the display device further comprises a member provided in the direction of the light emission to suppress the emission of light from being received by the behavior detection sensor.

[0043] In this way, reflected light from parts of the housing located in the direction of light emission from the motion detection sensor becomes less likely to be received, thus further suppressing the decrease in the sensitivity of the motion detection sensor.

[0044] (19) The system may further include an odor sensor for detecting odors, a display output operation for displaying on the image display unit an image of a character performing movements corresponding to the detection results of the odor sensor, and an audio output operation for outputting audio corresponding to the detection results of the odor sensor as audio spoken by the character displayed on the image display unit.

[0045] In this way, it is possible to recreate scent-related communication between the character displayed on the image display section of the display device and the user. For example, when a scent is detected by the scent sensor, the system can be controlled to output audio, such as the character saying "I smell something," or to display video, showing the character sniffing. Therefore, a wider variety of communication can be achieved between the character and the user.

[0046] (20) The display output operation is an operation to display on the image display unit an image of the character performing movements corresponding to the type of odor detected, and the sound output operation is an operation to output sound corresponding to the type of odor detected as sound emitted by the character.

[0047] In this way, communication regarding the type of smell can be reproduced between the character displayed on the image display unit and the user. For example, when the smell of cigarettes is detected, a display output action may be performed that shows the character making a motion as if disgusted by the smoke, or an audio output action may be performed that says words expressing concern for the user's health. Also, when the smell of fragrances such as aroma oils is detected, an audio output action may be performed that asks questions about the fragrance. By implementing such control, the range of communication between the character displayed on the image display unit and the user can be broadened, and the user's attachment to the character can be increased.

[0048] (21) The system further comprises a voice detection means capable of detecting sound and a detection means capable of detecting the presence of a person in the detection target area, wherein when the voice detection means detects the presence of a person in the detection target area, it is preferable to activate voice recognition for interacting with the character displayed on the image display unit.

[0049] This approach allows for more natural communication between the user and the character displayed on the image screen, without the user needing to utter a trigger word to activate speech recognition, for example.

[0050] (22) The device may further include a wind detection means for detecting wind, a display output operation for displaying on the image display unit an image of a character performing movements corresponding to the detection result of the wind detection means, and an audio output operation for outputting audio corresponding to the detection result of the wind detection sensor as audio spoken by the character displayed on the image display unit.

[0051] In this way, it is possible to recreate communication between the character displayed on the image display unit and the user regarding the wind provided to the display device. The wind can be generated artificially by the user, for example, by moving a part of the body such as waving a hand towards the display device, or by blowing breath on it.

[0052] (23) The operation control means may perform the display output operation or the sound output operation in accordance with the breath blown by the user, based on the detection result by the wind detection means.

[0053] In this way, it is possible to recreate communication between the character displayed on the image display unit and the user, in response to the breath blown onto the display device. [Effects of the Invention]

[0054] According to the present invention, it is possible to provide a display device or the like that can achieve high visibility with respect to the displayed image.

[0055] Furthermore, the effects of the present invention are not limited to those described herein. Effects derived from the components of the structure disclosed in this specification and the drawings are also disclosed, and the applicant intends to obtain rights to such components through divisional applications, amendments, etc. For example, phrases such as "can do" or "is possible" in this specification are descriptions that clearly indicate the effects to be achieved, and there are components that demonstrate effects even without such descriptions. Moreover, there are effects that can be grasped by the structure even without such descriptions. [Brief explanation of the drawing]

[0056] [Figure 1] This is a perspective view showing an example of a display device according to the present invention. [Figure 2] (A) A front view showing an example of a display device according to the present invention, and (B) A rear view showing an example of a display device according to the present invention. [Figure 3](A) A right side view showing an example of a display device according to the present invention, and (B) A left side view showing an example of a display device according to the present invention. [Figure 4] (A) A plan view showing an example of a display device according to the present invention, and (B) A bottom view showing an example of a display device according to the present invention. [Figure 5] This is an exploded perspective view showing an example of a display device according to the present invention. [Figure 6] This is a cross-sectional view taken along the line AA in Figure 2(A). [Figure 7] This is a perspective view illustrating the display device with the top cover removed. [Figure 8] This is a diagram showing the back surface of the top cover. [Figure 9] This is a control block diagram of a display device according to one embodiment. [Figure 10] This figure illustrates the outline of a display device according to one embodiment. [Figure 11] This figure illustrates the outline of a display device according to one embodiment. [Figure 12] This is a diagram illustrating a character according to one embodiment. [Figure 13] This diagram shows a 3D character in a stereoscopic state. [Figure 14] (A) A flowchart for recreating odor-related communication, and (B) A voice management table related to odor. [Figure 15] This is a flowchart for recreating communication regarding the frequency of stay. [Figure 16] (A) A flowchart for recreating communication regarding the place of stay, and (B) A voice management table regarding the frequency of stay. [Figure 17] (A) A flowchart for reproducing communication regarding the number of visits, and (B) A voice management table related to the number of visits. [Figure 18](A) A flowchart for recreating communication related to the length of stay, and (B) A voice management table related to the length of stay. [Figure 19] (A) A flowchart for reproducing communication related to behavioral patterns, and (B) A voice management table related to behavioral patterns. [Figure 20] This is a flowchart for reproducing the process of detecting suspicious individuals. [Figure 21] (A) A diagram showing the state where the 3D character is located behind the dimming member, and (B) A diagram showing the state where the 3D character is located in front of the dimming member. [Figure 22] This figure shows an example of an image displayed on a display device according to one embodiment. [Figure 23] This figure shows an example of an image displayed on a display device according to one embodiment. [Figure 24] This figure shows an example of an image displayed on a display device according to one embodiment. [Figure 25] This figure shows an example of an image displayed on a display device according to one embodiment. [Figure 26] This figure shows an example of an image displayed on a display device according to one embodiment. [Figure 27] This figure shows an example of an image displayed on a display device according to one embodiment. [Figure 28] This figure shows an example of an image displayed on a display device according to one embodiment. [Figure 29] This figure shows an example of an image displayed on a display device according to one embodiment. [Figure 30] This figure shows an example of an image displayed on a display device according to one embodiment. [Figure 31] This figure shows an example of an image displayed on a display device according to one embodiment. [Figure 32] This figure shows an example of an image displayed on a display device according to one embodiment. [Figure 33] This figure shows an example of an image displayed on a display device according to one embodiment. [Figure 34] This figure shows an example of an image displayed on a display device according to one embodiment. [Figure 35] This figure shows an example of an image displayed on a display device according to one embodiment. [Figure 36] This figure shows an example of an image displayed on a display device according to one embodiment. [Modes for carrying out the invention]

[0057] [Outline configuration of the display device] Figure 1 is a perspective view showing a display device 1 according to an example of the present invention. Figure 2(A) is a front view showing a display device 1 according to an example of the present invention, and Figure 2(B) is a rear view showing a display device 1 according to an example of the present invention. Figure 3(A) is a right side view showing a display device 1 according to an example of the present invention, and Figure 3(B) is a left side view showing a display device 1 according to an example of the present invention. Figure 4(A) is a top view showing a display device 1 according to an example of the present invention, and Figure 4(B) is a bottom view showing a display device 1 according to an example of the present invention. Figure 5 is an exploded perspective view showing a display device 1 according to an example of the present invention. Figure 6 is a cross-sectional view taken along the line AA in Figure 2(A). The general configuration of the display device 1 according to an example of the present invention will be described below with reference to Figures 1 to 6.

[0058] In each diagram, the left-right direction of the display device 1 is defined as the X direction, and the direction from the left side to the right side of the display device 1 is defined as the +X direction (positive X direction). The front-to-back direction (depth direction) of the display device 1 is defined as the Y direction, and the direction from the front side to the back side of the display device 1 is defined as the +Y direction (positive Y direction). The up-and-down direction of the display device 1 is defined as the Z direction, and the direction from the bottom side to the top side of the display device 1 is defined as the +Z direction (positive Z direction).

[0059] Display device 1 can be used for various purposes. For example, display device 1 may be used for commercial purposes (e.g., to attract customers, for advertising), for entertainment purposes (to entertain people), as a toy, etc. For example, in the case of commercial or entertainment purposes, display device 1 may be installed in public places such as stores and other commercial facilities. Display device 1 may be used at exhibitions of products or services to attract customers and entertain visitors by displaying images of a specific character introducing or advertising a product or service. Alternatively, display device 1 may be installed in various amusement facilities and used to entertain visitors to amusement facilities. In the case of a toy, display device 1 may be installed in the user's home, etc. Furthermore, as will be described later, if a three-dimensional image is displayed on display device 1, it may be used to entertain the viewer by allowing them to experience stereoscopic vision of the displayed object. The viewer is, for example, the user of display device 1.

[0060] As shown in Figure 5, the display device 1 comprises a housing 10, an image display unit 20 capable of displaying an image of an object to be displayed, and a dimming member 30.

[0061] The housing 10 is a box-shaped component that forms the outer shape of the display device 1. The ratio of the width (also called the left-right direction), height (also called the up-down direction), and depth (also called the front-to-back direction) of the housing 10 is approximately 1:1:1. However, this ratio of lengths is just an example, and at least some of it may be different. The corners of the housing 10 are rounded. For example, when the display device 1 is viewed from the front, the four corners of the housing 10 are rounded. The housing 10 should be sized to accommodate an image display unit 20 of a predetermined size (for example, 17 inches) inside.

[0062] The housing 10 has an opening 5 on the front side of the display device 1 (the -Y side in each figure). The front side of the display device 1 corresponds to the side from which the viewer sees the image displayed by the display device 1. The opening 5 is formed on the front side of the display device 1 within the internal space of the housing 10. For example, as shown in Figure 2(A), the opening 5 is formed in a rectangular shape when viewed from the front side of the display device 1. The housing 10 has an internal space 100. The internal space 100 is the space inside the housing 10 where the image is displayed. The portion of the internal space 100 other than the opening 5 is surrounded by a light-shielding material (see Figure 6). External light does not enter the internal space 100 through the components that make up the housing 10. Therefore, the housing 10 may be formed entirely of a material that blocks external light, or its outer surface or the surface facing the internal space 100 may be covered with a light-shielding material. In Figure 6, the internal space 100 is shown by a dashed line, and the two spatial regions 101 and 102, which divide the internal space 100 by the dimming member 30, are shown by double dashed lines. Spatial region 101 is the space on the rear side of the dimming member 30. The height dimension of spatial region 101 is larger towards the back and decreases as you move towards the front. Spatial region 102 is the space on the front side of the dimming member 30. The height dimension of spatial region 102 is smaller towards the back and increases as you move towards the front. In this embodiment, the opening 5 is defined by a planar region that allows spatial region 101 to pass through to the external space. Therefore, the opening 5 may be read as an opening surface. The internal space 100 has a certain area in the depth direction (front-to-back direction) of the housing 10, and as shown in the YZ cross section of Figure 6, the length of the housing 10 in the depth direction is longer at the top than at the bottom. The internal space 100 should be perceived by the viewer, for example, as the living space of a character displayed in stereoscopic vision.

[0063] For example, the housing 10 is made of a resin material or the like, and its surface (for example, at least one of the outer and inner surfaces) is coated with a dark-colored (for example, black) rubber paint. This prevents light from entering the internal space 100 of the housing 10 from parts other than the opening 5. It is not necessary for the internal space 100 to be surrounded by a light-shielding material in all parts other than the opening 5; it is sufficient if the internal space 100 is surrounded by a light-shielding material to a certain extent. The housing 10 may be made of a material other than resin, for example, metal or other materials. The color of the outer surface of the housing 10 is not specified, but it may be white or black, for example, to give an impression of luxury or simplicity. The surface of the housing 10 may be processed to give it a matte finish.

[0064] Furthermore, as shown in Figure 5, the housing 10 includes a main body portion 11, a top cover portion 12, a portion 13 for arranging the dimming member 30, a bottom cover portion 14, and a rear cover portion 15. Each of the components 12 to 15 is attached to the main body portion 11 by fasteners such as screws, with the exception of a portion of the top cover portion 12 (described later).

[0065] Next, the image display unit 20 will be described. The image display unit 20 is a display unit having a light source. An example of the image display unit 20 is a liquid crystal display. In this case, the image display unit 20 includes a backlight, which is an example of a light source, and a display body 28 (see Figure 5) in which liquid crystal elements, which are an example of display elements, are arranged in two dimensions. The light source is, for example, a white light source. The liquid crystal elements modulate the light from the backlight on a pixel-by-pixel basis. The liquid crystal elements have a configuration in which liquid crystal molecules are sandwiched between pixel electrodes provided on a pixel-by-pixel basis and a common electrode common to multiple pixels. The image display unit 20 displays a color (multicolor) image based on the three primary colors of red (R), green (G), and blue (B). In this embodiment, the image display unit 20 displays the image in such a way that it is recognized as a three-dimensional image. In this embodiment, the image display unit 20 is a 17-inch liquid crystal display.

[0066] The image display unit 20 is preferably configured to display a three-dimensional image of the object to be displayed, and it is preferable that it be a display capable of stereoscopic viewing without the need for glasses. Furthermore, it is preferable that the image display unit 20 is configured to be able to switch between three-dimensional and two-dimensional images. The image display unit 20 may display an image of the object to be displayed, for example, a specific character (for example, a person or an animal). For example, the image display unit 20 may be controlled to display a human-shaped character 1000 so that it can be viewed stereoscopically by the viewer, as shown in Figure 13. In this case, the character 1000 is a character modeled after a historical figure, but it may also be a female character, an animal character (for example, a cat), or any other character. It is not limited to this, and various images can be displayed on the image display unit 20. Also, below, a character that is displayed stereoscopically (an example of a displayed object) will be referred to as a "3D character," etc. A 3D character is an example of a 3D object.

[0067] Thus, the display device 1 should be a device capable of reproducing stereoscopic display using the naked eye. Such a display device 1 may also be called, for example, a "naked-eye stereoscopic display device."

[0068] Naked-eye stereoscopic display can be reproduced, for example, by using a lenticular lens-type image display unit 20. For example, the display surface 29 of the image display unit 20 is provided with a lenticular lens in which a plurality of semi-cylindrical lenses are arranged, and the image display unit 20 displays a group of image sequences (also called a lenticular image, etc.) composed of a combination of multiple interlaced image sequences with respect to a three-dimensional image. When a viewer looks at the group of image sequences through the lenticular lens from an appropriate position, the three-dimensional image appears three-dimensional due to an optical illusion caused by the parallax between the two eyes.

[0069] As shown in Figure 6, the image display unit 20 is positioned in the internal space 100 of the housing 10 so that the image can be viewed from an opening 5 provided on the front side of the display device 1. For example, the image display unit 20 is positioned along the back surface (inner wall surface) of the inner circumferential surface of the housing 10. In this embodiment, as shown in Figure 6, the back surface of the inner circumferential surface of the housing 10 is provided substantially perpendicular to the bottom surface of the housing 10, and the image display unit 20 is also provided substantially perpendicular to the bottom surface of the housing 10.

[0070] Next, the light-reducing member 30 will be described. The light-reducing member 30 is an optical member that reduces the amount of external light entering the internal space 100 through the opening 5. The light-reducing member 30 is a plate-shaped (including panel-shaped) or film-shaped member. The light-reducing member 30 can also reduce the amount of light from the image display unit 20 (for example, light from the backlight of the image display unit 20). The light-reducing member 30 is provided to maintain the internal space 100 in a dark state. The reason for this will be explained later. The light-reducing member 30 also contributes to suppressing reflections where the viewer looking at the image through the opening 5 is reflected in the light-reducing member 30, and to making it difficult to see the internal components of the internal space 100. The light-reducing member 30 may be a member called a smoke panel, smoke film, etc. Since the light-reducing member 30 transmits at least the image light from the image display unit 20 to the front side, it can be said to be an optically transparent member. Examples of the light-reducing member 30 include a dark-colored panel member having a predetermined light transmittance (for example, about 6%). However, it is not limited to this, and the light-reducing member 30 may be, for example, a dark-colored film having a predetermined light transmittance attached to a colorless, transparent panel member. The light-reducing member 30 is a dark-colored member such as black, but it may also be blue or other colors.

[0071] The dimming member 30 is positioned in the internal space 100 of the housing 10, on the front side of the image display unit 20, and spaced apart from the image display unit 20. In this embodiment, it is positioned between the opening 5 and the image display unit 20 such that there is a spatial area 101 (Figure 6) between them.

[0072] As described above, the housing 10 has a light-shielded internal space 100, which suppresses the intrusion of external light into the internal space 100 of the housing 10. Furthermore, by arranging the light-reducing member 30 in front of the image display unit 20, at a distance from the image display unit 20, the image light from the image display unit 20 is prevented from directly reaching the viewer's eyes. Therefore, it is possible to suppress the difficulty in viewing the image recognized in the internal space 100 of the housing 10 due to the combined effect of image light from the image display unit 20 and external light, thereby providing a display device 1 that can achieve high visibility of the displayed image.

[0073] Furthermore, because the dimming member 30 is positioned between the opening 5 and the image display unit 20, a spatial area (for example, spatial area 102 (see Figure 6)) is formed on the front side of the dimming member 30 inside the housing 10, and this spatial area can be used for a predetermined purpose.

[0074] Here, if the dimming member 30 were absent, and a viewer were to look directly at the image display unit 20 itself, which displays a three-dimensional image of the object to be displayed, light would leak out from the light source, allowing the viewer to perceive the position of the light source. As a result, the viewer would be able to perceive that "the object to be displayed is reflected in the image display unit 20." Consequently, the sense of floating, as if the image of the object to be displayed were floating in the internal space 100, may not be sufficiently achieved.

[0075] In contrast, when the dimming member 30 is provided as described above, the amount of image light emitted from the surrounding area of ​​the object to be displayed in the image display unit 20 is suppressed by the dimming member 30, making it difficult for the viewer to see the surrounding area. As a result, the viewer does not feel that "the object to be displayed is shown in the image display unit 20," and a sense of the object floating is obtained. Therefore, the visibility of the displayed image of the object to be displayed can be improved.

[0076] Furthermore, if a viewer were to directly look at the image display unit 20 itself, which displays a three-dimensional image of an object, they might see a blurred image around the object, even though the object appears three-dimensional to them. In such cases, the viewer may find it difficult to see the three-dimensional image of the object.

[0077] In contrast, when the dimming member 30 is provided as described above, the amount of light emitted from the image display unit 20 is reduced by the dimming member 30, and the image light of the blurred image around the object to be displayed is also reduced by the dimming member 30. As a result, the blurred image becomes difficult for the viewer to see, making it easier to recognize the object to be displayed as a three-dimensional image. Furthermore, because the dimming member 30 is provided, components present in the internal space 100 become difficult to see, so it is less likely that the viewer will be disappointed by the visibility of such components.

[0078] [Detailed structure of each element] Next, we will explain the detailed configuration of each element 10, 20, and 30.

[0079] The dimming member 30 has a front surface that is inclined with respect to the vertical. In this embodiment, as shown in Figure 6, the dimming member 30 is provided inclined at a predetermined angle (for example, an angle of about 50 degrees) with respect to the bottom surface of the housing 10, from its upper end 31 to its lower end 32 toward the opening 5 side (the front side of the display device 1). For example, as shown in Figure 5, the upper surface of the placement portion 13 for the dimming member 30 is inclined at a predetermined angle with respect to the bottom surface of the housing 10, and the dimming member 30 is placed on the upper surface of the placement portion 13.

[0080] In this way, the optical path of the reflected light from the light-reducing member 30 will be in a direction different from the viewer's eyes (or face). Therefore, when a viewer looks at the image display unit 20 through the light-reducing member 30, it is possible to prevent the viewer's face from being reflected in the light-reducing member 30. As long as this objective can be achieved, the tilt angle and tilt direction of the light-reducing member 30 can be modified in various ways. Therefore, a display device 1 with higher visibility can be provided.

[0081] Furthermore, within the housing 10, a space 102 (see Figure 6) can be provided on the side of the opening 5 that is closer to the light-reducing member 30, where a person can insert their hand.

[0082] Furthermore, the image display unit 20 is preferably controlled to display such that at least a portion of the object to be viewed in 3D by the viewer (for example, a part of the body of a particular character) is located at the position of the dimming member 30. In this way, the viewer can reach their hand into the spatial area 102 on the side of the opening 5 from the dimming member 30 and get the sensation that they can touch the object to be viewed in 3D floating in the spatial area 102 (for example, a human-shaped character 1000 (see Figure 13), an example of the first image). Therefore, a display device with excellent entertainment value can be provided.

[0083] Furthermore, the provision of the spatial area 102 described above increases the degree of freedom in the placement of the gesture sensor 63 and other components, which will be described later.

[0084] As shown in Figures 2(A) and 6, the housing 10 further includes a speaker 62 (an example of an audio output unit). The speaker 62 is positioned on a surface facing the internal space 100 of the housing 10, on the front side of the dimming member 30, and at a position where the distance to the dimming member 30 is smaller than the distance to the opening 5. In this embodiment, the speaker 62 is located on the upper surface 85 of the internal space 100 of the housing 10, on the side of the dimming member 30 (towards the back of the housing 10) from the intermediate position 201 between the upper end 21 of the dimming member 30 and the upper end 51 of the opening 5.

[0085] In this way, the sound output by the speaker 62 may be reflected by the dimming member 30 and transmitted to the viewer, making the viewer feel as if the sound is coming from the displayed object (e.g., a specific character) itself, as shown on the image display unit 20. This effect is particularly effective when the display control is set so that at least a part of the displayed object (e.g., a part of a specific character's body) that is viewed stereoscopically by the viewer is located at the position of the dimming member 30. Furthermore, by positioning the speaker 62 in a location that is difficult for the viewer to see, the design of the display device 1 can also be enhanced.

[0086] Furthermore, as shown in Figure 6, the upper end 51 of the opening 5 is positioned above the upper end 21 of the image display unit 20 (specifically, the display surface 29), and the upper surface 85 of the internal space 100 of the housing 10 is inclined downward (in the -Z direction in Figure 6) from the upper end 51 of the opening 5 towards the upper end 21. In this way, the image displayed on the image display unit 20 can be viewed from a position higher than the upper end 21 of the image display unit 20, while looking down at it. This makes it easier for the viewer to view the image in a natural posture. For example, the display device 1 is placed on a desk. A viewer is standing or sitting in a chair in front of the display device 1. The viewer's eyes are assumed to be positioned higher than the upper surface of the display device 1. Therefore, the viewer views the display device 1 by looking down at an angle θ. The angle θ is the angle between the horizontal direction and the viewer's line of sight. The angle θ is assumed to be, for example, 15 degrees, but it will vary depending on how the display device 1 is used. Based on this assumed angle θ, the inclination angle of the upper surface 85 should be determined so that the viewer can see the entire display surface of the image display unit 20 or the entire display area of ​​the image that should be viewed by the viewer. In addition, a relatively large spatial area 110 for the control unit, which will be described later, can be secured.

[0087] Furthermore, as shown in Figure 6, the upper end 51 of the opening 5 of the housing 10 is provided to protrude forward (an example of the first direction side) from the lower end 52 of the opening 5. This protruding portion is also called an overhang. In this way, it is possible to suppress the reduction in the visibility of the image on the image display unit 20 due to light from above the display device 1 being reflected by the dimming member 30.

[0088] As shown in Figures 1 and 6, a slanted portion 84 is provided on the opening 5 side (front side) of the lower part of the housing 10. The side portion 53 of the opening 5 (see Figure 3) is inclined at a predetermined angle so as to extend from the upper end 51 of the opening 5 toward the vicinity of the upper part 88 of the slanted portion 84. For example, the side portion 53 of the opening 5 is inclined so as to be approximately perpendicular to the light-reducing member 30.

[0089] Furthermore, as shown in Figure 6, the upper part 88 of the slanted portion 84 is located above the lower end 22 of the image display unit 20, and the lower surface 86 of the internal space 100 of the housing 10 is inclined downward from the upper part 88 of the slanted portion 84 toward the lower end 22 of the image display unit 20.

[0090] In the case of naked-eye stereoscopic display, the greater the so-called 3D effect, the smaller the displayed object appears to the viewer in stereoscopic view. By tilting the lower surface 86 of the internal space 100 as described above, even when the 3D effect is increased, the lower part of the displayed object (for example, the feet of a particular character) can be displayed near the upper part 88 of the slanted section 84.

[0091] Furthermore, as shown in Figure 1, the display device 1 is equipped with an operation unit 40 that receives operations on the display device 1. For example, the display device 1 is provided with two operation units 40: an operation unit 41 for performing voice input (also known as instructing the start of voice recognition) and an operation unit 42 for changing display settings related to three-dimensional images (for example, settings related to parallax).

[0092] These operating units 40 (41, 42) are located on the lower part of the housing 10, on the front side (one example on the first direction side) of the opening 5. More specifically, as shown in Figure 1, these operating units 40 (41, 42) are positioned on an oblique section 84 located on the opening 5 side of the lower part of the housing 10. This arrangement prevents the user's hand from overlapping the displayed image on the image display unit 20 when operating the operating unit 40, allowing the user to operate the operating unit 40 while viewing the displayed image on the image display unit 20. Therefore, it becomes easier for the user to operate the operating unit 40, improving the operability of the display device 1. Furthermore, because the operating unit 40 is located on the oblique section 84, the user can easily find the operating unit 40.

[0093] Next, we will describe the various sensors provided in the display device 1.

[0094] The display device 1 further includes two motion detection units (an example of motion detection means capable of detecting the movements of a viewer) consisting of a microphone 61 and a gesture sensor 63 (see Figure 6). It is not essential that both of these components 61 and 63 are provided in the display device 1; either the microphone 61 or the gesture sensor 63 may be provided in the display device 1 as the motion detection means.

[0095] The microphone 61 is configured as a voice detection means capable of detecting the voice of a visual observer, such as a user (for example, a voice input operation). The microphone 61 is located, for example, in the oblique section 84 described above (see Figure 1). For voice input using the microphone 61, for example, the control unit 73 (described later) performs voice recognition processing, and the voice recognition result, for example, shown as text data, is obtained. The voice recognition processing may be performed by a voice recognition device separately provided in the display device 1, or it may be performed on an external server separate from the display device 1.

[0096] The gesture sensor 63 (an example of an object detection sensor) is configured to detect the behavior of an object. An example of a gesture sensor 63 is an infrared sensor. The gesture sensor 63 has a light emitter (for example, infrared light) and a light receiver. The light emitted (also called irradiated) from the emitter of the gesture sensor 63 strikes the object to be detected, is reflected, and is received by the light receiver. The gesture sensor 63 then detects the behavior of the object to be detected based on the light (reflected light) received by the light receiver. For example, if the gesture sensor 63 detects a behavior that is the same as a specific behavior that has been pre-registered, it is determined by the observer that the specific behavior has occurred.

[0097] For example, the gesture sensor 63 has a function (also called a wave detection function) that can detect whether or not a predetermined behavior is occurring in accordance with the movement of the hand. For example, if a person observing the gesture sensor 63 makes a waveing ​​motion ("bye-bye") or a stroking motion ("petting") within the detection range of the gesture sensor 63, the gesture sensor 63 will detect the wave motion and determine that it is either "bye-bye" or "petting".

[0098] The gesture sensor 63 should be capable of detecting the position of the object to be detected in the direction of approach to or away from the gesture sensor 63 (for example, the Z direction in Figure 2(A)) and the position of the object to be detected on a plane normal to that approach / away direction (for example, the XY plane in Figure 2(A)). For example, this plane may be divided into four quadrants with the light-receiving part of the gesture sensor 63 as the origin. In this case, the X axis should be set parallel to the left and right sides of the front of the housing 10.

[0099] As shown in Figure 2(A), the gesture sensor 63 is installed approximately in the center of the inner surface of the housing 10 in the left-right direction (X direction in Figure 2(A)).

[0100] Furthermore, as shown in Figure 6, the gesture sensor 63 (more specifically, the detection surface of the gesture sensor 63) is positioned on the inner circumferential surface of the housing 10, facing inward towards the housing 10, so that the detection direction of the gesture sensor 63 is directed inward towards the housing 10. In this way, for example, the gesture of the observer can be detected in the internal space 100 of the housing 10, in this embodiment, the spatial region 102. Therefore, compared to the case where the gesture sensor 63 is positioned on the outer circumferential surface of the housing 10, a decrease in the sensitivity of the gesture sensor 63 can be suppressed.

[0101] Furthermore, when the gesture sensor 63 is positioned on the outer periphery of the housing 10, for example, the gesture sensor 63 may detect the behavior of the object to be detected even if only a person passes by the vicinity of the display device 1. In contrast, when the gesture sensor 63 is positioned on the inner periphery of the housing 10 and facing inward, such false detections can be prevented.

[0102] In particular, the gesture sensor 63 is preferably positioned on the upper surface 85 of the inner circumferential surface of the housing 10, facing the lower surface 86, as shown in Figure 6. In this way, the gesture sensor 63 is provided on the inner circumferential surface of the housing 10 where external light is less likely to enter. Therefore, compared to the case where the gesture sensor 63 is provided on a surface other than the upper surface 85, the decrease in sensitivity of the gesture sensor 63 can be further suppressed.

[0103] Furthermore, the gesture sensor 63 is preferably positioned on the upper surface 85 of the inner circumferential surface of the housing 10, opposite the boundary position 202 (see Figure 6) between the upper part 88 of the oblique portion 84 and the lower end portion 32 of the dimming member 30. The display control is then configured so that the feet of a specific character are displayed in three dimensions on the surface of the dimming member 30. In this way, the viewer can get the sensation that they can touch the entire (whole body) of a specific character that appears to float and be three-dimensional on the surface of the dimming member 30. Note that the above display control can be reproduced, for example, by changing the parallax setting value in a 3D application related to three-dimensional display.

[0104] Furthermore, on the inner surface of the housing 10, a member is provided in a region that exists in the direction of emission of light from the gesture sensor 63, for example, a region 202 opposite the position where the gesture sensor 63 is positioned, to suppress the reception of light emitted from the gesture sensor 63 (e.g., infrared light) by the gesture sensor 63. In this way, the amount of light received by the gesture sensor 63 from light reflected in or around region 202 is reduced, further suppressing the decrease in sensitivity of the gesture sensor 63. Examples of the "member that suppresses reception by the gesture sensor 63" include a light-absorbing member that can absorb light from the gesture sensor 63, and a member that diffusely reflects light from the gesture sensor 63. Examples of the "light-absorbing member" include black paper, a rubber-coated member, or a member made of an infrared-absorbing material (such as an infrared anti-reflective sheet).

[0105] In the display device 1, it is preferable that predetermined processing corresponding to the detection results from the motion detection means (for example, the microphone 61 and the gesture sensor 63) is executed as the action of a specific character displayed on the image display unit 20. Such control may be executed, for example, by the control unit 70 described later.

[0106] In this way, when the movement of the observer is detected, a specific character will move according to the detection result, thus recreating communication between the observer and that specific character. This function that recreates communication between the observer and a specific character, or a function that recreates simulated communication between the observer and a specific character, is called the "communication function." Therefore, for example, a highly entertaining display device 1 can be provided.

[0107] For example, when a viewer says "bye-bye," the microphone 61 detects the viewer's voice "bye-bye," and the control unit 70 determines the action of a specific character based on the voice recognition result "bye-bye." In the display device 1, specific phrases and the actions corresponding to those phrases are pre-registered in a data table or the like. The control unit 70 then executes the processing corresponding to the determined action. For example, at least one of the following is executed: a voice output process that outputs the voice "bye-bye" from the speaker 62, and a display output process that displays an image of a specific character waving on the image display unit 20. In this way, the viewer feels that the specific character displayed on the image display unit 20 has responded to the voice they spoke. Therefore, for example, a highly entertaining display device 1 can be provided.

[0108] Furthermore, for example, if a user places their hand into the internal space 100 and waves, the gesture sensor 63 detects the user's gesture "bye-bye," and the control unit 70 determines the action of a specific character based on the gesture detection result "bye-bye." In the display device 1, specific actions and actions corresponding to those specific actions are pre-registered in a data table or the like. The control unit 70 then executes the processing corresponding to the determined action. For example, at least one of the following is executed: an audio output process that outputs the sound "bye-bye" from the speaker 62, and a display output process that displays an image of the specific character waving on the image display unit 20. In this way, the user feels that the specific character displayed on the image display unit 20 has responded to the gesture they made. Therefore, for example, a highly entertaining display device 1 can be provided.

[0109] Furthermore, the display device 1 is further equipped with a human presence sensor 64 (see Figure 6) capable of detecting the presence of a person within a predetermined range (for example, also referred to as the detection target space) relative to the display device 1. Examples of such human presence sensors 64 include a Doppler sensor (for example, a microwave Doppler sensor) capable of detecting the presence of an object based on the speed of the moving object and the presence or absence of a Doppler signal.

[0110] The motion sensor 64 is positioned near the upper end 51 of the opening 5, facing the front side of the display device 1, and the detection area of ​​the motion sensor 64 is located on the front side of the display device 1. This makes it possible to more reliably detect the presence of a person on the front side of the display device 1.

[0111] In detail, the motion sensor 64 is positioned on the front side (front side) of the placement area 110 (see Figure 7), which will be described later, with a gap that does not cause it to come into contact with the outer peripheral wall 80 on the front side of the housing 10.

[0112] In the display device 1, it is preferable that the display image of the image display unit 20 be controlled to switch to a three-dimensional image when the motion sensor 64 detects that a person has approached within a predetermined range. Otherwise, a two-dimensional image may be displayed, or the display image of the image display unit 20 may be hidden. In this way, for example, as long as a person is in a position where the object to be displayed on the image display unit 20 (e.g., a specific character) cannot be viewed in stereoscopically, the three-dimensional image will not be displayed on the image display unit 20, and when the person approaches within a range where the object to be displayed can be viewed in stereoscopically, the three-dimensional image will be displayed on the image display unit 20. Therefore, it is possible to avoid the situation where people in the vicinity lose interest in the display device 1 because they viewed the object to be displayed from a position where they cannot view it in stereoscopically.

[0113] [Configuration regarding the placement space of the control unit, etc.] The display device 1 has a control unit 70. For example, the display device 1 has a plurality of control units 70, including a power control unit 71 that controls the power supply of the display device 1, a display control unit 72 that controls the display image displayed on the image display unit 20, and a control unit 73 that manages these control units 71, 72, etc. (see Figure 7). Figure 7 is a perspective view illustrating the display device 1 with the top cover 12 removed. In this embodiment, each of the plurality of control units 70 may be mounted on a different circuit board, or two or more control units 70 may be mounted on a single circuit board. Accordingly, the arrangement position of each control unit 70 may be changed as appropriate.

[0114] As shown in Figure 5, the housing 10 has a top cover portion 12. Also, as shown in Figure 6, the housing 10 has a space area 110 between the top cover portion 12 and the upper surface 85 of the inner circumferential surface of the housing 10. The control unit 70 is arranged in this space area 110. In this way, maintenance of the control unit 70 that controls the display device 1 can be performed by removing the top cover portion 12 provided on the top surface of the housing 10. Therefore, the maintainability of the display device 1 can be improved. The space area 110 is also referred to as the housing space for housing the control unit 70, etc.

[0115] The control unit 70 is located on the upper part of the housing 10, while the power supply unit 90 of the display device 1 is located on the lower part 14 of the housing 10 (see Figure 4(B)).

[0116] The connecting cord 91 (see Figure 7) that connects the power supply unit 90 and the control unit 70 (specifically, the power control unit 71) is routed through a gap area 89 secured between the outer perimeter wall 80 of the housing 10 (for example, the left wall of the housing 10) and the internal space 100. In this way, the power supply unit 90 can be placed in an inconspicuous location, and the connecting cord 91 that connects the power supply unit 90 and the control unit 70 can be routed so that it is not visible to the viewer from the outside and the internal space 100 side (opening 5 side). Therefore, the design of the display device 1 can be enhanced. In addition, since the power supply unit 90 is located below the internal space 100, the power supply unit 90 can be placed in an inconspicuous location, and the center of gravity of the display device 1 can be lowered, making it easier to stabilize its orientation.

[0117] Furthermore, a ventilation hole 99 (see Figure 4(B)) is provided on the bottom surface of the display device 1. The ventilation hole 99 is connected to the space below the internal space. This space is spatially connected to the space area 110 above the internal space 100 via a gap area 89 through which the connection cord 91 is routed. Therefore, even when the space area 110 is blocked by the top cover portion 12, the heat generated in the space area 100 can be released to the outside through the ventilation hole 99. Note that a ventilation opening for releasing the heat generated in the space area 110 to the outside may be provided on the top cover portion 12, or a heat sink or other heat absorption or dissipation member may be provided in the space area 110 or elsewhere.

[0118] Furthermore, the top cover portion 12 is attached to the main body portion 11 of the housing 10 at multiple mounting positions (for example, nine mounting positions 211 to 219). For example, the top cover portion 12 is attached to the main body portion 11 of the housing 10 at two mounting positions 211 and 212 on the front side (front side) of the housing 10, at two mounting positions 213 and 214 on the right side of the housing 10, at two mounting positions 215 and 216 on the left side of the housing 10, and at three mounting positions 217 to 219 on the rear side (back side) of the housing 10.

[0119] For example, as shown in Figures 7 and 8, at mounting positions 211 and 212 on the front side of the display device 1 (an example of the first mounting position) among the multiple mounting positions 211 to 219, the top cover portion 12 and the main body portion 11 of the housing 10 are connected using a first fastener at a position inside the outer peripheral wall 80 of the housing 10. Examples of the "first fastener" include a fitting member 95 and a receiving member 96 configured to allow the fitting member 95 to be attached and detached. Figure 8 shows the back surface of the top cover portion 12. For example, the fitting member 95 is formed in a convex shape, and the receiving member 96 is formed to allow the convex fitting member 95 to be inserted.

[0120] On the other hand, at mounting positions 217 to 219 on the back side of the display device 1 (an example of a second mounting position) (see Figure 7) among the multiple mounting positions 211 to 219, the main body 11 and the top cover 12 of the housing 10 are joined using a second fastener at a position outside the outer peripheral wall 80 of the housing 10. An example of the "second fastener" is a screw 98 (see Figure 8).

[0121] In this way, at the second mounting positions (for example, mounting positions 217-219) which are difficult for the viewer to see, the top cover portion 12 and the main body portion 11 are joined from the outside of the outer peripheral wall 80 of the housing 10 using a second fixing device (for example, a screw 98). On the other hand, at the first mounting positions (for example, mounting positions 211, 212) which are easily visible to the viewer, the top cover portion 12 and the main body portion 11 are joined at a location that is difficult for the viewer to see using a first fixing device (for example, a fitting member 95 and a receiving member 96). Therefore, the design of the display device 1 can be enhanced.

[0122] Furthermore, the first fastener (e.g., the fitting member 95 and the receiving member 96) is easier to attach and detach than the second fastener (e.g., the screw 98), and the maintenanceability of the display device 1 can be improved by using the first fastener. Moreover, the top cover portion 12 and the main body portion 11 are not connected using the first fastener at all mounting positions 211 to 219, but at some of the multiple mounting positions 211 to 219, the top cover portion 12 and the main body portion 11 are connected using the second fastener. Therefore, the maintenanceability of the display device 1 can be improved while also preventing the top cover portion 12 from being removed by a third party.

[0123] In this embodiment of the display device 1, with respect to the mounting positions 213 to 216 on the side of the housing 10, the top cover portion 12 and the main body portion 11 of the housing 10 are connected using a first fastener, similar to the mounting positions 211 and 212 on the front. However, the invention is not limited to this, and the top cover portion 12 and the main body portion 11 of the housing 10 may also be connected using a second fastener, similar to the mounting positions 217 to 219 on the rear.

[0124] [Detailed configuration of the control unit] Figure 9 is a control block diagram of the control unit 70 of the display device 1 according to one embodiment. As described above, the control unit 70 has a general control unit 73. The general control unit 73 is a controller that has a CPU 701 which functions as an arithmetic processing unit that performs calculation processing, and a memory including RAM 703 which is used as a work area and ROM 702 which stores control programs, etc. Various programs are stored in the ROM 702, and the general control unit 73 reproduces various functions by executing these programs. For example, the ROM 702 stores a voice recognition application (an application with the function of a voice recognition engine) for reproducing a conversation between a user and a character, and the general control unit 73 reproduces a conversation between a user and a character by executing the voice recognition application based on input signals from various sensors 61, 63, 64, 65, etc. or a GPS receiver 60, etc. Furthermore, the overall control unit 73 (an example of an operation control means) includes a display control circuit 704 (for example, a display control unit 72, etc.) that controls images and the like displayed on the image display unit 20, and an audio control circuit 705 that controls the sound output from the speaker 62. In addition, the overall control unit 73 includes a communication control circuit 706 that controls communication with other devices (for example, an external voice recognition server (also called a voice recognition engine) not shown, and an external dialogue server (also called a dialogue engine) not shown, etc.). The overall control unit 73 also controls the power state of the display device 1 based on input signals from the power control unit 71 that controls the power supply of the display device 1.

[0125] [About the characters displayed on the display device] Before explaining the control contents of the control unit 70 by the overall control unit 73, we will now explain the characters that can be displayed on the image display unit 20 of the display device 1 with reference to Figures 10 to 12.

[0126] Figure 10 is a diagram illustrating the overview of a display device 1 according to one embodiment, and more specifically, it shows the state in which a 3D character 1100 is displayed on the display device 1. The 3D character 1100 is a female character. The display device 1 (more specifically, the control unit 73) further displays a stage image 2100, which represents a stage, below the 3D character 1100. In this case, the stage image 2100 shows a magic circle. A viewer who sees this display can get the impression that the 3D character 1100 is standing on a stage. The colors of the 3D character 1100 and the stage image 2100 are not particularly limited. For example, the skin of the 3D character 1100 is flesh-colored. The hair color and upper body clothing of the 3D character 1100 are relatively light blue (e.g., light blue), the ornaments on the knees are a darker blue (e.g., blue), and the skirt and shoes are white. The stage image 2100 is a relatively dark blue (e.g., dark light blue). Figure 10 and Figure 11, described below, show a view looking down into the housing 10 from slightly above the front of the display device 1.

[0127] Figure 11 is a diagram illustrating the overview of a display device 1 according to one embodiment, and more specifically, it shows the state in which a 3D character 1200 is displayed on the display device 1. The 3D character 1200 is a cat character. In the case shown in Figure 11(B), the display device 1 displays the 3D character 1200 and a stage image 2200, which represents a stage, below the 3D character 1200. In this case, the stage image 2200 alternately displays the string "Yupiteru" and the string representing the name of the 3D character 1200, "Juno" (pronounced "Yuno"), along the outer edge of a circular stage. The colors of the 3D character 1200 and the stage image 2200 are not particularly specified.

[0128] Here, the 3D character 1200 and the stage image 2200 will be explained in more detail with reference to Figure 12. The 3D character 1200 is broadly divided into the character body 1210 and the collar 1220. The character body 1210 is the cat character itself. The character body 1210 includes parts of the body shown in white, such as the area between the eyebrows, around the nose and mouth, the abdomen, and the front parts of the legs. The parts of the character body 1210 shown in light gray are relatively light brown in color (e.g., ochre), such as the areas above and to the sides of the eyes on the face, the upper part of the torso, and the parts of the legs other than the front. The parts of the character body 1210 shown in even darker gray are even darker brown in color (e.g., brown), such as the face, head, torso, and the striped areas of the legs shown by thin lines. Collar 1220 refers to the collar displayed on the neck of the character body 1210. Collar 1220 is a reddish color (for example, red). A tag 1221 is attached to the collar 1220 below the face of the character body 1210. Tag 1221 is circular and has a predetermined mark inscribed on it. This mark is a "V" shaped symbol with a "●" (a circle with the inside filled in) placed below it, and each is in a reddish color (for example, red). The mark inscribed on tag 1221 may function as a trademark indicating the origin of the display device 1. The stage image 2200 is brownish overall, with the circles and text being a relatively dark brown (for example, brown), and the smoke-like image inside the circles being a lighter brown (for example, ochre).

[0129] In Figures 10 to 12, the backgrounds of 3D characters 1100 and 1200 are shown as black, but they are not limited to pure black; relatively dark background colors (for example, black or other dark colors) are also acceptable.

[0130] The characters shown in Figures 10 to 12 are examples only. When the display device 1 displays a humanoid character, it is not limited to female characters; it may also display male characters (for example, character 1000 (see Figure 13)). The display device 1 may display any of the following: a real person (for example, a family member), a person who existed in the past (for example, a historical figure), or a fictional character (for example, a character appearing in a work of fiction such as a manga or anime). When displaying a non-humanoid animal character, the display device 1 is not limited to a cat character; it may also display any of the following: a dog, a hamster, or other animal that can be kept as a pet in a typical household; a horse, a cow, or other animal; or a fictional animal (for example, a character appearing in a work of fiction such as a manga or anime). The display device 1 may also display other characters that have a collar 1220.

[0131] The display device 1 (specifically, the central control unit 73) moves parts of the character's body and outputs sounds that mimic the character's speech based on the communication function. The communication function is a function that reproduces communication between the viewer and the character, or a function that reproduces simulated communication. In the communication function, the character moves in response to the viewer's actions (e.g., speech or body movements). For example, 3D character 1100 performs actions that reproduce actions that humans normally perform, such as moving the entire body, like dancing, or changing facial expressions (e.g., expressing emotions such as joy, anger, sadness, and happiness). For example, 3D character 1200 performs actions that animals normally perform (e.g., yawning, wagging its tail, walking, etc.). In addition, the display device 1 may, for example, output singing sounds that make it seem as if 3D character 1100 is singing, or output sounds related to dialogue with the viewer, in accordance with the movements of 3D character 1100. The display device 1 may, for example, output sounds representing cat meows in accordance with the movements of the 3D character 1200, or output sounds related to dialogue with the viewer. Such output of images and sounds is not limited to communication functions, but may be performed using various functions of the display device 1.

[0132] Furthermore, the interaction with the user in the communication function is reproduced, for example, by a voice recognition application stored in the ROM 702 of the control unit 73, and the external voice recognition server and dialogue server mentioned above. For example, when the operation unit 40 is pressed by the user, the control unit 73 starts the voice recognition application. This enables voice recognition for interacting with the character. The voice spoken by the user (also called the user voice) is transmitted from the communication control circuit 706 of the control unit 73 to the voice recognition server, where the voice recognition server performs voice recognition processing on the user voice and outputs the voice recognition result. The dialogue server has pre-registered voices (also called character voices) spoken by characters (for example, 3D characters 1100) displayed on the image display unit 20, associated with each input string. The voice recognition result from the voice recognition server (for example, the voice recognition result shown as a string) is input to the dialogue server, and the character voice corresponding to that voice recognition result is transmitted from the dialogue server to the display device 1. The control unit 73 then outputs the character voice received from the dialogue server through the speaker 61 of the display device 1. In this way, the response processing to the user's voice is performed, and the dialogue between the user and the character is reproduced.

[0133] <About the communication features for 3D Character 1100> In the following sections, various controls for reproducing communication between the 3D character 1100 and the user will be explained in order with reference to Figures 14 to 20.

[0134] <1. Regarding communication functions related to scent> For example, an odor sensor 65 (see Figure 9) for detecting odors may be provided on the display device 1, and the control unit 73 may perform an audio output operation to output audio corresponding to the detection result from the odor sensor 65 as the character voice of the 3D character 1100. The odor sensor 65 may output a signal that changes according to the intensity of a certain odor, or a signal that changes according to the components (odor components) contained in the odor. For example, the odor sensor 65 may output a signal that changes according to the type of odor. The odor sensor 65 may be configured to detect the concentration of specific odor components (tar, ammonia, alcohol, carbon dioxide, etc.) using a deodorizing filter or the like. In this way, the control unit 73 can reproduce odor-related communication between the character displayed on the image display unit 20 of the display device 1 and the user, and can reproduce a wider variety of communication between the character and the user. The odor sensor 65 may be provided on the outer surface of the display device 1, for example, on the slanted portion 84 of the housing 10 of the display device 1.

[0135] The control unit 73 may, for example, perform an audio output operation to output a voice corresponding to the detected type of odor as the character voice of the 3D character 1100. Note that a single sensor capable of identifying multiple types of odor components may be configured as the odor sensor, or multiple sensors capable of identifying different types of odor components may be configured as the odor sensor.

[0136] Figure 14(A) is a flowchart for reproducing communication related to odors, and Figure 14(B) is a diagram showing an odor-related voice management table (also called a voice management table). The voice management table is stored, for example, in the control unit 73 of the display device 1 or in the dialogue server. As shown in Figure 14(B), the voice management table has pre-registered information for each type of odor component (also called an odor substance) detectable by the odor sensor 65, including the type of odor that mainly contains that odor component and the voice (referred to as character voice) emitted by the 3D character 1100. For example, in the voice management table, the odor of cigarettes mainly containing tar is registered in association with tar, and as the character voice when the cigarette odor is detected, phrases that show concern for the user's health, such as "Smoking too much is not good for you," are registered.

[0137] First, in step S11, the control unit 73 determines whether or not an odor component has been detected. For example, if the concentration of an odor component detected by the odor sensor 65 exceeds a predetermined threshold (reference value) for a particular odor, the control unit 73 determines that the odor component has been detected. In step S12, the control unit 73 determines the type of odor registered in the voice management table in association with the detected odor component. For example, if a concentration of tar exceeding a predetermined threshold is detected, it is determined that a cigarette odor has been detected. The control unit 73 then outputs a character voice corresponding to the detected type of odor from the speaker 62. For example, if it is determined that a cigarette odor has been detected, the control unit 73 executes a voice output operation that outputs a voice message expressing concern for the user's health (in this case, "Smoking too much is not good for you") as a character voice. Other examples include the following. For example, if the concentration of a specific main component contained in fragrances such as essential oils or food exceeds a predetermined standard value, the control unit 73 determines that an odor from the fragrance or food has been detected and outputs a voice message in the character's voice asking about the source of the odor. Also, if alcohol exceeding a predetermined standard value is detected, the control unit 73 determines that an alcohol odor has been detected and outputs a voice message in the 3D character 1100's character voice such as "You smell like alcohol" or "Have you been drinking again? You need to stop." Furthermore, if bad breath components (for example, hydrogen sulfide, methyl mercaptan, dimethyl sulfide, etc.) exceeding a predetermined standard value are detected, the control unit 73 determines that bad breath has been detected and outputs a voice message in the 3D character 1100's character voice such as "Your breath smells a bit, do you brush your teeth?" or "Be careful about periodontal disease." Furthermore, if odor components contained in gaseous fuels, such as tert-butyl mercaptan, dimethyl sulfide, or tetrahydrothiophene, are detected, the control unit 73 determines that the smell of gaseous fuel has been detected and outputs a voice message such as "It smells like gas!" as the character voice of the 3D character 1100.

[0138] Thus, the control unit 73 should perform control to output a voice corresponding to the detected type of odor as the character voice of the 3D character 1100. By performing such control, the range of communication between the character displayed on the image display unit 20 and the user can be broadened, and the user's attachment to the character can be increased.

[0139] Display device 1 is not limited to identifying the voice to be output based on a voice management table. Display device 1 may, for example, identify the voice to be output according to a scenario in which the content of a character's utterance changes based on the content of past dialogues (dialogue history). This scenario may define a branching scenario in which the data identifying the voice to be output by a character is managed in a tree structure.

[0140] Here, an example of audio output operation corresponding to the detection result of the odor sensor 65 is shown, but it is not limited to this, and the control unit 73 may also perform a display output operation that displays on the image display unit 20 an image of a character performing movements corresponding to the detection result of the odor sensor 65. For example, similar to the audio management table, a display management table (not shown) may be set up in advance, and the control unit 73 may perform a display output operation that displays on the image display unit 20 an image of a 3D character 1100 performing movements corresponding to the type of odor detected. The display management table may be, for example, a table that registers data defining the 3D character 1100 in association with odor components and types of odors. The data defining the 3D character 1100 may be data showing the image of the 3D character 1100 to be displayed, or it may be data defining the content of the movements of the 3D character 1100. For example, if any odor component is detected, the control unit 73 may display on the image display unit 20 an image of the 3D character 1100 performing a sniffing motion. Also, if the control unit 73 determines that, for example, cigarette smoke has been detected, it may display on the image display unit 20 an image of the 3D character 1100 performing a smoke-related motion. In this case, the control unit 73 may also display an image that mimics smoke on the image display unit 20. Furthermore, the control unit 73 may perform both the above-described audio output operation and display output operation. For example, if any odor component is detected by the odor sensor 65, the control unit 73 may display on the image display unit 20 an image of the 3D character 1100 performing a sniffing motion, while simultaneously outputting an audio message such as "Something smells" as the character voice of the 3D character 1100 from the speaker 62.

[0141] Furthermore, the control unit 73 may control the 3D character 1100's reaction to change according to the concentration (also called detection intensity) of the odor component detected by the odor sensor 65. For example, the control unit 73 may selectively display one of several stepwise motion images (e.g., "grimacing (making a disgusted face)", "sweating profusely", "turning pale", and "fainting") depending on the concentration of the odor component.

[0142] The display device 1 may be able to detect whether a user is smoking by combining it with other sensors, such as a smoke sensor that detects smoke, a camera image (for example, an image taken by the imaging unit 227), or a thermal camera image, as a method for distinguishing between the smell of cigarettes and other odors (unpleasant smells).

[0143] The control unit 73 may, when it detects that the user is smoking, display an image resembling smoke (a video that reproduces the appearance of billowing smoke) superimposed on (in front of) the 3D character 1100. In this case, the control unit 73 may make the 3D character 1100's face protrude forward and zoom in, giving it a displeased expression. The control unit 73 may change the degree to which the 3D character 1100 is displeased depending on the level of intimacy between the user and the 3D character 1100. For example, if the level of intimacy is above a predetermined value, the control unit 73 may make the 3D character 1100's expression such as "I'll forgive you because I love you," and if it is below the predetermined value, it may make the 3D character 1100's expression look unpleasant. The control unit 73 may, for example, determine the level of intimacy based on the user's usage history of the display device 1 (for example, past usage time or past conversation content). This is not the only algorithm for determining intimacy levels.

[0144] <2. Communication features based on user location information> Furthermore, for example, the display device 1 may have a GPS (Global Positioning System) receiver 60 (see Figure 9), and the following control may be performed based on the user's location information. Here, it is assumed that the display device 1 is portable. For example, the control unit 73 may acquire the location information of the display device 1 that the user is carrying (carrying) based on the signal from the GPS receiver 60 as the user's own location information, and perform the following control based on the acquired location information.

[0145] For example, it would be desirable to control the system so that voices corresponding to the frequency of the user's stay (also called visit frequency) at a location identified based on the user's location information are output as character voices. Figure 15 is a flowchart for reproducing communication related to the frequency of stay.

[0146] For example, in step S21, the control unit 73 determines whether or not the user's location information has been received from the GPS receiver 60. If the user's location information has been received, in step S22, the control unit 73 determines whether or not the frequency of stays at the location identified based on the user's location information is equal to or greater than a predetermined value (e.g., "2"). The frequency of stay is the number of times the user stayed at a single location during a predetermined period (e.g., one day or one week). For example, the control unit 73 searches for and identifies the user's location using a network or the like based on the location information acquired from the GPS receiver 60 (e.g., the user's current location information). Then, the control unit 73 calculates the user's frequency of stay based on the number of times the user stayed at the identified location and determines whether or not the user's frequency of stay is equal to or greater than a predetermined value. For example, if the user's frequency of stay is equal to or greater than a predetermined value, in step S23, the control unit 73 controls the speaker 62 to output a predetermined character voice that has been pre-registered in relation to the user's frequency of stay. For example, if a user goes to the same place twice on the same day, the control unit 73 determines that the user's frequency of visits exceeds a predetermined value and outputs a character voice such as, "Hey, you were just here a moment ago."

[0147] Furthermore, the control unit 73 should be controlled to output voices corresponding to the location identified based on the acquired location information as character voices for the 3D character 1100. Figure 16(A) is a flowchart for reproducing communication related to the place of stay, and Figure 16(B) is a diagram showing a voice management table for character voices related to the place of stay.

[0148] For example, in step S31, the control unit 73 determines whether or not the user's location information has been received from the GPS receiver 60. If the user's location information is received, in step S32, the control unit 73 searches for and identifies the user's location using the network or the like based on the user's location information. Then, in step S33, the control unit 73 outputs character voices from the speaker 62 according to the identified location, based on the voice management table in Figure 16(B). For example, when the user goes to a supermarket, the control unit 73 outputs character voices such as "What are you making for dinner tonight?" or when the user goes to a hospital, it outputs character voices such as "Are you okay? Are you feeling unwell?" Also, for example, when the user goes to an amusement park, the control unit 73 outputs character voices such as "You had a lot of fun!"

[0149] Furthermore, the control unit 73 should be controlled to output voices as character voices for the 3D character 1100 corresponding to the number of times the user has stayed at a location identified based on the acquired location information (also referred to as the number of visits, etc.). Figure 17(A) is a flowchart for reproducing communication related to the number of stays, and Figure 17(B) is a diagram showing a voice management table for character voices related to the number of stays.

[0150] Steps S41 and S42 in Figure 17(A) are the same as steps S31 and S32 in Figure 16(A), so their explanation is omitted. In step S43, the control unit 73 obtains the number of times the user has stayed at the location identified in step S42. Then, in step S44, the control unit 73 outputs character voices from the speaker 62 according to the number of times the user has stayed, based on the voice management table in Figure 17(B). For example, when the user visits a certain game center for the first time, the control unit 73 outputs character voices such as "The games were fun, weren't they?" Then, when the user visits the same game center again, the control unit 73 outputs character voices such as "I've been wanting to come again." Furthermore, when the user visits the same game center more than a predetermined number of times (for example, 10 times or more), the control unit 73 outputs character voices such as "Are you going to play games again?"

[0151] Furthermore, the central control unit 73 may be controlled to output voices corresponding to the user's stay time at a location identified based on the acquired location information as character voices for the 3D character 1100. Figure 18(A) is a flowchart for reproducing communication related to stay time, and Figure 18(B) is a diagram showing a voice management table for character voices related to stay time.

[0152] Steps S51 and S52 in Figure 18(A) are the same as steps S31 and S32 in Figure 16(A), so their explanation is omitted. In step S53, the control unit 73 obtains the user's stay time at the location identified in step S52. Then, in step S54, the control unit 73 outputs character voices from the speaker 62 according to the user's stay time, based on the voice management table in Figure 18(B). For example, if the user's stay time at the convenience store is 5 minutes or less, the control unit 73 outputs character voices such as, "You're early. I'm glad because I was waiting for you." If the user's stay time at the convenience store is 5 minutes or more but less than 10 minutes (5 to 10 minutes), the control unit 73 outputs character voices such as, "What did you buy?" Furthermore, if the user's stay time at the convenience store exceeds 10 minutes, the control unit 73 outputs character voices such as, "You're late. I was worried about you."

[0153] The control unit 73 should perform the above-described control based on the user's location information acquired using the GPS receiver 60 or the like. In this way, the user can get the feeling that the character is responding to their actions, and their attachment to the character will increase.

[0154] Although a portable display device 1 is given as an example above, a stationary display device 1 may also be used. For example, the control unit 73 (specifically, the communication control circuit 706) communicates with the user's smartphone (a smartphone equipped with a GPS receiver) to obtain the user's location information (location information of the smartphone the user is carrying) while the user is out. Then, when the user returns home and communicates with the 3D character 1100, the control unit 73 should be controlled to perform the actions described above. The character's voice and movements may be changed as appropriate.

[0155] <3. Communication functions related to user behavior patterns> Furthermore, if it is determined that the user's behavior pattern matches a predetermined behavior pattern, it is desirable that the system be controlled to output a voice corresponding to that predetermined behavior pattern as the character voice of the 3D character 1100. Figure 19(A) is a flowchart for reproducing communication related to behavior patterns, and Figure 19(B) is a diagram showing a voice management table for character voices related to behavior patterns.

[0156] For example, in the control unit 73, the days of the week the user goes to work (e.g., Monday to Friday), the time of day they go to work (e.g., 8:30 am), and the specific route they use when going to work are pre-registered by the user as a "commute behavior pattern". Then, for example, when the user's location information is received from the GPS receiver 60 (step S61), the control unit 73 determines, based on the user's location information, whether the user's behavior pattern matches a predetermined behavior pattern (step S62). For example, if the user passes through a specific route at 8:30 am on a Tuesday, the control unit 73 determines that the user's behavior pattern matches the "commute behavior pattern". Then, in step S63, the control unit 73 outputs the voice registered in association with the "commute behavior pattern" (e.g., "Have a good day at work") as the character voice of the 3D character 1100 from the speaker 62, based on the voice management table in Figure 19(B). In this way, the character responds to the user's actions, thereby increasing the user's attachment to the character. It is not necessary for the user to have pre-registered predetermined behavior patterns (for example, behavior patterns when going to work). For example, the control unit 73 may have a learning function and learn the user's behavior patterns so that predetermined behavior patterns can be registered.

[0157] <4. Communication function related to the detection of suspicious persons> Furthermore, if a person detected in the detection target space is determined to be a suspicious person, a predetermined action should be performed. After the predetermined action is performed, if the user of the display device 1 is detected, an audio message regarding the detection of a suspicious person should be output as the character voice of the 3D character 1100. Figure 20 is a flowchart for reproducing the actions related to the detection of a suspicious person.

[0158] For example, in the display device 1, a shooting unit (e.g., a camera) (not shown) for photographing a viewer (user, etc.) is provided on the front side of the display device 1, and the shooting unit (more specifically, the sensor on the shooting unit) may be used as a detection means for detecting the presence of a person in the detection target space. The "detection target space" is, for example, the field of view range (shootable range) of the shooting unit in the space on which the display device 1 is placed (e.g., the user's home). The shooting unit includes, for example, a lens and an image sensor (e.g., a CCD or CMOS), and captures a multicolor image. The lens of the shooting unit is positioned to photograph a viewer (especially their face). For example, the lens of the shooting unit is located near the center in the width direction of the display device 1 at the upper end 51. The shooting unit outputs, for example, image signals of the R, G, and B color components to the control unit 70. The overall control unit 73 processes these image signals to generate a captured image.

[0159] The control unit 73 monitors the target space using the camera unit (step S71). When the control unit 73 detects the presence of a person in the target space, in step S72 it performs user authentication, such as facial recognition, and in step S73 it determines whether the detected person is a registered user of the display device 1. For example, if the control unit 73 determines that the person photographed by the camera unit is a registered user of the display device 1, it determines that the person is not a suspicious person. On the other hand, if the person photographed by the camera unit is determined to be an unregistered user, in step S74 the control unit 73 determines that the person is a suspicious person and performs a predetermined action. Examples of "predetermined actions" include starting recording by the camera unit, issuing an alarm at a relatively loud volume, or notifying a pre-registered security company. Alternatively, the "predetermined action" may be an action in which the 3D character 1100 speaks to the suspicious person (for example, "Who are you?! Say the password!"). Furthermore, if there is no response from the person identified as suspicious, or if the password is incorrect, the above recording start operation may be performed. If the password is incorrect, the control unit 73 may output a voice message such as "That's wrong! Say it again" as the character voice of the 3D character 1100, and if it determines that the password is incorrect again, the above recording start operation may be performed. In this way, for example, a suspicious person can be made to withdraw from the detection target space, thereby improving security in the detection target space.

[0160] Furthermore, after the execution of a predetermined operation, the control unit 73 may output a voice message related to the detection of a suspicious person as the character voice of the 3D character 1100 when the user of the display device 1 is detected. Examples of "voice messages related to the detection of a suspicious person" include "That was scary." In this way, the user's attachment to the character displayed on the image display unit 20 can be increased.

[0161] Furthermore, when the detection target space is being monitored using the display device 1, the following actions may be performed in addition to detecting suspicious persons.

[0162] For example, the display device 1 may be placed in the reception area of ​​a company, and a 3D character 1100 may be displayed as a receptionist performing reception duties. Specifically, when a microwave Doppler sensor (an example of a detection means) detects the approach of a person in the detection target space (e.g., the reception area), the control unit 73 may output a voice message such as "Welcome. Which department can I help you with?" as the character voice of the 3D character 1100. Then, based on the response from the detected person (visitor), the control unit 73 may control the system to make a phone call to the department desired by the visitor.

[0163] <5. Regarding the communication function related to the startup time of the display device 1> Furthermore, the control unit 73 may control the 3D character 1100's voice speech so that the content of the communication changes according to the time the display device 1 has been running since a predetermined point in time (for example, the initial startup time) (for example, the cumulative startup time). For example, as described below, the control unit 73 may control the 3D character 1100 so that it speaks to the user in a more friendly manner as the startup time of the display device 1 increases.

[0164] For example, regarding the various character voices mentioned above, it is preferable that three patterns of character voices—a polite tone, a tone that suggests a friendly relationship with the user, and a tone that suggests a romantic relationship with the user—be pre-registered in the voice management table. Then, for example, when the startup time of the display device 1 from a predetermined point in time is less than 100 hours, the control unit 73 outputs the polite tone character voice from the three patterns of character voices registered in the voice management table. Furthermore, when the startup time is 100 hours or more but less than 1000 hours, the control unit 73 outputs the tone of character voice that suggests a friendly relationship with the user from the three patterns of character voices registered in the voice management table. Finally, when the startup time exceeds 1000 hours, the control unit 73 outputs the tone of character voice that suggests a romantic relationship with the user from the three patterns of character voices registered in the voice management table.

[0165] In this way, users can perceive a change in their relationship with the character (for example, their level of intimacy) due to the change in how the character speaks to them.

[0166] Furthermore, the control unit 73 may control the 3D character 1100's affinity with the user depending on the time elapsed since the last startup. For example, even if the cumulative startup time of the display device 1 exceeds 100 hours, if one week has passed since the last startup, the control unit 73 may output a character voice that uses polite language rather than an equal tone with the user. In this way, the user will interact with the character displayed on the image display unit 20 as frequently as possible to maintain affinity with the character, thereby further increasing their affection for the character.

[0167] Furthermore, the control unit 73 should output a greeting such as "Nice to meet you" as the character's voice when it is first started up, and then, after a predetermined period of time (for example, a convenient period such as one month) has elapsed since the first start-up, it should output a message indicating an anniversary (for example, "It's been a month since we met") as the character's voice. In this way, it is possible to further increase the user's attachment to the 3D character 1100.

[0168] <6. Communication functions through integration with other devices> Furthermore, in a stationary display device 1, for example, the following operations may be performed in cooperation with other devices. For example, when a user visits a location where a device capable of communicating with the display device 1 (hereinafter referred to as "other devices") is installed, the control unit (CPU, etc.) of the other devices may identify the user and automatically guide the user with information suitable for that user (e.g., gourmet information or event information) as described below. For example, the facial image of a user using the system for coordinating the display device with other devices and the display device owned by that user (e.g., IP address, etc.) are associated and registered in advance on an external server, etc. The control unit of the other devices, for example, when a person is detected by a sensor in the camera unit installed in the other devices, identifies the user of the display device 1 by comparing the facial image of the person detected in the captured image with the facial image of the user registered on the external server. The control unit of the other devices then identifies the display device 1 (e.g., the IP address of the display device 1, etc.) that is registered in association with that user on the external server and transmits information to the display device 1 indicating that a user of the display device 1 has been detected. The control unit 73 of the display device 1 has "user-appropriate information" (for example, gourmet information or event information) pre-registered, and the control unit 73 transmits the registered "user-appropriate information" to the other device in response to receiving a signal from that other device. The control unit of the other device then outputs (for example, voice output) the "user-appropriate information" received from the display device 1. When providing "user-appropriate information," the other device may display a 3D character 1100 on its display screen. The information provided to the user is then transmitted from the other device to the display device 1 and stored as user information in the control unit 73 of the display device 1. For example, if the display device 1 is installed in the user's home, when the user's return home is detected, the control unit 73 may output a voice message such as "You went to **, how was it?" as the character voice of the 3D character 1100. In this way, the user's attachment to the character displayed on the image display unit 20 can be increased.

[0169] <7. Other communication features> Furthermore, the following control may be performed based on the detection results from various sensors.

[0170] For example, a wind detection means (e.g., a wind sensor) capable of detecting wind (e.g., wind speed) may be provided near the lower end 52 of the opening 5 of the display device 1, and the following control may be performed based on the detection result from the wind sensor. The wind may be artificially created by the user, for example, wind generated by moving a part of the body such as waving one's hand towards the display device 1, or wind generated by blowing breath (exhaled air) towards it. For example, if the wind sensor detects wind with a wind speed of a predetermined value or higher, the control unit 73 may output an image of the hair (e.g., hair) or clothes (e.g., skirt) of a character (e.g., 3D character 1100) displayed on the image display unit 20 fluttering in the wind. Also, for example, if an image of a lit candle is displayed on the image display unit 20, and wind is detected by the wind sensor, the control unit 73 may switch to an image of the candle flame going out. Furthermore, the control unit 73 may switch the image according to the detected wind strength (e.g., wind speed), such as making the clothes of the 3D character 1100 flutter more when the detected wind is stronger than a predetermined threshold (wind speed is greater than a predetermined threshold).

[0171] Furthermore, for example, an object detection means (e.g., an ultrasonic sensor) capable of detecting the presence or absence of an object and the distance to the object may be installed on the inner surface of the housing 10 of the display device 1, facing inward towards the housing 10, and the following control may be performed based on the detection result from the ultrasonic sensor. For example, if the control unit 73 determines, based on the detection result from the ultrasonic sensor, that a viewer's hand is touching the 3D character 1100 that is displayed stereoscopically inside the housing 10, it may output an image showing the 3D character 1100 reacting. The control unit 73 may also control the display so that the 3D character 1100 shows different reactions depending on the part touched by the viewer. The parts of the 3D character 1100 that can be touched by the viewer may be, for example, body parts such as the head, chest, abdomen, buttocks, or legs. The parts of the 3D character 1100 that can be touched by the viewer may also be the clothing (e.g., clothes, skirt) or ornaments (e.g., accessories) of the 3D character 1100.

[0172] Furthermore, for example, the display device 1 may be provided with earthquake detection means (e.g., a seismic sensor) capable of sensing an earthquake and measuring its seismic intensity, and the control unit 73 may issue an earthquake warning when an earthquake is detected by the seismic sensor.

[0173] Furthermore, for example, a weather sensor capable of measuring the weather may be provided in the display device 1, and the central control unit 73 may notify the user of weather changes, weather forecasts, etc., based on the measurement results from the weather sensor. The weather sensor may, for example, have a barometric pressure sensor, a temperature sensor, and a humidity sensor, and may be configured to measure the weather based on the detection results of each sensor.

[0174] Furthermore, the control unit 73 may display images on the image display unit 20 in which the facial expressions and movements (also called motion) of the character displayed change according to the temperature detected by the temperature sensor and / or the humidity detected by the humidity sensor.

[0175] Furthermore, the control unit 73 may display images on the image display unit 20 in which the facial expressions and movements of the character displayed change according to the detection results from a human presence sensor such as a microwave Doppler sensor (for example, the distance between the display device 1 and the observer).

[0176] Furthermore, the control unit 73 may use a humidity sensor to determine whether or not the user has breathed on the device. In addition, the control unit 73 may also use a temperature sensor to determine the type of breath blown on the device by the user. These sensors may be installed, for example, near the lower end 52 of the opening 5 of the display device 1.

[0177] Here, the breath blown by the user can be of two types: a "whoosh" breath and a "haaa" breath. Generally, when blowing cold breath, one blows quickly with a "whoosh," so here we will refer to the "whoosh" breath as "cold breath." Also, generally, when blowing warm breath, one blows slowly with a "haaa" breath, so here we will refer to the "haaa" breath as "warm breath."

[0178] Regarding these two types of breath, the inventors of this application have obtained the following findings through experiments, etc. Specifically, regarding humidity, measurements showed that when a breath is blown "hoo" towards a temperature and humidity sensor (for example, a sensor in which a temperature sensor and a humidity sensor are integrated) at a predetermined distance from the sensor, the humidity rises sharply from a steady state immediately afterward. Furthermore, measurements showed that the humidity increases monotonically while the breath is being blown, and when the breath is stopped, it takes several tens of seconds to return to the original steady state. Similar measurement results were obtained when a breath is blown "ha" towards the temperature and humidity sensor under the same conditions. On the other hand, regarding temperature, measurements showed that when a breath is blown "hoo," the temperature decreases slightly from a steady state or remains almost constant, while when a breath is blown "ha," the temperature rises. Note that the breath blown by the user towards the display device 1 is an example of wind hitting the display device 1.

[0179] Taking these findings into consideration, for example, in a display device 1 equipped with a humidity sensor, if the humidity sensor detects a rapid increase in humidity from a steady state, the control unit 73 may determine (or decide) that a person has breathed on it. Furthermore, if no further monotonic increase in humidity is detected thereafter, the control unit 73 may determine that the breathing has stopped. Alternatively, if a predetermined time has elapsed since the rapid increase in humidity was detected (for example, the time it normally takes to exhale (for example, about 3 seconds)), the control unit 73 may determine that the breathing has stopped, regardless of the humidity detection result at that time.

[0180] Furthermore, if a rapid increase in humidity is detected by the humidity sensor, and the temperature sensor detects that the temperature has risen from a steady state (for example, at almost the same time), the control unit 73 may determine that the breath blown by the observer was "warm breath". Conversely, if a rapid increase in humidity is detected by the humidity sensor, and the temperature sensor detects that the temperature has not changed from a steady state, or has decreased from a steady state, the control unit 73 may determine that the breath blown by the observer was "cold breath".

[0181] The control unit 73 may output video and audio corresponding to the detection of breath being blown on the image display unit 20 as the movement of the character displayed on the image display unit 20 and the character's voice. The control unit 73 may also output video and audio corresponding to the type of breath blown on the character displayed on the image display unit 20 as the movement of the character displayed on the image display unit 20 and the character's voice. For example, if the breath blown on by the observer is "cold breath", the control unit 73 may output video of the character's clothes fluttering, and if the breath blown on by the observer is "warm breath", it may output video of the character making a movement to avoid the breath.

[0182] Furthermore, the inventors of this application have obtained the following findings using various gas sensors. Specifically, measurements showed that when a breath is blown towards the gas sensor at a predetermined distance (for example, about 10 cm), the output value of the gas sensor decreases immediately afterward, and immediately after the breath is finished, the output value of the gas sensor begins to rise. Conversely, measurements showed that when a breath is blown towards the gas sensor, the output value of the gas sensor increases immediately afterward, and immediately after the breath is finished, the output value of the gas sensor begins to decline. In addition, measurements showed that when wind from a fan (for example, an electric fan) hits the gas sensor, the output value of the gas sensor decreases, and when the wind from the fan no longer hits the gas sensor, the output value of the gas sensor increases.

[0183] Taking these findings into consideration, the control unit 73 may, for example, determine that the type of breath blown by the observer is "cold breath" when the output value of the gas sensor in the display device 1, which is equipped with a gas sensor, drops sharply from a steady state. Conversely, if the output value of the gas sensor rises sharply from a steady state, the control unit 73 may determine that the type of breath blown by the observer is "warm breath".

[0184] The system can also be configured to detect breath using a wind sensor. The inventors of this application have confirmed that the wind sensor can sometimes detect relatively weak winds, such as those caused by fanning with paper, and that it immediately reaches a peak when breath is blown onto the wind sensor, indicating good responsiveness when wind starts blowing. However, if breath is blown continuously, the peak level drops off quickly. With a strong wind, such as a sudden gust of air, the heater may cool down, and it may take time for it to recover.

[0185] In relation to a configuration that detects breath using a wind sensor, the following configuration may be used.

[0186] The control unit 73 should process the direction in which it is not breathing if the wind sensor continuously detects a predetermined amount of airflow. Processing the direction in which it is not breathing means, for example, determining that no one is breathing. In this case, the control unit 73 should process the direction in which it is breathing if the time from when the wind sensor starts detecting wind until when it stops is within the time when breathing is possible.

[0187] In this case, the wind sensor may be a sensor that detects wind by electrically measuring the heat removed by the wind. In this sensor, the wind received by the sensor corresponds to the amount of air blown onto it. This sensor is set so that if the wind received by the sensor lasts for a period of time equivalent to the time that air was blown onto it, the value drops to a value lower than the actual airflow during that period. It is preferable that this drop is less likely to occur if the wind received by the sensor is less than the amount of air blown onto it.

[0188] In the display device 1, a flow path may be provided that allows air to flow into multiple wind sensors, sharing a common airflow path. The flow path may be configured so that air enters different wind sensors at a predetermined ratio, not 1:1. The control unit 73 may determine the size and duration of the airflow based on this ratio and the differences in the characteristics of the multiple wind sensors. The display device 1 may include multiple wind sensors that drop to a value lower than the actual airflow at different timings during the duration, and the control unit 73 may determine the size and duration of the airflow based on the outputs of the multiple wind sensors. The display device 1 may include at least wind sensors that are not gas sensors and gas sensors as the multiple wind sensors.

[0189] Furthermore, it is preferable to use a gas sensor for detecting a predetermined gas as the wind sensor. It is preferable to use a gas sensor for detecting a predetermined gas, which is equipped with a heater, as the wind sensor. In this case, it is preferable to use a gas sensor equipped with a heater that has the characteristic of outputting an output in the direction that increases the amount of gas detected when the degree of breath blowing is relatively small (as a result of detecting the gas contained in the breath), and outputting an output in the direction that decreases the amount of gas detected when the degree of breath blowing is relatively large (due to the cooling of the heater by the wind from the breath).

[0190] When the control unit 73 determines that breath is being blown on it, if the strength of the breath is relatively large (for example, if the airflow is above a threshold), it should display an animation that moves the clothes and hair of the 3D character 1100. On the other hand, if the strength of the breath is relatively small, it should display an animation different from the one that moves the clothes and hair of the 3D character 1100.

[0191] Incidentally, when a gas sensor is used to detect breath, the gas sensor reacts to components in human breath (for example, carbon dioxide) and outputs the above value. The reason why the output value of the gas sensor differs depending on whether a "whoosh" or an "exhale" is blown is that when a "whoosh" is blown, the velocity of the breath is high and it tends to disperse into the surroundings immediately after hitting the gas sensor, while when an "exhale" is blown, the velocity of the breath is low and the components of the breath tend to remain in place after hitting the gas sensor.

[0192] Furthermore, the control unit 73 may use, for example, the humidity detection result from the humidity sensor to determine whether the detected wind is due to a person breathing on it or from a fan. For example, if the humidity sensor detects that the output value of the gas sensor in the display device 1 drops sharply from a steady state and the humidity rises sharply from a steady state, the control unit 73 may determine that the user is breathing on it. On the other hand, if the output value of the gas sensor drops sharply from a steady state but the humidity remains at a steady state, the control unit 73 may determine that the wind is being blown by a fan. Furthermore, the control unit 73 may use the temperature detection result from the temperature sensor to determine the type of breath when it is determined that the user is breathing on it. Also, if the output value of the gas sensor repeatedly rises and falls within a relatively short period of time, the control unit 73 may determine that the wind is being blown by an oscillating fan.

[0193] Wind sensors, humidity sensors, temperature sensors, temperature and humidity sensors, and gas sensors used to detect wind are examples of wind detection means. The display device 1 may also have a barometric pressure sensor as a wind detection sensor, because changes in atmospheric pressure can occur due to the generation and strength of wind.

[0194] Various controls as described above can be performed. Note that these controls are not limited to 3D character 1100, but may also be applied to communication functions related to other characters (for example, 3D character 1200).

[0195] [Examples of displaying 3D images, etc.] In the display device 1 having the above configuration, it is preferable that the following display be performed with respect to three-dimensional images (especially, three-dimensional images that display, for example, 3D characters). The following display may be performed, for example, as an example of the "communication function" described above. The following display may be reproduced, for example, by the control unit 73 executing a 3D application in the ROM 702.

[0196] For example, although not shown in the diagram, the control unit 73 may change the perspective of the character (also called a perspective image) when there is movement in a part of the character's body. In this way, the character can be given a sense of dynamism.

[0197] For example, although not shown in the diagram, when a character becomes angry due to a conversation with a viewer and throws a punch, the control unit 73 may control the camera position so that the character's hand is visible in front of the camera within the 3D application, and also control the perspective to be more exaggerated than normal, at least for the duration of the punch. Then, once the character's punch is finished, the control unit 73 may control the perspective to return to normal.

[0198] Furthermore, when adjusting the distance between the left and right cameras (for example, the distance setting value in the 3D application) so that the 3D character appears to protrude in front of the dimming member 30 in naked-eye stereoscopic viewing, there is a problem that the 3D character appears stretched in the front-to-back direction if the degree of protrusion is increased. Taking this problem into consideration, it is preferable for the control unit 73 to perform image processing such as compressing the front-to-back direction of the 3D character as the degree of protrusion increases (for example, as the distance between the left and right cameras is widened). In particular, it is preferable to provide a compression amount corresponding to the degree of protrusion, so that the compression amount increases as the 3D character protrudes further forward.

[0199] Furthermore, although not shown in the diagram, the control unit 73 may display the 3D character in such a way that various parts of its body (for example, the chest in the case of a female character) appear to sway. In this case, to further emphasize the three-dimensionality of the 3D character, it is preferable to display an image in which the 3D character is facing diagonally forward rather than directly forward.

[0200] Furthermore, the control unit 73 may set various parameters in the 3D application (such as camera distance, orientation, and distance to the display object) to appropriate values ​​according to the character displayed on the image display unit 20. In addition to automatic setting by the control unit 73, physical sliders for adjusting the various parameters in the 3D application may be provided on the housing 10, allowing an observer to easily adjust the parameters while viewing the 3D character.

[0201] Furthermore, although not shown in the diagram, the control unit 73 may display a predetermined object (for example, a board) in the same position as the dimming member 30. In this way, the presence of the dimming member 30 can be visually communicated to the viewer, and the viewer's hand may not collide with the dimming member 30 when they place their hand into the spatial area 102 (Figure 6). It is also preferable that the display device 1 be equipped with a function to calibrate various parameters so that the predetermined object and the dimming member 30 are in the same position.

[0202] Furthermore, it is advisable to pre-prepare two images: one showing the 3D character extending forward of the dimming member 30 (towards the opening 5), and another showing the 3D character extending only to the rear of the dimming member 30 (towards the image display unit 20), so that different actions are performed in each state. For example, although not shown in the diagram, when the control unit 73 displays an image on the image display unit 20 showing the 3D character extending forward, it is advisable to display an image on the image display unit 20 showing the 3D character performing an action that actively invites the viewer to touch the 3D character, such as shaking hands. Conversely, when the 3D character does not perform such an action, it is advisable to display an image where no such action is performed. Alternatively, the control unit 73 could, for example, display an image of a slide on the surface of the inclined dimming member 30 and draw an image of the character sliding on it (towards the front).

[0203] Furthermore, the control unit 73 may selectively display one of a plurality of images, including the first and second images described below, as images recognized as three-dimensional images in the image display unit 20. The first image should be an image that can be viewed stereoscopically by the viewer (see the 3D character 1000 in Figure 21(B)) such that at least a portion of the 3D character 1000 is located in front of the dimming member 30 (towards the opening 5). The second image should be an image that is perceived to be located either in front of or behind the first image. For example, the image display unit 20 may switch between displaying a second image (see Figure 21(A)) that is stereoscopically viewable by the viewer, where the 3D character 1000 (an example of a "display object that can be viewed stereoscopically by the viewer") is located behind the dimming member 30 (towards the image display unit 20), and a first image (see Figure 21(B)) that is stereoscopically viewable by the viewer, where the part of the 3D character 1000 above its feet is located in front of the dimming member 30 (towards the opening 5). In the first image, the entire 3D character 1000 may be located in front of the dimming member 30, allowing for stereoscopic viewing. In this way, it is possible to selectively display one of several images, including the first and second images, where the position in which the viewer perceives an image as a three-dimensional object differs, thereby changing the sense of depth given to the viewer. As a result, for example, the viewer can be more entertained. The image of the 3D character 1000 itself is displayed on the display surface of the image display unit 20, and Figure 13 shows the 3D character 1000 as seen in stereoscopic view by the viewer (which can also be described as appearing to pop out from the image display unit 20).

[0204] For example, the central control unit 73 may switch the displayed image of the image display unit 20 by transitioning from an image in which the 3D character 1000 only extends to the rear side of the dimming member 30 (see Figure 21(A)) to an image in which the 3D character 1000 (all or part of the 3D character 1000) extends to the front side of the dimming member 30 (see Figure 21(B)). The position in which the three-dimensional image is recognized may be switchable by operation of the operation unit 40 or other operations by the user. The user may operate the system so that the image is displayed in a position where the three-dimensional image appears three-dimensional. In addition, there may be three or more switchable positions for the three-dimensional image, as whether or not the three-dimensional image appears three-dimensional may vary from person to person.

[0205] Furthermore, when transitioning between the first image and the second image, the control unit 73 may display an image (video) of the 3D character 1000 gradually moving from the rear side to the front side of the dimming member 30 (or from the front side to the rear side of the dimming member 30).

[0206] In such image transitions, the central control unit 73 may display on the image display unit 20 an image of a 3D character performing an action that indicates the presence of the dimming member 30. For example, if the 3D character strikes the dimming member 30 from behind, an image of a hole in it may be placed at the same position as the dimming member 30, and an image of the 3D character jumping out of the hole and moving towards the front may be displayed.

[0207] [Specific examples of images displayed on display device 1] Next, specific examples of images displayed on the display device 1 will be described with reference to Figures 22 to 36. Figures 22 to 36 show examples of characters (images including the 3D character 1200 described in Figures 11 and 12) displayed on the display device 1 according to this embodiment. Each image shown in Figures 22 to 36 is an image that is displayed on the display device 1 and can be seen by a viewer through the opening 5. Although the stage image 2200 is displayed in Figures 22 to 36, it is also possible to display the 3D character 1200 without the stage image 2200.

[0208] The display device 1 (specifically, the central control unit 73) displays the images of the 3D character 1200 shown in Figures 22 to 28, switching them regularly or randomly based on the communication function during periods when it is waiting for the viewer's action. The display device 1 (specifically, the central control unit 73) changes the display of the 3D character 1200 based on the communication function. For example, as shown in Figure 22(A), the 3D character 1200 is displayed in a standing position facing the front side of the display device 1 (the side where the image is viewed). The display device 1 may use this posture as the basic posture and display it during periods when no communication based on the communication function is taking place. For example, as shown in Figure 22(B), the 3D character 1200 makes a motion as if licking its front paws. For example, as shown in Figures 22(C) and 23(A), the 3D character 1200 makes a motion as if looking alternately to the left and right. For example, as shown in Figure 23(B), the 3D character 1200 makes a motion as if facing the ground. For example, as shown in Figure 23(C), 3D character 1200 performs a stretching motion while sitting. For example, as shown in Figure 24(A), 3D character 1200 performs a motion as if looking down at the ground. Furthermore, for example, as shown in Figures 24(B) and 24(C), 3D character 1200 performs a walking motion towards the front. For example, as shown in Figure 25(A), 3D character 1200 performs a motion as if looking down at its own abdomen. For example, as shown in Figure 25(B), 3D character 1200 performs a head tilting motion. For example, as shown in Figure 25(C), 3D character 1200 performs a motion as if rubbing its own eyes. For example, as shown in Figure 26(A), 3D character 1200 performs a yawning motion. For example, as shown in Figure 26(B), 3D character 1200 performs a motion as if licking its own front paws while sitting. For example, as shown in Figure 26(C), the 3D character 1200 makes a motion as if looking to its left front. For example, as shown in Figure 27(A), the 3D character 1200 makes a motion as if looking to its right front. As shown in Figure 27(B), the 3D character 1200 makes a motion as if stretching. For example, as shown in Figure 27(C), the 3D character 1200 makes a motion as if looking down at the ground.For example, as shown in Figure 28(A), the 3D character 1200 faces diagonally forward to the right of the display device 1, and then faces forward as shown in Figure 28(B). As shown in Figure 28(C), the 3D character 1200 performs a motion of licking its front paws.

[0209] Figures 29 to 36 show examples of displays of the 3D character 1200 by the display device 1 (specifically, the control unit 73) based on its communication function during dialogue processing. The strings shown in Figures 29 to 36 are strings that can be recognized by voice recognition and are displayed above the 3D character 1200. Figure 29(A) is what is displayed when the display device 1 recognizes the observer's utterance, "Come here, come here," and a voice is output in response. Figures 29(B) to 30(B) are what are displayed when the display device 1 recognizes the observer's utterance, "Sit," and a voice is output in response. Figure 30(C) is what is displayed when the display device 1 recognizes the observer's utterance, "Are you hungry?", and a voice is output in response. Figure 31(A) is what is displayed when the display device 1 recognizes the observer's utterance, "Go around," and a voice is output in response. Figures 31(B) and (C) are displayed when the display device 1 recognizes the observer's utterance, "It's snack time," and a sound is output in response. Figure 32(A) is displayed when the display device 1 recognizes the observer's utterance, "Give me your paw," and a sound is output in response. Figures 32(B) to 33(B) are displayed when the display device 1 recognizes the observer's utterance, "How cute," and a sound is output in response. Figure 33(C) is displayed when the display device 1 recognizes the observer's utterance, "Hello," and a sound is output in response. Figure 34(A) is displayed when the display device 1 recognizes the observer's utterance, "Time to eat," and a sound is output in response. Figures 34(B) and (C) are displayed when the display device 1 recognizes the observer's utterance, "Is it a girl?", and a sound is output in response. Figure 35(A) is what the display device 1 displays when it recognizes the observer's utterance of "Wait," and in response, it outputs a sound. Figure 35(B) is what the display device 1 displays when it recognizes the observer's utterance of "Good boy," and in response, it outputs a sound. Figures 35(C) and 36 are what the display device 1 displays when it recognizes the observer's utterance of "Yuno," and in response, it outputs a sound.

[0210] <More detailed description of 3D character 1200> The 3D character 1200 described in Figures 22 to 36 will be explained in more detail below. In the following explanation, when the display device 1 is the processing unit, it may be said that the processing is performed by the control unit 70 (more specifically, the overall control unit 73). The 3D character 1200 is particularly well rendered with a proportion of approximately 3 heads. It has been found that this particularly emphasizes the sense of depth. The display device 1 should render the 3D character 1200 such that, when viewed from the side, the head occupies approximately one-third of the height in the vertical direction, the torso occupies approximately one-third, and the feet occupy approximately one-third. The display device 1 should render the 3D character 1200 such that, excluding the tail, the head occupies approximately one-third of the height in the horizontal direction when viewed from the side, the torso occupies approximately two-thirds.

[0211] Display device 1 has a function to render the image by shifting between a state where the tail is not visible and a state where the tail is visible, with the time spent in the visible state being shorter than the time spent in the invisible state. The tail will be rendered behind the head, but the occasional visibility of the tail enhances the sense of depth and prevents eye and head fatigue caused by constantly experiencing a strong sense of depth. In particular, display device 1 should perform this rendering process when in standby mode for voice recognition. When shifting to the state where the tail is visible, display device 1 should have a function to render the tail so that it appears from the top of the head. In this way, the viewer's line of sight is usually in the eyes of the face, and the tail suddenly pops out from above the center of that line of sight, creating a sense of surprise and amusement.

[0212] Display device 1 may create a flat area on top of the 3D character 1200's head when viewed from the front, and in particular, the area between the left and right ears should be drawn as flat when viewed from the front. In this way, a three-dimensional tail suddenly appears above the head from the flat top of the head, which has little sense of depth, creating a greater sense of surprise and interest. Display device 1 may also draw the tail to appear from above the head and then draw the part near the tip of the tail to move. In this way, the viewer's gaze can be drawn to the part of the tail behind the face, creating a greater sense of depth. Display device 1 may similarly draw the tail to appear from the left and right sides of the body. When the tail appears from the left and right, display device 1 should shorten the length and / or duration of the tail's appearance compared to when it appears from above the head. When the tail appears from the left and right, display device 1 may draw it to appear as if it is flickering. Display device 1 may also draw the viewer's gaze to move further back from time to time, creating a greater sense of depth. The display device 1 may display the tail appearing from above the head when sound is being recognized, and display the tail appearing from either the left or right direction when sound is being output from the cat. The display device 1 may also provide parts of the tail with different drawing patterns at predetermined intervals along its length. For example, patterns with a predetermined width may be applied to the cylindrical surface of the tail in an annular or arc shape at regular intervals. The inventors have found that this makes the movement of the tail appear more dynamic in three-dimensional space.

[0213] The display device 1 should maintain the same posture during voice recognition, and should display a drawing that changes its current posture to the same posture when there is a change from a state where voice recognition is not in progress to a state where voice recognition is in progress. The display device 1 should say "I'm gonna chat" before starting voice recognition. The display device 1 should be equipped with a function to detect the actions of the observer (e.g., a sensor or switch) and should say "What is it?" when it detects an action from the observer. The two functions should be executed in succession in the form of "What is it?" and "I'm gonna chat," and then the device should be processed to enter the voice recognition state.

[0214] Display device 1 is equipped with information on phrases that are praiseworthy, such as "cute," as voice recognition phrases. When it recognizes a praiseworthy phrase, it should change its body posture. It would be even better if the cat itself moved, such as by walking. In this way, the observer will be motivated to praise the cat in order to see the changes in its posture and movement, resulting in excellent therapeutic effects such as improvements in behavior and speech.

[0215] The display device 1 is equipped with a voice recognition phrase corresponding to the command to feed the cat, and when this phrase is recognized, it should display a drawing of the cat wagging its tail faster than in other cases. In this way, the viewer can get a more realistic sense of the cat being alive.

[0216] Display device 1 should render the outer edge of the cat's eye as roughly circular, with the pupil as a vertically elongated ellipse. Display device 1 should render the pupil with a gradient of light and dark in the vertical direction, with the color becoming lighter towards the bottom. Display device 1 should provide a darker area in the center of the pupil than the surrounding circular or elliptical area. Display device 1 should render a crescent-shaped or semi-circular white area along the outer edge of the pupil in the area above the pupil, closer to the outer edge of the face. Conversely, display device 1 should render a circular white area below the pupil, closer to the center of the face. Display device 1 should continue rendering this white area even if the position of the 3D character 1200 changes (such as a change in posture), or if the position of the camera or light changes. Normally, highlights are often added computationally as reflections of light, etc. However, by doing this, the individuality of the cat's eyes, which are the most visible part when speaking to the voice recognition system, can be emphasized, and the cat can be made to stand out as a unique character in the short time the voice recognition system is working.

[0217] Display device 1 can take two states: when the face is facing forward and when it is facing downward. When the face is facing forward, the outline of the eyes is drawn as a roughly circular shape, while when the face is facing downward, the eyes are drawn as a horizontally elongated ellipse.

[0218] Display device 1 can take two states: one in which the upper edge of the face is above the upper edge of the body, and another in which the upper edge of the face is below the upper edge of the body. When the upper edge of the face is above the upper edge of the body, the outline of the eyes is drawn as a roughly circular shape, while when the upper edge of the face is below the upper edge of the body, the eyes are drawn as a horizontally elongated ellipse. Display device 1 is equipped with a function to draw a state of yawning with the mouth open, and when drawing this, it is desirable to draw the eyes closed.

[0219] Display device 1 should prepare multiple idle motion patterns for the 3D character 1200, and repeatedly select and draw one of these patterns. Idle motions include motions such as licking feet, stroking the face with hands, licking the buttocks, facing forward, looking left and right, licking the ground, stretching, yawning, and walking.

[0220] Display device 1 should render the ears so that they move with a delay compared to the movement of the face. For example, the ears should be rendered so that they maintain their position for a while even after the face starts to move. Display device 1 should also have a function to simultaneously perform a tail-swinging motion when performing a licking motion. The display device 1 should have asymmetrical patterns on the body of the 3D character 1200 when viewed from the front. This makes it easier to remember the cat as having a unique personality and makes it easy to determine whether the right or left side is being viewed. This is particularly useful when the scene is magnified to the point where the entire 3D character 1200 is not visible. In particular, the patterns should be those of a calico cat, or especially a tabby cat. The inventors have found that this makes it easier to perceive the three-dimensionality. In particular, the patterns on the head should be placed in the front-to-back direction, while the patterns on the body should be placed in the up-to-down direction, so that the directions of the patterns are different. This makes it easier to recognize changes in the position of the camera or the cat, regardless of the direction of movement.

[0221] The display device 1 is equipped with a function to emit the sound "nya," and it is preferable that the "nya" sound has multiple intonations, with different motions associated with each sound. Among the intonations, it is preferable that there be a questioning intonation, and the motion be a head tilt.

[0222] <About the communication features for 3D Character 1200> This section provides additional information regarding the communication functions of the 3D character 1200. The following measures can be used to provide viewers with higher-quality communication with the 3D character 1200. Here, we will outline the actions taken by the person to tame the character and the story of their interactions with the 3D character 1200. In this embodiment, a camera unit for photographing the viewer is provided on the front side of the display device 1.

[0223] (1) First step: The stage of taming Typically, stray cats and other cats come in various types, some running away simply at the sight of a person, and others running away when a person approaches. In such cases, the cat's behavior appears to involve repeatedly looking back to check on the person before fleeing. Here, the control unit 70 recognizes the presence of a viewer based on the image captured using the camera unit, and if the microwave intensity measured by the human presence sensor 64 exceeds a threshold, it displays an image of the 3D character 1200 performing a fleeing motion. This is to indicate that a person has approached the cat. The camera unit recognizes the viewer in order to show the viewer the scene of the 3D character 1200 fleeing. In other words, the 3D character 1200 will not perform the fleeing motion unless the viewer approaches the display device 1 from the front.

[0224] Next, it is thought that a person might say to a cat, "Squat down (lower your eyes)" or "Come here, come here." Some cats might stop and observe the situation. However, when the person approaches, the cat runs away. This is repeated several times. It is thought that cats will not get used to such human behavior. Therefore, during the period when the control unit 70 is displaying the video of the 3D character 1200 running away, if the microwave intensity measured by the human presence sensor 64 is below a certain threshold, and if the control unit recognizes a word indicating a call to the 3D character 1200, such as "Come here," it will display a video of the 3D character 1200 performing an action that makes it appear as if it is stopping. The condition here is that the microwave intensity must be below a threshold because it is assumed that a human is standing still.

[0225] Next, one might consider feeding a cat that has stopped to look at it. However, since cats run away when people approach them, it seems that the only option is to leave food in a place where cats frequently visit. Therefore, the display device 1 has a function to display an image of food being placed within the video display space. For example, when the control unit 70 receives a predetermined operation (for example, an operation of the operation unit 41 or operation unit 42), or when the gesture sensor 63 detects a predetermined gesture instructing to place food, it displays an image of food in the video, indicating that food has been placed. In this way, the observer will, for example, place food every day. At this time, the control unit 70 should display a 3D character 1200 that appears to be watching the scene from a distance. When the control unit 70 does not recognize the presence of an observer using the human presence sensor 64, and the observer is not being captured by the camera, it displays an image of the 3D character 1200 eating the food. Here, a situation is recreated in which the cat does not eat the food in front of a person. From the observer's perspective, it creates a situation where the food is gone before they know it. The control unit 70 counts and stores the number of times the observer feeds the cat. This state continues for a while, but the control unit 70 should display a display that gradually reduces the distance between the observer, the 3D character 1200, and the person (the distance perceived by the observer) as the number of times the cat is fed decreases. For example, the control unit 70 should make the 3D character 1200 larger as the number of times the cat is fed decreases, simulating that the distance has decreased (i.e., the cat has become a little more accustomed to the cat). Furthermore, when the number of times the cat is fed increases and reaches a predetermined threshold, the control unit 70 displays an image of the 3D character 1200 eating the cat, assuming that the cat has become accustomed to the cat, even if the observer is looking at the character, that is, even if the control unit 70 recognizes the presence of the observer using the human presence sensor 64 and the observer is being filmed by the camera unit. Only at this point can the observer visually see the 3D character 1200 eating the cat.

[0226] However, it is often difficult for people to know when a cat will eat. Therefore, the control unit 70 may set a time period (or a specific point in time) during which the 3D character 1200 will eat, and display an image of the 3D character 1200 eating during that time period. This is to make the viewer aware that the cat seems to eat during this time period. When the control unit 70 detects that a viewer is about to touch the 3D character 1200, it causes the 3D character 1200 to output a predetermined speech sound, such as "shhh" or "shhh shhh," and displays an image of the 3D character 1200 running away. The viewer's attempt to touch the 3D character 1200 may be identified when the intensity of microwaves detected by the human presence sensor 64 exceeds a threshold while the 3D character 1200 is eating, or when the first sensor 2331 detects a predetermined gesture.

[0227] This situation will continue for a while, but the control unit 70 should gradually reduce the distance at which the viewer's hand can be brought close to the 3D character 1200. When the viewer can get close to a predetermined distance, the control unit 70 should consider that the 3D character 1200 has become accustomed to the viewer and should display an image of the character grooming itself or relaxing in front of the viewer. Specifically, the control unit 70 should increase the threshold for microwave intensity or increase the threshold for the distance from the display device 1 when a gesture is made. In this way, the control unit 70 should lower the detection sensitivity, making the 3D character 1200 less responsive to the viewer's movements and preventing it from making sounds such as "hiss" or "hisssss."

[0228] Cats are always wary, but they gradually start to groom themselves, lie down, scratch, and wipe their faces. As cats become more accustomed to people and human hands, people will be able to touch them. At this point, the control unit 70 should not reflect the microwave detection results from the human presence sensor 64 in the movement of the 3D character 1200. The control unit 70 should use the first sensor 2331 as a motion sensor and, according to the detection results of the viewer's gestures in the up, down, left, right, forward, and backward directions, display an image of the 3D character 1200 appearing to enjoy being petted. Furthermore, the control unit 70 should recognize the viewer's voice using the microphone 61 and display an image of the 3D character 1200 reacting to it. For example, the control unit 70 should be configured to emit the sound "nya" as the spoken content, regardless of what words it recognizes.

[0229] The control unit 70 may also display an image of the 3D character 1200 begging for food as time passes. When the control unit recognizes the presence of a viewer by the camera unit and the presence of a viewer is detected by the motion sensor 64, it may set a time of day (for example, morning, noon, or evening) and display an image of the character making a "meow" sound and rubbing its face against something. Furthermore, as the viewer speaks to the 3D character 1200, the control unit 70 may recreate the process of the 3D character 1200 learning its name. For example, the control unit 70 may respond only to the word "Yuno" and make a "meow" sound, or it may respond to calls such as "Yuno" and "Here's some food" and display an image of the character acting affectionately or rubbing its face against something happily.

[0230] (2) Second step: The stage of learning the language (Japanese) When the control unit 70 recognizes the voice of a person calling out "Yuno" at some point, it outputs a voice response indicating "What?". From here, the 3D character 1200 begins to learn words. The control unit 70 counts the number of times it has been called out to, takes the cumulative average per day, and responds according to a value calculated by multiplying the cumulative average number of times it has been fed per day by the cumulative average number of times it has been called out to and a random coefficient (hereinafter referred to as the "cumulative average"). These calls are predetermined calls such as "Good morning," "Hello," "Good evening," "How are you?", and "Do you want some food?". Depending on the cumulative average, the control unit 70 may stop responding (i.e., simulate the 3D character 1200 forgetting words) or increase the number of words it responds to. For example, the control unit 70 should decrease the number of words it responds to as the cumulative average is small, and increase the number of words it responds to as the cumulative average is large. The cumulative average value is calculated based on the number of times the display device 1 has been spoken to from the start of use to the present, but it may also be calculated based on the number of times the display device 1 has been spoken to from a predetermined period in the past to the present. The predetermined period may be fixed, such as one month, or if the display device 1 has not been used for a certain period, it may be the period from the time it is used again after that period. In the initial stages of using the display device 1, the cumulative average value may change significantly, so for example, if the observer does not speak to the 3D character 1200 even once a day, the 3D character 1200 may stop responding, but as the number of times it is spoken to increases, the cumulative average value will not change significantly. In this way, it is possible to reproduce the way the 3D character 1200 takes time to forget words. The random coefficient used in calculating the cumulative average value is a value that reproduces the capriciousness of a cat, and can also be called the capriciousness coefficient. The random coefficient should be varied based on the actions of both 3D character 1200 and the observer, such as whether or not to give food when character 1200 begs for it, or waking 3D character 1200 up by talking to it or touching it when it is sleeping.

[0231] The control unit 70 may also be configured to have the 3D character 1200 speak to the observer or respond to questions about predetermined information such as weather and news when the cumulative average value exceeds a certain threshold. Of course, if the observer reduces the number of times they feed the character, the cumulative average value will decrease, so the control unit 70 will reduce the types of responses or stop responding altogether. In other words, if the observer feeds the character 1200 haphazardly or doesn't speak to it appropriately, the 3D character 1200 may not maintain its ability to respond, or even if it does, it may not respond due to its "whims." In this way, a higher quality communication function with the 3D character 1200 can be provided to the observer.

[0232] Furthermore, the following is also possible:

[0233] For example, with a lenticular display, the image may no longer appear three-dimensional if the eye position moves even a few centimeters to the right or left from the position where the image appears three-dimensional. In this case, there is a risk that the viewer will give up, thinking, "The image doesn't look three-dimensional." Taking this into consideration, the control unit 70 may be controlled to issue an instruction, for example, based on the detection result of the human presence sensor 64, such as, "If I appear as two people, try moving another 3 centimeters to the right." This would prevent the viewer from becoming bored because the image no longer appears three-dimensional. The instruction may be output as audio, for example, from the speaker 62. The timing of issuing the instruction may be when the human presence sensor 64 recognizes that the area around the display device 1 has transitioned from being empty to being occupied by a person. Alternatively, the timing of issuing the instruction may be when an unregistered person is detected, or it may be at regular intervals.

[0234] Furthermore, for example, if the display device 1 is capable of performing physics calculations for the movement of multiple parts of a character, it is preferable to prevent the execution of physics calculations for the movement of a particular part of the character (e.g., the chest) when that particular part is relatively small.

[0235] Furthermore, it would be desirable to add motion to the character's body while not adding motion to the character's clothing, and instead control the movement of the clothing using physics calculations in accordance with the character's body movements. This would reduce the computational load in the physics calculations.

[0236] Furthermore, for example, the control unit 70 may display an object on the image display unit 20 to indicate whether or not voice recognition is in progress. For example, the image display unit 20 may be controlled to display an image resembling a lamp that lights up only when voice recognition is in progress. This object may be displayed, for example, on the back side of a specific character and at the edge of the display area of ​​the image display unit 20 in an inconspicuous manner (with relatively inconspicuous brightness, color, shape, size, etc.).

[0237] Furthermore, for example, the control unit 70 may display the words (sentences) recognized by speech recognition on the viewer's side (front side) of a specific character object for a predetermined period of time after speech recognition, and then hide them after the predetermined period has elapsed (see Figures 29 to 35). Then, the control unit may be controlled so that the character begins to speak only after the words (speech recognition results) have been hidden.

[0238] Furthermore, when a three-dimensional image of a character on the stage is displayed, the control unit 70 may display characters with a relatively small depth (for example, a human-shaped character) towards the front of the stage rather than in the center, while displaying characters with a relatively large depth (for example, a cat character) in the center of the stage. Also, for example, when a human-shaped character is displayed, the display control may be configured to emphasize the length of the stage itself to create a sense of depth.

[0239] Furthermore, when the control unit 70 displays an image of a character at a position other than the center of the stage (for example, a position on the front side), it is preferable that when displaying an image of the character rotating, the stage also displays an image of rotating in the same way as the character.

[0240] Furthermore, it would be desirable to display a stage with a relatively large depth, and to show a video of a character moving along the outer edge of such a stage (for example, a video of a cat character walking along the outer edge of a circular stage).

[0241] Furthermore, when the character is walking, it is best to avoid rendering the stage (including roads, etc.) and instead render an image of the character simply stomping in place, with the character's overall position remaining almost unchanged. Then, when the character performs actions other than walking, the stage and other elements should be rendered at the character's feet.

[0242] [Differentiation] Although an example of an embodiment of the present invention has been described above, the present invention is not limited to the above embodiment, and various modifications are possible. For example, the following modifications may be carried out.

[0243] (1) For example, in the display device 1 according to the above embodiment, it is preferable that a plurality (for example, two) of dimming members 30 are further provided in a detachable manner. In this way, the brightness and floating effect of the image displayed in the image display unit 20 can be adjusted without providing a separate adjustment member.

[0244] (2) In addition, in the display device 1 according to the above embodiment and each of its modifications, in addition to the dimming member 30 (see Figure 6) which is inclined with respect to the bottom surface of the housing 10, a dimming member which is perpendicular to the bottom surface of the housing 10 may be further provided.

[0245] (3) In the above embodiment, the gesture sensor 63 (an example of a behavior detection sensor) is positioned on the inner circumferential surface of the housing 10, facing inward towards the housing 10 (see Figure 6), but is not limited to this. For example, the gesture sensor 63 (more specifically, the detection surface of the gesture sensor 63) may be positioned diagonally forward and downward at the top of the opening 5. In this way, even if the gesture made by the observer is made outside the opening 5, the gesture can be detected.

[0246] (4) In addition, for example, in the display device 1 according to the above embodiment and each of its modifications, a transparent display with adjustable transmittance (or transmittance) may be provided. The transparent display may be provided, for example, in the internal space 100 of the housing 10 on the front side (front side) of the dimming member 30. In particular, the transparent display may be tilted in the same manner as the dimming member 30.

[0247] Alternatively, instead of the transparent display, a film with adjustable transmittance (or transparency) may be provided. In this way, it is possible to create an effect in which the stereoscopically displayed character gradually becomes visible.

[0248] (5) In addition, in the display device 1 according to the above embodiment and each of its modifications, a panel into which the viewer's face can be inserted (a so-called face-in-the-hole panel) may be provided near the opening 5. The panel should be positioned so that it can be viewed stereoscopically without glasses. Alternatively, an image may be drawn on the housing 10 side of the panel so that the viewer's face is photographed when their face is inserted into the panel. The captured image may then be uploaded to a social networking service (SNS) as "You when you are looking at me".

[0249] (6) It is also preferable to have a naked-eye stereoscopic display device that instructs the user to close one eye and move their head from side to side to a position where the image is clearly visible, and then open both eyes when the image is clearly visible with one eye closed. Furthermore, if the image appears double when the user opens both eyes at a position where the image is clearly visible with one eye closed, it is preferable to have a naked-eye stereoscopic display device that instructs the user to close one eye again, move their head to either the left or right, and then open both eyes when the image is clearly visible.

[0250] (7) Furthermore, the system may include a printed document containing words that can be voice-recognized by the display device 1, along with the display device 1 according to the above embodiments and each modified example. In addition, the system may be configured such that the printed document containing words that can be voice-recognized by the display device 1 can be placed near the display device 1.

[0251] (8) The system may also be characterized by having a built-in voice recognition device and a display device 1 having a voice directivity in a specific direction (for example, the front direction), and by arranging identical display devices facing in the opposite direction to that specific direction. For example, the two display devices 1 may be arranged so that the openings 5 ​​of each of the two display devices 1 face in opposite directions to each other. In this way, for example, it is possible to avoid the input of the voice of a person using the other display device 1 or the voice output from the speaker 62 of the other display device 1 into one display device 1 (more specifically, the microphone 61 of the display device 1).

[0252] (9) The display method of the image display unit 20 may be a naked-eye stereoscopic method such as a lenticular lens method or a parallax barrier method, or a display method that can be recognized as a three-dimensional image using glasses. The housing of the display device 1 may be a rectangular parallelepiped, a cube, a cylinder, other polyhedrons, a sphere, or other shape. The shapes, structures, dimensions, colors, patterns, arrangements, etc. of the components of the display device 1 described above are merely examples. Some of the components of the display device 1 described above may be omitted, or other components may be added. The display device 1 can be a stationary display device, but it can also be a portable, a head-mounted, or glasses-type display device that can be worn on the viewer's head. In such cases, it is preferable that a common (single) dimming member be placed on the optical path between the image light of the image seen by the viewer's left eye and the image light of the image seen by the viewer's right eye. The opening 5 does not have to be square when viewed from the front, and may be formed in a circular or other shape. The image display unit 20 may be an image display unit that uses organic EL, digital mirror devices, or other display elements as display elements. Even if the image display unit 20 is a display device that has a light source other than a backlight, if there is a possibility that light leakage from the light source will be visible, the presence of a light-reducing member can improve the sense of floating that can be given to the viewer.

[0253] (10) The display device 1 may have one or more image display units other than the image display unit 20. For example, as a second image display unit, a display unit may be provided on all or part of the floor of the internal space 100, with its display surface facing upward (for example, vertically upward). The second image display unit may be, for example, a liquid crystal display, but other types of display units may also be used. The control unit 70 may control the display of one or more image display units other than the image display unit 20. In this case, a stage image may be displayed on the second image display unit, and a 3D character may be displayed on the image display unit 20. In this way, an image-based performance can be performed on the floor of the internal space 100. Alternatively, instead of the second image display unit, a light-emitting element (for example, a light-emitting diode), a light-guiding member, and a light-shielding member may be used to perform the floor performance. In this case, a light-guiding member is placed on the floor of the internal space 100, and a light-shielding member corresponding to a predetermined pattern (for example, a magic circle) is placed on the light-guiding member. When light from a light-emitting element is incident on the light guide member, light is emitted upward from the area of ​​the upper surface of the light guide member where no light-shielding member is placed, and this can be seen by the observer.

[0254] (11) In the above embodiment, voice recognition for interacting with the character displayed on the image display unit 20 is enabled in response to a press operation of the operation unit 41, but the embodiment is not limited to this. For example, when the presence of a person is detected in the detection target area of ​​a human presence sensor (an example of a detection means), such as an all-around microwave Doppler sensor, the control unit 73 may enable the voice recognition. In this way, when the user interacts with the character displayed on the image display unit 20, they do not need to perform an operation to enable voice recognition or utter a trigger word, for example, and communication can be reproduced more naturally.

[0255] In this case, it is preferable that both speech recognition in the speech recognition application within the display device 1 and speech recognition on the speech recognition server be enabled. However, as described below, the activation of speech recognition in the speech recognition application within the display device 1 and the activation of speech recognition on the speech recognition server may be performed in stages. For example, when the presence of a person is detected in the detection target area of ​​the human presence sensor, speech recognition in the speech recognition application within the display device 1 may be enabled, and then, when a voice or greeting from a visual observer is detected by the speech recognition application, speech recognition on the speech recognition server may be enabled.

[0256] Furthermore, if the display device 1 is equipped with a camera or other imaging unit (an example of a detection means), a detection target space may be provided on the front side (opening 5 side) of the display device 1, and the control unit 73 may enable voice recognition when the presence of a person is detected on the front side of the display device 1. In this way, it is possible to more reliably determine that a viewer is about to speak to the character displayed on the image display unit 20 and then enable voice recognition.

[0257] Furthermore, it is preferable that the control unit 73 be configured to activate voice recognition only after a person has been detected in the detection area and user authentication has been successful. The user authentication method should be, for example, an authentication method that does not require user operation (facial recognition, voice recognition, etc.). In this way, if, for example, user authentication is performed on a person other than a registered user registered in the display device 1 and the user authentication fails, voice recognition will not be activated, and the person will not be able to interact with the character displayed on the image display unit 20. Conversely, the character displayed on the image display unit 20 will not react to a person other than a registered user. This can increase the user's attachment to the character.

[0258] Furthermore, if speech other than the words pre-registered in the display device 1 or the dialogue server installed in the external server is detected, speech recognition may be disabled.

[0259] Alternatively, an odor sensor may be used as a means for enabling speech recognition. For example, the odor of a registered user of the display device 1 may be registered in the display device 1 in advance, and speech recognition may be enabled when the odor of the registered user is detected by the odor sensor.

[0260] Furthermore, even if speech recognition is enabled in any of the above manners, for example, the speech of a character (e.g., a 3D character 1100) displayed on the image display unit 20 is not immediately output, and it is preferable that the speech of the character is not output unless the user speaks to the character. For example, the overall control unit 73 preferably does not immediately output the character speech "Welcome back" in response to enabling of speech recognition, but outputs the character speech "Welcome back" on condition that the user speech "I'm home" is detected while speech recognition is enabled. Furthermore, for example, in an interactive system, a branch scenario for reproducing the following dialogue between an observer and a character (e.g., the 3D character 1100) is preferably created. For example, on a weekday, User: I'm home Character: Welcome home~ User: It's so hot Character: You must be tired after being out in this heat the above dialogue is reproduced, and on a holiday, User: I'm home Character: Ah, welcome back User: It's so hot Character: Don't complain—you went out on purpose in this heat User: It was for work, work Character: I'm sorry if that's true, good job today a branch scenario is preferably created such that the above dialogue is reproduced.

[0261] Alternatively, a branch scenario based on the detection result obtained by the odor sensor may be created. For example, User: The food turned out delicious! Character: "Hmm, let me smell it. Sniff, sniff. It smells good!" or "Hmmmm!? Isn't it a bit salty? Take care of your health!" It would be good to recreate a dialogue like this.

[0262] Another example is when an odor is detected by an odor sensor. Character: Sniff, sniff, hmm? What's this smell? User: I burned some aromatherapy oils. Character: Ah, no wonder I felt so relaxed. It would be good to allow for the reproduction of dialogues like the one shown. Furthermore, if the observer's response to the question about the type of smell is not registered in the branching scenario, it would be good if a voice such as "Oh, really?!" is output uniformly as the character's voice.

[0263] (12) The control unit 73 may also continuously record audio for a predetermined period of time (for example, about 15 seconds) and activate speech recognition when a trigger word is detected. For example, the speech recognition application of the display device 1 may be activated at all times (or in response to a press operation of the operation unit 41, etc.), and speech recognition by the speech recognition server may be activated by the detection of a trigger word. In this case, the control unit 73 (specifically, the communication control circuit 706) may send audio data of the audio detected by the microphone 61 (an example of an audio detection means) (for example, audio detected between the start of detection and the end of detection) excluding the trigger word to the speech recognition server. For example, suppose that the user voice "I'm going to Tokyo tomorrow, can you tell me the weather, Rei-tan?" is detected. Here, "Rei-tan," the nickname of the 3D character 1100, is the trigger word. In this case, the control unit 73 sends the voice "I'm going to Tokyo tomorrow, can you tell me the weather, Rei-tan?" which is the detected voice "I'm going to Tokyo tomorrow, can you tell me the weather, Rei-tan?" with the trigger word "Rei-tan" removed, to the voice recognition server.

[0264] Here, for example, if the detected voice "I'm going to Tokyo tomorrow, Rei-tan, can you tell me the weather?" is sent directly to the speech recognition server, the inclusion of "Rei-tan" in the speech recognition result may prevent the dialogue server from accurately extracting the character voice corresponding to the speech recognition result, potentially leading to a disjointed conversation with the user. In contrast, by using the method described above, even if the trigger word is spoken in the middle of a sentence, the voice data excluding the trigger word is sent to the speech recognition server. Therefore, it is possible to suppress the disjointed conversation with the user caused by speech recognition being performed with the trigger word included in the middle of a sentence.

[0265] (13) In addition, when reproducing the interaction between the user and the character displayed on the image display unit 20 in cooperation with the speech recognition server, the following operations may be performed depending on the configuration of the speech recognition server.

[0266] For example, if the speech recognition server is configured to start speech recognition processing only after it has finished receiving the audio data file, the control unit 73 may individually send each audio data file of the audio detected by the microphone 61, before and after the trigger word, to the speech recognition server. For example, among the audio detected between the start and end of detection, the audio data file of the user voice detected before the trigger word (also called the first half of the user voice) may be sent to the speech recognition server before the audio data file of the user voice detected after the trigger word (also called the second half of the user voice).

[0267] In this way, the speech recognition server starts processing the first half of the user's voice without waiting for the second half of the user's voice audio data file to be received. Therefore, speech recognition processing can be performed more efficiently compared to sending a combined audio data file containing both the first and second half of the user's voice to the speech recognition server. As a result, the display device 1 can receive character voices from the dialogue server earlier, and the user's waiting time until a response is received to their voice can be reduced.

[0268] Furthermore, for example, if the speech recognition server is configured to stream audio data from the display device 1 and perform speech recognition processing in real time, it is desirable that the playback speed T1 of the user voice in the first half of the audio data is controlled to be faster than the standard playback speed T0 (T1 > T0) when the first half of the audio data is transmitted to the speech recognition server in real time. For example, the control unit 73 changes the settings on the speech recognition server so that the user voice in the first half of the audio is played 25% faster than the standard playback speed T0, and then transmits the audio data for the first half of the audio. In this way, the speech recognition server can complete the speech recognition processing for the first half of the user voice earlier and start the speech recognition processing for the second half of the user voice earlier compared to when the user voice in the first half is played at the standard playback speed T0. As a result, the display device 1 can receive character voice from the dialogue server earlier, and the user's waiting time until a response is given to the user's voice can be shortened.

[0269] Furthermore, when the voice data of the user's speech in the second half is transmitted to the speech recognition server in real time, it is preferable that the playback speed T2 of the speech in the second half is controlled to be faster than the standard playback speed T0 and slower than the playback speed T1 of the user's speech in the first half (that is, satisfying the relationship T0<T2<T1). For example, the overall control unit 73 adjusts settings such that the user's speech in the second half is played back 10% faster than the standard playback speed T0 on the speech recognition server, and then transmits the voice data of the second half. In this way, both the user's speech in the first half and the user's speech in the second half are streamed faster than the standard playback speed T0, and the speech recognition processing is executed on the speech recognition server. As a result, the user's waiting time until a response to the user's speech is provided can be further shortened. On the other hand, although the user's speech in the second half is played faster than the standard playback speed T0, it is played at a speed slower than the playback speed T1 of the user's speech in the first half. Therefore, a decrease in speech recognition accuracy in the speech recognition system can be suppressed. Accordingly, it is possible to further reduce the user's waiting time while suppressing a decrease in speech recognition accuracy.

[0270] Note that, in a case where speech recognition processing based on streaming playback of voice data is executed in real time on the speech recognition server, for example, although the user's speech detected by the microphone 61 is transmitted to the speech recognition server in real time, it is preferable to perform control such that speech recognition on the speech recognition server is not started until the trigger word speech is detected.

[0271] [Other Modified Examples, Etc.] The above-described embodiments and modified examples are illustrative. It goes without saying that partial replacement or combination of the configurations shown in the above-described embodiments and modified examples is possible, and each component described in the above-described embodiments and modified examples may be combined arbitrarily. For example, the control unit 70 may be configured to execute any one of the processes in the above-described embodiments and modified examples in parallel with other processes (for example, by multitasking or the like).

[0272] Furthermore, the inventions and components described in the means for solving the problem may be further applied to combinations of the components of the above embodiments and each modified example. Similar effects and benefits from similar configurations in multiple embodiments and multiple modified examples will not be mentioned sequentially for each embodiment and modified example. Moreover, the present invention is not limited to the above embodiments. For example, it will be obvious to those skilled in the art that various changes, improvements, and combinations are possible. [Explanation of symbols]

[0273] 1 Display device 5 Openings 10 cabinets 11. Main body of the enclosure 12 Top cover section 20 Image display section 30 Light-reducing member 40 Control section 61 Mike 62 speakers 63 Gesture Sensors 64 motion sensors

Claims

1. A display device for displaying images, A housing having an opening on the first direction side for viewing the image in a light-shielded internal space, An image display unit arranged in the aforementioned internal space, A light-reducing member is positioned on the first direction side of the image display unit, and is spaced apart from the image display unit. Equipped with, The image display unit shows a specific character. Motion detection means capable of detecting the movements of a visual observer, A motion control means that controls the movement of the specific character according to the detection result by the motion detection means, Furthermore, The motion detection means is a motion detection sensor capable of detecting the behavior of an object. The behavior detection sensor is positioned to detect gestures made within the internal space of the housing. The behavior detection sensor is positioned on the upper surface of the inner circumferential surface of the housing. The aforementioned behavior detection sensor emits light, receives the reflected light from the object being detected, and detects the gesture. The system further includes a member provided in the direction of light emission to suppress the emission of light from being received by the behavior detection sensor. Display device.

2. The housing has a cover portion on its upper surface, and a housing space between the cover portion and the upper surface of the inner circumferential surface of the housing. The control unit relating to the display device is located in the housing space, The housing includes a power supply unit located below the internal space of the housing, The connecting cord that electrically connects the power supply unit and the control unit is routed so as to pass through the gap area secured between the outer wall of the housing and the internal space. The display device according to claim 1.

3. The housing has a cover portion on its upper surface, and a housing space between the cover portion and the upper surface of the inner circumferential surface of the housing. The control unit relating to the display device is located in the housing space, The cover portion is attached to the main body portion of the housing at multiple mounting positions, The cover portion and the main body portion are, At the first mounting position on the first direction side among the plurality of mounting positions, the first fastener is used to connect the components at a position inside the outer peripheral wall of the housing. At the second mounting position of the display device, which is on the second direction side opposite to the first direction from the first mounting position, the device is connected from the outside of the outer peripheral wall of the housing using a second fastener. The display device according to claim 1.

Images