Indicating device, etc.
The display device enhances the visual effect and three-dimensional perception by using a light-shielded housing and light reduction member to maintain a dark state, addressing the challenge of enhancing stereoscopic video display visuals.
Patent Information
- Application Number
- JP2024023475
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2020-01-23
- Filing Date
- 2024-02-20
- Publication Date
- 2025-06-30
- Estimated Expiration
- 2040-03-31
AI Technical Summary
Existing display devices struggle to enhance the visual effect of stereoscopic video displays, particularly in maintaining a dark state to enhance the three-dimensional effect.
A display device with a housing that includes a light-shielded video display space and a light reduction member to reduce external light, combined with a video display unit that forms a virtual image, enhancing the three-dimensional effect by maintaining the video display space in a dark state.
The proposed solution effectively enhances the visual effect and three-dimensional perception of the display device by maintaining a dark state and reducing external light interference.
Smart Images

Figure 0007699784000001 
Figure 0007699784000002 
Figure 0007699784000003
Abstract
Description
Technical Field
[0001] The present invention relates to a display device and the like.
Background Art
[0002] Patent Document 1 describes a stereoscopic video display device that does not use special glasses. This stereoscopic video display device includes a light source, a liquid crystal display panel, and a parallax barrier disposed on the observer side of the liquid crystal display panel.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] One of the objects of the present invention is to enhance the visual effect of a display device.
[0005] The object of the invention of the present application is not limited to this, and the applicant also has the intention to obtain rights by means of divisional application, amendment, etc. for a configuration aimed at obtaining an effect exerted by a part of the configuration disclosed in this specification and drawings. For example, the problems obtained by reading the parts described as "can be" in this specification as "are problems" are disclosed in this specification. The problems are described as independent ones, and the applicant also has the intention to obtain rights by means of divisional application, amendment, etc. alone for the configurations for solving each problem. Even if the problems are implicitly grasped from the description of the specification, the applicant has the intention to make a part of the configuration described in this specification the scope of claims by amendment or divisional application. In addition, the configurations for solving the problems obtained by combining these independent problems are also disclosed, and the applicant has the intention to obtain rights.
Means for Solving the Problems
[0006] It is preferable to provide a display device having a housing with a light-shielded video display space inside and a video observation area provided on the first direction side of the video display space, and a video display unit for forming a virtual image in the video display space.
[0007] In this way, since the virtual image combined with the video display space is displayed in a relatively dark space when viewed from the observation side, the three-dimensional effect of the virtual image that can be given to the observer can be enhanced. Therefore, the visual effect of the display device can be enhanced.
[0008] It is preferable to provide a display device having a light reduction member for reducing external light entering the video display space from the observation area.
[0009] In this way, since the external light entering the video display space is reduced by the light reduction member, the video display space can be maintained in a dark state, and the three-dimensional effect of the virtual image that can be given to the observer can be enhanced.
[0010] The video display unit includes a first display unit that emits first image light and an optical system that forms the virtual image based on the first image light. It is preferable to use a display device having a light shielding member on the optical path of the reflected light of the first image light reflected by the light reduction member and between the light reduction member and the optical system.
[0011] In this way, it is possible to suppress the video displayed in the video display space from being observed by the observer due to the first image light being reflected by the light reduction member.
[0012] It is preferable that the light shielding member is provided at a position that does not overlap the observation area when viewed from the first direction side.
[0013] In this way, even when the observer peeks into the video display space from the observation area, it is possible to suppress the video displayed in the video display space from being observed by the observer due to the first image light being reflected by the light reduction member.
[0014] (5) The image display unit includes a first display unit that emits first image light and an optical system that forms the aerial image based on the first image light. The optical system is preferably a display device arranged to avoid an area on the optical path of the reflected light reflected by the light reduction member among the first image light.
[0015] In this way, it is possible to suppress the situation where the image displayed in the image display space due to the first image light being reflected by the light reduction member is observed by the observer.
[0016] (6) The optical system includes an optical member having a first surface on which the first image light is incident and a second surface facing the first surface. The optical member is preferably a display device that reflects the first image light toward the first direction side and transmits the light incident on the second surface toward the first surface side.
[0017] In this way, since it is possible to allow the observer to observe the second surface side of the optical member superimposed on the aerial image combined using the optical member, the three-dimensional feeling of the aerial image that can be given to the observer can be further enhanced.
[0018] (7) The display device preferably has a second display unit that emits second image light that overlaps the aerial image when viewed from the first direction side.
[0019] In this way, the degree of freedom in selecting the image to be observed by the observer superimposed on the aerial image can be increased.
[0020] (8) The display device preferably has a higher light emission luminance of the first display unit than that of the second display unit.
[0021] In this way, due to the difference between the light emission luminance of the first display unit and the light emission luminance of the second display unit, the three-dimensional feeling of the aerial image that can be given to the observer can be further enhanced.
[0022] (9) The first display unit may be a display device that is arranged above the observation area such that the display surface faces downward, and is inclined such that the second direction side opposite to the first direction is lower than the first direction side.
[0023] In this way, an aerial image can be formed using an optical member by the first display unit arranged above the observation area.
[0024] (10) The display surface of the first display unit may be a display device that is inclined at approximately 20 degrees with respect to the horizontal direction.
[0025] In this way, the three-dimensional effect of the aerial image that can be given to the observer can be enhanced, and at the same time, the image displayed in the image display space by the first image light being reflected by the light attenuation member can be made less observable.
[0026] (11) The second display unit may be a display device that is arranged below the observation area such that the display surface faces upward.
[0027] In this way, since the image displayed on the second display surface appears to be located below the aerial image formed in the air, the three-dimensional effect of the aerial image that can be given to the observer can be enhanced.
[0028] (12) The first display unit may be a display device that emits the first image light such that the aerial image is observed on the second display surface.
[0029] In this way, since the aerial image is observed to be located above the image displayed on the second display surface, the three-dimensional effect of the aerial image that can be given to the observer can be enhanced.
[0030] (13) The housing may be a display device that has a first accommodation space above the first display unit and has a processing board arranged on the second direction side in the first accommodation space.
[0031] In this way, the processing substrate can be arranged in a region with a margin in the dimension in the height direction among the first accommodation spaces secured above the first display unit.
[0032] (14) The processing substrate has a mounting portion for detachably attaching an external device, and the mounting portion is preferably a display device that is exposed to the outside of the housing from the second direction side of the housing.
[0033] In this way, it is possible to make it difficult for an observer to observe the portion of the mounting portion for detachably attaching an external device that is exposed to the outside of the housing.
[0034] (15) It has a sensor provided below the observation region, and the processing substrate is preferably a display device that executes processing according to the information measured by the sensor.
[0035] In this way, it is possible to suppress the observation of the aerial image from being hindered by the configuration related to the sensor.
[0036] (16) It has a sensor substrate on which the sensor is mounted, and the sensor substrate is preferably provided in a portion of the housing on the first direction side.
[0037] In this way, it is possible to suppress the observation of the aerial image from being hindered by the configuration related to the sensor.
[0038] (17) The sensor is preferably a display device including a sensor for detecting a gesture.
[0039] In this way, it is possible to suppress the observation of the aerial image from being hindered by the body part of the observer when the observer makes a gesture.
[0040] (18) The housing preferably has a second accommodation space below the video display space, and is provided in the second accommodation space and has a control substrate for supplying a signal from the sensor to the processing substrate.
[0041] In this way, compared with the case where the control board is housed in the first housing space above the first display unit, it is possible to suppress the increase in the dimension above the observation region of the housing.
[0042] (19) It is preferable that the display device includes a wiring part that electrically connects the control board and the processing board, and a partition member that partitions so that the wiring part cannot be observed from the video display space side.
[0043] In this way, it is possible to suppress the wiring part that electrically connects the control board and the processing board from being observed.
[0044] (20) It is preferable that the processing board is a display device that controls the display of the first display unit according to the information measured by the sensor.
[0045] In this way, it is possible to change the aerial video according to the information measured by the sensor.
[0046] (21) It is preferable that the display device includes a viewing angle control member provided on the display surface of the first display unit and narrowing the viewing angle in the first direction side.
[0047] In this way, it is possible to suppress the image displayed on the first display surface from being directly observed by the observer.
[0048] (22) It is preferable that the first image light is the image light of an image recognized as a two-dimensional image.
[0049] In this way, even when the first display unit that displays an image recognized as a two-dimensional image is used, it is possible to give the observer a three-dimensional feeling of the aerial video.
[0050] (23) It is preferable that the housing has a configuration in which a plurality of parts are joined by a fixture, and the fixture is a display device that is not exposed at least from the first direction side.
[0051] By doing so, it is possible to suppress the fixed member from being observed by the observer, and the aesthetic appearance of the display device can be enhanced.
[0052] (24) It is preferable that the display device is configured such that at least a part of the portion facing the video display space is subjected to a process for reducing light reflection.
[0053] By doing so, it becomes easier to maintain the video display space in a dark state, and thus the three-dimensional effect of the aerial video that can be given to the observer can be further enhanced.
[0054] (25) It is preferable that the housing has a portion surrounding the observation region when viewed from the first direction side.
[0055] By doing so, in combination with the aerial video displayed in the video display space and the housing located on the front side thereof, the three-dimensional effect of the aerial video that can be given to the observer can be further enhanced.
[0056] (26) It is preferable that the video display unit is a display device that displays a video of a character showing a cat.
[0057] By doing so, it is possible to display a video of a character showing a three-dimensional cat.
[0058] (27) It is preferable that the video display unit is a display device that changes the video based on a communication function that reproduces communication between the character and an observer who observes the character.
[0059] By doing so, it is possible to change the video of the character showing a cat based on the communication function.
[0060] An odor sensor that detects an odor in (28), a display output operation that causes a character to perform a movement according to the detection result of the odor sensor and displays the video on the video display unit, and an audio output operation that outputs, as a voice uttered by the character displayed on the video display unit, a voice according to the detection result of the odor sensor, and an operation control means for executing at least one of them may be further provided.
[0061] In this way, communication regarding odor between the character displayed on the video display unit and the user can be reproduced. For example, when an odor is detected by the odor sensor, the audio output operation in which the character utters a voice such as "It smells like something" or the display output operation of the video in which the character performs an action of smelling the odor can be controlled to be performed. Therefore, more diverse communication can be achieved between the character and the user.
[0062] (29) The display output operation is an operation of displaying, on the video display unit, a video in which the character displayed on the video display unit performs a movement according to the detected type of odor, and the audio output operation is an operation of outputting, as a voice uttered by the character displayed on the video display unit, a voice according to the detected type of odor.
[0063] In this way, communication regarding the type of odor between the character displayed on the video display unit and the user can be reproduced. For example, when the odor of tobacco is detected, a display output operation of displaying a video in which the character performs a movement of disliking the smell or an audio output operation of uttering words concerned about the user's health can be executed. Also, when the odor of a fragrance such as essential oil is detected, an audio output operation of uttering a question regarding the fragrance can be executed. By performing such control, the range of communication between the character displayed on the video display unit and the user can be widened, and the user's affection for the character can be increased.
[0064] (30) It further includes voice detection means capable of detecting voice and detection means capable of detecting the presence of a person in the detection target area. When the presence of a person in the detection target area is detected, the voice detection means may enable voice recognition for dialogue with the character displayed on the video display unit.
[0065] In this way, when communicating with the character displayed on the video display unit, for example, the user does not need to utter a trigger word to enable voice recognition, and communication can be carried out more naturally.
[0066] (31) It further includes wind detection means for detecting wind, display output operation for displaying on the video display unit a video in which a character makes a movement according to the detection result of the wind detection means, and operation control means for executing at least one of voice output operation for outputting, as the voice uttered by the character displayed on the video display unit, voice according to the detection result of the wind detection sensor.
[0067] In this way, communication regarding the wind applied to the display device can be reproduced between the character displayed on the video display unit and the user. The wind may be, for example, artificially generated by the user, such as the wind generated by moving a body part such as waving a hand towards the display device or the wind generated by blowing.
[0068] (32) The operation control means may perform the display output operation or the voice output operation according to the breath blown by the user based on the detection result of the wind detection means.
[0069] In this way, communication corresponding to the breath blown on the display device can be reproduced between the character displayed on the video display unit and the user.
[0070] The inventions described in (1) to (32) above can be arbitrarily combined. For example, it is preferable to add at least a part of the configuration of at least one of the inventions after (2) to all or part of the configuration of the invention described in (1). In particular, it is preferable to make an invention in which at least a part of the configuration of at least one of the inventions after (2) is added to the invention described in (1). Further, any configuration may be extracted from the inventions described in (1) to (32), and the extracted configurations may be combined. The applicant of the present application has the intention of obtaining rights for inventions including these configurations. Also, even if there is a description such as "in the case of ~" or "when ~", it is not described as a configuration limited to that case or that time. These show examples of better configurations, and the applicant also has the intention of obtaining rights for configurations other than these cases and times. Also, the places described in a sequential manner are not limited to this order. The applicant also discloses configurations in which some parts are deleted or the order is changed, and has the intention of obtaining rights.
Effect of the Invention
[0071] According to the present invention, the visual effect of the display device can be enhanced.
[0072] The effects of the invention of the present application are not limited to this, and the effects exerted by the parts of the configuration disclosed in this specification and the drawings are also disclosed, and the applicant also has the intention of obtaining rights for the configurations that exert such effects by means of divisional applications, amendments, etc. For example, the places described as "can ~" in this specification are descriptions that clearly indicate the effects exerted, and even if there is no description of "can ~", there are parts that indicate the effects. Also, even if there is no such description, there are effects grasped by the said configuration.
Brief Description of the Drawings
[0073]
Figure 1A
Figure 1B
Figure 1C
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13
Figure 14
Figure 15
Figure 16
Figure 17
Figure 18
Figure 19
Figure 20
Figure 21
Figure 22
Figure 23
Figure 24
Figure 25
Figure 26
Figure 27
Figure 28
Figure 29
Figure 30
Figure 31
Figure 32
Figure 33
Figure 34
Figure 35
Figure 36
Figure 37
Figure 38
Figure 39
Figure 40
Figure 41
Figure 42
Figure 43
Figure 44
Figure 45
Figure 46
Figure 47
Figure 48
Figure 49
Figure 50
Figure 51
Figure 52
Figure 53
Figure 54
Figure 55
Mode for Carrying Out the Invention
[0074] Hereinafter, embodiments will be described in detail with reference to the drawings. The following embodiments are examples of the embodiments of the present disclosure, and the present disclosure is not limited to these embodiments. In the drawings referred to in the present embodiment, the same parts or parts having the same function are denoted by the same reference numerals or similar reference numerals (reference numerals with A, B, etc. added after the numbers), and the repeated description thereof may be omitted. Further, in each of the drawings referred to in the following description, the scale may be different from the actual one in order to make each member, each region, etc. recognizable.
[0075] <1. Overview of Display Device 1> FIGS. 1A and 1B are diagrams for explaining the overview of a display device according to an embodiment of the present invention. The display device 1 displays an image so that an observer can observe the image through the observation region SC. In the present embodiment, "observation" may be interpreted in the sense of "seeing" or "viewing". The observer is a user who uses the display device 1, for example, a person who observes an image displayed on the display device 1. The observation region SC is a region provided on the front side of the display device 1, and here it is a rectangular region. The display device 1 displays an image by aerial imaging. Aerial imaging refers to forming an image in the air, for example, by using the reflection of light. Aerial imaging may be adopted to give the observer a feeling that the image floats in a predetermined space. The image displayed by aerial imaging is called an aerial image.
[0076] When shown in Fig. 1A, the display device 1 displays the character 1100 as an aerial image. The character 1100 is a female character. The display device 1 further displays a stage image 2100 meaning a stage under the character 1100. The stage image 2100 shows a magic circle here. An observer who sees such a display can get the impression that the character 1100 is standing on the stage. The colors of the character 1100 and the stage image 2100 are not particularly limited. For example, the skin of the character 1100 is skin-colored. The hair color and the upper body clothing of the character 1100 are relatively light blue colors (e.g., light blue), the ornaments applied to the knees are darker blue colors (e.g., blue), and the skirt and shoes are white. The stage image 2100 is a relatively dark blue color (e.g., dark light blue).
[0077] When shown in Fig. 1B(a), the display device 1 displays the character 1200 as an aerial image. The character 1200 is a cat character. When shown in Fig. 1B(b), the display device 1 displays a stage image 2200 meaning a stage under the character 1200. The stage image 2200 shows a string of characters "Yupiteru" and a string of characters naming the character 1200, "Juno" (referred to as "Yuno"), alternately written along the outer periphery of a circular stage here.
[0078] The colors of the character 1200 and the stage video 2200 are not particularly limited. Here, the character 1200 and the stage video 2200 will be described more specifically with reference to FIG. 1C. The character 1200 is roughly classified into a character main body 1210 and a collar 1220. The character main body 1210 is the cat character itself whose name is "Juno" here. The character main body 1210 includes parts shown in white on the body parts. For example, the parts corresponding to this are the parts around the eyebrows, nose, mouth, abdomen, and the front side parts of the feet. Among the body parts of the character main body 1210, the parts shown in light gray are of a relatively light brown color system (for example, loess color). For example, the parts above and beside the eyes on the face part, the upper part of the torso part, and the parts of the feet other than the front side parts correspond to this. Among the body parts of the character main body 1210, the parts shown in darker gray are of a darker brown color system (for example, brown). For example, the face, head, torso, and the striped parts shown by thin lines on the feet correspond to this. The collar 1220 means the collar displayed at the position of the neck of the character main body 1210. The collar 1220 is of a red color system (for example, red). Among the collar 1220, a tag 1221 is attached at the position under the face of the character main body 1210. The tag 1221 is circular and a predetermined logo is marked on it. The logo is a logo in which a "●" (a circle with the inside filled) is arranged below a "V" - shaped symbol, and each is marked in a red color system (for example, red). The logo marked on the tag 1221 may function as a trademark indicating the origin of the display device 1. The stage video 2200 is entirely of a brown color system. The circle and the character string are of a relatively dark brown color (for example, brown), and the image imitating the smoke inside the circle is of a lighter brown color system (for example, loess color).
[0079] In FIGS. 1A, 1B, and 1C, the backgrounds of the characters 1100 and 1200 are shown in black, but it is not limited to pure black, and a relatively dark background (for example, black or other dark color systems) may also be used.
[0080] The characters shown in FIGS. 1A, 1B, and 1C are examples. When the display device 1 displays a humanoid character, it is not limited to a female character, and a male character may be displayed. The display device 1 may display any of an actual person (for example, a family member), a person who actually existed in the past (for example, a historical figure), or a fictional character (for example, a character appearing in a fictional work such as a comic or an anime). When displaying a non-humanoid animal character, the display device 1 is not limited to a cat character, and may display any of characters of animals that can be raised in a general household such as a dog or a hamster, characters of other animals such as a horse or a cow, and fictional animal characters (for example, characters appearing in a comic, an anime, or other fictional works). Further, the display device 1 may display other characters having the collar 1220.
[0081] Based on the communication function, the display device 1 moves the body parts of the character or outputs a voice imitating the speech of the character. The communication function is a function of reproducing the communication between the observer and the character or a function of reproducing a pseudo-communication. In the communication function, the character moves in response to the behavior of the observer (for example, speech or body movement). For example, the character 1100 performs an action that reproduces an action normally performed by a human, such as moving the whole body like dancing or changing the expression (for example, expressing emotions of joy, anger, sorrow, and pleasure). For example, the character 1200 makes a movement that reproduces an action normally performed by an animal (for example, yawning, wagging the tail, walking, etc.). Further, the display device 1 outputs, for example, a singing voice as if the character 1100 is singing or a voice related to the dialogue with the observer in accordance with the action of the character 1100. The display device 1 outputs, for example, a voice meaning a meow of a cat or a voice related to the dialogue with the observer in accordance with the action of the character 1200. Such output of video and audio is not limited to the communication function, and may be performed by various functions of the display device 1.
[0082] The interaction with the user in the communication function may be realized, for example, by the cooperation of a voice recognition application (an application having the function of a voice recognition engine) incorporated in the display device 1, an external voice recognition server (not shown), and an external dialogue server (not shown). For example, when the operation unit 2214 described later is pressed, the voice recognition application is activated, and voice recognition for dialogue with the character is enabled. Enabling voice recognition means, in this embodiment, operating the voice recognition function, for example, turning on the voice recognition engine to wait for voice input. Then, the voice uttered by the user (also referred to as user voice) is transmitted from the communication control circuit 706 of the processing board 224 described later to the voice recognition server, and the voice recognition server executes voice recognition processing on the user voice and outputs a voice recognition result. For example, in the dialogue server, for each inputtable character string, the voice (also referred to as character voice) uttered by the character (for example, character 1100) displayed on the display device 1 (for example, the video display unit described later) is registered in advance in association with each other. Then, the voice recognition result (for example, the voice recognition result indicated by a character string) by the voice recognition server is input to the dialogue server, and the character voice corresponding to the voice recognition result is output from the dialogue server. Then, the character voice output by the dialogue server is output from the display device 1. In this way, response processing for the voice by the user is executed, and the dialogue between the user and the character is reproduced.
[0083] The display device 1 is used by the general user, for example, as an entertainment display device. In this case, the display device 1 is used, for example, at the residence such as the user's home. However, it is not limited to this, and the display device 1 may be used for commercial use (for example, for advertising) or other purposes. For example, in the case of commercial use, the display device 1 is installed in a public place such as a store or other commercial facility. The display device 1 may display a video in which a character introduces or advertises a product or service at a venue such as an exhibition of products or services. The use of the display device 1 may be other uses than these.
[0084] <2. External Configuration of Display Device 1> Figs. 2, 3, and 4 are perspective views showing the external configuration of the display device 1. Fig. 2 is a view of the display device 1 seen from the front right obliquely. Fig. 3 is a view of the display device 1 seen from slightly above on the front left obliquely. Fig. 4 is a view of the display device 1 seen from slightly below on the front right obliquely. Fig. 5 is a front view of the display device 1. Fig. 6 is a right side view of the display device 1. Fig. 7 is a front side view of the display device 1. Fig. 8 is a plan view (top view) of the display device 1. Fig. 9 is a bottom view of the display device 1. Fig. 10 is a rear view of the display device 1.
[0085] The display device 1 has a rectangular parallelepiped appearance. The display device 1 has a housing 100. The housing 100 is a box-shaped member forming the outer shape of the display device 1. The housing 100 is rectangular parallelepiped-shaped. The housing 100 is longer in the height direction (also referred to as the vertical direction) than in the width direction (also referred to as the left-right direction). The lengths of the width direction and the depth direction (also referred to as the front-rear direction) of the housing 100 are substantially the same. The ratio of the lengths of the width direction, the height direction, and the depth direction (also referred to as the front-rear direction) of the display device 1 is approximately 2:3:2. In the following description, among the depth direction of the display device 1, the side on the observer side is referred to as the "front side" (corresponding to the first direction side), and the opposite side is referred to as the "rear side" (corresponding to the second direction side).
[0086] The housing 100 has R-shaped corners. As shown in FIG. 5, when the display device 1 is viewed from the front side, the four corners of the housing 100 are each rounded. The surface of the housing 100 is preferably processed to give a texture by matte finishing. In this way, a rectangular parallelepiped display device 1 with excellent design is provided. The housing 100 is preferably formed of a resin material, but may be formed of metal or other materials. The housing 100 has a light-shielded video display space inside. The video display space is a space inside the housing 100 where the aerial video is displayed (formed). Most or all of the video display space is formed of light-shielding members. Therefore, the members constituting the housing 100 prevent external light from entering the video display space. The housing 100 may be formed of a material that blocks external light entirely, for example, or the outer surface or the surface facing the video display space may be covered with a material that blocks light. The color of the outer surface of the housing 100 is not limited, but it is preferably white, black, or the like that gives a sense of luxury or simplicity. The display device 1 preferably has dimensions and a weight such that a person such as an observer can carry it alone.
[0087] The portions of the housing 100 that are exposed on the outside are divided into a right panel 101, a front panel 102, a left panel 103, a rear panel 104, an upper lid portion 105, and a lower lid portion 106. The right panel 101, the front panel 102, the left panel 103, the rear panel 104, the upper lid portion 105, and the lower lid portion 106 are plate-like members. The right panel 101 is a panel located on the right side surface of the housing 100 when viewed from the front side. The left panel 103 is a panel located on the left side surface of the housing 100 when viewed from the front side. The right panel 101 and the left panel 103 have the same shape and the same dimensions. Also, the right panel 101 and the left panel 103 are symmetric in the height direction, and the molds for forming the right panel 101 and the left panel 103 can be shared. For this reason, the right panel 101 and the left panel 103 can use common members, and an effect of reducing costs and the labor of assembly work can be expected.
[0088] The front panel 102 is located on the front side of the display device 1. The front panel 102 has an opening 110 where the light reduction member 200 can be mounted. The observation area SC is provided on the front panel 102. The observation area SC is the area that an observer who views the video displayed on the display device 1 observes. The observation area SC is also the area where the opening 110 formed in the housing 100 exists. The light reduction member 200 is provided in the observation area. The light reduction member 200 is provided vertically so as to block the opening 110. The light reduction member 200 and the opening 110 are provided above the center in the height direction of the housing 100 when viewed from the front side of the display device 1. The light reduction member 200 and the opening 110 are square or rectangular.
[0089] The light reduction member 200 includes a first region 210 in the shape of a rectangle (which may be square) used for observing the video, and a second region 220 surrounding the periphery of the first region 210. Since the second region 220 is an area not used for observing the image at the edge portion, it may be an area that does not transmit light. Therefore, the observation area SC can also be said to be the area where the first region 210 exists. In the following description, when referring to the light reduction member 200, it may be regarded as the first region 210.
[0090] The light reduction member 200 is an optical member that reduces external light entering the video display space from the observation area SC. The light reduction member 200 is provided to maintain the video display space in a dark state. The light reduction member 200 is provided to suppress the occurrence of reflection where the observer himself / herself is reflected in the observation area SC and to make the internal components of the video display space less visible to the observer. The light reduction member 200 is a plate-shaped (including panel-shaped) member, but may also be a member called a sheet-shaped or film-shaped member. The light reduction member 200 may be a member called a smoke panel or a smoke film. For example, the light reduction member 200 has a light transmittance of 24% and a thickness of about 2 mm. The light reduction member 200 has a light transmittance that does not interfere with the observation of the video displayed in the video display space of the display device 1. The light reduction member 200 is a semi-transparent member in a dark color system such as black, but may also be a blue color or other colors.
[0091] The information area ST is provided below the observation area SC (dimming member 200 and opening 110) in the front panel 102. The information area ST is located in an opening formed in the front panel 102. The information area ST is an area for collecting predetermined information using a sensor or presenting predetermined information to an observer. As electronic components provided in the information area ST, there are a first sensor 2331, a second sensor 2332, a microphone 2333, and a light emitting unit 2334. The first sensor 2331 is a gesture sensor that detects gestures made by an observer. The second sensor 2332 includes one or more sensors other than the gesture sensor. Examples of the sensors of the second sensor 2332 include a gas sensor (odor sensor), a temperature sensor, and an illuminance sensor. The microphone 2333 picks up sound and converts the picked-up sound into an audio signal. The light emitting unit 2334 presents predetermined information by emitting light. The light emitting unit 2334 includes, for example, a light emitter (e.g., a light emitting diode) that emits light in a predetermined color and a light guiding member that guides the light emitted by the light emitter. In the present embodiment, the light guiding member of the light emitting unit 2334 is arranged so as to surround the area where the first sensor 2331, the second sensor 2332, and the microphone 2333 are provided. The light emitting unit 2334 emits light in, for example, a blue-based color (e.g., light blue), but may be configured to emit light in one or more colors such as a green-based color, a red-based color, or other colors. The light emitting unit 2334 is not limited to a configuration having a light guiding member, and may emit light in a predetermined area, for example, by a configuration having a plurality of light emitters.
[0092] The operation area OT is provided on the upper lid portion 105. The operation area OT is an area for receiving operations performed by an observer. The operation area OT is an area where the operation units 2211, 2212, 2213, and 2214 are provided. The operation units 2211, 2212, 2213, and 2214 are switches that receive pressing operations respectively. The operation unit 2211 is operated when instructing to turn on or off the power of the display device 1. The operation unit 2212 is operated when instructing to increase the volume. The operation unit 2213 is operated when instructing to decrease the volume. The operation unit 2214 is operated when instructing to execute a predetermined function. The operation unit 2214 may be, for example, an operation unit called a special key. The operation unit 2214 may be operated, for example, when instructing the start of voice recognition on the display device 1. On the upper lid portion 105, openings are provided corresponding to the positions where each of the operation units 2211, 2212, 2213, and 2214 is provided. The operation units 2211, 2212, 2213, and 2214 are exposed to the outside by being located in the respective openings. Note that the number of operation units described here, the functions assigned to the operation units, and the acceptable operation methods are examples.
[0093] The human presence sensor 234 is provided on the lower lid portion 106. The human presence sensor 234 is exposed to the outside by being located in the opening of the lower lid portion 106. The human presence sensor 234 is a detection unit that detects the presence of a person (moving object) in the detection target space. In this embodiment, the human presence sensor 234 is a microwave Doppler sensor, which emits microwaves and detects the presence of a person in the detection target space based on the reception intensity of the microwaves, which are the reflected waves. For example, the human presence sensor 234 detects whether a person is present on the front side of the display device 1.
[0094] On the back panel 104 of the display device 1, a power jack 2311 and a rear cover portion 1041 are provided. The power jack 2311 is a jack to which a power cord is connected. The power jack 2311 receives power supply from an external power source or the like via the power cord. The rear cover portion 1041 is a removable cover portion. When the rear cover portion 1041 is removed, as shown in FIG. 11, a slot 222 and a USB (Universal Serial Bus) connector 223 are exposed. The slot 222 is a mounting portion where an external storage medium is mounted. The external storage medium corresponds to, for example, the microSD (registered trademark) standard, but may also correspond to standards related to microSDHC or other SD cards or other standards. The USB connector 223 is a mounting portion where a USB cable or a USB port of an external device compliant with the USB standard is mounted. In the display device 1, data can be input and output to and from an external device via the slot 222 and the USB connector 223. The number of mounting portions may be even more. Since the portions of the slot 222 and the USB connector 223 that are exposed outside the housing are on the back side of the display device 1, they can be made difficult to be observed by an observer. Also, the number of mounting portions where an external device is mounted and the corresponding standards are not particularly limited.
[0095] The housing 100 is configured by combining a right panel 101, a front panel 102, a left panel 103, a back panel 104, an upper cover portion 105, and a lower cover portion 106. In the present embodiment, as a coupling method, screwing using screws, which are an example of fixtures, is adopted. However, there are no screwed portions on the front panel 102 and the upper cover portion 105.
[0096] On the right panel 101, it is screwed at two upper and lower positions on the front side by screws 710 and 720. On the left panel 103 of the housing 100, it is screwed at two upper and lower positions on the front side by screws 730 and 740. On the rear panel 104, it is screwed at three upper positions by screws 751, 752, and 753, screwed at two positions near the center in the height direction by screws 754 and 755, and screwed at three lower positions by screws 756, 757, and 758. On the lower lid part 106, it is screwed at two positions on the front side by screws 761 and 762. The front panel 102 and the upper lid part 105 are parts that are relatively easy to observe by an observer using the display device 1. On the other hand, the other parts are parts that are relatively difficult to observe by an observer using the display device 1. Therefore, according to the display device 1, it is possible to suppress the screwing positions from being observed by the observer and maintain the aesthetic appearance of the display device 1. Doing so can also contribute to giving the observer a sense of immersion in the video.
[0097] FIG. 12 is a diagram for explaining an example of how the display device 1 is used by an observer. FIG. 12 shows the positional relationship between the display device 1 and the observer U using it as viewed from the left side surface of the display device 1. The display device 1 is placed on the desk 3000. A chair 3100 is arranged on the front side (front side) of the display device 1. The observer U is seated on the chair 3100 facing the direction of the display device 1. In this example, the position of the observer U's eyes is higher than the upper surface of the display device 1. For this reason, the observer U observes by looking down at the observation area SC at an angle θ. The angle θ is the angle between the horizontal direction and the line-of-sight direction of the observer U. The angle θ is within the range of θ1 or more and θ2 or less. The angle θ is, for example, 15 degrees. The horizontal distance between the observer U and the observation area SC is approximately 50 cm.
[0098] <3. Principle Regarding the Display of the Display Device 1> FIG. 13 is a diagram for explaining the principle related to the display of the display device 1. FIG. 13 shows a schematic diagram when the inside of the display device 1 is viewed from the left side of the display device 1. In the video display space S1 inside the housing 100, a first display unit 310, an optical member 320, and a second display unit 330 are provided. A video display unit that forms a virtual image in the video display space S1 is configured by the cooperation of the first display unit 310 and the optical member 320.
[0099] The first display unit 310 and the second display unit 330 are display units that display images. The first display unit 310 and the second display unit 330 are display units having light sources, for example, liquid crystal displays. The light source is a backlight. The first display unit 310 and the second display unit 330 display color (multi-color) images based on the three primary colors of red (R), green (G), and blue (B). The first display unit 310 and the second display unit 330 display images recognized as two-dimensional images in the present embodiment.
[0100] The first display unit 310 is an 8-inch liquid crystal display. For example, in this case, the first display unit 310 includes a backlight, which is an example of a light source, and a display body in which liquid crystal elements, which are examples of display elements, are two-dimensionally arranged. The light source is, for example, a white light source. The liquid crystal element modulates the light from the backlight in pixel units. The liquid crystal element has a configuration in which, for example, liquid crystal molecules are sandwiched between a pixel electrode provided in pixel units and a common electrode common to a plurality of pixels. The first display unit 310 has a first display surface 311 that emits the first image light L1. The first display unit 310 emits image light for displaying the characters 1100 and 1200 in FIGS. 1A to 1C. The first display unit 310 is arranged to be inclined such that one end on the observation region SC side is positioned above the observation region SC and the back side is lower. This inclination is equal to the inclination of the first display surface 311 and is approximately 20 degrees with respect to the horizontal plane. By inclining approximately 20 degrees in this way, the inventor has obtained the knowledge that the three-dimensional effect of the aerial image that can be given to the observer can be enhanced, and the virtual image formed in the image display space by the first image light L1 being reflected by the light attenuation member 200 can be made less observable. The basis for this will be described later. However, this angle is an example. In the width direction of the display device 1, the height of each position of the first display surface 311 is the same.
[0101] The optical member 320 is an example of an optical system that forms an aerial image based on the first image light L1 from the first display unit 310. The optical member 320 has light transmissivity and reflectivity. The optical member 320 is plate-shaped. Here, the optical member 320 is a half mirror. The optical member 320 is made of acrylic mirror and has a light transmittance of about 30%. The thickness of the optical member 320 is about 2 mm. The light transmittance is just an example and may be 6% for example, as long as the transmittance is ensured to a degree that an observer can observe the aerial image displayed in the video display space S1. The optical member 320 is disposed inclined with respect to the opening 110 and the first display surface 311 in the video display space S1. The tip of the optical member 320 on the observation region SC side is located below the observation region SC and is inclined so that the back side is at a higher position. This inclination is 35 degrees with respect to the horizontal plane. However, this angle is just an example. In the width direction of the display device 1, the height of each position of the optical member 320 is the same.
[0102] The second display unit 330 is a 7-inch liquid crystal display. The second display unit 330 has a second display surface 331 that emits second image light L2 of the displayed image. In FIGS. 1A and 1B, the second display unit 330 displays a video V2 corresponding to the stage videos 2100 and 2200. The second display unit 330 is disposed such that the normal direction of the second display surface 331 faces upward. The second display surface 331 is located on the back side of one end on the lower side of the optical member 320. A pedestal portion 400 is provided on the front side of the second display surface 331. The pedestal portion 400 is a part of the member that constitutes the video display space S1 of the housing 100. The upper surface of the pedestal portion 400 is located at approximately the same height as the second display surface 331, but the second display surface 331 may be slightly lower.
[0103] Under the above configuration, the first image light L1 emitted by the first display unit 310 is incident on the first surface 321 of the optical member 320 at a predetermined angle. The incident first image light L1 is reflected by the optical member 320 toward the front side of the display device 1 at the predetermined angle. Due to this reflected light L1r, the aerial image V1 is recognized in the video display space S1 of the housing 100. The aerial image V1 is a virtual image recognized below the tip of the back side of the first display surface 311, for example, below the position of the intersection of the first display surface 311 and the optical member 320.
[0104] The second image light L2 emitted by the second display unit 330 is incident on the second surface 332 of the optical member 320 and transmitted to the first surface 321 side. The second image light L2 directly enters the eyes of the observer. The video V2 of the second display surface 331 is a real image recognized as being located below the aerial image V1. For example, the aerial image V1 is recognized at the center in the front-rear direction of the second display surface 331. In this way, the aerial image V1 is recognized as the characters 1100 and 1200 shown in FIGS. 1A to 1C, and the video V2 is recognized as the stage videos 2100 and 2200 shown in FIGS. 1A to 1C. According to the display device 1, by allowing the observer to observe the aerial image V1 combined using the optical member 320, a three-dimensional effect of the video can be given to the observer, and further, by allowing the observer to observe the video V2 below it, the three-dimensional effect can be enhanced. Also, by using the second display unit 330, the degree of freedom in selecting the video to be observed by the observer together with the aerial image can be increased as compared with the case where a light emitter and a light guide member are combined to emit light in a pattern of a predetermined pattern.
[0105] It is desirable that a viewing angle control member 312 for narrowing the viewing angle to the front side be provided on the first display surface 311 of the first display unit 310. In this way, even when the observer approaches the observation area SC and looks up, it is possible to suppress the image displayed on the first display surface 311 from being directly observed by the observer. Regarding the second display surface 331, a viewing angle control member for narrowing the viewing angle to the front side is not provided so that the observer can easily observe the video V2.
[0106] The basic display principle of the display device 1 is as described above. Further, as a configuration for enhancing its visual effect, the display device 1 has a light reduction member 200 and a light shielding member 500. Their actions and effects will be described later.
[0107] <4. Internal Configuration of Display Device 1> Next, the internal configuration of the display device 1 will be described. FIGS. 14, 15, 16, 17, and 18 are views showing a state in which the right panel 101, the front panel 102, the left panel 103, and the rear panel 104 of the housing 100 are removed. As shown in FIG. 14, when the right panel 101 is removed, the right internal panel 107 is exposed. As shown in FIG. 15, when the front panel 102 is removed, the front internal panel 108 is exposed. As shown in FIG. 16, when the left panel 103 is removed, the left internal panel 109 is exposed. As shown in FIG. 16, when the rear panel 104 is removed, the wiring portion 800 and the partition member 900 are exposed.
[0108] The right internal panel 107 and the left internal panel 109 hold the first display portion 310 and the optical member 320 described in FIG. 13 by sandwiching them from both the left and right sides.
[0109] The screws 710 and 720 shown in FIGS. 2, 4, and 6 sequentially pass through the holes H1 and H2 passing through the right panel 101, the front internal panel 108, and the right internal panel 107 to couple them. The screws 730 and 740 shown in FIGS. 3 and 7 sequentially pass through the holes H3 and H4 passing through the left panel 103, the front internal panel 108, and the left internal panel 109 to couple them. The screws 751, 752, and 753 shown in FIG. 10 fix the rear panel 104 and the upper lid portion 105. The screw 754 couples the rear panel 104 and the right panel 101. The screw 755 fixes the rear panel 104 and the left panel 103. The screws 765, 765, and 757 fix the rear panel 104 and the lower lid portion 106.
[0110] Figures 19, 20, 21, 22, 23, and 24 are views showing the state in which the right internal panel 107 and the left internal panel 109 are further removed. FIG. 19 is a view showing how the display device 1 looks when viewed from the right side. FIG. 20 is a view showing how the display device 1 looks when viewed from the left side. FIG. 21 is a view showing how the display device 1 looks when viewed obliquely downward from the right side. FIG. 22 is a view showing how the display device 1 looks when viewed obliquely upward from the right side. FIG. 23 is a view showing how the display device 1 looks when viewed obliquely downward from the left side. FIG. 24 is a view showing how the display device 1 looks when viewed obliquely upward from the left side.
[0111] Inside the housing 100, a first display unit 310, an optical member 320, a second display unit 330, a pedestal unit 400, and a light-shielding member 500 are provided. The first display unit 310, the optical member 320, the second display unit 330, and the pedestal unit 400 have the same configuration as described with reference to FIG. 13.
[0112] The light-shielding member 500 is provided on the optical path of the reflected light of the first image light L1 from the first display unit 310 that is reflected by the light-reducing member 200. The light-shielding member 500 covers one end side of the optical member 320 on the side of the light-reducing member 200 (observation region SC), in other words, the end side far from the first display unit 310, so as to prevent this reflected light from entering the optical member 320. The light-shielding member 500 is, for example, a member that absorbs visible light, but any member that can prevent the transmission of the first image light L1 is acceptable. The light-shielding member 500 is preferably, for example, black or another dark color system, but other colors are also acceptable. The reason for this will be described later, but it is to suppress the situation where the image (virtual image) formed in the video display space S1 by the reflection of the first image light L1 by the light-reducing member 200 is observed by the observer. In particular, it suppresses the observation of an image that may be observed when the observer observes the video by peeping into the video display space S1 from the observation region SC. In addition to this image, it also suppresses the observation of external objects such as the ceiling. The upper surface of the light-shielding member 500 is substantially horizontal, but it is not limited to this.
[0113] Above the first display unit 310, a first plate 601 is provided, and above the first plate 601, a first accommodation space S2 (see FIGS. 19 and 20) for accommodating various components is formed. Also, below the second display unit 330, a second plate 602 is provided, and below the pedestal unit 400 and the second plate 602, a second accommodation space S3 (see FIGS. 25 to 27) for various components is formed.
[0114] As shown in FIGS. 17 to 24, the first accommodation space S2 is a space separated from the video display space S1 by a first plate 601 provided on the first display unit 310. The first plate 601 is coupled to the right inner panel 107 using screws 791, 792, 793 and to the left inner panel 109 using screws 794, 795, 796. In the first accommodation space S2, an operation substrate 221, a processing substrate 224, speakers 2251, 2252, and a holding unit 226 are provided. The operation substrate 221 is a substrate on which operation units 2211, 2212, 2213, 2214 are mounted on the surface. The operation substrate 221 supplies signals corresponding to the operations of the operation units 2211, 2212, 2213, 2214 to the processing substrate 224. The processing substrate 224 functions as a processing substrate that controls the display device 1. The processing substrate 224 may be referred to as a main substrate. The processing substrate 224 is electrically connected to the operation substrate 221 and the speakers 225A, 225B, for example, via a printed wiring board (e.g., FPC). The processing substrate 224 is located on the back side of the first accommodation space S2 in the depth direction of the display device 1. The processing substrate 224 is a so-called SoC substrate and operates a processor and an OS (Operating System). The processing substrate 224 reads signals from sensors mounted on the sensor substrate 233 and voice signals from the microphone 2333 by the OS, or acquires signals corresponding to the operations of the operation units 2211, 2212, 2213 from the operation substrate 221. The processing substrate 224 performs control for displaying video on the first display unit 310 and the second display unit 330. Slots 222 and USB connectors 223 are mounted on the processing substrate 224 and are exposed from the back side of the display device 1.
[0115] The speakers 2251 and 2252 are provided on both the left and right sides when viewed from the front side, and emit sound to the outside through the openings 1051 and 1052 formed in the upper lid portion 105. It is desirable that the speakers 2251 and 2252 are not placed too far from the processing substrate 224. It is desirable that the speakers 2251 and 2252 are spaced apart so that their sounds do not interfere with each other as much as possible.
[0116] The holding portion 226 is provided at a position overlapping the processing substrate 224, and holds the processing substrate 224 on its lower surface. A heat sink 2261 for heat dissipation or heat absorption is provided on the upper surface of the holding portion 226 on the side opposite to the side holding the processing substrate 224. The first display portion 310 and the first plate 601 are inclined so as to descend from the front side to the back side. For this reason, the first accommodation space S2 has gradually increasing dimensions in the height direction from the front side to the back side, and there is more margin in the height direction on the back side. By utilizing this, members having a thickness such as the processing substrate 224 and the holding portion 226 are accommodated. In this way, it is possible to suppress the upper housing portion from becoming longer than the observation region SC, contributing to weight reduction and miniaturization of the display device 1, and also being desirable in terms of design.
[0117] FIGS. 25, 26, and 27 are diagrams showing the internal configuration of the display device 1 when the lower lid portion 106 is removed. A second plate 602 is provided below the pedestal portion 400 and the second display portion 330. A second accommodation space S3 is formed between the second plate 602 and the lower lid portion 106. The second accommodation space S3 is provided with a control board 231, a wiring 232, a sensor board 233, and a human sensor 234. The front-side internal panel 108 is coupled to the second plate 602 using screws 771, 772, 773, and 774. The front-side internal panel 108 is coupled to the lower lid portion 106 using screws 775, 776, and 777. The front-side internal panel 108 is fixed using screws 771 to 777, but in the situation where the display device 1 is used, since it is covered by the front-side panel 102, the screws 771 to 777 are not exposed on the front side.
[0118] The control board 231 controls the supply of power and signals to the display device 1. The control board 231 is electrically connected to the processing board 224 via the wiring part 800, and exchanges various signals and supplies power to the processing board 224. The control board 231 is electrically connected to the sensor board 233 and the human presence sensor 234 via the wiring 232. The wiring 232 is, for example, a printed wiring board (e.g., FPC).
[0119] The sensor board 233 is a board on which the first sensor 2331, the second sensor 2332, and the microphone 2333 are mounted. The sensor board 233 is provided in a region below the light reduction member 200 (observation region SC) on the back side surface of the front side inner panel 108. The sensor board 233 is erected vertically so that its board surface extends in the height direction and the width direction. The sensors on the sensor board 233 may be those that detect predetermined information. The first sensor 2331 is an optical sensor that emits light (e.g., infrared light) to the front side and detects the gesture of an observer by receiving the reflected light. The microphone 2333 picks up sound and outputs a sound signal indicating the picked-up sound. The gas sensor as the second sensor 2332 detects odors such as gas odor and burning odor. The temperature sensor detects temperature. The illuminance sensor detects illuminance. The first sensor 2331 is located approximately at the center in the width direction of the information region ST. The sensor board 233 outputs signals from the first sensor 2331, the second sensor 2332, and the microphone 2333 to the control board 231 via the wiring 232. The processing board 224 controls the light emission of the light emitting part 2334 when voice recognition is possible via the wiring part 800 and the control board 231.
[0120] The human presence sensor 234 is arranged at a predetermined interval of about 30 cm or the like on the back side of the front side inner panel 108 so as not to contact the front side inner panel 108. Doing so is desirable for ensuring the detection sensitivity of the human presence sensor 234. The human presence sensor 234 is provided slightly on the front side from the middle in the depth direction. The human presence sensor 234 outputs a signal indicating the detection result to the control board 231.
[0121] The wiring section 800 includes a power line 810, a signal line 820, and a signal line 830. The wiring section 800 is routed from the lower side to the upper side of the housing 100. The wiring section 800 passes between the rear panel 104 and the partition member 900. The control board 231 supplies power to the processing board 224 via the power line 810. The control board 231 exchanges signals with the processing board 224 via the signal line 820. The processing board 224 supplies a signal (for example, a driving signal or a video signal) for driving the second display section 330 via the signal line 830. The power line 810, the signal line 820, and the signal line 830 are provided so as to pass through a space region between the partition member 900 and the rear panel 104. A background plate 910 is provided on the front side of the partition member 900. The background plate 910 is a dark color such as black, for example. The partition member 900 is formed in a plate shape using, for example, a resin material and is a member that does not transmit light. In this way, the wiring section 800 is not observed from the video display space S1 side.
[0122] The processing board 224 functions as operation control means for controlling the displays of the first display unit 310 and the second display unit 330 or controlling the audio outputs from the speakers 2251 and 2252 based on the communication function. For example, the processing board 224 controls the displays of the first display unit 310 and the second display unit 330 or controls the audio outputs from the speakers 2251 and 2252 according to the information measured by the sensor board 233 and the human presence sensor 234. For example, when the processing board 224 detects the presence of a person based on the human presence sensor 234, it may cause the character to greet or output the voice of the character. When a gesture such as moving left and right, up and down, waving goodbye, or forward and backward is detected by the first sensor 2331 as a hand wave, the processing board 224 controls the display of the first display unit 310 or controls the audio output from the speakers 2251 and 2252. For example, the processing board 224 rotates the character in that direction according to the left - right or up - down hand wave. When a waving - goodbye gesture is detected, the processing board 224 causes the character to wave goodbye. When a gesture of moving the hand forward and backward is detected, the processing board 224 returns the display of the character to the default (e.g., FIGS. 1A - 1C). The processing board 224 changes the display of at least one of the first display unit 310 and the second display unit 330 according to the illuminance measured by the illuminance sensor. For example, when the surroundings of the display device 1 become dark, the processing board 224 may darken the display. The processing board 224 may also perform control such as moving the eyes of the character based on the illuminance sensor. The processing board 224 controls the display of the first display unit 310 or controls the audio output from the speakers 2251 and 2252 according to the temperature detected by the temperature sensor. The processing board 224 changes the speech content of the character according to whether the surroundings of the display device 1 are hot or cold. Also, the processing board 224 controls the light emission of the light - emitting unit 2334. The processing board 224 changes the volume according to the operations of the operation units 2211, 2212, 2213, and 2214. Note that the voice engine may be realized by the function of the processing board 224 or may be realized by an external recognition server.In the latter case, the processing substrate may have a communication module for performing wireless LAN or network communication such as Wi-Fi, and communicate with the speech recognition server via the communication module.
[0123] The processing substrate 224 makes the emission luminance of the light source of the first display unit 310 brighter than the emission luminance of the light source of the second display unit 330. This is because the inventor has obtained the knowledge that by doing so, the three-dimensional effect of the aerial image that can be given to the observer can be further enhanced due to the difference between the emission luminance of the first display unit 310 and the emission luminance of the second display unit 330. Since the three-dimensional effect may be impaired if the video display space S1 is bright, the emission luminance of the second display unit 330 is lowered.
[0124] The first display unit 310 is inclined at approximately 20 degrees with respect to the horizontal direction. This is to prevent the situation where the observer may assume a posture of peering in when sitting on a chair, or to prevent display defects from occurring in combination with the display of the second display unit 330. By doing so, the entire display device 1 can be seen even when the observer views it from slightly above. Therefore, the observer does not need to assume a posture of peering in.
[0125] By doing so, it is possible to prevent the ceiling from being reflected by the optical member 320 and observed by the observer, or from overlapping with the image on the second display surface 331 and making the aerial image look less clear. The operation will be described. As shown in FIG. 28, it is assumed that the first image lights L31 and L32 are incident on the light attenuation member 200. In this case, the respective reflected waves L31r and L32r of the first image lights L31 and L32 are emitted from the light attenuation member 200 and further reflected by the optical member 320, so that the observer observes the video V3, which is a virtual image. For example, when the first display unit 310 displays an image of a character, the lower part of the character, for example, the image near the feet, may be observed. Also, as shown in FIG. 29, light L4 is incident on the light attenuation member 200 from the ceiling, lighting, etc., passes through it, and is further reflected by the optical member 320, resulting in the reflection of the ceiling near the lower end of the optical member 320. In this way, the display quality of the display device 1 may be affected by the observation of images other than the original aerial image V1.
[0126] Therefore, by disposing the light shielding member 500 on the optical path of the reflected light in the light dimming member 200 and on the optical path of the light L4 from the ceiling, lighting, etc., the display of the video V3 and the reflection of the ceiling, etc. are suppressed. As shown in FIG. 30, by providing the light shielding member 500, the reflection in the optical member 320 is suppressed, so that the display of the video V3 and the reflection of the ceiling are suppressed. Since the light shielding member 500 is below the observation region SC and the light dimming member 200 also exists, it is difficult for the observer to recognize the existence of the light shielding member 500. For example, assuming that the horizontal distance between the observer and the observation region SC is 50 cm and the angle θ at which the observer's line of sight is incident is 35 degrees, the light shielding member 500 is provided on the optical path of the light related to the video V3 and the reflection. As shown in FIG. 31, if the inclination angle of the first display unit 310 is 10 degrees, the position of the video V3 is displayed more on the back side, and the video V3 becomes easier to observe. To suppress this, it is necessary to extend the light shielding member 500 further to the back side, which is not desirable. Therefore, it is desirable that the inclination angle of the first display unit 310 is 20 degrees.
[0127] According to such a purport, even without using the light shielding member 500, the optical member 320 may be disposed while avoiding the region on the optical path of the reflected light reflected by the light dimming member 200 in the first image light L1. In this way, it is possible to suppress the virtual image formed in the video display space by the first image light L1 being reflected by the light dimming member from being observed by the observer.
[0128] Also, the observer makes a gesture near the first sensor 2331 which is a gesture sensor. In this case, if the first sensor 2331 is above the observation region SC, the hand making the gesture may get in the way, and the observation of the video via the observation region SC may be hindered. In the present embodiment, since sensors such as the first sensor 2331 are provided below the observation region SC, even when making a gesture while observing the observation region SC, the observation can be suppressed from being hindered.
[0129] The reason for darkening the virtual image display space S1 is to make the virtual image in the air look more three-dimensional. For example, when a specific character is displayed, the floating feeling of the character can be obtained because the surroundings are dark. Also, when viewed from the front side, the periphery of the observation area SC is surrounded by the housing 100 (front panel 102). In this way, the combination of the virtual image displayed in the virtual image display space and the housing located in front of it can enhance the three-dimensional feeling of the virtual image that can be given to the observer.
[0130] The part facing the virtual image display space S1 is subjected to a process of reducing light reflection (for example, matte finish). In this way, even if external light or other light enters the virtual image display space S1, the reflection is suppressed, so it is easy to maintain a dark state. It is possible to prevent the internal space from becoming bright. Such a process may be performed on part or all of the frames of the background plate 910, the pedestal portion 400, the first display portion 310, and the second display portion 330.
[0131] Also, when a coupling method using fixtures such as screws is adopted, the front panel 102 and the front side internal panel 108 can be easily removed compared to the case of adhesion or the like. Therefore, dust that has entered the virtual image display space can also be removed using an air blower or a soft cloth. On the other hand, since the front panel 102 is not fixed with fixtures such as screws, it is prevented from being observed by the observer and causing the observer to be startled.
[0132] <5. Detailed Configuration of the Processing Substrate 224> FIG. 33 is a control block diagram of a processing board 224 included in a display device 1 according to an embodiment. As shown in FIG. 33, the processing board 224 is a controller having a memory including a CPU 701 that functions as an arithmetic processing unit that executes arithmetic processing and the like, a RAM 703 used as a work area, and a ROM 702 that stores control programs and the like. Note that the processing board 224 may be read as, for example, a control unit (an example of operation control means). Various programs are stored in the ROM 702 of the processing board 224, and the processing board 224 realizes various functions by executing these programs. For example, a voice recognition application for reproducing an interaction between a user and a character is stored in the ROM 702, and the processing board 224 executes the voice recognition application based on input signals from various sensors 234, 2331 to 2332 or a GPS receiver 60 or the like, thereby reproducing an interaction between the user and the character. Further, the processing board 224 includes a display control circuit 704 that controls an image or the like displayed on the display device 1 (specifically, a video display unit), and a voice control circuit 705 that controls voice output from speakers 2551 and 2552. Further, the processing board 224 includes a communication control circuit 706 that controls communication with other devices (for example, an external voice recognition server (also referred to as a voice recognition engine) not shown and an external dialogue server (also referred to as a dialogue engine) not shown).
[0133] <6. Communication function related to character 1100> Hereinafter, various controls for reproducing communication between a character 1100 displayed on the display device 1 (for example, a video display unit) and a user will be described in order with reference to FIGS. 34 to 40.
[0134] <Regarding the communication function regarding ni> For example, an odor sensor for detecting an odor may be provided in the display device 1 as the second sensor 2332, and the processing board 224 may execute a voice output operation for outputting, as the character voice of the character 1100, a voice corresponding to the detection result by the odor sensor. The odor sensor may output a signal that changes according to, for example, the intensity of a certain odor, or a signal that changes according to the components (odor components) contained in the odor. The odor sensor outputs a signal that changes according to, for example, the type of odor. The odor sensor is configured to be able to detect the concentration of specific odor components (such as tar, ammonia, alcohol, carbon dioxide, etc.) using, for example, a deodorizing filter or the like. In this way, the processing board 224 can reproduce communication regarding odor between the character displayed on the video display unit of the display device 1 and the user, and can reproduce more diverse communication between the character and the user.
[0135] The processing board 224 may execute a voice output operation for outputting, as the character voice of the character 1100, a voice corresponding to the detected type of odor. Note that a single sensor capable of identifying a plurality of types of odor components may be configured as the odor sensor, or a plurality of sensors capable of identifying different types of odor components may be configured as the odor sensor.
[0136] FIG. 34(A) is a flowchart for reproducing communication regarding odor, and FIG. 34(B) is a diagram showing an audio management table (also referred to as an audio management list) regarding odor. The audio management table is stored, for example, in the processing substrate 224 of the display device 1 or in the dialogue server. As shown in FIG. 34(B), in the audio management table, for each type of odor component (also referred to as an odor substance) detectable by the odor sensor, the type of odor mainly containing the odor component and the voice (referred to as a character voice) emitted by the character 1100 are registered in advance. For example, in the audio management table, the tobacco odor mainly containing tar is registered in association with tar, and as the character voice when the tobacco odor is detected, words such as "Smoking too much is not good for your health~" that show concern for the user's health are registered.
[0137] First, in step S11, the processing substrate 224 (which may also be read as the control unit) determines whether an odor has been detected. For example, when the concentration of the odor component detected by the odor sensor exceeds a predetermined threshold value (reference value) for a specific odor, the processing substrate 224 determines that the odor component has been detected. In step S12, the processing substrate 224 determines the type of odor registered in the voice management table in association with the detected odor component. For example, when tar with a concentration exceeding a predetermined threshold is detected, it is determined that the smell of tobacco has been detected. Then, the processing substrate 224 outputs character voices corresponding to the detected odor type from the speakers 2551 and 2552. For example, when it is determined that the smell of tobacco has been detected, the processing substrate 224 executes a voice output operation of outputting a voice of words concerned about the user's health (here, "Smoking too much is not good~") as a character voice. As other examples, the following can be mentioned. For example, when the concentration of a specific main component contained in a fragrance such as aromatic oil or food exceeds a predetermined reference value, the processing substrate 224 determines that an odor such as a fragrance or food has been detected and outputs a voice asking a question about the source of the odor as a character voice. Also, when alcohol exceeding a predetermined reference value is detected, the processing substrate 224 determines that the smell of alcohol has been detected and outputs voices such as "It smells like alcohol~" or "You've been drinking again. Cut it out." as the character voice of character 1100. Also, when an odor component contained in gas fuel such as tertiary butyl mercaptan, dimethyl sulfide, or tetrahydrothiophene is detected, the processing substrate 224 determines that the odor of gas fuel has been detected and outputs voices such as "It smells like gas!" as the character voice of character 1100. Also, when an odor component such as hydrogen sulfide, methyl mercaptan, or dimethyl sulfide (halitosis components) exceeding a predetermined reference value is detected, the processing substrate 224 determines that halitosis has been detected and outputs voices such as "You have a bit of bad breath. Have you brushed your teeth?" or "Pay attention to periodontal abscess." as the character voice of character 1100.
[0138] Thus, the processing substrate 224 may execute control to output, as the character voice of the character 1100, voice corresponding to the detected type of smell. By performing such control, the range of communication between the character displayed on the video display unit and the user can be widened, and the user's attachment to the character can be increased.
[0139] The display device 1 is not limited to identifying the voice output based on the voice management table. For example, the display device 1 may identify the voice to be output according to a scenario in which the speech content of the character changes based on the content of past conversations (conversation history). This scenario may define a branching scenario in which data for identifying the voice output by the character is managed in a tree structure.
[0140] Here, although the voice output operation of voice according to the detection result by the odor sensor is illustrated, it is not limited thereto. The processing board 224 may execute a display output operation of displaying, on the video display unit, a video in which a character makes a movement according to the detection result by the odor sensor. For example, similar to the voice management table, a display management table (not shown) may be provided in advance, and the processing board 224 may execute a display output operation of displaying, on the video display unit, a video in which the character 1100 makes a movement according to the detected type of odor. The display management table may be, for example, a table in which data defining the character 1100 is registered in association with the odor component and the type of odor. The data defining the character 1100 may be data indicating the video of the character 1100 to be displayed, or may be data defining the content of the movement of the character 1100. For example, when any odor component is detected, the processing board 224 may display, on the video display unit, a video in which the character 1100 makes a movement of smelling the odor. Further, when the processing board 224 determines that, for example, the smell of tobacco is detected, the processing board 224 may display, on the video display unit, a video in which the character 1100 makes a movement of disliking it. At this time, the processing board 224 may display a video simulating smoke on the video display unit. Furthermore, the processing board 224 may execute both the voice output operation and the display output operation as described above. For example, when any odor component is detected by the odor sensor, the processing board 224 may display, on the video display unit, a video in which the character 1100 makes a movement of smelling the odor, and output, from the speakers 2551 and 2552, a voice such as "Something smells" as the character voice of the character 1100.
[0141] Furthermore, the processing board 224 may control so that the reaction of the character 1100 changes according to the concentration of the odor component (also referred to as detection intensity) detected by the odor sensor. For example, the processing board 224 may selectively display any one of a plurality of videos of movements (for example, "frowning (showing a disgusted expression)", "sweating coldly", "turning pale", and "fainting", etc.) provided step by step according to the concentration of the odor component.
[0142] The display device 1 may be able to detect that the user is smoking, for example, by combining a smoke sensor that detects smoke, a camera image (e.g., an image captured by the imaging unit 227), an image of a thermal camera, or other sensors, as a method of distinguishing between the smell of tobacco and other odors (scents).
[0143] When the processing board 224 detects that the user is smoking, it may display an image simulating smoke (a video reproducing the state where the smoke appears as puffs) over the character 1100 (in front of the character 1100). At this time, the processing board 224 may protrude the face of the character 1100 forward to enlarge the face and give it an expression as if it is disgusted. The processing board 224 may display a change in the degree of disgust of the character 1100 according to the degree of intimacy, which is the degree of intimacy between the user and the character 1100. For example, when the degree of intimacy is equal to or greater than a predetermined value, the processing board 224 may make the expression of the character 1100 such that it forgives because it loves, and when it is less than the predetermined value, make the character 1100 have an unpleasant expression. The processing board 224 may specify the degree of intimacy according to, for example, the usage record of the display device 1 by the user (e.g., past usage time and past conversation content). The algorithm for specifying the degree of intimacy is not limited to this.
[0144] <Regarding the communication function based on the user's location information> Also, for example, the display device 1 may have a GPS (Global Positioning System) receiver 60 (see FIG. 33), and the following control may be executed based on the user's location information. And, for example, the processing board 224 may acquire the location information of the display device 1 carried (held) by the user as the user's own location information based on the signal from the GPS receiver 60, and execute the following control based on the acquired location information.
[0145] For example, it may be controlled such that a voice corresponding to the stay frequency (also referred to as the visit frequency) at a location specified based on the user's location information is output as a character voice. FIG. 35 is a flowchart for reproducing communication regarding the stay frequency.
[0146] For example, in step S21, the processing board 224 determines whether position information of the user has been received from the GPS receiver 60. When the position information of the user is received, in step S22, the processing board 224 determines whether the number of stays (also referred to as the number of visits, etc.) of the user at a location specified based on the position information of the user is equal to or greater than a predetermined value (for example, "2"). Note that the stay frequency is the number of times the user has stayed at a single location within a predetermined period (for example, one day or one week, etc.). For example, the processing board 224 searches for and specifies the user's stay location using a network or the like based on the position information (for example, the current position information of the user) acquired from the GPS receiver 60. Then, the processing board 224 calculates the stay frequency of the user based on the number of stays of the user at the specified location, and determines whether the stay frequency of the user is equal to or greater than the predetermined value. For example, when the stay frequency of the user is equal to or greater than the predetermined value, in step S23, the processing board 224 controls so that a predetermined character voice registered in advance regarding the stay frequency of the user is output from the speakers 2551 and 2552. For example, when the user has visited the same location twice on the same day, the processing board 224 determines that the stay frequency of the user is equal to or greater than the predetermined value, and outputs a character voice such as "Hey, you were here just now".
[0147] Also, the processing board 224 may be controlled to output a voice corresponding to the location specified based on the acquired position information as a character voice of the character 1100. FIG. 36(A) is a flowchart for reproducing communication regarding the stay location, and FIG. 36(B) is a diagram showing a voice management table of character voices regarding the stay location.
[0148] For example, in step S31, the processing board 224 determines whether the user's location information has been received from the GPS receiver 60. When the user's location information is received, in step S32, the processing board 224 searches for and identifies the user's staying location using a network or the like based on the user's location information. Then, in step S33, the processing board 224 outputs, from the speakers 2551 and 2552, character voices corresponding to the identified location based on the voice management table of FIG. 36(B). For example, when the user goes to a supermarket, the processing board 224 outputs character voices such as "What should I cook for dinner today?" as the character voices of the character 1100, or when the user goes to a hospital, voices such as "Are you okay? Do you feel unwell?" are output as the character voices of the character 1100. Also, for example, when the user goes to an amusement park, the processing board 224 outputs character voices such as "You had a great time playing."
[0149] Further, the processing board 224 may be controlled to output, as the character voices of the character 1100, voices corresponding to the number of stays (also referred to as the number of visits, etc.) of the user at the location identified based on the acquired location information. FIG. 37(A) is a flowchart for reproducing the communication regarding the number of stays, and FIG. 37(B) is a diagram showing the voice management table of the character voices regarding the number of stays.
[0150] Steps S41 and S42 in Fig. 37(A) are the same as steps S31 and S32 in Fig. 36(A), so the description thereof is omitted. In step S43, the processing board 224 acquires the number of times the user has stayed at the location specified in step S42. Then, in step S44, the processing board 224 outputs, from the speakers 2551 and 2552, character voices corresponding to the number of times the user has stayed based on the voice management table in Fig. 37(B). For example, when the user visits a certain game center for the first time, the processing board 224 outputs character voices such as "It was fun playing games". Then, when the user visits the certain game center again, the processing board 224 outputs character voices such as "I really wanted to come again". Further, when the user visits the certain game center a predetermined number of times or more (for example, 10 times or more), the processing board 224 outputs character voices such as "Are you going to play games again~".
[0151] Also, the processing board 224 may be controlled to output, as the character voice of the character 1100, a voice corresponding to the staying time of the user at the location specified based on the acquired position information. Fig. 38(A) is a flowchart for reproducing the communication regarding the staying time, and Fig. 38(B) is a diagram showing the voice management table of the character voices regarding the staying time.
[0152] Steps S51 and S52 in FIG. 38(A) are the same as steps S31 and S32 in FIG. 36(A), so the description thereof is omitted. In step S53, the processing board 224 acquires the user's staying time at the location specified in step S52. Then, in step S54, the processing board 224 outputs character voices corresponding to the user's staying time from the speakers 2551 and 2552 based on the voice management table in FIG. 38(B). For example, when the user's staying time at a convenience store is within 5 minutes, the processing board 224 outputs character voices such as "You were quick. I'm glad I waited." Also, when the user's staying time at a convenience store is 5 minutes or more and less than 10 minutes (5 to 10 minutes), the processing board 224 outputs character voices such as "What did you buy?" Further, when the user's staying time at a convenience store exceeds 10 minutes, the processing board 224 outputs character voices such as "You were late. I was worried."
[0153] The processing board 224 may perform the above control based on the user's position information acquired using a GPS receiver 60 or the like. In this way, the user can get the feeling that the character shows a reaction according to his / her actions, and the user's attachment to the character increases.
[0154] Note that the display device 1 is installed, for example, at the user's home, and the display device 1 (specifically, the communication control circuit 706) may communicate with the user's smartphone (a smartphone equipped with a GPS receiver) or the like to acquire the position information of the user while out (the position information of the smartphone held by the user). Then, when communicating with the character 1100 after the user returns home or the like, the processing board 224 may control to execute the above operations. Note that the content of the character voices and movements at this time may be changed as appropriate.
[0155] <Regarding the communication function related to the user's behavior pattern> Also, when it is determined that the user's behavior pattern matches a predetermined behavior pattern, it may be controlled so that voice corresponding to the predetermined behavior pattern is output as the character voice of the character 1100. FIG. 39(A) is a flowchart for reproducing communication regarding the behavior pattern, and FIG. 39(B) is a diagram showing a voice management table of character voices regarding the behavior pattern.
[0156] For example, on the processing board 224, the day of the week when the user goes to work (for example, Monday to Friday), the arrival time (for example, 8:30), and the specific route used at the time of arrival are pre-registered by the user as the "behavior pattern at the time of going to work". Then, for example, when the position information of the user is received from the GPS receiver 60 (step S61), the processing board 224 determines whether the user's behavior pattern matches a predetermined behavior pattern based on the position information of the user (step S62). For example, when the user passes a specific route at 8:30 on Tuesday, the processing board 224 determines that the user's behavior pattern matches the "behavior pattern at the time of going to work". Then, in step S63, the processing board 224 outputs, from the speakers 2551 and 2552, the voice (for example, "Do your best at work") registered in association with the "behavior pattern at the time of going to work" based on the voice management table in FIG. 39(B) as the character voice of the character 1100. In this way, by having the character show a reaction according to the user's behavior, the user's attachment to the character can be increased. Note that it is not essential that a predetermined behavior pattern (for example, the behavior pattern at the time of going to work) be pre-registered by the user. For example, the processing board 224 may have a learning function, and the predetermined behavior pattern may be registered by learning the user's behavior pattern.
[0157] <Regarding the communication function for detecting a suspicious person> Also, when a person detected in the detection target space is determined to be a suspicious person, a predetermined operation may be executed. Then, after the predetermined operation is executed, if a user of the display device 1 is detected, a voice regarding the detection of the suspicious person may be output as the character voice of the character 1100. FIG. 40 is a flowchart for realizing an operation regarding the detection of a suspicious person.
[0158] For example, in the display device 1, as shown in FIG. 32, a photographing unit 227 (for example, a camera) for photographing an observer (such as a user) is provided on the front side of the display device 1, and the photographing unit 227 (specifically, the sensor included in the photographing unit 227) may be used as a detection means for detecting the presence of a person in the detection target space. The "detection target space" includes, for example, the angular range (photographable range) of the photographing unit 227 in the space where the display device 1 is placed (for example, the user's home). The photographing unit 227 includes, for example, a lens and an image sensor (for example, a CCD or a CMOS), and photographs a multi-color image. The lens of the photographing unit 227 is provided at a position where an observer (especially the face) can be photographed. In the example shown in FIG. 32, the lens of the photographing unit 227 is provided above the observation area SC and near the center in the width direction of the display device 1 on the front side panel 102 disposed on the front side of the housing 100. The photographing unit 227 outputs, for example, image signals of the R, G, and B color components to the processing board 224. The processing board 224 processes this image signal to generate a photographed image.
[0159] The processing board 224 monitors the detection target space using the imaging unit 227 (step S71). Then, when the presence of a person is detected in the detection target space, in step S72, the processing board 224 performs user authentication such as face authentication, for example, and in step S73, determines whether the detected person is a registered user of the display device 1. If the processing board 224 determines that the person photographed by the imaging unit 227, for example, is a registered user of the display device 1, it determines that the person is not a suspicious person. On the other hand, if it is determined that the person photographed by the imaging unit 227 is an unregistered user, in step S74, the processing board 224 determines that the person is a suspicious person and executes a predetermined operation. Examples of the "predetermined operation" include an operation to start recording by the imaging unit 227, an operation to issue an alarm at a relatively high volume, an operation to notify a pre-registered security company, and the like. Alternatively, the "predetermined operation" may be an operation in which the character 1100 addresses the suspicious person (for example, "Who!? Say the password!"). And if there is no reply from the person determined to be a suspicious person, or if the password is incorrect, the above-described recording start operation or the like may be executed. In addition, when the password is incorrect, the processing board 224 outputs a voice such as "That's wrong!? Say it again" as the character voice of the character 1100, and when it is determined again that the password is incorrect, the above-described recording start operation or the like may be executed. By doing so, for example, a suspicious person can be made to retreat from the detection target space, and the crime prevention performance in the detection target space can be enhanced.
[0160] Then, after the execution of the predetermined operation, when a user of the display device 1 is detected, the processing board 224 may output a voice related to the detection of a suspicious person as the character voice of the character 1100. Examples of the "voice related to the detection of a suspicious person" include "That was scary". By doing so, the user's attachment to the character displayed on the video display unit can be increased.
[0161] Also, when the detection target space is being monitored using the display device 1, not limited to the detection of a suspicious person, the following operations may be performed.
[0162] For example, the display device 1 may be arranged in the reception space of an enterprise, and the character 1100 may display performing reception work as a so-called receptionist. Specifically, when the approach of a person in the detection target space (for example, the reception space) is detected by a microwave Doppler sensor (an example of detection means), the processing board 224 may output voices such as "Welcome. Which department can I help you?" as the character voice of the character 1100. Then, the processing board 224 may be controlled to make a call to the department desired by the visitor based on the response from the detected person (the visitor).
[0163] <Regarding the communication function related to the startup time of the display device 1> In addition, the processing board 224 may be controlled such that the content of the communication changes according to the startup time (for example, the cumulative startup time) of the display device 1 from a predetermined time point (for example, the first startup time) in the choice of words in the character voice of the character 1100. For example, as described below, the processing board 224 may be controlled such that the longer the startup time of the display device 1, the more familiar the character 1100 speaks to the user.
[0164] For example, for various character voices as described above, it is preferable that three patterns of character voices, namely, a polite tone, a speech tone as if the user and the character are friends, and a speech tone as if the user and the character are lovers, are registered in advance in the voice management table. Then, for example, when the startup time of the display device 1 from a predetermined point in time is less than 100 hours, the processing board 224 outputs the character voice with a polite tone among the three patterns of character voices registered in the voice management table. Also, when the startup time is 100 hours or more and less than 1000 hours, the processing board 224 outputs the character voice with a speech tone as if the user and the character are friends among the three patterns of character voices registered in the voice management table. Further, when the startup time exceeds 1000 hours, the processing board 224 outputs the character voice with a speech tone as if the user and the character are lovers among the three patterns of character voices registered in the voice management table.
[0165] By doing so, the user can feel that the relationship (e.g., intimacy) with the character has changed due to the change in the character's way of speaking to the user himself / herself.
[0166] Note that the processing board 224 may be controlled to decrease the intimacy of the character 1100 with respect to the user depending on the elapsed time since the previous startup. For example, even when the cumulative startup time of the display device 1 exceeds 100 hours, when one week has elapsed since the previous startup, the processing board 224 may output the character voice with a polite tone instead of a speech tone on an equal footing with the user. In this way, the user will come into contact with the character displayed on the video display unit without leaving an interval as much as possible in order to maintain the intimacy with the character, and the attachment to the character can be further increased.
[0167] Also, the processing substrate 224 may output a greeting voice such as "Nice to meet you" as a character voice at the first startup, and when a predetermined period (for example, a well-defined period such as one month) has elapsed since the first startup, output a voice with content indicating an anniversary (for example, "It's been one month since we met") as a character voice. By doing so, the attachment to the character 1100 can be further increased.
[0168] <Communication function through cooperation with other devices> Also, for example, when the display device 1 is installed at the user's home or the like, the following operations may be executed by cooperation with other devices. For example, when the user visits a place where a device (hereinafter referred to as other device) capable of communicating with the display device 1 is installed, the other device may identify the user and automatically guide information suitable for the user (for example, gourmet information or event information) as follows. For example, the face image of the user who uses the cooperation system between the display device and other devices and the display device (for example, IP address or the like) owned by the user are associated and registered in advance in an external server or the like. When a person is detected by a sensor included in the imaging unit provided in the other device, for example, the control unit of the other device identifies the user of the display device 1 by comparing the face image of the person detected in the captured image with the face image of the user registered in the external server. Then, the control unit of the other device specifies the display device 1 (for example, the IP address of the display device 1 or the like) registered in association with the user in the external server, and transmits information indicating that the user of the display device 1 has been detected to the display device 1. In the processing board 224 of the display device 1, "information suitable for the user" (for example, gourmet information or event information) is registered in advance, and the processing board 224 transmits the registered "information suitable for the user" to the other device in response to the reception of a signal from the other device. Then, the control unit of the other device outputs the "information suitable for the user" received from the display device 1 (for example, voice output). When guiding the "information suitable for the user", the other device may display the character 1100 on its display screen. Also, information or the like guided to the user may be transmitted from the other device to the display device 1 and stored as user information in the processing board 224 of the display device 1. Then, for example, when the display device 1 is installed at the user's home and the user's return home is detected, the processing board 224 may output voices such as "You went to **, how was it?" as the character voice of the character 1100. By doing so, the user's attachment to the character displayed on the video display unit can be increased.
[0169] <Regarding Other Communication Functions> Furthermore, the following control may be performed based on detection results by various sensors.
[0170] For example, a wind detection means (e.g., a wind sensor) capable of detecting wind (e.g., wind speed) may be provided on the front panel 102 of the display device 1, and the following control may be performed based on the detection result by the wind sensor. The wind may be, for example, artificially generated by the user, such as wind generated by moving a body part such as waving a hand toward the display device 1 or wind generated by blowing breath. For example, when wind with a wind speed equal to or higher than a predetermined value is detected by the wind sensor, the processing board 224 may display and output an image in which the hair (e.g., hair) or clothes (e.g., skirt) of the character (e.g., character 1100) displayed on the video display unit flutter. Also, for example, when an image of a lit candle is displayed on the video display unit and wind is detected by the wind sensor, the processing board 224 may switch to an image in which the flame of the candle goes out. Furthermore, when the detected wind is stronger than a predetermined threshold (wind speed is greater than a predetermined threshold), the processing board 224 may switch the image according to the intensity of the detected wind (e.g., wind speed), such as the clothes of the character 1100 fluttering more strongly.
[0171] Further, for example, an object detection means (e.g., an ultrasonic sensor) capable of detecting the presence or absence of an object and the distance to the object may be installed in the display device 1, and the following control may be performed based on the detection result by the ultrasonic sensor. For example, when the processing board 224 determines based on the detection result by the ultrasonic sensor that the hand of the observer is touching the character 1100 recognized as a stereoscopic video, the processing board 224 may display and output a video in which the character 1100 shows a reaction. Further, the processing board 224 may perform display control so as to show different reactions according to the part of the character 1100 touched by the observer. The part of the character 1100 touched by the observer may be, for example, a part of the body such as the head, chest, abdomen, buttocks, or legs. Also, the part of the character 1100 touched by the observer may be the clothing (e.g., a dress, a skirt) or ornaments (e.g., accessories) of the character 1100.
[0172] Further, for example, a seismic detection means (e.g., a seismic sensor) capable of detecting an earthquake and measuring the seismic intensity may be provided in the display device 1, and when an earthquake is detected by the seismic sensor, the processing board 224 may issue an earthquake warning.
[0173] Further, for example, a weather sensor capable of measuring the weather may be provided in the display device 1, and the processing board 224 may notify changes in the weather, weather forecasts, etc. based on the measurement result by the weather sensor. Note that the weather sensor may have, for example, a pressure sensor, a temperature sensor, and a humidity sensor, and may be configured to be able to measure the weather based on the detection results of each sensor.
[0174] Further, the processing board 224 may display a video in which the expression and movement (also referred to as motion) of the character displayed on the video display unit change according to the temperature detected by the temperature sensor or / and the humidity detected by the humidity sensor.
[0175] Further, the processing substrate 224 may display a video in which the expression and movement of the character displayed on the video display unit change according to the detection result (for example, the distance between the display device 1 and the observer) by a human sensor such as a microwave Doppler sensor.
[0176] Further, the processing substrate 224 may use a humidity sensor to determine whether the user has blown air. Furthermore, the processing substrate 224 may also use a temperature sensor to determine the type of air blown by the user. These sensors may be provided in the display device 1 as, for example, the second sensor 2332.
[0177] Here, there are two types of air blown by the user, for example, the air blown with "hoo" and the air blown with "haa". Generally, when blowing cold air, the air is blown quickly with "hoo", so here, the air blown with "hoo" is called "cold air". Also, generally, when blowing warm air, the air is blown slowly with "haa", so here, the air blown with "haa" is called "warm air".
[0178] Regarding these two types of air, the inventor of the present application obtained the following findings through experiments and the like. Specifically, first, regarding humidity, when blowing "hoo" air toward the temperature and humidity sensor (for example, a sensor in which a temperature sensor and a humidity sensor are integrated) at a position a certain distance away from the temperature and humidity sensor, it was found that the humidity rapidly increased from the steady state immediately after that. Also, thereafter, the humidity increased monotonically while blowing air, and when the blowing of air was stopped, it took several tens of seconds to return to the original steady state. The same measurement results were obtained when blowing "haa" air toward the temperature and humidity sensor under the same conditions. On the other hand, regarding temperature, when blowing "hoo" air, the temperature slightly decreased from the steady state or remained almost horizontal, and when blowing "haa" air, the temperature increased. The air blown by the user onto the display device 1 is an example of the wind hitting the display device 1.
[0179] In consideration of such findings, etc., for example, in the display device 1 provided with a humidity sensor, when the humidity sensor detects that the humidity has rapidly increased from a steady state, the processing board 224 may determine (also referred to as a decision) that the observer has blown air. Further, when it is detected that the monotonic increase in humidity stops thereafter, the processing board 224 may determine that the blowing of air has stopped. Alternatively, when a predetermined time (for example, the time required to exhale normal breath (for example, about 3 seconds)) has elapsed since the rapid increase in humidity was detected, the processing board 224 may determine that the blowing of air has stopped regardless of the humidity detection result at that time.
[0180] Furthermore, when the rapid increase in humidity is detected by the humidity sensor and at the same time (for example, at approximately the same timing), the temperature sensor detects that the temperature has increased from the steady state, the processing board 224 may determine that the type of air blown by the observer is "warm air". Conversely, when the rapid increase in humidity is detected by the humidity sensor and the temperature sensor detects that the temperature has not changed from the steady state or has decreased from the steady state, the processing board 224 may determine that the type of air blown by the observer is "cold air".
[0181] Then, the processing board 224 may output the video and audio corresponding to the detection of the blowing of air as the movement of the character and the character voice displayed on the video display unit. Also, the processing board 224 may output the video and audio corresponding to the type of air blown as the movement of the character and the character voice displayed on the video display unit. For example, when the type of air blown by the observer is "cold air", the processing board 224 may display and output a video of the character's clothes fluttering, and when the type of air blown by the observer is "warm air", the processing board 224 may display and output a video of the character making a movement to avoid the air.
[0182] In addition, the inventors of the present application have also obtained the following findings using various gas sensors. Specifically, when blowing "whoosh" air towards the gas sensor at a position about a predetermined distance (for example, about 10 cm) away from the gas sensor, the output value of the gas sensor decreases immediately afterwards, and when the blowing stops, the output value of the gas sensor immediately turns to increase, as measured results. Conversely, when blowing "ha" air towards the gas sensor, the output value of the gas sensor increases immediately afterwards, and when the blowing stops, the output value of the gas sensor immediately turns to decrease, as measured results. Also, for example, when the air sent from a blower (for example, a fan) hits the gas sensor, the output value of the gas sensor decreases, and when the air from the fan no longer hits the gas sensor, the output value of the gas sensor increases, as measured results.
[0183] In consideration of such findings, etc., for example, in the display device 1 provided with a gas sensor, when the output value of the gas sensor suddenly decreases from the steady state, it may be determined that the type of air blown by the observer is "cold air". Conversely, when the output value of the gas sensor suddenly increases from the steady state, it may be determined that the type of air blown by the observer is "warm air".
[0184] It is also possible to adopt a configuration for detecting breath using a wind sensor. The inventors of the present application have confirmed that according to the wind sensor, it is sometimes possible to detect a relatively weak wind such as the wind when lying on paper, and when blowing breath on the wind sensor, it immediately reaches a peak and has good responsiveness when the wind starts to blow. However, if blowing breath continuously, it immediately drops from the peak. It is conceivable that a strong wind such as a whoosh breath cools the heater and takes time to recover.
[0185] Regarding the configuration for detecting breath using a wind sensor, the following configuration may be adopted.
[0186] When the processing substrate 224 continuously detects a predetermined air volume by means of an air sensor, it may perform processing in a direction where it is not being blown on. Processing in a direction where it is not being blown on is, for example, processing for determining that no breath is being blown. In this case, when the time from the start to the end of wind detection by the air sensor is within the time during which blowing is possible, the processing substrate 224 may be made to perform processing in the direction where it is in a state of being blown on.
[0187] In this case, the air sensor may be a sensor that detects wind by electrically measuring the heat taken away by the wind. In this sensor, the wind received by the sensor corresponds to the air volume of the blown breath. This sensor is set such that when the wind received by the sensor continues for a time corresponding to the time during which the breath was blown, it drops to a value less than the actual air volume during the duration of this continuation, and when the wind received by the sensor is less than the air volume of the blown breath, it is set such that this drop is less likely to occur.
[0188] In the display device 1, a flow path for allowing air to flow in with a common breath inflow path may be provided for a plurality of air sensors as the air sensors. The flow path may be configured such that air enters different air sensors at a predetermined ratio that is not 1:1. The processing substrate 224 may determine the magnitude and time of the blown breath based on the ratio and the differences in the characteristics of the plurality of air sensors. The display device 1 includes a plurality of air sensors with different timings of dropping to a value less than the actual air volume during the duration, and the processing substrate 224 may determine the magnitude and time of the blown breath based on the outputs of the plurality of air sensors. The display device 1 may include at least an air sensor that is not a gas sensor and a ca sensor as the plurality of air sensors.
[0189] Further, it is advisable to use a gas sensor for detecting a predetermined gas as the wind sensor. As the wind sensor, it is advisable to use a gas sensor for detecting a predetermined gas and including a heater. In this case, the gas sensor including the heater outputs in a direction in which the gas detection amount increases when the degree of blowing is relatively small (as a result of detecting the gas contained in the breath), while outputting in a direction in which the gas detection amount decreases when the degree of blowing is relatively large (due to the cooling of the heater by the wind of the breath).
[0190] When the processing board 224 determines that breath is being blown, when the strength is relatively large (for example, when the air volume is equal to or greater than the threshold value), an animation that moves the clothes, hair, etc. of the character 1100 is displayed, while when the strength is relatively small, an animation different from the animation that moves the clothes, hair, etc. of the character 1100 is displayed.
[0191] By the way, when a gas sensor is used for detecting breath, the gas sensor outputs the above output value in response to a component (for example, carbon dioxide) contained in human breath. The reason why the output value of the gas sensor is different when "whoosh" breath is blown and when "ha" breath is blown is that when "whoosh" breath is blown, the speed of the blown breath is high and it easily diffuses around immediately after colliding with the gas sensor, while when "ha" breath is blown, the speed of the blown breath is low and the components of the breath tend to remain at the place even after colliding with the gas sensor.
[0192] Furthermore, the processing board 224 may determine whether the detected wind is due to the observer's blowing or due to a blower, for example, by using the detection result of humidity by a humidity sensor. For example, in the display device 1, when it is detected by the humidity sensor that the output value of the gas sensor has rapidly decreased from the steady state and the humidity has rapidly increased from the steady state, the processing board 224 may determine that the user has blown. On the other hand, when the output value of the gas sensor has rapidly decreased from the steady state but the humidity remains in the steady state, the processing board 224 may determine that the wind is being sent by the blower. Furthermore, when it is determined that the user has blown, the processing board 224 may use the detection result of temperature by a temperature sensor to determine the type of the breath. Also, when the rise and fall of the output value of the gas sensor are repeated within a relatively short fixed period, the processing board 224 may determine that the wind of the oscillating fan is hitting.
[0193] Note that the wind sensor, humidity sensor, temperature sensor, temperature and humidity sensor, and gas sensor used for detecting wind are examples of wind detection means. The display device 1 may have a barometric pressure sensor as a sensor for detecting wind. This is because a change in barometric pressure may occur depending on the generation and strength of wind.
[0194] The various controls as described above can be executed. Note that the above controls are not limited to the character 1100, and may be performed on the communication function for other characters (for example, the character 1200).
[0195] <7. Specific examples of the video displayed by the display device 1> Next, with reference to FIGS. 41 to 55, a specific example of the video displayed by the display device 1 will be described. FIGS. 41 to 55 are diagrams showing an example of a character (video including the character 1200 described in FIGS. 1B and 1C) displayed on the display device 1. Each video shown in FIGS. 41 to 55 is an image that is displayed on the display device 1 and can be observed by an observer through the observation region SC. Although the stage video 2200 is displayed in FIGS. 41 to 55, the character 1200 may be displayed without displaying the stage video 2200.
[0196] FIGS. 41 to 47 are displays performed by the display device 1 during a period of waiting for the operation of the observer based on the communication function. The display device 1 (specifically, the processing board 224) performs the following-described displays by switching them regularly or randomly. For example, as shown in FIG. 41(a), the character 1200 is displayed in a posture standing facing the front side (observation side) of the display device 1. The display device 1 may use this posture as a basic posture and also as a display during a period when communication based on the communication function is not being performed. For example, as shown in FIG. 41(b), the character 1200 makes an action of licking its front leg. For example, as shown in FIGS. 41(c) and 42(a), the character 1200 makes an action of alternately looking to its left and right. For example, as shown in FIG. 42(b), the character 1200 makes an action of facing the direction of the ground. For example, as shown in FIG. 42(c), the character 1200 makes an action of stretching while sitting. For example, as shown in FIG. 43(a), the character 1200 makes an action of peeking into the ground. Further, for example, as shown in FIGS. 43(b) and 43(c), the character 1200 makes an action of walking on the front side. When the display device 1 makes the character 1200 perform a walking action, it may display a video in which the character 1200 stamps its feet on the spot and does not substantially move the overall position of the character 1200 without displaying the stage video. When the character 1200 performs an action other than the walking action, the display device 1 may display the stage video at the feet of the character 1200.
[0197] For example, as shown in FIG. 44(a), the character 1200 makes an action of peering into its own abdomen. For example, as shown in FIG. 44(b), the character 1200 makes an action of tilting its neck. For example, as shown in FIG. 44(c), the character 1200 makes an action of rubbing its own eyes. For example, as shown in FIG. 45(a), the character 1200 makes an action of yawning. For example, as shown in FIG. 45(b), the character 1200 makes an action of licking its front legs while sitting. For example, as shown in FIG. 45(c), the character 1200 makes an action of looking diagonally forward to its left. As shown in FIGS. 46(a) and (b), the character 1200 makes an action of stretching. For example, as shown in FIG. 46(c), the character 1200 makes an action of peering into the ground. As shown in FIG. 47(a), the character 1200 faces in the direction diagonally forward to the right of the display device 1, and then as shown in FIG. 47(b), it faces forward. As shown in FIG. 47(c), the character 1200 makes an action of licking its front legs.
[0198] FIGS. 48 to 55 are an example of the display of the character 1200 performed by the display device 1 (specifically, the processing substrate 224) during the dialogue processing in the communication function. The character strings shown in FIGS. 48 to 55 are character strings recognizable by voice recognition and are displayed above the character 1200. It is preferable that the phrase (sentence) recognized by voice recognition is displayed for a predetermined time after the voice recognition and is made non-displayed after the elapse of the predetermined time. Then, it is preferable that the character 1200 is controlled to speak after the phrase (voice recognition result) is made non-displayed.
[0199] FIG. 48(a) is what is displayed when the display device 1 recognizes the observer's utterance of "come here, come here~", and in response to this, voice is output. FIGS. 48(b) to 49(b) are what are displayed when the display device 1 recognizes the observer's utterance of "sit down", and in response to this, voice is output. FIG. 49(c) is what is displayed when the display device 1 recognizes the observer's utterance of "are you hungry?", and in response to this, voice is output. FIG. 50(a) is what is displayed when the display device 1 recognizes the observer's utterance of "policeman", and in response to this, voice is output. FIGS. 50(b) and (c) are what are displayed when the display device 1 recognizes the observer's utterance of "it's snack time", and in response to this, voice is output. FIG. 51(a) is what is displayed when the display device 1 recognizes the observer's utterance of "hand", and in response to this, voice is output. FIGS. 51(b) to 52(b) are what are displayed when the display device 1 recognizes the observer's utterance of "so cute", and in response to this, voice is output. When the display device 1 displays the character 1200 at a position other than the center of the stage video (for example, a position on the front side), when rotating the character 1200, the stage video 2200 may be rotated in the same manner as the character 1200. Further, the display device 1 may display a stage video 2200 having a shape with a relatively large distance in the depth direction, and display a video (for example, a video in which a cat character walks along the outer edge of a circular stage) in which the character 1200 is moved along the outer edge of the stage video 2200 inside such a stage video 2200.
[0200] Figure 52(c) is what is displayed when the display device 1 recognizes the observer's utterance of "Hello", and in response to this, voice is output. Figure 53(a) is what is displayed when the display device 1 recognizes the observer's utterance of "Eat rice", and in response to this, voice is output. Figures 53(b) and (c) are what are displayed when the display device 1 recognizes the observer's utterance of "Is it a girl?", and in response to this, voice is output. Figure 54(a) is what is displayed when the display device 1 recognizes the observer's utterance of "Wait", and in response to this, voice is output. Figure 54(b) is what is displayed when the display device 1 recognizes the observer's utterance of "What a good child~", and in response to this, voice is output. Figures 54(c) and 55 are what are displayed when the display device 1 recognizes the observer's utterance of "Uno", and in response to this, voice is output.
[0201] <8. More detailed description of the character 1200> The character 1200 described with reference to FIGS. 1B, 1C and FIGS. 41 to 55 will be described in more detail. In the following description, for the description with the display device 1 as the processing subject, it may be regarded as the processing performed by the processing board 224. The character 1200 is preferably drawn at approximately life size. By doing so, it has been found that the sense of depth is particularly emphasized. The display device 1 preferably draws the character 1200 such that, when viewed from the side (horizontal side), in the vertical direction, the head occupies approximately one-third, the torso occupies one-third, and the legs occupy one-third of the height. For the character 1200 except for the tail, the display device 1 preferably draws it such that, when viewed from the side in the left-right direction, the head occupies approximately one-third and the torso occupies two-thirds.
[0202] The display device 1 has a function of drawing that mutually displaces between a state where the tail is not visible and a state where the tail is visible with a face in the front, and it is preferable that the time when the tail is visible is shorter than the time when the tail is not visible. Although the tail will be drawn deeper than the head, sometimes being able to see the tail can greatly enhance the sense of three-dimensionality, and constantly feeling a strong sense of three-dimensionality can prevent the eyes and head from getting fatigued. In particular, the display device 1 preferably performs such drawing processing in the voice recognition standby state. The display device 1 preferably has a function of drawing such that the tail appears from the top of the head when displacing to the state where the tail is visible. In this way, normally, when the observer's line of sight is on the eyes of the face and the tail suddenly jumps out above the head from the upper center thereof, it can give a sense of surprise and interest.
[0203] The display device 1 may be provided with a flat portion when viewed from the front at the top of the head of the character 1200, and in particular, the head portion between the left and right ears may be drawn flat when viewed from the front. In this way, a tail with a three-dimensional effect suddenly appears from the flat top of the head with a weak three-dimensional effect, which can give more surprise and interest. Also, after drawing the tail so that it appears from above the head, the display device 1 may perform drawing to move the portion closer to the tip of the tail. In this way, the viewing point can be focused on the portion of the tail behind the face, and a stronger three-dimensional effect can be felt. The display device 1 may similarly draw the tail so that it appears from the left and right sides of the body. When the display device 1 causes the tail to appear from the left and right sides, the length and / or time of the appearance of the tail may be made shorter than when the tail appears from above the head. When the display device 1 causes the tail to appear from the left and right sides, it may perform drawing to make it appear intermittently. The display device 1 may also perform drawing to move the line of sight to the back side from time to time, which can make the three-dimensional effect more perceptible. While the tail appears from above the head during voice recognition, the display device 1 may perform drawing to cause the tail to appear from either the left or the right direction when outputting voice from the cat. The display device 1 may be provided with a portion on the tail that has a drawing mode different from other portions at predetermined intervals in the length direction. For example, a pattern with a predetermined width may be attached in a circular or arc shape on the cylindrical surface of the tail at regular intervals. In this way, the inventors have found that the movement of the tail can be felt to move more dynamically in three-dimensional space.
[0204] When there is a change from a state where voice recognition is not in progress to a state where voice recognition is in progress, the display device 1 may perform drawing to change the current posture to the same posture so as to be in the same posture during voice recognition. The display device 1 may cause the voice "Let's talk nya" to be uttered before the start of voice recognition. The display device 1 may be provided with a function (such as a sensor or a switch) for detecting the actions of the observer, and may be provided with a function of uttering "What nya?" when an action from the observer is detected. Both functions may be continuously executed in the form of "What nya?" and "Let's talk nya", and then the processing may be performed so as to enter the voice recognition state.
[0205] The display device 1 has information on phrases such as "so cute" that are praised as speech recognition phrases. When a praised phrase is recognized, it is advisable to change the body posture. Furthermore, it is even better to move the position of the cat itself, such as walking. By doing so, since observers will want to see the changes in the cat's posture and movement, they will take praising actions and words, and excellent therapeutic effects such as improvement in actions and words can be obtained.
[0206] The display device 1 has a speech recognition phrase corresponding to giving food. When the phrase is recognized, it is advisable to perform a drawing of wagging the tail faster than in other cases. By doing so, it is possible to give the observer a feeling as if the cat is more actually alive.
[0207] The display device 1 may perform drawing processing such that the outline of the cat's eyes is generally circular and the black eye part is vertically elongated elliptical. The display device 1 may preferably draw the black eye part with a shading gradient in the vertical direction and draw it in a lighter color as it goes downward. The display device 1 may preferably provide a part that is darker than the periphery of a generally circular or elliptical shape at the center of the black eye. The display device 1 may preferably provide and draw a crescent-shaped or semi-circular white area along the outer edge of the black eye at a portion closer to the outside of the face above the black eye part. On the other hand, the display device 1 may preferably provide and draw a circular white area at a position closer to the center of the face below the black eye. The display device 1 may preferably continue to draw this white area even when there is a change in the position of the character 1200 (such as a change in posture), or a change in the position of the camera or light. Usually, highlights are often inserted by calculation as reflections of light or the like. However, by doing so, it is possible to emphasize the individuality of the cat's eyes, which are most visible during speech recognition conversations, and impress as an individual cat in a short time during speech recognition.
[0208] The display device 1 takes a state where the face is facing forward and a state where the face is facing downward. When the face is facing forward, the outline of the eyes is drawn generally circular, while when the face is facing downward, the eyes are drawn in a horizontally elongated elliptical shape.
[0209] The display device 1 takes on two states: one where the upper end of the face is above the upper end of the body, and the other where the upper end of the face is below the upper end of the body. When the upper end of the face is above the upper end of the body, the outline of the eyes is generally drawn in a circular shape, while when the upper end of the face is below the upper end of the body, the eyes are drawn in a horizontally elongated elliptical shape. The display device 1 has a function of depicting the state of yawning with the mouth open, and when doing so, it is advisable to draw the eyes closed.
[0210] The display device 1 may prepare multiple patterns of standby motions for the character 1200 and repeat the process of selecting one pattern from these patterns for drawing. Examples of standby motions include motions of licking the feet, stroking the face with the hand, licking the buttocks, facing forward, looking around left and right, licking the ground, stretching, yawning, walking, etc.
[0211] The display device 1 may draw the ears so that they move with a delay relative to the movement of the face. For example, even when the face starts to move, the ears may be drawn to maintain their position for a while. The display device 1 may be equipped with a function of simultaneously performing a motion of wagging the tail from side to side when performing a licking motion. When viewing the character 1200 from the front, the pattern on the body of the display device 1 may be made asymmetrical left and right. By doing so, it becomes easier to remember as an individualistic cat, and it also becomes easier to determine whether the right side or the left side is visible. This is particularly useful when providing a scene where the overall image of the character 1200 is enlarged so that it cannot be fully seen. In particular, the pattern is preferably that of a calico cat, and especially preferably that of a tiger cat. The inventors have found that this makes it particularly easy to grasp the three-dimensional effect. In particular, the pattern on the head is provided in the front-back direction, while the pattern on the body is provided in the up-down direction, etc., and the directions of the patterns may be made different. In this way, even when the position of the camera or the cat changes in any direction, it becomes easier to recognize.
[0212] The display device 1 is provided with a function of emitting a meowing sound, and the meowing sound includes those with a plurality of intonations, and different motions are associated with each meowing sound. It is preferable to adopt such a configuration. Among the intonations, there is an interrogative intonation, and as the motion, it is preferable to include a motion of tilting the head.
[0213] <9. Regarding the communication function of character 1200> Supplement the communication function regarding character 1200. By doing the following, it is possible to provide a higher-quality communication function with character 1200 to the observer. Here, an outline of the actions of the person until they get used to the pet and the action story of character 1200 will be described. In this embodiment, as shown in FIG. 32, a photographing unit 227 for photographing the observer is provided on the front side of the display device 1.
[0214] (9-1) First step: The stage until getting used to Normally, there are various types of cats such as stray cats that run away just by seeing a person or run away when a person approaches. At that time, the cat's behavior seems to run away while looking at the person while turning back several times. Here, the processing board 224 recognizes the presence of the observer based on the photographed image taken by the photographing unit 227, and when the intensity (received intensity) of the microwave measured by the human sensor 234 exceeds the threshold value, a video in which character 1200 performs an action of running away is displayed. This is to consider that a person has approached the cat. Recognizing the observer by the photographing unit 227 is for showing the observer the scene where character 1200 runs away. That is, unless the observer approaches the display device 1 from the front side, character 1200 is prevented from performing the action of running away.
[0215] Next, it is considered that a person calls out to the cat, such as "Squat down (lower your eye level)" or "Come here, come here". Sometimes, the cat stops and observes the situation. However, when the person approaches, the cat runs away. This is repeated several times. With such human behavior, it is thought that the cat will not get used to it. Therefore, while the character 1200 is shown running away on the display, when the intensity of the microwave measured by the human sensor 234 is below a certain threshold and, for example, a word indicating a call to the character 1200 such as "Come here" is recognized by voice recognition, a video showing the character 1200 performing an action to stop is displayed. Here, the condition that the intensity of the microwave is below the threshold is because a state where a human stops is assumed.
[0216] Next, it may be considered that a person gives food to a stationary cat. However, when a person approaches the cat, the cat runs away, so it is considered that the only option is to place food in a place where the cat often comes. Therefore, the display device 1 has a function of displaying an image in which food is placed within the video display space. For example, when the processing board 224 receives a predetermined operation using the operation area OT (for example, an operation of the operation unit 2214), or when a predetermined gesture indicating placing food is detected by the first sensor 2231, it assumes that the food has been placed and displays an image showing the food in the video. This video may be displayed using either the first display unit 310 or the second display unit 330. In this way, the observer will, for example, place food every day. At this time, the processing board 224 may make a display such that the character 1200 seems to be watching from afar. When the processing board 224 does not recognize the presence of the observer using the human sensor 234 and the observer is not photographed by the photographing unit 227, it displays an image in which the character 1200 eats the food. Here, it is reproducing a situation where the cat does not eat the food in front of people. From the observer's perspective, it creates a situation where the food has disappeared without them noticing. The processing board 224 counts the number of times the observer has given food and stores it. This state will continue for a while, but the processing board 224 may make a display that gradually reduces the distance between the observer, the character 1200, and the person (the distance felt by the observer) according to the number of times food has been given. For example, when starting to give food, as the number of times food has been given increases, the processing board 224 may display the character 1200 larger to reproduce the reduction in distance (that is, getting a little more used to it). Furthermore, when the number of times food has been given increases and reaches a predetermined threshold, assuming the cat has become accustomed, even when the observer is looking at the character, that is, when the processing board 224 recognizes the presence of the observer using the human sensor 234 and the observer is photographed by the photographing unit 227, it displays an image in which the character 1200 eats the food. Only at this time can the observer observe the character 1200 eating the food.
[0217] However, it is not uncommon for people not to know when a cat will eat. Therefore, the processing board 224 may determine the time period (alternatively, it may be a specific time point) when the character 1200 eats, and cause the character 1200 to perform the action of eating at that time period. This is to make the observer notice that it seems the character eats at this time period. When it is detected that the observer tries to touch the character 1200, the processing board 224 causes the character 1200 to output a voice of a predetermined utterance content "Shah" or "Shashah", and causes the character 1200 to perform an escaping action. The fact that the observer tries to touch the character 1200 may be identified by the intensity of the microwave detected by the human presence sensor 234 exceeding the threshold value when the character 1200 is performing the action of eating, or by the first sensor 2331 detecting a predetermined gesture.
[0218] Such a situation continues for a while, but the processing board 224 may gradually reduce the distance at which the observer's hand can approach the character 1200. When it approaches a predetermined distance, the processing board 224 may display an image in which the character 1200 performs an action of grooming or relaxing in front of people, assuming that the character 1200 has become accustomed to the observer. Specifically, the processing board 224 increases the threshold value for the intensity of the microwave, or increases the threshold value for the distance from the display device 1 when a gesture is performed. In this way, the processing board 224 reduces the detection sensitivity, dulls the reaction of the character 1200 to the observer's movement, and does not cause the character 1200 to make utterances such as "Shah" or "Shashah".
[0219] The cat is always on guard, but will gradually add actions such as grooming, lying down, scratching its claws, and wiping its face. As the cat gradually gets used to people and human hands, people will be able to touch the cat with their hands. Therefore, the processing board 224 may not reflect the microwave detection result by the human sensor 234 in the operation of the character 1200. The processing board 224 may function the first sensor 2331 as a motion sensor and display a video in which the character 1200 looks comfortable when being stroked according to the detection result of the gestures of the observer in the up-down, left-right, front-back directions. The processing board 224 may further recognize the voice of the observer by the microphone 2333 and display a video in which the character 1200 reacts to it. For example, no matter what words are recognized, the processing board 224 may be set to emit a meowing sound of "nya" as the utterance content.
[0220] Furthermore, as time passes, the processing board 224 may display a video in which the character 1200 begs for food. When the imaging unit 227 recognizes the presence of the observer and the human sensor 234 detects the presence of the observer, the processing board 224 may determine the time zone (for example, morning, noon, evening) and make the character emit a meowing sound of "nyar nyar" and display a video of performing an action of rubbing its face. Furthermore, when the observer talks to the character 1200, the processing board 224 may reproduce the appearance of the character 1200 remembering its own name. For example, the processing board 224 may only react to the word "Yuno" and emit a meowing sound of "nya", or react to the calls of "Yuno" and "There's food" and display videos of performing coquettish actions or looking happy while rubbing itself.
[0221] (9-2) Second step: The stage of learning the language (Japanese) When the processing board 224 recognizes a call from an observer named "Uno" at a certain time, it outputs a voice indicating a response of "What?". From here, it enters the stage where the character 1200 learns words. The processing board 224 counts the number of times it has been called, calculates the cumulative average per day, and makes a response according to a value calculated by the cumulative average per day of the number of times food has been given × the cumulative average of the number of times it has been called × a random coefficient (hereinafter referred to as the "cumulative average value"). This call is, for example, a predetermined call such as "Good morning", "Hello", "Good evening", "Are you okay?", "Do you want food?". The processing board 224 stops responding (that is, reproduces the situation where the character 1200 has forgotten words) or increases the words it responds with according to the cumulative average value. For example, the processing board 224 may decrease the words it responds with as the cumulative average value gets smaller, and increase the words it responds with as the cumulative average value gets larger. The cumulative average value is calculated based on the number of times it has been called from the start time of using the display device 1 to the current time, but it may also be calculated based on the number of times it has been called from a time point retroactively a predetermined period from the current time to the current time. The predetermined period may be fixed, such as one month, or when the display device 1 has not been used for a certain period, it may be the period after the start of use after that period. At the beginning when the use of the display device 1 starts, the cumulative average value can change greatly. For example, if the observer does not call even once a day, the character 1200 may stop responding, but as the number of calls increases, the cumulative average value will not change much. In this way, it is possible to reproduce the state where it takes time for the character 1200 to forget words. The random coefficient used in calculating the cumulative average value is a value for reproducing the capriciousness of a cat and may be called a capriciousness coefficient. The random coefficient may be changed by the actions of the character 1200 and the observer, such as giving food or not giving food when the character 1200 begs for food, or taking actions such as calling or touching to wake up the character 1200 when it is sleeping.
[0222] When the cumulative average value further exceeds a certain threshold, the processing substrate 224 may be configured to talk to the observer from the character 1200 or respond to questions regarding predetermined information such as weather and news. Of course, when the number of times the observer feeds the character decreases, the cumulative average value decreases, so the processing substrate 224 may reduce the types of responses or stop responding. That is, if the observer feeds the character in a haphazard manner or does not appropriately talk to it, the function of the character 1200 to respond may not be maintained, or even if it is maintained, there may be cases where it does not respond due to "capriciousness". In the above manner, it is possible to provide a higher-quality communication function with the character 1200 to the observer.
[0223] [Other Embodiments] The present disclosure is not limited to the above-described embodiments and can be appropriately modified without departing from the gist thereof.
[0224] The display device 1 may have an operation reception means such as a touch sensor, a proximity sensor, or other means for receiving the operations of the observer in the observation area SC. In this way, the observer can perform operations using the observation area SC. For example, if such an operation method is adopted in the communication function, an effect of improving the quality of communication with the character that can be observed through the observation area SC can be expected.
[0225] The first display unit 310 may display an image recognized as a three-dimensional video (stereoscopic video). In this way, an effect of further improving the stereoscopic feeling given to the observer can be expected. As the display method, in addition to the autostereoscopic display methods such as the lenticular lens method and the parallax barrier method, a display method that can be recognized as a three-dimensional video using glasses may also be used.
[0226] The display device is not limited to a rectangular parallelepiped shape, and may be a cube, a cylinder, other polyhedra, a spherical shape, or other shapes. Also, the shapes, structures, dimensions, colors, patterns, etc. of the respective components of the display device 1 described above are merely examples. Also, some of the components provided in the display device 1 described above may be omitted, or other components may be added. For example, the second display unit 330 may be omitted, or the second display unit 330 that emits the second image light L2 in the first direction may be arranged in a standing state instead of the background plate 910. Also, aerial imaging may be realized using an optical system other than that described with reference to FIG. 13. Also, the configuration of the present invention may be applied to a display device using a display method or a projector method instead of the aerial imaging method. In the case of the display method, a liquid crystal display, an organic EL display, or a display of another display method is used as the video display unit. For example, as the video display unit, a display unit provided inside the video display space and having a display surface (for example, a display surface parallel to the observation region SC) facing the direction of the observation region SC may be used. This display unit may have the same configuration as the first display unit 310 or the second display unit 330 and may be provided on the back surface portion of the video display space. In the case of the projector method, a projection surface and projection means for projecting an image thereon may be used. Also, the light shielding member 200 may be arranged on the front side or the back side of the opening 110 to reduce the light entering the video display space from the outside. Also, if the video display space S1 is maintained in a relatively dark state, a configuration in which the light shielding member 200 is not provided may also be considered.
[0227] Also, in the above embodiment, voice recognition for interacting with the character displayed on the video display unit is enabled in response to the pressing operation of the operation unit 2214, but it is not limited to this. For example, when the presence of a person is detected in the detection target area of a human sensor (an example of detection means) such as an omnidirectional microwave Doppler sensor, the processing board 224 may enable the voice recognition. In this way, when the user interacts with the character displayed on the video display unit, for example, there is no need to perform an operation for enabling voice recognition or utter a trigger word, and communication can be reproduced more naturally.
[0228] At this time, for example, it is preferable that both the voice recognition in the voice recognition application in the display device 1 and the voice recognition in the voice recognition server are enabled. However, as described below, the activation of the voice recognition in the voice recognition application in the display device 1 and the activation of the voice recognition in the voice recognition server may be executed step by step. For example, when the presence of a person is detected in the detection target area such as the human sensor, the voice recognition in the voice recognition application in the display device 1 is activated, and then, when a greeting or a call by an observer is detected by the voice recognition application, the voice recognition in the voice recognition server may be activated.
[0229] In addition, when the display device 1 is provided with a photographing unit (an example of detection means) such as a camera, a detection target space is provided on the front side of the display device 1, and the processing board 224 may be configured to activate voice recognition when the presence of a person is detected on the front side of the display device 1. In this way, it is possible to more reliably determine that the observer is trying to talk to the character displayed on the video display unit and then activate the voice recognition.
[0230] Furthermore, after a person is detected in the detection target area, it is preferable that the processing board 224 is configured to activate the voice recognition on the condition that the user authentication is successful. The authentication method for user authentication may be, for example, an authentication method that does not require the user's manual operation (such as face authentication or vocal cord authentication). In this way, for example, when user authentication is performed on a person other than the registered user registered in the display device 1 and the user authentication fails, the voice recognition is not activated and the user cannot interact with the character displayed on the video display unit. Conversely, for a person other than the registered user, the character displayed on the video display unit does not show a reaction. Thereby, the user's affection for the character can be increased.
[0231] In addition, when voice other than the words pre-registered in the display device 1 or the dialogue server mounted on the external server is detected, the voice recognition may not be activated.
[0232] In addition, an odor sensor may be used as a means for enabling voice recognition. For example, the odor of the registered user of the display device 1 may be registered in the display device 1 in advance, and when the odor of the registered user is detected by the odor sensor, voice recognition may be enabled.
[0233] Also, even if voice recognition is enabled in this way, for example, the voice of the character (e.g., character 1100) displayed on the video display unit may not be immediately output, and the voice of the character may not be output unless the user addresses the character. For example, in response to the activation of voice recognition, the processing board 224 may not immediately output a character voice such as "Welcome home," but may output a character voice such as "Welcome home" on the condition that a user voice such as "I'm home" is detected while voice recognition is enabled. Furthermore, for example, in an interactive system, a branching scenario for reproducing the following type of interaction between an observer and a character (e.g., character 1100) may be created. For example, on weekdays, User: I'm home Character: Welcome home~ User: Achoo Character: You must be tired in this hot weather such an interaction is reproduced, and on holidays, User: I'm home Character: Ah, welcome home User: Achoo Character: Don't complain since you went out in this hot weather User: It's work, it's work Character: If that's really the case, sorry, you've been working hard it is preferable that a branching scenario is created so that an interaction like this is reproduced.
[0234] Also, a branching scenario according to the detection result by the odor sensor may be created. For example, User: I made delicious food~ Character: "Hmmm, let me smell. Mmm. It smells good!" Or, "Huh!? Isn't it too salty? Be careful of your diet!" Dialogue like this may be reproduced.
[0235] Also, as another example, when an odor is detected by an odor sensor, Character: "Mmm, what's this smell?" User: "I burned some incense." Character: "Ah, no wonder I felt relaxed." Dialogue like this may be reproduced. If the response content of the observer to the question about the type of odor is not registered in the branch scenario, for example, a voice such as "Oh, I see!" may be uniformly output as the character voice.
[0236] Also, the processing board 224 may, for example, constantly record the voice for a recent predetermined time (for example, about 15 seconds), and when the voice of a trigger word for activating voice recognition is detected, activate the voice recognition. For example, the voice recognition application of the display device 1 may be constantly (or in response to a pressing operation of the operation unit 41, etc.) activated, and the voice recognition by the voice recognition server may be activated by the detection of the trigger word. At this time, the processing board 224 may transmit the voice data of the voice excluding the voice of the trigger word from the detected voice (for example, the voice detected between the detection start time and the detection end time) detected by the microphone 2333 (an example of a voice detection means) to the voice recognition server. For example, assume that user voice such as "I'm going to Tokyo tomorrow, but can you tell me the weather, Raytan?" is detected. Here, "Raytan", which is the pet name of the character 1100, is the trigger word. In this case, the processing board 224 transmits the voice "I'm going to Tokyo tomorrow, but can you tell me the weather, Raytan?" excluding the voice of the trigger word "Raytan" from the detected voice "I'm going to Tokyo tomorrow, but can you tell me the weather, Raytan?" to the voice recognition server.
[0237] Here, for example, if the detected voice "I'm going to Tokyo tomorrow, but tell me the weather, Reitan" as described above is directly sent to the speech recognition server, due to the inclusion of "Reitan" in the speech recognition result, the character voice corresponding to the speech recognition result may not be accurately extracted in the dialogue server, and there is a risk that the dialogue with the user will not match. On the other hand, if it is done as described above, even when the trigger word is uttered in the middle of a sentence, the voice data of the voice excluding the trigger word will be sent to the speech recognition server. Therefore, it is possible to suppress the situation where the dialogue with the user does not match due to the speech recognition being performed with the trigger word included in the middle of a sentence.
[0238] Also, when realizing the dialogue between the user and the character displayed on the video display unit through the cooperation of the speech recognition server and the dialogue server, the following operations may be executed according to the configuration of the speech recognition server.
[0239] For example, when the speech recognition server is configured to start the speech recognition process after receiving the voice data file, the processing board 224 may separately send each voice data file of the voice before and after the voice of the trigger word in the detected voice by the microphone 2333 to the speech recognition server. For example, among the detected voices from the detection start time to the detection end time, the voice data file of the user voice detected before the voice of the trigger word (also referred to as the first half of the user voice) may be sent to the speech recognition server ahead of the voice data file of the user voice detected after the voice of the trigger word (also referred to as the second half of the user voice).
[0240] In this way, in the voice recognition server, the voice recognition process for the first half of the user voice starts without waiting for the reception completion of the voice data file of the second half of the user voice. Therefore, compared with the case of transmitting the voice data file of the voice combining the first half of the user voice and the second half of the user voice to the voice recognition server, the voice recognition process can be efficiently performed. As a result, the display device 1 can receive the character voice from the dialogue server earlier, and can shorten the waiting time of the user until being responded to the user's voice.
[0241] Also, for example, when the voice recognition server is configured to perform the voice recognition process in real time by streaming and playing back the voice data from the display device 1, when the first half of the voice data is transmitted to the voice recognition server in real time, it is preferable to control the playback speed T1 of the first half of the user voice to be faster than the standard playback speed T0 (T1>T0). For example, the processing board 224 changes the setting so that the first half of the user voice is played back 25% faster than the standard playback speed T0 in the voice recognition server and transmits the first half of the voice data. In this way, in the voice recognition server, compared with the case where the first half of the user voice is played back at the standard playback speed T0, the voice recognition process for the first half of the user voice can be completed earlier, and the voice recognition process for the second half of the user voice can be started earlier. As a result, the display device 1 can receive the character voice from the dialogue server earlier, and can shorten the waiting time of the user until being responded to the user's voice.
[0242] Furthermore, when the voice data of the latter half of the user voice is transmitted to the voice recognition server in real time, it is preferably controlled such that the playback speed T2 of the voice in the latter half is faster than the standard playback speed T0 and slower than the playback speed T1 of the user voice in the first half (that is, the relationship of T0 < T2 < T1 is satisfied). For example, the processing board 224 changes the setting so that the user voice in the latter half is played back 10% faster than the standard playback speed T0 in the voice recognition server and transmits the voice data of the latter half. In this way, both the user voice in the first half and the user voice in the latter half are streamed and played back faster than the standard playback speed T0, and voice recognition processing is executed in the voice recognition server. As a result, the waiting time of the user until a response is made to the user's voice can be further shortened. On the other hand, the user voice in the latter half is played back at a speed faster than the standard playback speed T0 but slower than the playback speed T1 of the user voice in the first half. Therefore, a decrease in voice recognition accuracy in the voice recognition system can be suppressed. Therefore, it is possible to further shorten the waiting time of the user while suppressing a decrease in voice recognition accuracy.
[0243] In addition, in the voice recognition server, when voice recognition processing by streaming playback of voice data is executed in real time, for example, although the user voice detected by the microphone 2333 is transmitted to the voice recognition server in real time, it is preferably controlled such that voice recognition in the voice recognition server is not started until the voice of the trigger word is detected.
[0244] The scope of the present invention is not limited to the configurations explicitly described in the specification, but also includes combinations of various aspects of the present invention disclosed in this specification within its scope. Among the present invention, the configuration for which a patent is sought is specified in the appended claims, but even a configuration that is not currently specified in the claims has the intention of making the configuration disclosed in this specification the scope of the claims in the future.
[0245] The invention of the present application is not limited to the configurations described in the above-described embodiments. The constituent elements of the above-described embodiments and modification examples may be arbitrarily selected and combined. Also, any constituent element of each embodiment or modification example may be arbitrarily combined with any constituent element described in the means for solving the invention or a constituent element embodying any constituent element described in the means for solving the invention. With respect to these, there is also an intention to acquire rights in the amendment or divisional application of the present application. Even if there are descriptions such as "in the case of ~" or "when ~", it is not described as a configuration limited to that case or that time. The present disclosure also includes configurations other than these cases and times, and there is an intention to acquire rights. Also, the descriptions with an order are not limited to this order. The present disclosure also includes configurations in which some parts are deleted or the order is changed, and there is an intention to acquire rights.
[0246] Also, by changing to a design registration application, there is an intention to acquire rights for the overall design or partial design. When the device displays an image, there is an intention to acquire rights for a design including the whole or a part of the image. Although the drawings depict the whole of the present device in solid lines, the drawings include not only the overall design but also partial designs claimed for a part of the device. For example, it goes without saying that a part of the members of the device can be a partial design, and the drawings include partial designs of parts of the device regardless of the members. As a part of the device, it may be a part of the members of the device or a part of the members. Regarding the overall design, of course, there is an intention to claim as rights a partial design in which an arbitrary part of the solid-line part of the drawing is made into a broken-line part. Also, regarding the modules, members, parts, etc. inside the housing of the device, those shown in the drawings are all independently subject to transactions, and similarly, there is an intention to change to a design registration application and claim as rights.
Explanation of Reference Numerals
[0247] 1: Display device 100: Housing 101: Right panel 102: Front panel 103: Left panel 104: Rear panel 105: Upper cover 106: Lower cover 107: Right inner panel 108: Front inner panel 109: Left inner panel 110: Opening 200: Light reduction member 210: First region 220: Second region 221: Operation board 222: Slot 223: USB connector 224: Processing board 226: Holding part 227: Photographing part 231: Control board 232: Wiring 233: Sensor board 234: Human presence sensor 310: First display part 311: First display surface 312: Viewing angle control member 320: Optical member 321: First surface 330: Second display part 331: Second display surface 400: Pedestal part 500: Light shielding member 601: First plate 602: Second plate 800: Wiring part 810: Power cord 820: Signal line 830: Signal line 900: Partition member 910: Background board 1041: Rear cover part 1051: Opening 1052: Opening 1100: Character 1200: Character 1210: Character body 1220 : First wheel 1221 : Ticket 2100 : Stage video 2200 : Stage video 2211 : Operation unit 2212 : Operation unit 2213 : Operation unit 2214 : Operation unit 2251 : Speaker 2252 : Speaker 2261 : Heat sink 2311 : Power jack 2331 : First sensor 2332 : Second sensor 2333 : Microphone 2334 : Light-emitting part
Claims
1. a housing having a light-shielded image display space therein and a viewing area for viewing an image on a first direction side of the image display space; an image display unit that forms an aerial image in the image display space; a light-reducing member that reduces external light entering the image display space from the observation area, the image display unit includes a display member and an optical member; an optical member disposed in the image display space at an angle with respect to the light reducing member; a light blocking member provided on one end side of the optical member that is adjacent to the light reducing member, A display device in which the light blocking member is provided at a position that does not overlap the observation area when viewed from the first direction side.
2. The optical member is inclined with respect to the horizontal, The display device according to claim 1 , wherein the upper surface of the light blocking member is substantially horizontal.
3. The image display unit is inclined with respect to the horizontal direction. The display device according to claim 1 .
Citation Information
Patent Citations
Multilayer transparent imaging device
CN104330884A
Virtual image type meter
JP1994262965A
Head-up display device
JP1996238956A
Display
JP2000219060A
Stereoscopic image display device with no glasses
JP2003295113A