Display device and the like
The display device enhances visibility and immersion by using a light-shielded housing and attenuation member to reduce external light and reflections, addressing visibility issues in existing display technologies.
Patent Information
- Application Number
- JP2025084505
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2020-01-23
- Filing Date
- 2025-05-21
- Publication Date
- 2025-08-01
- Estimated Expiration
- 2040-03-31
AI Technical Summary
Existing display devices face issues with reduced visibility of displayed images due to the combination of image light from the image display unit and external light, which can impair the viewer's perception of the image.
The display device incorporates a housing with a light-shielded internal space, an image display unit, and a light attenuation member to suppress external light entry and direct image light from reaching the viewer, enhancing visibility by reducing glare and reflections.
The solution provides high visibility and a more immersive experience by minimizing external light interference and reflections, allowing for clearer recognition of three-dimensional images and improved user interaction.
Smart Images

Figure 2025113375000001_ABST
Abstract
Description
Technical Field
[0001] For example, it relates to a display device capable of displaying an image, etc.
Background Art
[0002] There are display devices having an image display unit and displaying a two-dimensional image or a three-dimensional image on the image display unit. For example, Patent Document 1 shows a display device that displays a three-dimensional image on an image display unit.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] However, the inventors of the present application have obtained the knowledge that in a display device as described in Patent Document 1 or the like, depending on the configuration of the display device, for example, the image light from the image display unit and the external light may combine to reduce the visibility of the displayed image.
[0005] One object of the present invention is to provide a display device or the like that can obtain high visibility with respect to a displayed image.
[0006] The object of the present invention is not limited to this, and the applicant also has the intention to obtain rights through divisional applications, amendments, etc. for configurations aimed at obtaining effects resulting from parts of the configurations disclosed in this specification, drawings, etc. For example, the problems obtained by reading the parts described as "~ can be done" in this specification as "~ is a problem" are disclosed in this specification. The problems are described as independent ones, and the applicant also has the intention to obtain rights through divisional applications, amendments, etc. alone for the configurations for solving each problem. Even if the problems are implicitly grasped from the description of the specification, the applicant has the intention to make part of the configurations described in this specification the scope of claims through amendment or divisional application. In addition, the applicant also discloses configurations for solving the problems obtained by combining these independent problems and has the intention to obtain rights.
Means for Solving the Problems
[0007] The object of the present invention can be achieved, for example, in the following forms (1) to (23).
[0008] (1) A display device for displaying an image, comprising a housing provided with an opening for viewing the image on the first direction side in a light-shielded internal space, an image display unit disposed in the internal space, and a light attenuation member disposed on the first direction side of the image display unit with a space therebetween.
[0009] In this way, it is possible to suppress the entry of external light into the internal space of the housing, and it is also possible to suppress the direct reaching of the image light from the image display unit to the eyes of the viewer. Therefore, it is possible to suppress the difficulty of visually recognizing the image recognized in the internal space of the housing due to the combination of the image light from the image display unit and the external light, and it is possible to provide a display device capable of obtaining high visibility with respect to the displayed image.
[0010] (2) The light attenuation member may be disposed between the opening and the image display unit.
[0011] By doing so, a space region is formed inside the housing on the side where the image is viewed rather than the light-shielding member, so that the space region can be used for a predetermined purpose.
[0012] (3) The surface of the light-shielding member on the first direction side may be inclined with respect to the display surface of the image display unit.
[0013] By doing so, when a viewer views the image display unit through the light-shielding member, it is possible to reduce the reflection of the viewer's face on the light-shielding member.
[0014] (4) The image display unit may display, as an image recognized as a three-dimensional image, a first image at least a part of which is recognized to exist on the opening side rather than the light-shielding member.
[0015] By doing so, the viewer can obtain a feeling of being able to touch an image that can be recognized as a three-dimensional image.
[0016] (5) The image display unit may selectively display any one of a plurality of images including the first image and a second image recognized to exist on the first direction side or the second direction side opposite to the first direction side rather than the first image as an image recognized as a three-dimensional image.
[0017] By doing so, it is possible to selectively display any one of a plurality of images including the first image and the second image, where the positions where the images are recognized to exist as three-dimensional images by the viewer are different, so that the three-dimensional feeling given to the viewer can be changed.
[0018] (6) It further has an audio output unit provided in the housing, and the audio output unit may be provided at a position on the first surface facing the internal space of the housing, on the first direction side rather than the light-shielding member and at a distance from the light-shielding member smaller than the distance from the opening.
[0019] In this way, since the sound output by the sound output unit may be reflected by the light shielding member and transmitted to the viewer, the viewer can be made to feel as if the sound is coming from, for example, the image itself displayed on the image display unit. Further, since the sound output unit is arranged at a position that is difficult to see from the viewer, the design property of the display device can also be enhanced.
[0020] (7) The upper end of the opening may be provided further above the upper end of the display surface of the image display unit, and the upper surface of the internal space may be inclined downward as it goes from the upper end of the opening to the upper end of the display surface.
[0021] In this way, since the image displayed on the image display unit can be visually recognized while looking down, it is possible to make it easier for the viewer to visually recognize the image in a natural posture.
[0022] (8) The image display unit may include a light source and a display body that modulates light from the light source to display an image.
[0023] In an image display unit that modulates light from a light source to display an image, there is a risk that the light from the light source leaks out and the position of the light source is recognized by the viewer, thereby impairing the floating feeling as if an image is floating in the internal space. Due to the presence of the light shielding member, it becomes difficult to visually recognize the light leaking from the light source, so a higher floating feeling of the image can be given.
[0024] (9) The upper end of the opening may protrude more toward the first direction side than the lower end of the opening.
[0025] In this way, it is possible to suppress the reduction in the visibility of the image in the image display unit due to the light from above the display device being reflected by the light shielding member.
[0026] (10) The housing has a cover portion on the upper surface of the housing, and has an accommodation space between the cover portion and the upper surface of the inner peripheral surface of the housing. The control unit related to the display device may be disposed in the accommodation space.
[0027] In this way, the maintenance of the control unit related to the display device can be performed by removing the cover portion provided on the upper surface of the housing. Therefore, the maintainability of the display device can be improved.
[0028] (11) It is provided with a power supply unit provided below the internal space of the housing, and the connection cord for electrically connecting the power supply unit and the control unit may be wired so as to pass through a gap region secured between the outer peripheral wall of the housing and the internal space.
[0029] In this way, the power supply unit is disposed at a position where it is not easily noticeable, and the center of gravity position of the display device can be lowered, making it easier to stabilize its posture. Also, the connection cord connecting the power supply unit and the control unit can be wired so as not to be visible to the viewer.
[0030] (12) The cover portion is attached to the main body portion of the housing at a plurality of attachment positions, and the cover portion and the main body portion are coupled using a first fixture at a first attachment position on the first direction side among the plurality of attachment positions at a position inside the outer peripheral wall of the housing, and at a second attachment position on the second direction side opposite to the first direction from the first attachment position of the display device, they may be coupled using a second fixture from the outside of the outer peripheral wall of the housing.
[0031] In this way, at the second attachment position where it is difficult for the viewer to touch, the cover portion and the main body portion are coupled from the outside of the outer peripheral wall of the housing using a second fixture that can be detached from the outside, and at the first attachment position where it is easy for the viewer to touch, the cover portion and the main body portion are coupled using a first fixture at a place where it is difficult for the viewer to visually observe, so the designability of the display device can be enhanced.
[0032] It is preferable that the display device further includes an operation unit provided in a lower portion of the housing on the first direction side of the opening in the housing.
[0033] In this way, when the viewer operates the operation unit, for example, the viewer's hand does not overlap the displayed image on the image display unit, and the viewer can operate the operation unit while viewing the displayed image on the image display unit. Therefore, it becomes easier for the viewer to operate the operation unit, and the operability of the display device can be improved.
[0034] It is preferable that a plurality of the light dimming members are detachably provided.
[0035] In this way, the brightness of the image displayed on the image display unit can be adjusted without providing a separate adjustment member.
[0036] It is preferable that the display device further includes an action detection means capable of detecting the action of the viewer and an action control means for controlling the action of the specific character according to the detection result by the action detection means, where a specific character is displayed on the image display unit.
[0037] In this way, when the action of the viewer is detected, a specific character acts according to the detection result, so that the communication between the viewer and the specific character can be reproduced.
[0038] The action detection means is an action detection sensor capable of detecting the behavior of an object, and the action detection sensor is preferably arranged to detect a gesture performed in the internal space of the housing.
[0039] In this way, the action detection sensor can detect, for example, the gesture of the viewer in the internal space of the housing. Therefore, a decrease in the sensitivity of the action detection sensor can be suppressed as compared with the case where the action detection sensor is arranged on the outer peripheral surface of the housing.
[0040] (17) The behavior detection sensor may be arranged on the upper surface of the inner peripheral surface of the housing.
[0041] In this way, since the behavior detection sensor is provided on the surface of the inner peripheral surface of the housing where it is more difficult for light from the outside to enter, it is possible to suppress a decrease in the sensitivity of the behavior detection sensor.
[0042] (18) The behavior detection sensor emits light, receives the reflected light thereof to detect the gesture, and further includes a member that is provided in the light emission direction of the light and suppresses the emitted light from being received by the behavior detection sensor. It is preferable to use a display device.
[0043] In this way, it becomes difficult to receive the reflected light from the part of the housing existing in the light emission direction of the light of the behavior detection sensor, so that a decrease in the sensitivity of the behavior detection sensor can be further suppressed.
[0044] (19) An odor sensor for detecting an odor, a display output operation for displaying, on the image display unit, an image in which a character performs a movement according to the detection result by the odor sensor, and an audio output operation for outputting, as a voice emitted by the character displayed on the image display unit, a voice according to the detection result by the odor sensor. It is preferable to further include an operation control means for executing at least one of them.
[0045] In this way, it is possible to reproduce communication regarding odor between the character displayed on the image display unit of the display device and the user. For example, when an odor is detected by the odor sensor, it can be controlled so that an audio output operation in which the character emits a voice such as "It smells like something" or a display output operation of an image in which the character performs an action of smelling the odor is performed. Therefore, more diverse communication can be achieved between the character and the user.
[0046] (20) The said display output operation is an operation of displaying, on the said image display unit, a video in which the said character makes movements according to the detected type of smell, and the said voice output operation may be an operation of outputting, as the voice uttered by the said character, a voice according to the detected type of smell.
[0047] In this way, communication regarding the type of smell between the character displayed on the image display unit and the user can be reproduced. For example, when the smell of tobacco is detected, a display output operation of displaying a video in which the character makes a movement of being irritated by the smoke, or a voice output operation of uttering words expressing concern for the user's health can be executed. Also, when the smell of a fragrance such as an aromatic oil is detected, a voice output operation of uttering a question regarding the fragrance can be executed. By performing such control, the range of communication between the character displayed on the image display unit and the user can be widened, and the user's affection for the said character can be increased.
[0048] (21) It further includes voice detection means capable of detecting voice, and detection means capable of detecting the presence of a person in the detection target area. When the presence of a person in the said detection target area is detected, the said voice detection means may activate voice recognition for having a conversation with the character displayed on the said image display unit.
[0049] In this way, when having a conversation with the character displayed on the image display unit and the user, for example, it is not necessary for the user to utter a trigger word for activating voice recognition, and communication can be taken more naturally.
[0050] (22) It further includes wind detection means for detecting wind, operation control means for executing at least one of a display output operation of displaying, on the said image display unit, a video in which the character makes movements according to the detection result of the said wind detection means, and a voice output operation of outputting, as the voice uttered by the character displayed on the said image display unit, a voice according to the detection result of the said wind detection sensor.
[0051] In this way, it is possible to reproduce the communication regarding the wind given to the display device between the character displayed on the image display unit and the user. The wind may be, for example, caused artificially by the user, such as the wind generated by moving a body part such as waving a hand toward the display device or the wind generated by blowing breath.
[0052] (23) The operation control means may perform the display output operation or the voice output operation according to the breath blown by the user based on the detection result by the wind detection means.
[0053] In this way, it is possible to reproduce the communication according to the breath blown to the display device between the character displayed on the image display unit and the user. [Advantages of the Invention]
[0054] According to the present invention, it is possible to provide a display device or the like that can obtain high visibility with respect to the display image.
[0055] Note that the effects of the invention of the present application are not limited to this, and the effects exerted by the constituent parts disclosed in this specification, drawings, etc. are also disclosed, and the applicant has the intention to obtain rights for the configurations exerting such effects by divisional applications, amendments, etc. For example, in this specification, the parts described as "can" or "is possible" are descriptions that clearly indicate the effects exerted, and even if there is no such description as "can" or "is possible", there are parts indicating the effects. Also, even if there is no such description, there are effects grasped by the said configuration. [Brief Description of the Drawings]
[0056]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13
Figure 14
Figure 15
Figure 16
Figure 17
Figure 18
Figure 19
Figure 20
Figure 21
Figure 22
Figure 23
Figure 24
Figure 25
Figure 26
Figure 27
Figure 28
Figure 29
Figure 30
Figure 31
Figure 32
Figure 33
Figure 34
Figure 35
Figure 36
Mode for Carrying Out the Invention
[0057] [Schematic Configuration of Display Device] FIG. 1 is a perspective view showing a display device 1 according to an example of the present invention. FIG. 2(A) is a front view showing the display device 1 according to an example of the present invention, and FIG. 2(B) is a rear view showing the display device 1 according to an example of the present invention. FIG. 3(A) is a right side view showing the display device 1 according to an example of the present invention, and FIG. 3(B) is a left side view showing the display device 1 according to an example of the present invention. FIG. 4(A) is a plan view showing the display device 1 according to an example of the present invention, and FIG. 4(B) is a bottom view showing the display device 1 according to an example of the present invention. FIG. 5 is an exploded perspective view showing the display device 1 according to an example of the present invention. FIG. 6 is a cross-sectional view taken along the line A-A in FIG. 2(A). Hereinafter, with reference to FIGS. 1 to 6, the schematic configuration of the display device 1 according to an example of the present invention will be described.
[0058] In each figure and the like, the left-right direction of the display device 1 is defined as the X direction, and the direction from the left side to the right side of the display device 1 is defined as the +X direction (the positive direction of the X direction). Also, the front-rear direction (depth direction) of the display device 1 is defined as the Y direction, and the direction from the front side (front side) to the back side (rear side) of the display device 1 is defined as the +Y direction (the positive direction of the Y direction). Further, the up-down direction of the display device 1 is defined as the Z direction, and the direction from the lower surface side to the upper surface side of the display device 1 is defined as the +Z direction (the positive direction of the Z direction).
[0059] The display device 1 is used for various applications. For example, the display device 1 may be for commercial use (e.g., for attracting customers, for advertising), for entertainment (for entertaining people), or for toys, etc. For example, in the case of commercial or entertainment use, the display device 1 may be installed in public places such as stores or other commercial facilities. The display device 1 is used, for example, at a venue such as an exhibition of products or services to attract customers by displaying an image in which a specific character introduces or promotes the product or service, and to entertain the visitors. Alternatively, the display device 1 may be installed in various amusement facilities, etc., and used to entertain the visitors to the amusement facilities. In the case of a toy, the display device 1 is installed in the user's home, etc. Further, when a three-dimensional image is displayed on the display device 1 as described later, it may be used to entertain the viewer by allowing the viewer to experience the stereoscopic view of the display object. The viewer is, for example, the user who uses the display device 1.
[0060] As shown in FIG. 5, the display device 1 includes a housing 10, an image display unit 20 capable of displaying an image of a display object, and a light reduction member 30.
[0061] The housing 10 is a box-shaped member that forms the outer shape of the display device 1. The housing 10 has a ratio of the lengths (maximum lengths) in the width direction (also referred to as the left-right direction), the height direction (also referred to as the up-down direction), and the depth direction (also referred to as the front-back direction) of approximately 1:1:1. However, this ratio of lengths is an example, and at least a part thereof may be different. The housing 10 has R-shaped corners. For example, when the display device 1 is viewed from the front side, the four corners of the housing 10 are each rounded. The housing 10 may be sized to accommodate an image display unit 20 of a predetermined size (e.g., 17-inch size) inside it.
[0062] The housing 10 has an opening 5 on the front side (the -Y side in each figure) of the display device 1. The front side of the display device 1 corresponds to the side where the viewer views the image displayed by the display device 1. The opening 5 is formed on the front side of the display device 1 in the internal space of the housing 10. For example, as shown in FIG. 2(A), the opening 5 is formed in a rectangular shape when viewed from the front side of the display device 1. The housing 10 has an internal space 100. The internal space 100 is the space inside the housing 10 where the image is displayed. The portion of the internal space 100 other than the opening 5 is surrounded by a light-shielding member (see FIG. 6). External light does not enter the internal space 100 through the members constituting the housing 10. Therefore, the housing 10 may be formed entirely of a material that blocks external light, or the outer surface and the surface facing the internal space 100 may be covered with a material that blocks light. In FIG. 6, the internal space 100 is indicated by a dashed line, and the two space regions 101 and 102 obtained by dividing the internal space 100 by the light-dimming member 30 are indicated by a chain double-dashed line. The space region 101 is the space on the back side of the light-dimming member 30. The space region 101 has a larger dimension in the height direction toward the back side, and the dimension becomes smaller as it moves toward the front side. The space region 102 is the space on the front side of the light-dimming member 30. The space region 102 has a smaller dimension in the height direction toward the back side, and the dimension becomes larger as it moves toward the front side. In the present embodiment, the opening 5 is specified by a planar region that allows the space region 101 to communicate with the external space. Therefore, the opening 5 may be read as an opening surface. The internal space 100 has a certain region in the depth direction (front-rear direction) of the housing 10, and as shown in the YZ cross-section of FIG. 6, the housing 10 has a longer length in the depth direction at the upper end than at the lower end. The internal space 100 may be recognized by the viewer, for example, as the living space of a stereoscopically displayed character.
[0063] For example, the housing 10 is formed of a resin member or the like, and a dark-colored (e.g., black) rubber coating is applied to its surface (e.g., at least one of the outer peripheral surface and the inner peripheral surface). Thereby, light is configured not to enter the internal space 100 of the housing 10 from portions other than the opening 5. Note that it is not essential for the internal space 100 to be surrounded by a light-shielding member in all portions other than the opening 5, and it suffices if the internal space 100 is surrounded by a light-shielding member so as to be somewhat dark. The housing 10 may be formed of a material other than a resin material, such as metal or other materials. Also, although the color of the outer surface of the housing 10 is not limited, it may be, for example, white or black that gives a sense of luxury or simplicity. The surface of the housing 10 may be processed to produce a texture by matte finishing.
[0064] Also, as shown in FIG. 5, the housing 10 includes a main body portion 11, an upper surface cover portion 12, a placement portion 13 for the light-dimming member 30, a bottom surface cover portion 14, and a rear surface cover portion 15. Note that each of the members 12 to 15 is attached to the main body portion 11 by a fixture such as a screw, except for a part of the upper surface cover portion 12 (described later).
[0065] Next, the image display unit 20 will be described. The image display unit 20 is a display unit having a light source. Examples of the image display unit 20 include a liquid crystal display. In this case, the image display unit 20 includes a backlight, which is an example of a light source, and a display body 28 (see FIG. 5) in which liquid crystal elements, which are examples of display elements, are two-dimensionally arranged. The light source is, for example, a white light source. The liquid crystal element modulates light from the backlight in pixel units. The liquid crystal element has, for example, a configuration in which liquid crystal molecules are sandwiched between a pixel electrode provided in pixel units and a common electrode common to a plurality of pixels. The image display unit 20 displays a color (multi-color) image based on the three primary colors of red (R), green (G), and blue (B). The image display unit 20 displays an image so as to be recognized as a three-dimensional image in this embodiment. The image display unit 20 is a 17-inch liquid crystal display in this embodiment.
[0066] The image display unit 20 is preferably configured to be able to display a three-dimensional image of the object to be displayed, and may be a display capable of stereoscopic display with the naked eye. Further, it is even better if the image display unit 20 is configured to be able to switch between a three-dimensional image and a two-dimensional image. For the image display unit 20, for example, an image of an object to be displayed such as a specific character (e.g., a person or an animal, etc.) may be displayed. For example, it is preferable that the humanoid character 1000 is display-controlled in the image display unit 20 so as to be stereoscopically viewed by the viewer as shown in FIG. 13. The character 1000 is a character imitating a historical figure here, but it may also be a female character, an animal (e.g., a cat) character, or other characters. It is not limited to this, and various images can be displayed on the image display unit 20. Further, hereinafter, the character (an example of the object to be displayed) that is stereoscopically displayed is also referred to as a "3D character", etc. The 3D character is an example of a 3D object.
[0067] Thus, the display device 1 is preferably a device capable of reproducing stereoscopic display with the naked eye. Such a display device 1 is also referred to as, for example, a "naked-eye stereoscopic display device".
[0068] The naked-eye stereoscopic display is preferably reproduced, for example, by using the lenticular lens type image display unit 20. For example, on the display surface 29 of the image display unit 20, a lenticular lens in which a plurality of semi-cylindrical lenses are arranged is provided, and the image display unit 20 displays an image sequence group (also referred to as a lenticular image, etc.) composed of a combination of a plurality of image sequences that have been interlaced with respect to the three-dimensional image. When the viewer views the image sequence group through the lenticular lens from an appropriate position, the three-dimensional image appears three-dimensional due to the visual illusion caused by the binocular parallax.
[0069] As shown in FIG. 6 and the like, the image display unit 20 is disposed in the internal space 100 of the housing 10 so that an image can be visually recognized through the opening 5 provided on the front side of the display device 1. For example, the image display unit 20 is disposed along the back surface (inner wall surface) of the inner peripheral surface of the housing 10. In the present embodiment, as shown in FIG. 6, the back surface of the inner peripheral surface of the housing 10 is provided substantially perpendicular to the bottom surface of the housing 10, and the image display unit 20 is also provided substantially perpendicular to the bottom surface of the housing 10.
[0070] Next, the light-shielding member 30 will be described. The light-shielding member 30 is an optical member that reduces external light entering the internal space 100 through the opening 5. The light-shielding member 30 is a plate-shaped (including panel-shaped) or film-shaped member. Further, the light-shielding member 30 can reduce the amount of light from the image display unit 20 (for example, light from the backlight of the image display unit 20). The light-shielding member 30 is provided to maintain the internal space 100 in a dark state. The reason will be described later. In addition, the light-shielding member 30 also contributes to suppressing the occurrence of reflection in which the viewer himself / herself looking at the image through the opening 5 is reflected on the light-shielding member 30 and making it difficult to visually recognize the components inside the internal space 100. The light-shielding member 30 may be a member called a smoke panel, a smoke film, or the like. Since the light-shielding member 30 allows at least the image light from the image display unit 20 to pass through to the front side, it can be optically regarded as a transparent member. Examples of the light-shielding member 30 include a dark-colored panel member having a predetermined light transmittance (for example, about 6%). Note that the present invention is not limited to this, and the light-shielding member 30 may be, for example, a dark-colored film having a predetermined light transmittance attached to a colorless transparent panel member. The light-shielding member 30 is a member of a dark color system such as black, but may be a blue color system or other colors.
[0071] The light-shielding member 30 is disposed in the internal space 100 of the housing 10 at a distance from the image display unit 20 on the front side of the image display unit 20. In the present embodiment, it is disposed between the opening 5 and the image display unit 20 so as to have a space region 101 (FIG. 6) between it and the image display unit 20.
[0072] By having the housing 10 have the light-shielded internal space 100 as described above, it is possible to suppress the entry of external light into the internal space 100 of the housing 10. Also, for example, on the front side of the image display unit 20, by arranging the light-reducing member 30 at a distance from the image display unit 20, it is possible to suppress the image light from the image display unit 20 from directly reaching the eyes of the viewer. Therefore, it is possible to suppress the image recognized in the internal space 100 of the housing 10 from being difficult to visually recognize due to the combination of the image light from the image display unit 20 and the external light, and it is possible to provide the display device 1 that can obtain high visibility with respect to the displayed image.
[0073] Further, since the light-reducing member 30 is arranged between the opening 5 and the image display unit 20, a space region (for example, the space region 102 (see FIG. 6)) is formed on the front side of the light-reducing member 30 inside the housing 10, so that the space region can be used for a predetermined purpose.
[0074] Here, if there is no light-reducing member 30 and the viewer directly looks at the image display unit 20 itself on which the three-dimensional image of the object to be displayed is displayed, the light from the light source leaks out and the position of the light source is recognized by the viewer, so that the viewer can recognize that "the object to be displayed is reflected on the image display unit 20". As a result, there may be a situation where a sufficient floating feeling as if the object image to be displayed is floating in the internal space 100 cannot be obtained.
[0075] On the other hand, when the light-reducing member 30 is provided as described above, the amount of image light emitted from the peripheral region of the object to be displayed in the image display unit 20 is suppressed by the light-reducing member 30, and the peripheral region is difficult for the viewer to see. As a result, the viewer does not feel that "the object to be displayed is reflected on the image display unit 20", and a floating feeling of the object to be displayed can be obtained. Therefore, the visibility with respect to the display image of the object to be displayed can be enhanced.
[0076] Also, for example, when the viewer directly observes the image display unit 20 itself on which the three-dimensional image of the object to be displayed is shown, although the object to be displayed appears three-dimensional to the viewer, a blurred image may be seen around the object to be displayed. In such a case, there is a risk that the viewer may find it difficult to view the three-dimensional image of the object to be displayed.
[0077] On the other hand, when the light reduction member 30 is provided as described above, the amount of light emitted from the image display unit 20 is reduced by the light reduction member 30, and the image light of the blurred image around the object to be displayed is also reduced by the light reduction member 30. As a result, it becomes difficult for the viewer to see the blurred image, and it becomes easier to recognize the object to be displayed as a three-dimensional image. Furthermore, since the presence of the light reduction member 30 makes it difficult to visually recognize the components existing in the internal space 100, it is also less likely that the viewer will be distracted by being able to see such components.
[0078] [Detailed Configuration of Each Element] Next, the detailed configuration of each of the elements 10, 20, and 30 will be described.
[0079] The light reduction member 30 has a front surface that is inclined with respect to the vertical direction. In the present embodiment, as shown in FIG. 6, the light reduction member 30 is inclined at a predetermined angle (for example, an angle of about 50 degrees) from its upper end portion 31 toward the opening portion 5 side (the front side of the display device 1), for example, with respect to the bottom surface of the housing 10. For example, as shown in FIG. 5, the upper surface of the arrangement portion 13 of the light reduction member 30 is inclined at a predetermined angle with respect to the bottom surface of the housing 10, and the light reduction member 30 is arranged on the upper surface of the arrangement portion 13.
[0080] In this way, the optical path of the reflected light of the light incident on the light-reducing member 30 is in a direction different from the viewer's eyes (or face). Therefore, when the viewer looks at the image display unit 20 through the light-reducing member 30, the viewer's face can be prevented from being reflected in the light-reducing member 30. As long as this purpose can be achieved, the tilt angle and tilt direction of the light-reducing member 30 can be modified in various ways. Therefore, it is possible to provide a display device 1 with higher visibility.
[0081] Furthermore, inside the housing 10, a spatial region 102 (see FIG. 6) into which the viewer can place his / her hand can be provided on the opening 5 side of the light reducing member 30.
[0082] The image display unit 20 may then be controlled to display at least a portion of the display object (for example, a part of the body of a specific character) that is viewed stereoscopically by the viewer at the position where the dimming member 30 is located. In this way, the viewer can insert their hand into the spatial region 102 that is closer to the opening 5 than the dimming member 30, and get the sensation of touching the display object (for example, a humanoid character 1000 (see FIG. 13 ), an example of a first image) that appears three-dimensionally and appears floating in the spatial region 102. Therefore, for example, it is possible to provide a display device that is highly entertaining.
[0083] Furthermore, by providing the spatial region 102 as described above, it is possible to increase the degree of freedom in the placement position of the gesture sensor 63 and the like, which will be described later.
[0084] 2(A) and 6, the housing 10 further includes a speaker 62 (an example of an audio output unit). The speaker 62 is provided on the surface of the housing 10 facing the internal space 100, closer to the front than the light-attenuating member 30, and at a position where the distance from the speaker 62 to the light-attenuating member 30 is smaller than the distance from the opening 5. In this embodiment, the speaker 62 is provided on the upper surface 85 of the internal space 100 of the housing 10, closer to the light-attenuating member 30 (toward the back of the housing 10) than an intermediate position 201 between the upper end 21 of the light-attenuating member 30 and the upper end 51 of the opening 5.
[0085] In this way, since the sound output by the speaker 62 may be reflected by the light shielding member 30 and transmitted to the viewer, the viewer can be made to feel that sound is coming from, for example, the display object (e.g., a specific character) itself displayed on the image display unit 20. This effect is particularly effective when the display control is such that at least a part of the display object stereoscopically viewed by the viewer (e.g., a part of the body of a specific character) exists at the position where the light shielding member 30 is disposed. Also, since the speaker 62 is disposed at a position where it is difficult to be seen by the viewer, the design property of the display device 1 can be enhanced.
[0086] Also, as shown in FIG. 6, the upper end portion 51 of the opening 5 is provided above the upper end portion 21 of the image display unit 20 (specifically, the display surface 29), and the upper surface 85 of the internal space 100 of the housing 10 is inclined downward (in the -Z direction in FIG. 6) from the upper end portion 51 of the opening 5 toward the upper end portion 21. In this way, it is possible to view the image displayed on the image display unit 20 while looking down from a position higher than the upper end portion 21 of the image display unit 20. Therefore, it is possible to make it easier for the viewer to view the image in a natural posture. For example, the display device 1 is placed on a desk. In front of the display device 1 (on the front side), there is a viewer standing or sitting on a chair. It is assumed that the position of the viewer's eyes is higher than the upper surface of the display device 1. Therefore, the viewer views the display device 1 at an angle θ while looking down. The angle θ is the angle between the horizontal direction and the viewer's line of sight. The angle θ is assumed to be, for example, 15 degrees, but it may vary depending on the usage situation of the display device 1. Based on the assumption of such an angle θ, it is preferable that the inclination angle of the upper surface 85 is determined so that the viewer can view the entire display surface of the image display unit 20 or the entire display area of the image to be viewed by the viewer. Also, it is possible to relatively widely secure the space area 110 for the control unit described later.
[0087] Also, as shown in FIG. 6, the upper end portion 51 of the opening 5 of the housing 10 is provided so as to protrude toward the front side (an example of the first direction side) more than the lower end portion 52 of the opening 5. This protruding portion is also referred to as an eaves. By doing so, it is possible to suppress the reduction in the visibility of the image in the image display unit 20 due to the light from above the display device 1 being reflected by the light attenuation member 30.
[0088] As shown in FIGS. 1 and 6, a diagonal portion 84 is provided on the opening 5 side (front side) in the lower portion of the housing 10. And the side portion 53 (see FIG. 3) of the opening 5 is provided to be inclined at a predetermined angle so as to extend from the upper end portion 51 of the opening 5 toward the vicinity of the upper portion 88 of the diagonal portion 84. For example, the side portion 53 of the opening 5 is provided to be inclined so as to be substantially perpendicular to the light attenuation member 30.
[0089] Also, as shown in FIG. 6, the upper portion 88 of the diagonal portion 84 is provided above the lower end portion 22 of the image display unit 20, and the lower surface 86 of the internal space 100 of the housing 10 is provided to be inclined downward as it extends from the upper portion 88 of the diagonal portion 84 toward the lower end portion 22 of the image display unit 20.
[0090] Here, regarding naked-eye stereoscopic display, the larger the so-called 3D effect (three-dimensional effect) is, the smaller the display object to be stereoscopically viewed by the viewer may become. By inclining the lower surface 86 of the internal space 100 as described above, even when the 3D effect is increased, the lower part of the display object to be stereoscopically displayed (for example, the feet of a specific character) can be displayed near the upper portion 88 of the diagonal portion 84.
[0091] Also, as shown in FIG. 1, the display device 1 includes an operation unit 40 that receives operations on the display device 1. For example, in the display device 1, two operation units 40 are provided: an operation unit 41 for performing voice input (also referred to as instructing the start of voice recognition) and an operation unit 42 for changing the display settings regarding the three-dimensional image (for example, the set value regarding the parallax).
[0092] These operation units 40 (41, 42) are provided in the lower part of the housing 10 on the front side (an example of the first direction side) of the opening 5 in the housing 10. Specifically, as shown in FIG. 1, these operation units 40 (41, 42) are arranged on the inclined portion 84 provided on the opening 5 side in the lower part of the housing 10. In this way, when the viewer operates the operation unit 40, for example, the viewer's hand does not overlap the displayed image on the image display unit 20, and the viewer can operate the operation unit 40 while viewing the displayed image on the image display unit 20. Therefore, it becomes easier for the viewer to perform an operation on the operation unit 40, so that the operability of the display device 1 can be improved. Further, since the operation unit 40 is provided on the inclined portion 84, the viewer can easily find the operation unit 40.
[0093] Next, various sensors provided in the display device 1 will be described.
[0094] The display device 1 further includes two motion detection units (an example of motion detection means capable of detecting the motion of a viewer), namely, a microphone 61 and a gesture sensor 63 (see FIG. 6). Note that it is not essential that both of these two members 61 and 63 are provided in the display device 1, and only one of the microphone 61 and the gesture sensor 63 may be provided in the display device 1 as the motion detection means.
[0095] The microphone 61 is configured as voice detection means capable of detecting the voice (for example, a voice input operation) of a viewer such as a user. The microphone 61 is arranged, for example, on the above-described inclined portion 84 (see FIG. 1). Note that voice recognition processing is executed, for example, by a general control unit 73 (described later) for the voice input using the microphone 61, and a voice recognition result indicated by, for example, text data or the like is obtained. The voice recognition processing may be executed by a voice recognition device separately provided in the display device 1, or may be executed by an external server or the like different from the display device 1.
[0096] The gesture sensor 63 (an example of an object detection sensor) is configured to be able to detect the behavior of an object. As the gesture sensor 63, for example, an infrared sensor or the like can be mentioned. The gesture sensor 63 has a light emitting part and a light receiving part for light (for example, infrared light). The light emitted (also referred to as irradiation) from the emitting part of the gesture sensor 63 hits the object to be detected, is reflected, and is received by the light receiving part. Then, the gesture sensor 63 detects the behavior of the object to be detected based on the light (reflected light) received by the light receiving part. For example, when the same behavior as a specific behavior pre-registered in the gesture sensor 63 is detected, it is determined that the specific behavior has been performed by the viewer.
[0097] For example, the gesture sensor 63 is provided with a function (also referred to as a Wave detection function) capable of detecting whether it is a predetermined behavior according to the movement of the hand. Then, for example, when a viewer waves their hand ("bye-bye") or strokes ("petting") within the detection range of the gesture sensor 63, the gesture sensor 63 may detect the Wave operation and determine it as "bye-bye" or "petting".
[0098] The gesture sensor 63 is preferably configured to be able to detect the position of the object to be detected in the approaching / separating direction (for example, the Z direction in FIG. 2(A)) with respect to the gesture sensor 63 and the position of the object to be detected on a plane having the approaching / separating direction as the normal (for example, the XY plane in FIG. 2(A)). For example, the plane is preferably divided into four quadrants with the light receiving part of the gesture sensor 63 as the origin. At this time, the X-axis is preferably set parallel to the left-right side of the front surface of the housing 10.
[0099] As shown in FIG. 2(A), the gesture sensor 63 is installed at a substantially central position on the inner peripheral surface of the housing 10 in the left-right direction (the X direction in FIG. 2(A)).
[0100] Also, as shown in FIG. 6, the gesture sensor 63 (specifically, the detection surface of the gesture sensor 63) is disposed on the inner peripheral surface of the housing 10 and faces inward of the housing 10, and the detection direction of the gesture sensor 63 is directed inward of the housing 10. In this way, for example, in the internal space 100 of the housing 10, in this embodiment, the gesture of the viewer is detected in the space region 102. Therefore, compared with the case where the gesture sensor 63 is disposed on the outer peripheral surface of the housing 10, a decrease in the sensitivity of the gesture sensor 63 can be suppressed.
[0101] Also, when the gesture sensor 63 is disposed on the outer peripheral surface of the housing 10, for example, even if a person simply passes by the periphery of the display device 1, the gesture sensor 63 may detect the behavior of the detection target. On the other hand, when the gesture sensor 63 is disposed on the inner peripheral surface of the housing 10 and faces inward of the housing 10, such false detection can be prevented.
[0102] In particular, as shown in FIG. 6, the gesture sensor 63 may be disposed on the upper surface 85 of the inner peripheral surface of the housing 10 and face the lower surface 86. In this way, the gesture sensor 63 is provided on a surface of the inner peripheral surface of the housing 10 where it is difficult for light from the outside to enter. Therefore, compared with the case where the gesture sensor 63 is provided on a surface other than the upper surface 85, a further decrease in the sensitivity of the gesture sensor 63 can be suppressed.
[0103] Further, the gesture sensor 63 may be disposed at a position on the upper surface 85 of the inner peripheral surface of the housing 10 that faces the boundary position 202 (see FIG. 6) between the upper portion 88 of the inclined portion 84 and the lower end portion 32 of the light shielding member 30. And, display control may be performed so that the feet of a specific character are three-dimensionally displayed on the surface of the light shielding member 30. In this way, a viewer can obtain a feeling as if they can touch the whole (entire body) of a specific character that appears to be floating and three-dimensional on the surface of the light shielding member 30. Note that the above-described display control may be reproduced, for example, by changing the parallax setting value in a 3D application related to three-dimensional display.
[0104] Also, in the inner peripheral surface of the housing 10, in a region where the light emitted from the gesture sensor 63 exists in the emission direction of the light, for example, in the region 202 facing the arrangement position of the gesture sensor 63, a member for suppressing the light emitted from the gesture sensor 63 (for example, infrared light) from being received by the gesture sensor 63 may be provided. In this way, since the amount of light received by the gesture sensor 63 that is reflected in the region 202 or its periphery is reduced, a further decrease in the sensitivity of the gesture sensor 63 can be suppressed. Examples of the "member for suppressing the light from being received by the gesture sensor 63" include a light absorbing member that can absorb the light from the gesture sensor 63, a member that diffusely reflects the light from the gesture sensor 63, and the like. Examples of the "light absorbing member" include black paper, a member coated with rubber, or a member formed of an infrared absorbing material (such as an infrared reflection preventing sheet).
[0105] In the display device 1, a predetermined process according to the detection result by the above-described motion detection means (for example, the microphone 61 and the gesture sensor 63) may be executed as the motion of a specific character displayed on the image display unit 20. Such control may be executed, for example, by a control unit 70 described later.
[0106] In this way, when the action of the viewer is detected, a specific character will act according to the detection result, so that the communication between the viewer and the specific character can be reproduced. The function of reproducing such communication between the viewer and the specific character, or the function of reproducing the pseudo-communication between the viewer and the specific character, is called the "communication function". Therefore, for example, a highly entertaining display device 1 can be provided.
[0107] For example, when the viewer utters "bye-bye", the microphone 61 detects the viewer's voice "bye-bye", and the control unit 70 determines the action of a specific character based on the voice recognition result "bye-bye". In the display device 1, a specific phrase and the action corresponding to the specific phrase are associated and registered in advance in a data table or the like. Then, the control unit 70 executes the process corresponding to the determined action. For example, at least one of the voice output process of outputting the voice of "bye-bye" from the speaker 62 and the display output process of displaying and outputting the video of a specific character waving its hand on the image display unit 20 is executed. In this way, the viewer will feel that the specific character displayed on the image display unit 20 reacts to the voice uttered by himself / herself. Therefore, for example, a highly entertaining display device 1 can be provided.
[0108] Also, for example, when a viewer puts their hand into the internal space 100 and waves it, the gesture sensor 63 detects the viewer's gesture "bye-bye", and the control unit 70 determines the movement of a specific character based on the gesture detection result "bye-bye". In the display device 1, a specific movement and the movement corresponding to the specific movement are associated and registered in advance in a data table or the like. Then, the control unit 70 executes the process corresponding to the determined movement. For example, similar to the above, at least one of the voice output process of outputting the voice "bye-bye" from the speaker 62 and the display output process of displaying and outputting the video of a specific character waving their hand on the image display unit 20 is executed. In this way, the viewer feels that the specific character displayed on the image display unit 20 reacts to the gesture they made. Therefore, for example, a highly entertaining display device 1 can be provided.
[0109] Further, the display device 1 further includes a human presence sensor 64 (see FIG. 6) capable of detecting the presence of a person within a predetermined range (also referred to as a detection target space, for example) based on the display device 1. Examples of the human presence sensor 64 include a Doppler sensor (for example, a microwave Doppler sensor) capable of detecting the presence of an object based on the speed of a moving object and the presence or absence of a Doppler signal.
[0110] The human presence sensor 64 is disposed facing the front side of the display device 1 near the upper end portion 51 of the opening 5, and the detection target area of the human presence sensor 64 is provided on the front side of the display device 1. In this way, it is possible to more reliably detect the presence of a person on the front side of the display device 1.
[0111] Specifically, the human presence sensor 64 is disposed at a distance from the outer peripheral wall 80 on the front side of the housing 10 in the front side (front side) of the arrangement area 110 (see FIG. 7) described later so as not to contact it.
[0112] In the display device 1, it is preferably controlled such that the display image of the image display unit 20 is switched to a three-dimensional image on the condition that the human presence sensor 64 detects that a person has approached within the predetermined range. Note that, at other times, a two-dimensional image may be displayed, or the display image of the image display unit 20 may be made non-displayed. In this way, for example, as long as a person is in a position where the object to be displayed on the image display unit 20 (for example, a specific character) cannot be viewed in three dimensions, the three-dimensional image is not displayed on the image display unit 20, and when a person approaches within the range where the object to be displayed can be viewed in three dimensions, the three-dimensional image is displayed on the image display unit 20. Therefore, it is possible to avoid the situation where peripheral people lose interest in the display device 1 due to viewing the object to be displayed from a position where the object to be displayed cannot be viewed in three dimensions.
[0113] [Configuration regarding the arrangement space of the control unit, etc.] The display device 1 has a control unit 70. For example, the display device 1 includes a plurality of control units 70 including a power control unit 71 that controls the power supply of the display device 1, a display control unit 72 that controls the display image displayed on the image display unit 20, a general control unit 73 that generalizes these control units 71, 72, etc. (see FIG. 7). Note that FIG. 7 is a perspective view for explaining the display device 1 with the upper cover portion 12 removed. In the present embodiment, each of the plurality of control units 70 may be mounted on a different substrate, or two or more control units 70 may be mounted on a single substrate. Accordingly, the arrangement position of each control unit 70 may be appropriately changed.
[0114] As shown in FIG. 5, the housing 10 has an upper cover portion 12. Further, as shown in FIG. 6, the housing 10 has a space region 110 between the upper cover portion 12 and the upper surface 85 of the inner peripheral surface of the housing 10. Then, the control unit 70 is disposed in the space region 110. In this way, the maintenance of the control unit 70 that controls the display device 1 can be performed by removing the upper cover portion 12 provided on the upper surface of the housing 10. Therefore, the maintainability of the display device 1 can be improved. Note that the space region 110 is also referred to as a housing space that houses the control unit 70 and the like.
[0115] While the control unit 70 is provided on the upper surface portion of the housing 10, the power supply unit 90 of the display device 1 is provided on the lower surface portion 14 of the housing 10 (see Fig. 4(B)).
[0116] And a connection cord 91 (see Fig. 7) for connecting the power supply unit 90 and the control unit 70 (specifically, the power supply control unit 71) is wired so as to pass through a gap region 89 secured between the outer peripheral wall 80 of the housing 10 (for example, the left side wall of the housing 10) and the internal space 100. In this way, the power supply unit 90 can be arranged at a less conspicuous position, and the connection cord 91 for connecting the power supply unit 90 and the control unit 70 can be wired so as not to be visible to the viewer from the outside and the internal space 100 side (opening 5 side). Therefore, the designability of the display device 1 can be enhanced. Further, since the power supply unit 90 exists below the internal space 100, the power supply unit 90 is arranged at a less conspicuous position and the center of gravity position of the display device 1 can be lowered, making it easier to stabilize its posture.
[0117] In addition, ventilation holes 99 (see Fig. 4(B)) are provided on the bottom surface of the display device 1. The ventilation holes 99 communicate with the space below the internal space. Also, this space is spatially connected to the space region 110 above the internal space 100 via the gap region 89 through which the connection cord 91 is wired. Therefore, even when the space region 110 is blocked by the upper surface cover portion 12, the heat generated in the space region 100 can be released to the outside through the ventilation holes 99. Note that ventilation openings for releasing the heat generated in the space region 110 to the outside may be provided in the upper surface cover portion 12, or heat sinks or other heat absorption or radiation members may be provided in the space region 110 or other locations.
[0118] Further, the upper cover portion 12 is attached to the main body portion 11 of the housing 10 at a plurality of attachment positions (for example, nine attachment positions 211 to 219). For example, the upper cover portion 12 is attached to the main body portion 11 of the housing 10 at two attachment positions 211 and 212 on the front side (front surface side) of the housing 10, at two attachment positions 213 and 214 on the right side of the housing 10, at two attachment positions 215 and 216 on the left side of the housing 10, and at three attachment positions 217 to 219 on the rear side (rear surface side) of the housing 10.
[0119] For example, as shown in FIGS. 7 and 8, at the attachment positions 211 and 212 (an example of the first attachment position) on the front side of the display device 1 among the plurality of attachment positions 211 to 219, the upper cover portion 12 and the main body portion 11 of the housing 10 are coupled using a first fixture at a position inside the outer peripheral wall 80 of the housing 10. Examples of the "first fixture" include a fitting member 95 and a receiving member 96 configured to be detachable from the fitting member 95. Note that FIG. 8 is a view showing the back surface of the upper cover portion 12. For example, the fitting member 95 is formed in a convex shape, and the receiving member 96 is formed to be able to insert the convex fitting member 95.
[0120] On the other hand, at the attachment positions 217 to 219 (an example of the second attachment position) on the back side of the display device 1 among the plurality of attachment positions 211 to 219 (see FIG. 7), the main body portion 11 of the housing 10 and the upper cover portion 12 are coupled using a second fixture at a position outside the outer peripheral wall 80 of the housing 10. Examples of the "second fixture" include a screw 98 (see FIG. 8).
[0121] In this way, at the second attachment positions (for example, attachment positions 217 to 219) that are difficult for the viewer to see, the upper surface cover portion 12 and the main body portion 11 are coupled from the outside of the outer peripheral wall 80 of the housing 10 using the second fixture (for example, screw 98). On the other hand, at the first attachment positions (for example, attachment positions 211, 212) that are easy for the viewer to see, the upper surface cover portion 12 and the main body portion 11 are coupled at a location that is difficult for the viewer to see using the first fixture (for example, fitting member 95 and receiving member 96). Therefore, the designability of the display device 1 can be enhanced.
[0122] Also, the first fixture (for example, fitting member 95 and receiving member 96) is more easily detachable than the second fixture (for example, screw 98), and by using the first fixture, the maintainability of the display device 1 can be enhanced. Furthermore, at all of the attachment positions 211 to 219, the upper surface cover portion 12 and the main body portion 11 are not coupled using the first fixture, but at a part of the plurality of attachment positions 211 to 219, the upper surface cover portion 12 and the main body portion 11 are coupled using the second fixture. Therefore, while enhancing the maintainability of the display device 1, it is also possible to suppress the upper surface cover portion 12 from being removed by a third party.
[0123] Note that in the display device 1 according to the present embodiment, regarding the attachment positions 213 to 216 on the side of the housing 10 among the plurality of attachment positions 211 to 219, similar to the attachment positions 211 and 212 on the front side, the upper surface cover portion 12 and the main body portion 11 of the housing 10 are coupled using the first fixture. However, it is not limited thereto, and regarding the attachment positions 213 to 216 on the side of the housing 10, similar to the attachment positions 217 to 219 on the back side, the upper surface cover portion 12 and the main body portion 11 of the housing 10 may be coupled using the second fixture.
[0124] [Regarding the detailed configuration of the control unit] FIG. 9 is a control block diagram of a control unit 70 included in the display device 1 according to an embodiment. As described above, the control unit 70 includes a general control unit 73. The general control unit 73 is a controller having a memory including a CPU 701 that functions as an arithmetic processing device that executes arithmetic processing and the like, a RAM 703 used as a work area, and a ROM 702 that stores control programs and the like. Various programs are stored in the ROM 702, and the general control unit 73 reproduces various functions by executing these programs. For example, a voice recognition application (an application having a function of a voice recognition engine) for reproducing an interaction between a user and a character is stored in the ROM 702, and the general control unit 73 executes the voice recognition application based on input signals from various sensors 61, 63, 64, 65, etc. or a GPS receiver 60, etc., thereby reproducing an interaction between a user and a character. Further, the general control unit 73 (an example of an operation control means) has a display control circuit 704 (e.g., a display control unit 72, etc.) that controls an image displayed on the image display unit 20, and an audio control circuit 705 that controls audio output from the speaker 62. Furthermore, the general control unit 73 has a communication control circuit 706 that controls communication with other devices (e.g., an external voice recognition server (also referred to as a voice recognition engine) not shown, and an external dialogue server (also referred to as a dialogue engine) not shown, etc.). Also, the general control unit 73 controls the power state of the display device 1 based on an input signal from a power control unit 71 that controls the power of the display device 1.
[0125] [Regarding the character displayed on the display device] Here, before explaining the control content by the general control unit 73 of the control unit 70, the characters that can be displayed on the image display unit 20 of the display device 1 will be described with reference to FIGS. 10 to 12.
[0126] FIG. 10 is a diagram for explaining the outline of the display device 1 according to an embodiment. Specifically, it is a diagram showing a state in which the 3D character 1100 is displayed on the display device 1. The 3D character 1100 is a female character. The display device 1 (specifically, the overall control unit 73) further displays a stage video 2100 meaning a stage under the 3D character 1100. The stage video 2100 shows a magic circle here. A viewer seeing this display can get an impression that the 3D character 1100 is standing on the stage. The colors of the 3D character 1100 and the stage video 2100 are not particularly limited. For example, the skin of the 3D character 1100 is skin-colored. The hair color and the upper body clothing of the 3D character 1100 are relatively light blue colors (for example, light blue), the decoration applied to the knees is a darker blue color (for example, blue), and the skirt and shoes are white. The stage video 2100 is a relatively dark blue color (for example, dark light blue). Note that FIGS. 10 and FIG. 11 described below show diagrams viewed from slightly above the front of the display device 1 looking down into the housing 10.
[0127] FIG. 11 is a diagram for explaining the outline of the display device 1 according to an embodiment. Specifically, it is a diagram showing a state in which the 3D character 1200 is displayed on the display device 1. The 3D character 1200 is a cat character. In the case shown in FIG. 11(B), the display device 1 displays the 3D character 1200 and a stage video 2200 meaning a stage under the 3D character 1200. The stage video 2200 shows a string of characters "Yupiteru" and a string of characters indicating the name "Juno" (referred to as "Yuno") of the 3D character 1200 alternately written along the outer periphery of a circular stage. The colors of the 3D character 1200 and the stage video 2200 are not particularly limited.
[0128] Here, the 3D character 1200 and the stage video 2200 will be described in more detail with reference to FIG. 12. The 3D character 1200 is roughly divided into a character body 1210 and a collar 1220. The character body 1210 is the cat character itself. The character body 1210 includes the parts shown in white among the body parts, for example, the parts around the eyebrows, nose and mouth, the abdomen, and the front side parts of the feet correspond to this. Among the body parts of the character body 1210, the parts shown in light gray are of a relatively light brown color system (for example, loess color), for example, the parts above and beside the eyes on the face, the upper part of the torso, and the parts of the feet other than the front side correspond to this. Among the body parts of the character body 1210, the parts shown in darker gray are of a darker brown color system (for example, brown), for example, the face, head, torso, and the striped parts shown by thin lines on the feet correspond to this. The collar 1220 means the collar displayed at the position of the neck of the character body 1210. The collar 1220 is of a red color system (for example, red). Among the collar 1220, a tag 1221 is attached at the position below the face of the character body 1210. The tag 1221 is circular and a predetermined logo is marked on it. The logo is a logo in which a "●" (a circle with the inside filled) is arranged below a "V" - shaped symbol, and each is marked in a red color system (for example, red). The logo marked on the tag 1221 may also function as a trademark indicating the origin of the display device 1. The stage video 2200 is entirely of a brown color system. The circle and the character string are of a relatively dark brown color (for example, brown), and the image imitating the smoke inside the circle is of a lighter brown color system (for example, loess color).
[0129] In FIGS. 10 to 12, the backgrounds of the 3D characters 1100 and 1200 are shown in black, but it is not limited to pure black, and a relatively dark background (for example, black or other dark color systems) may also be used.
[0130] Note that the characters shown in FIGS. 10 to 12 are merely examples. When the display device 1 displays a humanoid character, the display device 1 is not limited to female characters, and may display male characters (for example, character 1000 (see FIG. 13)). The display device 1 may display any of real people (for example, family members), people who existed in the past (for example, historical figures), and fictional characters (for example, characters appearing in fictional works such as comics and animations). When the display device 1 displays a non-humanoid animal character, the display device 1 is not limited to cat characters, and may display characters of animals that can be raised in ordinary households such as dogs and hamsters, characters of other animals such as horses and cows, and fictional animal characters (for example, characters appearing in fictional works such as comics and animations). Further, the display device 1 may display other characters having the collar 1220.
[0131] The display device 1 (specifically, the overall control unit 73) moves the body parts of the character or outputs voice imitating the character's speech based on the communication function. The communication function is a function for reproducing the communication between the viewer and the character or a function for reproducing pseudo-communication. In the communication function, the character moves in response to the behavior of the viewer (e.g., speech or body movement). For example, the 3D character 1100 performs actions that reproduce the actions usually performed by humans, such as moving the whole body like dancing or changing expressions (e.g., expressing emotions of joy, anger, sorrow, and happiness). For example, the 3D character 1200 makes movements that reproduce the actions usually performed by animals (e.g., yawning, wagging the tail, walking, etc.). Also, the display device 1 outputs singing voice as if the 3D character 1100 is singing or outputs voice related to the dialogue with the viewer, for example, in accordance with the actions of the 3D character 1100. The display device 1 outputs voice meaning the meowing of a cat or outputs voice related to the dialogue with the viewer, for example, in accordance with the actions of the 3D character 1200. Such output of video and voice is not limited to the communication function and may be performed by various functions of the display device 1.
[0132] In addition, the interaction with the user in the communication function is reproduced by, for example, the voice recognition application stored in the ROM 702 of the overall control unit 73, the above-described external voice recognition server, and the dialogue server. For example, when the operation unit 40 is pressed by the user, the overall control unit 73 activates the voice recognition application. Thereby, voice recognition for interacting with the character is enabled. Then, the voice uttered by the user (also referred to as user voice) is transmitted from the communication control circuit 706 of the overall control unit 73 to the voice recognition server, and the voice recognition server executes voice recognition processing on the user voice and outputs a voice recognition result. For each inputtable character string, the voices uttered by the characters (also referred to as character voices) displayed on the image display unit 20 (for example, the 3D character 1100) are registered in advance in association with each other in the dialogue server. Then, the voice recognition result (for example, the voice recognition result indicated by a character string) by the voice recognition server is input to the dialogue server, and the character voice corresponding to the voice recognition result is transmitted from the dialogue server to the display device 1. Then, the overall control unit 73 outputs the character voice received from the dialogue server from the speaker 61 of the display device 1. In this way, response processing for the voice by the user is executed, and the interaction between the user and the character is reproduced.
[0133] <Regarding the Communication Function for the 3D Character 1100> Hereinafter, various controls for reproducing the communication between the 3D character 1100 and the user will be described in order with reference to FIGS. 14 to 20.
[0134] <Regarding the Communication Function for 1. For example, an odor sensor 65 (see FIG. 9) for detecting an odor may be provided in the display device 1, and the overall control unit 73 may execute an audio output operation of outputting, as the character audio of the 3D character 1100, audio corresponding to the detection result by the odor sensor 65. The odor sensor 65 outputs a signal that changes according to, for example, the intensity of a certain odor, or outputs a signal that changes according to the components (odor components) contained in the odor. The odor sensor 65 outputs a signal that changes according to, for example, the type of odor. The odor sensor 65 is configured to be able to detect the concentration of specific odor components (tar, ammonia, alcohol, carbon dioxide, etc.) using, for example, a deodorizing filter or the like. In this way, the overall control unit 73 can reproduce communication regarding odor between the character displayed on the image display unit 20 of the display device 1 and the user, and can reproduce more diverse communication between the character and the user. Note that the odor sensor 65 may be provided on the outer peripheral surface of the display device 1, for example, on the diagonal portion 84 of the housing 10 in the display device 1.
[0135] For example, the overall control unit 73 may execute an audio output operation of outputting, as the character audio of the 3D character 1100, audio corresponding to the detected type of odor. Note that a single sensor capable of identifying a plurality of types of odor components may be configured as the odor sensor, or a plurality of sensors capable of identifying different types of odor components may be configured as the odor sensor.
[0136] FIG. 14(A) is a flowchart for reproducing communication regarding odor, and FIG. 14(B) is a diagram showing an audio management table (also referred to as an audio management list) regarding odor. The audio management table is stored, for example, in the overall control unit 73 of the display device 1 or in the dialogue server. As shown in FIG. 14(B), in the audio management table, for each type of odor component (also referred to as an odor substance) detectable by the odor sensor 65, the type of odor mainly containing the odor component and the audio (referred to as character audio) emitted by the 3D character 1100 are registered in advance. For example, in the audio management table, the tobacco odor mainly containing tar is registered in association with tar, and as the character audio when the tobacco odor is detected, words such as "Excessive smoking is not good for your health~" that show concern for the user's health are registered.
[0137] First, in step S11, the overall control unit 73 determines whether an odor component has been detected. For example, when the concentration of the odor component detected by the odor sensor 65 exceeds a predetermined threshold (reference value) for a specific odor, the overall control unit 73 determines that the odor component has been detected. In step S12, the overall control unit 73 determines the type of odor registered in the voice management table in association with the detected odor component. For example, when tar with a concentration exceeding a predetermined threshold is detected, it is determined that a tobacco odor has been detected. Then, the overall control unit 73 outputs a character voice corresponding to the detected odor type from the speaker 62. For example, when it is determined that a tobacco odor has been detected, the overall control unit 73 executes a voice output operation of outputting a voice of words concerned about the user's health (here, "Smoking too much is not good~") as a character voice. As other examples, the following can be cited. For example, when the concentration of a specific main component contained in a fragrance such as aromatic oil or food exceeds a predetermined reference value, the overall control unit 73 determines that an odor such as a fragrance or food has been detected and outputs a voice asking a question about the source of the odor as a character voice. Also, when alcohol exceeding a predetermined reference value is detected, the overall control unit 73 determines that an alcohol odor has been detected and outputs voices such as "It smells like alcohol~" or "You've been drinking again. Cut it out." as the character voice of the 3D character 1100. Also, when an odor component contained in gas fuel, such as tertiary butyl mercaptan, dimethyl sulfide, or tetrahydrothiophene, is detected, the overall control unit 73 determines that the odor of gas fuel has been detected and outputs a voice such as "It smells like gas!" as the character voice of the 3D character 1100. Also, when a bad breath component (e.g., hydrogen sulfide, methyl mercaptan, dimethyl sulfide, etc.) exceeding a predetermined reference value is detected, the overall control unit 73 determines that bad breath has been detected and outputs voices such as "You have a bit of bad breath. Have you brushed your teeth?" or "Pay attention to periodontal abscess." as the character voice of the 3D character 1100.
[0138] In this way, the overall control unit 73 may execute control to output, as the character voice of the 3D character 1100, the voice corresponding to the detected type of smell. By performing such control, the range of communication between the character displayed on the image display unit 20 and the user can be widened, and the user's attachment to the character can be increased.
[0139] The display device 1 is not limited to specifying the voice output based on the voice management table. For example, the display device 1 may specify the voice to be output according to a scenario in which the speech content of the character changes based on the content of past conversations (conversation history). This scenario may define a branching scenario in which data for specifying the voice output by the character is managed in a tree structure.
[0140] Here, although the voice output operation of the voice according to the detection result by the odor sensor 65 is illustrated, it is not limited thereto. The overall control unit 73 may execute a display output operation of displaying, on the image display unit 20, a video in which a character makes a movement according to the detection result by the odor sensor 65. For example, similarly to the voice management table, a display management table (not shown) may be provided in advance. The overall control unit 73 may execute a display output operation of displaying, on the image display unit 20, a video in which the 3D character 1100 makes a movement according to the detected type of odor. The display management table may be, for example, a table in which data defining the 3D character 1100 is registered in association with the odor component and the type of odor. The data defining the 3D character 1100 may be data showing the video of the 3D character 1100 to be displayed, or may be data defining the content of the movement of the 3D character 1100. For example, when any odor component is detected, the overall control unit 73 may display, on the image display unit 20, a video in which the 3D character 1100 makes a movement of smelling the odor. Further, when the overall control unit 73 determines that, for example, the smell of tobacco is detected, the overall control unit 73 may display, on the image display unit 20, a video in which the 3D character 1100 makes a movement of disliking the smell. At this time, the overall control unit 73 may display a video simulating smoke on the image display unit 20. Furthermore, the overall control unit 73 may execute both the above-described voice output operation and the display output operation. For example, when any odor component is detected by the odor sensor 65, the overall control unit 73 may display, on the image display unit 20, a video in which the 3D character 1100 makes a movement of smelling the odor, and output, from the speaker 62, a voice such as "Something smells" as the character voice of the 3D character 1100.
[0141] Furthermore, the overall control unit 73 may control so that the reaction of the 3D character 1100 changes according to the concentration of the odor component (also referred to as detection intensity) detected by the odor sensor 65. For example, the overall control unit 73 may selectively display any one of a plurality of videos of movements provided stepwise (for example, "frowning (showing a displeased expression)", "sweating coldly", "turning pale", and "fainting") according to the concentration of the odor component.
[0142] For example, as a method for the display device 1 to distinguish between the smell of tobacco and other odors (scents), in combination with another sensor such as a smoke sensor that detects smoke, a camera image (for example, an image captured by the imaging unit 227), an image of a thermal camera, etc., it may be possible to detect that the user is smoking a cigarette.
[0143] When the overall control unit 73 detects that the user is smoking a cigarette, an image imitating smoke (a video reproducing the state where the smoke appears as puffs) may be displayed in front of (overlapping) the 3D character 1100. At this time, the overall control unit 73 may cause the face of the 3D character 1100 to protrude forward and enlarge the face, and give it an expression as if it is disgusted. The overall control unit 73 may perform a display with the degree of disgust of the 3D character 1100 changed according to the degree of intimacy, which is the degree of intimacy between the user and the 3D character 1100. For example, when the degree of intimacy is equal to or greater than a predetermined value, the overall control unit 73 may give an expression to the 3D character 1100 as if saying "I forgive you because I love you", and when it is less than the predetermined value, make the 3D character 1100 have an unpleasant expression. For example, the overall control unit 73 may specify the degree of intimacy according to the usage record of the display device 1 by the user (for example, past usage time and past conversation content). The algorithm for specifying the degree of intimacy is not limited to this.
[0144] <2. Regarding the communication function based on the user's position information> Also, for example, it is preferable that the display device 1 has a GPS (Global Positioning System) receiver 60 (see FIG. 9), and the following control is executed based on the user's position information. Here, it is assumed that the display device 1 is portable. Then, for example, the overall control unit 73 may acquire the position information of the display device 1 held (carried) by the user as the user's own position information based on the signal from the GPS receiver 60, and execute the following control based on the acquired position information.
[0145] For example, it may be controlled such that a voice corresponding to the stay frequency (also referred to as the visit frequency) at a location specified based on the user's location information is output as a character voice when the user stays at the location. FIG. 15 is a flowchart for reproducing communication regarding the stay frequency.
[0146] For example, in step S21, the overall control unit 73 determines whether the user's location information has been received from the GPS receiver 60. When the user's location information is received, in step S22, the overall control unit 73 determines whether the stay frequency at the location specified based on the user's location information is equal to or greater than a predetermined value (for example, "2"). Note that the stay frequency is the number of times the user has stayed at one location within a predetermined period (for example, one day or one week, etc.). For example, the overall control unit 73 searches for and specifies the user's stay location using a network or the like based on the location information (for example, the user's current location information) acquired from the GPS receiver 60. Then, the overall control unit 73 calculates the user's stay frequency based on the number of times the user has stayed at the specified location, and determines whether the user's stay frequency is equal to or greater than the predetermined value. For example, when the user's stay frequency is equal to or greater than the predetermined value, in step S23, the overall control unit 73 controls such that a predetermined character voice registered in advance regarding the user's stay frequency is output from the speaker 62. For example, when the user has visited the same location twice on the same day, the overall control unit 73 determines that the user's stay frequency is equal to or greater than the predetermined value, and outputs a character voice such as "Hey, you were here just a moment ago".
[0147] Also, the overall control unit 73 may be controlled to output a voice corresponding to the location specified based on the acquired location information as the character voice of the 3D character 1100. FIG. 16(A) is a flowchart for reproducing communication regarding the stay location, and FIG. 16(B) is a diagram showing a voice management table of the character voice regarding the stay location.
[0148] For example, in step S31, the overall control unit 73 determines whether user position information has been received from the GPS receiver 60. When the user position information is received, in step S32, the overall control unit 73 searches for and identifies the user's staying location by using a network or the like based on the user position information. Then, in step S33, the overall control unit 73 outputs, from the speaker 62, a character voice corresponding to the identified location based on the voice management table of FIG. 16(B). For example, when the user goes to a supermarket, the overall control unit 73 outputs a character voice such as "What should I cook for dinner today?", or when the user goes to a hospital, the overall control unit 73 outputs a character voice such as "Are you okay? Do you not feel well?". Also, for example, when the user goes to an amusement park, the overall control unit 73 outputs a character voice such as "You had a lot of fun".
[0149] Further, the overall control unit 73 may be controlled to output, as a character voice of the 3D character 1100, a voice corresponding to the number of stays (also referred to as the number of visits, etc.) of the user at the location specified based on the acquired position information. FIG. 17(A) is a flowchart for reproducing communication regarding the number of stays, and FIG. 17(B) is a diagram showing a voice management table of character voices regarding the number of stays.
[0150] Steps S41 and S42 in Fig. 17(A) are the same as steps S31 and S32 in Fig. 16(A), so the description thereof is omitted. In step S43, the overall control unit 73 acquires the number of times the user has stayed at the location specified in step S42. Then, in step S44, the overall control unit 73 outputs, from the speaker 62, a character voice corresponding to the number of times the user has stayed based on the voice management table in Fig. 17(B). For example, when the user visits a certain game center for the first time, the overall control unit 73 outputs a character voice such as "The game was fun". Then, when the user visits the certain game center again, the overall control unit 73 outputs a character voice such as "I really wanted to come again". Furthermore, when the user visits the certain game center a predetermined number of times or more (for example, 10 times or more), the overall control unit 73 outputs a character voice such as "Going to play games again~".
[0151] Also, the overall control unit 73 may be controlled to output, as the character voice of the 3D character 1100, a voice corresponding to the staying time of the user at the location specified based on the acquired position information. Fig. 18(A) is a flowchart for reproducing the communication regarding the staying time, and Fig. 18(B) is a diagram showing the voice management table of the character voice regarding the staying time.
[0152] Steps S51 and S52 in Fig. 18(A) are the same as steps S31 and S32 in Fig. 16(A), so the description thereof will be omitted. In step S53, the overall control unit 73 acquires the staying time of the user at the location specified in step S52. Then, in step S54, the overall control unit 73 outputs character voices corresponding to the staying time of the user from the speaker 62 based on the voice management table in Fig. 18(B). For example, when the staying time of the user at the convenience store is within 5 minutes, the overall control unit 73 outputs character voices such as "You were quick. I'm glad I waited for you." Also, when the staying time of the user at the convenience store is 5 minutes or more and less than 10 minutes (5 - 10 minutes), the overall control unit 73 outputs character voices such as "What did you buy?" Further, when the staying time of the user at the convenience store exceeds 10 minutes, the overall control unit 73 outputs character voices such as "You were late. I was worried."
[0153] The overall control unit 73 may perform the above control based on the position information of the user acquired using the GPS receiver 60 or the like. In this way, the user can get the feeling that the character shows a reaction according to the user's actions, and the user's affection for the character increases.
[0154] Note that in the above, the portable display device 1 is exemplified, but for example, a stationary display device 1 may also be used. For example, the overall control unit 73 (specifically, the communication control circuit 706) communicates with the user's smartphone (a smartphone equipped with a GPS receiver) or the like to acquire the position information of the user while out (the position information of the smartphone held by the user). Then, when communicating with the 3D character 1100 after the user returns home or the like, the overall control unit 73 may control so that the above operations are executed. Note that the content of the character voices and movements at this time may be changed as appropriate.
[0155] <3. Communication Function Regarding User's Behavior Pattern> In addition, when it is determined that the user's behavior pattern matches a predetermined behavior pattern, it may be controlled so that voice corresponding to the predetermined behavior pattern is output as the character voice of the 3D character 1100. FIG. 19(A) is a flowchart for reproducing communication regarding the behavior pattern, and FIG. 19(B) is a diagram showing a voice management table of character voices regarding the behavior pattern.
[0156] For example, in the overall control unit 73, the day of the week when the user goes to work (for example, Monday to Friday), the time of going to work (for example, 8:30), and the specific route used when going to work are pre-registered by the user or the like as the "behavior pattern when going to work". Then, for example, when the position information of the user is received from the GPS receiver 60 (step S61), the overall control unit 73 determines whether the user's behavior pattern matches a predetermined behavior pattern based on the position information of the user (step S62). For example, when the user passes through a specific route at 8:30 on Tuesday, the overall control unit 73 determines that the user's behavior pattern matches the "behavior pattern when going to work". Then, in step S63, the overall control unit 73 outputs, from the speaker 62, as the character voice of the 3D character 1100, the voice (for example, "Do your best at work") registered in association with the "behavior pattern when going to work" based on the voice management table in FIG. 19(B). In this way, by having the character show a reaction according to the user's behavior, the user's affection for the character can be increased. Note that it is not essential for a predetermined behavior pattern (for example, the behavior pattern when going to work) to be pre-registered by the user. For example, the overall control unit 73 may have a learning function, and the predetermined behavior pattern may be registered by learning the user's behavior pattern.
[0157] <4. Regarding the communication function for detecting a suspicious person> Also, when a person detected in the detection target space is determined to be a suspicious person, a predetermined operation may be executed. Then, after the predetermined operation is executed, when a user of the display device 1 is detected, a voice regarding the detection of the suspicious person may be output as the character voice of the 3D character 1100. FIG. 20 is a flowchart for reproducing the operation regarding the detection of a suspicious person.
[0158] For example, in the display device 1, a photographing unit (for example, a camera) (not shown) for photographing a viewer (user, etc.) may be provided on the front side of the display device 1, and the photographing unit (specifically, the sensor included in the photographing unit) may be used as a detecting means for detecting the presence of a person in the detection target space. The "detection target space" includes, for example, the angle-of-view range (photographable range) of the photographing unit in the space where the display device 1 is placed (for example, the user's home). The photographing unit includes, for example, a lens and an imaging element (for example, a CCD or a CMOS), and photographs a multi-color image. The lens of the photographing unit is provided at a position where a viewer (especially the face) can be photographed. For example, the lens of the photographing unit is provided near the center in the width direction of the display device 1 in the upper end portion 51. The photographing unit outputs, for example, image signals of each color component of R, G, and B to the control unit 70. The overall control unit 73 processes this image signal to generate a photographed image.
[0159] The overall control unit 73 monitors the detection target space using the imaging unit (step S71). Then, when the presence of a person is detected in the detection target space, in step S72, the overall control unit 73 performs user authentication such as face authentication, for example, and in step S73, determines whether the detected person is a registered user of the display device 1. For example, if the overall control unit 73 determines that the person captured by the imaging unit is a registered user of the display device 1, it determines that the person is not a suspicious person. On the other hand, if it is determined that the person captured by the imaging unit is an unregistered user, in step S74, the overall control unit 73 determines that the person is a suspicious person and executes a predetermined operation. Examples of the "predetermined operation" include an operation to start recording by the imaging unit, an operation to issue an alarm at a relatively high volume, an operation to notify a pre-registered security company, and the like. Alternatively, the "predetermined operation" may be an operation in which the 3D character 1100 addresses the suspicious person (for example, "Who!? Say the password!"). Then, if there is no response from the person determined to be a suspicious person, or if the password is incorrect, the above-described recording start operation or the like may be executed. In addition, when the password is incorrect, the overall control unit 73 outputs a voice such as "That's wrong!? Say it again" as the character voice of the 3D character 1100, and may execute the above-described recording start operation or the like when it is determined again that the password is incorrect. By doing so, for example, a suspicious person can be made to retreat from the detection target space, and the crime prevention performance in the detection target space can be enhanced.
[0160] Then, after executing the predetermined operation, if the user of the display device 1 is detected, the overall control unit 73 may output a voice regarding the detection of a suspicious person as the character voice of the 3D character 1100. Examples of the "voice regarding the detection of a suspicious person" include "That was scary". By doing so, the user's attachment to the character displayed on the image display unit 20 can be increased.
[0161] Also, when the detection target space is being monitored using the display device 1, not limited to the detection of a suspicious person, the following operations may be performed.
[0162] For example, the display device 1 may be arranged in the reception space of a company, and a 3D character 1100 may display a reception operation as a so-called receptionist. Specifically, when the approach of a person in the detection target space (for example, the reception space) is detected by a microwave Doppler sensor (an example of the detection means), the overall control unit 73 may output a voice such as "Welcome. Which department can I help you?" as the character voice of the 3D character 1100. Then, the overall control unit 73 may control to make a call to the department desired by the visitor based on the response from the detected person (the visitor).
[0163] <5. Communication function regarding the startup time of the display device 1> In addition, the overall control unit 73 may control so that the content of communication changes according to the startup time (for example, the cumulative startup time) of the display device 1 from a predetermined time point (for example, the first startup time) in the word usage of the 3D character 1100 in the character voice. For example, as described below, the overall control unit 73 may control so that the 3D character 1100 speaks to the user in a more familiar way as the startup time of the display device 1 becomes longer.
[0164] For example, for various character voices as described above, it is preferable that three patterns of character voices, namely, a polite tone, a speech tone as if the user is in a friendly relationship, and a speech tone as if the user is in a romantic relationship, are registered in advance in the voice management table. Then, for example, when the startup time of the display device 1 from a predetermined time point is less than 100 hours, the overall control unit 73 outputs a character voice with a polite tone among the three patterns of character voices registered in the voice management table. Also, when the startup time is 100 hours or more and less than 1000 hours, the overall control unit 73 outputs a character voice with a speech tone as if the user is in a friendly relationship among the three patterns of character voices registered in the voice management table. Further, when the startup time exceeds 1000 hours, the overall control unit 73 outputs a character voice with a speech tone as if the user is in a romantic relationship among the three patterns of character voices registered in the voice management table.
[0165] In this way, the user can feel that the relationship (e.g., intimacy) with the character has changed due to the change in the character's way of speaking to the user himself / herself.
[0166] Note that the overall control unit 73 may control to decrease the intimacy of the 3D character 1100 with respect to the user depending on the elapsed time since the previous startup. For example, even when the cumulative startup time of the display device 1 exceeds 100 hours, when one week has elapsed since the previous startup, the overall control unit 73 may output a character voice with a polite tone instead of a speech tone on an equal footing with the user. In this way, the user will come into contact with the character displayed on the image display unit 20 without leaving an interval as much as possible in order to maintain the intimacy with the character, and the attachment to the character can be further increased.
[0167] In addition, at the first startup, the overall control unit 73 outputs a greeting voice such as "Nice to meet you" as a character voice, and when a predetermined period (for example, a well - defined period such as one month) has elapsed since the first startup, it outputs a voice with content indicating a commemorative day (for example, "It's been one month since we met") as a character voice. By doing so, the attachment to the 3D character 1100 can be further increased.
[0168] <6. Communication function through cooperation with other devices> Also, for example, in the stationary display device 1, the following operations may be executed by cooperation with other devices. For example, when a user visits a place where a device (hereinafter referred to as another device) capable of communicating with the display device 1 is installed, the control unit (such as a CPU) of the other device identifies the user and automatically guides information suitable for the user (for example, gourmet information or event information) as follows. For example, the face image of a user who uses a cooperation system between the display device and another device and the display device (for example, an IP address, etc.) owned by the user are associated and registered in advance in an external server or the like. When a person is detected by a sensor included in a photographing unit provided in the other device, for example, the control unit of the other device identifies the user of the display device 1 by comparing the face image of the person detected in the photographed image with the face image of the user registered in the external server. Then, the control unit of the other device specifies the display device 1 (for example, the IP address of the display device 1, etc.) registered in association with the user in the external server, and transmits information indicating that the user of the display device 1 has been detected to the display device 1. In the overall control unit 73 of the display device 1, "information suitable for the user" (for example, gourmet information or event information) is registered in advance, and the overall control unit 73 transmits the registered "information suitable for the user" to the other device in response to the reception of a signal from the other device. Then, the control unit of the other device outputs the "information suitable for the user" received from the display device 1 (for example, voice output). When guiding the "information suitable for the user", the other device may display the 3D character 1100 on its display screen. Also, information such as the information guided to the user may be transmitted from the other device to the display device 1 and accumulated as user information in the overall control unit 73 of the display device 1. Then, for example, when the display device 1 is installed in the user's home and the user's return home is detected, the overall control unit 73 may output a voice such as "You went to **, how was it?" as the character voice of the 3D character 1100. In this way, the user's attachment to the character displayed on the image display unit 20 can be increased.
[0169] <7. Other communication functions> Furthermore, the following control may be performed based on the detection results by various sensors.
[0170] For example, a wind detection means (e.g., a wind sensor) capable of detecting wind (e.g., wind speed) may be provided near the lower end portion 52 of the opening 5 of the display device 1, and the following control may be performed based on the detection result by the wind sensor. The wind may be, for example, considered to be caused artificially by the user, such as the wind generated by moving a body part such as waving a hand toward the display device 1 or the wind generated by blowing breath (exhalation). For example, when wind with a wind speed equal to or higher than a predetermined value is detected by the wind sensor, the overall control unit 73 may display and output an image in which the hair (e.g., hair) and clothes (e.g., skirt) of the character (e.g., 3D character 1100) displayed on the image display unit 20 flutter. Also, for example, when an image of a lit candle is displayed on the image display unit 20 and wind is detected by the wind sensor, the overall control unit 73 may switch to an image in which the flame of the candle goes out. Furthermore, when the detected wind is stronger than a predetermined threshold (the wind speed is greater than a predetermined threshold), the overall control unit 73 may switch the image according to the intensity of the detected wind (e.g., wind speed), such as making the clothes of the 3D character 1100 flutter more.
[0171] Also, for example, object detection means (e.g., an ultrasonic sensor) capable of detecting the presence or absence of an object and the distance to the object may be installed on the inner peripheral surface of the housing 10 of the display device 1 facing inward of the housing 10, and the following control may be performed based on the detection result by the ultrasonic sensor. For example, when the overall control unit 73 determines that the hand of the viewer touches the 3D character 1100 stereoscopically displayed in the housing 10 based on the detection result by the ultrasonic sensor, it may be good to display and output a video in which the 3D character 1100 shows a reaction. Further, the overall control unit 73 may perform display control so as to show different reactions according to the part touched by the viewer on the 3D character 1100. The part touched by the observer on the 3D character 1100 may be, for example, a body part such as the head, chest, abdomen, buttocks, or legs. Also, the part touched by the observer on the 3D character 1100 may be the clothes (e.g., a dress, a skirt) or ornaments (e.g., an accessory) of the 3D character 1100.
[0172] Also, for example, earthquake detection means (e.g., a seismic sensor) capable of detecting an earthquake and measuring the seismic intensity may be provided in the display device 1, and when the overall control unit 73 detects an earthquake by the seismic sensor, it may be good to issue an earthquake warning.
[0173] Also, for example, a weather sensor capable of measuring the weather may be provided in the display device 1, and the overall control unit 73 may be good to notify the change in weather, weather forecast, etc. based on the measurement result by the weather sensor. Note that the weather sensor may have, for example, a barometric pressure sensor, a temperature sensor, and a humidity sensor, and may be configured to be able to measure the weather based on the detection results of each sensor.
[0174] Also, the overall control unit 73 may be good to display a video in which the expression and movement (also referred to as motion) of the character displayed on the image display unit 20 change according to the temperature detected by the temperature sensor or / and the humidity detected by the humidity sensor.
[0175] Further, the overall control unit 73 may display a video in which the expression and movement of the character displayed on the image display unit 20 change according to the detection result (for example, the distance between the display device 1 and the viewer) by a human presence sensor such as a microwave Doppler sensor.
[0176] Further, the overall control unit 73 may use a humidity sensor to determine whether or not the user has blown air. Furthermore, the overall control unit 73 may also use a temperature sensor to determine the type of air blown by the user. These sensors may be provided, for example, near the lower end 52 of the opening 5 of the display device 1.
[0177] Here, there are two types of air blown by the user, for example, the air blown with "hoo" and the air blown with "haa". Generally, when blowing cold air, the air is blown quickly with "hoo", so here, the air blown with "hoo" is called "cold air". Also, generally, when blowing warm air, the air is blown slowly with "haa", so here, the air blown with "haa" is called "warm air".
[0178] Regarding these two types of air, the inventor of the present application obtained the following findings through experiments and the like. Specifically, first, regarding humidity, when blowing "hoo" air toward a temperature and humidity sensor (for example, a sensor in which a temperature sensor and a humidity sensor are integrated) at a position a predetermined distance away from the temperature and humidity sensor, a measurement result was obtained that the humidity rapidly increases from the steady state immediately after that. Also, thereafter, the humidity monotonically increases while blowing air, and when the blowing of air stops, it takes several tens of seconds to return to the original steady state, as measured. The same measurement results were obtained when blowing "haa" air toward the temperature and humidity sensor under the same conditions. On the other hand, regarding temperature, when blowing "hoo" air, the temperature slightly decreases from the steady state or remains almost horizontal, and when blowing "haa" air, the temperature rises, as measured. The air blown by the user against the display device 1 is an example of the wind hitting the display device 1.
[0179] In consideration of such findings, etc., for example, in the display device 1 provided with a humidity sensor, when the humidity sensor detects that the humidity has rapidly increased from a steady state, the overall control unit 73 may determine (also referred to as a decision) that the viewer has blown air. Further, when it is then detected that the monotonic increase in humidity has stopped, the overall control unit 73 may determine that the blowing of air has stopped. Alternatively, when a predetermined time (for example, the time required to exhale normal breath (for example, about 3 seconds)) has elapsed since the rapid increase in humidity was detected, the overall control unit 73 may determine that the blowing of air has stopped regardless of the humidity detection result at that time.
[0180] Furthermore, when the rapid increase in humidity is detected by the humidity sensor and, at approximately the same timing, the temperature sensor detects that the temperature has increased from a steady state, the overall control unit 73 may determine that the type of air blown by the viewer is "warm air". Conversely, when the rapid increase in humidity is detected by the humidity sensor and the temperature sensor detects that the temperature has not changed from a steady state or has decreased from a steady state, the overall control unit 73 may determine that the type of air blown by the viewer is "cold air".
[0181] Then, the overall control unit 73 may output the video and audio corresponding to the detection of the blowing of air as the movement of the character and the character voice displayed on the image display unit 20. Also, the overall control unit 73 may output the video and audio corresponding to the type of air blown as the movement of the character and the character voice displayed on the image display unit 20. For example, when the type of air blown by the viewer is "cold air", the overall control unit 73 may display and output a video of the character's clothes fluttering, and when the type of air blown by the viewer is "warm air", the overall control unit 73 may display and output a video of the character making a movement to avoid the air.
[0182] In addition, the inventor of the present application has also obtained the following findings using various gas sensors. Specifically, when blowing "hoo" towards a gas sensor at a position about a predetermined distance (e.g., about 10 cm) away from the gas sensor, the output value of the gas sensor decreases immediately after that, and when the blowing stops, the output value of the gas sensor immediately turns upward, as measured results. Conversely, when blowing "ha" towards the gas sensor, the output value of the gas sensor increases immediately after that, and when the blowing stops, the output value of the gas sensor immediately turns downward, as measured results. Also, for example, when the wind sent from a blower (e.g., a fan) hits the gas sensor, the output value of the gas sensor decreases, and when the wind from the fan no longer hits the gas sensor, the output value of the gas sensor increases, as measured results.
[0183] In consideration of such findings and the like, the overall control unit 73 may, for example, in the display device 1 provided with the gas sensor, when the output value of the gas sensor rapidly decreases from the steady state, determine that the type of breath blown by the viewer is "cold breath". Conversely, when the output value of the gas sensor rapidly increases from the steady state, the overall control unit 73 may determine that the type of breath blown by the viewer is "warm breath".
[0184] It is also possible to adopt a configuration for detecting breath using a wind sensor. The inventor of the present application has confirmed that according to the wind sensor, it is sometimes possible to detect a relatively weak wind such as the wind when lying on paper, and when blowing breath on the wind sensor, it immediately reaches a peak and has good responsiveness when the wind starts to blow. However, if blowing breath continuously, it immediately drops from the peak. It is conceivable that a strong wind such as a hoo breath cools the heater and takes time to recover.
[0185] Regarding the configuration for detecting breath using a wind sensor, the following configuration may be adopted.
[0186] When the overall control unit 73 continuously detects a predetermined air volume with the wind sensor, it may perform processing in a direction where the user is not being blown on. Processing in a direction where the user is not being blown on is, for example, processing for determining that no breath is being blown. In this case, when the time from the start to the end of wind detection by the wind sensor is within the time during which blowing is possible, the overall control unit 73 may perform processing in the direction where the user is being blown on.
[0187] In this case, the wind sensor may be a sensor that detects wind by electrically measuring the heat taken away by the wind. In this sensor, the wind received by the sensor corresponds to the air volume of the blown breath. This sensor is set to drop to a value less than the actual air volume during the duration when the wind received by the sensor continues for a time corresponding to the time of the blown breath, and is preferably set such that this drop is less likely to occur when the wind received by the sensor is less than the air volume of the blown breath.
[0188] In the display device 1, a flow path for allowing wind with a common breath inflow path to flow in may be provided for a plurality of wind sensors as the wind sensors. The flow path is preferably configured such that wind enters different wind sensors at a predetermined ratio that is not 1:1. The overall control unit 73 may determine the size and time of the blown breath based on the ratio and the differences in the characteristics of the plurality of wind sensors. The display device 1 includes a plurality of wind sensors with different timings of dropping to a value less than the actual air volume during the duration, and the overall control unit 73 may determine the size and time of the blown breath based on the outputs of the plurality of wind sensors. The display device 1 may include at least a wind sensor that is not a gas sensor and a ca sensor as the plurality of wind sensors.
[0189] Also, it is preferable to use a gas sensor for detecting a predetermined gas as the wind sensor. As the wind sensor, it is preferable to use a gas sensor for detecting a predetermined gas and including a heater. In this case, the gas sensor including the heater outputs in a direction in which the gas detection amount increases when the degree of blowing is relatively small (as a result of detecting the gas contained in the breath), while outputs in a direction in which the gas detection amount decreases when the degree of blowing is relatively large (due to the cooling of the heater by the wind of the breath).
[0190] When the overall control unit 73 determines that a breath is being blown, when the strength is relatively large (for example, when the air volume is equal to or greater than the threshold value), it displays an animation that moves the clothes, hair, etc. of the 3D character 1100, while when the strength is relatively small, it displays an animation different from the animation that moves the clothes, hair, etc. of the 3D character 1100.
[0191] By the way, when using a gas sensor for breath detection, the gas sensor outputs the above output value in response to a component (for example, carbon dioxide) contained in human breath. And, the reason why the output value of the gas sensor is different between the case where a breath of "whoosh" is blown and the case where a breath of "ha" is blown is that when a breath of "whoosh" is blown, the speed of the blown breath is high and it easily diffuses around immediately after colliding with the gas sensor, while when a breath of "ha" is blown, the speed of the blown breath is low and the components of the breath tend to stay on the spot after colliding with the gas sensor.
[0192] Furthermore, the overall control unit 73 may determine whether the detected wind is caused by a viewer's blowing or by a blower, for example, using the detection result of humidity by a humidity sensor. For example, in the display device 1, when it is detected by the humidity sensor that the output value of the gas sensor has rapidly decreased from the steady state and the humidity has rapidly increased from the steady state, the overall control unit 73 may determine that the user has blown. On the other hand, when the output value of the gas sensor has rapidly decreased from the steady state but the humidity remains in the steady state, the overall control unit 73 may determine that the wind is being sent by the blower. Furthermore, the overall control unit 73 may use the detection result of temperature by a temperature sensor to determine the type of breath when it is determined that the user has blown. Also, when the increase and decrease of the output value of the gas sensor are repeated within a relatively short fixed period, the overall control unit 73 may determine that the wind of the oscillating fan is hitting.
[0193] Note that the wind sensor, humidity sensor, temperature sensor, temperature-humidity sensor, and gas sensor used for detecting wind are examples of wind detection means. The display device 1 may have a barometric pressure sensor as a sensor for detecting wind. This is because a change in barometric pressure can occur depending on the generation and strength of the wind.
[0194] The various controls as described above can be executed. Note that the above-described control is not limited to the 3D character 1100, and may be performed for the communication function related to other characters (for example, the 3D character 1200).
[0195] [Display example of three-dimensional image, etc.] In the display device 1 having the configuration as described above, the following display may be performed for a three-dimensional image (particularly, for example, a three-dimensional image displaying a 3D character). The following display may be executed, for example, as an example of the above-described "communication function". Note that the following display may be reproduced, for example, when the overall control unit 73 executes the 3D application in the ROM 702.
[0196] For example, although not shown, when there is movement in a part of the character's body, the overall control unit 73 may change the parse of the character (for example, also referred to as a parse image). By doing so, a sense of jumping can be given to the character.
[0197] For example, although not shown, when the character gets angry through conversation with the viewer and an effect is performed where the character throws a punch, the overall control unit 73 controls the camera position so that the character's hand appears in front of the camera within the 3D application, and controls to change the parse to a state where it is emphasized more than the normal state, at least during the period when the punch is being thrown. Then, when the character's punch ends, the overall control unit 73 may control to return the parse to the normal state.
[0198] Also, when adjusting the interval between the left and right cameras (for example, the interval setting value in the 3D application) so that the 3D character appears to jump out in front of the lenticular member 30 in autostereoscopic viewing, if the degree of popping out is increased, there is a problem that the 3D character appears to be stretched in the front-rear direction. Considering such a problem, the overall control unit 73 may execute image processing to compress the front-rear direction of the 3D character as the degree of popping out increases (for example, as the interval between the left and right cameras is widened). In particular, a compression amount corresponding to the degree of popping out may be provided, and the compression amount may be increased as the 3D character jumps out more to the front side.
[0199] Also, although not shown, the overall control unit 73 may display various parts of the 3D character's body (for example, the chest in the case of a female character) so as to sway. In this case, in order to more strongly emphasize the three-dimensionality of the 3D character, for example, an image in which the 3D character is facing obliquely forward instead of straight ahead may be displayed.
[0200] Further, the overall control unit 73 may set various parameters (such as the separation degree, orientation of the camera, distance to the display object, etc.) in the 3D application to appropriate values according to the character displayed on the image display unit 20. Note that, not limited to the automatic setting by the overall control unit 73, a physical slider for adjusting various parameters in the above 3D application may be provided on the housing 10 so that a viewer or the like can easily adjust the various parameters while viewing the 3D character.
[0201] Also, although not shown in the figure, the overall control unit 73 may display a predetermined object (for example, a plate or the like) so as to be drawn at the same position as the light shielding member 30. In this way, it is possible to notify the viewer in the video that the light shielding member 30 exists, and when the viewer puts a hand into the space region 102 (FIG. 6), it is possible to prevent the viewer's hand from hitting the light shielding member 30. Note that it is still better if the display device 1 is provided with a function of calibrating various parameters so that the predetermined object and the light shielding member 30 are at the same position.
[0202] Also, videos in a state where the 3D character pops out to the front side (the opening 5 side) of the light shielding member 30 and in a state where the 3D character only pops out to the rear side (the image display unit 20 side) of the light shielding member 30 may be provided in advance, and different actions may be performed in each state. For example, although not shown in the figure, when the overall control unit 73 displays a video in which the 3D character pops out to the front side on the image display unit 20, the image display unit 20 may display a video in which the 3D character actively asks the viewer to touch it, such as when the 3D character requests a handshake. In the reverse case, a video in which such an operation is not performed may be displayed. Further, the overall control unit 73 may, for example, display an image of a slide on the surface of the inclined light shielding member 30 and draw an image of the character sliding on it (the front side).
[0203] Further, the overall control unit 73 may selectively display, on the image display unit 20, any one of a plurality of images including the following first image and second image as an image recognized as a three-dimensional image. The first image may be an image (see the 3D character 1000 in FIG. 21(B)) that can be stereoscopically viewed by the viewer such that at least a part of the 3D character 1000 is present on the front side (opening 5 side) of the light dimming member 30. The second image may be an image recognized as being present on the front side or the back side of the first image. For example, on the image display unit 20, a second image (see FIG. 21(A)) that can be stereoscopically viewed by the viewer such that the 3D character 1000 (an example of "a display object to be stereoscopically viewed by the viewer") is present on the back side (image display unit 20 side) of the light dimming member 30, and a first image (see FIG. 21(B)) that can be stereoscopically viewed by the viewer such that the portion above the feet of the 3D character 1000 is present on the front side (opening 5 side) of the light dimming member 30 may be switched and displayed. In the first image, it may be an image that can be stereoscopically viewed by the viewer such that all parts of the 3D character 1000 are present on the front side of the light dimming member 30. In this way, any one of a plurality of images including the first image and the second image, where the positions where an image recognized as a three-dimensional image by the viewer exists are different, can be selectively displayed, so that the stereoscopic effect given to the viewer can be changed. As a result, for example, the viewer can be made to enjoy more. Note that the image of the 3D character 1000 itself is displayed on the display surface of the image display unit 20, and FIG. 13 shows the 3D character 1000 stereoscopically viewed by the viewer (also expressed as appearing to jump out from the image display unit 20).
[0204] For example, the overall control unit 73 may switch the display image of the image display unit 20 by causing a transition from an image (see FIG. 21(A)) in which the 3D character 1000 only pops out to the rear side of the light attenuation member 30 to an image (see FIG. 21(B)) in which the 3D character 1000 (all or a part of the 3D character 1000) pops out to the front side of the light attenuation member 30. The position where the three-dimensional image is recognized may be switchable by an operation of the operation unit 40 by the viewer or other operations. The viewer may operate so that the image is displayed at a position where the three-dimensional image appears three-dimensionally. Also, there may be three or more switchable positions for the three-dimensional image. This is because whether the three-dimensional image appears three-dimensionally may vary depending on individual differences.
[0205] Also, when performing a display transition between the first image and the second image, the overall control unit 73 may display an image (video) of a moving process in which the 3D character 1000 gradually moves from the rear side to the front side (or from the front side to the rear side) of the light attenuation member 30.
[0206] In such an image transition, the overall control unit 73 may display, for example, a video in which the 3D character performs an action indicating the presence of the light attenuation member 30 on the image display unit 20. For example, when the 3D character hits the light attenuation member 30 from a position on the rear side of the light attenuation member 30, an image with a hole opened may be arranged at the same position as the light attenuation member 30, and a video in which the 3D character pops out from the hole and moves to the front side may be displayed.
[0207] [Specific example of video displayed on display device 1] Next, with reference to FIGS. 22 to 36, a specific example of the video displayed on the display device 1 will be described. FIGS. 22 to 36 are diagrams showing an example of a character (video including the 3D character 1200 described in FIGS. 11 and 12) displayed on the display device 1 according to the present embodiment. Each video shown in FIGS. 22 to 36 is an image that is displayed on the display device 1 and can be viewed by a viewer through the opening 5. Although the stage video 2200 is displayed in FIGS. 22 to 36, the 3D character 1200 may be displayed instead without displaying this.
[0208] The display device 1 (specifically, the overall control unit 73) switches and displays the video of the 3D character 1200 shown in FIGS. 22 to 28 regularly or randomly during the period of waiting for the operation of the viewer based on the communication function. The display device 1 (specifically, the overall control unit 73) changes the display of the 3D character 1200 based on the communication function. For example, as shown in FIG. 22(A), the 3D character 1200 is displayed in a posture of standing facing the front side (the side where the image is viewed) of the display device 1. The display device 1 may use this posture as the basic posture and also as the display during the period when communication based on the communication function is not being performed. For example, as shown in FIG. 22(B), the 3D character 1200 makes an action of licking its front leg. For example, as shown in FIGS. 22(C) and 23(A), the 3D character 1200 makes an action of alternately looking to its left and right. For example, as shown in FIG. 23(B), the 3D character 1200 makes an action of facing the ground. For example, as shown in FIG. 23(C), the 3D character 1200 makes an action of stretching while sitting. For example, as shown in FIG. 24(A), the 3D character 1200 makes an action of peeking into the ground. Further, for example, as shown in FIGS. 24(B) and 24(C), the 3D character 1200 makes an action of walking towards the front side. For example, as shown in FIG. 25(A), the 3D character 1200 makes an action of peeking into its own abdomen. For example, as shown in FIG. 25(B), the 3D character 1200 makes an action of tilting its neck. For example, as shown in FIG. 25(C), the 3D character 1200 makes an action of rubbing its own eyes. For example, as shown in FIG. 26(A), the 3D character 1200 makes an action of yawning. For example, as shown in FIG. 26(B), the 3D character 1200 makes an action of licking its front leg while sitting. For example, as shown in FIG. 26(C), the 3D character 1200 makes an action of looking at its left front. For example, as shown in FIG. 27(A), the 3D character 1200 makes an action of looking at its right front. As shown in FIG. 27(B), the 3D character 1200 makes an action of stretching. For example, as shown in FIG. 27(C), the 3D character 1200 makes an action of peeking into the ground.For example, as shown in FIG. 28(A), the 3D character 1200 faces in the direction diagonally forward to the right of the display device 1, and then as shown in FIG. 28(B), faces forward. As shown in FIG. 28(C), the 3D character 1200 performs an action of licking its front leg.
[0209] Figures 29 to 36 are an example of the display of the 3D character 1200 performed by the display device 1 (specifically, the overall control unit 73) based on the communication function during the dialogue process. The character strings shown in Figures 29 to 36 are character strings recognizable by voice recognition and are displayed above the 3D character 1200. Figure 29(A) is what is displayed when the display device 1 recognizes the viewer's utterance of "Come here~", and in response, a voice is output. Figures 29(B) to 30(B) are what are displayed when the display device 1 recognizes the viewer's utterance of "Sit down", and in response, a voice is output. Figure 30(C) is what is displayed when the display device 1 recognizes the viewer's utterance of "Are you hungry?", and in response, a voice is output. Figure 31(A) is what is displayed when the display device 1 recognizes the viewer's utterance of "Police officer", and in response, a voice is output. Figures 31(B) and (C) are what are displayed when the display device 1 recognizes the viewer's utterance of "It's snack time", and in response, a voice is output. Figure 32(A) is what is displayed when the display device 1 recognizes the viewer's utterance of "Hand", and in response, a voice is output. Figures 32(B) to 33(B) are what are displayed when the display device 1 recognizes the viewer's utterance of "So cute", and in response, a voice is output. Figure 33(C) is what is displayed when the display device 1 recognizes the viewer's utterance of "Hello", and in response, a voice is output. Figure 34(A) is what is displayed when the display device 1 recognizes the viewer's utterance of "Eat rice", and in response, a voice is output. Figures 34(B) and (C) are what are displayed when the display device 1 recognizes the viewer's utterance of "Is it a girl?", and in response, a voice is output. Figure 35(A) is what is displayed when the display device 1 recognizes the viewer's utterance of "Wait", and in response, a voice is output. Figure 35(B) is what is displayed when the display device 1 recognizes the viewer's utterance of "What a good child", and in response, a voice is output. Figures 35(C) and 36 are what are displayed when the display device 1 recognizes the viewer's utterance of "Uno", and in response, a voice is output.
[0210] <More detailed description of the 3D character 1200> A more detailed description will be given of the 3D character 1200 described with reference to FIGS. 22 to 36. In the following description, with respect to the description with the display device 1 as the processing subject, it may be regarded as the processing performed by the control unit 70 (more specifically, the overall control unit 73). The 3D character 1200 is particularly preferably drawn at approximately life size. By doing so, it has been found that the sense of depth is particularly emphasized. The display device 1 may draw the 3D character 1200 such that, when viewed from the side (horizontal side), in the vertical direction, the head occupies approximately one-third, the torso occupies one-third, and the legs occupy one-third of the height. The display device 1 may draw the 3D character 1200 such that, for parts other than the tail, when viewed from the side, in the horizontal direction, the head occupies approximately one-third and the torso occupies two-thirds.
[0211] The display device 1 has a function of performing mutually displaced drawing between a state where the tail is not visible and a state where the tail is visible with a face on the front. It is preferable that the time when the tail is visible is shorter than the time when the tail is not visible. Although the tail is drawn deeper than the head, the occasional visibility of the tail can greatly enhance the sense of three-dimensionality and prevent the eyes and head from getting tired due to constantly feeling a strong sense of three-dimensionality. In particular, the display device 1 preferably performs such drawing processing in the voice recognition standby state. The display device 1 preferably has a function of drawing such that the tail appears from the top of the head when displacing to the state where the tail is visible. In this way, normally, since the viewer's line of sight is on the eyes of the face and the tail suddenly pops out above the head from the upper center thereof, surprise and interest can be given.
[0212] The display device 1 is preferably provided with a flat portion on the top of the head of the 3D character 1200 when viewed from the front, and in particular, the head portion between the left and right ears should be drawn flat when viewed from the front. In this way, a tail with a three-dimensional effect suddenly appears from the flat top of the head with a weak three-dimensional effect, which can give more surprise and interest. Also, after drawing the tail so that it appears from above the head, the display device 1 is preferably configured to perform drawing that moves the portion closer to the tip of the tail. In this way, the viewing point can be focused on the portion of the tail behind the face, and a stronger three-dimensional effect can be felt. The display device 1 may similarly draw the tail so that it appears from the left and right sides of the body. When the display device 1 causes the tail to appear from the left and right, the length and / or time during which the tail appears is preferably shorter than when the tail appears from above the head. When the display device 1 causes the tail to appear from the left and right, it is preferably configured to perform drawing that causes the tail to appear in a flickering manner. The display device 1 may also be configured to perform drawing that sometimes moves the line of sight to the back, which can make the viewer feel a stronger three-dimensional effect. While the tail appears from above the head during voice recognition, the display device 1 is preferably configured to perform drawing that causes the tail to appear from either the left or the right direction when outputting voice from the cat. The display device 1 is preferably provided with a portion on the tail that has a drawing pattern different from other portions at predetermined intervals in the length direction. For example, a pattern with a predetermined width in an annular or arc shape may be attached to the cylindrical surface of the tail at regular intervals. In this way, the inventors have found that the movement of the tail can be felt to move more dynamically in three-dimensional space.
[0213] When voice recognition is in progress, the display device 1 is preferably configured to perform drawing that changes the current posture to the same posture when there is a change from a state where voice recognition is not in progress to a state where voice recognition is in progress so as to be in the same posture. Before the start of voice recognition, the display device 1 is preferably configured to utter "Let's talk nya". The display device 1 is preferably provided with a function (such as a sensor or a switch) for detecting the actions of the viewer, and is preferably provided with a function of uttering "What nya?" when an action from the viewer is detected. Both functions are preferably executed continuously in the form of "What nya?" and "Let's talk nya", and then the process is preferably performed so as to enter the voice recognition state.
[0214] The display device 1 has information on phrases such as "so cute", which are phrases of praise, as voice recognition phrases, and when a phrase of praise is recognized, it may change the body posture. Furthermore, it is even better to move the position of the cat itself, such as walking. By doing so, since the viewer wants to see the change in the cat's posture and the movement of the movement, they will take praise actions and words, and excellent effects of therapy such as improvement of actions and words can be obtained.
[0215] The display device 1 has a voice recognition phrase corresponding to giving food, and when the phrase is recognized, it is advisable to draw the tail wagging faster than in other cases. By doing so, it is possible to give the viewer a feeling as if the cat is actually alive.
[0216] The display device 1 may perform drawing processing with the outline of the cat's eyes generally circular and the black eye part vertically elongated elliptical. The display device 1 may draw the black eye part with a shading gradient in the vertical direction and draw it in a lighter color as it goes downward. The display device 1 may provide a part blacker than the periphery of a generally circular or elliptical shape at the center of the black eye. The display device 1 may provide and draw a crescent-shaped or semi-circular white area along the outer edge of the black eye in the part closer to the outside of the face above the black eye part. On the other hand, the display device 1 may provide and draw a circular white area at a position closer to the center of the face below the black eye. The display device 1 may continue to draw this white area even when there is a change in the position of the 3D character 1200 (such as a change in posture), or a change in the position of the camera or light. Usually, highlights are often put in by calculation as reflections of light and the like. However, by doing so, it is possible to emphasize the individuality of the cat's eyes, which are most seen during voice recognition conversations, and to impress the viewer as an individual cat in a short time during voice recognition.
[0217] The display device 1 takes a state where the face is facing forward and a state where the face is facing downward. When the face is facing forward, the outline of the eyes is drawn generally circular, while when the face is facing downward, the eyes are drawn horizontally elongated elliptical.
[0218] The display device 1 takes two states: one where the upper end of the face is above the upper end of the body, and the other where the upper end of the face is below the upper end of the body. When the upper end of the face is above the upper end of the body, the outline of the eyes is generally drawn in a circular shape, while when the upper end of the face is below the upper end of the body, the eyes may be drawn in a horizontally elongated elliptical shape. The display device 1 has a function of drawing a state of yawning with the mouth open, and when drawing this, it is advisable to draw the eyes closed.
[0219] The display device 1 may prepare a plurality of patterns of standby motions for the 3D character 1200 and repeat the process of selecting and drawing one pattern from these patterns. Examples of standby motions include motions of licking the feet, stroking the face with the hand, licking the buttocks, facing forward, looking around left and right, licking the ground, stretching, yawning, walking, etc.
[0220] The display device 1 may draw the ears so that they move with a delay relative to the movement of the face. For example, even when the face starts to move, the ears may be drawn to maintain their position for a while. The display device 1 may be equipped with a function of simultaneously performing a motion of wagging the tail from side to side when performing a licking motion. When the 3D character 1200 is viewed from the front, the display device 1 may make the pattern on the body asymmetrical left and right. In this way, it becomes easier to be remembered as an individual cat, and it also becomes easier to determine whether the right side or the left side is visible. This is particularly useful when providing a scene where the overall image of the 3D character 1200 is enlarged so that it cannot be seen in its entirety. In particular, the pattern is preferably that of a calico cat, and especially that of a tabby cat. The inventors have found that this makes it particularly easy to grasp the three-dimensional effect. In particular, the pattern on the head may be provided in the front-back direction, while the pattern on the body may be provided in the up-down direction, etc., so that the directions of the patterns are different. In this way, even if the position of the camera or the cat changes in any direction, it becomes easier to recognize.
[0221] The display device 1 is configured to have a function of emitting a meowing sound, and the meowing sound includes those with a plurality of intonations, and different motions are associated with each meowing sound. Among the intonations, there may be an interrogative intonation, and as a motion, there may be a motion of tilting the head.
[0222] <Regarding the communication function of the 3D character 1200> Supplement the communication function regarding the 3D character 1200. By doing the following, a higher-quality communication function with the 3D character 1200 can be provided to the viewer. Here, the behavior of the person until they get used to it and the outline of the action story with the 3D character 1200 will be described. In this embodiment, a photographing unit for photographing the viewer is provided on the front side of the display device 1.
[0223] (1) First step: The stage until getting used to Normally, there are various types of cats such as stray cats that run away just by seeing a person or run away when a person approaches. At that time, the cat's behavior seems to run away while looking back at the person's appearance several times. Here, the control unit 70 recognizes the presence of the viewer based on the photographed image taken by the photographing unit, and when the intensity of the microwave measured by the human sensor 64 exceeds the threshold value, a video in which the 3D character 1200 performs a running-away motion is displayed. This is to consider that a person has approached the cat. Recognizing the viewer with the photographing unit is to show the viewer the scene where the 3D character 1200 runs away. That is, unless the viewer approaches the display device 1 from the front side, the 3D character 1200 is prevented from performing a running-away motion.
[0224] Next, it is considered that a person calls to a cat, saying "Squat down (lower your eye level)", "Come here, come here", etc. Sometimes, there is a cat that stops and observes the situation. However, when a person approaches, the cat runs away. This is repeated several times. With such actions of the person, it is considered that the cat will not get used to it. Therefore, during the period when the control unit 70 is displaying the video in which the 3D character 1200 is running away, when the intensity of the microwave measured by the human sensor 64 is equal to or lower than a certain threshold value, and for example, when a word indicating calling to the 3D character 1200 such as "Come here" is recognized by voice recognition, the control unit 70 displays a video in which the 3D character 1200 performs an action of stopping. Here, the condition that the intensity of the microwave is equal to or lower than the threshold value is because a state where a human stops is assumed.
[0225] Next, it may be considered that a person gives food to a stationary cat. However, when a person approaches the cat, the cat runs away, so it is considered that the only option is to place food in a place where the cat often comes. Therefore, the display device 1 has a function of displaying an image in which food is placed within the video display space. For example, when the control unit 70 receives a predetermined operation (for example, an operation of the operation unit 41 or the operation unit 42), or when a predetermined gesture indicating placing food is detected by the gesture sensor 63, it assumes that food has been placed and displays an image showing the food in the video. In this way, the viewer will, for example, place food every day. At this time, the control unit 70 may preferably display a scene where the 3D character 1200 is watching from afar. When the control unit 70 does not recognize the presence of the viewer using the human sensor 64 and the viewer is not being photographed by the imaging unit, the control unit 70 displays an image of the 3D character 1200 eating the food. Here, a situation where the cat does not eat the food in front of people is reproduced. From the viewer's perspective, it creates a situation where the food has disappeared without them noticing. The control unit 70 counts the number of times the viewer has given food and stores this count. This state will continue for a while, but the control unit 70 may preferably display a scene where the distance between the viewer, the 3D character 1200, and the person (the distance felt by the viewer) is gradually reduced according to the number of times food has been given. For example, when starting to give food, as the number of times food has been given increases, the control unit 70 may display the 3D character 1200 larger to reproduce the reduction in distance (that is, the viewer is getting a bit more used to it). Furthermore, when the number of times food has been given increases and reaches a predetermined threshold, assuming the cat has become accustomed, even when the viewer is looking at the character, that is, when the control unit 70 recognizes the presence of the viewer using the human sensor 64 and the viewer is being photographed by the imaging unit, the control unit 70 displays an image of the 3D character 1200 eating the food. Only at this time can the viewer visually observe the 3D character 1200 eating the food.
[0226] However, it is not uncommon for people not to know when a cat will eat. Therefore, the control unit 70 may determine the time period (alternatively, it may be a specific time point) when the 3D character 1200 eats food, and display a video of the 3D character 1200 eating food during that time period. This is to make the viewer notice that it seems the 3D character 1200 eats food during this time period. When it is detected that the viewer attempts to touch the 3D character 1200, the control unit 70 causes the 3D character 1200 to output a voice with a predetermined utterance content "Shah" or "Shashar", and displays a video of the 3D character 1200 running away. The viewer's attempt to touch the 3D character 1200 may be identified when the intensity of the microwave detected by the human sensor 64 exceeds a threshold value or the first sensor 2331 detects a predetermined gesture while the 3D character 1200 is performing an action of eating food.
[0227] Such a situation continues for a while, but the control unit 70 may gradually reduce the distance at which the viewer's hand can approach the 3D character 1200. When it approaches a predetermined distance, the control unit 70 may display a video of the 3D character 1200 performing an action of grooming or relaxing in front of people, assuming that the 3D character 1200 has become accustomed to the viewer. Specifically, the control unit 70 increases the threshold value for the intensity of the microwave or increases the threshold value for the distance from the display device 1 when a gesture is made. In this way, the control unit 70 reduces the detection sensitivity, dulls the reaction of the 3D character 1200 to the viewer's movement, and also stops causing utterances such as "Shah" or "Shashar".
[0228] The cat is always on guard, but will gradually add behaviors such as grooming, lying down, scratching its claws, and wiping its face. As the cat gradually gets used to people and people's hands, people will be able to touch the cat with their hands. Therefore, the control unit 70 may not reflect the detection result of the microwave by the human sensor 64 in the operation of the 3D character 1200. The control unit 70 may function the first sensor 2331 as a motion sensor and display a video in which the 3D character 1200 looks comfortable when being stroked according to the detection result of the gestures of the viewer in the up-down, left-right, front-back directions. The control unit 70 may further recognize the voice of the viewer by the microphone 61 and display a video in which the 3D character 1200 reacts to it. For example, no matter what words are recognized, the control unit 70 may make the 3D character 1200 emit a meowing sound of "nya" as the utterance content.
[0229] As time passes, the control unit 70 may display a video in which the 3D character 1200 begs for food. When the shooting unit recognizes the presence of the viewer and the human sensor 64 detects the presence of the viewer, the control unit 70 may determine the time zone (for example, morning, noon, evening) and make the 3D character 1200 emit a meowing sound of "nyanya" and display a video of performing a rubbing face motion. Further, when the viewer talks to the 3D character 1200, the control unit 70 may reproduce the state in which the 3D character 1200 remembers its own name. For example, the control unit 70 may only react to the word "Yuno" and make the 3D character 1200 emit a meowing sound of "nya", or react to the calls of "Yuno" and "There is food" and display videos of taking cute actions or rubbing happily.
[0230] (2) Second step: The stage of learning the language (Japanese) When the control unit 70 recognizes a call from a viewer named "Uno" at a certain time, it outputs a voice indicating a response of "What?". From here, it enters the stage where the 3D character 1200 learns words. The control unit 70 counts the number of times it has been called, calculates the cumulative average per day, and responds according to a value calculated by the cumulative average per day of the number of times food has been given × the cumulative average of the number of times it has been called × a random coefficient (hereinafter referred to as the "cumulative average value"). This call is a predetermined call such as "Good morning", "Hello", "Good evening", "Are you okay?", "Do you want food?", etc. The control unit 70 stops responding (that is, reproduces the fact that the 3D character 1200 has forgotten words) or increases the words to respond according to the cumulative average value. For example, the control unit 70 may decrease the words to respond as the cumulative average value gets smaller, and increase the words to respond as the cumulative average value gets larger. The cumulative average value is calculated based on the number of times it has been called from the start time of using the display device 1 to the current time, but it may also be calculated based on the number of times it has been called from a time point retroactively a predetermined period in the past to the current time. The predetermined period may be fixed, such as one month, or when the display device 1 has not been used for a certain period, it may be the period after the start of use after that period. At the beginning when the use of the display device 1 starts, the cumulative average value can change greatly. For example, if the viewer does not call even once a day, the 3D character 1200 may stop responding, but as the number of calls increases, the cumulative average value changes less. In this way, it is possible to reproduce the state where it takes time for the 3D character 1200 to forget words. The random coefficient used in calculating the cumulative average value is a value for reproducing the capriciousness of a cat and may be called a capriciousness coefficient. The random coefficient may be changed by the actions of the 3D character 1200 and the viewer, such as giving / not giving food when the character 1200 begs for food, or taking actions such as calling or touching to wake up when the 3D character 1200 is sleeping.
[0231] When the cumulative average value further exceeds a certain threshold, the control unit 70 may be configured to talk to the viewer from the 3D character 1200 or respond to questions about predetermined information such as weather and news. Of course, when the number of times the viewer feeds the character decreases, the cumulative average value decreases, so the control unit 70 may reduce the type of response or stop responding. That is, if the viewer feeds the character in a haphazard manner or does not appropriately talk to the character, the function of the 3D character 1200 to respond may not be maintained, or even if it is maintained, the character may not respond "randomly" as described above. In this way, a higher-quality communication function with the 3D character 1200 can be provided to the viewer.
[0232] The following may also be done.
[0233] For example, in a lenticular display, the image may become invisible in three dimensions when the viewer's eyes move only a few centimeters to the right or left from the position where the image appears three-dimensional. In this case, there is a risk that the viewer may give up and think that "the image does not appear three-dimensional". Considering this point, the control unit 70 may control to issue an instruction such as "try moving 3 centimeters to the right when I appear to be two people" based on the detection result of the human sensor 64, for example. By doing so, it is possible to prevent the viewer from getting bored due to the image not appearing three-dimensional. The instruction may be output as sound from the speaker 62, for example. Also, the timing of issuing the instruction may be the timing when the human sensor 64 recognizes the transition from a state where there is no one around the display device 1 to a state where there is someone. Further, the timing of issuing the instruction may be the timing when an unregistered person is recognized, or it may be a regular timing.
[0234] Also, for example, when the display device 1 is capable of performing physical calculations related to the movements of multiple parts of the character, when a specific part of the character (for example, the chest) is relatively small, the physical calculations related to the movement of the specific part may not be performed.
[0235] In addition, while adding motion to the character's body, it is preferable not to add motion to the character's clothes and to control the clothes to move by physical calculation according to the movement of the character's body. By doing so, the amount of calculation in the physical calculation can be reduced.
[0236] Further, for example, the control unit 70 may display an object for indicating whether or not voice recognition is in progress on the image display unit 20. For example, in the image display unit 20, display control may be performed such that an image imitating a lamp lights up only during voice recognition. The object may be displayed, for example, on the back side of a specific character and in a non-conspicuous manner (with relatively inconspicuous brightness, color, shape, size, etc.) at the edge portion of the display area of the image display unit 20.
[0237] Further, for example, the control unit 70 may display the phrase (sentence) recognized by voice recognition on the viewer's viewpoint side (front side) rather than the object of a specific character for a predetermined time after voice recognition, and make it non-displayed after the elapse of the predetermined time (see FIGS. 29 to 35). Then, after the phrase (voice recognition result) is made non-displayed, the character may be controlled to speak.
[0238] In addition, when a three-dimensional image in which a character exists on the stage is displayed, the control unit 70 may display a character with a relatively small length in the depth direction (for example, a humanoid character) on the front side of the stage rather than in the center of the stage, while displaying a character with a relatively large length in the depth direction (for example, a cat character) in the center of the stage. Further, for example, when a humanoid character is displayed, display control may be performed to emphasize the length of the stage itself to create a sense of depth.
[0239] In addition, when the control unit 70 displays an image of a character at a position other than the center of the stage (for example, a position on the front side), when displaying a video in which the character rotates, the stage may also be displayed to rotate in the same manner as the character.
[0240] Also, a stage having a shape with a relatively large distance in the depth direction may be displayed, and an image in which a character moves along the outer edge of the stage inside such a stage (for example, an image in which a cat character walks along the outer edge of a circular stage) may be displayed.
[0241] Also, when causing the character to perform a walking motion, it is preferable that an image in which the stage etc. (including roads etc.) is not drawn and the character stamps its feet on the spot without substantially moving the overall position of the character is drawn. And when the character performs an operation other than the walking motion, it is preferable that a stage etc. is drawn at the feet of the character.
[0242] [Modification Example] As described above, an example of an embodiment of the present invention has been described, but the present invention is not limited to the above-described embodiment, and various modifications are possible. For example, the following modification examples may be implemented.
[0243] (1) For example, in the display device 1 according to the above-described embodiment, it is preferable that a plurality (for example, two) of light-shielding members 30 are detachably provided. In this way, the brightness and floating feeling of the image displayed on the image display unit 20 can be adjusted without providing a separate adjustment member.
[0244] (2) Also, in the display device 1 according to the above-described embodiment and each modification example, in addition to the light-shielding member 30 (see FIG. 6) inclined with respect to the bottom surface of the housing 10, a light-shielding member arranged perpendicular to the bottom surface of the housing 10 may be further provided.
[0245] (3) Also, in the above embodiment, the gesture sensor 63 (an example of a behavior detection sensor) is arranged on the inner peripheral surface of the housing 10 facing inward of the housing 10 (see FIG. 6), but it is not limited thereto. For example, the gesture sensor 63 (specifically, the detection surface of the gesture sensor 63) may be arranged obliquely forward and downward at the upper part of the opening 5. In this way, even when a gesture is made outside the opening 5 by a viewer, the gesture can be detected.
[0246] (4) Further, for example, in the display device 1 according to the above embodiment and each modification, a transmissive display capable of adjusting the transmittance (or transparency) may be further provided. The transmissive display may be provided, for example, on the front side (frontward side) of the light-shielding member 30 in the internal space 100 of the housing 10. In particular, the transmissive display may be arranged in an inclined manner in the same way as the light-shielding member 30.
[0247] Alternatively, instead of the transmissive display, a film capable of adjusting the transmittance (or transparency) may be provided. In this way, an effect can be achieved such that the three-dimensional stereoscopic display character gradually begins to be visible.
[0248] (5) Also, in the display device 1 according to the above embodiment and each modification, a panel (so-called face-fitting panel) capable of fitting the face of the viewer may be further provided near the opening 5. The panel may be installed at a position where naked-eye stereoscopic viewing is possible. Also, a picture may be drawn on the side of the panel facing the housing 10, and the face of the viewer may be photographed in a state where the viewer fits his / her face into the panel. And it is preferable to adopt a mechanism in which the photographed image is uploaded to an SNS (Social Networking Service) as "you when looking at me".
[0249] (6) Also, it is preferable to use a stereoscopic display device without glasses that outputs an instruction to move the head left and right to a position where an image can be clearly seen (also referred to as clearly) with one eye closed, and to open both eyes at a position where an image can be clearly seen with one eye closed. Further, when the image appears double when both eyes are opened at a position where an image can be clearly seen with one eye closed, it is preferable to use a stereoscopic display device without glasses that outputs an instruction to close one eye again, move further to the left or right, and open both eyes at a position where an image can be clearly seen.
[0250] (7) Also, it is preferable to use a system that includes the display device 1 according to the above-described embodiments and each modification example, and includes a printed matter on which phrases recognizable by voice by the display device 1 are printed. Further, it is preferable to use a system that includes the display device 1 and allows a printed matter on which phrases recognizable by voice by the display device 1 are printed to be installed near the display device 1.
[0251] (8) Also, it is preferable to use a system that includes a display device 1 with a built-in voice recognition device and having voice directivity in a specific direction (for example, the front direction), and in which the same display device is arranged in the direction opposite to the specific direction. For example, it is preferable that the two display devices 1 are arranged such that the openings 5 of the two display devices 1 face each other in the opposite direction. In this way, for example, it is possible to avoid the situation where, in one display device 1 (specifically, the microphone 61 of the display device 1), the voice of a person using the other display device 1 or the voice output from the speaker 62 of the other display device 1 is input.
[0252] (9) Further, as the display method of the image display unit 20, in addition to the autostereoscopic display methods such as the lenticular lens method and the parallax barrier method, a display method that can be recognized as a three-dimensional video using glasses may also be used. The housing of the display device 1 may have a rectangular parallelepiped shape, a cubic shape, a cylindrical shape, other polyhedral shapes, a spherical shape, or other shapes. Also, the shape, structure, dimensions, color, pattern, arrangement, etc. of each component of the above-described display device 1 are merely examples. Further, some of the components provided in the above-described display device 1 may be omitted, or other components may be added. Although the display device 1 may be a stationary display device, it may also be a portable type or a head-mounted type or a glasses type configured to be wearable on the head of the viewer. In such a case, as the dimming member, it is preferable that a common (single) dimming member is arranged on the optical paths of the image light of the image viewed by the viewer's left eye and the image light of the image viewed by the right eye. The opening 5 does not have to be square when viewed from the front side, and may be formed in a circular shape or other shapes. The image display unit 20 may be an image display unit using an organic EL, a digital mirror device, or other display elements as the display element. Even if the image display unit 20 is a display device having a light source other than a backlight, if there is a possibility that light leakage from the light source can be visually recognized, the presence of the dimming member can improve the floating feeling that can be given to the viewer.
[0253] (10) The display device 1 may have one or more display units other than the image display unit 20. For example, as the second image display unit, a display unit may be provided on the whole or a part of the floor of the internal space 100 such that the display surface faces upward (e.g., vertically upward). The second image display unit may be, for example, a liquid crystal display, but may also be a display unit of another type. The control unit 70 may control the display of one or more display units other than the image display unit 20. In this case, a stage video may be displayed on the second image display unit, and a 3D character may be displayed on the image display unit 20. In this way, an effect using an image can be performed on the floor of the internal space 100. Further, instead of the second image display unit, an effect on the floor may be performed using a light emitter (e.g., a light-emitting diode), a light guide member, and a light-shielding member. In this case, the light guide member is arranged on the floor of the internal space 100, and a light-shielding member corresponding to a predetermined pattern (e.g., a magic circle) is arranged on the light guide member. When light from the light emitter is incident on the light guide member, light is emitted upward from a region of the upper surface of the light guide member where the light-shielding member is not arranged, and a viewer can see this.
[0254] (11) In the above embodiment, voice recognition for interacting with the character displayed on the image display unit 20 is activated in response to a pressing operation of the operation unit 41, but it is not limited to this. For example, when the presence of a person is detected in the detection target area of a human sensor (an example of detection means) such as an omnidirectional microwave Doppler sensor, the overall control unit 73 may activate the voice recognition. In this way, when the user interacts with the character displayed on the image display unit 20, for example, there is no need to perform an operation for activating voice recognition or utter a trigger word, and communication can be reproduced more naturally.
[0255] At this time, for example, it is preferable that both the voice recognition in the voice recognition application in the display device 1 and the voice recognition in the voice recognition server are enabled. However, as described below, the activation of the voice recognition in the voice recognition application in the display device 1 and the activation of the voice recognition in the voice recognition server may be executed step by step. For example, when the presence of a person is detected in the detection target area such as the human sensor, the voice recognition in the voice recognition application in the display device 1 is activated, and then, when a greeting or a call from a viewer is detected by the voice recognition application, the voice recognition in the voice recognition server may be activated.
[0256] In addition, when the display device 1 is provided with an imaging unit (an example of a detection unit) such as a camera, a detection target space is provided on the front side (the opening 5 side) of the display device 1, and the overall control unit 73 may activate voice recognition when the presence of a person is detected on the front side of the display device 1. In this way, it is possible to more reliably determine that the viewer is trying to talk to the character displayed on the image display unit 20 and then activate the voice recognition.
[0257] Furthermore, after a person is detected in the detection target area, it is preferable that the overall control unit 73 is configured to activate the voice recognition on the condition that the user authentication is successful. Note that the authentication method for user authentication may be, for example, an authentication method that does not require the user's manual operation (such as face authentication or vocal cord authentication). In this way, for example, when user authentication is performed for a person other than the registered user registered in the display device 1 and the user authentication fails, the voice recognition is not activated and the user cannot talk to the character displayed on the image display unit 20. Conversely, for a person other than the registered user, the character displayed on the image display unit 20 does not show a reaction. Thereby, the user's affection for the character can be increased.
[0258] In addition, when voice other than the words pre-registered in the display device 1 or the dialogue server mounted on the external server is detected, the voice recognition may not be activated.
[0259] Also, an odor sensor may be used as a means for enabling voice recognition. For example, the odor of the registered user of the display device 1 may be registered in the display device 1 in advance, and when the odor of the registered user is detected by the odor sensor, voice recognition may be enabled.
[0260] Also, even if voice recognition is enabled in this way, for example, the voice of the character (e.g., 3D character 1100) displayed on the image display unit 20 may not be immediately output, and the voice of the character may not be output unless the user addresses the character. For example, the overall control unit 73 does not immediately output the character voice of "Welcome home" in response to the enabling of voice recognition, but outputs the character voice of "Welcome home" on the condition that the user voice of "I'm home" is detected in the state where voice recognition is enabled. Furthermore, for example, in an interactive system, it is preferable that a branching scenario for reproducing the following interaction between the viewer and the character (e.g., 3D character 1100) is created. For example, on weekdays, User: I'm home Character: Welcome home~ User: Achoo Character: You must be tired in the hot weather such an interaction is reproduced, and on holidays, User: I'm home Character: Ah, welcome home User: Achoo Character: Don't complain since you went out in the hot weather User: It's work, it's work Character: If that's really the case, sorry. You've been working hard it is preferable that a branching scenario is created so that such an interaction is reproduced.
[0261] Also, a branching scenario according to the detection result by the odor sensor may be created. For example, User: I made a delicious meal~ Character: "Hmmm, let me smell. Mmm. It smells good!" or "Huh!? Isn't it too salty? Be careful with your body!" Dialogue like this may be reproduced.
[0262] Also, as another example, when an odor is detected by an odor sensor, Character: "Mmm, what's this smell?" User: "I burned some aromatherapy." Character: "Ah, that's why I thought it would be relaxing." Dialogue like this may be reproduced. Note that if the response content of the viewer to the question about the type of odor is not registered in the branching scenario, for example, a voice such as "Oh, I see!" may be uniformly output as the character voice.
[0263] (12) Also, the overall control unit 73 may, for example, constantly record the voice for a recent predetermined time (for example, about 15 seconds), and when a voice of a trigger word for enabling voice recognition is detected, enable the voice recognition. For example, the voice recognition application of the display device 1 may be constantly (or in response to a pressing operation of the operation unit 41, etc.) enabled, and the voice recognition by the voice recognition server may be enabled by the detection of the trigger word. And at this time, the overall control unit 73 (specifically, the communication control circuit 706) may transmit the voice data of the voice obtained by removing the voice of the trigger word from the detected voice (for example, the voice detected between the detection start time point and the detection end time point) detected by the microphone 61 (an example of the voice detection means) to the voice recognition server. For example, assume that a user voice such as "I'm going to Tokyo tomorrow, but can you tell me the weather, Raytan?" is detected. Here, "Raytan", which is the pet name of the 3D character 1100, is the trigger word. In this case, the overall control unit 73 transmits the voice "I'm going to Tokyo tomorrow, but can you tell me the weather, Raytan?" obtained by removing the voice of the trigger word "Raytan" from the detected voice "I'm going to Tokyo tomorrow, but can you tell me the weather, Raytan?" to the voice recognition server.
[0264] Here, for example, if the detected voice "I'm going to Tokyo tomorrow, but tell me the weather, Raytan" is sent to the voice recognition server as it is, due to the inclusion of "Raytan" in the voice recognition result, the character voice corresponding to the voice recognition result may not be accurately extracted in the dialogue server, and there is a risk that the dialogue with the user will not match. On the other hand, if it is done as described above, even when the trigger word is uttered in the middle of a sentence, the voice data of the voice excluding the trigger word is sent to the voice recognition server. Therefore, it is possible to suppress the situation where the dialogue with the user does not match due to voice recognition being performed with the trigger word included in the middle of a sentence.
[0265] (13) Also, when reproducing the dialogue between the user and the character displayed on the image display unit 20 through cooperation with the voice recognition server, the following operations may be executed according to the configuration of the voice recognition server.
[0266] For example, when the voice recognition server is configured to start the voice recognition process after receiving the voice data file, the overall control unit 73 may individually send the voice data files of the voices before and after the trigger word among the detected voices by the microphone 61 to the voice recognition server. For example, among the detected voices from the detection start time to the detection end time, the voice data file of the user voice detected before the voice of the trigger word (also referred to as the first half of the user voice) may be sent to the voice recognition server ahead of the voice data file of the user voice detected after the voice of the trigger word (also referred to as the second half of the user voice).
[0267] In this way, in the speech recognition server, the speech recognition process for the first half of the user speech starts without waiting for the reception completion of the speech data file of the second half of the user speech. Therefore, compared with the case of transmitting the speech data file of the speech combining the first half of the user speech and the second half of the user speech to the speech recognition server, the speech recognition process can be efficiently performed. As a result, the display device 1 can receive the character speech from the dialogue server earlier, and the waiting time of the user until a response is made to the user's speech can be shortened.
[0268] Also, for example, when the speech recognition server is configured to perform the speech recognition process in real time by streaming and playing back the speech data from the display device 1, when the first half of the speech data is transmitted to the speech recognition server in real time, it is preferable to control the playback speed T1 of the first half of the user speech to be faster than the standard playback speed T0 (T1>T0). For example, the overall control unit 73 changes the setting so that the first half of the user speech is played back 25% faster than the standard playback speed T0 in the speech recognition server and transmits the first half of the speech data. In this way, in the speech recognition server, compared with the case where the first half of the user speech is played back at the standard playback speed T0, the speech recognition process for the first half of the user speech can be terminated earlier, and the speech recognition process for the second half of the user speech can be started earlier. As a result, the display device 1 can receive the character speech from the dialogue server earlier, and the waiting time of the user until a response is made to the user's speech can be shortened.
[0269] Furthermore, when the voice data of the latter half of the user voice is transmitted to the voice recognition server in real time, it is preferably controlled such that the playback speed T2 of the voice in the latter half is faster than the standard playback speed T0 and slower than the playback speed T1 of the user voice in the first half (that is, the relationship of T0 < T2 < T1 is satisfied). For example, the overall control unit 73 changes the setting so that the user voice in the latter half is played back 10% faster than the standard playback speed T0 in the voice recognition server and transmits the voice data of the latter half. In this way, both the user voice in the first half and the user voice in the latter half are streamed and played back faster than the standard playback speed T0, and voice recognition processing is executed in the voice recognition server. As a result, the waiting time of the user until a response is made to the user's voice can be further shortened. On the other hand, the user voice in the latter half is played back at a speed that is faster than the standard playback speed T0 but slower than the playback speed T1 of the user voice in the first half. Therefore, a decrease in voice recognition accuracy in the voice recognition system can be suppressed. Therefore, it is possible to further shorten the waiting time of the user while suppressing a decrease in voice recognition accuracy.
[0270] In addition, in the voice recognition server, when voice recognition processing by streaming playback of voice data is executed in real time, for example, although the user voice detected by the microphone 61 is transmitted to the voice recognition server in real time, it is preferably controlled such that voice recognition in the voice recognition server is not started until the voice of the trigger word is detected.
[0271] [Other extension examples, etc.] The above-described embodiments and each modification are illustrative, and it goes without saying that partial substitution or combination of the configurations shown in the above embodiments and each modification is possible, and each component described in the above embodiments and each modification may be arbitrarily combined. For example, the control unit 70 may execute any one of the processes in the above-described embodiments and each modification and other processes in parallel (for example, by multitasking or the like).
[0272] Also, the invention described in the means for solving the problems and each component may be further applied to the combinations of the components in the above-described embodiments and each modification example. For the same operational effects due to the similar configurations of the plurality of embodiments and the plurality of modification examples, they will not be sequentially mentioned for each embodiment and modification example. Furthermore, the present invention is not limited to the above-described embodiments. For example, it will be obvious to those skilled in the art that various changes, improvements, combinations, etc. are possible.
Explanation of Reference Numerals
[0273] 1 Display device 5 Opening 10 Housing 11 Main body portion of the housing 12 Upper surface cover portion 20 Image display portion 30 Light reduction member 40 Operation portion 61 Microphone 62 Speaker 63 Gesture sensor 64 Human presence sensor
Claims
1. A display device for displaying an image, comprising: a housing provided with an opening for viewing the image on the first direction side in a light-shielded internal space; an image display unit disposed in the internal space; a light attenuation member disposed on the first direction side of the image display unit with a space therebetween; The display device comprising the above components.
2. The light attenuation member is disposed between the opening and the image display unit. The display device according to Claim 1.
3. The surface of the light attenuation member on the first direction side is inclined with respect to the display surface of the image display unit. The display device according to Claim 2.
4. The image display unit displays, as an image recognized as a three-dimensional image, a first image at least a part of which is recognized to exist on the opening side rather than the light attenuation member. The display device according to Claim 3.
5. The image display unit selectively displays any one of a plurality of images including the first image and a second image recognized to exist on the first direction side or the second direction side opposite to the first direction side with respect to the first image, as an image recognized as a three-dimensional image. The display device according to Claim 4.
6. The housing further has an audio output unit, The audio output unit is provided at a position on the first surface of the housing facing the internal space, on the first direction side of the light attenuation member and at a distance from the light attenuation member smaller than the distance from the opening. The display device according to any one of Claims 2 to 5.
7. The upper end of the opening is provided further above the upper end of the display surface of the image display unit, The upper surface of the internal space is inclined downward from the upper end of the opening toward the upper end of the display surface. The display device according to any one of Claims 1 to 6.
8. The image display unit has a light source and a display body that modulates light from the light source to display an image. The display device according to any one of Claims 1 to 7.
9. The upper end of the opening protrudes on the first direction side with respect to the lower end of the opening. The display device according to any one of Claims 1 to 7.
10. The housing has a cover portion on the upper surface of the housing and has an accommodation space between the cover portion and the upper surface of the inner peripheral surface of the housing, The control unit related to the display device is disposed in the accommodation space. The display device according to any one of Claims 1 to 9.
11. It includes a power supply unit provided below the internal space of the housing, The connection cord electrically connecting the power supply unit and the control unit is wired to pass through a gap region secured between the outer peripheral wall of the housing and the internal space. The display device according to claim 10.
12. The cover portion is attached to the main body portion of the housing at a plurality of attachment positions, and Between the cover portion and the main body portion, At a first attachment position on the first direction side among the plurality of attachment positions, it is coupled using a first fixture at a position inside the outer peripheral wall of the housing. At a second attachment position on the second direction side opposite to the first direction from the first attachment position of the display device, it is coupled using a second fixture from the outside of the outer peripheral wall of the housing. The display device according to claim 10 or claim 11.
13. It further includes an operation unit provided in the lower portion of the housing on the first direction side of the opening portion. The display device according to any one of claims 1 to 12.
14. A plurality of the dimming members are detachably provided. The display device according to any one of claims 1 to 13.
15. A specific character is displayed on the image display portion, Motion detection means capable of detecting the motion of the viewer, and Motion control means for controlling the motion of the specific character according to the detection result by the motion detection means, It further includes. The display device according to any one of claims 1 to 14.
16. The motion detection means is a behavior detection sensor capable of detecting the behavior of an object, The behavior detection sensor is arranged to detect a gesture performed in the internal space of the housing. The display device according to claim 15.
17. The behavior detection sensor is arranged on the upper surface of the inner peripheral surface of the housing. The display device according to claim 16.
18. The behavior detection sensor emits light and receives the reflected light to detect the gesture, A member provided in the light emission direction of the light to suppress the emitted light from being received by the behavior detection sensor, It further includes. The display device according to claim 16 or claim 17.
19. An odor sensor for detecting an odor, An operation control means for executing at least one of a display output operation of displaying, on the image display unit, an image in which a character makes a movement according to a detection result by the odor sensor, and an audio output operation of outputting, as a voice emitted by the character displayed on the image display unit, an audio according to the detection result by the odor sensor; further comprising The display device according to any one of claims 1 to 14.
20. The display output operation is an operation of displaying, on the image display unit, an image in which a character makes a movement according to the type of detected odor; The audio output operation is an operation of outputting, as a voice emitted by the character, an audio according to the type of detected odor The display device according to claim 19.
21. Audio detection means capable of detecting audio; Detection means capable of detecting the presence of a person in a detection target area; further comprising When the presence of a person in the detection target area is detected, the audio detection means activates audio recognition for conducting a conversation with the character displayed on the image display unit The display device according to any one of claims 1 to 20.
22. Wind detection means for detecting wind; An operation control means for executing at least one of a display output operation of displaying, on the image display unit, an image in which a character makes a movement according to a detection result by the wind detection means, and an audio output operation of outputting, as a voice emitted by the character displayed on the image display unit, an audio according to the detection result by the wind detection sensor; further comprising The display device according to any one of claims 1 to 14.
23. Based on the detection result by the wind detection means, the operation control means performs the display output operation or the audio output operation according to the breath blown by the user The display device according to claim 22.
Citation Information
Patent Citations
Picture embossing display device
JP1998062717A
Display
JP2000219060A
Stereoscopic two-dimensional image display device and its method
JP2005141102A
Image display device
JP2010277019A
Display device, etc.
JP7475027B2