Indicating device, etc.

The display device design addresses the issue of reduced visibility by using a light-shielded internal space and a light attenuation member to manage light entry and direction, resulting in enhanced image clarity and viewer engagement.

JP7689765B2Active Publication Date: 2025-06-09YUPITERU CORP
View PDF 10 Cites 0 Cited by

Patent Information

Application Number
JP2024004254
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-01-23
Filing Date
2024-01-16
Publication Date
2025-06-09
Estimated Expiration
2040-03-31

AI Technical Summary

Technical Problem

Display devices struggle with maintaining high visibility of images due to the combination of image light from the display unit and external light, which can reduce the clarity and effectiveness of the displayed content.

Method used

The implementation of a display device design that includes a housing with a light-shielded internal space, an image display unit, and a light attenuation member positioned between the image display unit and the viewer. This configuration suppresses external light entry and directs image light away from the viewer's direct line of sight, enhancing image visibility.

Benefits of technology

This design effectively improves image visibility by reducing the impact of external light and minimizing direct image light exposure to the viewer, resulting in a clearer and more engaging display experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007689765000001
    Figure 0007689765000001
  • Figure 0007689765000002
    Figure 0007689765000002
  • Figure 0007689765000003
    Figure 0007689765000003
Patent Text Reader

Abstract

To provide a display device and the like that can obtain high visibility about a display image.SOLUTION: A display device 1 includes a housing 10, an image display unit 20, and a light reducing member 30. The housing 10 includes an opening 5 through which an image is viewed in a first direction side in an internal space 100 where light is blocked. The image display unit 20 is disposed in the internal space 100. The light reducing member 30 is disposed apart from the image display unit 20 on the first direction side relative to the image display unit 20.SELECTED DRAWING: Figure 6
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] For example, it relates to a display device capable of displaying an image, etc.

Background Art

[0002] There are display devices having an image display unit and displaying a two-dimensional image or a three-dimensional image on the image display unit. For example, Patent Document 1 shows a display device that displays a three-dimensional image on an image display unit.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, the inventors of the present application have obtained the knowledge that in a display device as described in Patent Document 1 or the like, depending on the configuration of the display device, for example, the image light from the image display unit and the external light may combine to reduce the visibility of the displayed image.

[0005] One object of the present invention is to provide a display device or the like capable of obtaining high visibility with respect to a displayed image.

[0006] The object of the present invention is not limited to this, and the applicant also has the intention of obtaining rights through divisional applications, amendments, etc. for configurations aimed at obtaining the effects achieved by the components disclosed in this specification, drawings, etc. For example, the problem of reading the part described as "can be" in this specification as "is a problem" is disclosed in this specification. The problems are described as independent ones, and the applicant also has the intention of obtaining rights through divisional applications, amendments, etc. alone for the configurations for solving each problem. Even if the problem is implicitly understood from the description in the specification, the applicant has the intention of making part of the configuration described in this specification the scope of claims by amendment or divisional application. In addition, the configurations for solving the problems obtained by combining these independent problems are also disclosed, and the applicant has the intention of obtaining rights.

Means for Solving the Problems

[0007] The object of the present invention can be achieved, for example, in the following forms (1) to (23).

[0008] (1) A display device for displaying an image, comprising a housing provided with an opening for viewing the image on the first direction side in a light-shielded internal space, an image display unit disposed in the internal space, and a light attenuation member disposed on the first direction side of the image display unit with a space therebetween.

[0009] In this way, it is possible to suppress the entry of external light into the internal space of the housing, and it is also possible to suppress the direct arrival of the image light from the image display unit to the eyes of the viewer. Therefore, it is possible to suppress the difficulty of visually recognizing the image recognized in the internal space of the housing due to the combination of the image light from the image display unit and the external light, and it is possible to provide a display device capable of obtaining high visibility with respect to the displayed image.

[0010] (2) The light attenuation member may be disposed between the opening and the image display unit.

[0011] By doing so, a space region is formed inside the housing on the side where the image is viewed rather than the light-shielding member, so that the space region can be used for a predetermined purpose.

[0012] (3) The surface of the light-shielding member on the first direction side may be inclined with respect to the display surface of the image display unit.

[0013] By doing so, when a viewer views the image display unit through the light-shielding member, it is possible to reduce the reflection of the viewer's face on the light-shielding member.

[0014] (4) The image display unit may display, as an image recognized as a three-dimensional image, a first image at least a part of which is recognized to exist on the opening side rather than the light-shielding member.

[0015] By doing so, the viewer can obtain a feeling as if touching an image that can be recognized as a three-dimensional image.

[0016] (5) The image display unit may selectively display any one of a plurality of images including the first image and a second image recognized to exist on the first direction side or the second direction side opposite to the first direction side rather than the first image, as an image recognized as a three-dimensional image.

[0017] By doing so, since any one of a plurality of images including the first image and the second image, the positions of which are recognized to be different and are recognized as images that are recognized as three-dimensional images by the viewer, can be selectively displayed, the three-dimensional feeling given to the viewer can be changed.

[0018] (6) The housing further has an audio output unit provided on the housing, and the audio output unit may be provided at a position on a first surface facing the internal space of the housing, on the first direction side rather than the light-shielding member and at a distance from the light-shielding member smaller than the distance from the opening.

[0019] In this way, since the sound output by the sound output unit may be reflected by the light-shielding member and transmitted to the viewer, the viewer can be made to feel as if the sound is coming from the image itself displayed on the image display unit, for example. Further, since the sound output unit is arranged at a position that is difficult to see from the viewer, the design property of the display device can also be enhanced.

[0020] (7) The upper end portion of the opening may be provided further above the upper end portion of the display surface of the image display unit, and the upper surface of the internal space may be inclined downward as it goes from the upper end portion of the opening to the upper end portion of the display surface.

[0021] In this way, since the image displayed on the image display unit can be visually recognized while looking down, it is possible to make it easier for the viewer to visually recognize the image in a natural posture.

[0022] (8) The image display unit may include a light source and a display body that modulates light from the light source to display an image.

[0023] In an image display unit that modulates light from a light source to display an image, if light from the light source leaks out and the position of the light source is recognized by the viewer, there is a risk that the floating feeling as if an image is floating in the internal space will be impaired. Due to the presence of the light-shielding member, it becomes difficult to visually recognize the light leaked from the light source, so a higher floating feeling of the image can be given.

[0024] (9) The upper end portion of the opening may protrude toward the first direction side more than the lower end portion of the opening.

[0025] In this way, it is possible to suppress the reduction in the visibility of the image in the image display unit due to the light from above the display device being reflected by the light-shielding member.

[0026] (10) The housing has a cover portion on the upper surface of the housing, and has an accommodation space between the cover portion and the upper surface of the inner peripheral surface of the housing. The control unit related to the display device may be arranged in the accommodation space.

[0027] In this way, the maintenance of the control unit related to the display device can be performed by removing the cover portion provided on the upper surface of the housing. Therefore, the maintainability of the display device can be improved.

[0028] (11) It is provided with a power supply unit provided below the internal space of the housing, and the connection cord for electrically connecting the power supply unit and the control unit may be wired so as to pass through a gap region secured between the outer peripheral wall of the housing and the internal space.

[0029] In this way, the power supply unit is arranged at a position where it is not easily noticeable, and the center of gravity position of the display device can be lowered, making it easier to stabilize its posture. Also, the connection cord connecting the power supply unit and the control unit can be wired so as not to be visible to the viewer.

[0030] (12) The cover portion is attached to the main body portion of the housing at a plurality of attachment positions, and the cover portion and the main body portion are coupled using a first fixture at a first attachment position on the first direction side among the plurality of attachment positions at a position inside the outer peripheral wall of the housing, and at a second attachment position on the second direction side opposite to the first direction from the first attachment position of the display device, they may be coupled using a second fixture from the outside of the outer peripheral wall of the housing.

[0031] In this way, at the second attachment position where it is difficult for the viewer to touch, the cover portion and the main body portion are coupled from the outside of the outer peripheral wall of the housing using the second fixture that can be detached from the outside, and at the first attachment position where it is easy for the viewer to touch, the cover portion and the main body portion are coupled using the first fixture at a place where it is difficult for the viewer to see, so the designability of the display device can be enhanced.

[0032] It is preferable that the display device further includes an operation unit provided in a lower portion of the housing on the first direction side of the opening in the housing.

[0033] In this way, when the viewer operates the operation unit, for example, the viewer's hand does not overlap the displayed image on the image display unit, and the viewer can operate the operation unit while viewing the displayed image on the image display unit. Therefore, it becomes easier for the viewer to operate the operation unit, and the operability of the display device can be improved.

[0034] It is preferable that a plurality of the dimming members are detachably provided.

[0035] In this way, the brightness of the image displayed on the image display unit can be adjusted without providing a separate adjustment member.

[0036] It is preferable that the display device further includes motion detection means capable of detecting the viewer's motion and motion control means for controlling the motion of the specific character according to the detection result by the motion detection means, where a specific character is displayed on the image display unit.

[0037] In this way, when the viewer's motion is detected, a specific character moves according to the detection result, so that communication between the viewer and the specific character can be reproduced.

[0038] The motion detection means is a behavior detection sensor capable of detecting the behavior of an object, and it is preferable that the behavior detection sensor is arranged to detect a gesture performed in the internal space of the housing.

[0039] In this way, the behavior detection sensor can detect, for example, the viewer's gesture in the internal space of the housing. Therefore, a decrease in the sensitivity of the behavior detection sensor can be suppressed as compared with the case where the behavior detection sensor is arranged on the outer peripheral surface of the housing.

[0040] (17) The behavior detection sensor may be disposed on the upper surface among the inner peripheral surfaces of the housing.

[0041] In this way, since the behavior detection sensor is provided on the surface of the inner peripheral surface of the housing where it is more difficult for light from the outside to enter, it is possible to suppress a decrease in the sensitivity of the behavior detection sensor.

[0042] (18) The behavior detection sensor emits light, receives the reflected light thereof to detect the gesture, and is provided with a member that suppresses the emitted light from being received by the behavior detection sensor in the light emission direction. It is preferable that the display device further includes such a member.

[0043] In this way, it becomes difficult to receive the reflected light from the part of the housing existing in the light emission direction of the light of the behavior detection sensor, so that a decrease in the sensitivity of the behavior detection sensor can be further suppressed.

[0044] (19) An odor sensor that detects an odor, a display output operation that displays, on the image display unit, an image in which a character performs a movement according to the detection result of the odor sensor, and a voice output operation that outputs, as a voice uttered by the character displayed on the image display unit, a voice according to the detection result of the odor sensor. It is preferable that the operation control means for executing at least one of them is further provided.

[0045] In this way, it is possible to reproduce communication regarding odor between the character displayed on the image display unit of the display device and the user. For example, when an odor is detected by the odor sensor, it can be controlled so that a voice output operation in which the character utters a voice such as "Something smells" or a display output operation of an image in which the character performs an action of smelling the odor is performed. Therefore, more diverse communication can be achieved between the character and the user.

[0046] (20) The said display output operation is an operation of displaying, on the said image display unit, a video in which the character makes movements according to the detected type of smell, and the said voice output operation may be an operation of outputting, as the voice emitted by the character, a voice according to the detected type of smell.

[0047] In this way, communication regarding the type of smell between the character displayed on the image display unit and the user can be reproduced. For example, when the smell of tobacco is detected, a display output operation of displaying a video in which the character makes movements of being addicted to smoking or a voice output operation of outputting a voice of words expressing concern for the user's health can be executed. Also, when the smell of a fragrance such as an essential oil is detected, a voice output operation of issuing a question regarding the fragrance can be executed. By performing such control, the range of communication between the character displayed on the image display unit and the user can be widened, and the user's attachment to the said character can be increased.

[0048] (21) It further includes voice detection means capable of detecting voice and detection means capable of detecting the presence of a person in the detection target area. When the presence of a person in the said detection target area is detected, the said voice detection means may activate voice recognition for conducting a conversation with the character displayed on the said image display unit.

[0049] In this way, when communicating with the character displayed on the image display unit and the user, for example, the user does not need to utter a trigger word for activating voice recognition, and communication can be conducted more naturally.

[0050] (22) It further preferably includes wind detection means for detecting wind, operation control means for executing at least one of a display output operation of displaying, on the image display unit, a video in which the character makes movements according to the detection result of the said wind detection means and a voice output operation of outputting, as the voice emitted by the character displayed on the image display unit, a voice according to the detection result of the said wind detection sensor.

[0051] In this way, it is possible to reproduce the communication regarding the wind given to the display device between the character displayed on the image display unit and the user. The wind may be, for example, artificially caused by the user, and may be, for example, the wind generated by moving a body part such as waving a hand toward the display device or the wind generated by blowing breath.

[0052] (23) The operation control means may perform the display output operation or the voice output operation according to the breath blown by the user based on the detection result by the wind detection means.

[0053] In this way, it is possible to reproduce the communication corresponding to the breath blown to the display device between the character displayed on the image display unit and the user.

Advantages of the Invention

[0054] According to the present invention, it is possible to provide a display device or the like that can obtain high visibility with respect to the display image.

[0055] Note that the effects of the invention of the present application are not limited to this, and the effects exerted by the parts of the configuration disclosed in this specification and the drawings and the like are also disclosed, and the applicant also has the intention of obtaining rights for the configurations exerting such effects by means of divisional applications, amendments, etc. For example, the parts described as "can" or "is possible" in this specification are descriptions that clearly indicate the effects exerted, and even if there is no description such as "can" or "is possible", there are parts that indicate the effects. Further, even if there is no such description, there are effects grasped by the said configuration.

Brief Description of the Drawings

[0056]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Figure 22

Figure 23

Figure 24

Figure 25

Figure 26

Figure 27

Figure 28

Figure 29

Figure 30

Figure 31

Figure 32

Figure 33

Figure 34

Figure 35

Figure 36

Embodiments for Carrying Out the Invention

[0057] [Schematic Configuration of the Display Device] FIG. 1 is a perspective view showing a display device 1 according to an example of the present invention. FIG. 2(A) is a front view showing the display device 1 according to an example of the present invention, and FIG. 2(B) is a rear view showing the display device 1 according to an example of the present invention. FIG. 3(A) is a right side view showing the display device 1 according to an example of the present invention, and FIG. 3(B) is a left side view showing the display device 1 according to an example of the present invention. FIG. 4(A) is a plan view showing the display device 1 according to an example of the present invention, and FIG. 4(B) is a bottom view showing the display device 1 according to an example of the present invention. FIG. 5 is an exploded perspective view showing the display device 1 according to an example of the present invention. FIG. 6 is a cross-sectional view taken along the line A-A in FIG. 2(A). Hereinafter, with reference to FIGS. 1 to 6, the schematic configuration of the display device 1 according to an example of the present invention will be described.

[0058] In each figure and the like, the left-right direction of the display device 1 is defined as the X direction, and the direction from the left side to the right side of the display device 1 is defined as the +X direction (the positive direction of the X direction). Also, the front-rear direction (depth direction) of the display device 1 is defined as the Y direction, and the direction from the front side (front side) to the rear side (rear side) of the display device 1 is defined as the +Y direction (the positive direction of the Y direction). Further, the up-down direction of the display device 1 is defined as the Z direction, and the direction from the lower surface side to the upper surface side of the display device 1 is defined as the +Z direction (the positive direction of the Z direction).

[0059] The display device 1 is used for various applications. For example, the display device 1 may be for commercial use (e.g., for attracting customers, for advertising), for entertainment (for entertaining people), or for toys, etc. For example, in the case of commercial or entertainment use, the display device 1 may be installed in public places such as stores or other commercial facilities. The display device 1 is used to attract customers by displaying an image in which a specific character introduces or advertises a product or service, etc. at a venue such as an exhibition of products or services, and to entertain visitors. Alternatively, the display device 1 may be installed in various amusement facilities, etc., and used to entertain visitors to the amusement facilities. In the case of a toy, the display device 1 is installed in the user's home, etc. Also, when a three-dimensional image is displayed on the display device 1 as described later, it may be used to entertain the viewer by allowing the viewer to experience the stereoscopic view of the display object. The viewer is, for example, the user who uses the display device 1.

[0060] As shown in FIG. 5, the display device 1 includes a housing 10, an image display unit 20 capable of displaying an image of a display object, and a light reduction member 30.

[0061] The housing 10 is a box-shaped member that forms the outer shape of the display device 1. The housing 10 has a ratio of the lengths (maximum lengths) in the width direction (also referred to as the left-right direction), the height direction (also referred to as the up-down direction), and the depth direction (also referred to as the front-back direction) of approximately 1:1:1. However, this ratio of lengths is an example, and at least a part thereof may be different. The corners of the housing 10 are R-shaped. For example, when the display device 1 is viewed from the front side, the four corners of the housing 10 are each rounded. The housing 10 may be sized to accommodate an image display unit 20 of a predetermined size (e.g., 17-inch size) inside it.

[0062] The housing 10 has an opening 5 on the front side of the display device 1 (the -Y side in each figure). The front side of the display device 1 corresponds to the side where the viewer can see the image displayed by the display device 1. The opening 5 is formed on the front side of the display device 1 in the internal space of the housing 10. For example, as shown in FIG. 2(A), the opening 5 is formed in a rectangular shape when viewed from the front side of the display device 1. The housing 10 has an internal space 100. The internal space 100 is the space inside the housing 10 where the image is displayed. The portion of the internal space 100 other than the opening 5 is surrounded by a light-shielding member (see FIG. 6). External light does not enter the internal space 100 through the members constituting the housing 10. Therefore, the housing 10 may be formed entirely of a material that blocks external light, or the outer surface and the surface facing the internal space 100 may be covered with a material that blocks light. In FIG. 6, the internal space 100 is indicated by a dashed line, and the two space regions 101 and 102 obtained by dividing the internal space 100 by the light-reducing member 30 are indicated by a two-dot chain line. The space region 101 is the space on the back side of the light-reducing member 30. The space region 101 has a larger dimension in the height direction toward the back side, and the dimension becomes smaller as it moves toward the front side. The space region 102 is the space on the front side of the light-reducing member 30. The space region 102 has a smaller dimension in the height direction toward the back side, and the dimension becomes larger as it moves toward the front side. In this embodiment, the opening 5 is specified by a planar region that allows the space region 101 to communicate with the external space. Therefore, the opening 5 may be read as an opening surface. The internal space 100 has a certain region in the depth direction (front-rear direction) of the housing 10. As shown in the YZ cross-section of FIG. 6, the housing 10 has a longer length in the depth direction at the upper end than at the lower end. The internal space 100 may be recognized by the viewer, for example, as the living space of a character that is stereoscopically displayed.

[0063] For example, the housing 10 is formed of a resin member or the like, and a dark-colored (e.g., black) rubber coating is applied to its surface (e.g., at least one of the outer peripheral surface and the inner peripheral surface). Thereby, light is configured not to enter the internal space 100 of the housing 10 from portions other than the opening 5. Note that it is not essential for the internal space 100 to be surrounded by a light-shielding member in all portions other than the opening 5, and it is sufficient if the internal space 100 is surrounded by a light-shielding member so as to be somewhat dark. The housing 10 may be formed of a material other than a resin material, such as metal or other materials. Also, the color of the outer surface of the housing 10 is not limited, and it may be, for example, white or black that gives a sense of luxury or simplicity. The surface of the housing 10 may be processed to produce a texture by matte finishing.

[0064] Also, as shown in FIG. 5, the housing 10 includes a main body portion 11, an upper surface cover portion 12, an arrangement portion 13 for the light attenuation member 30, a bottom surface cover portion 14, and a rear surface cover portion 15. Note that each of the members 12 to 15 is attached to the main body portion 11 by a fixture such as a screw, except for a part of the upper surface cover portion 12 (described later).

[0065] Next, the image display unit 20 will be described. The image display unit 20 is a display unit having a light source. Examples of the image display unit 20 include a liquid crystal display. In this case, the image display unit 20 includes a backlight, which is an example of a light source, and a display body 28 (see FIG. 5) in which liquid crystal elements, which are examples of display elements, are two-dimensionally arranged. The light source is, for example, a white light source. The liquid crystal element modulates the light from the backlight in pixel units. The liquid crystal element has a configuration in which, for example, liquid crystal molecules are sandwiched between a pixel electrode provided in pixel units and a common electrode common to a plurality of pixels. The image display unit 20 displays a color (multi-color) image based on the three primary colors of red (R), green (G), and blue (B). The image display unit 20 displays an image so as to be recognized as a three-dimensional image in this embodiment. The image display unit 20 is a 17-inch liquid crystal display in this embodiment.

[0066] The image display unit 20 is preferably configured to be able to display a three-dimensional image of the object to be displayed, and may be a display capable of stereoscopic display with the naked eye. Further, it is even better if the image display unit 20 is configured to be able to switch between a three-dimensional image and a two-dimensional image. For the image display unit 20, for example, an image of an object to be displayed such as a specific character (for example, a person or an animal, etc.) may be displayed. For example, it is preferable that the humanoid character 1000 is display-controlled in the image display unit 20 so as to be stereoscopically viewed by the viewer as shown in FIG. 13. The character 1000 is a character imitating a historical figure here, but it may also be a female character, an animal (for example, a cat) character, or other characters. It is not limited to this, and various images can be displayed on the image display unit 20. Also, hereinafter, the character that is stereoscopically displayed (an example of the object to be displayed) is also referred to as a "3D character". The 3D character is an example of a 3D object.

[0067] Thus, the display device 1 is preferably a device capable of reproducing stereoscopic display with the naked eye. Such a display device 1 is also referred to as, for example, a "naked-eye stereoscopic display device".

[0068] The stereoscopic display with the naked eye is preferably reproduced, for example, by using the lenticular lens type image display unit 20. For example, on the display surface 29 of the image display unit 20, a lenticular lens in which a plurality of semi-cylindrical lenses are arranged is provided, and the image display unit 20 displays an image sequence group (also referred to as a lenticular image, etc.) composed of a combination of a plurality of image sequences that have been interlaced processed with respect to the three-dimensional image. When the viewer views the image sequence group through the lenticular lens from an appropriate position, the three-dimensional image appears three-dimensional due to the optical illusion caused by the binocular parallax.

[0069] As shown in FIG. 6 and the like, the image display unit 20 is disposed in the internal space 100 of the housing 10 so that an image can be visually recognized through the opening 5 provided on the front side of the display device 1. For example, the image display unit 20 is disposed along the back surface (inner wall surface) of the inner peripheral surface of the housing 10. In the present embodiment, as shown in FIG. 6, the back surface of the inner peripheral surface of the housing 10 is provided substantially perpendicular to the bottom surface of the housing 10, and the image display unit 20 is also provided substantially perpendicular to the bottom surface of the housing 10.

[0070] Next, the light attenuation member 30 will be described. The light attenuation member 30 is an optical member that reduces external light entering the internal space 100 through the opening 5. The light attenuation member 30 is a plate-like (including panel-like) or film-like member. Further, the light attenuation member 30 can reduce the amount of light from the image display unit 20 (for example, light from the backlight of the image display unit 20). The light attenuation member 30 is provided to maintain the internal space 100 in a dark state. The reason will be described later. Further, the light attenuation member 30 also contributes to suppressing the occurrence of reflection in which the viewer himself / herself looking at the image through the opening 5 is reflected on the light attenuation member 30 and making it difficult to visually recognize the components inside the internal space 100. The light attenuation member 30 may be a member called a smoke panel, a smoke film, or the like. Since the light attenuation member 30 transmits at least the image light from the image display unit 20 to the front side, it can be optically regarded as a transparent member. Examples of the light attenuation member 30 include a dark-colored panel member having a predetermined light transmittance (for example, about 6%). Note that the present invention is not limited to this, and the light attenuation member 30 may be, for example, a dark-colored film having a predetermined light transmittance attached to a colorless transparent panel member. The light attenuation member 30 is a member of a dark color system such as black, but may be a blue color or other colors.

[0071] The light attenuation member 30 is disposed in the internal space 100 of the housing 10 at a distance from the image display unit 20 on the front side of the image display unit 20. In the present embodiment, it is disposed between the opening 5 and the image display unit 20 so as to have a space region 101 (FIG. 6) between it and the image display unit 20.

[0072] By having the housing 10 have the light-shielded internal space 100 as described above, it is possible to suppress external light from entering the internal space 100 of the housing 10. Also, for example, on the front side of the image display unit 20, by arranging the light reduction member 30 at a distance from the image display unit 20, it is possible to suppress the image light from the image display unit 20 from directly reaching the eyes of the viewer. Therefore, it is possible to suppress the image recognized in the internal space 100 of the housing 10 from being difficult to visually recognize due to the combination of the image light from the image display unit 20 and external light, and it is possible to provide the display device 1 that can obtain high visibility with respect to the displayed image.

[0073] Further, since the light reduction member 30 is arranged between the opening 5 and the image display unit 20, a space region (for example, the space region 102 (see FIG. 6)) is formed on the front side of the light reduction member 30 inside the housing 10, so that the space region can be used for a predetermined purpose.

[0074] Here, if there is no light reduction member 30 and the viewer directly looks at the image display unit 20 itself on which the three-dimensional image of the object to be displayed is displayed, the light from the light source leaks out and the position of the light source is recognized by the viewer, so that the viewer can recognize that "the object to be displayed is reflected on the image display unit 20". As a result, there may be a situation where a sufficient floating feeling as if the object image to be displayed is floating in the internal space 100 cannot be obtained.

[0075] On the other hand, when the light reduction member 30 is provided as described above, the amount of image light emitted from the peripheral region of the object to be displayed in the image display unit 20 is suppressed by the light reduction member 30, and the peripheral region becomes difficult to see from the viewer. As a result, the viewer does not feel that "the object to be displayed is reflected on the image display unit 20", and a floating feeling of the object to be displayed can be obtained. Therefore, the visibility with respect to the displayed image of the object to be displayed can be enhanced.

[0076] Further, for example, when the viewer directly views the image display unit 20 on which the three-dimensional image of the object to be displayed is displayed, although the object to be displayed appears three-dimensional to the viewer, a blurred image may be visible around the object to be displayed. In such a case, there is a risk that the viewer may find it difficult to view the three-dimensional image of the object to be displayed.

[0077] On the other hand, when the light-shielding member 30 is provided as described above, the amount of light emitted from the image display unit 20 is reduced by the light-shielding member 30, and the image light of the blurred image around the object to be displayed is also reduced by the light-shielding member 30. As a result, it becomes difficult for the viewer to see the blurred image, and it becomes easier to recognize the object to be displayed as a three-dimensional image. Furthermore, since the light-shielding member 30 is provided, it becomes difficult to visually recognize the components existing in the internal space 100, so it is also less likely that the viewer will be distracted by being able to visually recognize such components.

[0078] [Detailed Configuration of Each Element] Next, the detailed configuration of each element 10, 20, 30 will be described.

[0079] The light-shielding member 30 has a front surface that is inclined with respect to the vertical direction. In this embodiment, as shown in FIG. 6, the light-shielding member 30 is inclined at a predetermined angle (for example, an angle of about 50 degrees) with respect to the bottom surface of the housing 10, for example, from its upper end 31 toward the lower end 32, toward the opening 5 side (front side of the display device 1). For example, as shown in FIG. 5, the upper surface of the arrangement portion 13 of the light-shielding member 30 is inclined at a predetermined angle with respect to the bottom surface of the housing 10, and the light-shielding member 30 is arranged on the upper surface of the arrangement portion 13.

[0080] In this way, the optical path of the reflected light of the light incident on the light attenuation member 30 will be in a direction different from the side of the viewer's eyes (or face). Therefore, when the viewer views the image display unit 20 through the light attenuation member 30, it is possible to prevent the viewer's face from being reflected and appearing in the light attenuation member 30. If such an object can be achieved, the inclination angle and inclination direction of the light attenuation member 30 can be variously deformed. Therefore, it is possible to provide a display device 1 with higher visibility.

[0081] Also, inside the housing 10, a space region 102 (see FIG. 6) for inserting the viewer's hand can be provided on the side of the opening 5 rather than the light attenuation member 30.

[0082] And in the image display unit 20, it is preferable that display control is performed such that at least a part of the display object to be stereoscopically viewed by the viewer (for example, a part of the body of a specific character) exists at the arrangement position of the light attenuation member 30. In this way, the viewer can put his hand into the space region 102 on the side of the opening 5 rather than the light attenuation member 30, and can obtain a feeling of being able to touch the display object (for example, a humanoid character 1000 (see FIG. 13), etc., an example of the first image) that appears to float and be three-dimensional in the space region 102. Therefore, for example, it is possible to provide a display device excellent in entertainment.

[0083] Also, by providing the space region 102 as described above, the degree of freedom in the arrangement position of a gesture sensor 63 or the like, which will be described later, can also be increased.

[0084] As shown in FIGS. 2(A) and 6, the housing 10 further has a speaker 62 (an example of a sound output unit). The speaker 62 is provided at a position on the surface facing the internal space 100 of the housing 10, on the front side rather than the light attenuation member 30 and at a distance from the opening 5 smaller than the distance from the light attenuation member 30. In the present embodiment, the speaker 62 is provided on the upper surface 85 of the internal space 100 of the housing 10, on the side of the light attenuation member 30 (the back side of the housing 10) rather than the intermediate position 201 between the upper end portion 21 of the light attenuation member 30 and the upper end portion 51 of the opening 5.

[0085] In this way, since the sound output by the speaker 62 may be reflected by the light-shielding member 30 and transmitted to the viewer, the viewer can be made to feel as if the sound is coming directly from the display object (e.g., a specific character) itself displayed on the image display unit 20, for example. This effect is particularly effective when the display control is such that at least a part of the display object (e.g., a part of the body of a specific character) stereoscopically viewed by the viewer exists at the position where the light-shielding member 30 is disposed. Also, since the speaker 62 is disposed at a position where it is difficult to be seen by the viewer, the design property of the display device 1 can be enhanced.

[0086] Also, as shown in FIG. 6, the upper end portion 51 of the opening 5 is provided above the upper end portion 21 of the image display unit 20 (specifically, the display surface 29), and the upper surface 85 of the internal space 100 of the housing 10 is inclined downward (in the -Z direction in FIG. 6) from the upper end portion 51 of the opening 5 toward the upper end portion 21. In this way, it is possible to view the image displayed on the image display unit 20 while looking down from a position higher than the upper end portion 21 of the image display unit 20. Therefore, it is possible to make it easier for the viewer to view the image in a natural posture. For example, the display device 1 is placed on a desk. There is a viewer standing or sitting on a chair on the front side (frontward side) of the display device 1. It is assumed that the position of the viewer's eyes is higher than the upper surface of the display device 1. Therefore, the viewer views the display device 1 at an angle θ while looking down. The angle θ is the angle between the horizontal direction and the viewer's line of sight direction. The angle θ is assumed to be, for example, 15 degrees, but it may vary depending on the usage situation of the display device 1. Based on the assumption of such an angle θ, it is preferable that the inclination angle of the upper surface 85 is determined so that the viewer can view the entire display surface of the image display unit 20 or the entire display area of the image to be viewed by the viewer. Also, a relatively wide space region 110 for the control unit described later can be secured.

[0087] Also, as shown in FIG. 6, the upper end portion 51 of the opening 5 of the housing 10 is provided so as to protrude toward the front side (an example of the first direction side) more than the lower end portion 52 of the opening 5. This protruding portion is also referred to as an eaves. By doing so, it is possible to suppress the decrease in the visibility of the image in the image display unit 20 due to the light from above the display device 1 being reflected by the light shielding member 30.

[0088] As shown in FIGS. 1 and 6, an inclined portion 84 is provided on the side of the opening 5 (front side) in the lower portion of the housing 10. And the side portion 53 (see FIG. 3) of the opening 5 is provided so as to be inclined at a predetermined angle so as to extend from the upper end portion 51 of the opening 5 toward the vicinity of the upper portion 88 of the inclined portion 84. For example, the side portion 53 of the opening 5 is provided so as to be inclined so as to be substantially perpendicular to the light shielding member 30.

[0089] Also, as shown in FIG. 6, the upper portion 88 of the inclined portion 84 is provided above the lower end portion 22 of the image display unit 20, and the lower surface 86 of the internal space 100 of the housing 10 is provided so as to be inclined downward as it extends from the upper portion 88 of the inclined portion 84 toward the lower end portion 22 of the image display unit 20.

[0090] Here, regarding naked-eye stereoscopic display, the larger the so-called 3D effect (three-dimensional effect) is, the smaller the display object to be stereoscopically viewed by the viewer may become. By inclining the lower surface 86 of the internal space 100 as described above, even when the 3D effect is increased, the lower part of the display object to be stereoscopically displayed (for example, the feet of a specific character) can be displayed near the upper portion 88 of the inclined portion 84.

[0091] Also, as shown in FIG. 1, the display device 1 includes an operation unit 40 that receives operations on the display device 1. For example, in the display device 1, two operation units 40 are provided: an operation unit 41 for performing voice input (also referred to as instructing the start of voice recognition) and an operation unit 42 for changing the display settings regarding the three-dimensional image (for example, the set value regarding the parallax).

[0092] These operation units 40 (41, 42) are provided in the lower part of the housing 10 on the front side (an example of the first direction side) of the opening 5 in the housing 10. Specifically, as shown in FIG. 1, these operation units 40 (41, 42) are arranged on the inclined portion 84 provided on the opening 5 side in the lower part of the housing 10. In this way, when the viewer operates the operation unit 40, for example, the viewer's hand does not overlap the displayed image on the image display unit 20, and the viewer can operate the operation unit 40 while viewing the displayed image on the image display unit 20. Therefore, it becomes easier for the viewer to operate the operation unit 40, so that the operability of the display device 1 can be improved. In addition, since the operation unit 40 is provided on the inclined portion 84, the viewer can easily find the operation unit 40.

[0093] Next, various sensors provided in the display device 1 will be described.

[0094] The display device 1 further includes two motion detection units (an example of motion detection means capable of detecting the motion of a viewer), namely, a microphone 61 and a gesture sensor 63 (see FIG. 6). Note that it is not essential that both of these two members 61 and 63 are provided in the display device 1, and only one of the microphone 61 and the gesture sensor 63 may be provided in the display device 1 as the motion detection means.

[0095] The microphone 61 is configured as voice detection means capable of detecting the voice of a viewer such as a user (for example, a voice input operation). The microphone 61 is arranged, for example, on the above-mentioned inclined portion 84 (see FIG. 1). Note that for the voice input using the microphone 61, voice recognition processing is executed, for example, by a general control unit 73 (described later), and a voice recognition result indicated by, for example, text data or the like is obtained. The voice recognition processing may be executed by a voice recognition device separately provided in the display device 1, or may be executed by an external server or the like different from the display device 1.

[0096] The gesture sensor 63 (an example of an object detection sensor) is configured to be able to detect the behavior of an object. Examples of the gesture sensor 63 include, for example, an infrared sensor. The gesture sensor 63 has a light emitting section and a light receiving section for light (for example, infrared light). The light emitted (also referred to as irradiated) from the emitting section of the gesture sensor 63 hits the object to be detected, is reflected, and is received by the light receiving section. Then, the gesture sensor 63 detects the behavior of the object to be detected based on the light (reflected light) received by the light receiving section. For example, when the same behavior as a specific behavior pre-registered in the gesture sensor 63 is detected, it is determined that the specific behavior has been performed by the viewer.

[0097] For example, the gesture sensor 63 has a function (also referred to as a Wave detection function) that can detect whether or not it is a predetermined behavior according to the movement of the hand. Then, for example, when a viewer makes a waving motion ("bye-bye") or a stroking motion ("petting") within the detection range of the gesture sensor 63, the gesture sensor 63 may detect the Wave motion and determine it as "bye-bye" or "petting".

[0098] The gesture sensor 63 is preferably configured to be able to detect the position of the object to be detected in the approaching / separating direction (for example, the Z direction in FIG. 2(A)) with respect to the gesture sensor 63 and the position of the object to be detected on a plane having the approaching / separating direction as the normal (for example, the XY plane in FIG. 2(A)). For example, the plane is preferably divided into four quadrants with the light receiving section of the gesture sensor 63 as the origin. At this time, the X-axis is preferably set parallel to the left-right side of the front surface of the housing 10.

[0099] As shown in FIG. 2(A), the gesture sensor 63 is installed at a substantially central position on the inner peripheral surface of the housing 10 in the left-right direction (the X direction in FIG. 2(A)).

[0100] Also, as shown in FIG. 6, the gesture sensor 63 (specifically, the detection surface of the gesture sensor 63) is disposed on the inner peripheral surface of the housing 10 and faces inward of the housing 10, and the detection direction of the gesture sensor 63 is directed inward of the housing 10. In this way, for example, in the internal space 100 of the housing 10, in this embodiment, the gesture of the viewer is detected in the space region 102. Therefore, compared with the case where the gesture sensor 63 is disposed on the outer peripheral surface of the housing 10, a decrease in the sensitivity of the gesture sensor 63 can be suppressed.

[0101] Also, when the gesture sensor 63 is disposed on the outer peripheral surface of the housing 10, for example, even if a person simply passes by the periphery of the display device 1, the gesture sensor 63 may detect the behavior of the detection object. On the other hand, when the gesture sensor 63 is disposed on the inner peripheral surface of the housing 10 and faces inward of the housing 10, such false detection can be prevented.

[0102] In particular, as shown in FIG. 6, the gesture sensor 63 is preferably disposed on the upper surface 85 of the inner peripheral surface of the housing 10 and faces the lower surface 86. In this way, the gesture sensor 63 is provided on a surface of the inner peripheral surface of the housing 10 where it is difficult for light from the outside to enter. Therefore, compared with the case where the gesture sensor 63 is provided on a surface other than the upper surface 85, a further decrease in the sensitivity of the gesture sensor 63 can be suppressed.

[0103] Further, the gesture sensor 63 may be disposed at a position on the upper surface 85 of the inner peripheral surface of the housing 10 that faces the boundary position 202 (see FIG. 6) between the upper portion 88 of the inclined portion 84 and the lower end portion 32 of the light shielding member 30. Then, display control may be performed such that the feet of a specific character are three-dimensionally displayed on the surface of the light shielding member 30. In this way, the viewer can obtain a feeling as if they can touch the entire (whole body) of a specific character that appears to float and look three-dimensional on the surface of the light shielding member 30. Note that the above-described display control may be reproduced, for example, by changing the parallax setting value in a 3D application related to three-dimensional display.

[0104] Also, in the inner peripheral surface of the housing 10, in a region where the light emitted from the gesture sensor 63 exists in the emission direction of the light, for example, in the region 202 facing the arrangement position of the gesture sensor 63, a member for suppressing the light emitted from the gesture sensor 63 (for example, infrared light) from being received by the gesture sensor 63 may be provided. In this way, since the amount of light received by the gesture sensor 63 that is reflected in the region 202 or its vicinity is reduced, a further decrease in the sensitivity of the gesture sensor 63 can be suppressed. Examples of the "member for suppressing the light from being received by the gesture sensor 63" include an absorptive member that can absorb the light from the gesture sensor 63, a member that diffusely reflects the light from the gesture sensor 63, and the like. Examples of the "absorptive member" include black paper, a member coated with rubber, or a member formed of an infrared absorption material (such as an infrared reflection prevention sheet).

[0105] In the display device 1, predetermined processing according to the detection results by the above-described motion detection means (for example, the microphone 61 and the gesture sensor 63) may be executed as the motion of a specific character displayed on the image display unit 20. Such control may be executed, for example, by a control unit 70 described later.

[0106] In this way, when the actions of the viewer are detected, specific characters will act according to the detection results, so that the communication between the viewer and the specific characters can be reproduced. The function of reproducing such communication between the viewer and specific characters, or the function of reproducing the pseudo-communication between the viewer and specific characters, is called the "communication function". Therefore, for example, a highly entertaining display device 1 can be provided.

[0107] For example, when the viewer utters "bye-bye", the microphone 61 detects the viewer's voice "bye-bye", and the control unit 70 determines the actions of specific characters based on the voice recognition result "bye-bye". In the display device 1, a specific phrase and the actions corresponding to the specific phrase are associated and pre-registered in a data table or the like. Then, the control unit 70 executes the process corresponding to the determined actions. For example, at least one of the voice output process of outputting the voice of "bye-bye" from the speaker 62 and the display output process of displaying and outputting the video of a specific character waving its hand on the image display unit 20 is executed. In this way, the viewer will feel that the specific character displayed on the image display unit 20 has reacted to the voice uttered by himself / herself. Therefore, for example, a highly entertaining display device 1 can be provided.

[0108] Also, for example, when a viewer puts a hand into the internal space 100 and waves the hand, the gesture sensor 63 detects the viewer's gesture "bye-bye", and the control unit 70 determines the action of a specific character based on the gesture detection result "bye-bye". In the display device 1, a specific action and an action corresponding to the specific action are associated and registered in advance in a data table or the like. Then, the control unit 70 executes a process corresponding to the determined action. For example, similar to the above, at least one of an audio output process of outputting the voice "bye-bye" from the speaker 62 and a display output process of displaying and outputting an image of a specific character waving a hand on the image display unit 20 is executed. In this way, the viewer feels that the specific character displayed on the image display unit 20 reacts to the gesture made by the viewer himself / herself. Therefore, for example, a highly entertaining display device 1 can be provided.

[0109] Further, the display device 1 further includes a human presence sensor 64 (see FIG. 6) that can detect the presence of a person within a predetermined range (also referred to as a detection target space, for example) with respect to the display device 1. Examples of the human presence sensor 64 include a Doppler sensor (for example, a microwave Doppler sensor) that can detect the presence of an object based on the speed of a moving object and the presence or absence of a Doppler signal.

[0110] The human presence sensor 64 is disposed facing the front side of the display device 1 near the upper end portion 51 of the opening 5, and the detection target area of the human presence sensor 64 is provided on the front side of the display device 1. In this way, it is possible to more reliably detect the presence of a person on the front side of the display device 1.

[0111] Specifically, the human presence sensor 64 is disposed at a distance from the outer peripheral wall 80 on the front side of the housing 10 in the front side (front side) of the arrangement area 110 (see FIG. 7) described later so as not to contact it.

[0112] In the display device 1, it is preferable that the display image of the image display unit 20 is controlled to be switched to a three-dimensional image on the condition that the human presence sensor 64 detects that a person has approached within the predetermined range. Note that, at other times, a two-dimensional image may be displayed, or the display image of the image display unit 20 may be made non-displayed. In this way, for example, as long as a person is in a position where the object to be displayed on the image display unit 20 (for example, a specific character) cannot be viewed in stereoscopy, the three-dimensional image is not displayed on the image display unit 20, and when a person approaches within the range where the object to be displayed can be viewed in stereoscopy, the three-dimensional image is displayed on the image display unit 20. Therefore, it is possible to avoid a situation where peripheral people lose interest in the display device 1 due to viewing the object to be displayed from a position where the object to be displayed cannot be viewed in stereoscopy.

[0113] [Configuration Regarding Arrangement Space of Control Unit, etc.] The display device 1 has a control unit 70. For example, the display device 1 includes a plurality of control units 70 including a power control unit 71 that controls the power supply of the display device 1, a display control unit 72 that controls the display image displayed on the image display unit 20, and a general control unit 73 that generalizes these control units 71, 72, etc. (see FIG. 7). Note that FIG. 7 is a perspective view for explaining the display device 1 in a state where the upper cover portion 12 is removed. In the present embodiment, each of the plurality of control units 70 may be mounted on a different substrate, or two or more control units 70 may be mounted on a single substrate. Along with this, the arrangement positions of the respective control units 70 may be appropriately changed.

[0114] As shown in FIG. 5, the housing 10 has an upper cover portion 12. Further, as shown in FIG. 6, the housing 10 has a space region 110 between the upper cover portion 12 and the upper surface 85 of the inner peripheral surface of the housing 10. And the control unit 70 is arranged in the space region 110. In this way, the maintenance of the control unit 70 that controls the display device 1 can be performed by removing the upper cover portion 12 provided on the upper surface of the housing 10. Therefore, the maintainability of the display device 1 can be improved. Note that the space region 110 is also referred to as a housing space that houses the control unit 70 and the like.

[0115] While the control unit 70 is provided on the upper surface portion of the housing 10, the power supply unit 90 of the display device 1 is provided on the lower surface portion 14 of the housing 10 (see FIG. 4(B)).

[0116] And a connection cord 91 (see FIG. 7) that connects the power supply unit 90 and the control unit 70 (specifically, the power supply control unit 71) is wired so as to pass through a gap region 89 secured between the outer peripheral wall 80 of the housing 10 (for example, the left side wall of the housing 10) and the internal space 100. In this way, the power supply unit 90 can be arranged at a less conspicuous position, and the connection cord 91 that connects the power supply unit 90 and the control unit 70 can be wired so as not to be visible to the viewer from the outside and the internal space 100 side (opening 5 side). Therefore, the design property of the display device 1 can be enhanced. Further, since the power supply unit 90 exists below the internal space 100, the power supply unit 90 is arranged at a less conspicuous position and the center of gravity position of the display device 1 can be lowered, making it easier to stabilize its posture.

[0117] In addition, ventilation holes 99 (see FIG. 4(B)) are provided on the bottom surface of the display device 1. The ventilation holes 99 communicate with the space below the internal space. Also, this space is spatially connected to the space region 110 above the internal space 100 via the gap region 89 through which the connection cord 91 is wired. Therefore, even when the space region 110 is blocked by the upper surface cover portion 12, the heat generated in the space region 100 can be released to the outside through the ventilation holes 99. Note that ventilation openings for releasing the heat generated in the space region 110 to the outside may be provided in the upper surface cover portion 12, or heat sinks or other heat absorption or heat dissipation members may be provided in the space region 110 or other locations.

[0118] Further, the upper cover portion 12 is attached to the main body portion 11 of the housing 10 at a plurality of attachment positions (for example, nine attachment positions 211 to 219). For example, the upper cover portion 12 is attached to the main body portion 11 of the housing 10 at two attachment positions 211 and 212 on the front side (front surface side) of the housing 10, at two attachment positions 213 and 214 on the right side of the housing 10, at two attachment positions 215 and 216 on the left side of the housing 10, and at three attachment positions 217 to 219 on the rear side (rear surface side) of the housing 10.

[0119] For example, as shown in FIGS. 7 and 8, at the attachment positions 211 and 212 (an example of the first attachment position) on the front side of the display device 1 among the plurality of attachment positions 211 to 219, the upper cover portion 12 and the main body portion 11 of the housing 10 are coupled using a first fixture at a position inside the outer peripheral wall 80 of the housing 10. Examples of the "first fixture" include a fitting member 95 and a receiving member 96 configured to be detachable from the fitting member 95. FIG. 8 is a view showing the back surface of the upper cover portion 12. For example, the fitting member 95 is formed in a convex shape, and the receiving member 96 is formed to be able to insert the convex fitting member 95.

[0120] On the other hand, at the attachment positions 217 to 219 (an example of the second attachment position) on the back side of the display device 1 among the plurality of attachment positions 211 to 219 (see FIG. 7), the main body portion 11 of the housing 10 and the upper cover portion 12 are coupled using a second fixture at a position outside the outer peripheral wall 80 of the housing 10. Examples of the "second fixture" include a screw 98 (see FIG. 8).

[0121] In this way, at a second attachment position (for example, attachment positions 217 to 219) that is difficult for the viewer to see, the upper surface cover portion 12 and the main body portion 11 are coupled from the outside of the outer peripheral wall 80 of the housing 10 using a second fixture (for example, screw 98). On the other hand, at a first attachment position (for example, attachment positions 211, 212) that is easy for the viewer to see, the upper surface cover portion 12 and the main body portion 11 are coupled at a location that is difficult for the viewer to see using a first fixture (for example, fitting member 95 and receiving member 96). Therefore, the designability of the display device 1 can be enhanced.

[0122] Also, the first fixture (for example, fitting member 95 and receiving member 96) is more easily detachable than the second fixture (for example, screw 98), and by using the first fixture, the maintainability of the display device 1 can be enhanced. Further, at all of the attachment positions 211 to 219, the upper surface cover portion 12 and the main body portion 11 are not coupled using the first fixture, but at some of the plurality of attachment positions 211 to 219, the upper surface cover portion 12 and the main body portion 11 are coupled using the second fixture. Therefore, it is possible to suppress the upper surface cover portion 12 from being removed by a third party while enhancing the maintainability of the display device 1.

[0123] Note that in the display device 1 according to the present embodiment, regarding the attachment positions 213 to 216 on the side of the housing 10 among the plurality of attachment positions 211 to 219, similar to the attachment positions 211 and 212 on the front side, the upper surface cover portion 12 and the main body portion 11 of the housing 10 are coupled using the first fixture. However, it is not limited thereto, and regarding the attachment positions 213 to 216 on the side of the housing 10, similar to the attachment positions 217 to 219 on the back side, the upper surface cover portion 12 and the main body portion 11 of the housing 10 may be coupled using the second fixture.

[0124] [Regarding the detailed configuration of the control unit] FIG. 9 is a control block diagram of a control unit 70 included in a display device 1 according to an embodiment. As described above, the control unit 70 includes a general control unit 73. The general control unit 73 is a controller having a memory including a CPU 701 that functions as an arithmetic processing device that executes arithmetic processing and the like, a RAM 703 used as a work area, and a ROM 702 that stores control programs and the like. Various programs are stored in the ROM 702, and the general control unit 73 reproduces various functions by executing these programs. For example, a voice recognition application (an application having a function of a voice recognition engine) for reproducing an interaction between a user and a character is stored in the ROM 702, and the general control unit 73 executes the voice recognition application based on input signals from various sensors 61, 63, 64, 65, etc. or a GPS receiver 60, etc., thereby reproducing an interaction between the user and the character. Further, the general control unit 73 (an example of operation control means) includes a display control circuit 704 (for example, a display control unit 72, etc.) that controls an image or the like displayed on the image display unit 20, and a voice control circuit 705 that controls the voice output from the speaker 62. Furthermore, the general control unit 73 includes a communication control circuit 706 that controls communication with other devices (for example, an external voice recognition server (also referred to as a voice recognition engine) not shown in the figure, and an external dialogue server (also referred to as a dialogue engine) not shown in the figure, etc.). Also, the general control unit 73 controls the power state of the display device 1 based on an input signal from a power control unit 71 that controls the power of the display device 1.

[0125] [Regarding the character displayed on the display device] Here, before explaining the control content by the general control unit 73 of the control unit 70, the characters that can be displayed on the image display unit 20 of the display device 1 will be described with reference to FIGS. 10 to 12.

[0126] FIG. 10 is a diagram for explaining the outline of the display device 1 according to an embodiment. Specifically, it is a diagram showing a state in which the 3D character 1100 is displayed on the display device 1. The 3D character 1100 is a female character. The display device 1 (specifically, the overall control unit 73) further displays a stage video 2100 meaning a stage under the 3D character 1100. The stage video 2100 shows a magic circle here. A viewer seeing this display can get an impression that the 3D character 1100 is standing on the stage. The colors of the 3D character 1100 and the stage video 2100 are not particularly limited. For example, the skin of the 3D character 1100 is skin-colored. The hair color and the upper body clothing of the 3D character 1100 are relatively light blue colors (e.g., light blue), the decoration applied to the knees is a darker blue color (e.g., blue), and the skirt and shoes are white. The stage video 2100 is a relatively dark blue color (e.g., dark light blue). Note that FIGS. 10 and 11 described below show diagrams viewed from slightly above the front of the display device 1 looking down into the housing 10.

[0127] FIG. 11 is a diagram for explaining the outline of the display device 1 according to an embodiment. Specifically, it is a diagram showing a state in which the 3D character 1200 is displayed on the display device 1. The 3D character 1200 is a cat character. In the case shown in FIG. 11(B), the display device 1 displays the 3D character 1200 and a stage video 2200 meaning a stage under the 3D character 1200. The stage video 2200 shows a string of characters "Yupiteru" and a string of characters indicating the name "Juno" (referred to as "Yuno") of the 3D character 1200, alternately written along the outer periphery of a circular stage. The colors of the 3D character 1200 and the stage video 2200 are not particularly limited.

[0128] Here, the 3D character 1200 and the stage video 2200 will be described in more detail with reference to FIG. 12. The 3D character 1200 is roughly divided into a character body 1210 and a collar 1220. The character body 1210 is the cat character itself. The character body 1210 includes the parts shown in white among the body parts, for example, the parts around the glabella, nose, mouth, abdomen, and the front side of the feet correspond to this. Among the body parts of the character body 1210, the parts shown in light gray are a relatively light brownish color (for example, loess color), for example, the parts above and beside the eyes on the face, the upper part of the torso, and the parts of the feet other than the front side correspond to this. Among the body parts of the character body 1210, the parts shown in a darker gray are a darker brownish color (for example, brown), for example, the face, head, torso, and the striped parts shown by thin lines on the feet correspond to this. The collar 1220 means the collar displayed at the position of the neck of the character body 1210. The collar 1220 is a red-based color (for example, red). Among the collar 1220, a tag 1221 is attached at the position under the face of the character body 1210. The tag 1221 is circular and a predetermined logo is marked on it. The logo is a logo in which a "●" (a circle filled inside) is arranged below a "V" - shaped symbol, and each is marked in a red-based color (for example, red). The logo marked on the tag 1221 may also function as a trademark indicating the origin of the display device 1. The stage video 2200 is entirely a brownish color, the circle and the character string are a relatively dark brownish color (for example, brown), and the image imitating the smoke inside the circle is a lighter brownish color (for example, loess color).

[0129] In FIGS. 10 to 12, the backgrounds of the 3D characters 1100 and 1200 are shown in black, but it is not limited to pure black, and a relatively dark background (for example, black or other dark color systems) may also be used.

[0130] Note that the characters shown in FIGS. 10 to 12 are merely examples. When the display device 1 displays a humanoid character, the display device 1 is not limited to a female character, and may display a male character (for example, character 1000 (see FIG. 13)). The display device 1 may display any of an actual person (for example, a family member), a person who actually existed in the past (for example, a historical figure), or a character of a fictional person (for example, a character appearing in a fictional work such as a comic or an anime). When the display device 1 displays a non-humanoid animal character, the display device 1 is not limited to a cat character, and may display a character of an animal that can be kept in a general household such as a dog or a hamster, a character of an animal such as a horse or a cow other than these, or a character of a fictional animal (for example, a character appearing in a fictional work such as a comic, an anime, or the like). Further, the display device 1 may display another character having the collar 1220.

[0131] The display device 1 (specifically, the overall control unit 73) moves the body parts of the character or outputs voices imitating the character's speech based on the communication function. The communication function is a function for reproducing the communication between the viewer and the character or a function for reproducing a pseudo-communication. In the communication function, the character moves in response to the behavior of the viewer (e.g., speech or body movement). For example, the 3D character 1100 performs actions that reproduce the actions normally performed by humans, such as moving the whole body like dancing or changing expressions (e.g., expressing emotions of joy, anger, sorrow, and pleasure). For example, the 3D character 1200 makes movements that reproduce the actions normally performed by animals (e.g., yawning, wagging the tail, walking, etc.). Also, the display device 1 outputs, for example, singing voices as if the 3D character 1100 is singing or voices related to the conversation with the viewer in accordance with the actions of the 3D character 1100. The display device 1 outputs, for example, voices meaning meows of a cat or voices related to the conversation with the viewer in accordance with the actions of the 3D character 1200. Such output of video and audio is not limited to the communication function and may be performed by various functions of the display device 1.

[0132] Note that the interaction with the user in the communication function is reproduced by, for example, the voice recognition application stored in the ROM 702 of the overall control unit 73, the above-mentioned external voice recognition server, and the dialogue server. For example, when the operation unit 40 is pressed by the user, the overall control unit 73 activates the voice recognition application. As a result, voice recognition for interacting with the character is enabled. Then, the voice uttered by the user (also referred to as user voice) is transmitted from the communication control circuit 706 of the overall control unit 73 to the voice recognition server, and the voice recognition server executes voice recognition processing on the user voice and outputs a voice recognition result. For each inputtable character string, the voices uttered by the characters (also referred to as character voices) displayed on the image display unit 20 (for example, the 3D character 1100) are registered in advance in association with each other in the dialogue server. Then, the voice recognition result (for example, the voice recognition result indicated by a character string) by the voice recognition server is input to the dialogue server, and the character voice corresponding to the voice recognition result is transmitted from the dialogue server to the display device 1. Then, the overall control unit 73 outputs the character voice received from the dialogue server from the speaker 61 of the display device 1. In this way, response processing for the voice by the user is executed, and the interaction between the user and the character is reproduced.

[0133] <Regarding the communication function related to the 3D character 1100> Hereinafter, various controls for reproducing the communication between the 3D character 1100 and the user will be sequentially described with reference to FIGS. 14 to 20.

[0134] <Regarding the communication function related to 1. For example, an odor sensor 65 (see FIG. 9) for detecting an odor may be provided in the display device 1, and the overall control unit 73 may execute an audio output operation of outputting, as the character audio of the 3D character 1100, audio corresponding to the detection result by the odor sensor 65. The odor sensor 65 outputs a signal that changes according to, for example, the intensity of a certain odor, or outputs a signal that changes according to a component (odor component) contained in the odor. The odor sensor 65 outputs a signal that changes according to, for example, the type of odor. The odor sensor 65 is configured to be able to detect the concentration of a specific odor component (such as tar, ammonia, alcohol, carbon dioxide, etc.) using, for example, a deodorizing filter or the like. In this way, the overall control unit 73 can reproduce communication regarding the odor between the character displayed on the image display unit 20 of the display device 1 and the user, and can reproduce more diverse communication between the character and the user. Note that the odor sensor 65 may be provided on the outer peripheral surface of the display device 1, for example, on the inclined portion 84 of the housing 10 in the display device 1.

[0135] For example, the overall control unit 73 may execute an audio output operation of outputting, as the character audio of the 3D character 1100, audio corresponding to the detected type of odor. Note that a single sensor capable of identifying a plurality of types of odor components may be configured as the odor sensor, or a plurality of sensors capable of identifying different types of odor components may be configured as the odor sensor.

[0136] FIG. 14(A) is a flowchart for reproducing communication regarding odor, and FIG. 14(B) is a diagram showing an audio management table (also referred to as an audio management list) regarding odor. The audio management table is stored, for example, in the overall control unit 73 of the display device 1 or in the dialogue server. As shown in FIG. 14(B), in the audio management table, for each type of odor component (also referred to as an odor substance) detectable by the odor sensor 65, the type of odor mainly containing the odor component and the audio (referred to as character audio) emitted by the 3D character 1100 are registered in advance. For example, in the audio management table, the tobacco odor mainly containing tar is registered in association with tar, and as the character audio when the tobacco odor is detected, words such as "Excessive smoking is not good for your health~" that show concern for the user's health are registered.

[0137] First, in step S11, the overall control unit 73 determines whether or not an odor component has been detected. For example, when the concentration of the odor component detected by the odor sensor 65 exceeds a predetermined threshold value (reference value) for a specific odor, the overall control unit 73 determines that the odor component has been detected. In step S12, the overall control unit 73 determines the type of odor registered in association with the detected odor component in the voice management table. For example, when tar with a concentration exceeding a predetermined threshold value is detected, it is determined that a tobacco odor has been detected. Then, the overall control unit 73 outputs a character voice corresponding to the detected odor type from the speaker 62. For example, when it is determined that a tobacco odor has been detected, the overall control unit 73 executes a voice output operation of outputting a voice of words concerned about the user's health (here, "Smoking too much is not good~") as a character voice. As other examples, the following can be mentioned. For example, when the concentration of a specific main component contained in a fragrance such as aromatic oil or food exceeds a predetermined reference value, the overall control unit 73 determines that an odor such as a fragrance or food has been detected and outputs a voice asking a question about the source of the odor as a character voice. Also, when alcohol exceeding a predetermined reference value is detected, the overall control unit 73 determines that an alcohol odor has been detected and outputs voices such as "It smells like alcohol~" or "You've come back drunk again. Cut it out." as the character voice of the 3D character 1100. Further, when an odor component contained in gaseous fuel such as tertiary butyl mercaptan, dimethyl sulfide, or tetrahydrothiophene is detected, the overall control unit 73 determines that the odor of gaseous fuel has been detected and outputs a voice such as "It smells like gas!" as the character voice of the 3D character 1100. Also, when a bad breath component (e.g., hydrogen sulfide, methyl mercaptan, dimethyl sulfide, etc.) exceeding a predetermined reference value is detected, the overall control unit 73 determines that bad breath has been detected and outputs voices such as "Your breath smells a bit. Have you brushed your teeth?" or "Pay attention to periodontal abscess." as the character voice of the 3D character 1100.

[0138] In this way, the overall control unit 73 may execute control to output, as the character voice of the 3D character 1100, the voice corresponding to the detected type of smell. By performing such control, the range of communication between the character displayed on the image display unit 20 and the user can be widened, and the user's attachment to the character can be increased.

[0139] The display device 1 is not limited to identifying the voice to be output based on the voice management table. For example, the display device 1 may identify the voice to be output according to a scenario in which the speech content of the character changes based on the content of past conversations (conversation history). This scenario may define a branching scenario in which data for identifying the voice output by the character is managed in a tree structure.

[0140] Here, although the voice output operation of the voice according to the detection result by the odor sensor 65 is illustrated, it is not limited thereto. The overall control unit 73 may execute a display output operation of displaying, on the image display unit 20, a video in which a character makes a movement according to the detection result by the odor sensor 65. For example, similarly to the voice management table, a display management table (not shown) may be provided in advance, and the overall control unit 73 may execute a display output operation of displaying, on the image display unit 20, a video in which the 3D character 1100 makes a movement according to the detected type of odor. The display management table may be, for example, a table in which data defining the 3D character 1100 is registered in association with the odor component and the type of odor. The data defining the 3D character 1100 may be data indicating the video of the 3D character 1100 to be displayed, or may be data defining the content of the movement of the 3D character 1100. For example, when any odor component is detected, the overall control unit 73 may display, on the image display unit 20, a video in which the 3D character 1100 makes a movement of smelling the odor. Further, when the overall control unit 73 determines that, for example, the smell of tobacco is detected, the overall control unit 73 may display, on the image display unit 20, a video in which the 3D character 1100 makes a movement of being disgusted. At this time, the overall control unit 73 may display a video simulating smoke on the image display unit 20. Furthermore, the overall control unit 73 may execute both the voice output operation and the display output operation as described above. For example, when any odor component is detected by the odor sensor 65, the overall control unit 73 may display, on the image display unit 20, a video in which the 3D character 1100 makes a movement of smelling the odor, and output, from the speaker 62, a voice such as "Something smells" as the character voice of the 3D character 1100.

[0141] Furthermore, the overall control unit 73 may control so that the reaction of the 3D character 1100 changes according to the concentration of the odor component (also referred to as detection intensity) detected by the odor sensor 65. For example, the overall control unit 73 may selectively display any one of a plurality of videos of movements provided step by step (for example, "frowning (showing a disgusted expression)", "sweating coldly", "turning pale", and "fainting") according to the concentration of the odor component.

[0142] For example, as a method for the display device 1 to distinguish between the smell of tobacco and other odors, in combination with another sensor such as a smoke sensor that detects smoke, a camera image (for example, an image captured by the imaging unit 227), an image of a thermal camera, etc., it may be possible to detect that the user is smoking.

[0143] When the overall control unit 73 detects that the user is smoking, an image simulating smoke (a video reproducing the state where the smoke appears as a puff) may be displayed in front of (overlapping) the 3D character 1100. At this time, the overall control unit 73 may cause the face of the 3D character 1100 to protrude forward and enlarge the face, and give it an expression as if it is disgusted. The overall control unit 73 may display a change in the degree of disgust of the 3D character 1100 according to the degree of intimacy, which is the degree of intimacy between the user and the 3D character 1100. For example, when the degree of intimacy is equal to or greater than a predetermined value, the overall control unit 73 may give the 3D character 1100 an expression as if saying "I forgive you because I love you", and when it is less than the predetermined value, make the 3D character 1100 show an unpleasant expression. The overall control unit 73 may specify the degree of intimacy according to, for example, the usage record of the display device 1 by the user (for example, past usage time and past conversation content). The algorithm for specifying the degree of intimacy is not limited to this.

[0144] <2. Communication function based on user's location information> Also, for example, it is preferable that the display device 1 has a GPS (Global Positioning System) receiver 60 (see FIG. 9), and the following control is executed based on the user's location information. Here, it is assumed that the display device 1 is portable. Then, for example, the overall control unit 73 may acquire the location information of the display device 1 carried (held) by the user as the user's own location information based on the signal from the GPS receiver 60, and execute the following control based on the acquired location information.

[0145] For example, it may be controlled such that a voice corresponding to the frequency of stay (also referred to as the visit frequency) at a location specified based on the user's location information is output as a character voice. FIG. 15 is a flowchart for reproducing communication regarding the frequency of stay.

[0146] For example, in step S21, the overall control unit 73 determines whether or not the user's location information has been received from the GPS receiver 60. When the user's location information is received, in step S22, the overall control unit 73 determines whether or not the frequency of stay of the user at the location specified based on the user's location information is equal to or greater than a predetermined value (for example, "2"). Note that the frequency of stay is the number of times the user has stayed at one location within a predetermined period (for example, one day or one week). For example, the overall control unit 73 searches for and specifies the user's stay location using a network or the like based on the location information (for example, the user's current location information) acquired from the GPS receiver 60. Then, the overall control unit 73 calculates the frequency of stay of the user based on the number of times the user has stayed at the specified location, and determines whether or not the frequency of stay of the user is equal to or greater than the predetermined value. For example, when the frequency of stay of the user is equal to or greater than the predetermined value, in step S23, the overall control unit 73 controls so that a predetermined character voice registered in advance regarding the frequency of stay of the user is output from the speaker 62. For example, when the user has visited the same location twice on the same day, the overall control unit 73 determines that the frequency of stay of the user is equal to or greater than the predetermined value, and outputs a character voice such as "Hey, you were here just a moment ago".

[0147] Also, the overall control unit 73 may be controlled to output a voice corresponding to the location specified based on the acquired location information as the character voice of the 3D character 1100. FIG. 16(A) is a flowchart for reproducing communication regarding the stay location, and FIG. 16(B) is a diagram showing a voice management table of the character voice regarding the stay location.

[0148] For example, in step S31, the overall control unit 73 determines whether position information of the user has been received from the GPS receiver 60. When the position information of the user is received, in step S32, the overall control unit 73 searches for and identifies the user's staying location by using a network or the like based on the position information of the user. Then, in step S33, the overall control unit 73 outputs, from the speaker 62, a character voice corresponding to the identified location based on the voice management table in FIG. 16(B). For example, when the user goes to a supermarket, the overall control unit 73 outputs a character voice such as "What should I cook for dinner today?", or when the user goes to a hospital, the overall control unit 73 outputs a character voice such as "Are you okay? Do you not feel well?". Also, for example, when the user goes to an amusement park, the overall control unit 73 outputs a character voice such as "You had a great time playing".

[0149] Further, the overall control unit 73 may be controlled to output, as a character voice of the 3D character 1100, a voice corresponding to the number of stays (also referred to as the number of visits, etc.) of the user at the location identified based on the acquired position information. FIG. 17(A) is a flowchart for reproducing communication regarding the number of stays, and FIG. 17(B) is a diagram showing a voice management table of character voices regarding the number of stays.

[0150] Steps S41 and S42 in Fig. 17(A) are the same as steps S31 and S32 in Fig. 16(A), so the description thereof is omitted. In step S43, the overall control unit 73 acquires the number of times the user has stayed at the location specified in step S42. Then, in step S44, the overall control unit 73 outputs, from the speaker 62, a character voice corresponding to the number of times the user has stayed, based on the voice management table in Fig. 17(B). For example, when the user first visits a certain game center, the overall control unit 73 outputs a character voice such as "It was fun playing games". And when the user visits the certain game center again, the overall control unit 73 outputs a character voice such as "I really wanted to come again". Further, when the user visits the certain game center a predetermined number of times or more (for example, 10 times or more), the overall control unit 73 outputs a character voice such as "Going to play games again~".

[0151] Also, the overall control unit 73 may be controlled to output, as the character voice of the 3D character 1100, a voice corresponding to the staying time of the user at the location specified based on the acquired position information. Fig. 18(A) is a flowchart for reproducing the communication regarding the staying time, and Fig. 18(B) is a diagram showing the voice management table of the character voice regarding the staying time.

[0152] Steps S51 and S52 in Fig. 18(A) are the same as steps S31 and S32 in Fig. 16(A), so the description thereof will be omitted. In step S53, the overall control unit 73 acquires the staying time of the user at the location specified in step S52. Then, in step S54, the overall control unit 73 outputs, from the speaker 62, character voices corresponding to the staying time of the user based on the voice management table in Fig. 18(B). For example, when the staying time of the user at the convenience store is within 5 minutes, the overall control unit 73 outputs character voices such as "You were quick. I'm glad I waited for you." Also, when the staying time of the user at the convenience store is 5 minutes or more and less than 10 minutes (5 - 10 minutes), the overall control unit 73 outputs character voices such as "What did you buy?" Further, when the staying time of the user at the convenience store exceeds 10 minutes, the overall control unit 73 outputs character voices such as "You were late. I was worried."

[0153] The overall control unit 73 may perform the above control based on the position information of the user acquired using the GPS receiver 60 or the like. In this way, the user can get the feeling that the character shows a reaction according to the user's own actions, and the user's affection for the character increases.

[0154] Note that in the above, the portable display device 1 is illustrated, but for example, a stationary display device 1 may also be used. For example, the overall control unit 73 (specifically, the communication control circuit 706) communicates with the user's smartphone (a smartphone equipped with a GPS receiver) or the like to acquire the position information of the user while out (the position information of the smartphone held by the user). Then, when communicating with the 3D character 1100 after the user returns home or the like, the overall control unit 73 may control so that the above operations are executed. Note that the content of the character voices and movements at this time may be appropriately changed.

[0155] <3. Communication Function Regarding User's Behavior Pattern> Further, when it is determined that the user's behavior pattern matches a predetermined behavior pattern, it may be controlled so that voice corresponding to the predetermined behavior pattern is output as the character voice of the 3D character 1100. FIG. 19(A) is a flowchart for reproducing communication regarding the behavior pattern, and FIG. 19(B) is a diagram showing a voice management table of character voices regarding the behavior pattern.

[0156] For example, in the overall control unit 73, the day of the week when the user goes to work (for example, Monday to Friday), the time of going to work (for example, 8:30), and the specific route used when going to work are registered in advance by the user or the like as the "behavior pattern when going to work". Then, for example, when the position information of the user is received from the GPS receiver 60 (step S61), the overall control unit 73 determines whether the user's behavior pattern matches a predetermined behavior pattern based on the position information of the user (step S62). For example, when the user passes through a specific route at 8:30 on Tuesday, the overall control unit 73 determines that the user's behavior pattern matches the "behavior pattern when going to work". Then, in step S63, the overall control unit 73 outputs, from the speaker 62, as the character voice of the 3D character 1100, the voice (for example, "Do your best at work") registered in association with the "behavior pattern when going to work" based on the voice management table in FIG. 19(B). In this way, by having the character show a reaction according to the user's behavior, the user's attachment to the character can be increased. Note that it is not essential for a predetermined behavior pattern (for example, the behavior pattern when going to work) to be registered in advance by the user. For example, the overall control unit 73 may have a learning function, and a predetermined behavior pattern may be registered by learning the user's behavior pattern.

[0157] <4. Regarding the communication function for detecting a suspicious person> Also, when it is determined that a person detected in the detection target space is a suspicious person, a predetermined operation may be executed. Then, after the predetermined operation is executed, if a user of the display device 1 is detected, a voice regarding the detection of the suspicious person may be output as a character voice of the 3D character 1100. FIG. 20 is a flowchart for reproducing the operation regarding the detection of a suspicious person.

[0158] For example, in the display device 1, a photographing unit (for example, a camera) (not shown) for photographing a viewer (user, etc.) may be provided on the front side of the display device 1, and the photographing unit (specifically, the sensor included in the photographing unit) may be used as a detection means for detecting the presence of a person in the detection target space. As the "detection target space", for example, the angle-of-view range (photographable range) of the photographing unit in the space where the display device 1 is placed (for example, the user's home) can be mentioned. The photographing unit includes, for example, a lens and an imaging element (for example, a CCD or a CMOS), and photographs a multi-color image. The lens of the photographing unit is provided at a position where a viewer (especially the face) can be photographed. For example, the lens of the photographing unit is provided near the center in the width direction of the display device 1 among the upper end portions 51. The photographing unit outputs, for example, image signals of each color component of R, G, and B to the control unit 70. The overall control unit 73 processes this image signal to generate a photographed image.

[0159] The overall control unit 73 monitors the detection target space using the imaging unit (step S71). Then, when the presence of a person is detected in the detection target space, in step S72, the overall control unit 73 performs user authentication such as face authentication, for example, and in step S73, determines whether the detected person is a registered user of the display device 1. For example, if the overall control unit 73 determines that the person captured by the imaging unit is a registered user of the display device 1, it determines that the person is not a suspicious person. On the other hand, if it is determined that the person captured by the imaging unit is an unregistered user, in step S74, the overall control unit 73 determines that the person is a suspicious person and executes a predetermined operation. Examples of the "predetermined operation" include an operation to start recording by the imaging unit, an operation to issue an alarm at a relatively high volume, an operation to notify a pre-registered security company, and the like. Alternatively, the "predetermined operation" may be an operation in which the 3D character 1100 addresses the suspicious person (for example, "Who!? Say the password!"). And if there is no reply from the person determined to be a suspicious person, or if the password is incorrect, the above recording start operation or the like may be executed. In addition, when the password is incorrect, the overall control unit 73 outputs a voice such as "That's wrong!? Say it again" as the character voice of the 3D character 1100, and may execute the above recording start operation or the like when it is determined again that the password is incorrect. By doing so, for example, a suspicious person can be made to retreat from the detection target space, and the crime prevention performance in the detection target space can be enhanced.

[0160] Then, after the execution of the predetermined operation, when a user of the display device 1 is detected, the overall control unit 73 may output a voice regarding the detection of a suspicious person as the character voice of the 3D character 1100. Examples of the "voice regarding the detection of a suspicious person" include "That was scary~". By doing so, the user's affection for the character displayed on the image display unit 20 can be increased.

[0161] Also, when the detection target space is being monitored using the display device 1, not limited to the detection of a suspicious person, the following operations may be performed.

[0162] For example, the display device 1 may be arranged in the reception space of a company, and a 3D character 1100 may be displayed to perform reception work as a so-called receptionist. Specifically, when the approach of a person in the detection target space (for example, the reception space) is detected by a microwave Doppler sensor (an example of detection means), the overall control unit 73 may output a voice such as "Welcome. Which department can I help you?" as the character voice of the 3D character 1100. Then, the overall control unit 73 may be controlled to call the department desired by the visitor based on the response from the detected person (the visitor).

[0163] <5. Communication function regarding the startup time of the display device 1> In addition, the overall control unit 73 may control the communication content to change according to the startup time (for example, the cumulative startup time) of the display device 1 from a predetermined time point (for example, the first startup time) in the word usage of the 3D character 1100's character voice. For example, as described below, the overall control unit 73 may control the 3D character 1100 to speak to the user in a more familiar way as the startup time of the display device 1 becomes longer.

[0164] For example, for various character voices as described above, it is preferable that three patterns of character voices, namely, a polite tone, a speech tone as if the user is in a friendly relationship, and a speech tone as if the user is in a romantic relationship, are registered in advance in the voice management table. Then, for example, when the startup time of the display device 1 from a predetermined time point is less than 100 hours, the overall control unit 73 outputs the character voice with a polite tone among the three patterns of character voices registered in the voice management table. Also, when the startup time is 100 hours or more and less than 1000 hours, the overall control unit 73 outputs the character voice with a speech tone as if the user is in a friendly relationship among the three patterns of character voices registered in the voice management table. Further, when the startup time exceeds 1000 hours, the overall control unit 73 outputs the character voice with a speech tone as if the user is in a romantic relationship among the three patterns of character voices registered in the voice management table.

[0165] By doing so, the user can feel that the relationship (e.g., intimacy) with the character has changed due to the change in the character's way of speaking to the user himself / herself.

[0166] In addition, the overall control unit 73 may control to decrease the intimacy of the 3D character 1100 with respect to the user depending on the elapsed time since the previous startup. For example, even when the cumulative startup time of the display device 1 exceeds 100 hours, when one week has elapsed since the previous startup, the overall control unit 73 may output the character voice with a polite tone instead of a speech tone on an equal footing with the user. In this way, the user will come into contact with the character displayed on the image display unit 20 without taking a break as much as possible in order to maintain the intimacy with the character, and the attachment to the character can be further increased.

[0167] Also, the overall control unit 73 may output a greeting voice such as "Nice to meet you" as a character voice at the first startup, and when a predetermined period (for example, a well - defined period such as one month) has elapsed since the first startup, output a voice with content indicating a commemorative day (for example, "It's been one month since we met") as a character voice. By doing so, the attachment to the 3D character 1100 can be further increased.

[0168] <6. Communication function through cooperation with other devices> Also, for example, in the stationary display device 1, the following operations may be executed in cooperation with other devices. For example, when a user visits a location where a device (hereinafter referred to as another device) capable of communicating with the display device 1 is installed, the control unit (such as a CPU) of the other device identifies the user and automatically guides the user to information suitable for the user (such as gourmet information or event information) as follows. For example, the face image of a user who uses a cooperation system between the display device and another device and the display device (such as an IP address, etc.) owned by the user are associated and registered in advance in an external server or the like. When a person is detected by a sensor included in the imaging unit provided in the other device, for example, the control unit of the other device compares the face image of the person detected in the captured image with the face image of the user registered in the external server to identify the user of the display device 1. Then, the control unit of the other device specifies the display device 1 (such as the IP address of the display device 1, etc.) registered in association with the user in the external server, and transmits information indicating that the user of the display device 1 has been detected to the display device 1. In the overall control unit 73 of the display device 1, "information suitable for the user" (such as gourmet information or event information) is registered in advance, and the overall control unit 73 transmits the registered "information suitable for the user" to the other device in response to the reception of a signal from the other device. Then, the control unit of the other device outputs the "information suitable for the user" received from the display device 1 (for example, voice output). When guiding the "information suitable for the user", the other device may display the 3D character 1100 on its display screen. Also, information such as the information guided to the user may be transmitted from the other device to the display device 1 and accumulated as user information in the overall control unit 73 of the display device 1. Then, for example, when the display device 1 is installed at the user's home and the user's return home is detected, the overall control unit 73 may output a voice such as "You went to **, how was it?" as the character voice of the 3D character 1100. In this way, the user's attachment to the character displayed on the image display unit 20 can be increased.

[0169] <7. Regarding Other Communication Functions> Furthermore, the following control may be performed based on the detection results by various sensors.

[0170] For example, a wind detection means (e.g., a wind sensor) capable of detecting wind (e.g., wind speed) may be provided near the lower end portion 52 of the opening 5 of the display device 1, and the following control may be performed based on the detection result by the wind sensor. The wind may be, for example, considered to be artificially generated by the user, such as the wind generated by moving a body part such as waving a hand toward the display device 1 or the wind generated by blowing breath. For example, when wind with a wind speed equal to or higher than a predetermined value is detected by the wind sensor, the overall control unit 73 may display and output an image in which the hair (e.g., hair) or clothes (e.g., skirt) of the character (e.g., 3D character 1100) displayed on the image display unit 20 flutter. Also, for example, when an image of a lit candle is displayed on the image display unit 20 and wind is detected by the wind sensor, the overall control unit 73 may switch to an image in which the flame of the candle goes out. Furthermore, when the detected wind is stronger than a predetermined threshold (the wind speed is greater than a predetermined threshold), the overall control unit 73 may switch the image according to the intensity (e.g., wind speed) of the detected wind, such as making the clothes of the 3D character 1100 flutter more.

[0171] Further, for example, an object detection means (e.g., an ultrasonic sensor) capable of detecting the presence or absence of an object and the distance to the object may be installed on the inner peripheral surface of the housing 10 of the display device 1 facing inward of the housing 10, and the following control may be performed based on the detection result by the ultrasonic sensor. For example, when the overall control unit 73 determines that the hand of the viewer touches the 3D character 1100 stereoscopically displayed in the housing 10 based on the detection result by the ultrasonic sensor, it may be preferable to display and output a video in which the 3D character 1100 shows a reaction. Further, the overall control unit 73 may perform display control so as to show different reactions according to the part touched by the viewer on the 3D character 1100. The part touched by the observer on the 3D character 1100 may be, for example, a part of the body such as the head, chest, abdomen, buttocks or legs. Further, the part touched by the observer on the 3D character 1100 may be the clothes (e.g., a dress, a skirt) or ornaments (e.g., an accessory) of the 3D character 1100.

[0172] Further, for example, a seismic detection means (e.g., a seismic sensor) capable of detecting an earthquake and measuring the seismic intensity may be provided in the display device 1, and when the overall control unit 73 detects an earthquake by the seismic sensor, it may issue an earthquake warning.

[0173] Further, for example, a weather sensor capable of measuring the weather may be provided in the display device 1, and the overall control unit 73 may notify the change in weather, weather forecast, etc. based on the measurement result by the weather sensor. The weather sensor may have, for example, a barometric pressure sensor, a temperature sensor, and a humidity sensor, and may be configured to measure the weather based on the detection results of each sensor.

[0174] Further, the overall control unit 73 may display a video in which the expression and movement (also referred to as motion) of the character displayed on the image display unit 20 change according to the temperature detected by the temperature sensor and / or the humidity detected by the humidity sensor.

[0175] In addition, the overall control unit 73 may display a video in which the expression and movement of the character displayed on the image display unit 20 change according to the detection result of a human presence sensor such as a microwave Doppler sensor (for example, the distance between the display device 1 and the viewer).

[0176] In addition, the overall control unit 73 may use a humidity sensor to determine whether or not the user has blown air. Further, the overall control unit 73 may also use a temperature sensor to determine the type of air blown by the user. These sensors may be provided, for example, near the lower end 52 of the opening 5 of the display device 1.

[0177] Here, there are two types of air blown by the user, for example, air blown with "hoo" and air blown with "haa". Generally, when blowing cold air, the air is blown quickly with "hoo", so here, the air blown with "hoo" is called "cold air". Also, generally, when blowing warm air, the air is blown slowly with "haa", so here, the air blown with "haa" is called "warm air".

[0178] Regarding these two types of air, the inventor of the present application obtained the following findings through experiments and the like. Specifically, first, regarding humidity, when blowing "hoo" air toward a temperature and humidity sensor (for example, a sensor in which a temperature sensor and a humidity sensor are integrated) at a position a certain distance away from the temperature and humidity sensor, a measurement result was obtained that the humidity rapidly rises from the steady state immediately afterwards. Also, after that, the humidity monotonically increases while blowing air, and when the blowing of air stops, it takes several tens of seconds to return to the original steady state, as measured. The same measurement results were obtained when blowing "haa" air toward the temperature and humidity sensor under the same conditions. On the other hand, regarding temperature, when blowing "hoo" air, the temperature slightly decreases from the steady state or remains almost horizontal, and when blowing "haa" air, the temperature rises, as measured. Note that the air blown by the user onto the display device 1 is an example of the wind hitting the display device 1.

[0179] In consideration of such findings, for example, in the display device 1 provided with a humidity sensor, when the humidity sensor detects that the humidity has rapidly increased from a steady state, the overall control unit 73 may determine (also referred to as a decision) that the viewer has blown air. Further, when it is detected that the monotonic increase in humidity then stops, the overall control unit 73 may determine that the blowing of air has stopped. Alternatively, when a predetermined time (for example, the time required to exhale normal breath (for example, about 3 seconds)) has elapsed since the rapid increase in humidity was detected, the overall control unit 73 may determine that the blowing of air has stopped regardless of the humidity detection result at that time.

[0180] Furthermore, when the rapid increase in humidity is detected by the humidity sensor and at the same time (for example, at approximately the same timing), the temperature sensor detects that the temperature has increased from a steady state, the overall control unit 73 may determine that the type of air blown by the viewer is "warm air". Conversely, when the rapid increase in humidity is detected by the humidity sensor and the temperature sensor detects that the temperature has not changed from a steady state or has decreased from a steady state, the overall control unit 73 may determine that the type of air blown by the viewer is "cold air".

[0181] Then, the overall control unit 73 may output an image or sound corresponding to the detection of the blowing of air as the movement of the character or the character sound displayed on the image display unit 20. Also, the overall control unit 73 may output an image or sound corresponding to the type of air blown as the movement of the character or the character sound displayed on the image display unit 20. For example, when the type of air blown by the viewer is "cold air", the overall control unit 73 may display and output an image of the character's clothes fluttering, and when the type of air blown by the viewer is "warm air", the overall control unit 73 may display and output an image of the character making a movement to avoid the air.

[0182] In addition, the inventor of the present application has also obtained the following findings using various gas sensors. Specifically, when blowing "hoo" towards the gas sensor at a position approximately a certain distance (for example, about 10 cm) away from the gas sensor, the output value of the gas sensor decreases immediately afterwards. When the blowing stops, the output value of the gas sensor turns upward immediately afterwards. Measurement results to this effect were obtained. Conversely, when blowing "haa" towards the gas sensor, the output value of the gas sensor increases immediately afterwards. When the blowing stops, the output value of the gas sensor turns downward immediately afterwards. Measurement results to this effect were obtained. Further, for example, when the wind sent from a blower (for example, a fan) hits the gas sensor, the output value of the gas sensor decreases. When the wind from the fan no longer hits the gas sensor, the output value of the gas sensor increases. Measurement results to this effect were obtained.

[0183] In consideration of such findings and the like, the overall control unit 73 may, for example, in the display device 1 provided with the gas sensor, when the output value of the gas sensor rapidly decreases from the steady state, determine that the type of breath blown by the viewer is "cold breath". Conversely, when the output value of the gas sensor rapidly increases from the steady state, the overall control unit 73 may determine that the type of breath blown by the viewer is "warm breath".

[0184] It is also possible to adopt a configuration for detecting breath using a wind sensor. The inventor of the present application has confirmed that according to the wind sensor, it is sometimes possible to detect a relatively weak wind such as the wind when lying on paper, and when blowing breath on the wind sensor, it immediately reaches a peak and has good responsiveness when the wind starts to blow. However, if blowing breath continuously, it immediately drops from the peak. It is conceivable that a strong wind such as a hoo breath cools the heater and takes time to recover.

[0185] Regarding the configuration for detecting breath using a wind sensor, the following configuration may be adopted.

[0186] When the overall control unit 73 continuously detects a predetermined air volume with the wind sensor, it may perform processing in a direction where the user is not being blown on. Processing in a direction where the user is not being blown on is, for example, processing that determines that no breath is being blown. In this case, when the time from the start to the end of wind detection by the wind sensor is within the time when breath can be blown, the overall control unit 73 may perform processing in the direction where the user is being blown on.

[0187] In this case, the wind sensor may be a sensor that detects wind by electrically measuring the heat taken away by the wind. In this sensor, the wind received by the sensor corresponds to the air volume of the blown breath. This sensor is set to drop to a value less than the actual air volume during the duration when the wind received by the sensor continues for a time corresponding to the time when the breath was blown, and it is preferably set so that this drop is less likely to occur when the wind received by the sensor is less than the air volume of the blown breath.

[0188] In the display device 1, a flow path for allowing the inflow of wind with a common breath inflow path may be provided for a plurality of wind sensors as the wind sensors. The flow path is preferably configured such that wind enters different wind sensors at a predetermined ratio that is not 1:1. The overall control unit 73 may determine the magnitude and time of the blown breath based on the ratio and the differences in the characteristics of the plurality of wind sensors. The display device 1 includes a plurality of wind sensors with different timings of dropping to a value less than the actual air volume during the duration, and the overall control unit 73 may determine the magnitude and time of the blown breath based on the outputs of the plurality of wind sensors. The display device 1 may at least include a wind sensor that is not a gas sensor and a ca sensor as the plurality of wind sensors.

[0189] Also, it is preferable to use a gas sensor for detecting a predetermined gas as the wind sensor. As the wind sensor, it is preferable to use a gas sensor for detecting a predetermined gas and including a heater. In this case, the gas sensor including the heater outputs in a direction in which the gas detection amount increases when the degree of blowing is relatively small (as a result of detecting the gas contained in the breath), while outputs in a direction in which the gas detection amount decreases when the degree of blowing is relatively large (due to the cooling of the heater by the wind of the breath).

[0190] When the overall control unit 73 determines that breath is being blown, when the strength is relatively large (for example, when the air volume is equal to or greater than the threshold), it displays an animation that moves the clothes, hair, etc. of the 3D character 1100, while when the strength is relatively small, it displays an animation different from the animation that moves the clothes, hair, etc. of the 3D character 1100.

[0191] By the way, when using a gas sensor for breath detection, the gas sensor outputs the above output value in response to a component (for example, carbon dioxide) contained in human breath. The reason why the output value of the gas sensor is different when "hoo" breath is blown and when "haa" breath is blown is that when "hoo" breath is blown, the speed of the blown breath is high and it easily diffuses around immediately after colliding with the gas sensor, while when "haa" breath is blown, the speed of the blown breath is low and the components of the breath tend to remain at the place after colliding with the gas sensor.

[0192] Furthermore, the overall control unit 73 may determine whether the detected wind is caused by a viewer's blowing or by a blower, for example, using the detection result of humidity by a humidity sensor. For example, in the display device 1, when the output value of the gas sensor rapidly decreases from the steady state and the humidity sensor detects that the humidity has rapidly increased from the steady state, the overall control unit 73 may determine that the user has blown. On the other hand, when the output value of the gas sensor rapidly decreases from the steady state but the humidity remains in the steady state, the overall control unit 73 may determine that the wind is being sent by the blower. Furthermore, when it is determined that the user has blown, the overall control unit 73 may determine the type of the breath using the detection result of temperature by a temperature sensor. Also, when the rise and fall of the output value of the gas sensor are repeated within a relatively short fixed period, the overall control unit 73 may determine that the wind of the swinging fan is hitting.

[0193] Note that the wind sensor, humidity sensor, temperature sensor, temperature and humidity sensor, and gas sensor used to detect wind are examples of wind detection means. The display device 1 may have a barometric pressure sensor as a sensor for detecting wind. This is because a change in barometric pressure can occur due to the generation of wind and its intensity.

[0194] The various controls as described above can be executed. Note that the above-described control is not limited to the 3D character 1100, and may be performed for the communication function related to other characters (for example, the 3D character 1200).

[0195] [Display example of three-dimensional image, etc.] In the display device 1 having the configuration as described above, the following display may be performed for a three-dimensional image (particularly, for example, a three-dimensional image displaying a 3D character). The following display may be executed, for example, as an example of the above-described "communication function". Note that the following display may be reproduced, for example, when the overall control unit 73 executes the 3D application in the ROM 702.

[0196] For example, although not shown in the drawings, when there is movement in a part of the character's body, the overall control unit 73 may change the parse of the character (for example, also referred to as a parse image). By doing so, a sense of jumping can be given to the character.

[0197] For example, although not shown in the drawings, when the character gets angry due to a conversation between the character and the viewer, and an effect is performed in which the character throws a punch, the overall control unit 73 controls the camera position so that the character's hand appears in front of the camera within the 3D application, and controls to change the parse to a state where it is emphasized more than the normal state, at least during the period when the punch is being thrown. Then, when the character's punch ends, the overall control unit 73 may control to return the parse to the normal state.

[0198] Also, when adjusting the interval between the left and right cameras (for example, the interval setting value in the 3D application) so that the 3D character appears to jump out in front of the lenticular member 30 in autostereoscopic vision, when increasing the degree of jumping out, there is a problem that the 3D character appears to be stretched in the front-rear direction. Considering such a problem, the overall control unit 73 may execute image processing so as to compress the front-rear direction of the 3D character as the degree of jumping out increases (for example, as the interval between the left and right cameras is widened). In particular, a compression amount corresponding to the degree of jumping out may be provided, and the compression amount may be increased as the 3D character jumps out more to the front side.

[0199] Also, although not shown in the drawings, the overall control unit 73 may display various parts of the 3D character (for example, the chest in the case of a female character) so as to sway. In this case, in order to further emphasize the three-dimensionality of the 3D character, for example, an image in which the 3D character is facing obliquely forward instead of straight ahead may be displayed.

[0200] Further, the overall control unit 73 may set various parameters (such as the degree of separation of the camera, the orientation, the distance to the object to be displayed, etc.) in the 3D application to appropriate values according to the character displayed on the image display unit 20. Note that, not limited to the automatic setting by the overall control unit 73, a physical slider for adjusting various parameters in the above 3D application may be provided on the housing 10 so that a viewer or the like can easily adjust the various parameters while viewing the 3D character.

[0201] Also, although not shown in the drawings, the overall control unit 73 may display a predetermined object (for example, a plate or the like) so as to be drawn at the same position as the light shielding member 30. In this way, it is possible to inform the viewer visually of the presence of the light shielding member 30, and when the viewer puts a hand into the space region 102 (FIG. 6), it is possible to prevent the viewer's hand from hitting the light shielding member 30. It is still better if the display device 1 is provided with a function of calibrating various parameters so that a predetermined object and the light shielding member 30 are at the same position.

[0202] Also, videos in a state where the 3D character pops out to the front side (the opening 5 side) of the light shielding member 30 and videos in a state where the 3D character only pops out to the rear side (the image display unit 20 side) of the light shielding member 30 may be provided in advance, and different actions may be performed in each state. For example, although not shown in the drawings, when the overall control unit 73 displays a video in which the 3D character pops out to the front side on the image display unit 20, the image display unit 20 may display a video in which the 3D character performs an action of actively allowing the viewer to touch the 3D character, such as asking for a handshake. When it is the reverse, a video in which such an operation is not performed may be displayed. Further, the overall control unit 73 may display, for example, an image of a slide on the surface of the inclined light shielding member 30 and draw an image of the character sliding on it (the front side).

[0203] Further, the overall control unit 73 may selectively display, on the image display unit 20, any one of a plurality of images including the following first image and second image as an image recognized as a three-dimensional image. The first image may be an image (see the 3D character 1000 in FIG. 21(B)) that can be stereoscopically viewed by the viewer such that at least a part of the 3D character 1000 exists on the front side (opening 5 side) of the light attenuation member 30. The second image may be an image recognized as existing on the front side or the back side of the first image. For example, on the image display unit 20, a second image (see FIG. 21(A)) that can be stereoscopically viewed by the viewer such that the 3D character 1000 (an example of "a display object to be stereoscopically viewed by the viewer") exists on the back side (image display unit 20 side) of the light attenuation member 30, and a first image (see FIG. 21(B)) that can be stereoscopically viewed by the viewer such that the portion above the feet of the 3D character 1000 exists on the front side (opening 5 side) of the light attenuation member 30 may be switched and displayed. In the first image, it may be an image that can be stereoscopically viewed by the viewer such that all parts of the 3D character 1000 exist on the front side of the light attenuation member 30. In this way, any one of a plurality of images including the first image and the second image, where the positions recognized as having an image recognized as a three-dimensional image by the viewer are different, can be selectively displayed, so that the stereoscopic effect given to the viewer can be changed. As a result, for example, the viewer can be made to enjoy more. Note that the image of the 3D character 1000 itself is displayed on the display surface of the image display unit 20, and FIG. 13 shows the 3D character 1000 that is stereoscopically viewed by the viewer (also expressed as appearing to jump out from the image display unit 20).

[0204] For example, the overall control unit 73 may switch the display image of the image display unit 20 by causing the image (see FIG. 21(A)) in which the 3D character 1000 only pops out to the rear side of the light dimming member 30 to transition to the image (see FIG. 21(B)) in which the 3D character 1000 (all or a part of the 3D character 1000) pops out to the front side of the light dimming member 30. The position where the three-dimensional image is recognized may be switchable by an operation of the operation unit 40 by the viewer or other operations. The viewer may operate so that the image is displayed at a position where the three-dimensional image looks three-dimensional. Also, there may be three or more switchable positions for the three-dimensional image. This is because whether the three-dimensional image looks three-dimensional may vary depending on individual differences.

[0205] Also, when performing the display transition between the first image and the second image, the overall control unit 73 may display an image (video) of the moving process in which the 3D character 1000 gradually moves from the rear side to the front side (or from the front side to the rear side) of the light dimming member 30.

[0206] In such an image transition, the overall control unit 73 may, for example, display on the image display unit 20 a video in which the 3D character performs an action indicating the presence of the light dimming member 30. For example, when the 3D character hits the light dimming member 30 from a position on the rear side of the light dimming member 30, an image with a hole opened may be arranged at the same position as the light dimming member 30, and a video in which the 3D character pops out from the hole and moves to the front side may be displayed.

[0207] [Specific example of video displayed on display device 1] Next, while referring to FIGS. 22 to 36, a specific example of the video displayed on the display device 1 will be described. FIGS. 22 to 36 are diagrams showing an example of a character (a video including the 3D character 1200 described in FIGS. 11 and 12) displayed on the display device 1 according to the present embodiment. Each video shown in FIGS. 22 to 36 is an image that is displayed on the display device 1 and can be viewed by a viewer through the opening 5. Although the stage video 2200 is displayed in FIGS. 22 to 36, the 3D character 1200 may be displayed instead without displaying this.

[0208] The display device 1 (specifically, the overall control unit 73) switches and displays the video of the 3D character 1200 shown in FIGS. 22 to 28 regularly or randomly during the period of waiting for the viewer's operation based on the communication function. The display device 1 (specifically, the overall control unit 73) changes the display of the 3D character 1200 based on the communication function. For example, as shown in FIG. 22(A), the 3D character 1200 is displayed in a posture of standing facing the front side (the side where the image is viewed) of the display device 1. The display device 1 may use this posture as the basic posture and also as the display during the period when communication based on the communication function is not being performed. For example, as shown in FIG. 22(B), the 3D character 1200 makes an action of licking its front leg. For example, as shown in FIGS. 22(C) and 23(A), the 3D character 1200 makes an action of alternately looking to its left and right. For example, as shown in FIG. 23(B), the 3D character 1200 makes an action of facing the direction of the ground. For example, as shown in FIG. 23(C), the 3D character 1200 makes an action of stretching while sitting. For example, as shown in FIG. 24(A), the 3D character 1200 makes an action of peeking into the ground. Further, for example, as shown in FIGS. 24(B) and 24(C), the 3D character 1200 makes an action of walking towards the front side. For example, as shown in FIG. 25(A), the 3D character 1200 makes an action of peeking into its own abdomen. For example, as shown in FIG. 25(B), the 3D character 1200 makes an action of tilting its neck. For example, as shown in FIG. 25(C), the 3D character 1200 makes an action of rubbing its own eyes. For example, as shown in FIG. 26(A), the 3D character 1200 makes an action of yawning. For example, as shown in FIG. 26(B), the 3D character 1200 makes an action of licking its front leg while sitting. For example, as shown in FIG. 26(C), the 3D character 1200 makes an action of looking at its left front. For example, as shown in FIG. 27(A), the 3D character 1200 makes an action of looking at its right front. As shown in FIG. 27(B), the 3D character 1200 makes an action of stretching. For example, as shown in FIG. 27(C), the 3D character 1200 makes an action of peeking into the ground.For example, as shown in FIG. 28(A), the 3D character 1200 faces in the direction diagonally forward to the right of the display device 1, and then, as shown in FIG. 28(B), faces forward. As shown in FIG. 28(C), the 3D character 1200 performs an action of licking its front leg.

[0209] Figures 29 to 36 are examples of the display of the 3D character 1200 performed by the display device 1 (specifically, the overall control unit 73) based on the communication function during the dialogue process. The character strings shown in Figures 29 to 36 are character strings recognizable by voice recognition and are displayed above the 3D character 1200. Figure 29(A) is what is displayed when the display device 1 recognizes the viewer's utterance of "Come here~", and in response, a voice is output. Figures 29(B) to 30(B) are what are displayed when the display device 1 recognizes the viewer's utterance of "Sit down", and in response, a voice is output. Figure 30(C) is what is displayed when the display device 1 recognizes the viewer's utterance of "Are you hungry?", and in response, a voice is output. Figure 31(A) is what is displayed when the display device 1 recognizes the viewer's utterance of "Police officer", and in response, a voice is output. Figures 31(B) and (C) are what are displayed when the display device 1 recognizes the viewer's utterance of "It's snack time", and in response, a voice is output. Figure 32(A) is what is displayed when the display device 1 recognizes the viewer's utterance of "Hand", and in response, a voice is output. Figures 32(B) to 33(B) are what are displayed when the display device 1 recognizes the viewer's utterance of "So cute", and in response, a voice is output. Figure 33(C) is what is displayed when the display device 1 recognizes the viewer's utterance of "Hello", and in response, a voice is output. Figure 34(A) is what is displayed when the display device 1 recognizes the viewer's utterance of "Eat rice", and in response, a voice is output. Figures 34(B) and (C) are what are displayed when the display device 1 recognizes the viewer's utterance of "Is it a girl?", and in response, a voice is output. Figure 35(A) is what is displayed when the display device 1 recognizes the viewer's utterance of "Wait", and in response, a voice is output. Figure 35(B) is what is displayed when the display device 1 recognizes the viewer's utterance of "What a good girl", and in response, a voice is output. Figures 35(C) and 36 are what are displayed when the display device 1 recognizes the viewer's utterance of "Uno", and in response, a voice is output.

[0210] <More detailed description of the 3D character 1200> A more detailed description will be given of the 3D character 1200 described with reference to FIGS. 22 to 36. In the following description, with respect to the description taking the display device 1 as the processing subject, it may be regarded as the processing performed by the control unit 70 (more specifically, the overall control unit 73). The 3D character 1200 is preferably drawn at approximately life-size. By doing so, it has been found that the sense of depth is particularly emphasized. The display device 1 preferably draws the 3D character 1200 such that, when viewed from the side (horizontal side), in the vertical direction, the head occupies approximately one-third, the torso occupies one-third, and the legs occupy one-third of the height. The display device 1 preferably draws the 3D character 1200 such that, for parts other than the tail, when viewed from the side, in the horizontal direction, the head occupies approximately one-third and the torso occupies two-thirds.

[0211] The display device 1 has a function of performing mutually displaced drawing between a state where the tail is not visible and a state where the tail is visible with a face in the front. It is preferable that the time when the tail is visible is shorter than the time when the tail is not visible. Although the tail is drawn deeper than the head, the ability to greatly feel the three-dimensional effect due to the tail being visible sometimes can prevent the eyes and head from getting fatigued due to constantly feeling a strong three-dimensional effect. In particular, the display device 1 preferably performs such drawing processing in the voice recognition standby state. The display device 1 preferably has a function of drawing such that when displacing to the state where the tail is visible, the tail appears from the top of the head. In this way, usually, since there is the viewer's line of sight on the eyes of the face and the tail suddenly pops out above the head from the upper center thereof, it can give a sense of surprise and interest.

[0212] The display device 1 may be provided with a flat portion on the top of the head of the 3D character 1200 in a front view, and in particular, the head portion between the left and right ears may be drawn flat in a front view. By doing so, a tail with a three-dimensional effect suddenly appears from the flat top of the head with a weak three-dimensional effect, which can provide more surprise and interest. Also, after drawing the tail so that it appears from above the head, the display device 1 may perform drawing to move the portion closer to the tip of the tail. By doing so, the viewpoint can be focused on the portion of the tail behind the face, and a stronger three-dimensional effect can be felt. The display device 1 may similarly draw the tail so that it appears from the left and right sides of the body. When the display device 1 causes the tail to appear from the left and right sides, the length and / or time during which the tail appears may be made shorter than when the tail appears from above the head. When the display device 1 causes the tail to appear from the left and right sides, it may perform drawing so that the tail appears in a flickering manner. The display device 1 may also perform drawing to move the line of sight to the back side from time to time, which can make the user feel a stronger three-dimensional effect. While the tail appears from above the head during voice recognition, the display device 1 may perform drawing so that the tail appears from either the left or right direction when outputting voice from the cat. The display device 1 may be provided with a portion on the tail that has a drawing mode different from other portions at predetermined intervals in the length direction. For example, a pattern with a predetermined width may be attached in an annular or arc shape on the cylindrical surface of the tail at regular intervals. By doing so, the inventors have found that the movement of the tail can be felt to move more dynamically in three-dimensional space.

[0213] When voice recognition is in progress, the display device 1 may perform drawing to change the current posture to the same posture when there is a change from a state where voice recognition is not in progress to a state where voice recognition is in progress so as to be in the same posture. Before the start of voice recognition, the display device 1 may cause the voice "Let's talk nya" to be uttered. The display device 1 may be provided with a function (such as a sensor or a switch) for detecting the operation of the viewer, and may be provided with a function of uttering "What nya?" when the operation from the viewer is detected. Both functions may be continuously executed in the form of "What nya?" and "Let's talk nya", and then the process may be performed so as to enter the voice recognition state.

[0214] The display device 1 is provided with information on words of praise such as "cute" as speech recognition phrases. When a phrase of praise is recognized, it is advisable to change the body posture. Furthermore, it is even better to move the position of the cat itself, such as walking. By doing so, since the viewer wants to see the change in the cat's posture and the movement of the movement, they will take praise actions and words, and excellent effects of therapy such as improvement of actions and words can be obtained.

[0215] The display device 1 is provided with a speech recognition phrase corresponding to giving food. When the phrase is recognized, it is advisable to perform a drawing in which the tail wags faster than in other cases. By doing so, it is possible to give the viewer a feeling as if the cat is actually alive.

[0216] The display device 1 may perform drawing processing with the outline of the cat's eyes generally circular and the black eye part vertically elongated elliptical. The display device 1 may draw the black eye part with a shading gradient in the vertical direction and draw it in a lighter color as it goes downward. The display device 1 may provide a blacker part at the center of the black eye than the periphery of a generally circular or elliptical shape. The display device 1 may provide and draw a crescent-shaped or semi-circular white area along the outer edge of the black eye in the outer part of the face near the upper part of the black eye part. On the other hand, the display device 1 may provide and draw a circular white area at a position near the center of the face below the black eye. The display device 1 may continue to draw this white area even when there is a change in the position of the 3D character 1200 (such as a change in posture), or a change in the position of the camera or light. Usually, highlights are often put in by calculation as reflections of light or the like. However, by doing so, it is possible to emphasize the individuality of the cat's eyes, which are most seen during speech recognition conversations, and to impress the viewer as an individual cat in a short time during speech recognition.

[0217] The display device 1 takes a state where the face is facing forward and a state where the face is facing downward. When the face is facing forward, the outline of the eyes is drawn generally circular, while when the face is facing downward, the eyes are drawn horizontally elongated elliptical.

[0218] The display device 1 takes on two states: one where the upper end of the face is above the upper end of the body, and the other where the upper end of the face is below the upper end of the body. When the upper end of the face is above the upper end of the body, the outline of the eyes is generally drawn in a circular shape, while when the upper end of the face is below the upper end of the body, the eyes are preferably drawn in a horizontally elongated elliptical shape. The display device 1 has a function of depicting a state of yawning with the mouth open, and when depicting this, it is preferable to draw the eyes closed.

[0219] The display device 1 preferably prepares a plurality of patterns of standby motions for the 3D character 1200 and repeats the process of selecting and drawing one pattern from among these patterns. Examples of standby motions include motions such as licking the feet, stroking the face with the hand, licking the buttocks, facing forward, looking around left and right, licking the ground, stretching, yawning, and walking.

[0220] The display device 1 preferably draws the ears so that they move with a delay relative to the movement of the face. For example, even when the face starts to move, the ears are preferably drawn to maintain their position for a while. The display device 1 preferably has a function of simultaneously performing a motion of wagging the tail from side to side when performing a licking motion. When the 3D character 1200 is viewed from the front, the display device 1 preferably makes the pattern on the body asymmetrical left and right. By doing so, it becomes easier to remember the cat as having a unique personality, and it also becomes easier to determine whether the right side or the left side is visible. This is particularly useful when providing a scene where the overall image of the 3D character 1200 is enlarged so much that it cannot be seen entirely. In particular, the pattern is preferably that of a calico cat, and more preferably that of a tabby cat. The inventors have found that doing so makes it particularly easy to grasp the three-dimensional effect. In particular, the pattern on the top of the head is preferably provided in the front-back direction, while the pattern on the body is preferably provided in the up-down direction, etc., so that the directions of the patterns are different. By doing so, even when the position of the camera or the cat changes in any direction, it becomes easier to recognize.

[0221] The display device 1 is provided with a function of emitting a meowing sound "nya", and the meowing sound "nya" includes those with a plurality of intonations, and different motions are associated with each meowing sound. It is preferable to adopt such a configuration. Among the intonations, there is an interrogative intonation, and as the motion, it is preferable to include a motion of tilting the head.

[0222] <Regarding the communication function of the 3D character 1200> Supplement regarding the communication function of the 3D character 1200. By doing the following, it is possible to provide a higher-quality communication function with the 3D character 1200 to the viewer. Here, the actions of the person until they get used to it and the outline of the action story with the 3D character 1200 will be described. In this embodiment, a photographing unit for photographing the viewer is provided on the front side of the display device 1.

[0223] (1) First step: The stage until getting used to it Normally, there are various types of cats such as stray cats that run away just by seeing a person or run away when a person approaches. At that time, the cat's behavior seems to run away while looking at the person's appearance while looking back several times. Here, the control unit 70 recognizes the presence of the viewer based on the photographed image photographed using the photographing unit, and when the intensity of the microwave measured by the human sensor 64 exceeds the threshold value, it displays a video in which the 3D character 1200 performs an action of running away. This is to consider that a person has approached the cat. Recognizing the viewer with the photographing unit is to show the viewer the scene where the 3D character 1200 runs away. That is, unless the viewer approaches the display device 1 from the front side, the 3D character 1200 is prevented from performing the action of running away.

[0224] Next, it is considered that a person calls out to the cat, such as "Squat down (lower your eye level)" or "Come here, come here". Sometimes, there is a cat that stops and observes the situation. However, when the person approaches, the cat runs away. This is repeated several times. With such human behavior, it is thought that the cat will not get used to it. Therefore, during the period when the control unit 70 is displaying the video of the 3D character 1200 running away, when the intensity of the microwave measured by the human sensor 64 is below a certain threshold and, for example, a word indicating calling out to the 3D character 1200 such as "Come here" is recognized by voice recognition, the control unit 70 displays a video in which the 3D character 1200 performs an action of stopping. Here, the condition that the intensity of the microwave is below the threshold is because it is assumed that a human is in a standing still state.

[0225] Next, it may be considered that a person gives food to a stationary cat. However, when a person approaches the cat, the cat runs away, so it is considered that the only option is to place food in a place where the cat often comes. Therefore, the display device 1 has a function of displaying an image in which food is placed within the video display space. For example, when the control unit 70 receives a predetermined operation (e.g., an operation of the operation unit 41 or the operation unit 42), or when a predetermined gesture indicating placing food is detected by the gesture sensor 63, it assumes that food has been placed and causes an image showing the food to be displayed within the image. In this way, the viewer will, for example, place food every day. At this time, the control unit 70 may cause a display such that the 3D character 1200 is looking at the situation from afar. When the control unit 70 does not recognize the presence of the viewer using the human sensor 64 and the viewer is not being photographed by the photographing unit, the control unit 70 displays an image in which the 3D character 1200 eats the food. Here, a situation where the cat does not eat the food in front of people is reproduced. From the viewer's perspective, a situation is created where the food has disappeared without them noticing. The control unit 70 counts the number of times the viewer has given food and stores this. This state will continue for a while, but the control unit 70 may cause a display that gradually reduces the distance between the viewer, the 3D character 1200, and the person (the distance felt by the viewer) according to the number of times food has been given. For example, when starting to give food, as the number of times food has been given increases, the control unit 70 may display the 3D character 1200 larger to reproduce the reduction in distance (i.e., the viewer is getting a bit more used to it). Furthermore, when the number of times food has been given increases and reaches a predetermined threshold, assuming the cat has become accustomed, even when the viewer is looking at the character, that is, when the control unit 70 recognizes the presence of the viewer using the human sensor 64 and the viewer is being photographed by the photographing unit, the control unit 70 displays an image in which the 3D character 1200 eats the food. Only at this time can the viewer visually observe the 3D character 1200 eating the food.

[0226] However, it is not uncommon for people not to know when a cat will eat. Therefore, the control unit 70 may determine the time period (alternatively, it may be a specific time point) when the 3D character 1200 eats food, and display an image of the 3D character 1200 eating food during that time period. This is to make the viewer notice that it seems the 3D character 1200 eats food during this time period. When it is detected that the viewer tries to touch the 3D character 1200, the control unit 70 causes the 3D character 1200 to output a voice of a predetermined utterance "Shah" or "Shashar", and displays an image of the 3D character 1200 running away. The viewer's attempt to touch the 3D character 1200 may be identified when the intensity of the microwave detected by the human sensor 64 exceeds a threshold value or the first sensor 2331 detects a predetermined gesture while the 3D character 1200 is performing an action of eating food.

[0227] Such a situation continues for a while, but the control unit 70 may gradually reduce the distance at which the viewer's hand can approach the 3D character 1200. When it approaches a predetermined distance, the control unit 70 may display an image of the 3D character 1200 performing an action of grooming or relaxing in front of people, assuming that the 3D character 1200 has become accustomed to the viewer. Specifically, the control unit 70 increases the threshold value for the intensity of the microwave or increases the threshold value for the distance from the display device 1 when a gesture is made. In this way, the control unit 70 reduces the detection sensitivity, dulls the reaction of the 3D character 1200 to the viewer's movement, and also stops causing utterances such as "Shah" or "Shashar".

[0228] The cat is always vigilant, but also engages in actions such as grooming, lying down, scratching its claws, and wiping its face. As the cat gradually gets used to people and human hands, people will be able to touch the cat with their hands. Therefore, the control unit 70 may not reflect the detection result of the microwave by the human presence sensor 64 in the operation of the 3D character 1200. The control unit 70 may cause the first sensor 2331 to function as a motion sensor and display a video in which the 3D character 1200 looks comfortable when being stroked according to the detection result of gestures in the up, down, left, right, front, and back directions of the viewer. The control unit 70 may further recognize the voice of the viewer by the microphone 61 and display a video in which the 3D character 1200 reacts to it. For example, no matter what words are recognized, the control unit 70 may make the 3D character 1200 emit a meowing sound of "nya" as the speech content.

[0229] As time passes, the control unit 70 may display a video in which the 3D character 1200 begs for food. When the shooting unit recognizes the presence of the viewer and the human presence sensor 64 detects the presence of the viewer, the control unit 70 may determine the time zone (for example, morning, noon, evening) and make the 3D character 1200 emit a meowing sound of "nyanyanya" and display a video of the 3D character 1200 rubbing its face. Furthermore, when the viewer talks to the 3D character 1200, the control unit 70 may reproduce the state in which the 3D character 1200 remembers its own name. For example, the control unit 70 may only react to the word "Yuno" and make the 3D character 1200 emit a meowing sound of "nya", or react to calls such as "Yuno" and "Food!" and display a video in which the 3D character 1200 acts coquettishly or rubs itself happily.

[0230] (2) Second step: The stage of learning the language (Japanese) When the control unit 70 recognizes a call by a viewer named "Uno" at a certain time, it outputs a voice indicating a response of "What?". From here, it enters the stage where the 3D character 1200 learns words. The control unit 70 counts the number of times it has been called, takes the cumulative average per day, and responds according to a value calculated by the cumulative average per day of the number of times food has been given × the cumulative average of the number of times it has been called × a random coefficient (hereinafter referred to as the "cumulative average value"). This call is a predetermined call such as "Good morning", "Good afternoon", "Good evening", "Are you okay?", "Do you want food?", etc. The control unit 70 stops responding (that is, reproduces the situation where the 3D character 1200 has forgotten words) or increases the words to respond according to the cumulative average value. For example, the control unit 70 may decrease the words to respond as the cumulative average value becomes smaller, and increase the words to respond as the cumulative average value becomes larger. The cumulative average value is calculated based on the number of times it has been called from the start time of using the display device 1 to the current time, but it may also be calculated based on the number of times it has been called from a time point retroactively a predetermined period from the current time to the current time. The predetermined period may be fixed, such as one month, or when the display device 1 has not been used for a certain period, it may be the period after the start of use after that period. At the beginning when the use of the display device 1 starts, the cumulative average value can change greatly. For example, if the viewer does not call even once a day, the 3D character 1200 may stop responding, but as the number of calls increases, the cumulative average value will not change much. In this way, it is possible to reproduce the state where it takes time for the 3D character 1200 to forget words. The random coefficient used in calculating the cumulative average value is a value for reproducing the capriciousness of a cat and may be called a capriciousness coefficient. The random coefficient may be changed by the actions of the 3D character 1200 and the viewer, such as giving / not giving food when the character 1200 begs for food, or taking actions such as calling or touching to wake up the 3D character 1200 when it is sleeping.

[0231] When the cumulative average value further exceeds a certain threshold, the control unit 70 may be configured to talk to the viewer from the 3D character 1200 or respond to questions regarding predetermined information such as weather, news, etc. Of course, when the number of times the viewer feeds the character decreases, the cumulative average value decreases, so the control unit 70 may reduce the type of response or stop responding. That is, if the viewer feeds the character in a sloppy manner or does not appropriately talk to the character, the function for the 3D character 1200 to respond may not be maintained, or even if it is maintained, there may be cases where it does not respond due to "capriciousness". In the above manner, a higher-quality communication function with the 3D character 1200 can be provided to the viewer.

[0232] The following may also be done.

[0233] For example, in a lenticular display, the image may become non-stereoscopic just by moving the eye position several centimeters to the right or left from the position where the image appears three-dimensional. In this case, there is a risk that the viewer may give up thinking that "the image does not appear three-dimensional". Considering this point, the control unit 70 may control to issue an instruction such as "try moving 3 centimeters to the right when I appear to be two people" based on the detection result of the human sensor 64, for example. By doing so, it is possible to suppress the viewer from getting bored due to the image not appearing three-dimensional. The instruction may be output as sound from the speaker 62, for example. Also, the timing of issuing the instruction may be the timing when the human sensor 64 recognizes the transition from a state where there is no one around the display device 1 to a state where there is someone. Also, the timing of issuing the instruction may be the timing when an unregistered person is recognized, or it may be a regular timing.

[0234] Also, for example, when the display device 1 is capable of executing physical calculations regarding the operations of a plurality of parts of the character, when a specific part of the character (for example, the chest) is relatively small, it is advisable not to execute the physical calculations regarding the operation of the specific part.

[0235] In addition, while adding motion to the character's body, it is preferable not to add motion to the character's clothes and to control the clothes to move by physical calculation according to the movement of the character's body. By doing so, the amount of calculation in the physical calculation can be reduced.

[0236] Further, for example, the control unit 70 may display an object for indicating whether or not voice recognition is in progress on the image display unit 20. For example, in the image display unit 20, display control may be performed such that an image imitating a lamp lights up only during voice recognition. The object may be displayed, for example, on the back side of a specific character so as not to be conspicuous at the edge of the display area of the image display unit 20 (with relatively inconspicuous brightness, color, shape, size, etc.).

[0237] Further, for example, the control unit 70 may display the phrase (sentence) recognized by voice recognition on the viewer's viewpoint side (front side) rather than the object of a specific character for a predetermined time after voice recognition and make it non-displayed after the elapse of the predetermined time (see FIGS. 29 to 35). Then, after the phrase (voice recognition result) is made non-displayed, the character may be controlled to speak.

[0238] In addition, when a three-dimensional image in which a character exists on the stage is displayed, the control unit 70 may display a character with a relatively small length in the depth direction (for example, a humanoid character) on the front side of the stage rather than in the center of the stage, while displaying a character with a relatively large length in the depth direction (for example, a cat character) in the center of the stage. Further, for example, when a humanoid character is displayed, display control may be performed to emphasize the length of the stage itself to create a sense of depth.

[0239] In addition, when the control unit 70 displays an image of a character at a position other than the center of the stage (for example, a position on the front side), when displaying an image in which the character rotates, the stage may also be displayed to rotate in the same manner as the character.

[0240] Also, a stage having a shape with a relatively large distance in the depth direction may be displayed, and an image in which a character moves along the outer edge of the stage inside such a stage (for example, an image in which a cat character walks along the outer edge of a circular stage) may be displayed.

[0241] Also, when making the character perform a walking motion, it is preferable that an image in which the character stamps its feet in place and does not substantially move the overall position of the character is drawn without drawing a stage or the like (including roads, etc.). And when the character performs an operation other than the walking operation, it is preferable that a stage or the like is drawn at the feet of the character.

[0242] [Modification Example] As described above, an example of an embodiment of the present invention has been described. However, the present invention is not limited to the above-described embodiment, and various modifications are possible. For example, the following modification examples may be implemented.

[0243] (1) For example, in the display device 1 according to the above-described embodiment, it is preferable that a plurality (for example, two) of light-dimming members 30 are detachably provided. In this way, the brightness and floating feeling of the image displayed on the image display unit 20 can be adjusted without providing a separate adjustment member.

[0244] (2) Also, in the display device 1 according to the above-described embodiment and each modification example, in addition to the light-dimming member 30 (see FIG. 6) inclined with respect to the bottom surface of the housing 10, a light-dimming member arranged perpendicular to the bottom surface of the housing 10 may be further provided.

[0245] (3) Also, in the above embodiment, the gesture sensor 63 (an example of a behavior detection sensor) is disposed on the inner peripheral surface of the housing 10 facing inward of the housing 10 (see FIG. 6), but it is not limited thereto. For example, the gesture sensor 63 (specifically, the detection surface of the gesture sensor 63) may be disposed obliquely forward and downward at the upper part of the opening 5. In this way, even when a gesture is made by a viewer outside the opening 5, the gesture can be detected.

[0246] (4) Further, for example, in the display device 1 according to the above embodiment and each modification, a transmissive display capable of adjusting the transmittance (or transmittancy) may be further provided. The transmissive display may be provided, for example, on the front side (frontward side) of the light-shielding member 30 in the internal space 100 of the housing 10. In particular, the transmissive display may be disposed obliquely in the same manner as the light-shielding member 30.

[0247] Alternatively, instead of the transmissive display, a film capable of adjusting the transmittance (or transmittancy) may be provided. In this way, an effect can be achieved such that the three-dimensionally displayed character gradually begins to be visible.

[0248] (5) Further, in the display device 1 according to the above embodiment and each modification, a panel (so-called face fitting panel) capable of fitting the face of a viewer may be provided near the opening 5. The panel may be installed at a position where naked-eye stereoscopic viewing is possible. Also, a picture may be drawn on the side of the panel facing the housing 10, and the face of the viewer may be photographed while the viewer fits his or her face into the panel. Then, a mechanism may be provided such that the photographed image is uploaded to an SNS (Social Networking Service) as "you when looking at me".

[0249] (6) Also, it is preferable to use a stereoscopic display device without glasses that outputs an instruction to move the head left and right to a position where an image can be clearly seen (also referred to as clearly) with one eye closed, and to open both eyes at a position where an image can be clearly seen with one eye closed. Further, when the image appears double when both eyes are opened at a position where an image can be clearly seen with one eye closed, it is preferable to use a stereoscopic display device without glasses that outputs an instruction to close one eye again, move further to the left or right, and open both eyes at a position where an image can be clearly seen.

[0250] (7) Also, it is preferable to use a system that includes the display device 1 according to the above-described embodiments and each modified example, and includes a printed matter on which phrases recognizable by voice by the display device 1 are printed. Further, it is preferable to use a system that enables the printed matter on which phrases recognizable by voice by the display device 1 are printed to be installed near the display device 1 together with the display device 1.

[0251] (8) Also, it is preferable to use a system characterized by including a display device 1 with a built-in voice recognition device and having voice directivity in a specific direction (for example, the front direction), and arranging the same display device in the direction opposite to the specific direction. For example, it is preferable to arrange the two display devices 1 such that the openings 5 of the two display devices 1 face each other in the opposite direction. In this way, for example, it is possible to avoid the situation where, in one display device 1 (specifically, the microphone 61 of the display device 1), the voice of a person using the other display device 1 or the voice output from the speaker 62 of the other display device 1 is input.

[0252] (9) Also, as the display method of the image display unit 20, in addition to the autostereoscopic display methods such as the lenticular lens method and the parallax barrier method, a display method that can be recognized as a three-dimensional video using glasses may also be used. The housing of the display device 1 may have a rectangular parallelepiped shape, a cubic shape, a cylindrical shape, other polyhedral shapes, a spherical shape, or other shapes. Also, the shapes, structures, dimensions, colors, patterns, arrangements, etc. of the respective components of the display device 1 described above are merely examples. Also, some of the components included in the display device 1 described above may be omitted, or other components may be added. Although the display device 1 may be a stationary display device, it is also conceivable to make it a portable type or a head-mounted type or a glasses type configured to be wearable on the head of the viewer. In such a case, as the dimming member, it is preferable to arrange a common (single) dimming member on the optical paths of the image light of the image viewed by the viewer's left eye and the image light of the image viewed by the right eye. The opening 5 does not have to be square when viewed from the front side, and may be formed in a circular shape or other shapes. The image display unit 20 may be an image display unit using an organic EL, a digital mirror device, or other display elements as the display element. Even if the image display unit 20 is a display device having a light source other than a backlight, if there is a possibility that light leakage from the light source can be visually recognized, the presence of the dimming member can improve the floating feeling that can be given to the viewer.

[0253] (10) The display device 1 may have one or more display units other than the image display unit 20. For example, as the second image display unit, a display unit may be provided on the whole or a part of the floor of the internal space 100 so that the display surface faces upward (for example, vertically upward). The second image display unit is, for example, a liquid crystal display, but may also be a display unit of other types. The control unit 70 may control the display of one or more display units other than the image display unit 20. In this case, a stage video may be displayed on the second image display unit, and a 3D character may be displayed on the image display unit 20. In this way, an effect using an image can be performed on the floor of the internal space 100. Further, instead of the second image display unit, an effect on the floor may be performed using a light emitter (for example, a light-emitting diode), a light guide member, and a light-shielding member. In this case, the light guide member is arranged on the floor of the internal space 100, and a light-shielding member corresponding to a predetermined pattern (for example, a magic circle) is arranged on the light guide member. When the light of the light emitter is incident on the light guide member, light is emitted upward from the region of the upper surface of the light guide member where the light-shielding member is not arranged, and the viewer can see this.

[0254] (11) In the above embodiment, voice recognition for interacting with the character displayed on the image display unit 20 is enabled in response to the pressing operation of the operation unit 41, but it is not limited to this. For example, when the presence of a person is detected in the detection target area of a human sensor (an example of detection means) such as an omnidirectional microwave Doppler sensor, the overall control unit 73 may enable the voice recognition. In this way, when the user interacts with the character displayed on the image display unit 20, for example, there is no need to perform an operation for enabling voice recognition or utter a trigger word, and communication can be reproduced more naturally.

[0255] At this time, for example, it is preferable that both the voice recognition in the voice recognition application in the display device 1 and the voice recognition in the voice recognition server are enabled. However, as described below, the activation of the voice recognition in the voice recognition application in the display device 1 and the activation of the voice recognition in the voice recognition server may be executed step by step. For example, when the presence of a person is detected in the detection target area such as the human sensor, the voice recognition in the voice recognition application in the display device 1 is activated, and then, when a greeting or a call from a viewer is detected by the voice recognition application, the voice recognition in the voice recognition server may be activated.

[0256] Further, when the display device 1 includes a photographing unit (an example of detection means) such as a camera, a detection target space is provided on the front side (the opening 5 side) of the display device 1, and the overall control unit 73 may activate voice recognition when the presence of a person is detected on the front side of the display device 1. In this way, it is possible to more reliably determine that the viewer is trying to talk to the character displayed on the image display unit 20 and then activate the voice recognition.

[0257] Furthermore, after a person is detected in the detection target area, it is preferable that the overall control unit 73 is configured to activate the voice recognition on the condition that the user authentication is successful. Note that the authentication method for user authentication may be, for example, an authentication method that does not require a user's manual operation (such as face authentication or vocal cord authentication). In this way, for example, when user authentication is performed on a person other than the registered user registered in the display device 1 and the user authentication fails, the voice recognition is not activated and the user cannot talk to the character displayed on the image display unit 20. Conversely, for a person other than the registered user, the character displayed on the image display unit 20 does not show a reaction. Thereby, the user's attachment to the character can be increased.

[0258] In addition, when voice other than the words pre-registered in the display device 1 or the dialogue server mounted on the external server is detected, the voice recognition may not be activated.

[0259] Also, as a means for enabling voice recognition, a smell sensor may be used. For example, the smell of the registered user of the display device 1 may be registered in the display device 1 in advance, and when the smell of the registered user is detected by the smell sensor, voice recognition may be enabled.

[0260] Also, even if voice recognition is enabled in this way, for example, instead of immediately outputting the voice of the character (e.g., 3D character 1100) displayed on the image display unit 20, it is preferable that the voice of the character is not output unless the user addresses the character. For example, the overall control unit 73 does not immediately output the character voice of "Welcome home" in response to the enabling of voice recognition, but outputs the character voice of "Welcome home" on the condition that the user voice of "I'm home" is detected in the state where voice recognition is enabled. Furthermore, for example, in an interactive system, it is preferable that a branching scenario for reproducing the following interaction between the viewer and the character (e.g., 3D character 1100) is created. For example, on weekdays, User: I'm home Character: Welcome home~ User: Achoo Character: You must be tired in the hot weather such an interaction is reproduced, and on holidays, User: I'm home Character: Ah, welcome home User: Achoo Character: Don't complain since you went out in the hot weather User: It's work, it's work Character: If that's really the case, sorry, you've been working hard it is preferable that a branching scenario is created so that an interaction such as the above is reproduced.

[0261] Also, a branching scenario according to the detection result by the smell sensor may be created. For example, User: I made delicious food~ Character: "Er, let me smell. Hmm. Nice smell!" or "Hm!? Isn't it too salty? Be careful of your body!" Dialogue like this may be reproduced.

[0262] Also, as another example, when an odor is detected by an odor sensor, Character: Hmm, what's this smell? User: I burned some aromatherapy. Character: Ah, no wonder I felt relaxed. Dialogue like this may be reproduced. If the response content of the viewer to the question about the type of odor is not registered in the branching scenario, for example, a voice such as "Oh, really!" may be uniformly output as the character voice.

[0263] (12) Also, the overall control unit 73 may always record the voice for a recent predetermined time (for example, about 15 seconds), and when the voice of a trigger word for enabling voice recognition is detected, enable the voice recognition. For example, the voice recognition application of the display device 1 may be always (or in response to a pressing operation of the operation unit 41, etc.) enabled, and the voice recognition by the voice recognition server may be enabled by the detection of the trigger word. And at this time, the overall control unit 73 (specifically, the communication control circuit 706) may transmit the voice data of the voice obtained by removing the voice of the trigger word from the detected voice (for example, the voice detected between the detection start time and the detection end time) detected by the microphone 61 (an example of the voice detection means) to the voice recognition server. For example, assume that user voice such as "I'm going to Tokyo tomorrow, but can you tell me the weather, Raytan?" is detected. Here, "Raytan", which is the pet name of the 3D character 1100, is the trigger word. In this case, the overall control unit 73 transmits the voice "I'm going to Tokyo tomorrow, but can you tell me the weather, Raytan?" obtained by removing the voice of the trigger word "Raytan" from the detected voice "I'm going to Tokyo tomorrow, but can you tell me the weather, Raytan?" to the voice recognition server.

[0264] Here, for example, if the detected voice "I'm going to Tokyo tomorrow, but please tell me the weather, Raytan" is sent to the speech recognition server as it is, due to the inclusion of "Raytan" in the speech recognition result, the character voice corresponding to the speech recognition result may not be accurately extracted in the dialogue server, and there is a risk that the dialogue with the user will not match. On the other hand, if it is done as described above, even when the trigger word is uttered in the middle of a sentence, the voice data of the voice excluding the trigger word is sent to the speech recognition server. Therefore, it is possible to suppress the situation where the dialogue with the user does not match due to the speech recognition being performed with the trigger word included in the middle of a sentence.

[0265] (13) Also, when reproducing the dialogue between the user and the character displayed on the image display unit 20 by cooperation with the speech recognition server, the following operations may be executed according to the configuration of the speech recognition server.

[0266] For example, when the speech recognition server is configured to start the speech recognition process after receiving the voice data file, the overall control unit 73 may separately send each voice data file of the voice before and after the trigger word in the detected voice by the microphone 61 to the speech recognition server. For example, among the detected voices from the detection start time to the detection end time, the voice data file of the user voice detected before the voice of the trigger word (also referred to as the first half of the user voice) may be sent to the speech recognition server ahead of the voice data file of the user voice detected after the voice of the trigger word (also referred to as the second half of the user voice).

[0267] In this way, in the speech recognition server, the speech recognition process for the first half of the user's speech starts without waiting for the reception completion of the speech data file of the second half of the user's speech. Therefore, compared with the case of transmitting the speech data file of the speech combining the first half of the user's speech and the second half of the user's speech to the speech recognition server, the speech recognition process can be efficiently performed. As a result, the display device 1 can receive the character speech from the dialogue server earlier, and can shorten the waiting time of the user until being responded to the user's speech.

[0268] Also, for example, when the speech recognition server is configured to perform the speech recognition process in real time by streaming and playing back the speech data from the display device 1, when the first half of the speech data is transmitted to the speech recognition server in real time, it is preferable to control the playback speed T1 of the first half of the user's speech to be faster than the standard playback speed T0 (T1>T0). For example, the overall control unit 73 changes the setting so that the first half of the user's speech is played back 25% faster than the standard playback speed T0 in the speech recognition server and transmits the first half of the speech data. In this way, in the speech recognition server, compared with the case where the first half of the user's speech is played back at the standard playback speed T0, the speech recognition process for the first half of the user's speech can be terminated earlier, and the speech recognition process for the second half of the user's speech can be started earlier. As a result, the display device 1 can receive the character speech from the dialogue server earlier, and can shorten the waiting time of the user until being responded to the user's speech.

[0269] Furthermore, when the voice data of the latter half of the user voice is transmitted to the voice recognition server in real time, it is preferably controlled such that the playback speed T2 of the voice in the latter half is faster than the standard playback speed T0 and slower than the playback speed T1 of the user voice in the first half (that is, the relationship of T0 < T2 < T1 is satisfied). For example, the overall control unit 73 changes the setting so that the user voice in the latter half is played back 10% faster than the standard playback speed T0 in the voice recognition server and transmits the voice data of the latter half. In this way, both the user voice in the first half and the user voice in the latter half are streamed and played back faster than the standard playback speed T0, and voice recognition processing is executed in the voice recognition server. As a result, the waiting time of the user until a response is made to the user's voice can be further shortened. On the other hand, the user voice in the latter half is played back at a speed faster than the standard playback speed T0 but slower than the playback speed T1 of the user voice in the first half. Therefore, a decrease in voice recognition accuracy in the voice recognition system can be suppressed. Therefore, it is possible to further shorten the waiting time of the user while suppressing a decrease in voice recognition accuracy.

[0270] In addition, in the voice recognition server, when voice recognition processing by streaming playback of voice data is executed in real time, for example, although the user voice detected by the microphone 61 is transmitted to the voice recognition server in real time, it is preferably controlled such that voice recognition in the voice recognition server is not started until the voice of the trigger word is detected.

[0271] [Other extension examples, etc.] The above-described embodiments and each modification are illustrative, and it goes without saying that partial substitution or combination of the configurations shown in the above embodiments and each modification is possible, and each component described in the above embodiments and each modification may be arbitrarily combined. For example, the control unit 70 may execute any one of the processes in the above-described embodiments and each modification and other processes in parallel (for example, by multitasking or the like).

[0272] In addition, the invention described in the means for solving the problems and each component may be further applied to the combinations of the components in the above embodiments and each modification example. For the same operational effects due to the same configurations of a plurality of embodiments and a plurality of modification examples, they will not be sequentially mentioned for each embodiment and modification example. Furthermore, the present invention is not limited to the above-described embodiments. For example, it will be obvious to those skilled in the art that various changes, improvements, combinations, etc. are possible.

Explanation of Reference Numerals

[0273] 1 Display device 5 Aperture 10 Housing 11 Main body portion of the housing 12 Upper cover portion 20 Image display portion 30 Dimming member 40 Operation portion 61 Microphone 62 Speaker 63 Gesture sensor 64 Human presence sensor

Claims

1. A display device for displaying an image, a housing having an opening for viewing the image on a first direction side in a light-shielded internal space; An image display unit disposed in the internal space; a light-reducing member disposed on the first direction side of the image display unit at a distance from the image display unit; a transparent display or a member capable of adjusting a transmittance, the transparent display or the member being provided on the first direction side of the light reducing member in the internal space; A display device comprising:

2. The surface of the attenuating member on the first direction side and the transmissive display or the member capable of adjusting the transmittance are all inclined with respect to the display surface of the image display unit. The display device according to claim 1 .

3. In addition to the dimming members arranged at an angle, another dimming member arranged vertically is further provided. The display device according to claim 1 .

4. A plurality of the light-reducing members are provided detachably. The display device according to any one of claims 1 to 3.

5. The display device includes a member capable of adjusting the transparency, and the member capable of adjusting the transparency is controlled so that the character displayed on the image display unit gradually becomes visible. The display device according to any one of claims 1 to 4.

6. The light-reducing member is disposed at an angle, and an image of a character sliding on the surface of the light-reducing member disposed at an angle is drawn. The display device according to any one of claims 1 to 5.

7. The image display unit displays a first image, at least a portion of which is recognized to be present on the opening side of the light reducing member, as an image recognized as a three-dimensional image. The display device according to any one of claims 1 to 6.

8. The image display unit selectively displays, as an image recognized as a three-dimensional image, one of a plurality of images including the first image and a second image recognized as existing on the first direction side of the first image or on the second direction side opposite to the first direction side. The display device according to claim 7.

9. The device further includes an audio output unit provided in the housing, The audio output unit is provided on a first surface of the housing facing the internal space, the first surface being closer to the first direction than the light-reducing member and at a position where the distance between the light-reducing member and the opening is smaller than the distance between the light-reducing member and the opening. The display device according to any one of claims 1 to 8.

10. an upper end of the opening is provided above an upper end of a display surface of the image display unit, The upper surface of the internal space is inclined downward from the upper end of the opening to the upper end of the display surface. The display device according to any one of claims 1 to 9.

11. An upper end of the opening protrudes further in the first direction than a lower end of the opening. The display device according to any one of claims 1 to 10.

Citation Information

Patent Citations

  • Picture embossing display device

    JP1998062717A

  • Display

    JP2000219060A

  • Stereoscopic image display device with no glasses

    JP2003295113A

  • Stereoscopic two-dimensional image display device and its method

    JP2005141102A

  • Image display device

    JP2010277019A