Display device

Abstract

To enhance the visual effect of a display device.SOLUTION: A display device 1 is provided, comprising a housing 100 having a shielded image display space therein and an image viewing area SC provided on a first direction side of the image display space, and an image display unit configured to form a floating image in the image display space.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to a display device and the like. [Background technology]

[0002] Patent Document 1 describes a stereoscopic image display device that does not require special glasses. The image display device comprises a light source, a liquid crystal display panel, and a display unit disposed on the viewer side of the liquid crystal display panel. It is equipped with a parallax barrier. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2003-295113 Summary of the Invention [Problem to be solved by the invention]

[0004] The object of the present invention is to provide a display device that is more visually appealing than conventional displays, for example. It's about providing something excellent.

[0005] The object of the present invention is not limited to this, and the configuration disclosed in the specification and drawings etc. The right to obtain the effect of the configuration obtained from the above can be obtained by divisional application, amendment, etc. For example, in this specification, the phrase "can do" should be changed to "the problem is that..." The present specification discloses a problem in which the above-mentioned phrase "there is a problem" is replaced with "there is a problem" and the problem is considered to be independent of each other. The configurations for solving each problem are described separately. The applicant intends to obtain rights by filing an application, amendment, etc. The problem is implicitly understood from the description of the specification. Although the present applicant intends to incorporate some of the features described in this specification into a patent application, the applicant may file an amendment or divisional application. The scope of the claims is intended to be a solution to a problem that combines these independent problems. The structure has also been disclosed, and we intend to acquire the rights. [Means for solving the problem]

[0006] (1) a video display unit that displays an aerial video; a shielding section provided on a front side of the image display section and shielding the front side of the image display section; It is preferable to provide a display device having:

[0007] In this way, when the user looks from the front side of the shielding portion, the image displayed by the image display portion is This does not refer to the aerial image itself displayed by the image display unit, but rather to the aerial image displayed by the image display unit. For example, if the components that make up the image display unit are not directly visible to the user, For example, when an aerial image is displayed by the image display unit, it is possible to reduce the possibility of the image being seen by the viewer. Therefore, it is possible to make it difficult for the user to realize that the information is being used. The mechanism by which the aerial image is displayed to the user is revealed, and the user is unable to see the aerial image. This helps prevent people from being disappointed by the statue.

[0008] The front side of the image display unit may be shielded entirely, but It is advisable to have a structure that blocks a part of the front side. It is also possible to shield the image from the outside, but it is preferable to shield a predetermined range from the edge of the aerial image. It is good. In this way, the end of the image display unit is shielded by the shielding unit, so that the user can see the image. This prevents the user from seeing the components at the edge of the display unit, and allows the user to see the aerial image. This will further reduce the risk of being disappointed by the content.

[0009] The shielding may be configured to completely block the view, or may be configured to limit the transmission of light to make the view less visible. The shielding part should be made of a dimming material that limits the transmission of light and makes it difficult to see. If such a light-reducing member is used in the shielding portion, the light-reducing member reduces external light, Since the floating image is displayed in a relatively dark space, the floating image that can be presented to the user is It can enhance the sensation. For example, the aerial image displayed on the image display unit is in the range of the user's viewpoint. The area within which the light that constitutes the aerial image passes is the area from the point of view of the camera to a position within a predetermined range. For example, the user may look into the video display unit located below the user's viewpoint. In such cases, it is advisable to include the area below the user's viewpoint. For example, an aerial image should be an image that looks as if it is in the air. For example, the image on a semi-transparent display is a real image. It is also possible to use a device that is visible on the panel, but it is particularly preferable to use a device that has an optical element in front of the image on the display screen. The optical members may include mirrors, lenses, prisms, optical films, etc. It is recommended to combine at least two of the following: Bikora and Lala. For example, the aerial image may be a mirrored image or an image that can be viewed stereoscopically with the naked eye. stomach. The aerial image may be, for example, a real image, but it is preferable to use a virtual image. Although the image may be a two-dimensional image, it is particularly preferable to use a three-dimensional image. It is preferable that different images are visually recognized. The front may be, for example, the lower front of the video display unit. In this way, the displayed image will not appear cut off due to the shape of the bottom edge of the image display unit. For example, if the image display section is a typical rectangle and one side of the image display section is For example, the image display section is configured to extend from an area above the bottom edge toward the bottom edge. When an image is displayed on the screen, it appears to be cut off sharply in a straight line at the bottom of the image display area. For example, if you want to place a character closer to the bottom edge, When the image is displayed from the top area to the bottom edge, the character will be switched at the bottom edge. This can prevent the display from appearing as if it has been cut off. Alternatively, the front may be, for example, the front right and front left of the image display unit. In this way, for example, when a character is displayed on the video display unit, the video display The character displayed in the image is sandwiched between the occluded parts on both sides, giving the user a sense of three-dimensionality. This can provide a visual effect of the video display unit. As the display device, for example, a video display unit includes a display unit that emits image light and a display unit that displays a video based on the image light. and an optical element for forming the aerial image based on the optical element.

[0010] (2) The shielding unit includes a housing that houses the image display unit and has an opening formed on the front side. It is good to have this configuration.

[0011] In this way, the user can enjoy the aerial image displayed by the image display unit housed in the housing. The image is blocked by the area surrounding the opening of the housing formed on the front side of the housing. The housing is designed to block external light from entering the image display unit from other than the opening of the housing. For example, the opening allows external light to enter the image display unit, but other If other openings are provided, the openings must be kept away from the It is best to have a structure that prevents external light from entering, so that the aerial image is displayed in a relatively dark space. This increases the sense of three-dimensionality of the aerial image that can be provided to the user.

[0012] (3) The image display unit includes a display unit that emits image light and a display unit that displays the aerial image based on the image light. It is preferable to have a configuration including an optical member for forming an image.

[0013] In this way, the floating image formed on the optical element appears to float in a predetermined space. This gives the user the feeling that they are actually using the device.

[0014] The optical member preferably has optical transparency and reflectivity. In this way, the user can superimpose the aerial image formed on the optical member onto the aerial image formed on the optical member. Since the user can observe the side opposite to the side on which the image is formed, This can further enhance the three-dimensionality of the aerial images that can be produced. The optical member is preferably a half mirror, and is preferably made of an acrylic mirror. is more preferable.

[0015] (4) a display unit moving means for moving the position of the display unit; It is preferable to include an optical member moving means for moving the position of the optical member.

[0016] In this way, the display unit and the optical member can be moved in accordance with the user's position relative to the housing. By moving the position of the optical element relative to the object, the aerial image formed on the optical element can be viewed by the user. It can be positioned in a position that is easy to see. The direction position can be adjusted.

[0017] The display unit is moved by the display unit moving means, and the optical member is moved by the optical member moving means. The operation of moving the optical member may be, for example, a slide operation by the user. Preferably, the user may perform a rotation operation. For example, the user's slide operation or rotation operation may be performed by a display unit moving means or an optical member moving means. It is preferable to provide a structure for transmitting the force of the user's slide operation to at least one of the steps. The rotation operation is directly performed by at least one of the display unit moving means and the optical member moving means. Although it may be possible to have a structure in which the force is transmitted indirectly via various mechanical elements, In particular, the direction of the user's operation and the direction of movement of the display unit moving means or the optical member moving means may be For example, the user's operation may be converted into a direction by rotating a steering wheel. The display unit moving means or the optical member moving means is configured to move the display unit around the first rotation axis. One of the first and second rotation axes is rotated around the second rotation axis to move the first and second rotation axes. It is preferable that the axis is not parallel to the rotation axis of the It is recommended to use a configuration like this. The position of the display unit and the position of the optical member are moved by the user's operation on one operation unit. It is advisable to design the structure so that both actions are carried out simultaneously. In this way, the user can rock both the display unit and the optical member in a single motion. It can be done.

[0018] (5) The display unit moving means moves the display unit forward from a position on the far side of the opening of the housing. The device is configured to be swingably attached to the housing, The optical member moving means moves the optical member forward to a position on the rear side of the opening of the housing. It is preferable that the sensor be configured to be swingably attached to the housing.

[0019] In this way, the swing angle of the display unit and the optical member relative to the housing can be changed. This allows the user to place the aerial image in a position that is easy to view.

[0020] (6) In conjunction with the swing of the display unit, the optical member is moved in the same direction as the swing direction of the display unit. It is preferable to provide a linkage part that causes the swinging.

[0021] In this way, the interlocking portion controls the swing angle of the display portion and the optical member relative to the housing, The display unit and the optical member can be changed in conjunction with each other. The display unit and the optical member can be swung in a single movement. The optical members can be swung in conjunction with each other, so the display unit and the optical members can be swung separately. In comparison with a configuration in which the optical element moves, the aerial image is prevented from being formed at a position outside the optical element. do.

[0022] The rotation axis of the display unit and the rotation axis of the optical member are, for example, positioned on intersecting axes. However, it is better to have them on parallel axes, and it is preferable that they are on the same axis. The swing angle of the display unit and the swing angle of the optical member caused by the interlocking unit are, for example, the same angle. However, it is preferable that the swing angle of the display unit is larger than the swing angle of the optical member. More preferable. The linking unit links the optical member and the display unit by, for example, a pulley and a belt. The optical member and the It is preferable that the display unit is configured to swing in conjunction with the display unit.

[0023] (7) The rotation axis of the display unit and the rotation axis of the optical member should preferably be arranged on axes that do not intersect.

[0024] In this way, the display unit and the optical member are moved by swinging the display unit and the optical member. This can prevent the position of the aerial image from shifting when the lens is moved.

[0025] The rotation axis of the display unit and the rotation axis of the optical member are preferably arranged on parallel axes, and in particular on the same axis. The center line of the rotation axis of the display unit and the rotation axis of the optical member should be aligned. In this way, the display unit and the optical member are moved by swinging the display unit and the optical member. This can further prevent the position of the aerial image from shifting when the lens is moved.

[0026] (8) The interlocking part is a first rotation axis for simultaneously rotating the angle in response to an operation from a user; a second rotation axis for changing the angle of the display unit in accordance with the rotation of the first rotation axis; a third rotation axis for changing the angle of the optical member in accordance with the rotation of the first rotation axis; It would be good to do so.

[0027] In this way, the user only needs to perform one rotation operation to change the display screen in response to the rotation operation. The angle of the beam and the angle of the optical element can be changed.

[0028] The first rotation axis, the second rotation axis, and the third rotation axis are preferably parallel to each other. I wish. The distance between the first rotation axis and the second rotation axis and the distance between the first rotation axis and the third rotation axis Preferably, the distances are the same.

[0029] (9) The interlocking portion is a first gear attached to the first rotating shaft; a second gear attached to the first rotating shaft; a third gear that meshes with the first gear and to which the optical member is connected; The display unit may further include a fourth gear that meshes with the second gear and is connected to the fourth gear.

[0030] In this way, the rotational motion imparted to the first rotation shaft is transmitted to the optical member via the first gear. The power is transmitted to the third gear connected to the display unit, and is also transmitted to the fourth gear connected to the display unit via the second gear. The force is transmitted to the gear, causing the optical member and the display unit to swing in unison. The value obtained by dividing the radius of the second gear by the radius of the fourth gear is the radius of the first gear divided by the radius of the fourth gear. It is preferably greater than the value obtained by dividing the radius of the gear by 3, and more preferably twice the value. The value obtained by dividing the number of teeth of the second gear by the number of teeth of the fourth gear is the value obtained by dividing the number of teeth of the first gear by the number of teeth of the fourth gear. It is preferably larger than the value divided by the number of teeth of the third gear, and more preferably twice the value. stomach. The first rotating shaft, the shaft on which the third gear is attached, and the shaft on which the fourth gear is attached It is preferable that the device further includes a case member that supports the shaft. This will reduce backlash in each gear, and the display will operate more reliably. and the optical member can be swung in conjunction with each other.

[0031] The first gear, the second gear, the third gear, and the fourth gear are, for example, The swing angle of the display unit may be set to be the same as the swing angle of the optical member. The swing angle of the display unit is set to be larger than the swing angle of the optical member. Preferably, the swing angle of the display unit is set to about twice the swing angle of the optical member. It is more preferable that

[0032] (10) The first gear, the second gear, the third gear, and the fourth gear are It is preferable to set the swing angle of the display unit to be twice the swing angle of the optical member.

[0033] In this way, when the display unit and the optical member are swung in conjunction with each other, the optical member is It has been found by the inventors of the present invention that the aerial images captured look good.

[0034] (11) The interlocking part is a worm wheel attached to the first rotating shaft; and a worm that meshes with the worm wheel.

[0035] In this way, the interlocking part adjusts the swing angle of the display part and the swing angle of the optical member. Even after the worm wheel is turned, the rotation of the worm wheel that engages with the worm is suppressed, and the display and light This prevents the swing position of the optical member from changing.

[0036] (12) The interlocking portion may have an operating member connected to the worm.

[0037] In this way, the operator can operate the operation member to switch between the display unit and the optical member. They can be swung in the same direction in conjunction with each other. In addition, the worm wheel is rotated by the worm, so the rotation of the worm The rotational speed can be significantly reduced before being transmitted to the worm wheel, and the swing position of the display unit and optical components can be adjusted. You can fine-tune the position. Furthermore, after the operator adjusts the swing positions of the display unit and the optical member, the operator releases his / her hand from the operating member. Even if the worm wheel is engaged with the worm, the rotation of the worm wheel is suppressed, and the display and The swing position of the optical member is prevented from changing.

[0038] The two worms mesh with each other at different positions on the worm wheel, The operating members are connected to the two worms, respectively, and the operating members are connected to different parts of the housing. The structure may be such that the contact hole is exposed at a position. In this way, the user can select the operation that is easiest for the user depending on the user's position relative to the housing. By operating the operation member, the display unit and the optical member can be swung in unison. This improves user operability.

[0039] (13) The display unit and the optical member have a member to which both loads are applied, and the member It is advisable to provide a balancing member to adjust the balance.

[0040] In this way, in particular, both the display unit and the optical member can be moved and can be moved to the desired position. For example, the weight of the display and optical components can reduce wear on the structure that keeps the display in place. The moment on the left and right of the parts on which both loads are applied is different. In a configuration in which the material is a gear box having a gear for a display unit and a gear for an optical member, As a member for adjusting the balance, for example, at least one of the gears or gearboxes It is advisable to provide a biasing means such as a spring to adjust the balance of the box. The components for adjusting the position of the object play the same role as the balance weights in an equatorial mount. It is advisable to provide a component that can In order to adjust the balance, it is necessary to adjust the weight of the display unit and the optical member. It is preferable to adjust the loads so that both loads are equal.

[0041] (14) The balance member is The third gear is biased in a direction opposite to the direction in which the third gear rotates due to the weight of the display unit. a first biasing member; The fourth gear is attached to the side opposite to the direction in which the fourth gear rotates due to the weight of the optical member. Preferably, the biasing member is at least one of the first biasing member and the second biasing member.

[0042] In this way, the third gear and the fourth gear will rotate due to the weight of the display unit and optical components. As a result, the wear on the meshing part between the third gear and the first gear and the force on the fourth gear can be reduced. This can reduce at least one of the wear of the meshing portion between the gear and the second gear. Furthermore, the force required by the operator to operate the operation unit can be reduced. The first biasing member and the second biasing member may be, for example, rubber or a leaf spring. For example, a coil spring is preferable. The first and second biasing members are biased in a direction to press the third gear and the fourth gear. However, it is more preferable to pull and bias the third gear and the fourth gear. The biasing member is attached only to the gear attached to the heavier of the display unit and the optical component. In this way, the gear attached to the heavy side and the gear meshing with it can be Since only one biasing member is required, the weight and cost of the display device can be reduced. Reductions can be achieved. It is preferable that the interlocking portion has both a first biasing member and a second biasing member. In this way, wear of the meshing portion between the third gear and the first gear and wear of the meshing portion between the fourth gear and the second gear can be reduced. This can reduce both the consumption of the

[0043] (15) The shielding portion is configured to obscure the lower portion of the image display portion when the image display portion is viewed from the front. the image display unit is disposed in front of the image display unit at a distance so as to shield the image display unit, The shielding unit is configured to shield the image display unit from the user as the user approaches the image display unit. The upper surface of the image display unit is made visible so that a wider area of the image display unit can be seen. It is advisable to set the downward position and the distance from the video display unit.

[0044] In this way, the user can see the image with the lower part of the image display unit covered by the shielding unit. Therefore, the aerial image displayed on the image display unit can be viewed. This can prevent the middle image from appearing cut off by the shape of the bottom edge of the video display area. For example, if the object is displayed on the video display from an area above the bottom edge toward the bottom edge, This prevents the characters from appearing cut off at the bottom edge. As a result, the user feels as if the character displayed on the video display unit is right in front of them. You can feel the sense of realism. In addition, as the user approaches the video display unit, the user can see a wider range of the video display unit. For example, when a character is displayed on the video display unit, the user can As the user approaches the image display, the bottom of the character displayed on the video display becomes visible. This gives the user a sense of realism as if the character is actually right in front of them.

[0045] The image display unit may have a long side and a short side, and may be arranged with the long side facing up and down. In this way, for example, when a person is displayed on the video display unit, the person's head and other parts of the person can be clearly seen. This can prevent a part of the object from disappearing from the image display section. The horizontal length of the shielding portion is preferably longer than the horizontal length of the image display portion. stomach. In this way, the lower part of the image display unit is not left unobstructed by the shielding part, and the user By the user seeing the bottom part of the image display, it appears that the user is actually This further reduces the chance of losing interest if the player is not present in front of the camera. The shielding portion has a surface parallel to the image display portion and is larger than the thickness of the image display portion. It is good to have thickness. In this way, the user can see the occlusion as a counter or desk, and for example, When a character is displayed on the image display unit, the user can You can feel as if the target is actually standing in front of the counter or desk.

[0046] The inventions shown in (1) to (15) above can be combined arbitrarily. For example, the invention shown in (1) may be composed entirely or partially of at least one invention from (2) onwards. In particular, the invention shown in (1) should be configured to include at least a part of the above. ) It is preferable that the invention be an invention that includes at least a portion of the configuration of at least one of the following inventions. , (1) Extract any configuration from the inventions shown in (1) to (15) and combine the extracted configurations. The applicant of the present application intends to obtain rights to the invention including these configurations. In addition, even if there is a description such as "in the case of..." or "when...", it does not mean that in that case or at that time. These are not intended to be limiting examples of the configuration. and intends to acquire rights for configurations other than those listed above. Also, the order of the descriptions is not limited to this. Some parts have been deleted. The structure of the invention is also disclosed, and there is no intention to acquire the rights. It has. [Effects of the Invention]

[0047] According to the present invention, the visual effect of the display device can be improved.

[0048] The effects of the present invention are not limited to this, and the configurations disclosed in the present specification and drawings, etc. The effects achieved by the divisional application are also disclosed, and the configuration achieving these effects is also disclosed. For example, in this specification, it is written "can..." The parts that say "can do ~" are descriptions that clearly state the effect that can be achieved, and even if there is no description that says "can do ~", the effect can be achieved. Even without such a description, the effect of the configuration can be understood. exist. [Brief explanation of the drawings]

[0049] [Figure 1A] 1 is a diagram illustrating an overview of a display device according to an embodiment. [Figure 1B] 1 is a diagram illustrating an overview of a display device according to an embodiment. [Figure 1C] FIG. 1 is a diagram illustrating a character according to an embodiment. [Figure 2] 1 is a diagram showing an external configuration of a display device according to an embodiment; [Figure 3] 1 is a diagram showing an external configuration of a display device according to an embodiment; [Figure 4] 1 is a diagram showing an external configuration of a display device according to an embodiment; [Figure 5] 1 is a front view of a display device according to an embodiment; [Figure 6] FIG. 2 is a right side view of the display device according to the embodiment. [Figure 7] FIG. 1 is a left side view of a display device according to an embodiment. [Figure 8]1 is a plan view (top view) of a display device according to an embodiment. [Figure 9] FIG. 2 is a rear view of the display device according to the embodiment. [Figure 10] FIG. 2 is a bottom view of the display device according to the embodiment. [Figure 11] FIG. 2 is a rear view of the display device according to the embodiment with the rear cover removed. [Figure 12] FIG. 1 is a diagram illustrating an example of how a display device according to an embodiment is used. [Figure 13] 1A and 1B are diagrams illustrating the principle of display on a display device according to an embodiment. [Figure 14] FIG. 1 is a diagram illustrating an internal configuration of a display device according to an embodiment. [Figure 15] FIG. 1 is a diagram illustrating an internal configuration of a display device according to an embodiment. [Figure 16] FIG. 1 is a diagram illustrating an internal configuration of a display device according to an embodiment. [Figure 17] FIG. 1 is a diagram illustrating an internal configuration of a display device according to an embodiment. [Figure 18] FIG. 1 is a diagram illustrating an internal configuration of a display device according to an embodiment. [Figure 19] FIG. 1 is a diagram illustrating an internal configuration of a display device according to an embodiment. [Figure 20] FIG. 1 is a diagram illustrating an internal configuration of a display device according to an embodiment. [Figure 21] FIG. 1 is a diagram illustrating an internal configuration of a display device according to an embodiment. [Figure 22] FIG. 1 is a diagram illustrating an internal configuration of a display device according to an embodiment. [Figure 23] FIG. 1 is a diagram illustrating an internal configuration of a display device according to an embodiment. [Figure 24] FIG. 1 is a diagram illustrating an internal configuration of a display device according to an embodiment. [Figure 25] FIG. 1 is a diagram illustrating an internal configuration of a display device according to an embodiment. [Figure 26] FIG. 1 is a diagram illustrating an internal configuration of a display device according to an embodiment. [Figure 27] FIG. 1 is a diagram illustrating an internal configuration of a display device according to an embodiment. [Figure 28] 1A and 1B are diagrams illustrating a cause of a virtual image being displayed on a display device according to an embodiment. [Figure 29] 1A and 1B are diagrams illustrating causes of reflection in a display device according to an embodiment. [Figure 30] 1A and 1B are diagrams illustrating the principle of displaying a virtual image and suppressing reflections in a display device according to an embodiment. [Figure 31] 1A and 1B are diagrams illustrating a cause of a virtual image being displayed on a display device. [Figure 32] 1 is a front view of a display device according to an embodiment; [Figure 33] FIG. 2 is a control block diagram of a display device according to an embodiment. [Figure 34] 1A is a flowchart for reproducing communication related to smells, and FIG. 1B is a diagram showing a voice management table related to smells. [Figure 35] 10 is a flowchart for reproducing communication regarding frequency of stay. [Figure 36] 1A is a flowchart for reproducing communication related to a place of stay, and FIG. 1B is a diagram showing a voice management table related to a place of stay. [Figure 37] 1A is a flowchart for reproducing communication related to the number of visits, and FIG. 1B is a diagram showing a voice management table related to the number of visits. [Figure 38] 1A is a flowchart for reproducing communication related to stay time, and FIG. 1B is a diagram showing a voice management table related to stay time. [Figure 39] 1A is a flowchart for reproducing communication related to behavioral patterns, and FIG. 1B is a diagram showing a voice management table related to behavioral patterns. [Figure 40] 10 is a flowchart for reproducing an operation relating to the detection of a suspicious person. [Figure 41]FIG. 10 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. [Figure 42] FIG. 10 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. [Figure 43] FIG. 10 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. [Figure 44] FIG. 10 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. [Figure 45] FIG. 10 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. [Figure 46] FIG. 10 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. [Figure 47] FIG. 10 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. [Figure 48] FIG. 10 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. [Figure 49] FIG. 10 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. [Figure 50] FIG. 10 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. [Figure 51] FIG. 10 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. [Figure 52] FIG. 10 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. [Figure 53] FIG. 10 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. [Figure 54] FIG. 10 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. [Figure 55] FIG. 10 is a diagram illustrating an example of an image displayed on a display device according to an embodiment. [Figure 56] FIG. 2 is a plan view (top view) of an interlocking portion of the display device according to the embodiment. [Figure 57] FIG. 57 is a view taken along the arrow AA in FIG. 56. DETAILED DESCRIPTION OF THE INVENTION

[0050] The following embodiments will be described in detail with reference to the drawings. These are examples of embodiments of the present disclosure, and the present disclosure is not limited to these embodiments. In the drawings referred to in this embodiment, the same parts or parts having similar functions are indicated by the same reference numerals. The same or similar code (codes with A, B, etc. added after the number) is used, and the repetition In addition, in each drawing referred to in the following description, each member In order to make each area recognizable, the scale may differ from the actual size. .

[0051] <1. Overview of Display Device 1> 1A and 1B are diagrams illustrating an overview of a display device according to one embodiment of the present invention. The display device 1 displays an image so that an observer can observe the image through an observation area SC. In this embodiment, observation may be interpreted as meaning to see or visually inspect. refers to a user who uses the display device 1, for example, a person who observes an image displayed on the display device 1. The observation area SC is an area provided on the front side of the display device 1, and in this case, it is a rectangular The display device 1 displays an image by aerial imaging. Aerial imaging refers to the formation of an image in the air using reflection. It is sometimes used to give the viewer the feeling that the object is floating. Images displayed using this technology are called aerial images.

[0052] In the case shown in FIG. 1A, the display device 1 displays a character 1100 as an aerial image. The character 1100 is a female character. The display device 1 further displays the character 11 Below 00, a stage image 2100 is displayed. Here, it shows a magic circle. When an observer sees such a display, they can see that there is a character 1 on the stage. The character 1100 and the stage The color of the image 2100 is not particularly important. For example, the skin of the character 1100 is flesh color. Character 1100's hair color and upper body clothing are a relatively light blue color (for example, light blue), The accessories on the knees should be a darker shade of blue (e.g. blue), the skirt and The stage image 2100 is a relatively dark blue color (for example, a deep light blue). is.

[0053] In the case shown in FIG. 1B(a), the display device 1 displays a character 1200 as an aerial image. The character 1200 is a cat character. In the case shown in FIG. 1B(b), the display device 1 displays a stage image 2200 representing a stage below the character 1200. The stage image 2200 is the character string "Yupiteru" and the character The name of Kuta 1200, "Juno" (pronounced "Yuno"), is written in a circular pattern. are written alternately along the perimeter of the stage.

[0054] The colors of the character 1200 and the stage image 2200 are not particularly important. The image 1200 and the stage image 2200 will be described in more detail with reference to FIG. 1C. The character 1200 is roughly divided into a character body 1210 and a collar 1220. The character body 1210 is the cat character itself, whose name is "Juno." The character body 1210 includes body parts shown in white, such as eyebrows. These include the area between the legs, around the nose and mouth, the abdomen, and the front of the legs. Among the body parts of the Kuta body 1210, the parts shown in light gray are relatively light brown. The color (e.g., ochre) of the face, for example, above and beside the eyes, This applies to the upper part of the body and the parts of the legs other than the front side. Of the 10 body parts, the parts shown in darker grey are an even darker brown colour ( For example, brown) and striped areas indicated by thin lines on the face, head, body, and legs. The collar 1220 corresponds to the neck of the character body 1210. The collar 1220 is a reddish color (for example, red). That is, a tag 1221 is attached to the position below the face of the character main body 1210. 1221 is a circle containing the required mark. The mark is located under a "V" symbol. It is a mark with a "●" (a circle with a filled-in interior) on each side, and each side is colored red ( For example, the mark is written in red. The mark written on the tag 1221 is displayed on the display device. The stage image 2200 may function as a trademark indicating the source of the The overall color is brownish, the circle and the text are a relatively dark brown (e.g., brown), The inner smoke-like image is a lighter brownish color (e.g., ochre).

[0055] In Figures 1A, 1B and 1C, the background of the characters 1100 and 1200 is black. However, it is not limited to pure black, and may be used on a relatively dark background (e.g., black Other dark colors may also be used.

[0056] The characters shown in FIGS. 1A, 1B, and 1C are examples. When displaying characters, it is not limited to female characters, but male characters can also be displayed. The display device 1 displays a real person (for example, a family member) or a real person who existed in the past ( historical figures), fictional characters (e.g., fictional characters from manga, anime, etc.) Characters that appear in the works of the anime may be displayed. When displaying a character, the display device 1 is not limited to a cat character, but may also display a dog, a hamster, or the like. Characters of animals that can be kept in a normal household, characters of other animals such as horses and cows, and fictional animal characters (e.g., those appearing in manga, anime, or other works of fiction). The display device 1 may display either a character or a character that has a collar 1220. It may also display other characters that correspond to the character.

[0057] The display device 1 moves the body parts of the character based on the communication function. The communication function can be used to A function that reproduces communication between observers and characters, or a pseudo-communication In the communication function, the behavior of the observer (e.g. The character moves in response to user input (e.g., speech or body movement). For example, the character 1100 Moving the whole body, such as dancing, or changing facial expressions (for example, expressing emotions such as joy, anger, sadness, and happiness) For example, character 1200 reproduces the movements that animals normally perform (e.g., yawning, wagging their tail, walking, etc.). In addition, the display device 1 may, for example, display a character in accordance with the movement of the character 1100. The character 1100 outputs a singing voice as if it were singing, and engages in a dialogue with the observer. For example, the display device 1 outputs a voice in accordance with the movement of the character 1200. , outputting sounds representing the sound of a cat meowing, or outputting sounds related to dialogue with the observer. Such video and audio output is not limited to the communication function, and the display device 1 can also be used for other purposes. The above-mentioned processing may be performed by various functions.

[0058] The dialogue with the user in the communication function is, for example, built into the display device 1. a voice recognition application (an application with a voice recognition engine function), This is realized by cooperation between an external speech recognition server (not shown) and an external dialogue server (not shown). For example, when an operation unit 2214 (described later) is pressed, a voice recognition application The application will start and voice recognition will be enabled for interacting with the characters. In this embodiment, the voice recognition function is activated, for example, by a voice recognition engine. The first step is to turn on the device and wait for voice input. The received voice (also referred to as user voice) is transmitted from a communication control circuit 706 of the processing board 224 (to be described later). The speech is then sent to the speech recognition server, where it performs speech recognition processing on the user's speech. For example, the dialogue server may have a string of characters that can be input. For each time, a character (for example, a character) is displayed on the display device 1 (for example, a video display unit to be described later). The voices (also called character voices) that the characters 1100 make correspond to each other and are predicted. The speech recognition result (e.g., a character string) is registered by the speech recognition server. The speech recognition result is input to the dialogue server, and the character voice corresponding to the speech recognition result is generated. The voice is output from the dialogue server. The character voice output by the dialogue server is output from the display device 1. In this way, the response process to the voice of the user is The game is executed, and the interaction between the user and the character is reproduced.

[0059] The display device 1 is used by general users as a display device for entertainment purposes, for example. In this case, the display device 1 is used, for example, at a user's residence such as a home. The display device 1 may be used for commercial purposes (for example, advertising) or other purposes. For commercial use, the display device 1 is installed in a public place such as a store or other commercial facility. 1. At a venue such as an exhibition of a product or service, a character The display device 1 may also be used for other purposes. It could be any other way.

[0060] <2. External Configuration of Display Device 1> 2, 3 and 4 are perspective views showing the external configuration of the display device 1. 3 is a view of the display device 1 as seen from the front right side. 4 is a view of the display device 1 as seen from slightly below and diagonally forward to the right. FIG. 6 is a front view of the display device 1. FIG. 7 is a right side view of the display device 1. 8 is a plan view (top view) of the display device 1. FIG. 9 is a front side view of the display device 1. 10 is a rear view of the display device 1. FIG.

[0061] The display device 1 has a rectangular parallelepiped appearance. The display device 1 has a housing 100. The housing 100 is a box-shaped member that forms the outer shape of the display device 1. The housing 100 is a rectangular parallelepiped. 0 is longer in the height direction (also called the up-down direction) than in the width direction (also called the left-right direction). The width and depth (also referred to as the front-rear direction) of the housing 100 are approximately the same. The ratio of the width, height, and depth (also referred to as the front-rear direction) of the device 1 is In the following description, the ratio of the depth of the display device 1 to the viewer side is 2:3:2. The side where it is located is called the "front side" (corresponding to the first direction side), and the opposite side is called the "back side" (corresponding to the second direction side). equivalent).

[0062] The corners of the housing 100 are rounded. As shown in FIG. 5, the display device 1 is viewed from the front side. When the housing 100 is installed, each of the four corners of the housing 100 is rounded. It is good to use a matte finish to create a textured look. A rectangular parallelepiped display device 1 is provided. The housing 100 is preferably made of a resin material, but metal is also suitable. The housing 100 may be made of metal or other materials. The image display space is the space inside the housing 100 where the floating image is displayed (formed). The image display space is entirely or largely made of light-blocking materials. Therefore, the members that make up the housing 100 prevent external light from entering the image display space. The housing 100 is, for example, entirely made of a material that blocks external light. Alternatively, the outer surface or the surface facing the image display space may be covered with a light-blocking material. The color of the outer surface of the housing 100 is not important, but it may be changed depending on the color to express a sense of luxury or simplicity. The display device 1 is preferably white or black, which creates a sense of brightness. It is advisable to make it as large and heavy as possible.

[0063] The parts of the housing 100 that are exposed to the outside are a right panel 101 and a front panel 102. , a left panel 103, a rear panel 104, an upper cover 105, and a lower cover 106. The right panel 101, the front panel 102, the left panel 103, and the rear panel 1 The right panel 101 is a front panel. The left panel 103 is a panel located on the right side of the housing 100 when viewed from the front side. The right panel 101 and the left panel 102 are located on the left side of the housing 100 when viewed from the side. The right panel 101 and the left panel 103 have the same shape and dimensions. 3 is a mold for forming the right panel 101 and the left panel 103, which are symmetrical in the height direction. Therefore, the right panel 101 and the left panel 103 can be made of the same material. This is expected to reduce costs and the effort required for assembly.

[0064] The front panel 102 is located on the front side of the display device 1. The front panel 102 has a dimming function. The observation area SC has an opening 110 into which the member 200 can be attached. The observation area SC is an area where an observer can see an image displayed on the display device 1. The observation area SC is an area where the opening 110 formed in the housing 100 exists. The light-reducing member 200 is provided in the observation area. The light-reducing member 200 is provided upright in the vertical direction so as to cover the opening 10. 110 is provided above the center of the height direction of the housing 100 when viewed from the front side of the display device 1. The light attenuating member 200 and the opening 110 are square or rectangular.

[0065] The light-reducing member 200 has a rectangular (or square) first region 21 used for observing an image. 0 and a second region 220 surrounding the first region 210. The second region 220 is an edge Since this is an area that is not used for observing an image, it may be an area that does not transmit light. Therefore, the observation area SC can also be said to be an area where the first area 210 exists. The light-reducing member 200 may be thought of as the first region 210.

[0066] The light-reducing member 200 is an optical member that reduces external light entering the image display space from the observation area SC. The light-reducing member 200 is provided to maintain the image display space in a dark state. The optical member 200 suppresses the occurrence of reflections of the observer himself / herself in the observation area SC, It is provided to make it difficult for the viewer to see the internal components of the image display space. The member 200 is a plate-shaped (including panel-shaped) member, but may also be called a sheet-shaped, film-shaped, etc. The light-reducing member 200 may be a smoke panel or a smoke film. The light attenuating member 200 may have a light transmittance of 24%, for example, and a thickness of The light-reducing member 200 reduces the amount of light emitted from the image displayed in the image display space of the display device 1. The light-reducing member 200 has a translucency that does not interfere with the observation of the object. However, it may be blue or other colors.

[0067] The information area ST is located in the observation area SC (including the light-reducing member 200 and the opening) of the front panel 102. The information area ST is provided below the opening 110 of the front panel 102. The information area ST is located at the opening. This is an area where information is presented to the viewer. The electronic components provided in the information area ST include: A first sensor 2331, a second sensor 2332, a microphone 2333, and a light emitting unit 2334. The first sensor 2331 is a gesture sensor that detects gestures made by the observer. The second sensor 2332 includes one or more sensors other than a gesture sensor. The sensors of the two sensors 2332 include, for example, a gas sensor (smell sensor), a temperature sensor, The microphone 2333 picks up sound and converts it into an audio signal. The light emitting unit 2334 emits light to display predetermined information. For example, the light source may be a light emitting element (e.g., a light emitting diode) that emits light in a predetermined color, and the light emitted by the light emitting element may be a light emitting diode. In this embodiment, the light guide member of the light emitting unit 2334 is 331, a second sensor 2332, and a microphone 2333 are provided. The light emitting portion 2334 emits light in a blue color (for example, light blue), for example. The LEDs are configured to emit light in one or more colors, such as green, red, or other colors. The light emitting unit 2334 is not limited to a configuration having a light guide member, but may have, for example, a plurality of light emitters. The light may be emitted in a predetermined area by such a configuration.

[0068] An operation area OT is provided on the top cover 105. The operation area OT is used for operations performed by the observer. The operation area OT is an area that accepts operation units 2211, 2212, 2213, and 2214. The operation units 2211, 2212, 2213, and 2214 are The operation unit 2211 is a switch that accepts a pressing operation. The operation unit 2212 is operated to instruct to turn the volume up or off. The operation unit 2213 is operated to instruct to lower the volume. The operation unit 2214 is operated when instructing the execution of a predetermined function. For example, the operation unit 2214 may be an operation unit called a special key. The upper cover 105 may be configured to be operated when instructing the device 1 to start voice recognition. , corresponding to the positions where the operation units 2211, 2212, 2213, and 2214 are provided. The operation units 2211, 2212, 2213, and 2214 are provided with openings. The number of operation parts described here and the number of operation parts allocated to the operation parts are The assigned functions and acceptable operation methods are examples.

[0069] A human presence sensor 234 is provided on the lower cover 106. The human sensor 234 is located at the opening of the detection target space. The human sensor 234 is a detection unit that detects the presence of a person (moving object) in the present embodiment. is a microwave Doppler sensor that emits microwaves and measures the reflected microwaves. The presence of a person in the detection target space is detected based on the reception strength of the human sensor. 234 detects whether or not a person is present in front of the display device 1.

[0070] The rear panel 104 of the display device 1 is provided with a power jack 2311 and a rear cover 1041. The power jack 2311 is where the power cord is connected. The jack 2311 receives power from an external power source via a power cord. 1041 is a removable cover. When the rear cover 1041 is removed, the As shown, slot 222 and USB (Universal Serial Bus The connector 223 is exposed. The slot 222 is a mounting portion for mounting an external storage medium. The external storage medium is compatible with the microSD (registered trademark) standard, for example. oSDHC and other SD card standards or other standards may be supported. Connector 223 is a USB cable or a USB port on an external device that supports the USB standard. In the display device 1, the slot 222 and the USB connector 22 Data can be input and output to and from external devices via the 3. The portions of the slot 222 and the USB connector 223 that are exposed to the outside of the housing Since the part is on the rear side of the display device 1, it can be made difficult for the viewer to observe. Furthermore, there is no particular restriction on the number of attachment parts to which external devices are attached or the corresponding standards.

[0071] The housing 100 has a right panel 101, a front panel 102, a left panel 103, and a back panel 104. The face panel 104, the upper cover portion 105, and the lower cover portion 106 are joined together. In this embodiment, the joining method is screw fastening using screws, which are an example of fasteners. However, there are no screwed portions on the front panel 102 or the top cover 105.

[0072] The right panel 101 is fastened to the front side with screws 710 and 720 at two locations, top and bottom. The left panel 103 of the housing 100 is fastened with screws at two locations on the top and bottom of the front side. The rear panel 104 is secured by screws 730 and 740. It is fastened with screws 751, 752, and 753 at three points on the side, and the center in the height direction It is fastened by screws 754 and 755 at two points near the base and screws 756 at three points on the lower side. , 757, 758. In the lower cover part 106, The front panel 102 and the top cover are fastened together with screws 761 and 762. The portion 105 is a portion that is relatively easily observed by an observer using the display device 1. On the other hand, other parts are relatively difficult to observe by the observer using the display device 1. Therefore, with the display device 1, the screw fastening points are not visible to the viewer. This can suppress the deterioration of the image quality and maintain the aesthetic appearance of the display device 1. This can also contribute to giving viewers a sense of immersion in the video.

[0073] FIG. 12 is a diagram illustrating an example of how the display device 1 is used by an observer. 2 shows the positional relationship between the display device 1 and the observer U who uses it, from the left side of the display device 1. The display device 1 is placed on a desk 3000. A chair 3100 is placed in front of the display device 1. In this example, the position of the eyes of the observer U is 1. Therefore, the observer U looks down on the observation area SC at an angle θ. The angle θ is the angle between the horizontal and the line of sight of the observer U. The angle θ is in the range of θ1 to θ2. The angle θ is, for example, 15 degrees. The horizontal distance between the observation area SC and the object is approximately 50 cm.

[0074] <3. Principles of display on the display device 1> FIG. 13 is a diagram illustrating the principle of display on the display device 1. 1 is a schematic diagram of the inside of the display device 1 as seen from the left side of the housing 100. The image display space S1 includes a first display unit 310, an optical member 320, and a second display unit 330. The first display unit 310 and the optical member 320 cooperate to form an image display space S 1 is configured with an image display unit that forms an aerial image.

[0075] The first display unit 310 and the second display unit 330 are display units that display images. The display unit 310 and the second display unit 330 are display units having a light source, such as a liquid crystal display. The light source is a backlight. The first display unit 310 and the second display unit 330 are It displays color (multicolor) images based on the three primary colors red (R), green (G), and blue (B). In this embodiment, the first display unit 310 and the second display unit 330 are recognized as two-dimensional images. Display the image.

[0076] The first display unit 310 is an 8-inch liquid crystal display. The display unit 310 includes a backlight, which is an example of a light source, and a liquid crystal element, which is an example of a display element. The light source is, for example, a white light source. The liquid crystal element is backlit by a pixel. The liquid crystal element modulates the light from the LCD. The first display section 310 has a structure in which liquid crystal molecules are sandwiched between a common electrode shared by several pixels. The first display unit 310 has a first display surface 311 that emits image light L1. In other words, it emits image light for displaying characters 1100 and 1200. 310 is a plate having one end on the observation area SC side positioned above the observation area SC and a rear side thereof positioned low. This inclination is equal to the inclination of the first display surface 311, The angle is approximately 20 degrees relative to the horizontal plane. This can enhance the three-dimensional effect of the aerial image that can be displayed, and the first image light L1 can be used in the dimming area. This makes it more difficult to observe a virtual image formed in the image display space by reflection from the material 200. The inventors have found that the angle is just an example. The basis for this will be explained later. In the width direction of the display device 1, the height of each position on the first display surface 311 is the same.

[0077] Optical member 320 forms an aerial image based on first image light L1 from first display unit 310. The optical member 320 has optical transparency and reflectivity. The optical member 320 is a plate-shaped member. In this example, the optical member 320 is a half mirror. The optical member 320 is made of an acrylic mirror and has a light transmittance of approximately 30%. The thickness is about 2 mm. The light transmittance is only an example and may be, for example, 6%. If the transmittance is sufficient to allow the observer to view the floating image displayed in the display space S1, The optical member 320 is arranged to interpose the opening 110 and the first display surface 3 in the image display space S1. The optical member 320 is disposed at an angle with respect to the observation area SC. It is located below the observation area SC and is inclined so that it is higher on the back side. The inclination of the display device 1 is 35 degrees with respect to the horizontal plane. However, this angle is just an example. In the width direction, the height of each position on the optical member 320 is the same.

[0078] The second display unit 330 is a 7-inch liquid crystal display. The second display unit 330 has a second display surface 331 that emits second image light L2 of the image. In the case of Figure 1A and Figure 1B, image V2, which corresponds to stage images 2100 and 2200, is displayed. The second display unit 330 is disposed so that the normal direction of the second display surface 331 faces upward. The second display surface 331 is located on the rear side of one end of the lower side of the optical member 320. A base 400 is provided on the front side of the second display surface 331. The base 400 is The base 400 forms part of the components that make up the image display space S1 of the housing 100. The second display surface 331 is located at approximately the same height as the first display surface 331, but the second display surface 331 is slightly lower. That's fine.

[0079] With the above configuration, the first image light L1 emitted from the first display unit 310 is reflected by the first The incident first image light L1 is incident on the first surface 321 at a predetermined angle. The reflected light L1r is reflected at the predetermined angle to the front side of the display device 1. Aerial image V1 is recognized in image display space S1 of housing 100. Aerial image V1 is a first display Below the tip of the rear side of the surface 311, for example, at the intersection of the first display surface 311 and the optical member 320 It is a virtual image perceived from below.

[0080] The second image light L2 emitted from the second display unit 330 is incident on the second surface 332 of the optical member 320. The second image light L2 is then transmitted to the first surface 321 side. The second image light L2 directly enters the viewer's eyes. The image V2 of 331 is a real image that is perceived as being located below the aerial image V1. For example, aerial image V1 is perceived at the center of second display surface 331 in the front-to-rear direction. In this way, the aerial image V1 is projected onto the screen of the characters 1100 and 120 in FIGS. 0, and the image V2 is recognized as the stage images 2100 and 2200 in FIGS. 1A to 1C. Display device 1 allows the user to view aerial image V1 combined using optical member 320. This gives the observer a sense of three-dimensionality, and then the observer can see image V2 below it. By using the second display unit 330, the stereoscopic effect can be further enhanced. In the case where a light emitting body and a light guide member are combined to emit light in a predetermined pattern, In comparison, it allows for greater freedom in selecting the images that viewers can view along with the aerial images. .

[0081] The first display surface 311 of the first display unit 310 is provided with a viewing angle control member that narrows the viewing angle to the front side. In this way, it is desirable to provide the observation area S Even if the observer approaches C and looks up, the image displayed on the first display surface 311 is not directly visible to the observer. The second display screen 331 can be prevented from being observed by the viewer. A viewing angle control member is provided to narrow the viewing angle to the front side so that the image V2 can be easily observed. Not yet.

[0082] The basic display principle of the display device 1 is as described above. As a configuration for enhancing the visual effect, the light-reducing member 200 and the light-blocking member 500 are provided. Its action and effects will be described later.

[0083] <4. Internal configuration of display device 1> Next, the internal configuration of the display device 1 will be described. FIG. 18 shows the right panel 101, the front panel 102, and the left panel 103 of the housing 100. 14 is a diagram showing a state in which the cover 103 and the rear panel 104 are removed. By removing the right side panel 101, the right side inner panel 107 is exposed. As shown in FIG. 1, the front panel 102 is removed, and the front inner panel 108 is As shown in FIG. 16, the left side panel 103 is removed, and the left side inner panel As shown in FIG. 16, the rear panel 104 is removed, and the rear panel 109 is exposed. As a result, the wiring portion 800 and the partition member 900 are exposed.

[0084] The right inner panel 107 and the left inner panel 109 are the same as the first display unit 3 described in FIG. 10 and the optical member 320 are held by being sandwiched from both the left and right sides.

[0085] The screws 710 and 720 shown in Figs. 2, 4, and 6 are attached to the right panel 101 and the front inner panel. 108 and holes H1 and H2 passing through the right inner panel 107. The screws 730 and 740 shown in Figs. 3 and 7 are inserted into the left panel 103 and the front side inner The hole H3 passes through the panel 108 and the hole H4 passes through the left inner panel 109. The screws 751, 752, and 753 shown in FIG. 10 are used to connect the rear panel 104 and The screw 754 fastens the rear panel 104 and the right panel 101 together. The screw 755 fastens the rear panel 104 and the left panel 103 together. 65, 765, and 757 fasten the rear panel 104 and the lower cover portion 106 together.

[0086] 19, 20, 21, 22, 23 and 24 further illustrate the right inner panel 10 19 is a diagram showing the display device 1 with the display panel 7 and the left inner panel 109 removed. 20 is a diagram showing the display device 1 as viewed from the left side. 21 is a diagram showing the display device 1 as viewed from the right side obliquely below. FIG. 22 is a diagram showing the display device 1 as viewed from diagonally above the right side. FIG. 24 is a diagram showing the display device 1 as viewed from the left side obliquely downward. FIG. 2 is a diagram showing the left side as viewed from diagonally above.

[0087] The housing 100 contains a first display unit 310, an optical member 320, and a second display unit 330. The display device includes a base 400 and a light blocking member 500. The display device includes a first display unit 310 and an optical member 320, the second display unit 330, and the base unit 400 are configured as described with reference to FIG. It is completed.

[0088] The light blocking member 500 blocks the first image light L1 from the first display unit 310 through the light reducing member 200. The light blocking member 500 is provided on the optical path of the light reflected from the optical member 320. The light-reducing member 200 (observation area SC) of the optical member 320 is provided to prevent light from entering the observation area SC. ) side, in other words, the side farther from the first display unit 310. 0 is a material that absorbs visible light, but also prevents the first image light L1 from passing through. The light blocking member 500 may be, for example, black or other dark colors. The reason for this will be described later, but the first image light L1 is not necessarily the light-reducing member 2. The image (virtual image) formed in the image display space S1 is reflected by the In particular, when looking into the image display space S1 from the observation area SC, In this way, when an observer views an image, it is possible to prevent the observer from observing an image that may be observed. In addition to this image, it also prevents external objects such as the ceiling from being observed. The top surface of the 00 is approximately horizontal, but is not limited to this.

[0089] A first plate 601 is provided above the first display unit 310. A first storage space S2 (see FIGS. 19 and 20) for storing various components is formed above the In addition, a second plate 602 is provided below the second display unit 330, and the base unit 40 0 and a second storage space S3 (see FIGS. 25 to 27) for various components below the second plate 602. ) is formed.

[0090] As shown in FIGS. 17 to 24, the first housing space S2 is provided above the first display unit 310. This space is separated from the image display space S1 by the first plate 601. 601 is connected to the right inner panel 107 using screws 791, 792, and 793. 794, 795, and 796 are connected to the left inner panel 109. The device includes an operation board 221, a processing board 224, speakers 2251 and 2252, and a holding unit 2 The operation board 221 is provided with operation units 2211, 2212, 2213, and 221. The operation board 221 has operation units 2211, 2212, and 2213 mounted on its surface. The processing board 224 receives signals according to the operations of the control circuits 13 and 2214. The processing board 224 functions as a processing board that controls the display device 1. The processing board 224 is called a main board. The processing board 224 may include an operation board 221 and a speaker 2251. 2252 via, for example, a printed wiring board (for example, FPC). The substrate 224 is located on the rear side of the first housing space S2 in the depth direction of the display device 1. The processing board 224 is a so-called SoC board, and includes a processor and an OS (Operating System). The processing board 224 is mounted on the sensor board 233. The OS can read and operate the signals from the sensors and the audio signals from the microphone 2333. Signals corresponding to the operations of the operation units 2211, 2212, and 2213 are acquired from the operation board 221. The processing board 224 controls the first display unit 310 and the second display unit 330 to display images. The processing board 224 has a slot 222 and a USB connector 223. The display device 1 is mounted on the back surface of the display device 1 and is exposed from the rear surface of the display device 1.

[0091] The speakers 2251 and 2252 are provided on both the left and right sides when viewed from the front side, and are attached to the top cover 105. The sound is emitted to the outside through the openings 1051 and 1052. It is desirable that the speaker 2252 is not too far away from the processing board 224. It is desirable that the distance between the 52 speakers be kept as small as possible to minimize interference between their sounds.

[0092] The holder 226 is provided at a position overlapping the processing substrate 224, and the processing substrate 224 is attached to the lower surface. The upper surface of the holder 226 opposite to the side that holds the substrate 224 is A heat sink 2261 is provided for heat dissipation or heat absorption. The first plate 601 is inclined downward from the front side to the rear side. The first storage space S2 has a height dimension that gradually increases from the front side to the rear side. By utilizing this, the processing substrate 224 and the holding substrate 225 can be easily mounted. The holding portion 226 accommodates a member having a thickness. This prevents the upper housing portion from becoming longer than the original length, which contributes to making the display device 1 lighter and more compact. Both are desirable from a design standpoint.

[0093] 25, 26 and 27 show the internal structure of the display device 1 when the lower cover 106 is removed. Below the base 400 and the second display unit 330, a second plate 60 is provided. A second storage space S3 is formed between the second plate 602 and the lower cover portion 106. The second accommodation space S3 is provided with a control board 231, wiring 232, and a sensor board 233. and a human sensor 234. The front inner panel 108 is secured by screws 771 and 772. , 773, 774 are connected to the second plate 602. The front inner panel 108 is , and is connected to the lower cover portion 106 using screws 775, 776, and 777. 08 is fixed using screws 771 to 777, but under the circumstances where the display device 1 is used, Since the front panel 102 covers the screws 771 to 777, the screws 771 to 777 are exposed to the front side. do not have.

[0094] The control board 231 controls the supply of power and signals to the display device 1. 31 is electrically connected to the processing board 224 via the wiring part 800, and transmits and receives various signals. The control board 231 is connected to the processing board 224 via wiring 232. The wiring 232 is electrically connected to the sensor board 233 and the human sensor 234. An example is a printed wiring board (e.g., FPC).

[0095] The sensor board 233 includes a first sensor 2331, a second sensor 2332, and a microphone. The sensor board 233 is mounted on the rear surface of the front inner panel 108. The light-reducing member 200 is provided in a region below the light-reducing member 200 (observation region SC) on the side surface. The sensor substrate 233 is vertically erected so that the substrate surface extends in the height direction and width direction. The sensor of the sensor board 233 may be any sensor that detects predetermined information. The sensor 2331 emits light (for example, infrared light) to the front side and receives the reflected light. The microphone 2333 is an optical sensor that detects the observer's gestures. The second sensor 2332 is a gas sensor that detects the sound and outputs a sound signal indicative of the detected sound. Detects odors such as gas and burnt food. Temperature sensor detects temperature. Illuminance sensor The first sensor 2331 detects the illuminance at approximately the center in the width direction of the information area ST. The sensor board 233 includes a first sensor 2331, a second sensor 2332, and a master sensor 2333. A signal from the microphone 2333 is output to the control board 231 via the wiring 232. The board 224 emits light when voice recognition is possible via the wiring section 800 and the control board 231. The control unit 2334 controls the light emission.

[0096] The human sensor 234 is mounted on the front inner panel 108 so as not to come into contact with the front inner panel 108. It is placed at a specified distance, such as about 30 cm behind 108. This is desirable in order to ensure the detection sensitivity of the human presence sensor 234. In terms of the row direction, it is installed slightly towards the front from the center. The signal is output to the control board 231.

[0097] The wiring section 800 includes a power line 810, a signal line 820, and a signal line 830. The wiring section 800 is routed from the bottom to the top of the rear panel 1. 04 and the partition member 900. The control board 231 is connected to the processing board 231 via the power line 810. The control board 231 supplies power to the processing board 224 via a signal line 820. The processing board 224 transmits and receives signals between the second display unit 330 and the processing board 224 via the signal line 830. A driving signal (for example, a driving signal or a video signal) is supplied to the power supply line 810 and the signal line 8 20 and the signal line 830 pass through the space between the partition member 900 and the rear panel 104. A background plate 910 is provided on the front side of the partition member 900. The rear panel 910 is a dark color such as black. The partition member 900 is made of a resin material, for example. This is a plate-shaped member that does not transmit light. The wiring portion 800 cannot be observed from the S1 side.

[0098] The processing board 224 is configured to control the first display unit 310 and the second display unit 312 based on the communication function. It controls the display on the display unit 330 and controls the audio output from the speakers 2251 and 2252. The processing board 224 functions as an operation control means for controlling, for example, the sensor board 233 and and the first display unit 310 and the second display unit 232 according to the information measured by the human presence sensor 234. The display of the display unit 330 is controlled, and the audio output from the speakers 2251 and 2252 is controlled. The processing board 224 detects the presence of a person based on, for example, a human presence sensor 234. When you press the button, the character will say hello and make a sound. The processing board 224 detects left and right movements as a hand gesture using the first sensor 2331. When a gesture such as up and down, bye-bye, or moving forward and backward is detected, the first display unit 310 It controls the display and the audio output from the speakers 2251 and 2252. For example, the processing board 224 may move a character in a direction corresponding to a left-right or up-down hand movement. When the bye-bye gesture is detected, the processing board 224 rotates the character. When the processing board 224 detects a gesture of moving the hand back and forth, The character display is reset to the default (for example, FIGS. 1A to 1C). The first display unit 310 and the second display unit 330 are illuminated in accordance with the illuminance measured by the illuminance sensor. The processing board 224 changes at least one of the displays. The processing board 224 detects the brightness of the characters based on the illuminance sensor. The processing board 224 may be controlled by the temperature detected by the temperature sensor. In response to the command, the display on the first display unit 310 is controlled, and the audio from the speakers 2251 and 2252 is output. The processing board 224 controls the output depending on whether the surroundings of the display device 1 are hot or cold. The processing board 224 also controls the light emission of the light emitting unit 2334. The processing board 224 controls the operation of the operation units 2211, 2212, 2213, and 2214. The volume is changed depending on the operation. The voice engine is realized by the function of the processing board 224. In the latter case, the processing board may be implemented by a Wi-Fi network or by an external recognition server. -Has a communication module that performs wireless LAN or network communication such as Wi-Fi, It is recommended to communicate with the speech recognition server using this.

[0099] The processing board 224 controls the light emission brightness of the light source of the first display unit 310 and the light emission brightness of the light source of the second display unit 330. In this way, the light emission luminance of the first display unit 310 and the light emission luminance of the second display unit 310 are set to be brighter than that of the first display unit 310. The difference in the luminance of the light emitted from the light source 330 enhances the three-dimensional effect of the aerial image that can be given to the viewer. The inventors have found that the image display space S1 can be brighter and more If the brightness is too high, the three-dimensional effect may be lost, so the brightness of the second display unit 330 is set low. .

[0100] The first display unit 310 is tilted at an angle of approximately 20 degrees relative to the horizontal direction. When sitting on a chair, you may end up looking down at the second display unit 330. This is to prevent display problems from occurring when the display is switched on. Therefore, the entire display can be seen even when the viewer looks at the display device 1 from slightly above. There is no need to assume a stern posture.

[0101] In this case, the ceiling may be reflected by the optical member 320 and be visible to the viewer. The aerial image does not overlap with the image on the second display screen 331, making it difficult to see clearly. As shown in FIG. 28, the first image light L31 and L32 are dimmed. In this case, the reflected waves of the first image light L31 and L32 are L31r and L32r are emitted from the light attenuating member 200 and further reflected by the optical member 320. As a result, the observer observes a virtual image V3. For example, When the first display unit 310 displays the character, the image of the lower part of the character, for example, the area around the feet, is displayed. Also, as shown in Figure 29, when light L4 is dimmed from the ceiling or lighting, The light is incident on the optical element 200, passes through it, and is then reflected by the optical element 320. The ceiling is reflected near the bottom of the member 320. By observing an image other than V1, the display quality of the display device 1 may be affected. .

[0102] Therefore, on the optical path of the reflected light from the light reducing member 200 and on the optical path of the light L4 from the ceiling, lighting, etc. By disposing the light blocking member 500 in the vicinity of the ceiling, the display of the image V3 and reflections of the ceiling, etc. are suppressed. As shown in FIG. 30, the provision of a light blocking member 500 suppresses reflection at an optical member 320. Therefore, the display of the image V3 and the reflection of the ceiling are suppressed. Since the light-blocking member 200 is located below the SC and the light-blocking member 200 is also present, the observer For example, if the horizontal distance between the observer and the observation area SC is 50 cm, the existence of 500 is difficult to recognize. ,Assuming that the angle θ of the observer's line of sight is 35 degrees, A light blocking member 500 is provided on the optical path of the light. If the tilt angle of 10 is set to 10 degrees, the position of image V3 will be displayed further back, and the image In order to prevent this, the light blocking member 500 should be extended further to the back. Therefore, it is desirable to set the tilt angle of the first display unit 310 to 20 degrees. I wish.

[0103] According to this concept, even without using the light blocking member 500, the attenuation of the first image light L1 can be reduced. Even if the optical member 320 is arranged so as to avoid the area on the optical path of the light reflected by the optical member 200, In this way, the first image light L1 is reflected by the light-reducing member and formed in the image display space. This can prevent a virtual image from being observed by the viewer.

[0104] In addition, the observer makes a gesture near the first sensor 2331, which is a gesture sensor. In this case, if the first sensor 2331 is located above the observation area SC, it is possible to detect the presence of a gesture. The hand that is holding the object may get in the way, hindering the observation of the image through the observation area SC. In this embodiment, since sensors such as the first sensor 2331 are provided below the observation area SC, Even if you make gestures while observing the observation area SC, the observation is not disturbed. can be.

[0105] The reason why the image display space S1 is dark is to make the floating image appear more three-dimensional. For example, when a specific character is displayed, the character may not be visible due to the dark surroundings. In addition, when viewed from the front, the periphery of the observation area SC The body is enclosed by a housing 100 (front panel 102). The floating image displayed in the display space and the housing located in front of it combine to give the viewer This can further enhance the three-dimensionality of the aerial images that can be viewed.

[0106] The part facing the image display space S1 is treated to reduce light reflection (for example, matte finish). In this way, even if external light or other light enters the image display space S1, it is reflected. It is easy to maintain a dark state because it suppresses glare. It can prevent the interior space from becoming bright. This process is performed on the background board 910, the base 400, the first display unit 310, and the second display unit 310. It is recommended that this be done on some or all of the 330 frames.

[0107] In addition, when a fastening method using screws or other fasteners is used, the front side is more difficult to attach than when using adhesives or other fasteners. Panel 102 and front inner panel 108 can be easily removed, allowing for easy access to the video display space. Dust can be removed using an air blower or a soft cloth. The side panel 102 is not fixed with a fastener such as a screw, and therefore can be seen by an observer. Anything that would be disappointing to the observer is suppressed.

[0108] 5. Detailed Configuration of Processing Board 224 FIG. 33 is a control block diagram of the processing board 224 included in the display device 1 according to one embodiment. As shown in FIG. 33, the processing board 224 is a processing device that executes arithmetic processing and the like. The CPU 701 functions as a control unit, and the RAM 703 is used as a work area. The controller has a memory including a ROM 702 that stores the programs. The processing board 224 may be read as, for example, a control unit (an example of an operation control means). Various programs are stored in the ROM 702 of the processing board 224. The board 224 executes these programs to realize various functions. For example, The ROM 702 contains a voice recognition application for reproducing the dialogue between the user and the character. The processing board 224 stores various sensors 234, 2331 to 2332. Alternatively, the voice recognition application may be executed based on an input signal from a GPS receiver 60 or the like. By executing the above, the dialogue between the user and the character is reproduced. a display control circuit 7 that controls the images displayed on the display device 1 (more specifically, the video display unit); 04, and a sound control circuit 705 that controls the sound output from the speakers 2551 and 2552. The processing board 224 also has other devices (for example, an external voice recognition device (not shown)). A voice recognition server (also called a voice recognition engine) and an external dialogue server (not shown) The communication control circuit 706 controls communication with the communication engine (also called a communication engine).

[0109] <6. About the communication function for Character 1100> In the following, a character 1100 and a user are displayed on the display device 1 (for example, a video display unit). See Figures 34 to 40 for various controls to reproduce communication with the user. These will be explained in order.

[0110] <About the smell-related communication function> For example, an odor sensor that detects an odor may be provided in the display device 1 as the second sensor 2332. The processing board 224 outputs a voice corresponding to the detection result of the odor sensor to the character 11. It is recommended to execute the voice output operation to output the voice as the character voice of 00. For example, it can output a signal that changes depending on the intensity of a certain smell, or detect the components contained in the smell ( Some odor sensors output signals that change depending on the odor components. For example, the odor sensor outputs a signal that changes depending on the type of odor. Using a filter or other device, specific odor components (tar, ammonia, alcohol, carbon dioxide, etc.) In this way, the processing board 224 is configured to be able to detect the concentration of the display device 1. Communication about smells between the user and the character displayed on the video display unit This allows for more diverse communication between the character and the user. can be reproduced.

[0111] The processing board 224 outputs a sound corresponding to the type of smell detected to the character 110, for example. It is recommended to execute the voice output operation to output the character voice of 0. A single sensor capable of identifying odor components may be configured as an odor sensor. The odor sensor is composed of multiple sensors that can distinguish different types of odor components. It's fine.

[0112] Figure 34(A) is a flowchart for recreating communication related to smells. FIG. 34(B) shows a voice management table (also called a voice management table) related to odors. The audio management table is stored in, for example, the processing board 224 of the display device 1. As shown in FIG. 34(B), the voice management table The types of odor components (also called odor substances) that can be detected by odor sensors are For each odor, the type of odor that mainly contains that odor component and the sound emitted by the character 1100 are displayed. For example, in the voice management table, In this case, the tobacco smell, which mainly contains tar, is registered in association with tar, When the smell of tobacco is detected, the character will say, "Smoking too much is not good." The following words are registered to show concern for the user's health:

[0113] First, in step S11, the processing board 224 (which may also be read as the control unit) For example, the processing board 224 may The concentration of the odor component detected by the sensor is equal to or exceeds a predetermined threshold (standard) for a specific odor. If the value exceeds the threshold, it is determined that the odor component has been detected. The logic board 224 registers the detected odor components in association with the detected odor components in the sound management table. For example, if a concentration of tar is detected that exceeds a predetermined threshold, If the detected odor is detected, it is determined that the tobacco odor has been detected. The character voice corresponding to the type of odor is output from the speakers 2551 and 2552. For example, if it is determined that a cigarette odor has been detected, the processing board 224 may output a message expressing concern for the user's health. The voice of the leaves (here, "Smoking too much is not good") is output as a character voice. Other examples include the following: For example, the concentration of a specific main component contained in fragrances such as aromatic oils or food is determined based on a predetermined standard. If the detected odor exceeds the threshold, the processing board 224 determines that the odor of a fragrance or food has been detected. A voice asking a question about the nephew's origin is output as a character voice. If an alcohol content exceeding this is detected, the processing board 224 determines that an alcohol odor has been detected. It also features voice messages such as "You smell like alcohol" and "You've been drinking again, stop it already." The voice of the character of the character 1100 is output. (e.g., hydrogen sulfide, methyl mercaptan, dimethyl sulfide, etc.) are detected, The logic board 224 determines that bad breath has been detected and responds with, "Your breath stinks a bit. Have you brushed your teeth?" and "Please wear a mask" are output as character voices for Character 1100. Also, tertiary butyl mercaptan, dimethyl sulfide or tetramethyl mercaptan When an odor component contained in the gas fuel, such as hydrothiophene, is detected, the processing substrate 224 The device determines that it has detected the smell of gas fuel and plays a voice message such as "I smell gas!" The character voice is output as Lacta 1100's character voice.

[0114] In this way, the processing board 224 outputs a voice corresponding to the type of detected odor to the character 1. It is recommended to execute control to output the voice as the character voice of 100. This allows communication between the user and the character displayed on the video display unit. This will broaden the scope of the characters and increase the user's attachment to the characters. .

[0115] The display device 1 is not limited to a device that specifies the audio to be output based on the audio management table. The display device 1 may, for example, determine the content of the character's utterance based on the content of past dialogues (dialogue history). The audio to be output may be specified according to a scenario in which the content of the voice changes. The data specifying the voice output by the character defines branching scenarios managed in a tree structure. It may also be something like this.

[0116] Here, an example is shown of an audio output operation according to the detection result by the odor sensor. However, the present invention is not limited to this, and the processing board 224 may be configured to move in accordance with the detection result of the odor sensor. A display output operation may be performed in which an image of the character's actions is displayed on the image display unit. For example, Similar to the voice management table, a display management table (not shown) is provided in advance. 24 is a video display of a character 1100 performing a movement according to the type of smell detected. The display management table may be, for example, A table in which data defining the character 1100 is registered in association with the minute and type of odor. The data defining the character 1100 is the character 1100 to be displayed. It may be data showing the image of the character 1100, or data specifying the details of the character's movements. For example, when some odor component is detected, the processing board 224 detects an odor-smelling animal. It is advisable to display an image of the character 1100 performing the action on the image display unit. 4, for example, when it is determined that a cigarette smell is detected, the character 1100 makes a movement as if it is smoky. It is advisable to display an image of the process on the image display unit. The video may be displayed on the video display unit. Furthermore, the processing board 224 may also output audio as described above. For example, an odor sensor may be used to detect an odor and output a display. When an odor component is detected, the processing board 224 controls the character 1100 to sniff the odor. While the image of the character 1100 performing the action is displayed on the image display unit, the character 1100 makes a sound such as "I smell something." The character voices may be output from the speakers 2551 and 2552.

[0117] Furthermore, the processing substrate 224 detects the concentration of the odor component detected by the odor sensor (detection It is preferable to control the reaction of the character 1100 to change depending on the intensity of the impact (also called the intensity of the impact). For example, the processing substrate 224 may have a plurality of stepwise movements according to the concentration of the odor component. (e.g., "grimacing (making a disgusted expression)," "breaking into a cold sweat," "turning pale" It is advisable to selectively display one of the following options: "to lose consciousness" or "to faint."

[0118] The display device 1 is a method for distinguishing between tobacco odor and odors (odors) other than tobacco odor. For example, a smoke sensor that detects smoke, a camera image (for example, an image taken by the photographing unit 227), a server By combining it with other sensors, such as images from a mobile camera, it is possible to determine whether the user is smoking. may be detectable.

[0119] If the processing board 224 detects that the user is smoking, it displays character 1 100 (in front of character 1100) and an image that resembles smoke (smoke appears to be billowing) In this case, the processing board 224 may display a character The face of the Kuta 1100 is pushed forward and the face is close up, making it look like it is displeased. The processing board 224 may also display a parental level, which is the degree of intimacy between the user and the character 1100. Depending on the density, the character 1100 may be displayed with varying degrees of dislike. For example, if the intimacy level is equal to or greater than a predetermined value, the board 224 may say, "I love you, so I'll forgive you." If the value is less than the predetermined value, the character 1100 The processing board 224 may, for example, The degree of intimacy is determined according to the usage history of the device 1 (for example, the past usage time and the past conversation content). The algorithm for determining intimacy is not limited to this.

[0120] <About the communication function based on user location information> Furthermore, for example, the display device 1 may include a GPS (Global Positioning System) receiver 60 (see FIG. 3). 3), and the following control is expected to be performed based on the user's location information. For example, the processing board 224 may then execute a command based on a signal from the GPS receiver 60. acquires location information of the display device 1 held (carried) by the user as the user's own location information, The following control may be performed based on the acquired location information.

[0121] For example, the frequency of a user's stay (visits) at a location identified based on the user's location information The voice corresponding to the frequency of the character is output as the character voice. Figure 35 shows a flowchart for reproducing communication regarding frequency of stay. It is.

[0122] For example, in step S21, the processing board 224 receives the user's It is determined whether the location information is received. When the user's location information is received, step S In step 22, the processing board 224 receives the user's location information from the processing board 224. The number of stays (also called the number of visits) is equal to or greater than a predetermined value (for example, "2"). The frequency of stay is determined by the number of times the user has stayed in the facility for a given period (for example, one day or one week). For example, the processing board 224 may include a GPS receiver. Based on location information (e.g., user's current location information) acquired from the device 60, The processing board 224 then searches for and identifies the user's location using a network or other means. The frequency of stay of the user is calculated based on the number of times the user has stayed at the specified location, and the user For example, if the frequency of a user's stay is equal to or greater than a predetermined value, If so, in step S23, the processing board 224 The voice of a predetermined character registered in advance is output from the speakers 2551 and 2552. For example, if a user goes to the same place twice on the same day, the processing board 224 In this case, it is determined that the user's frequency of visit is above a certain value, and it is possible to send a message like "Hey, I was there just now." Which character voice is output?

[0123] The processing board 224 also outputs a sound corresponding to the location specified based on the acquired position information. It is recommended to control the character 1100 to output the character voice. is a flowchart for reproducing communication about the place of stay. 6(B) is a diagram showing a voice management table of character voices relating to places of stay.

[0124] For example, in step S31, the processing board 224 receives the user's It is determined whether the location information is received. When the user's location information is received, step S In 32, the processing board 224 uses a network or the like based on the user's location information. Then, in step S33, the processing board 224, based on the voice management table of FIG. 36(B), The processing board 224 outputs the user voice from the speakers 2551 and 2552. When the person goes to the supermarket, they hear voice messages such as "What should we make for dinner tonight?" When the user goes to the hospital, the voice of the user can be heard, such as "Are you OK? Are you feeling unwell?" The processing board 224 outputs the character voice of the character 1100. When the user goes to an amusement park, the character will output a voice message such as "You had a lot of fun."

[0125] The processing board 224 also determines the location where the user stayed based on the acquired location information. The character 1100 plays a voice corresponding to the number of stays (also called the number of visits). It is advisable to control the system so that the voice is output as a chat voice. FIG. 37(B) is a flowchart for reproducing communication, and FIG. 37(C) is a flowchart for reproducing communication, and FIG. FIG. 10 is a diagram showing a voice management table of character voices.

[0126] Steps S41 and S42 in FIG. 37A are the same as steps S31 and S32 in FIG. 36A. In step S43, the processing substrate 224 is In step S42, the number of times the user has stayed at the specified location is acquired. In step 44, the processing board 224 determines whether or not the user The character voice corresponding to the number of times the user has stayed is output from the speakers 2551 and 2552. For example, when a user visits a certain game center for the first time, the board 224 may display a message saying, "I'm having fun playing games." Then, the processing board 224 outputs a character voice such as "I'm glad you liked it." When I went to a certain game center again, I was told, "I wanted to go again." Furthermore, the processing board 224 outputs a game sound when the user enters the game center. If you play more than a certain number of times (for example, 10 times or more), you will receive a character message such as "Let's play the game again." Outputs kuta audio.

[0127] The processing board 224 also detects whether the user is staying at a location specified based on the acquired location information. The voice corresponding to the time spent is controlled to be output as the character voice of the character 1100. Figure 38(A) shows a flowchart for reproducing communication regarding the duration of stay. FIG. 38(B) is a voice management table of character voices related to stay time. This is a diagram showing the structure.

[0128] Steps S51 and S52 in FIG. 38A are the same as steps S31 and S32 in FIG. 36A. In step S53, the processing substrate 224 is In step S52, the time spent by the user at the specified location is acquired. In step 54, the processing board 224 determines whether or not the user The character voice corresponding to the stay time is output from the speakers 2551 and 2552. For example, When the user's stay time at the convenience store is less than 5 minutes, the processing board 22 4 outputs a character voice such as "That was quick. I'm glad I was waiting." The user's stay time in the convenience store is between 5 and 10 minutes (5-10 minutes). At other times, the processing board 224 outputs a character voice such as "What did you buy?" Furthermore, if the user's stay in a convenience store exceeds 10 minutes, the system will The logic board 224 outputs a character voice such as "You're late. I was worried."

[0129] The processing board 224 performs the following operations based on the user's location information acquired using the GPS receiver 60 or the like. In this way, the user can select the appropriate action according to his / her own behavior. This gives the user a sense of the character's reaction, and Za's attachment grows.

[0130] It should be noted that the display device 1 is installed, for example, in a user's home, and the display device 1 (details The communication control circuit 706) controls the user's smartphone (a smartphone equipped with a GPS receiver). It communicates with smartphones and other devices to obtain the location information of users while they are out (including smartphones that users have). Then, after the user returns home, etc., the character When communicating with the controller 1100, the processing board 224 performs the operations described above. It is recommended to control the character so that it is executed. Note that the character's voice and movements can be changed as needed. It would be good to do so.

[0131] <Communication functions related to user behavior patterns> In addition, if it is determined that the user's behavior pattern matches a predetermined behavior pattern, A voice corresponding to a specific action pattern is output as the character voice of the character 1100. Figure 39(A) shows the communication regarding the behavioral pattern. Fig. 39(B) is a flowchart for reproducing the character related to the behavior pattern. FIG. 10 is a diagram showing a voice management table for voice.

[0132] For example, in the processing board 224, the days of the week when the user works (for example, Monday to Friday) The time of commuting to work (e.g., 8:30) and the specific route used when commuting to work are used as the "commuting behavior" The user registers the pattern in advance. When the user's location information is received from the processing board 224 (step S61), the processing board 224 Based on the location information, it is determined whether the user's behavior pattern matches a predetermined behavior pattern. For example, if a user travels a specific route at 8:30 on Tuesday, In this case, the processing board 224 determines that the user's behavior pattern matches the "behavior pattern when coming to work." Then, in step S63, the processing board 224 determines that the voice Based on the management table, the voice (e.g., For example, "Good luck at work!" is spoken as the character voice of character 1100. In this way, the reaction according to the user's actions is output from the camera 2551 and 2552. By showing the character, the user's attachment to the character can be increased. It should be noted that a predetermined behavioral pattern (for example, a behavioral pattern when going to work) can be It is not essential that the information is registered in advance. For example, if the processing board 224 has a learning function, By learning the user's behavioral patterns, predetermined behavioral patterns are registered. You can do this.

[0133] <Communication function for detecting suspicious individuals> In addition, if a person detected in the detection target space is judged to be suspicious, a predetermined action will be taken. After the predetermined operation is executed, the user of the display device 1 When a suspicious person is detected, a voice message about the detection of a suspicious person is played in the character voice of the character 1100. Figure 40 shows the flow for realizing the operation related to the detection of a suspicious person. This is a chart.

[0134] For example, in the display device 1, as shown in FIG. 32, a viewer ( A photographing unit 227 (for example, a camera) is provided to photograph a user, etc. In detail, a sensor included in the photographing unit 227 detects the presence of a person in the detection target space. The "detection target space" may be, for example, the space in which the display device 1 is mounted. The range of the angle of view (capable of capturing images) of the image capturing unit 227 in the space where it is placed (for example, the user's home) The photographing unit 227 includes, for example, a lens and an image pickup element (for example, a CCD or The lens of the image capturing unit 227 captures a multicolor image. 32, the lens of the photographing unit 227 is located in a position where it can photograph the 100, above the observation area SC of the front panel 102 arranged on the front side of the The image capturing unit 227 is provided near the center in the width direction of the display device 1. For example, R, The image signals for the G and B color components are output to the processing board 224. The signal is processed to generate a captured image.

[0135] The processing board 224 monitors the detection target space using the imaging unit 227 (step S7 1). When the presence of a person is detected in the detection target space, the processing board 224 In step S72, user authentication such as face authentication is performed, and in step S73, The processing board 224 determines whether the identified person is a registered user of the display device 1. For example, if it is determined that the person photographed by the photographing unit 227 is a registered user of the display device 1, On the other hand, if the person photographed by the photographing unit 227 is not a suspicious person, the person is judged not to be a suspicious person. If it is determined that the user is a registered user, the processing board 224 performs the following steps in step S74: The system determines that the object is suspicious and performs a predetermined action. Examples of "predetermined actions" include: The operation of starting recording by the photographing unit 227, the operation of issuing an alarm at a relatively loud volume, An example of such a "predetermined action" is to notify a registered security company. Character 1100 calls out to a suspicious person (e.g., "Who's that? Say the password!") If there is no response from the person who is judged to be suspicious, or if the password is not correct, If the password is incorrect, the above-mentioned recording start operation may be executed. If the character is a typo, the processing board 224 will output a voice such as "That's not right! Say it again." When the password is determined to be incorrect, the character will output the voice of the character. In this way, for example, when a suspicious person is detected, the above-mentioned recording start operation may be executed. It is possible to withdraw from the target space, improving crime prevention in the detection target space. .

[0136] After the execution of the predetermined operation, the processing board 224 When this happens, a voice regarding the detection of a suspicious person is output as the character voice of the character 1100. An example of a "voice related to the detection of a suspicious person" would be "That was scary." This will increase the user's attachment to the character displayed on the video display unit. It can be made bigger.

[0137] In addition, when a detection target space is monitored using the display device 1, the display device 1 can be used not only to detect suspicious persons but also to The following operations may be performed:

[0138] For example, the display device 1 is placed in a reception space of a company, and the character 1100 is It may also be displayed as a receptionist. A Doppler sensor (one example of a detection means) detects the object of detection in a space to be detected (for example, a reception space). When the approach of a person is detected, the processing board 224 outputs a message saying, "Welcome. Which department are you in?" Is there anything I can do for you?" is output as the character voice for Character 1100. Then, the processing board 224 detects the visitor based on the response from the detected person (visitor). It is preferable to control the call so that the call is made to a department desired by the user.

[0139] <Communication function regarding the startup time of Display Device 1> The processing board 224 also determines whether the character 1100 uses a predetermined character voice. The startup time (e.g., cumulative startup time) of the display device 1 from the time (e.g., the time of the first startup) It is advisable to control the content of communication so that it changes depending on the processing base. As will be described later, the longer the activation time of the display device 1, the more the character 110 It is a good idea to control the voice so that it speaks to the user in familiar language.

[0140] For example, for the various character voices described above, it is possible to change the tone of voice to be polite, the character's relationship with the user, or the like. and three types of characters who speak as if they are in a romantic relationship with the user. It is preferable that the voice is registered in the voice management table in advance. When the operating time of the display device 1 is less than 100 hours, the processing board 224 Of the three character voice patterns registered in the In addition, when the start-up time is 100 hours or more and less than 1000 hours, the processing substrate 2 24 is the user's voice among the three character voice patterns registered in the voice management table. The character's voice sounds like they are friends. When the time exceeds 0, the processing board 224 performs the voice control of one of the three patterns registered in the voice control table. Among the character voices, a character voice with a tone of voice that sounds like the character is in a romantic relationship with the user is output. do.

[0141] In this way, the user can see that the character's way of speaking to him or her has changed. By doing so, you can feel that your relationship with the character (for example, intimacy) has changed. can.

[0142] Depending on the time elapsed since the last startup, the processing board 224 may not be able to respond to the user's request. For example, the display device 1 may be controlled to decrease the intimacy level of the character 1100. Even if the startup time exceeds 100 hours, if one week has passed since the last startup, When the user speaks, the processing board 224 uses polite character voice instead of speaking in a tone that is on an equal footing with the user. In this way, the user can hear the voice displayed on the video display unit. In order to maintain intimacy with the character, try to interact with the character as quickly as possible. This will further increase the attachment to the character.

[0143] In addition, the processing board 224 carries a greeting voice such as "Nice to meet you" at the time of the first start-up. The voice is output as a character voice and is displayed for a predetermined period (for example, one month) from the first time the device is started. Once the anniversary has passed, the message will include something that indicates the anniversary (for example, "It's been a month since we met"). It is recommended to output the voice as a character voice. This can further increase the attachment of

[0144] <About communication functions that link with other devices> In addition, for example, when the display device 1 is installed in a user's home or the like, it is possible to link the display device 1 with other devices. For example, the following operation may be performed by a device that can communicate with the display device 1 ( When a user visits a place where another device is installed, the other device As described below, the user is identified and information suitable for the user (e.g., group For example, the display device and other The facial image of the user who uses the linked system with the device and the display device owned by the user The device (for example, IP address) is associated with the device and registered in advance in an external server or the like. The control unit of the other device may, for example, detect the person by using a sensor included in the imaging unit of the other device. When a person is detected, the facial image of the person detected in the captured image is compared with the user ID registered on the external server. The user of the display device 1 is identified by comparing the image with the user's facial image. The control unit of the other device controls the display device registered in association with the user in the external server. The user of the display device 1 is detected. The processing board 224 of the display device 1 has a Information suitable for the user (e.g., gourmet information and event information) is pre-registered and processed. In response to receiving a signal from the other device, the board 224 The control unit of the other device then transmits the information received from the display device 1. The received "information suitable for the user" is output (for example, as a voice output). When providing the information, the other device displays the character 1100 on its display screen. In addition, the information provided to the user may be transmitted from the other device to the display device 1. The information may be stored as user information in the processing board 224 of the display device 1. For example, if the display device 1 is installed in a user's home, when it detects that the user has returned home, The logic board 224 converts voices such as "Did you go to **? How was it?" into character 1. It is recommended to output the voice of the character 100. In this way, This can increase the user's attachment to the character.

[0145] <Other communication features> Furthermore, the following control may be performed based on the detection results from various sensors.

[0146] For example, a wind detection means (for example, a wind sensor) capable of detecting wind (for example, wind speed) is provided in the display device. The wind sensor is provided on the front panel 102 of the first wind sensor, and based on the detection result of the wind sensor, The wind may be artificially generated by the user, for example. For example, wind and breath (exhalation) generated by moving a part of the body, such as waving a hand towards the display device 1, For example, wind with a speed greater than a predetermined value may be used. When the wind sensor detects the wind, the processing board 224 The character's (e.g., character 1100) hair (e.g., hair) and clothing (e.g., skirt) For example, an image of a lit candle may be displayed on the screen. When the wind sensor detects wind, the processing board 22 4, it is recommended to switch to the video of the candle flame going out. When the wind speed is greater than the threshold, the clothing of the character 1100 The processing substrate 224 may flutter more strongly depending on the strength of the detected wind (for example, wind speed). It is a good idea to switch the video.

[0147] In addition, for example, an object detection method capable of detecting the presence or absence (existence) of an object and the distance to the object is also available. A stage (for example, an ultrasonic sensor) is installed in the display device 1, and the detection result by the ultrasonic sensor is displayed. For example, the processing board 224 may be configured to include an ultrasonic sensor. Based on the detection result, the observer is directed to the character 1100 recognized as a 3D image. When it is determined that the character 1100 is touching the screen, an image showing the character's reaction is displayed. In addition, the processing board 224 may be touched by the observer at the character 1100. The display may be controlled so that the character reacts differently depending on the part of the body that is touched. The parts that can be touched by the observer in this example are the head, chest, abdomen, buttocks, or legs. It is advisable to use body parts such as those exemplified by the character 1100. The parts that can be touched are the clothing (for example, clothes, skirts) and decorations ( For example, accessories).

[0148] In addition, for example, an earthquake detection means (for example, a seismic sensor) capable of detecting an earthquake and measuring the seismic intensity is provided. The processing board 224 is provided in the display device 1, and when the seismic sensor detects an earthquake, , it is advisable to issue an earthquake warning.

[0149] In addition, for example, a weather sensor capable of measuring the weather is provided in the display device 1, and the processing board 224 The weather sensor notifies users of weather changes and weather forecasts based on the results of measurements made by the sensor. The weather sensor may include, for example, an air pressure sensor, a temperature sensor, and a humidity sensor. It is preferable that the weather can be measured based on the detection results of the sensor.

[0150] The processing board 224 also includes a temperature and / or humidity sensor. The facial expression and movement of the character displayed on the video display changes depending on the humidity detected by the sensor. It is recommended to display images with changing motion.

[0151] The processing board 224 also receives the detection results of a human presence sensor such as a microwave Doppler sensor. (For example, the distance between the display device 1 and the viewer) It is a good idea to display footage of the person's facial expressions and movements changing.

[0152] The processing board 224 also uses a humidity sensor to detect the humidity of the air blown by the user. Furthermore, the processing board 224 also uses a temperature sensor to determine whether the It is preferable to determine the type of breath blown by the user. , it is preferable that the second sensor 2332 be provided in the display device 1 .

[0153] Here, the breath blown by the user may be, for example, a "whoosh" breath, There are two types of breath: the "yow" breath and the "ha" breath. When you do this, you blow in a quick "whoosh" sound, so here we will refer to the "whoosh" sound as " It is called "cold breath." Generally, when blowing warm breath, you should make a slow "ha" sound. Since it involves blowing, the breath blown out is called "warm breath" here.

[0154] Regarding these two types of breath, the inventors of the present application have obtained the following findings through experiments etc. First, regarding humidity, a temperature and humidity sensor (for example, a temperature sensor and a humidity sensor integrated together) At a position a predetermined distance from the temperature and humidity sensor, breathe "whoosh" towards the sensor. Measurement results showed that when sprayed, the humidity rose sharply from a steady state immediately afterwards. After that, the humidity increased monotonically while the breath was being blown, and then decreased when the breath was stopped. Measurement results showed that under the same conditions, it takes several tens of seconds for the temperature to return to its normal state. The same measurement results were obtained when the user blew "ha" sound toward the temperature and humidity sensor. On the other hand, when blowing on the temperature, the temperature drops slightly from the steady state. The temperature either drops or remains almost flat, and if you blow on it, the temperature rises. The results were obtained. Note that the breath of the user blowing on the display device 1 is This is an example.

[0155] Taking into consideration such findings, for example, in a display device 1 provided with a humidity sensor, When the humidity sensor detects a sudden increase in humidity from a steady state, the processing substrate 2 24 is judged (also called determined) to have been blown on by the observer. If the monotonous increase in humidity is no longer detected after that, the processing substrate 224 is Alternatively, it may be determined that the operation has stopped after a predetermined time has elapsed since the sudden increase in humidity was detected. After a certain period of time (for example, the time it takes to exhale normally (for example, about 3 seconds)) has passed, the processing The plate 224 determines that the blowing has stopped regardless of the humidity detection result at that time. It is best to decline.

[0156] Furthermore, when a sudden increase in humidity is detected by the humidity sensor (e.g., When the temperature sensor detects that the temperature has risen above the steady state, The logic board 224 determines that the type of breath blown by the observer is "warm breath." Conversely, when a sudden increase in humidity is detected by the humidity sensor, The temperature sensor detects that the temperature has not changed from the steady state or has dropped from the steady state. When notified, the processing board 224 determines that the type of breath blown by the observer is "cold breath." It is best to judge that this is the case.

[0157] The processing board 224 then outputs video and audio in response to the detection of the blowing on the screen. It is preferable to output the movement and voice of the character displayed on the image display unit. The processing board 224 displays images and sounds corresponding to the type of breath blown on the image display unit. For example, the processing board 224 If the type of breath blown by the observer is "cold breath," the character The image of the subject's clothes fluttering was displayed, and the type of breath blown by the observer was determined as "warm" If the character is "breath," the image of the character making a movement to avoid the breath is displayed. good.

[0158] Furthermore, the inventors of the present application have also obtained the following findings using various gas sensors. At a position a predetermined distance (for example, about 10 cm) from the gas sensor, When you blow into the gas sensor, the output value of the gas sensor immediately drops. The measurement results showed that when the gas sensor was turned on, the output value of the gas sensor immediately began to increase. When you blow a "breath" into the gas sensor, the output value of the gas sensor immediately The measurement result showed that immediately after the breath was released, the output value of the gas sensor began to decrease. In addition, when the wind blown by a blower (for example, an electric fan) hits the gas sensor, When the gas sensor output drops, the air from the fan no longer hits the gas sensor. The measurement results showed that the output value of the gas sensor increased.

[0159] Taking into consideration such findings, for example, in a display device 1 provided with a gas sensor, If the output value of the gas sensor suddenly drops from the steady state, it is due to the breath blown by the observer. On the other hand, if the output value of the gas sensor is in a steady state, If the temperature rises sharply from the It would be good to be judged.

[0160] A wind sensor may also be used to detect breath. According to the results, it is possible to detect a relatively weak wind, such as that caused by holding a piece of paper up in the air. It peaked immediately when I started, and I confirmed that it had good response when the wind started to blow. However, if you continue to blow, it will quickly drop from its peak. Strong winds can cool the heater down and it may take a long time to recover.

[0161] In relation to the configuration for detecting breath using a wind sensor, the following configuration may be adopted.

[0162] When the wind sensor continuously detects a predetermined wind volume, the processing board 224 It is best to process in a direction that is not being blown. The processing in the direction of no breath is, for example, processing to determine that no breath is being blown. The processing board 224 detects the time from when the wind sensor starts to when it stops detecting the wind. When the blowing is possible within the time limit, the processing of the direction in which the breath is being blown is performed. It is a good idea to do so.

[0163] In this case, the wind sensor electrically measures the heat taken away by the wind. In this sensor, the sensor may detect the wind by detecting the The wind corresponds to the amount of air blown onto the sensor. If the time corresponding to the time the alarm is set continues, the actual air volume will be The sensor is set to a low value, so that the amount of air blown onto the sensor is If the value is smaller than , it is preferable that the setting be made so that this drop is unlikely to occur.

[0164] In the display device 1, the wind sensor is a plurality of wind sensors, and the wind sensor detects the inflow path of the breath. A common flow path for wind to flow in may be provided. It is preferable that the airflow is configured to flow at a predetermined ratio other than 1:1. The ratio and the difference in the characteristics of the multiple wind sensors are used to calculate the magnitude and The display device 1 may determine the time during which the airflow rate drops below the actual value. The processing board 224 is provided with a plurality of wind sensors with different timings for dropping in. The display device 1 may determine the magnitude and duration of the breath blowing based on the output of The plurality of wind sensors include at least a wind sensor that is not a gas sensor and a gas sensor. It may be prepared.

[0165] It is also preferable to use a gas sensor for detecting a predetermined gas as the wind sensor. The gas sensor for detecting a predetermined gas as the wind sensor is a gas sensor equipped with a heater. In this case, the gas sensor equipped with the heater detects the temperature of the object by breathing or When the degree of breath is relatively small, the amount of detected gas is large (as a result of detecting gas contained in breath). On the other hand, when the degree of breath blowing is relatively large (in response to the wind of the breath), It has the characteristic of outputting in the direction of decreasing the amount of gas detected (due to cooling of the heater by It is a good idea to use something like this.

[0166] When the processing board 224 determines that a breath is being blown, the strength of the breath is relatively large. When the wind speed is high (for example, when the wind speed is above a threshold), the clothes and hair of the character 1100 are When the strength of the animation is relatively low, the character It would be better to display a different animation from the animation that moves the clothes and hair of the 1100. stomach.

[0167] When a gas sensor is used to detect breath, the gas sensor detects the components contained in human breath. The output value is output in response to the gas (e.g., carbon dioxide). The gas sensor output differs depending on whether a breath is blown or not. The reason for the different force values is that when a "whoosh" sound is blown, the force of the blown sound is The speed of the particles is high and they tend to diffuse into the surrounding area immediately after hitting the gas sensor. When breath is blown, the velocity of the breath is low and it continues to flow even after hitting the gas sensor. It is thought that breath components tend to remain in that location.

[0168] Furthermore, the processing board 224 may also use the humidity detection result of a humidity sensor, for example. Whether the wind was caused by the observer blowing on the object or by a fan For example, in the display device 1, when the output value of the gas sensor suddenly changes from a steady state, The humidity sensor detects a sudden drop in temperature and a sudden rise in humidity from a steady state. When this occurs, the processing board 224 may determine that the user has blown on the device. Although the output value of the gas sensor dropped sharply from the steady state, the humidity remained steady. When this happens, the processing board 224 may determine that air is being blown by the fan. Furthermore, the processing board 224 can be controlled by the user using the temperature detection result of the temperature sensor. When it is determined that breath has been blown, it is advisable to determine the type of breath. If the output value of the gas sensor repeatedly rises and falls within a relatively short fixed period, the processing The substrate 224 may determine that it is being exposed to the wind of an oscillating fan.

[0169] In addition, wind sensors, humidity sensors, temperature sensors, and temperature and humidity sensors are used to detect wind. The display device 1 includes a sensor for detecting wind, a wind sensor, and a gas sensor. The air pressure may change depending on the occurrence and strength of wind. Because.

[0170] The above-mentioned various controls can be executed. Not limited to 00, communication regarding other characters (e.g., character 1200) This may be done for application functions.

[0171] <7. Specific examples of images displayed by the display device 1> Next, specific examples of images displayed by the display device 1 will be described with reference to FIGS. 41 to 55 show the characters (described in FIGS. 1B and 1C) displayed on the display device 1. 41 to 55. Each of the images shown in FIGS. 41 to 55 is a diagram showing an example of a video including a character 1200. The image is displayed on the display device 1 and can be observed by an observer through an observation area SC. 41 to 55 show a stage image 2200. Alternatively, the character 1200 may be displayed without displaying the character.

[0172] 41 to 47 show the display device 1 detecting the behavior of the observer based on the communication function. This is the display that is performed during the standby period. The display device 1 (specifically, the processing board 224) The display is switched regularly or randomly. For example, as shown in Figure 41(a), As shown, the character 1200 is standing facing the front side (observation side) of the display device 1. The display device 1 uses this posture as a basic posture and is used as a base for communication functions. For example, the display of the period when no communication based on the ), the character 1200 makes a motion as if licking its front paw. For example, As shown in FIG. 41(c) and FIG. 42(a), the character 1200 crosses its left and right sides. For example, as shown in Figure 42(b), the character 1200 For example, as shown in FIG. 42(c), the character 120 For example, as shown in Figure 43(a), The character 1200 looks down at the ground. As shown in FIG. 43(c), the character 1200 moves in a manner as if walking forward. When the character 1200 is made to walk, the display device 1 displays a stage image. Without showing the character 1200, the character 1200 steps in place and the overall position of the character 1200 is The display device 1 may display an image in which the character 1200 is barely moving. When performing an action other than the action, the stage image is displayed at the feet of the character 1200. good.

[0173] For example, as shown in FIG. 44(a), the character 1200 is peering into his own abdomen. For example, as shown in FIG. 44(b), the character 1200 tilts its head. For example, as shown in FIG. 44(c), the character 1200 For example, as shown in FIG. 45(a), the character 1200 For example, as shown in FIG. 45(b), the character 1200 is sitting. For example, as shown in Figure 45(c), 1200 moves to look diagonally forward to the left. For example, as shown in FIG. 46(c), the character 1200 stretches. Then, the character 1200 makes a motion as if peering down at the ground. As shown, the character 1200 faces diagonally forward to the right of the display device 1, and then moves to the position shown in FIG. As shown in FIG. 47(b), the character 1200 faces forward. It licks its front paws.

[0174] 48 to 55 show the display device 1 (specifically, the processing board 224) as a communication function. 48 to 55 are examples of the display of the character 1200 during dialogue processing in the Noh. The character string to be displayed is a character string that can be recognized by voice recognition and is displayed above the character 1200. This is because the phrases (sentences) recognized by speech recognition are It is preferable that the message be displayed as a message and then hidden after the predetermined time has elapsed. The character 1200 is controlled to start speaking after the phrase (speech recognition result) is hidden. It would be good if you could do this.

[0175] FIG. 48(a) shows the state when the display device 1 recognizes the observer's utterance "Come on over here." In response to this, a sound is output. This is displayed when the display device 1 recognizes the observer's utterance of "sit" and In response, a voice is output. In FIG. 49(c), the display device 1 outputs a message saying "Are you hungry?" This is displayed when the observer's speech is recognized, and a voice is output in response. 50(a) is displayed when the display device 1 recognizes the observer's utterance of "police officer." In response to this, sound is output. It is displayed when the observer's utterance "It's his time" is recognized, and in response to this, 51(a) shows the state in which the display device 1 recognizes the observer's utterance of "hands up." The message is sometimes displayed, and a voice is output in response. ) is displayed when the display device 1 recognizes the observer's utterance of "cute," In response to this, sound is output. The display device 1 can be used to project a sound from a position other than the center of the stage image (for example, For example, when displaying the character 1200 at a position on the front side, When rotating 0, the stage image 2200 also rotates in the same way as the character 1200. In addition, the display device 1 displays a stage image 220 having a shape with a relatively large distance in the depth direction. 0 is displayed, and the stage image 2200 is displayed inside the stage image 2200. A video of a character 1200 moving along the outer edge of a circular stage (for example, It is a good idea to display a video of a cat character walking along the road.

[0176] FIG. 52(c) shows the display when the display device 1 recognizes the observer's utterance of "Hello." In response to this, a voice is output. This is displayed when the robot recognizes the observer's utterance of "eat," and a voice responds to this. 53(b) and (c) show the state where the display device 1 recognizes the observer's utterance "Is it a girl?" When the display is recognized, a voice is output in response. This is displayed when the display device 1 recognizes the observer's utterance of "wait" and responds to this. FIG. 54(b) shows the display device 1 outputting the observer's utterance "What a good boy!" This is displayed when the device recognizes the message, and a voice is output in response. FIG. 55 shows what is displayed when the display device 1 recognizes the observer's utterance of "Yuno." In response to this, a sound is output.

[0177] <8. More detailed explanation of character 1200> More details about the character 1200 described in FIGS. 1B, 1C and 41 to 55 In the following description, when the display device 1 is the subject of processing, The character 1200 is particularly suitable when it is drawn with a body proportion of approximately 3:1. It has been found that this arrangement particularly emphasizes the sense of depth. When viewed from the side, the head is roughly one-third, the torso is one-third, and the legs are one-third. The character 1200 may be drawn so that it occupies the height. When viewed from the side, the head occupies roughly one-third and the body two-thirds in the left-right direction. It is advisable to draw the character 1200.

[0178] The display device 1 is configured to alternate between a state in which the tail is visible and a state in which the tail is not visible, with the face facing forward. It has a function to draw the tails in a displaced manner, and the time when the tail is visible is longer than the time when the tail is not visible. The tail will be drawn further back than the head, but sometimes the tail can be seen. This allows you to feel a greater sense of three-dimensionality, and the constant sense of three-dimensionality makes it easier for your eyes to focus. In particular, the display device 1 can prevent the user from getting tired and mentally fatigued when in a voice recognition standby state. When the display device 1 changes to a state where the tail is visible, the head It would be good to have a function to draw the tail so that it appears from the top of the The tail suddenly jumps out from the center of the face above the head when the observer's gaze is on the face's eyes. This can provide surprise and excitement.

[0179] The display device 1 may have a flat portion on the top of the character 1200's head when viewed from the front. In particular, it is a good idea to draw the head between the left and right ears flat when viewed from the front. A three-dimensional tail suddenly appears on top of the head, which is a flat head with a weak sense of touch, This can provide surprise and interest. In addition, the display device 1 can be displayed as if a tail appears from above the head. After drawing the tail, it is a good idea to move the tail tip. It can be gathered in the tail part further back, giving it a more three-dimensional feel. Similarly, the display device 1 may render tails appearing from the left and right sides of the body. When the tail appears from the right, the length of the tail that appears is longer than when the tail appears from above. The display device 1 may be configured to appear from the left and right. The display device 1 should be designed so that the viewer's eyes occasionally move to the back. The display device 1 may be configured to draw images in a way that makes the image appear more three-dimensional. The tail appears from above the head during voice recognition, but moves to the left and right when the cat outputs voice. The display device 1 may be configured to display a tail with a predetermined length in the longitudinal direction. It is advisable to provide areas with different drawing styles at regular intervals. For example, the tail cylinders can be arranged at regular intervals. It is advisable to apply a circular or arc-shaped pattern with a predetermined width to the surface. The inventors found that the robot feels like it moves more dynamically in three-dimensional space. .

[0180] The display device 1 is configured to change the posture from a state where voice recognition is not being performed so that the display device 1 maintains the same posture during voice recognition. When there is a change in the state during voice recognition, the current posture is changed to the same posture. It is recommended that the display device 1 should be able to recognize the user by saying "Let's talk" before starting the voice recognition. The display device 1 has a function to detect the action of the viewer (for example, a sensor or a switch), and It would be good to have a function that says "What's that?" when it detects an action from the observer. is executed in succession in the form of "What's that?" and "Let's talk" and then the voice recognition state is It is recommended to process the system so that it enters this state.

[0181] The display device 1 uses phrases that are praiseworthy, such as "cute," as phrases for speech recognition. When equipped with information and recognizing words and phrases that are commendable, it is a good idea to change your body posture. It would be even better if the cat itself moved, such as walking. Because they want to see changes in posture and movement, they start to praise and act in a way that is more effective than their actions and words. This provides excellent therapeutic benefits, such as improved movement.

[0182] The display device 1 has a speech recognition phrase corresponding to feeding, and recognizes the phrase. In this case, it is a good idea to draw the tail wagging faster than in other cases. It gives the observer the feeling that the object is actually alive.

[0183] The display device 1 depicts the outer contour of the cat's eye as a roughly circular shape, and the pupil as a vertically elongated oval. The display device 1 should be able to process the pupil area by applying a gradation of light and dark in the vertical direction. The display device 1 may be drawn in brighter colors toward the bottom. The center of the display device 1 may be approximately circular or elliptical and may be darker than the surrounding area. On the outer part of the face above the pupil, there is a crescent or half-moon shape along the outer edge of the pupil. In contrast, the display device 1 displays the white area in the center of the face below the pupil. It is preferable to provide a circular white area at the near position and draw it. The image shows the change in the position of the character 1200 (such as a change in posture), or the position of the camera or light. It is good to keep drawing even if the position changes. However, by doing this, it is possible to The eyes are the most visible part of the cat's personality, so you can highlight them and create a unique cat. This allows you to make an impression in the short time it takes for voice recognition to be performed.

[0184] The display device 1 can be in a state where the face is facing forward and a state where the face is facing downward. When the face is facing forward, the outline of the eyes is drawn in a roughly circular shape, while when the face is facing downward, To draw the eyes, draw them as long, horizontal ovals.

[0185] The display device 1 is configured to display a state in which the top of the face is above the top of the body, and a state in which the top of the face is above the top of the body. When the top of the face is above the top of the body, the outline of the eyes is roughly circular. However, if the top of the face is lower than the top of the body, the eyes are drawn in a horizontal oval shape. The display device 1 has a function of drawing a state of yawning with the mouth open, It is a good idea to close your eyes when drawing this.

[0186] The display device 1 provides a plurality of standby motion patterns for the character 1200. Then, select one pattern from these patterns and repeat the process of drawing it. The standby motions are licking its paws, stroking its face with its hands, Butt licking motion, front facing motion, left and right looking motion, ground licking motion Motions include yawning, stretching, yawning, walking, etc. be.

[0187] The display device 1 may be configured to draw the ears so that their movement lags behind the movement of the face. It is advisable to draw the ears so that they remain in their positions for a while even after the licking mode starts. When performing this action, it is advisable to have a function that simultaneously performs a tail wagging motion from side to side. The display device 1 is designed so that the pattern on the body of the character 1200 is asymmetrical when viewed from the front. This way, it will be easier to remember the cat as a unique character, and the right side will be visible. It becomes easy to distinguish whether the left side or the right side is visible. This is useful when creating a scene that is so enlarged that the whole image cannot be seen. It is good to make it look like a cat, especially a tabby cat pattern. This will help you to grasp the three-dimensional effect. In particular, the pattern on the head is provided in the front-to-back direction, while the pattern on the body is provided in the front-to-back direction. It is advisable to arrange the patterns in different directions, such as vertically. This will make it easier to recognize changes in the camera and cat's position, regardless of which direction they move. It becomes.

[0188] The display device 1 has a function of emitting a meowing sound, and the meowing sound It has multiple intonations, and each cry corresponds to a different motion. It is advisable to use a structure that allows for matching. It is recommended that the robot has a head tilting motion.

[0189] <9. About the communication function for Character 1200> The following is a summary of the communication functions for character 1200. This will provide the observer with a higher quality communication function with the character 1200. Here we will provide you with 1200 actions and characters to tame. In this embodiment, as shown in FIG. On the front side of the display device 1, an image capturing section 227 for capturing an image of the viewer is provided.

[0190] (9-1) First step: Taming Usually, stray cats and other cats have various traits that cause them to run away when they see a person or when a person approaches. There is a cat in the park. At that time, the cat's behavior is to look back many times to check the person's condition and then run away. Here, the processing board 224 is based on the photographed image taken by the photographing unit 227. The presence of an observer is recognized based on the intensity of the microwave measured by the human presence sensor 234. When the received signal strength exceeds the threshold, the character 1200 is shown running away. This is because the cat is considered to be approaching a person. This is to show the observer the scene where the character 1200 escapes. The character 1200 will not run away unless you approach the display device 1 from the front side. are.

[0191] Next, people crouch down (lower their eyes) and say things like, "Come on, come on" to the cat. It is possible to imagine what kind of voice they are calling. Some cats stop and check the situation. When a person approaches, the cat runs away. This happens several times. It is thought that the cat will not get used to it. Therefore, the processing board 224 During the period when the image being displayed is being displayed, the microwave intensity measured by the human presence sensor 234 If the degree is equal to or less than a certain threshold and the character 1200 is called out, for example, "Come on over." When the speech recognition recognizes a word indicating this, the character 1200 will stop moving. The image is displayed. Here, the condition is that the microwave intensity is below the threshold. This is because it assumes that a person will stop moving.

[0192] Next, a person might feed a cat that has stopped by. However, when a person approaches a cat, Since cats tend to run away, the only way to deal with this is to place food in places where cats often visit. The display device 1 has a function of displaying an image in which food is placed in the image display space. The substrate 224 receives a predetermined operation using the operation area OT (for example, an operation of the operation unit 2214). When the first sensor 2231 receives a predetermined gesture instructing the placement of food, If detected, it is assumed that food has been placed and an image showing the food is displayed in the video. The image may be displayed using either the first display unit 310 or the second display unit 330. In this way, the observer can place food, for example, every day. In this case, it is advisable to display the character 1200 as if watching the scene from a distance. The board 224 does not recognize the presence of an observer using the human sensor 234, and the photographing unit 227 When the observer is not photographed, an image of the character 1200 eating food is displayed. Here, a situation is recreated in which a cat refuses to eat food in front of a person. The processing board 224 is a device that allows the observer to The number of times the food has been given is counted and stored. This state continues for a while. The processing board 224 gradually changes the relationship between the observer and the character 1200 depending on the number of times the food is given. It is recommended to display the image in such a way that the distance (the distance perceived by the observer) between the object and the object decreases. The board 224 starts feeding the character 1200 and the number of times it has been fed increases. By making the display clearer, it is possible to recreate the feeling that the distance has been shortened (i.e., the user has become somewhat accustomed to the display). Furthermore, as the number of feedings increases and reaches a certain threshold, the cat will begin to feel accustomed to the food. Therefore, even if the observer is looking at the character, the processing board 224 detects the presence of the human sensor 234. Even when the presence of the observer is recognized using the above and the observer is photographed by the photographing unit 227, An image of the character 1200 eating food is displayed. You can observe Rakuta 1200 eating food.

[0193] However, it is often the case that people do not know when a cat will eat. 224 is the time period when the character 1200 eats food (instead, It is also possible to determine a time period during which the character 1200 eats food. Good. This is to make the observer aware that it seems like they are feeding at this time of day. The processing board 224 detects that the observer is about to touch the character 1200. The character 1200 is given a predetermined utterance, "Shah" or "Shah Shah." The observer outputs the character 1200 and makes the character 1200 run away. Trying to touch 1200 means that character 1200 is eating food. When the human presence sensor 234 detects that the microwave intensity exceeds a threshold value, It is preferable that the first sensor 2331 detects a predetermined gesture.

[0194] This situation continues for a while, but the processing board 224 gradually changes the character of the observer's hand. It is a good idea to shorten the distance that you can get close to Kuta 1200. When this happens, the processing board 224 determines that the character 1200 has become accustomed to the observer and It is advisable to display an image of the robot grooming itself or relaxing in front of the robot. The threshold for microwave intensity or the time at which the gesture is made is increased. The threshold value for the distance from the display device 1 is increased. In this way, the processing board 224 By gradually lowering the detection sensitivity, the reaction of the character 1200 to the observer's movements becomes slower. Also, do not allow them to make sounds such as "shhh" or "shhh shhh."

[0195] Cats are always on guard, but they also start grooming themselves, lying down, scratching their claws, and wiping their faces. As cats get used to people and their hands, people can start touching them with their hands. Then, the processing board 224 converts the microwave detection result of the human sensor 234 into the character 1 The processing board 224 may be configured to control the first sensor 2331 so that it is not reflected in the operation of the 200. It functions as a motion sensor and detects the observer's gestures in the up, down, left, right, forward and backward directions. Therefore, it is advisable to display an image in which the character 1200 looks comfortable when stroked. The processing board 224 further recognizes the viewer's voice through a microphone 2333 and For example, the processing board 224 may Even if it recognizes a word like this, it will produce the meow sound "nya" as the speech content. It is recommended to do so.

[0196] The processing board 224 further controls the character 1200 to beg for food as time passes. The processing board 224 recognizes the presence of the observer by the photographing unit 227. When the presence of an observer is detected by the human sensor 234, the time period (for example, Decide on a time (morning, afternoon, or evening) and have your cat make a "meow meow" sound and rub its face against yours. Furthermore, the processing board 224 can be used to display an image of the character. As you talk to Character 1200, you can see how Character 1200 remembers your name. For example, the processing board 224 may only respond to the word "Yuno" and not to "Nya." You can make it make sounds like "Yuno" or "Here's food." When you show images of the cat behaving in a sweet way or rubbing against you happily, good.

[0197] (9-2) Second step: Learning the language (Japanese) When the processing board 224 recognizes the observer's voice saying "Yuno", it responds by saying "What From this point on, the character 1200 will learn the words and The processing board 224 counts the number of times the call is made and calculates the cumulative average / Take a day and calculate the cumulative average number of times the animal was fed / day x cumulative average number of times it was called x random coefficient. The answer will be based on the value calculated from the above (hereinafter referred to as the "cumulative average value"). For example, "Good morning," "Hello," "Good evening," "How are you?", "Do you want some food?" The processing board 224 stops responding depending on the cumulative average value. (i.e., recreating that character 1200 has forgotten the words), or For example, the processing board 224 may increase the response word as the cumulative average value decreases. The larger the cumulative average value, the more words to respond to. , calculated based on the number of times the user has been called out from the time the display device 1 was first used until the present time. However, based on the number of times the person was approached from a certain period of time back to the present, The predetermined period may be fixed, such as one month, or may be calculated based on the display. If the device 1 has not been used for a certain period of time, the period from the time when it is first used after that period In the early stages of use of the display device 1, the cumulative average value may vary significantly. Therefore, for example, if the observer does not speak to the character 1200 even once a day, the character 1200 will not respond. However, as the number of calls increases, the cumulative average value changes significantly. This way, it will take time for character 1200 to forget the words. The random coefficient used to calculate the cumulative average is based on the whims of the cat. The random coefficient is a value used to reproduce the character's Give / don't feed character 1200 when he begs for food. When the character is awake, you can call out to them or touch them to wake them up. It is recommended to vary it depending on 0 and the observer's actions.

[0198] When the cumulative average value exceeds a certain threshold, the processing board 224 further Talk to the observer and respond to questions about weather, news, and other predetermined information. Of course, if the observer reduces the number of feedings, the cumulative average will decrease. As the processing board 224 receives less and less of this response, it may become unresponsive. In other words, if the observer is careless in feeding the animals or does not speak to them properly, the characters may not be able to eat them. The Kuta 1200 may not respond properly, or may respond only at random. In this way, the observer is able to interact with the character 1200. It is possible to provide higher quality communication functions.

[0199] [Other embodiments] The present disclosure is not limited to the above-described embodiments, and may be modified as appropriate within the scope of the present disclosure. It is possible to do this.

[0200] The display device 1 has a touch sensor, a proximity sensor, or other sensors in the observation area SC that are operated by the observer. In this way, the observer can use the observation area SC to For example, in the communication function, When the law is adopted, communication with the character can be observed through the observation area SC. It is expected to have the effect of improving the quality of

[0201] The first display unit 310 may display an image that is recognized as a three-dimensional image (stereoscopic image). This is expected to have the effect of further improving the stereoscopic effect given to the viewer. Display methods include naked-eye 3D, such as lenticular lens and parallax barrier methods. In addition to the viewing method, a display method that allows the image to be recognized as a three-dimensional image using glasses may also be used.

[0202] The display device is not limited to a rectangular parallelepiped shape, but may be a cube, cylinder, other polyhedron, sphere, or other shape. The shapes, structures, dimensions, colors, patterns, etc. of the components of the display device 1 described above are examples. In addition, some of the components included in the display device 1 described above may be omitted, or a different component may be used. For example, the second display unit 330 may be omitted, or the background plate Instead of the display 910, a second display unit 330 that emits second image light L2 in the first direction is disposed in an upright position. Also, aerial imaging may be realized using an optical system other than that described in FIG. Furthermore, the configuration of the present invention may be a display system or a projector system, rather than an aerial imaging system. In the case of a display system, the present invention may be applied to a projector-type display device. LCD displays, organic EL displays, and other display types are used. For example, the image display unit is provided inside the image display space, and the direction of the observation area SC is A display unit having a display surface facing the viewing area SC (eg, a display surface parallel to the viewing area SC) may be used. This display unit has the same configuration as the first display unit 310 or the second display unit 330, and has a video display space. In the case of a projector system, the projection surface and the image projected thereon are The light-reducing member 200 is positioned more positively than the opening 110. It may be disposed on the front side or rear side to reduce light entering the image display space from the outside. If the image display space S1 is to be kept relatively dark, the dimming member 200 is installed. It is also possible to consider a configuration in which this is not possible.

[0203] In the above embodiment, in response to a pressing operation of the operation unit 2214, the image displayed on the image display unit Voice recognition is enabled for interacting with the characters, including but not limited to For example, a detection target of a human sensor (one example of a detection means) such as a full-circle microwave Doppler sensor When a person's presence is detected in the area, the processing board 224 activates the voice recognition. In this way, the user can easily interact with the character displayed on the video display unit. When interacting with a device, it may be necessary to perform an operation to activate voice recognition or to trigger a There is no need to pronounce the "do" sound, and communication can be reproduced more naturally.

[0204] At this time, for example, the voice recognition in the voice recognition application in the display device 1 and the voice recognition server However, as will be described later, it is recommended that both the display device 1 and the voice recognition on the server be enabled. Enabling speech recognition in the speech recognition application and on the speech recognition server For example, in the detection target area of the human presence sensor, When the presence of a person is detected, the voice recognition application in the display device 1 is enabled. After that, the voice recognition application recognizes the voices and greetings of the observers. Once detected, speech recognition may be enabled at the speech recognition server.

[0205] In addition, when the display device 1 is equipped with a photographing unit (an example of a detection unit) such as a camera, the display device A detection target space is provided on the front side of the display device 1, and the processing board 224 is When the presence of a person is detected, voice recognition may be enabled. The character displayed on the video display unit can be seen to be talking to the observer. Once this is determined with certainty, voice recognition can be enabled.

[0206] Furthermore, after a person is detected in the detection target area, the user authentication is successful. The processing board 224 may be configured to enable the voice recognition, provided that The authentication method for user authentication may be, for example, an authentication method that does not require manual operation by the user (face authentication). In this way, for example, a registered user registered in the display device 1 can When user authentication is attempted on a person other than the user and the user authentication fails, The recognition is not validated, and you cannot interact with the character displayed on the video display unit. In other words, the character displayed on the video display unit will not respond to people other than registered users. This can increase the user's attachment to the character.

[0207] In addition, the display device 1 or the external server may be equipped with a dialogue server that stores a message in advance. If speech of other words is detected, speech recognition may not be enabled.

[0208] An odor sensor may also be used as a means to enable voice recognition. For example, the scent of a registered user of the display device 1 is registered in advance in the display device 1, and the scent of the registered user is displayed. When an odor is detected by the odor sensor, voice recognition may be activated. .

[0209] Even if voice recognition is enabled in this way, for example, The voice of the character shown (e.g., character 1100) is not immediately output. It is better to make the character's voice silent unless the user speaks to it. For example, the processing board 224 may respond to voice recognition being enabled by saying "Welcome back." Instead of the character voice being output immediately, the voice recognition is enabled and the When the user's voice "Now" is detected, the character's voice will say "Welcome back." Furthermore, for example, in a dialogue system, the observer and the character (e.g. For example, a branching scenario is created to reproduce the following dialogue between the character and the person. For example, on weekdays, User: I'm home Character: Welcome back ~ User : Atchi character: Dialogues such as "Thank you for your hard work in this hot weather" are reproduced, and if it is a holiday, User: I'm home Character: Ah, welcome back User: Itchy Character: Why did you bother to come out in this heat? I called so I won't complain. User: It's work. Work character: Sorry if that's true. It would be good if branching scenarios were created so that dialogue such as "Thank you for your hard work" could be reproduced.

[0210] In addition, a branching scenario may be created depending on the detection results of the odor sensor. For example, User: "The food is delicious!" Character: "Well, let me smell it. Sniff sniff. "It smells bad!" or "Hmmmm! Isn't that a lot of salt? Take care of yourself!" may be reproduced.

[0211] As another example, when an odor is detected by the odor sensor, the character: Kun, what's that smell? User: I lit an aroma. Character: Oh, that's why. It may be possible to reproduce a dialogue that you thought would relax you. If the observer's response to a question of this type is not registered in the branching scenario, for example, It would be good if voices such as "Oh, is that so!" were uniformly output as character voices.

[0212] The processing board 224 also constantly records the audio of the most recent predetermined time (for example, about 15 seconds). When the trigger word for activating voice recognition is detected, the corresponding Voice recognition may be enabled. For example, a voice recognition application on the display device 1 may be The voice recognition server is always enabled (or in response to a pressing operation of the operation unit 41). The voice recognition by the processing board may be activated by detecting a trigger word. 224 is a detected voice ( For example, the trigger word is generated from the sound detected between the start and end of detection. The voice data of the voice, excluding the voice of the voice, should be sent to the voice recognition server. For example, Let's assume that the user's voice is "I'm going to Tokyo tomorrow. Tell me the weather, Rei-tan." In this case, the nickname of the character 1100, "Rei-tan", is the trigger word. In this case, the processing board 224 detects the voice "I'm going to Tokyo tomorrow, but I want to know the weather forecast from Rei-chan." The audio "I'm going to Tokyo tomorrow, but I'm going to Tokyo tomorrow" is taken from the audio "I'm going to Tokyo tomorrow, but I'm going to Tokyo tomorrow." "Tell me the weather, Itan" is sent to the voice recognition server.

[0213] For example, the detected voice is something like the above: "I'm going to Tokyo tomorrow. Tell me the weather, Rei-chan." If this is sent to the speech recognition server as is, "Rei-tan" will be included in the speech recognition results. This makes it difficult for the dialogue server to accurately recognize the character voice corresponding to the speech recognition result. In contrast, if the above-mentioned If you set it to "0", the trigger word will be recognized even if it is uttered in the middle of a sentence. The speech data excluding the trigger is sent to the speech recognition server. The dialogue with the user was not synchronized due to the fact that the speech recognition was performed with the It can prevent the loss of

[0214] In addition, the dialogue between the user and the character displayed on the video display unit is carried out by the voice recognition server and the dialogue server. To achieve this through collaboration with the speech recognition server, the following steps are taken depending on the configuration of the speech recognition server: Such actions may be performed.

[0215] For example, the voice recognition server may start voice recognition processing after receiving the voice data file. If configured to start, the processing board 224 starts the detection by the microphone 2333. Of the output audio, each audio data file before and after the trigger word audio can be individually recorded. For example, the detection time from the detection start time to the detection end time is transmitted to the recognition server. The user voice detected before the trigger word (user voice in the first half of the voice) The audio data file of the trigger word (also called "voice") is detected after the trigger word is spoken. The voice data file of the user's voice (also called the latter half of the user's voice) is preceded by a voice recognition server. This should be sent to the server.

[0216] In this way, the speech recognition server can recognize the first half of the user's speech. The process starts without waiting for the completion of reception of the voice data file of the second half of the user voice. Therefore, the voice data of the voice that combines the first half of the user voice and the second half of the user voice is To perform speech recognition processing more efficiently than sending a file to a speech recognition server. As a result, the display device 1 can receive the character voice from the dialogue server earlier. This reduces the waiting time for the user to receive a response to their voice. .

[0217] Also, for example, the voice recognition server may stream voice data from the display device 1 and If the speech recognition process is configured to run in real time, the first half of the audio data When the data is sent to the speech recognition server in real time, the playback speed of the first half of the user's voice is It is preferable that T1 is controlled to be faster than the standard playback speed T0 (T1>T0). For example, The processing board 224 recognizes that the first half of the user's voice is played back at the standard playback speed T Change the settings so that it plays 25% faster than 0, and send the audio data for the first half of the In this way, the speech recognition server can play back the first half of the user's voice at the standard playback speed. Compared to when played at T0, the speech recognition process for the first half of the user voice is performed more quickly. This allows the speech recognition process for the latter part of the user's voice to be started earlier. can be started. As a result, the display device 1 can receive the character voice from the dialogue server earlier, and can shorten the waiting time of the user until a response is made to the user's voice. The waiting time of the user until a response is made to the user's voice can be shortened.

[0218] Furthermore, when the voice data of the latter half of the user voice is transmitted to the voice recognition server in real time, the reproduction speed T2 of the voice in the latter half is faster than the standard reproduction speed T0 and slower than the reproduction speed T1 of the user voice in the first half (that is, it satisfies the relationship of T0 < T2 < T1). It is preferably controlled as follows. For example, the processing board 224 changes the setting so that the user voice in the latter half is reproduced 10% faster than the standard reproduction speed T0 in the voice recognition server, and transmits the voice data of the latter half. In this way, both the user voice in the first half and the user voice in the latter half are stream-reproduced faster than the standard reproduction speed T0, and voice recognition processing is executed in the voice recognition server. As a result, the waiting time of the user until a response is made to the user's voice can be further shortened. On the other hand, the user voice in the latter half is reproduced at a speed faster than the standard reproduction speed T0 but slower than the reproduction speed T1 of the user voice in the first half. Therefore, a decrease in voice recognition accuracy in the voice recognition system can be suppressed. Thus, it is possible to further shorten the waiting time of the user while suppressing a decrease in voice recognition accuracy. In the voice recognition server, when the voice recognition processing by the stream reproduction of the voice data is executed in real time, for example, although the user voice detected by the microphone 2333 is transmitted to the voice recognition server in real time, the voice of the trigger word is detected.

[0219] Note that in the voice recognition server, when the voice recognition processing by the stream reproduction of the voice data is executed in real time, for example, although the user voice detected by the microphone 2333 is transmitted to the voice recognition server in real time, the voice of the trigger word is detected. Although the user voice detected by the microphone 2333 is transmitted to the voice recognition server in real time, the voice of the trigger word is detected. ​​​​​​​​​It is preferable to control the speech recognition server so that speech recognition does not start until the speech recognition server receives the command.

[0220] The first display unit 310 and the optical member 320 are linked by the linking unit to swing relative to the housing. Embodiments of the present invention Next, the first display unit 310 and the optical member 320 are linked together and swung relative to the housing 100. An embodiment in which an interlocking portion 50 is provided for connecting the two ends of the lever 14 is described below with reference to FIGS. 56 and 57. FIG. 56 shows the interlocking portion 50 with the second worm 73 and second shaft member 74, which will be described later, removed. 57 is a plan view of the first display unit 31, and FIG. 58 is a view taken along the line AA in FIG. 56. 0 position, and also moves the position of the optical member 320. The interlocking unit 50 is an optical member moving means that moves the optical member from the opening 110 of the housing 100 to the rear side (the rear side ) is mounted in the housing 100.

[0221] As shown in FIGS. 56 and 57, the interlocking unit 50 includes a first rotating shaft 51, a second rotating shaft 52, Third rotating shaft 53, first gear 54, second gear 55, third gear 56, fourth gear 57, worm Wheel 58, first worm 59, first shaft member 71, first operating member 72, second worm 7 3, second shaft member 74, second operating member 75, first connecting member 65, second connecting member 66, first attachment It has a biasing member 67, a second biasing member 68, and a case member 69.

[0222] The case member 69 includes a bottom plate portion 69a, a first support plate portion 69b, a second support plate portion 69c, a third support plate portion 69d, a The bottom plate 69a has a support plate portion 69d and a fourth support plate portion 69e. The first support plate portion 69b and the second support plate portion 69c are formed by the bottom plate portion 69a. The first support plate portion 69b and the second support plate portion 69c are formed upward from the end portion in the width direction. The third support plate portion 69d and the fourth support plate portion 69e are opposed to each other. Between the second support plate portion 69c, from the front side portion in the depth direction of the bottom plate portion 69a upward The third support plate portion 69d faces the first support plate portion 69b. The portion 69e faces the second support plate portion 69c.

[0223] The first rotating shaft 51, the second rotating shaft 52, and the third rotating shaft 53 are rotatably mounted on a case member 69. Specifically, both ends of the first rotary shaft 51 are attached to the first support plate portions 69b. The second support plate portion 69c is rotatably supported on the rear side in the depth direction of the second support plate portion 69c.

[0224] The second rotation shaft 52 and the third rotation shaft 53 are located in front of the first rotation shaft 51 in the depth direction. The second rotation shaft 52 and the third rotation shaft 53 are arranged coaxially. The second rotating shaft 52 and the third rotating shaft 53 are arranged in a straight line, and the center lines of the second rotating shaft 52 and the third rotating shaft 53 are aligned. Both ends of the second rotary shaft 52 are rotatably supported by the first support plate portion 69b and the third support plate portion 69d. The third rotary shaft 53 is supported at both ends by the second support plate 69c and the fourth support plate 69d. e is rotatably supported by a shaft.

[0225] The first rotary shaft 51 is provided with a first gear 54, a warp gear 55, a gear 56, a gear 57, a gear 58, a gear 59, a gear 60, a gear 61, a gear 62, a gear 63, a gear 64, a gear 65, a gear 66, a gear 67, a gear 68, a gear 69 ... The wheel 58 and the second gear 55 are mounted so as not to be rotatable. The gear 54, the worm wheel 58, and the second gear 55 rotate together. The third gear 56 is non-rotatably attached to the first gear 54. The fourth gear 57 is attached to the third rotary shaft 53 so as not to rotate. The second gear 55 and the fourth gear 57 are in mesh with each other.

[0226] An optical member 320 is attached to the third gear 56 via a first connecting member 65 . Therefore, the third gear 56 and the optical member 320 rotate together. The first display unit 310 is attached via a connecting member 66. The first display unit 310 rotates together.

[0227] As shown in FIG. 56, the number of teeth of the first gear 54 is smaller than the number of teeth of the second gear 55. The radius of the gear 54 is smaller than the radius of the second gear 55. The number of teeth of the third gear 56 is The number of teeth of the third gear 56 is greater than that of the fourth gear 57, and the radius of the third gear 56 is greater than that of the fourth gear 57. It has become.

[0228] With this configuration, the value obtained by dividing the radius of the second gear 55 by the radius of the fourth gear 57 is The radius of the first gear 54 is larger than the radius of the third gear 56. In addition, the value obtained by dividing the number of teeth of the second gear 55 by the number of teeth of the fourth gear 57 is twice as large as that of the first gear. The number of teeth of the third gear 54 is greater than the value obtained by dividing the number of teeth of the third gear 56. It's twice as much.

[0229] The first worm 59 is engaged with the rear side of the worm wheel 58. 59 is attached to a first shaft member 71. As shown in FIG. are arranged along the height direction from the first worm 59 upward, and their upper ends are connected to the housing 10 100 is inserted into a first insertion hole 100a formed on the top surface of the housing 100 and exposed to the outside of the top surface of the housing 100. A first operating member 72 is attached to the upper end of the first shaft member 71. In this embodiment, the operating member 72 and the second operating member 75 (described later) are in the shape of a block such as a cylinder. However, it may be in the shape of a lever.

[0230] As shown in FIG. 57, the upper part of the worm wheel 58 is engaged with the second worm 73. A second shaft member 74 is attached to the second worm gear 73. The second shaft member 74 is , are arranged along the depth direction from the second worm 73 toward the rear side, and the rear end is 100b formed on the rear surface of the housing 100. A second operating member 75 is attached to the end portion on the far side of the second shaft member 74. The first shaft member 71 and the second shaft member 74 are positioned at different widthwise positions so as not to interfere with each other. They are arranged as follows.

[0231] With this configuration, the user can select either the first operating member 72 or the second operating member 75. When either of these is operated, either the first worm 59 or the second worm 73 rotates, The worm wheel 58 rotates, and the first rotary shaft 51 rotates. This causes the first gear 54 and the second gear 55 to rotate. As the gear rotates, the third gear 56 that is meshed with the first gear 54 rotates, and the second gear The fourth gear 57, which is meshed with the third gear 56, rotates. 65 and the optical member 320 connected to the fourth gear 57 via the second connecting member 66. The first display unit 310 connected to the first display unit 310 swings in the same direction in unison. The swing angle of the display unit 310 and the optical member 320 relative to the housing 100 can be changed. can.

[0232] In this way, the user can operate either the first operating member 72 or the second operating member 75. As a result, the first display unit 310 and the optical member 320 can be displayed at a position that is easy for the user to see. The optical element 320 can be swung to a desired position with a single operation. The depth position of the middle image can be adjusted.

[0233] As described above, the radius of the second gear 55 divided by the radius of the fourth gear 57 is equal to the radius of the first gear 55. 4 divided by the radius of the third gear 56, and in this embodiment, Therefore, the swing angle of the first display unit 310 is larger than the swing angle of the optical member 320. In this way, when the display unit and the optical member are swung in conjunction with each other, The inventors of the present invention have found that the aerial image formed on the optical member 320 looks good. It was served.

[0234] The first rotating shaft 51, the second rotating shaft 52, and the third rotating shaft 53 are supported by a case member 69. This reduces backlash in each gear 54 to 57, and ensures more reliable operation. The display unit 310 and the optical member 320 can be swung in conjunction with each other.

[0235] The second rotation axis 52 is the rotation axis of the optical member 320, and the second rotation axis 53 is the rotation axis of the first display unit 310. The three rotation axes 53 are arranged on the same axis, which does not intersect. The first display unit 310 and the optical member 320 are moved by the swinging of the first display unit 310 and the optical member 320. When the lens is moved, the position of the aerial image is prevented from shifting.

[0236] A structure in which the worm wheel 58 is rotated by the first worm 59 and the second worm 73 Therefore, the rotation of the first worm 59 and the second worm 73 is significantly reduced. The rotational position of the first display unit 310 and the optical member 320 can be finely adjusted. Furthermore, the user can adjust the swing positions of the first display unit 310 and the optical member 320. Even if you release your hands from the first operating member 72 and the second operating member 75 after adjusting the first operating member 72 and the second operating member 75, The rotation of the worm wheel 58 meshing with the worm 59 and the second worm 73 is suppressed, This prevents the first display unit 310 and the optical member 320 from changing in their pivot positions.

[0237] The first worm 59 and the second worm 73 are respectively positioned at different positions of the worm wheel 58. The first worm 59 and the second worm 73 are engaged with each other at the same position. The first operating member 72 and the second operating member 75 are connected to each other. 75 are exposed at different positions on the housing 100. Depending on the position, the user can operate the operation member 72, 75 whichever is easier to operate. The first display unit 310 and the optical member 320 can be swung in conjunction with each other, and the user can operate the The workability is improved.

[0238] The fourth gear 57 is connected to the first display unit 310 via the second connecting member 66, The load of the first display unit 310 is applied to the third gear 56. The third gear 56 is connected to the optical member 61 via the first connecting member 65. Since the third gear 56 and the fourth gear 320 are connected, the load of the optical member 320 is applied. 57, the interlocking portion 5 is used as a balancing member for adjusting the balance in the rotation direction. 0 includes a first biasing member 67 and a second biasing member 68. 7 and second biasing member 68, including the members to which they are attached, will now be described.

[0239] As shown in Figures 56 and 57, the fourth gear 57 has a rear side with respect to the third rotary shaft 53. In this embodiment, the second biasing member engaging portion 57a is formed. 3a is a protrusion projecting from the surface of the fourth gear 57. A second biasing member attachment portion 69f is formed on the surface facing the gear 57. The second biasing member attachment portion 69f is a projection that projects from the second support plate portion 69c toward the fourth gear 57. The shape.

[0240] As shown in FIG. 57, both ends of the second biasing member 68 are connected to the second biasing member engaging portion 53a and the second biasing member engaging portion 53b. The second biasing member 68 is engaged with the second biasing member attachment portion 53a. The fourth gear 57 is biased in a direction pulling it toward the second biasing member mounting portion 69f. The second biasing member 68 is urged in the direction opposite to the direction in which the fourth gear 57 swings due to the gravity of the optical member 320. The second biasing member 68 and the first biasing member 67 are coil springs. be.

[0241] As shown in FIG. 56, the third gear 56 has a first attachment at a position on the rear side of the second rotary shaft 52. In this embodiment, the first biasing member engaging portion 56a is The third gear 56 and the first support plate portion 69b are in the form of a protrusion protruding from the surface of the third gear 56. A first biasing member attachment portion 69g is formed on the opposing surface. The force member mounting portion 69g has a protrusion shape that protrudes from the first support plate portion 69b toward the third gear 56. do.

[0242] Both ends of the first biasing member 67 are engaged with the first biasing member engaging portion 56a and the first biasing member mounting portion 69g. The first biasing member 67 is engaged with the first biasing member engaging portion 56a. The first biasing member 67 biases the third gear 56 in a direction pulling it toward the 9g side. The gravity of the first display unit 310 biases the third gear 56 in the direction opposite to the direction in which the third gear 56 swings. There are.

[0243] The first and second biasing members 67 and 68 bias the first display unit 310 and the optical unit 311. The force that rotates the third gear 56 and the fourth gear 57 can be reduced by the weight of the material 320. As a result, wear of the meshing portion between the third gear 56 and the first gear 54 and wear of the meshing portion between the fourth gear 57 and the It is possible to reduce wear on the meshing portion with the second gear 55. Furthermore, the first operation by the user Therefore, the operating force for the first operating part 61 and the second operating part 62 can be reduced.

[0244] The positions where the first biasing member engaging portion 56a and the second biasing member engaging portion 53a are formed are Therefore, it is preferable that the first gear 56 and the fourth gear 57 are positioned closer to their outer peripheries. The positions where the biasing member engaging portion 56a and the second biasing member engaging portion 53a are formed are different from the positions where the third gear 56 and the fourth gear 56 are formed. If the biasing member 57 is positioned closer to the outer periphery of the biasing member 57, the biasing force of the first biasing member 67 and the second biasing member 68 will be small. As a result, the rotational moment acting on the third gear 56 and the fourth gear 57 becomes larger. , the first biasing member 67 and the second biasing member 68 have a smaller biasing force, i.e., the first biasing member 67 and the second biasing member 68 have a smaller biasing force. The biasing member 67 and the second biasing member 68 suppress wear of the meshing portion and This reduces the operating force required by the user.

[0245] The first display unit 310 and the optical member 320 are linked by the linking unit 50 to swing relative to the housing. In the movable embodiment, the light blocking member 500 is a flexible material such as urethane foam. Therefore, even if the optical member 320 swings relative to the housing 100, the flexible light blocking member 500 does not expand. By contracting, the optical element 500 continues to be in contact with the inner circumferential surface of the housing 100, and the optical element 500 is Reflections at 320 are suppressed, preventing the display of image V3 and reflections of the ceiling.

[0246] In the embodiment described above, the interlocking unit 50 is configured to operate the first indicator by the plurality of gears 54 to 57. The unit 310 and the optical member 320 are oscillated in conjunction with each other, but the pulley and belt Even if the first display unit 310 and the optical member 320 are configured to swing in conjunction with each other by The first rotating shaft 51, the second rotating shaft 52, and the third rotating shaft 53 are preferably provided as a case member 69. Alternatively, the sensor may be pivotally supported by the housing 100.

[0247] The ratio of the amount of change in angle obtained by dividing the swing angle of the first display unit 310 by the swing angle of the optical member 320 is: 2 is preferable, but other values are also acceptable. In particular, when the angle between the vertical direction of the image and the horizontal plane is It is advisable to set the relationship between the amount of change between the two so that the angle (for example, 90 degrees) is maintained. In this embodiment, the first display unit 310 and the optical member 320 are configured to swing in the same direction. This is preferable, but it may be swung in a different direction. In this case, it is preferable to swing the first display unit 310 and the optical member 320 in a direction that widens the gap between them. In this way, the user can adjust the angle of the image formed on the optical member 320 relative to the horizontal plane. do.

[0248] The third gear 56 is connected to the first display unit 310 via the first connecting member 65, and the fourth gear The optical member 320 is attached to the gear 57 via a second connecting member 66. The swing angle may be larger than the swing angle of the first display unit 310, or may be doubled in this embodiment.

[0249] In the embodiment described above, the first display unit 310 and the optical The member 320 is moved, but the first display unit 310 and In another embodiment, the optical member 320 may be moved.

[0250] The first biasing member 67 and the second biasing member 68 are coil springs, but may be leaf springs or The biasing member may be made of rubber or the like. The second biasing member 68 biases in the pulling direction, but it also biases in the pressing direction to bias the second gear 5 5 in the direction opposite to the direction in which the first display unit 310 swings due to the gravity of the first display unit 310, and the fourth gear 57 is Alternatively, the optical member 320 may be biased in the direction opposite to the direction of swing caused by gravity.

[0251] In some embodiments, the processing board 224 executes an "Away Home Alarm Mode." In this embodiment, the processing board 224 detects a microwave reflected by the human sensor 234. The processing board 224 then detects the movement of the suspicious person. If it is determined that a suspicious person has entered the room, the speaker 2251 and 2252 will announce, "Who is it? The processing board 224 issues a warning saying, "Did you know that?! The police have been called!" You may or may not report the suspicious person. Even if you do not report the suspicious person to the police, This may be considered intimidating and cause the suspicious person to leave the room. Send messages such as SMS (Short Message Service) to mobile phones such as smartphones. The processing board 224 may also receive the message "I'm home!" input to the microphone 2333. If it is determined that the voice is the user's voice, the "home alarm mode" is cancelled. You may notice a suspicious person entering your home due to the movement of a tree in your garden or the movement of a neighbor living in your next door neighbor's room. In order to suppress false detection, the display device 1 is placed in a place that does not induce false detection, for example, in the center of a room. It is preferable to place it in a

[0252] In the embodiment described above, the first display unit 310 and the optical member 320 are In the above embodiment, the longitudinal direction is the front-rear direction, but the longitudinal direction may be the width direction. Alternatively, the optical member 320 may be a transparent liquid crystal, and the interlocking portion 50 may swing the transparent liquid crystal to a vertical position. The longitudinal direction of the transmissive liquid crystal may be set as the width direction.

[0253] An embodiment in which the image display unit is a 3D display panel using a parallax barrier method or a lenticular method. In this embodiment, the optical member 320 may be attached to the position where the optical member 320 is attached. 320, a 3D display panel is provided, and the above-mentioned interlocking unit 50 The display panel is swingable relative to the housing 100. In this embodiment, 702, an external storage medium inserted in the slot 222, an external storage medium inserted in the USB connector 223, The USB memory stores video content such as exercise and yoga, and the processing board 22 4 is an embodiment in which these video contents are displayed on a 3D display panel that is a video display unit. In this embodiment, the user can see an 3D image in all directions, as compared to a 2D image on a television or video. You can recognize how to move your body from your position.

[0254] The processing board 224 may be an embodiment that performs reception for a company or the like. The processing board 224 detects the incoming microwave based on the reflected microwave received by the human sensor 234. The display device 1 detects the approach of a customer, and when a person approaches, the speakers 2251 and 2252 announce " Welcome. Which department would you like to work for?" is output as a voice message, and the image is The character speaking the above voice is displayed on the image display unit. 24 is a signal indicating that a visitor has operated the operation units 2212, 2213, and 2214, or a signal from a microphone. Based on the sound data acquired by Rophone 2333 that the visitor speaks to Display Device 1, The user is connected to the extension number of the department of his / her choice via IP (Internet Protocol) telephone.

[0255] In some embodiments, the processing board 224 performs IP telephony functions. The display device 1 displays an image of the other party captured by the image capturing unit 227 of the other party's display device 1 and An image of the other person generated based on the The image of the android is displayed on the video display unit, and the other party's display The voice of the other person picked up by the microphone 2333 of the device 1 is transmitted to the speakers 2251 and 225 In this embodiment, the processing board 224 performs the following operations based on the user's photo data: The display device 1 of the other party generates a three-dimensional image of the user and transmits it to the display device 1 of the other party. The three-dimensional image of the user received by the processing board 224 may be displayed on the video display unit. The user's photo data may be taken by the photographing unit 227 or may be stored on the user's smartphone. It may be a 3D image of the user taken by a smartphone or digital camera. The method for generating the image is described below. The processing substrate 224 is Then, a 3D surface is generated from the photo data. https: / / www.youtube.com / watch?v=4whM0VVYlwQ https: / / www.youtube.com / watch?v=4whM0VVYlwQ https: / / www.nicovideo.jp / watch / sm28810904 The processing board 224 then uses techniques such as OpenPose to estimate the pose. The user's bones (joints and skeleton) are estimated from the photograph data, and a 3D model incorporating these bones is created. Convert the surface model into FBX (Filmbox) format and use it in game engines such as Unity. The processing board 224 uses 3D surface to pose estimation model technology to Alternatively, the processing board 224 may use an external web service to estimate the bones of the user. The 3D image of the user created by the above method from the user's photo data is displayed as a video. The image display unit may display the other party (user's wife, child, grandchild, etc.). In embodiments where a simulated image or a three-dimensional image of a target is displayed, the processing board 224 The image of the other party captured by the image capturing unit 227 of the display device 1 on the hand side and the microphone of the display device 1 on the other side are displayed. Based on the voice of the other person picked up by the Rophone 2333, the other person's actions, mouth movements or feelings are Based on this information, the system generates an image of the other person or a 3D image of the other person. It may also be an embodiment in which the robot moves its head, moves its body, or changes its facial expression. The image board 224 displays an image of the other person on the video display unit according to the volume of the other person's speech. The movement and size of the mouth in the image or three-dimensional image may be changed. 4 may recognize the vowels spoken by the other person and reproduce the mouth shapes corresponding to these vowels.

[0256] In the embodiment described above where processing board 224 performs the IP telephony functions, processing board 22 When a call is received from the other party's display device 1, the above-mentioned three-dimensional image is displayed on the video display unit. Good too.

[0257] The processing board 224 can realistically reproduce not only family members such as wives, husbands, children, and grandchildren, but also pets. The image of the pet may be captured by the image capture unit 227 and displayed on the video display unit. The image may be taken by a smartphone or a digital camera of the user. The processing board 224 may be a device that captures the image of the user captured by the image capturing unit 227. Based on the image and the user's voice captured by the microphone 2333, the user can select the video display. When it is determined that the user has spoken to a pet displayed on the display, , pets smile, move, wag their tails, and be sweet. The image may be displayed on the video display unit.

[0258] In the embodiment in which the image of the pet is displayed on the video display unit, the display device 1 has a U Photos of deceased pets, names of these pets, etc., can be sent from users via SB Connector 223, etc. The data of the pet's bark is input, and the processing board 224 performs the above-mentioned method on the pet's photograph. A 3D image is generated and displayed on the video display unit, and is also played through speakers 2251 and 2252. This embodiment may play the sounds of pets. 4, the microphone 2333 acquired the message "Pochi O" about the user's deceased pet. In response to calls such as "hand", the pet will meow, wag its tail, and show its joy. Alternatively, the processing board 224 may generate a three-dimensional image of the operation, such as the above, and display it on the image display unit. The user's actions are recognized from the image of the user captured by the shadow unit 227, and the user's actions are recognized from the image of the user captured by the shadow unit 227. 3D images of the pet's movements, such as moving its ears or eyes, depending on the action. is generated and displayed on the video display unit.

[0259] The processing board 224 may display an image of an object such as a car on the video display unit. In the embodiment where the display is performed on the display unit, the display device 1 is connected to the car's display via a USB connector 223 or the like. The car data provided by the dealer (exterior, interior, wheels, etc.) is entered. The processing board 224 then receives the information from the prospective purchaser, acquired by the microphone 2333, that reads, "Turn the exterior red." "Make it the best color," "Make it the best wheels," "Make it the best interior," etc. The system recognizes the instructions of the person planning to enter the vehicle, generates a 3D image of the vehicle according to these instructions, and displays it on the video display unit. Furthermore, the processing board 224 receives the image of the prospective purchaser captured by the image capturing unit 227. The system recognizes the movements of the prospective buyer and changes the angle of the 3D image of the car according to the buyer's movements. and displayed on the video display unit.

[0260] The processing board 224 displays images of the deceased, Buddha (Buddha statue, etc.), monks, etc. on the video display unit. In this embodiment, the display device 1 may be connected to the deceased via a USB connector 223 or the like. Image data of the deceased's portrait, Buddha, and monk is input, and the processing board 224 processes the input image data. Based on the data, a 3D image of the deceased's portrait or Buddha statue is generated and displayed on the video display unit. In an embodiment where a portrait is displayed, the processing board 224 receives the image captured by the microphone 2333. The system recognizes calls to the deceased by bereaved family members and responds to these calls with a smiling portrait of the deceased. An embodiment may be such that a three-dimensional image is generated and displayed on the video display unit. In this embodiment, the processing board 224 plays the Heart Sutra through speakers 2251 and 2252. It plays the sounds of Buddhist sutras, mokugyo (wooden fish), and bells, and also plays 3D images of Buddha and monks reciting sutras. The image is generated and displayed on the video display unit, while a sutra with Japanese hiragana annotations is displayed as subtitles. The image may be displayed on a video display unit. The subtitle data is input to the display device 1 via a USB connector 223 or the like. In this configuration, the housing 100 is configured so that ritual implements, memorial tablets, etc. can be placed inside, and they can be used as the background of the three-dimensional image. This may be done so that the ritual implements and memorial tablets can be seen.

[0261] The processing board 224 controls the communication control circuit 706 to control the camera and communication device of the smartphone or the like. It generates 3D video based on the video captured by a device equipped with this function, and displays this 3D video. For example, a grandfather may display a 3D video of his grandchild dancing on an image display unit. The grandson can show his grandfather a dance by displaying the image on the video display unit of the display device 1. can be done.

[0262] In the embodiment in which the processing board 224 performs reception for a company or the like, the processing board 224 The above 3D image is created from photographic data of people taken with a smartphone or digital camera. Using this method, we generate 3D polygon data that can be used in game engines such as Unity. Alternatively, a three-dimensional image of the person at the reception desk may be displayed on the video display unit. The processing board 224 captures a person's motion including the background taken with a smartphone or digital camera. Using the above-mentioned method of generating 3D images based on the image, 3D polygon data of characters and backgrounds are generated. After generating the 3D polygon data for the person and the 3D polygon data for the background, Specifically, the processing board 224 may display the following UR Using the method shown in L, we automatically extract the 2D projection images and photographic images of existing 3D objects. Based on the similarity with the extracted region, the system extracts 3D objects stored in the photo and similar objects. Extract the object and match the texture of a similar object in the photo to the 3D object. Generate a video with the above pasted on it. https: / / gigazine.net / news / 20140806-3d-object-manipulation

[0263] The display device 1 may be configured to read out text data in the voice of a specific person. In this embodiment, the processing board 224 processes the waveform and timing of the recorded audio data of the user's voice. Text-to-Speech (TTS) technology is used to create natural synthesized voice from text data. The synthesized voice is reproduced by speakers 2251 and 2252. The processing board 224 is Using this technology, synthetic speech is generated from a small amount of speech data. https: / / coestation.jp /

[0264] In embodiments where processing board 224 performs IP telephony functions, processing board 224 Voice data of the user on the other side acquired by the microphone 2333 of the display device 1 on the hand side Specifically, the processing board 224 performs the following steps. Using the technology shown in the URL, we determine the user's emotions from the user's voice data. http: / / www.logit.co.jp / solution / voice-analysis.php Alternatively, the processing board 224 may receive the image of the other party captured by the image capturing unit 227 of the other party's display device 1. The emotion of the user on the other end is determined from image data including the facial expression of the user on the other end. The processing board 224 uses the technology shown at the following URL to generate image data including the user's facial expression. Determine user's emotion from data https: / / www.cac.co.jp / trends / trend06.html Then, the processing board 224 displays the determination result of the emotion of the user on the other side on the video display unit. For example, if the emotion of the other user is judged to be angry, The processing board 224 displays information that the hand is angry on the video display unit. The facial expression of the image imitating the user on the other side is displayed on the video display unit according to the emotion of the user on the other side. For example, if the emotion of the other user is judged to be angry, If there is an angry expression, an image of the user on the other side with an angry expression is displayed on the video display unit. Specifically, the processing board 224 preliminarily generates animations of element objects of the face to be moved for each type of emotion. Animation data is created in advance, and animation data corresponding to the detected emotion is displayed as a video. The processing board 224 extracts the positions of the facial elements using the technology shown in the URL below. Do the following. https: / / www.atr-p.com / products / af.html

[0265] The processing board 224 receives the audio data acquired by the microphone 2333 at regular intervals. If it determines that the audio data is music, A video of a character dancing to the rhythm of the music is generated and displayed on the video display unit. Specifically, the processing board 224 may be an embodiment shown in the URL below. Using the technology, real-time BPM (Beats Per Minute) analysis is performed, and the BPM Move the character left and right in sync with the https: / / www.cri-mw.co.jp / product / amusement / beatwiz / index.html

[0266] The display device 1 is a device that uses a motion sensor such as a pyroelectric sensor, a hall sensor, a reed sensor, etc. The processing board 224 is equipped with sensors, and based on the detection signals from these sensors, Alternatively, the operation of the image display unit may be changed. The display device 1 is a light receiving device such as a photodiode that receives an infrared light signal output by an infrared remote control. The processing board 224 is provided with a section for detecting the position of the character in response to the signal received by the light receiving section. An embodiment in which the operation is changed and displayed on the video display unit may also be used.

[0267] An anti-reflection film may be attached to the back side of the light-reducing member 200. 0 is not perpendicular to the bottom cover 106 of the housing 100 but is tilted slightly (by a few degrees). Alternatively, the light-reducing member 200 may have a curved surface. This curved surface may be a cylindrical surface that is convex outward or , inwardly convex cylindrical surfaces, and spherical surfaces. When the viewer looks into the back side of the light-reducing member 200 from the outside, the first display image reflected on the back surface of the light-reducing member 200 is This prevents the part 310 from being reflected by the optical member 320 and being seen by the user. An anti-reflection film may be attached to the front side of the optical member 200. This prevents the user from being disappointed by their own image being reflected in the dimming member 200. It is possible.

[0268] The width of the opening 110 in the front panel 102 of the housing 100 is larger than the width of the first display unit 310. It is preferable to make the opening 110 larger than the opening 110 itself, and preferably to make the opening 110 longer horizontally. The user may feel that the floating image formed on the optical element 320 is displayed in the background. Furthermore, the three-dimensional effect of the aerial image formed on optical member 320 is further enhanced.

[0269] An illumination member such as an LED is provided inside the housing 100 on the rear side of the optical member 320 and around the second display unit 330. Instead of the second display unit 330, a plurality of the above may be arranged around the second display unit 330 as decoration. Instead of the first display unit 310, a plurality of illumination members may be arranged in a position corresponding to the surrounding area. The second display unit 330 is replaced by a pico-projector screen. A picoprojector was placed on the white screen, and an image was projected onto the white screen by a picoprojector. An image projected onto a color screen may be focused by the optical element 320. The back panel 910 is white, and the pico projector is placed on the base 400 shown in FIG. An image may be projected onto a white background board 910 by a projector. A 3D liquid crystal display may be placed at the position where the background plate 910 is placed. With this configuration, the aerial image formed on the optical member 320 The 3D feel of the image is further emphasized. The back panel that controls the lighting components, pico projector, and 3D LCD The image processing unit for the background is configured separately from the image processing unit that controls the first display unit 310. This is preferable because it reduces the load on the image processing unit that controls the first display unit 310. The image processing unit for the first display unit 310 is a microcomputer with lower specifications than the image processing unit for controlling the first display unit 310. Constructing the display device 1 using a computer is preferable as it reduces the cost of the display device 1.

[0270] The first display unit 310 is disposed horizontally, and the optical member 320 is spaced apart from the first display unit 310. In this embodiment, the user may place the device 100 above the opening 110 of the housing 100. The user looks into the inside of the housing 100 from the outside and observes the aerial image formed on the optical member 320.

[0271] The housing 100 is structured so that it can be installed upside down, and the display device 1 is equipped with an acceleration sensor. The substrate 224 detects the vertical movement of the housing 100 based on the information detected by the acceleration sensor. is installed facing downwards, and then the first display unit 310 displays The embodiment may also be one in which the up-down direction or left-right direction of the image is adjusted. When the housing 100 is installed with its original upper side facing downward, the user can see the first display unit 310. Direct visual inspection.

[0272] The first display unit 310 is divided into a plurality of parts, and the display from each of the divided first display units 310 is An embodiment may also be provided with a plurality of optical members 320 that focus the image light.

[0273] Instead of providing the first display unit 310 and the optical member 320 inside the housing 100, the background plate 91 A parallax barrier liquid crystal is arranged at the position where 0 is provided, and the processing board 224 is arranged to Alternatively, an image for each eye may be generated and displayed on a parallax barrier liquid crystal display. In this mode, characters from MikuMikuDance and other games dance on a parallax barrier LCD screen. When the Graphics image is displayed, the background appears to be in the background and the key in the dresser appears to be in the background. When the character's hair is in the forward position, it appears to pop out in front.

[0274] It is important that the angle of the first display unit 310 with respect to the horizontal plane is not too large. The reflected image of the object reflected by the optical member 320 is reduced, and the viewing angle control member 3 12 prevents the image displayed on the first display surface 311 from being directly observed by the viewer. The angle of the first display unit 310 with respect to the horizontal plane is set to 30° or less. It is preferable that the angle is 20° or less, and more preferably 10° or less.

[0275] The light-reducing member 200 may be manufactured by injection molding. If the light-reducing member 200 is used, the flatness of the light-reducing member 200 will deteriorate, causing distortion in the aerial image. 00, the flatness of the light-reducing member 200 is high, and the aerial image is clearly visible, which is preferable. stomach.

[0276] The lower the light transmittance of the dimming member 200, the more the aerial image formed on the optical member 320 appears to float. The light transmittance of the dimming member 200 is set to 15% or less. It is preferable to set it to 10% or less, and more preferably to set it to 8% or less.

[0277] The first display unit 310 is 8 inches in size, has an aspect ratio of 4:3, and a resolution of 1024 x 769. It is preferable that the liquid crystal display device is an IPS (In Plane Switching) liquid crystal.

[0278] A half mirror may be disposed above the second display unit 330. In this embodiment, , the boundary between the top and bottom of the stage becomes difficult to see, and the character image formed on the optical member 320 becomes It appears to be floating in space.

[0279] The second display unit 330 may display a ring that rotates around the character.

[0280] The first display unit 310 and the second display unit 330 may be 3D liquid crystal devices. Instead of the optical member 20, a 3D liquid crystal device may be disposed at the position where the optical member 320 is disposed. Alternatively, the 3D liquid crystal device may be placed at the same position as the background plate 910. Furthermore, 3D liquid crystal devices may be disposed on the inner surface of the housing 100 on the left and right sides of the background plate 910. The 3D liquid crystal may be disposed only on the rear side of the optical member 320, or may be disposed on the front side of the optical member 320. It may be arranged only on the front side, or on both the back and front sides of the optical member 320, i.e., The 3D liquid crystal may be arranged across the optical element 320. In this case, different images may be displayed on the rear and front sides of the optical member 320. 3D liquid crystal devices may be placed on the left and right sides. dot matrix display devices with stereoscopic display functions, and transmissive display devices that allow naked-eye stereoscopic viewing. A transparent display panel with a lenticular lens that allows for naked-eye 3D viewing. As shown in the URL below, the device is equipped with a transparent display panel viewed with 3D glasses. This includes those equipped with optical filters. https: / / osusumehulu.com / wp-content / uploads / 2015 / 06 / KS001508.jpg A half mirror is provided on the display panel itself on the display surface side of the above-mentioned dot matrix display device. This half mirror is made of glass on the surface of the liquid crystal panel, and has enough aluminum to transmit light. The 3D LCD device has a display panel that is partially or entirely coated with aluminum. A member that can control the transparency by turning on and off electricity may be provided. The light-controlling film shown in the URL below can be applied to the front of the display panel, allowing for better control of the transparency. It is recommended to configure it so that it is attached to the https: / / www.toppan.co.jp / electronics / new_products / lc_magic This dimming is performed by turning the housing 100 white if the housing 100 is white, and turning the housing 100 black if the housing 100 is black. It is advisable to match the color of the housing 100 with the color when opaque, for example, one that turns black. A transmissive screen may be attached to part or the entire display panel of the 3D liquid crystal device. In the embodiment, a light-controlling filter such as that shown in the URL below, whose transmittance can be controlled electrically, is used. It is preferable to use a structure in which the film is attached to the front of the display panel. http: / / www.hachinos.jp A view restriction sheet that restricts the view in a predetermined direction may be attached to the front of the 3D liquid crystal device. Even with this configuration, the display of 3D images displayed by the 3D liquid crystal device is not obstructed. .

[0281] In this embodiment, an intermediate optical member is provided inside the housing 100 on the rear side of the light-reducing member 200. This intermediate optical member may be disposed in close contact with the light-attenuating member 200, or may be disposed in contact with the light-attenuating member 200. It may be arranged at a distance from the optical member 200. This intermediate optical member performs two reflections. The AI plate, which is a two-layer orthogonal reflector using stacked mirrors, and the nano- DCRC, an optical element manufactured by press molding of imprint, or retroreflective sheeting By configuring in this way, a three-dimensional aerial image can be obtained.

[0282] The first display unit 310, the second display unit 330, and the 3D liquid crystal device may all or any of the following: It may also be a round or doughnut-shaped non-rectangular shape, as shown in the URL. https: / / www.j-display.com / product / reflective.html https: / / www.j-display.com / news / 2019 / 20190305.html

[0283] The embodiment allows objects to be placed on the light blocking member 500, the second display unit 330, and the base unit 400. In this embodiment, the light blocking member 500, the second display unit 330, and the base 400 from the outside, the light-reducing member 200 and the rear panel 104 are detachable or removable. It can be opened and closed.

[0284] A transparent water tank for storing liquid such as water is provided above the second display unit 330. may be provided in an embodiment. https: / / www.j-display.com / news / 2019 / 20190305.html In this embodiment, the image displayed on the second display unit 330 is projected onto the screen through the liquid stored in the water tank. Alternatively, a transparent water tank for storing liquid such as water may be provided on the light blocking member 500. These tanks may be open at the top or may be sealed. Alternatively, the light blocking member 500 may be formed with a recess for storing a liquid such as water.

[0285] The display device 1 is provided with a fragrance generator, a humidifier, and a haptic actuator. The processing board 224 may be configured to operate a fragrance generator, a humidifier, a haptic device, etc. in response to the user's emotions. For example, the processing board 224 can change the output value output to the electromechanical actuator. If it is determined that the person is angry, the output of the humidifier is increased. , haptics provided on devices worn by users (e.g., smartphones and watches) A wireless signal is output to the haptic actuator to control the haptic actuator. In this embodiment, the processing board 224 may , an output to be output to a haptic actuator provided in a device worn by a user. Change the value.

[0286] A transmission type image display device such as that shown in the following URL is attached to the front or back side of the dimming member 200. The user can see the image formed on the optical member 320 and the image displayed on the transmission type image display device. An embodiment in which the images are viewed superimposed may also be used. http: / / www.hachinos.jp / https: / / www.youtube.com / watch?v=TfWk8K-ZZ_c In this embodiment, the first display portion 310 is provided from the upper or lower portion of the front side of the dimming member 200. It is preferable that the light source is provided on a convex portion formed on the front side of the transmission type image display device. It is preferable that the light reducing member 200 is provided exposed on the front side thereof so that the user can touch it. In this embodiment, a first detection means for detecting a touch on the transmissive image display device; Second detection: Detects the hand passing over the transparent image display device without touching it. and a detection means for detecting the first and second signals. Based on the detection result, at least one of the first display unit 310 and the transmissive image display device The display content may be changed (for example, changed to a different animation). An example of the second detection means is a range sensor such as the one shown in the URL below. . https: / / www.hokuyo-aut.co.jp / search / index.php?cate01=1 As shown in the URL below, the second detection means is attached to the bottom center of the front of the image display device. The second detection means may be configured to detect the position where the user's hand has crossed. http: / / www.crayon-pic.co.jp / netflix-screen-game As shown in the URL below, two second detection means are provided on the left and right of the image display device, The position where the user's hand has crossed may be detected by these second detection means. https: / / prtimes.jp / main / html / rd / p / 000000417.000008210.html

[0287] A mist screen such as the one shown in the URL below is installed on the front side of the housing 100 to The image is projected onto the mist screen from the rear side of the clean, and the mist screen A display device (such as the above-mentioned 3D liquid crystal device or transmission type image display device) may be provided on the rear side. https: / / www.cornestech.co.jp / tech / products / products_leiadisplay_1 / With this configuration, even if the display device 1 is placed in a dark place, the mist screen The image is projected clearly.

[0288] The display device 1 is provided with an acceleration sensor, and the processing board 224 detects Based on the received information, the first display unit 310 changes the character's movements and character In this embodiment, for example, the display device 1 may When the processing board 224 is lifted or tilted, the first display unit 310 Defeat the character.

[0289] Instead of the first display unit 310, the optical member 320, and the second display unit 330, a base unit 40 In this embodiment, a transmissive liquid crystal image display unit is disposed in parallel with the background plate 910 behind the In this embodiment, the base 400 is configured to be When the image display unit is turned on, the image display unit is spaced apart from the image display unit so as to shield the lower part of the image display unit. The base 400, which is the shielding part, brings the user closer to the image display part. In accordance with the above, the image display unit is configured to be wider so that the user can view a wider range of the image display unit. The vertical position of the camera relative to the image display unit and the distance from the image display unit are set. The user views the image while the lower part of the image display unit is shielded by the base unit 400, which is a shielding unit. You can see the aerial image displayed on the display unit. This can prevent the middle image from appearing cut off by the shape of the bottom edge of the video display area. For example, if the object is displayed on the video display from an area above the bottom edge toward the bottom edge, This prevents the characters from appearing cut off at the bottom edge. As a result, the user feels as if the character displayed on the video display unit is right in front of them. In addition, as the user approaches the image display unit, the image A wider area of the image display can be seen. For example, a character can be displayed on the image display. When the user approaches the video display unit, the user can see the The bottom of the character is visible, giving the user the feeling that the character is actually in front of them. The image display unit has a long side and a short side, and the long side is set as the up-down direction. In this way, for example, when a person is displayed on the video display unit, To prevent a part of a person, such as the person's head, from disappearing from the image display unit. The horizontal length of the shielding part should be longer than the horizontal length of the image display part. In this way, there is no part of the lower part of the image display unit that is not covered by the shielding part, By viewing the lower part of the image display unit, the user can see that the character This further reduces the chance of losing interest if there is no one in front of you. It is preferable that the surface of the image display section is parallel to the image display section and that the thickness of the image display section is greater than that of the image display section. In this way, the user can see the occluded part as a counter or desk, and for example, When a character is displayed on the video display section, the user will You can feel as if you are actually standing in front of the counter or desk.

[0290] The light-reducing member 200 is a semi-transmissive screen, and the first display unit 310, the optical member 320, and Instead of the second display unit 330, the rear side of the semi-transparent screen is A projector is installed on the side of the screen, and a horizontal plane and a flat plane are installed on the front side from the bottom edge of the semi-transparent screen. In this embodiment, the stage may be formed to protrude. The image output from the projector is projected onto a semi-transparent screen, and the user can see the In this embodiment, a semi-transparent screen is placed on the stage, and the image projected onto the screen can be seen. Multiple shielding plates parallel to the screen or tilted so that the top edge is slightly closer to the semi-transparent screen A plurality of such projections are provided at intervals in the depth direction. The image output from the projector is blocked by a shielding plate, preventing it from being reflected on the stage. The vertical length of the shielding plates and the spacing between the shielding plates are determined based on the possible positions of the user's eyes and The vertical length of the shielding plate is determined by the relationship with the direction of the projector light. The vertical length of the semi-transparent screen is shorter than the vertical length of the semi-transparent screen. If the vertical distance is 5 cm, the vertical length of the shielding plate is 1 cm. The projector should be tilted so that its upper end is close to the semi-transparent screen. This is more preferable because it can further reduce the reflection of the image output from the screen onto the stage. The length of the shielding plates in the vertical direction is preferably longer than the distance between the shielding plates. The lengths of the shielding plates in the opposite directions may be the same or different. For example, the distance between the stage closest to the user's eyes may be different. On the front side, the vertical length of the shielding plate is shortened, and the angle between the stage and the shielding plate is reduced. The distance between the shielding plates is reduced, and the distance between the shielding plates is increased as the plate moves toward the back of the stage. The length of the shielding plate is increased, the angle between the stage and the shielding plate is increased, and the distance between the shielding plates is increased. The shielding plate should be made of a material and have a thickness that does not allow light irradiated from the back side to pass through. The front surface of the shielding plate should be made of a material that does not easily reflect light. This is preferable in that it prevents the user from being reflected on the front surface. The screen is adjusted so that the image projected from the projector onto the semi-transparent screen is rectangular. It is preferable to perform keystone correction on the image output from the image processing device, but keystone correction is not required. Without shape correction, the horizontal direction of the bottom of the image projected onto the semi-transparent screen is , the upper part of the image can be drawn over a longer range than the horizontal direction. , the character is displayed on a semi-transparent screen according to its drawing position. It is preferable to perform shape correction.

[0291] The display device 1 does not have a physical switch or a touch panel that switches between the functions of the other embodiments described above. It has a switching means such as a panel.

[0292] The scope of the present invention is not limited to the configurations and methods expressly set forth in the specification, but is intended to be illustrative and not restrictive. Combinations of the various aspects of the invention disclosed herein are also included within their scope. The patentable structure of the invention is specified in the attached claims, but the current process Even if the configuration is not specified in the claims, the configuration disclosed in this specification may be used in the future. It is our intention to include this in the scope of the patent claims.

[0293] The present invention is not limited to the configurations described in the above-described embodiments. The components of the modified examples may be arbitrarily selected and combined. Any component of the embodiment and any component or invention described in the Summary of the Invention Any of the components described in the means for solving the above problems may be arbitrarily combined with any of the components that embody the components. It is also advisable to acquire rights to these by amending the present application or filing a divisional application, etc. Even if there is a description such as "in the case of..." or "when...", These are not configurations that are limited to these cases. The company also discloses the intention to acquire the rights. The parts marked with are not necessarily in this order. The company has also disclosed its intention to acquire the rights.

[0294] In addition, by converting the application to a design registration, you can obtain rights for the entire design or a partial design. If the device displays an image, the design may include the whole or part of that image. Although the entire device is depicted in solid lines in the drawings, The drawings include not only the design but also the partial design claimed for a part of the device. For example, a partial design can be made of a part of the device, or the device can be made of a part of the device regardless of the part. The drawings include a part of the device as a partial design. It may be a part of the device, or a part of that part. and the intention to obtain a partial design right by changing any part of the solid line portion of the drawing to a broken line portion. In addition, the modules, components, parts, etc. inside the device housing are also shown in the drawings. All of the above are subject to independent trade and are similarly subject to the same regulations. The applicant intends to amend the application and obtain the rights. [Explanation of symbols]

[0295] 1:Display device 100: Housing 101: Right panel 102: Front panel 103: Left panel 104: Rear panel 105: Top cover 106: Lower lid part 107: Right inner panel 108: Front inner panel 109: Left side inner panel 110: Opening 200: Light-reducing material 210: 1st area 220:Second area 221: Operation board 222: Slot 223: USB connector 224: Processing substrate 226: Holding part 227: Photography Department 231: Control board 232: Wiring 233: Sensor board 234: Human Sensor 310: 1st display section 311: 1st display screen 312: Viewing angle control member 320: Optical components 321: 1st page 330:Second display 331: 2nd display screen 400: Base 500: Light blocking material 601: First plate 602: Second plate 800: Wiring section 810: Power line 820: Signal line 830: Signal line 900: Partition material 910:Background board 1041: Rear lid part 1051: Opening 1052: Opening 1100: Character 1200: Character 1210: Character body 1220: Collar 1221: Bills 2100: Stage footage 2200: Stage footage 2211 :Operation unit 2212 :Operation unit 2213 :Operation unit 2214 :Operation unit 2251: Speaker 2252: Speaker 2261: Heat sink 2311: Power jack 2331: First sensor 2332: Second sensor 2333: Microphone 2334: Light-emitting part

Claims

1. an image display unit that displays an aerial image; a shielding section provided on a front side of the image display section and shielding the front side of the image display section; A display device having:

2. The shielding unit includes a housing that houses the image display unit and has an opening formed on the front side. The display device according to claim 1 .

3. The image display unit includes a display unit that emits image light and a display unit that forms the aerial image based on the image light. and an optical element for imaging the image. The display device according to claim 2 .

4. a display unit moving means for moving the position of the display unit; and an optical member moving means for moving the position of the optical member. The display device according to claim 3 .

5. The display unit moving means moves the display unit to a position on the far side of the opening of the housing. The device is configured to be swingably attached to the housing, The optical member moving means moves the optical member forward to a position on the rear side of the opening of the housing. The device is configured to be swingably attached to the housing. The display device according to claim 4 .

6. The optical member is swung in the same direction as the swing direction of the display unit in conjunction with the swing of the display unit. Equipped with an interlocking part that The display device according to claim 5 .

7. The rotation axis of the display unit and the rotation axis of the optical member are provided on axes that do not intersect. The display device according to claim 6.

8. The interlocking portion is a first rotation axis for simultaneously rotating the angle in response to an operation from a user; a second rotation axis for changing the angle of the display unit in accordance with rotation of the first rotation axis; a third rotation axis for changing the angle of the optical member in accordance with the rotation of the first rotation axis; Prepared The display device according to claim 6 or 7.

9. The interlocking portion is a first gear attached to the first rotating shaft; a second gear attached to the first rotating shaft; a third gear that meshes with the first gear and to which the optical member is connected; a fourth gear that meshes with the second gear and to which the display unit is connected; The display device according to claim 8 .

10. The first gear, the second gear, the third gear, and the fourth gear are The angle of movement is set to be twice the angle of the swing of the optical member. The display device according to claim 9 .

11. The interlocking portion is a worm wheel attached to the first rotating shaft; a worm that meshes with the worm wheel; The display device according to any one of claims 8 to 10.

12. The interlocking portion has an operating member connected to the worm. The display device according to claim 11.

13. The display unit and the optical member have members to which both loads are applied, and the Equipped with a balance member for adjusting the lance The display device according to any one of claims 9 to 12.

14. The balance member is The third gear is biased in a direction opposite to the direction in which the third gear rotates due to the weight of the display unit. a first biasing member; The fourth gear is attached to the side opposite to the direction in which the fourth gear rotates due to the weight of the optical member. and a second biasing member biasing the first biasing member. The display device according to claim 13.

15. The shielding portion shields a lower portion of the image display portion when the image display portion is viewed from the front. and the image display unit is disposed in front of the image display unit with a gap therebetween. The shielding unit is configured to shield the user from the image display unit as the user approaches the image display unit. The image display unit is configured to be vertically and horizontally adjustable so that a wider area of the image display unit can be viewed. The direction and distance from the video display unit are set. The display device according to any one of claims 1 to 14.

Images