Indicator devices, etc.
Patent Information
- Application Number
- JP2026092336
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2021-09-30
- Filing Date
- 2026-06-02
- Publication Date
- 2026-09-08
AI Technical Summary
【0007】 本発明によれば、例えば空中画像の表示の傾きを変更して空中画像を見ることができる仕組みを提供する等、従来よりも優れた表示装置等を提供することができる。 上記した以外の課題、構成及び効果は、以下の実施形態の説明により明らかにされる。
Smart Images

Figure 2026143552000001_ABST
Abstract
Description
[[Technical Field]]
[0001] The present invention relates to a display device and the like. [[Background Art]]
[0002] As a background art in the present technical field, there is Japanese Patent Laid-Open No. 2020-118815 (Patent Document 1), for example. This publication, for example, describes that "the display device includes: a housing 100 having an opening 1011 that is a light-transmitting region facing forward at least in a first direction; a display body 200 that is disposed inside the housing 100 and is a light-transmissive plate-shaped member facing the opening 1011; and an image display unit that causes the display body 200 to display an image. The housing 100 has, in a space between the opening 1011 and the display body 200, an inclined region 1012 serving as a first region and an inclined region 1013 serving as a second region that sandwich the display body 200 from both sides when viewed from the front side." (see the abstract). [[Prior Art Document]] [[Patent Document]]
[0003] [[Patent Document 1]] Japanese Patent Laid-Open No. 2020-118815 [[Summary of the Invention]] [[Problem to be Solved by the Invention]]
[0004] Patent Document 1 describes a mechanism for enhancing the visual effect of a display device. For example, Patent Document 1 does not explicitly describe a mechanism that allows an aerial image to be viewed by changing the display inclination of the aerial image. The present invention provides a display device and the like that are superior to conventional ones, for example, such as a mechanism that allows an aerial image to be viewed by changing the display inclination of the aerial image.
[0005] The object of the present invention is not limited thereto, and the applicant intends to obtain rights through divisional applications, amendments, etc., for configurations that aim to obtain the effects derived from the components of the configuration disclosed in this specification and the drawings, etc. For example, problems that can be described in this specification as "~is possible" or "~is feasible" are disclosed in this specification. Each problem is described independently, and the applicant intends to obtain rights to each configuration for solving each problem independently through divisional applications, amendments, etc. Even if a problem is implicitly understood from the description in the specification, the applicant intends to include a part of the configuration described in this specification in the claims through amendment or divisional application. Furthermore, configurations that solve problems by combining these independent problems are also disclosed, and the applicant intends to obtain rights to them. [Means for solving the problem]
[0006] To solve the above problems, for example, the configuration described in the claims is adopted. The present application includes multiple means for solving the above problems, but to give one example, it is characterized by having an image display unit that displays an aerial image to the user, and a tilt changing unit that changes the tilt of the display of the aerial image to the user. [Effects of the Invention]
[0007] According to the present invention, it is possible to provide a display device that is superior to conventional ones, for example, by providing a mechanism that allows the aerial image to be viewed by changing the tilt of the display of the aerial image. Problems, configurations, and effects other than those described above will be clarified by the following description of embodiments.
[0008] For example, in this specification, phrases such as "can do" or "is possible" are descriptions that clearly indicate the effect to be achieved, and there are also parts that demonstrate the effect even without such descriptions. Furthermore, there are effects that can be understood from the configuration even without such descriptions. [Brief explanation of the drawing]
[0009] [Figure 1] Figure 1 is an example of a perspective view of a display device 100 according to one embodiment. [Figure 2] Figure 2 is an example of an explanatory diagram illustrating the usage state and usage environment of a display device 100 according to one embodiment. [Figure 3] Figure 3 is an example of a perspective view of a display device 100 according to one embodiment. [Figure 4A] Figure 4A shows an example of the appearance of the display device 100 according to one embodiment, viewed from various directions. [Figure 4B] Figure 4B shows an example of the appearance of the display device 100 according to one embodiment, viewed from different directions than those in Figure 4A. [Figure 5] Figure 5 is an example of a perspective view of the front case 111. [Figure 6A] Figure 6A shows examples of the external appearance of the front case 111 as viewed from various directions. [Figure 6B] Figure 6B shows examples of the appearance of the front case 111 from different directions than those shown in Figure 6A. [Figure 7] Figure 7 shows an example of a cross-sectional view of the front case 111. [Figure 8] Figure 8 is an example of an explanatory diagram illustrating different tilt states of the display device 100 according to one embodiment. [Figure 9] Figure 9 is an example of an explanatory diagram illustrating the relationship between a display device 100 in a tilted state of the housing 110 according to one embodiment, and the cables 910 and 920 connected to the display device 100. [Figure 10] Figure 10 is an example of a cross-sectional view of a display device 100 according to one embodiment. [Figure 11] Figure 11 is an example of an exploded view of a display device 100 according to one embodiment. [Figure 12] Figure 12 is an example of an exploded view illustrating the relationship between the front case 111, the speaker 1104, and the speaker enclosure. [Figure 13] Figure 13 is an example of an explanatory diagram illustrating the shape of a speaker enclosure. [Figure 14] Figure 14 is an example of a perspective view of the shape of the lower part of the front case 111. [Figure 15] Fig. 15 is an example of an explanatory diagram illustrating the connection state of electrical components of the display device 100 according to one embodiment. [Figure 16] Fig. 16 is an example of a system block diagram illustrating the electrical configuration of the display device 100 according to one embodiment. [Figure 17] Fig. 17 is an example of an explanatory diagram illustrating the detection area and detection target of a non-contact sensor. [Figure 18] Fig. 18 is an example of an explanatory diagram illustrating the display device 100 according to one embodiment connected to a network 1810. [Figure 19] Fig. 19 is an example of an explanatory diagram illustrating variations of the tilt changing unit. [Figure 20] Fig. 20 is an example of an explanatory diagram illustrating the display device 100 according to the second embodiment. [Figure 21] Fig. 21 is an example of an explanatory diagram illustrating the display device 100 according to the third embodiment. [Figure 22] Fig. 22 is an example of an explanatory diagram illustrating the display device 100 according to the fourth embodiment. [Figure 23] Fig. 23 is a diagram illustrating an example of a communication function according to one embodiment. [Figure 24] Fig. 24 is an example of an explanatory diagram illustrating the adjustable detection area 2410 of the non-contact sensor 1102. [Figure 25] Fig. 25 is an example of an explanatory diagram illustrating a configuration that radiates radiation light 2500 parallel to an image forming plane 140. [Figure 26] Fig. 26 is an example of an explanatory diagram illustrating structural variations of the non-contact sensor 1102 and a housing 110. [Figure 27] Fig. 27 is an example of an explanatory diagram illustrating a configuration that radiates radiation light 2500 obliquely to an image forming plane 140. [Figure 28] Fig. 28 is another example of an explanatory diagram illustrating a configuration that radiates radiation light 2500 obliquely to an image forming plane 140. DETAILED DESCRIPTION OF THE INVENTION
[0010] The embodiments will be described in detail below with reference to the drawings. The embodiments shown below are examples of embodiments of the present disclosure, and the present disclosure is not limited to these embodiments. In the drawings referenced in these embodiments, the same parts or parts having similar functions are denoted by the same or similar reference numerals (simply a number followed by A, B, etc.), and repeated explanations may be omitted. In addition, in the drawings referenced in the following description, the scale may be different from that of the actual parts in order to make each component, area, etc. recognizable.
[0011] Figure 1 is an example of a perspective view of a display device 100 according to one embodiment. Figure 1(a) is an example of a perspective view of the display device 100, illustrating the state in which the display device 100 is not displaying the aerial image 130. Figure 1(b) is an example of a perspective view of the display device 100 in the state in which the aerial image 130 is displayed, illustrating the state in which the aerial image 130 is displayed on the display device 100.
[0012] Figure 1(c) is an example of a front view of the display device 100 described in Figure 1(a) with an image plane 140 of the aerial image 130 added. The image plane 140 is shown by a dashed line. Figure 1(d) is an example of a front view of the display device 100 described in Figure 1(b) with an image plane 140 of the aerial image 130 added. The image plane 140 is shown by a dashed line.
[0013] First, let me explain the overview of the display device 100. The display device 100 is a display device based on the concept of displaying Kirishima Rei, the mascot character of the applicant, Yupiteru Corporation, as a hologram, allowing users to enjoy conversations with the character and images of the character. The display device 100 displays the character using an aerial image 130, making the character appear to float in space like a hologram. In that sense, the aerial image 130 may be perceived as a floating image that gives the user a sense of floating when viewed. In this way, the display device 100 displays the aerial image 130 in such a way that the user can recognize the existence of a character that gives a sense of three-dimensionality. In that sense, the display device 100 may also be called a virtual figure, virtual signage, etc.
[0014] The display device 100 has the following structural features, for example: • It displays a character projected like a hologram using an aerial image 130, allowing the user to face the character (for example, directly in front of it) and touch it. • It is equipped with a non-contact sensor to detect non-contact operations, and detects user operations (aerial operations or gesture operations, as described later) by touching the aerial image 130.
[0015] Furthermore, the display device 100 performs a communication function that enables simulated communication between the character and the user 200. This communication function enables communication such as the user 200 conversing with the character, or the user 200 touching the character's body with their hand, to which the character reacts.
[0016] Features related to communication functions include, for example, the following: • A time notification function in which the character announces the time. • A function that allows the character to tell the weather by connecting to the internet via Wi-Fi, etc., and communicating with a designated server device. • A voice recognition function (e.g., local voice recognition) that allows the user to converse and interact with the character. • The relationship between the user and the character, such as the character's feelings towards the user, changes based on the content of the conversation and the user's touch operations. • The character's movements and phrases change according to the relationship between the user and the character, allowing users to enjoy a humane cohabitation with the character. • A function to control external devices such as home appliances.
[0017] However, the display device 100 is not required to have all of these functions; it may not have at least some of these functions, or it may have functions other than those listed above.
[0018] Next, the configuration of the display device 100 will be described. In the embodiment shown in Figure 1, the user (user 200 shown in Figure 2) can view the aerial image 130 as if it were floating in space. In particular, the display device 100 displays the aerial image 130 as a stereoscopic image that allows the user to perceive depth. The display device 100 has a housing 110 that opens towards the user 200, and displays the aerial image 130 in the space inside the housing.
[0019] User 200 can see the aerial image 130, which gives a sense of three-dimensionality, appearing to leap out from the box materialized in the casing 110 towards User 200 (the front side). As will be described in more detail later, the fact that the inside of the casing 110 is maintained in a relatively dark environment also contributes to User 200 getting the feeling that the character is floating. In this way, the display device 100 makes it easier for User 200 to recognize the object displayed in the aerial image 130 as a three-dimensional object (see Figure 1(d) in particular). This display also contributes to User 200 feeling a greater sense of familiarity and affection for the object in the aerial image 130.
[0020] Figures 1(b) and 1(d) show that the display device 100 is displaying the character image as an aerial image 130. The display device 100 further... It is configured to perform the communication function described above. This allows user 200 to feel as if they are interacting with the character and communicating with it.
[0021] The image plane 140, shown by a dashed line in Figure 1(d), indicates the imaging position of the aerial image 130. The image plane 140 and the aerial image 130 exist on the same plane. In other words, the image plane 140 is the position where the aerial image 130 is imaged. The image plane 140 can also be understood as the display surface of a virtual image. To make this clear, that is, to make it clear that the aerial image 130 is not in front of or behind the image plane 140, but precisely on the image plane 140 itself, in Figure 1(d), one of the diagonal lines representing the image plane 140 is depicted passing on the front side of the aerial image 130, and the other diagonal line is depicted passing on the back side of the aerial image 130.
[0022] The display device 100 is a display device that is small enough in size and weight to be held and carried by a user 200 with one hand. The display device 100 has a vertical housing structure that is longer in the height direction (i.e., up and down direction) than in the width direction (i.e., left and right direction). In this embodiment, the display device 100 has the shape of a rectangular parallelepiped. The dimensions of the display device 100 are, for example, 171.5 mm in the height direction, 97 mm in the width direction, and 93 mm in the depth direction. The weight of the display device 100 is, for example, approximately 565 g. The user 200 uses the display device 100 by placing it on a flat surface such as a desk 230 or a table (hereinafter referred to as the "contact surface").
[0023] The display device 100 is configured to change the tilt of the aerial image 130 displayed to the user 200. The display device 100 is configured to change the tilt of the aerial image 130 relative to the user 200. The tilt of the display relative to the user 200 may refer, for example, to the tilt of the aerial image 130 or the image plane 140 with respect to the direction of the user 200's line of sight. The display device 100 is particularly configured to change the tilt of the display in the front-to-back direction, and in particular, it is well-configured to change the aerial image 130 so that it faces directly toward the user 200's line of sight.
[0024] The display device 100 is configured so that the user 200 can adjust whether or not the aerial image 130 is tilted and the magnitude of that tilt. The aerial image 130 is not limited to a planar image, but may also be a curved surface or a three-dimensional image. Other display methods for aerial images will be described later. In this embodiment, "tilt of the aerial image 130" may be read as "tilt of the imaging surface 140 of the aerial image 130" or "tilt of the aperture surface 700" (see Figure 7; the aperture surface 700 will be described later), etc. As a result, even if the user 200's eye height and the height of the display device 100's installation position are different, the user 200 can view the aerial image 130 directly by adjusting the tilt of the aerial image 130. This point will be explained in more detail using Figure 2.
[0025] In the embodiments shown in Figures 1(a) and 1(d), the aerial image 130 is an animated human character, but it may also be a non-human character such as an animal (e.g., a cat) or a robot. Furthermore, these aerial images 130 may be animation-based, photograph-based, computer graphics-based, or a combination of these. In addition, two or more characters may be displayed simultaneously as the aerial image 130. The aerial image 130 is preferably a video image with some kind of movement (motion), but it may also be a still image.
[0026] In Figures 1(c) and 1(d), the imaging surface 140 is located at the position of the aperture surface 700 (see Figure 7) provided on the front side (user 200 side) of the display device 100, and is approximately the same size as (or may be the same size as) the aperture surface 700. Therefore, the display device 100 is configured to display the aerial image 130 within the range of the aperture surface 700 when the user 200 is looking directly at the imaging surface 140.
[0027] The imaging surface 140 is preferably displayed at or near the position of the aperture surface 700 within the concave space (the first space 300 described later) that is opened by the aperture surface 700, as will be described later, but it may also be displayed at a position offset in front of or behind it. However, the inventors have confirmed that it is easier to obtain a sense of three-dimensionality in the aerial image 130 when the imaging surface 140 is located within the first space 300 compared to when the imaging surface 140 is located closer to the user 200. The size of the imaging surface 140 may differ from the size of the range of the aperture surface 700. "Imaging surface 140" may be read as "aerial image 130" as appropriate.
[0028] The inventors have found that by displaying the aerial image 130 at or near the position of the aperture surface 700 on the side of the first space 300 inside the housing 110 that is closest to the user 200, the effect of enhancing the sense of three-dimensionality of the aerial image 130 obtained by the user 200, such as the feeling of the character floating or popping out, is enhanced in combination with the first space 300. The sense of popping out can be described as the feeling that the image of the character appears to pop out from the jet-black housing. Furthermore, when the aerial image 130 is displayed at or near the position of the aperture surface 700, the user 200 can see the aerial image 130 at a position close to themselves. This is desirable for enhancing the sense of immersion when using the display device 100, such as when communicating with the character. Note that "nearby" should be, for example, within a range of about 10% before or after the distance from the lens plate 1001 to the image plane, as described later.
[0029] Figure 1(a) shows that the front case 111 and rear case 112 of the housing 110 of the display device 100, and the tilt adjustment section 120 have different color schemes. The front case 111 is preferably a low-luminosity color such as black. This can improve the sense of floating that the user 200 feels when viewing the aerial image 130 shown in Figure 1(b). Furthermore, the front case 111 is surface-treated to suppress light reflection, for example, by a textured or matte finish (i.e., non-glossy). This can prevent the user 200's face from being reflected when viewing the aerial image 130, thereby enhancing the sense of immersion when using the display device 100.
[0030] The rear case 112 is preferably a color with a higher brightness than the front case 111, such as a glossy white or silver. Furthermore, the rear case 112 may be polished to give it a lustrous surface. This makes it easier for the user 200 to perceive the display device 100 as having a premium feel and a futuristic design, and to appreciate the rarity and novelty of the aerial image display technology 130.
[0031] Figure 2 is an example of an explanatory diagram illustrating the usage state and environment of a display device 100 according to one embodiment. In Figure 2, the display device 100 is placed on a desk 230. The display device 100 is positioned so that the display of the aerial image 130 is tilted toward a user 200 seated in a chair 220. Preferably, a configuration is adopted that allows the user 200 to change the tilt of the housing 110 of the display device 100 so that they can view the aerial image 130 from a position at least 35 cm away from the display surface (i.e., the imaging surface 140) of the aerial image 130, and face the aerial image 130 directly.
[0032] In particular, the housing 110 should be configured to allow its tilt to be changed continuously (for example, seamlessly) or steplessly. This makes it easier for the user 200 to adjust the housing 110 to their preferred tilt while the display device 100 remains on the desk 230. The tilt of the housing 110 after adjustment is maintained. The display device 100 should be configured such that the tilt of the display unit 1000 located inside the display device 100 is changed in conjunction with the change in the tilt of the housing 110, thereby adjusting the tilt of the aerial image 130 displayed on the user 200 side. In this specification, "display unit" refers to an example of an "image display unit".
[0033] For example, the tilt adjustment unit 120 is located below the housing 110 and changes the tilt of the housing 110. The tilt of the tilt adjustment unit 120 is fixed (i.e., unchanging) when installed on the desk 230, and the relative tilt of the housing 110 with respect to the tilt adjustment unit 120 can be changed. The tilt adjustment unit 120 is configured to change the front-to-back tilt of the housing 110 so that the aerial image 130 is displayed facing the user 200's line of sight. For example, the tilt of the display of the aerial image 130 is configured to be changed by a predetermined angle range towards the rear, with the horizontal direction Dh as the reference (0 degrees).
[0034] Tilting the housing 110 backward means tilting it so that the upper part of the housing 110 is further back than the lower part. The housing 110 should be configured to be able to change to any angle within the range of 0 to 25 degrees. The relative positional relationship between the user 200's eyes and the aerial image 130 changes depending on the installation environment, such as the height of the display device 100 and the position of the user 200's eyes. In this way, the user 200 can face the aerial image 130 directly and view it in various installation environments, thereby enhancing the user 200's sense of immersion when using the display device 100.
[0035] In the embodiment shown in Figure 2, the user 200 is looking at the display device 100 at a downward angle Au with respect to the horizontal direction Dh, and the user 200's line of sight Du coincides with the perpendicular Lv to the aerial image 130 on the display device 100. In this state, the user 200 can directly view the aerial image 130. Furthermore, even if the user 200 adjusts their posture or shifts their body forward or backward, the user 200's line of sight Du remains within the range Ap of the preferred field of view of the aerial image 130, so the user 200 can continue to perceive the aerial image 130 without any discomfort.
[0036] The sizes of the user 200, chair 220, desk 230, etc., and their relative positions shown in Figure 2 are merely illustrative examples. By changing the placement of the display device 100 and the tilt of the housing 110, the user 200 can install the display device 100 in a desired location in various usage environments and use it without discomfort. Because the display device 100 has a compact configuration with the dimensions and weight described above, it can be placed on surfaces other than the desk 230, such as shelves, furniture, desktop computer cases, monitor stands, etc.
[0037] Figure 3 shows an example of a perspective view of a display device 100 according to one embodiment. Figure 3(a) shows an example of a perspective view of the display device 100 viewed from the right at an angle relative to the user 200 side (front side). Figure 3(b) shows an example of a perspective view of the display device 100 viewed from the left at an angle relative to the rear side.
[0038] As described above, the display device 100 has a first space 300, which is a concave space that opens to the user 200 through the opening surface 700. The display device 100 further has a main switch 310 located at a position that the user 200's fingers can reach when they place their fingers into the first space 300 through the opening surface 700. The main switch 310 is an operating part of the display device 100 that is positioned to be particularly easy for the user 200 to see and operate.
[0039] The main switch 310 is an operating unit for performing predetermined operations related to the functions of the display device 100, and it is preferable that it be assigned to control the main functions of the display device 100. One such function is the function to instruct the start (i.e., turn on) of the voice recognition function used in the communication function described above. The main switch 310 may also be assigned other functions, for example, functions that are used relatively frequently, such as starting and stopping the display device 100. The main switch 310 also controls the display of the aerial image 130. A function for changing the display may be assigned to it. In this specification, "main switch" is an example of an "operating unit".
[0040] A sub-switch 320 is provided on the right side of the display device 100 (i.e., the right side as seen from the user 200's perspective) of the outer periphery of the display device 100 (i.e., the housing 110). The sub-switch 320 is preferably a volume control operation unit located at least towards the rear of the housing 110 in the depth direction from the front to the rear. In another embodiment, the sub-switch 320 may function as another adjustment switch for, for example, display brightness adjustment, various buttons, etc., instead of or in addition to the volume control switch. In this specification, "sub-switch" is an example of a "second operation unit".
[0041] Furthermore, in addition to the sub-switch 320, sensors (hereinafter simply referred to as sensors) 330 are provided to detect various parameters through a sensor window. Specifically, on the right side of the display device 100, further back than the sub-switch 320 for volume control, there is a sensor window for at least one sensor 330.
[0042] In the embodiment shown in Figure 3, a temperature sensor 1631 (see Figure 16) and an illuminance sensor 1632 (see Figure 16) are used as sensors 330. Alternatively or additionally, at least one sensor 330 can be a humidity sensor, pressure sensor (barometric pressure sensor), carbon dioxide concentration sensor, carbon monoxide concentration sensor, TVOC (total volatile organic compound) sensor, PM2.5 sensor, ozone sensor, etc. In this specification, "sensors" and "sensor" refer to an example of a "sensor unit." Furthermore, in addition to components configured and implemented as so-called "sensors" that detect various environmental parameters, it is also possible to use components that can be used for sensor applications. For example, a microphone is originally a component for inputting the voice of a user 200, but it can also be used as an external sound detection sensor.
[0043] The display device 100 may have a function to output information to the user 200 based on information obtained from the sensors 330, and may be used, for example, for control related to communication functions. The display device 100 may have a configuration that notifies the user 200 of information obtained from the sensors 330. If, for example, a temperature sensor is used as the sensor 330, the display device 100 may have the character utter phrases related to temperature, such as "It's hot!" or "It's cold!", based on the temperature information.
[0044] The display device 100 may perform effects such as changing the character's costume according to the temperature. If, for example, an illuminance sensor is used as one of the sensors 330, the display device 100 may change the brightness of the aerial image 130 display (for example, the luminescence of the LCD 1003) according to the illuminance measured by the illuminance sensor. Furthermore, as will be described later, the display device 100 may be configured to control devices connected to the display device 100 based on information obtained from the sensors 330.
[0045] The display device 100 has a power switch 340 on the rear side of the outer periphery of the display device 100 (i.e., the housing 110). By positioning the power switch 340 in a location close to the rear side, where it cannot be seen by the user 200 who is positioned on the front side, the appearance of the display device 100 as seen by the user 200 is simplified. In the embodiment shown in Figure 3, the configuration eliminates all operating elements other than the main switch 310 from the front and top sides of the display device 100, which are easily visible to the user 200. Therefore, when the user 200 is viewing the aerial image 130, they will not perceive, or will not perceive, the presence of other sub-switches 320, sensors 330, and the power switch 340, making it easier for them to concentrate on viewing the aerial image 130. In this way, the user 200 can enhance their sense of immersion when using the display device 100.
[0046] Furthermore, in the embodiment shown in Figure 3, by arranging the sub-switches 320 and sensors 330 on the outer periphery of the display device 100 as described above, the upper part of the display device 100 can be made lighter and more compact. For example, if a large storage space for electronic components were to be secured in the upper part of the display device 100, it may give the impression that the top of the display device 100 is bloated. In contrast, the display device 100 is designed to give the user 200 the impression that the top is compact, thereby ensuring the aesthetic appearance of the display device 100 and enhancing the user 200's sense of immersion when using the display device 100.
[0047] Furthermore, in the embodiment shown in Figure 3, since the sub-switch 320 is located on the user 200 side compared to the sensors 330, the sensor window is less likely to be covered by the user 200's fingers even when the user 200 is operating the sub-switch 320, thus minimizing any adverse effects on detection by the sensor 330.
[0048] Figure 4A shows examples of the appearance of the display device 100 according to one embodiment, viewed from various directions. Figure 4B shows examples of the appearance of the display device 100 according to one embodiment, viewed from different directions than those in Figure 4A.
[0049] Figure 4A(a) is an example of a top view (plan view) of the display device 100. Figure 4A(b) is an example of a left side view of the display device 100. Figure 4A(c) is an example of a front view of the display device 100. Figure 4B(d) is an example of a right side view of the display device 100. Figure 4B(e) is an example of a rear view of the display device 100. Figure 4B(f) is an example of a bottom view of the display device 100.
[0050] Figure 4A(a) shows that the front width Wf and rear width Wb of the display device 100 are different, with the rear width Wb being smaller than the front width Wf. Furthermore, the top surface of the display device 100 does not have any operating elements such as switches, resulting in a simple appearance. As a result, the top surface of the display device 100 is very smooth overall. By eliminating mechanical components from the top of the display device 100, the display device 100 can have a lighter top surface. Figure 4A(a) also shows that a switch protrudes from the right side, and that the sum of the width of the display device 100 at the location where the switch is installed and the protruding width of the switch does not exceed the front width Wf.
[0051] With the above configuration, when user 200 faces the aerial image 130 and views the display device 100 from user 200's side (front side), the presence of the sub-switches 320 and sensors 330 located on the right side of the display device 100 is not visible to user 200, or is very difficult to see. As a result, from user 200's perspective, the presence of unnecessary switches (buttons) exposed at the location of the housing 110 is not visible or is difficult to see, giving a clean impression. In addition, user 200 is less likely to obtain unnecessary information about the appearance from the outer periphery of the display device 100, allowing them to concentrate on viewing the displayed aerial image 130 and increasing their sense of immersion in using the display device 100.
[0052] In Figure 4A(b), no operating elements such as switches are provided on the left side of the outer periphery of the display device 100, and the left side of the display device 100 is very smooth overall. In Figure 4A(c), on the front side (user 200 side) of the outer periphery of the display device 100, a first space 300 surrounded by four inner wall portions 400 is formed. In this embodiment, the four inner wall portions 400 are planar in shape and are substantially orthogonal to each other (they may be orthogonal). However, the connection points of each of the four inner wall portions 400 may be curved. Furthermore, the inner wall portion 400 may be composed of a single continuously curved inner wall portion 400, for example, a circular or elliptical shape.
[0053] In this embodiment, the inner wall portion 400 is inclined towards the center from the front side (user 200 side) to the back side. Therefore, the first space 300 has a truncated square pyramidal shape with the opening surface 700 as its base. This configuration will be explained in more detail with reference to the figures.
[0054] In Figure 4B(d), the sub-switch 320 and sensors 330 are provided on the right side of the outer surface of the display device 100. These configurations are the same as those already described in relation to Figure 3.
[0055] In Figure 4B(e), a power switch 340 and two connection ports are provided on the outer surface of the display device 100, specifically at a location exposed on the rear side. In this embodiment, one of the connection ports is a power jack for inserting a power cable 910, and the other connection port is for connecting, for example, a debug cable.
[0056] In Figure 4B(f), the bottom surface 1020 of the outer periphery of the display device 100 is provided with four anti-slip features (only one of which is labeled with a reference numeral) and legs 810 (see Figure 8).
[0057] The anti-slip material is preferably made of a substance such as rubber that has a higher frictional force than the material (e.g., plastic) that makes up the rest of the base surface 1020. It is even better if the anti-slip material protrudes slightly from the rest of the base surface 1020, as this concentrates the weight of the display device 100 on the protruding anti-slip material, increasing the frictional force of the anti-slip material against the contact surface, thereby preventing slipping and tipping.
[0058] In this embodiment, the legs 810 are configured to protrude toward the ground surface of the display device 100. The legs 810 may be configured as a tilt stand that protrudes toward the ground surface when rotated around a rotation axis from a state in which the user 200 is housed in the bottom area. In another embodiment, the legs 810 may be push-knob-shaped legs that protrude outward (for example, downward) when pushed further by the user 200 while housed in the bottom area. It is preferable that the protrusion width of the legs 810 can be adjusted in stages or continuously (for example, seamlessly) so that the user 200 can adjust the tilt of the display device 100 more flexibly.
[0059] Figure 5 shows an example of a perspective view of the front case 111. Figure 5(a) is a perspective view of the front case 111 from the front. Figure 5(b) is a perspective view of the front case 111 from the rear.
[0060] Figure 5 shows a perspective view of the front case 111 that forms the front surface of the outer periphery of the display device 100. As described above, the front case 111 has four inner wall portions 400 that surround a concave first space 300 that opens to the user 200 side through an opening surface 700. The four inner wall portions 400 consist of an upper inner wall portion 510, a left inner wall portion 520, a lower inner wall portion 530, and a right inner wall portion 540. The front edges of the upper inner wall portion 510, the left inner wall portion 520, the lower inner wall portion 530, and the right inner wall portion 540 define the front opening surface 700 of the first space 300. The rear opening surface 710 of the first space 300 is closed by, for example, the front panel 1101 described later.
[0061] The four inner wall sections 400 are inclined such that the distance between opposing inner wall sections 400 decreases as the distance from the opening surface 700 (see Figure 7) to the back side of the display device 100 increases. This configuration, in which the inner wall sections 400 gradually narrow toward the back side of the display device 100, enhances the sense of depth that the user 200 perceives regarding the first space 300. With this configuration, the user 200 can more easily see the inner wall sections 400 together with the aerial image 130 displayed within the range of the opening surface 700, and can more easily perceive the depth of the first space 300 inside the housing 110. As a result, the user 200 can more easily perceive the aerial image 130 as being located close to them, and in combination with the first space 300 inside the housing 110, the user 200 can more easily perceive a stronger sense of three-dimensionality in the aerial image 130.
[0062] A slit-shaped opening is formed in the left inner wall portion 520. Hereafter, in this specification, such an opening will be referred to as the non-contact sensor opening 550, but this is an opening. This is an example of "[...]."
[0063] On the left inner wall portion 520, a dummy groove 570L is formed parallel to the non-contact sensor opening 550, extending along the left inner wall portion 520 on the rear side (rear side) of the display device 100, beyond the non-contact sensor opening 550. Continuing from the dummy groove 570L, a dummy groove 570(570T) is formed on the upper inner wall portion 510. Continuing from the dummy groove 570(570T), a dummy groove 570(570R) is also formed on the right inner wall portion 540.
[0064] The configuration in which dummy grooves 570 extending in parallel to the non-contact sensor opening 550 are formed along the left inner wall portion 520, the upper inner wall portion 510, and the right inner wall portion 540 makes it easier for the user 200 to recognize the non-contact sensor opening 550 as part of the design of the inner wall surface. In particular, the lower inner wall portion 530 is an inner wall portion that is relatively easy for the user 200 to see, similar to the left inner wall portion 520 and the right inner wall portion 540, but the dummy grooves 570 do not extend to the lower inner wall portion 530. Therefore, the dummy grooves 570, in combination with the non-contact sensor opening 550, are easily recognized as a symmetrical design. In another embodiment, dummy grooves may also be provided in the lower inner wall portion 530 so as to be continuous with the dummy grooves 570 provided in the left inner wall portion 520, the upper inner wall portion 510, and the right inner wall portion 540.
[0065] The dummy groove 570 is a portion that is recessed relatively upward on the upper inner wall portion 510, a portion that is recessed relatively to the left on the left inner wall portion 520, and a portion that is recessed relatively to the right on the right inner wall portion 540. These recesses are perceived as steps by the user 200, and together with the non-contact sensor opening 550, the dummy groove 570 is easily recognized as part of the design of the inner wall surface. Therefore, in another embodiment, a similar, or even enhanced or improved, visual effect can be obtained by providing a step-like step that is similarly perceived as a step, instead of or in addition to the dummy groove 570 which is perceived as a step.
[0066] For example, in a configuration where a step is provided instead of the dummy groove 570 described above, the step-shaped step is formed on the upper inner wall 510, the left inner wall 520, and the right inner wall 540 such that the rear side of the display device 100 protrudes more towards the first space 300 surrounded by the inner wall 400 than the front side, so that the user 200 can visually recognize the step. Furthermore, by designing the inclination of each inner wall (upper inner wall 510, left inner wall 520, lower inner wall 530, and right inner wall 540) to be constant before and after the step, the appearance of the display device can be simplified, and manufacturing costs can be reduced.
[0067] In a configuration where the inclination of each inner wall section is changed before and after the step, the reflection direction of light emitted by the non-contact sensor described later on the surface of the inner wall section can be designed more flexibly. Furthermore, in yet another embodiment, for example, a step may be provided instead of the dummy groove 570 described above, and the upper inner wall section 510 and the lower inner wall section 530, and the left inner wall section 520 and the right inner wall section 540 may be designed to be parallel on the front side of the step.
[0068] Furthermore, a sound-emitting hole 640, consisting of multiple openings for emitting sound from the speaker 1104, is formed at an angle to the front edge of the left inner wall portion 520. The sound-emitting hole 640 is an example of a sound-transmitting portion. The sound-transmitting portion should be a part that transmits sound more easily than the left inner wall portion 520, for example, by using a mesh-like material. The non-contact sensor 1102 in this embodiment is also called, for example, an Air Touch sensor, and can detect non-contact operations such as the movement of a user's fingers in the air. The opening 550 for the non-contact sensor corresponds to the length of one side of the detection area of the non-contact sensor 1102, and light from the non-contact sensor 1102 passes through it.
[0069] Similar to the left inner wall 520, the right inner wall 540 also has a sound-emitting hole 640 for the speaker 1104, which is inclined relative to the front edge of the right inner wall 540. This sound-emitting hole 640 is also an example of a sound-transmitting section. The sound-transmitting section should be a part that allows sound to pass through more easily than the right inner wall 540, for example, by using a mesh-like material. An opening 560 for the main switch is formed in the lower inner wall 530.
[0070] As will be described later, the front case 111 in the embodiment of Figure 5 has a non-contact sensor 1102 along the vertical direction of the left inner wall portion 520. However, for the sake of visual uniformity, it is also possible to form a similar slit-shaped opening as a dummy opening in the right inner wall portion 540. In another embodiment, a single continuous slit-shaped opening may be formed in the left inner wall portion 520, the upper inner wall portion 510, and the right inner wall portion 540, integrating the non-contact sensor opening 550 and the dummy opening.
[0071] The spacing between the opposing inner walls of the front case 111 gradually narrows from the opening 700 on the user 200 side towards the opening 710 on the rear side of the front case 111. This shape allows the surrounding frame (the four inner walls 400 (510, 520, 530, 540) of the front case 111) to give the user 200 a more exaggerated sense of perspective to the aerial image 130 displayed near the opening 700 on the user 200 side. As a result, the user 200 is more likely to perceive the displayed aerial image 130 as floating higher or as being closer to the user than it actually is, exceeding its depth.
[0072] Figure 6A shows examples of the external appearance of the front case 111 viewed from various directions. Figure 6B shows examples of the external appearance of the front case 111 viewed from different directions than those in Figure 6A.
[0073] Figure 6A(a) is an example of a top view (plan view) of the front case 111. Figure 6A(b) is an example of a left side view of the front case 111. Figure 6A(c) is an example of a front view of the front case 111. Figure 6B(d) is an example of a right side view of the front case 111. Figure 6B(e) is an example of a rear view of the front case 111. Figure 6B(f) is an example of a bottom view of the front case 111.
[0074] In Figure 6(a), the upper inner wall portion 510 of the front case 111 has, more specifically, a sound collection hole 620 and a microphone housing portion 610 formed on the side opposite to the inner wall surface of the inner wall portion 400 (510, 520, 530, 540) surrounding the first space 300 that opens to the user side of the display device 100 (hereinafter simply referred to as "the side opposite to the inner wall surface of inner wall portion 400," that is, the back side of the inner wall portion). The sound collection hole 620 is an example of a sound-transmitting portion. The sound-transmitting portion should be a part that allows sound to pass through more easily than the upper inner wall portion 510, for example, by using a mesh-like material.
[0075] In Figure 6A(b), the left inner wall portion 520 of the front case 111, more specifically on the side opposite to the inner wall surface of the inner wall portion, has a non-contact sensor opening 550, a sensor housing portion 630, a sound emission hole 640, and a speaker enclosure 650.
[0076] The other components of Figure 6A(c) are the same as those already described in relation to Figures 4A(c) and 5(a). The dummy groove 570 is formed along the left inner wall 520, the upper inner wall 510, and the right inner wall 540. Note that the dashed line B-B' shown in Figure 6A(c) is a hypothetical line used to illustrate the relationship with the cross-sectional view in Figure 7(a) and is not actually visible.
[0077] In Figure 6B(d), a sound vent 640 and a speaker enclosure 650 are formed on the right inner wall portion 540 of the front case 111, more specifically on the side opposite to the inner wall surface of the inner wall portion 400, similar to the left inner wall portion 520 of the front case 111 in Figure 6A(b).
[0078] Unlike the left inner wall portion 520 of the front case 111 shown in Figure 6A(b), the right inner wall portion 540 of the front case 111 shown in Figure 6B(d) does not have a non-contact sensor opening 550 and a sensor housing portion. However, as shown in Figure 6B(d), a dummy opening 660 may be provided in the right inner wall portion 540 of the front case 111 at the position indicated by the dashed line corresponding to the non-contact sensor opening 550 of the left inner wall portion 520, so as to give a symmetrical appearance when viewed from the user 200 side.
[0079] In embodiments that include such dummy grooves or other steps, when the display device 100 is viewed from the user 200's side, similar slit-shaped openings exist on both the left and right inner walls 400, resulting in a symmetrical appearance and making it easier to avoid the user 200 feeling any visual discomfort.
[0080] In the embodiment shown in Figure 6, the front case 111 is configured to have one sensor on the left inner wall portion 520. However, in another embodiment, a sensor may be provided on the upper inner wall portion 510 or the lower inner wall portion 530, or on the right inner wall portion 540. Furthermore, by providing two or more sensors, it is possible to increase the detection accuracy and the types of gestures that can be detected.
[0081] For example, by providing sensors at different distances from the opening surface 700 (see Figure 7) on the left inner wall portion 520 and the right inner wall portion 540, or by providing sensors at different distances from the opening surface 700 on the upper inner wall portion 510 and the right inner wall portion 540, it is possible to configure the device to detect the degree to which the user 200's finger is pressed in the depth direction (e.g., the amount (length) of the press, the speed of the press), for example, a pressing operation that causes the display device 100 to undulate in the front-to-back direction.
[0082] Figure 6B(e) shows the front case 111 viewed from the rear towards the front. Similar to Figure 6(a), the upper inner wall 510 of the front case 111 has a microphone housing 610, and the lower inner wall 530 of the front case 111 has an opening 560 for the main switch. Figure 6B(e) also shows the rear opening surface 710 of the first space 300 surrounded by the inner walls 400 (510, 520, 530, 540) of the front case 111.
[0083] Note that the dashed line C-C' shown in Figure 6B(e) is a hypothetical line used to explain the relationship with the cross-sectional view in Figure 7(b), and is not actually visible to the naked eye.
[0084] From Figure 6B(f), it can be seen that, more specifically, on the inner wall portion 530 at the bottom of the front case 111, on the side opposite to the inner wall surface of the inner wall portion 400, there is an opening 560 for the main switch, similar to that in Figure 6B(e).
[0085] In the embodiment shown in Figure 6, the sound vents 640 are provided in the lower regions of the left inner wall 520 and the right inner wall 540. However, in other embodiments, they may be provided in the central or upper regions of the left inner wall 520 and the right inner wall 540, for example. In the configuration where the sound vents 640 for the speaker 1104 are provided in the central regions of the left inner wall 520 and the right inner wall 540, the sound vents 640 for the speaker 1104 are positioned behind the sensor housing 630 (i.e., on the back side of the display device 100). The speaker 1104 is mounted on the front case 111 so that the sound emitted from the speaker 1104 propagates from the opening surface 700 of the first space 300 of the display device 100 to the user 200. This point will be explained in more detail using Figure 11.
[0086] Figure 7 shows an example of a cross-sectional view of the front case 111. Figure 7(a) is an example of a cross-sectional view of the front case 111 viewed along the dashed line B-B' in Figure 6A(c). Figure 7(b) is an example of a cross-sectional view of the front case 111 viewed along the dashed line C-C' in Figure 6A(e).
[0087] In Figure 7(a), the upper inner wall portion 510 is surrounded by the inner wall portions 400 (510, 520, 530, 540) of the front case 111, extending from the front side to the rear side of the display device 100, forming a first space. The upper inner wall portion 510 is inclined at an inclination angle At so that 300 is reduced in size. In addition, the lower inner wall portion 530 is inclined at an inclination angle At so that the first space 300, enclosed by the inner wall portions 400 (510, 520, 530, 540) of the front case 111, is reduced in size from the front to the rear.
[0088] In the embodiment shown in Figure 7(a), the inclination angle At of the upper inner wall portion 510 is smaller than the inclination angle At of the lower inner wall portion 530. However, it is also possible to make the inclination angle At of the upper inner wall portion 510 and the inclination angle At of the lower inner wall portion 530 equal, or to make the inclination angle At of the upper inner wall portion 510 larger than the inclination angle At of the lower inner wall portion 530. In another embodiment, for example, adjusting the inclination angle At of the upper inner wall portion 510 and the inclination angle At of the lower inner wall portion 530 so that the sum of the inclination angles At of the upper inner wall portion 510 and the inclination angle At of the lower inner wall portion 530 is within a range of a predetermined value, such as the viewing angle of the LCD 1003 used, is preferable because it can naturally guide the user 200's line of sight Du within the viewing angle.
[0089] Furthermore, the inventors of this application have discovered, in connection with the space-saving configuration described with reference to Figure 10, that a very compact configuration can be achieved when the inclination angle At of the lower inner wall portion 530 is between 45 and 50 degrees, particularly around 48.5 degrees.
[0090] In Figure 7(b), the left inner wall 520 and the right inner wall 540 are inclined at an inclination angle Al and an inclination angle Ar, respectively, such that the first space 300 enclosed by the inner wall 400 (510, 520, 530, 540) of the front case 111 is reduced from the front to the rear. In the embodiment of Figure 7(b), the inclination angles Al of the left inner wall 520 and Ar of the right inner wall 540 are equal, but the left inner wall 520 and the right inner wall 540 may be inclined at different angles.
[0091] In another embodiment, for example, by adjusting the inclination angle Al of the left inner wall 520 and the inclination angle Ar of the right inner wall 540 so that the sum of the magnitudes of the inclination angle Al of the left inner wall 520 and the inclination angle Ar of the right inner wall 540 is within a range of a predetermined value, such as the viewing angle of the LCD 1003 used, the user 200's line of sight Du can be naturally guided within the viewing angle, which is desirable.
[0092] Figure 8 is an example of an explanatory diagram illustrating different tilt states of the display device 100 according to one embodiment. Figure 8(a) is an example of the display device 100 in an upright state. Figure 8(b) is an example of the display device 100 tilted to a maximum of 25° by the first tilt changing mechanism of the tilt changing unit 120. Figure 8(c) is an example of the display device 100 tilted by a predetermined angle (5°) by the second tilt changing mechanism of the tilt changing unit 120. Figure 8(d) is an example of the display device 100 tilted to a maximum of 25° + 5° = 30° using both the first and second tilt changing mechanisms.
[0093] In the embodiment shown in Figure 8, the tilt changing section 120 of the display device 100 has a first tilt changing mechanism and a second tilt changing mechanism. The second tilt changing mechanism is an example of a second tilt changing section.
[0094] As will be explained in more detail using Figure 11, the first tilt adjustment mechanism consists of the support surface 1110 of the mount base 800 and the bottom case 1010 of the housing 110. The second tilt adjustment mechanism consists of the legs 810 provided on the bottom surface 1020 of the mount base 800. The first and second tilt adjustment mechanisms are independent of each other, and for example, after tilting the first tilt adjustment mechanism to its maximum extent, the display device 100 can be tilted further to the rear as viewed from the user 200 using the second tilt adjustment mechanism. The mount base 800, legs 810 and bottom surface 1020, like the front case 111, are surface-treated to suppress light reflection, for example, by a textured finish or a matte finish (i.e., a non-glossy finish).
[0095] In the embodiment shown in Figure 8, the bottom surface 1020 of the mount base 800 is also the bottom surface 1020 of the display device 100. Note that the mount base 800 is part of the base, and the mount base itself is sometimes referred to as the base. In Figure 8(a), the user 200 is positioned on the left side of the page and looks at the display device 100 towards the right side of the page. In this case, the right side of Figure 8(a) is the "rear side from the user 200's perspective" and the "back side of the display device 100". The left side is the "front side of the display device 100".
[0096] The first tilt-changing mechanism can continuously (for example, seamlessly) change the tilt of the housing 110 relative to the mount base 800 or the ground surface from the upright state in Figure 8(a) to the maximum tilt state in Figure 8(b). It is preferable to configure the first tilt-changing mechanism to produce a click sensation or click sound when tilted to the maximum tilt state, as this makes it easier for the user 200 to avoid applying excessive force. In this case, the tilt of the housing 110 refers to the tilt of the aperture surface 700 or the imaging surface 140 of the aerial image 130 with respect to a straight line perpendicular to the ground surface of the display device 100.
[0097] In the embodiment shown in Figure 8, the user 200 can easily adjust the tilt of the housing 110 from the upright state in Figure 8(a) to the tilted state in Figure 8(c) using the second tilt adjustment mechanism. In the embodiment shown in Figure 8(c), the second tilt adjustment mechanism allows for tilt adjustment by a fixed angle (5°), but it can also be set to a larger or smaller angle. Furthermore, a configuration that allows for multi-stage angle adjustment or seamless and continuous angle adjustment can also be adopted.
[0098] Because the display device 100 has a first tilt adjustment mechanism and a second tilt adjustment mechanism, it is possible to effectively utilize the limited design space of the display device 100 and achieve a wide angle adjustment range. Therefore, the user 200 can easily adjust the display of the aerial image 130 to a desired tilt with a wider adjustment range, according to their own usage environment.
[0099] In the state where the legs 810, which are the second tilt-changing mechanism as shown in Figures 8(c) and 8(d), are extended, the display device 100 contacts the ground surface with its legs 810 and the rear side region of its bottom surface 1020. Similar to the anti-slip measures in Figure 4B(f), it is preferable that the parts that contact the ground surface in the states shown in Figures 8(c) and 8(d) be made of a material with greater friction, such as rubber, as this allows for more stable installation of the display device 100.
[0100] In the embodiment shown in Figure 8, both the left and right sides of the housing 110 are angled upwards towards the rear. This prevents the housing 110 from contacting the mounting base 800, the desk 230, or shelves, even when the housing 110 is tilted relative to the mounting base 800. This configuration minimizes the increase in height required to implement the tilt adjustment section 120. With this configuration, for example, a relatively large aerial image 130 can be displayed to the user 200 within the space required for installing the display device 100.
[0101] Furthermore, even if the degree of inclination is the same, for example, the user 200 can select between a first configuration in which the bottom surface 1020 of the display device 100 is grounded according to Figures 8(a) and 8(b), and a second configuration in which the legs 810 and the rear side region of the bottom surface 1020 of the display device 100 are grounded according to Figures 8(c) and 8(d).
[0102] Figure 9 is an example of an explanatory diagram illustrating the relationship between a tilted display device 100 and the cables 910 and 920 connected to the display device 100 according to one embodiment. Figure 9(a) is a view of the tilted display device 100 shown in Figure 8(b), parallel to the bottom surface of the display device 100, from the back to the front. Figure 9(b) is a view of the tilted display device 100 shown in Figure 8(b), parallel to the top surface of the display device 100, from the right rear to the left front.
[0103] In Figure 9, the bottom surface 1020 of the display device 100 is formed by the mount base 800, and two cables 910 and 920 are connected to the display device 100. As mentioned above, in the embodiment of Figure 9, the bottom surface 1020 of the mount base 800 (i.e., the bottom surface 1020 of the tilt adjustment section 120) also serves as the bottom surface 1020 of the display device 100. In the embodiment of Figure 9, the cables are a power cable 910 for power supply with power lines and a data cable 920 for data transmission and reception with signal lines, but other cables may be used.
[0104] The tilt adjustment section 120 further has a recess 900 on its rear side. In this embodiment, the recess 900 is located on the rear side of the mount base 800, behind the housing 110, and is open upwards. The recess 900 has a cable connector located inside, and the cables 910 and 920 are inserted into the connector portion of the display device 100 in the direction of the arrows in the figure. Regardless of the tilt state of the housing 110, the cables are inserted through the space provided by the recess 900 on the rear side of the display device 100, so that they do not come into contact with the mount base 800, or are less likely to come into contact with it, when inserted.
[0105] Similarly, the cables 910 and 920 connected to the display device 100 are configured not to come into contact with, or to come into contact with, the tilt-changing section 120 (for example, the upper surface of the recess 900), regardless of the tilt of the housing 110. For example, since the connection part to the display device 100 is made of a rigid material that does not deform (including not deforming at all), the cables 910 and 920 can maintain a non-contact state with the tilt-changing section 120 within the space provided by the recess 900 on the back side of the display device 100, regardless of the tilt of the housing 110, under the force applied to the connection part of the cables 910 and 920 in a typical usage environment.
[0106] The rigid portions of cables 910 and 920 should have a length that allows them to extend outward from the recess 900 on the back side, regardless of the tilt of the housing 110, before transitioning to the flexible cable portion. Such a configuration makes it possible to suppress stress on cables 910 and 920 and the connection points (e.g., the jack) regardless of how the tilt of the housing 110 changes, thus making it easier to avoid damage to cables 910 and 920.
[0107] Figure 10 is an example of a cross-sectional view of a display device 100 according to one embodiment. From Figure 10, a cross-sectional view of the display device 100 as seen along the line A-A' in Figures 4A(c) and 4B(e) can be seen.
[0108] The display device 100 has a housing 110 and a tilt changing section (first tilt changing mechanism and second tilt changing mechanism) 120 that constitute its outer periphery. The housing 110 has a front case 111 and a rear case 112 as components visible to the user 200. The housing 110 further has a bottom case 1010 that functions as a sliding part, which also serves as part of the first tilt changing mechanism.
[0109] In the embodiment shown in Figure 10, the front case 111 forms the front side (user side 200) of the housing 110 of the display device 100. The rear case 112 forms the top surface, both left and right sides, and the back surface of the housing 110 of the display device 100. The bottom case 1010 forms the bottom surface of the housing 110. The display unit 1000 is housed in the internal space of the housing 110 defined by the front case 111, the rear case 112, and the bottom case 1010.
[0110] In the embodiment shown in Figure 10, the display unit 1000 includes a lens plate 1001, a main board 1002, an LCD (liquid crystal display) 1003, and an LCD holder 1004. In this specification, "main board" refers to an example of a "control board," and "LCD" refers to an example of a "display."
[0111] In the embodiment shown in Figure 10, LCD1003 is a 5-inch liquid crystal display that is longer in the vertical direction than in the horizontal direction. However, the display can be any configuration that has a display surface that emits image light, for example Alternatively, displays employing organic EL displays or digital mirror devices may be used. In the embodiment shown in Figure 10, the distance D1 from the surface of the LCD 1003 to the center of the lens plate 1001 is equal to the distance D2 from the center of the lens plate 1001 to the image plane 140. Also, in the embodiment shown in Figure 10, the position of the image plane 140 is approximately equal to the position of the aperture surface 700 of the front case 111.
[0112] In another embodiment, the position of the imaging plane 140 may be designed to be offset from the position of the aperture surface 700 of the front case 111. In yet another embodiment, the position of the imaging plane 140 may be designed to be changeable from the position of the aperture surface 700 in the front case 111. In such a configuration, the user 200 can make adjustments to better suit their preferences.
[0113] In the embodiment shown in Figure 10, the distance D1 from the surface of the LCD 1003 to the center of the lens plate 1001 and the distance D2 from the center of the lens plate 1001 to the image plane 140 should both be selected within a range of approximately 30 mm to 40 mm. By appropriately selecting the above distances D1 and D2, it is possible to make the edges and dots of the aerial image 130 less noticeable and to reduce the blurring of the aerial image 130.
[0114] The inclination of the inner wall portions 400 (510, 520, 530, 540) of the front case 111 changes at an angle less than or equal to the viewing angle of the LCD 1003. In particular, if it is about the same as the viewing angle, it is good because it can guide the user 200's line of sight to a range in which the aerial image 130 can be clearly seen. This effectively reduces the situation in which the user 200 views the aerial image 130 at an angle and consequently finds the image difficult to see. Furthermore, because the inner wall portions 400 (510, 520, 530, 540) of the front case 111 are inclined inward, the outer frame (also called the bezel area) of the LCD 1003 provided inside the housing 110 can be positioned in the user 200's blind spot.
[0115] In this specification, "lens plate" refers to an example of an "optical system." The lens plate 1001 is configured, for example, as a microlens array plate in which multiple minute lenses are arranged. The lens plate 1001 is an optical component also called a 3D lens. Each minute lens projects an image or video displayed by a display such as the LCD 1003 onto the opening side of the front case 111, thereby displaying an aerial image 130 to the user 200.
[0116] A display method combining a display and an optical system makes it possible to display an aerial image at a position different from the display surface of the display. In this embodiment, a first space 300 can be provided between the optical system composed of the lens plate 1001 and the aerial image 130 imaging surface 140. The first space 300 is mainly located behind the aerial image 130, but it has various uses and effects, such as providing the user 200 with an enhanced sense of depth as explained in relation to Figure 5, being used as a propagation space for sound output by the speaker 1104 described later, being used as a path for accessing the operating section such as the main switch 310 formed as a touch sensor, and being used as a space for providing a member to hide the internal components of the display device 100.
[0117] Furthermore, the fact that the optical system is composed of a lens plate 1001 and does not have a reflector contributes to making it easier to implement the display device 100 in a vertically elongated housing structure such as a rectangular parallelepiped.
[0118] The display method for the aerial image 130, which combines the LCD 1003 and the lens plate 1001, does not require electrical or electronic conversions in the process of converting the image light emitted by the LCD 1003 (i.e., the image displayed by the LCD 1003) into the aerial image 130. Therefore, it is possible to display the aerial image 130 with a simple configuration. In addition, the total number of components of the entire display device 100, the computational load, and the power consumption can be reduced, thereby reducing manufacturing costs and operating costs.
[0119] In the embodiment shown in Figure 10, the distance D3 from the center of the lens plate 1001 to the center of the non-contact sensor aperture 550 is shorter than the distance D2 from the center of the lens plate 1001 to the image plane 140. In another embodiment, the distance D3 from the center of the lens plate 1001 to the center of the non-contact sensor aperture 550 can also be designed to be equal to the distance D2 from the center of the lens plate 1001 to the image plane 140.
[0120] The main circuit board 1002, located on the rear side of the center of the display device 100, is positioned upright and approximately parallel (including parallel; the same applies hereinafter) to the lens plate 1001 and LCD 1003. Therefore, in this embodiment, the control board is provided in a space formed behind the imaging plane 140 of the aerial image 130, such that its surface is approximately parallel to the imaging plane 140 of the aerial image 130. The main circuit board 1002 is vertically positioned and housed within the housing 110. By positioning the main circuit board 1002 approximately parallel to the lens plate 1001 and LCD 1003, it is possible to reduce the number of components that extend in the front-to-back direction within the display device 100, allowing for more flexible use of space.
[0121] In this embodiment, by arranging the main board 1002 vertically, the size of the control board can be increased in accordance with the size of the imaging surface 140 of the aerial image 130 while suppressing an increase in the dimensions of the display device 100 as seen from the user 200. For example, it is also possible to create a housing space for the main board 1002 at the bottom or top of the LCD 1003 and install the control board in such a housing space. However, in this case, it is necessary to secure a larger space in the front-to-back and left-to-right directions of the display device 100, which would increase the size of the display device 100. In contrast, with the display device 100 in which the main board 1002 is mounted vertically, as described above, the increase in the size of the top can be suppressed, resulting in a more compact appearance and a more desirable aesthetic appearance.
[0122] The internal space of the housing 110 further includes a weight 1030 and a supercapacitor 1070 (also called an electric double-layer capacitor) as a means of energy storage, located above or above the bottom case 1010, and below the center of gravity of the display device 100 (towards the bottom case 1010).
[0123] In the embodiment shown in Figure 10, the weight 1030 and the supercapacitor 1070, which have a relatively high specific gravity compared to the other components, are provided below the display device 100. This lowers the center of gravity of the entire display device 100 and improves its stability. As a result, the display device 100 can maintain a stable state regardless of the tilt of the housing 110 of the display device 100. This also helps to prevent tipping over.
[0124] The supercapacitor 1070 supplies power to more reliably retain user information and other data even in the event of an unexpected power loss, and can be used to close files when such a situation occurs. A rechargeable battery may be used instead of or in addition to the supercapacitor 1070. The supercapacitor 1070, like the weight 1030, is located below the display device 100. Therefore, the supercapacitor 1070 also functions as a weight that lowers the center of gravity of the entire display device 100, thereby further improving the stability of the display device 100's posture.
[0125] Furthermore, if the weight 1030 and the supercapacitor 1070 are placed in front of the center of gravity of the display device 100 (towards the front case 111), the display device 100 can be installed even more stably, regardless of the tilt of the housing 110 of the display device 100.
[0126] A tilt adjustment section 120 is provided below the housing 110. More specifically, below the bottom case 1010, which is part of the housing 110 and also part of the tilt adjustment section 120, a mount base 800 is provided, which together with the bottom case 1010 constitutes the first tilt adjustment mechanism of the tilt adjustment section 120. The mount base 800 is an example of a base, and in the embodiment shown in Figure 10, the bottom case 1010 is mounted on the mount base 800.
[0127] The front case 111 has an opening 550 for a non-contact sensor. Through the opening 550, the non-contact sensor 1102, such as an IR (infrared) sensor or a photoelectric sensor, emits light toward its detection range (hereinafter also referred to as the "detection area"). The surface treatment of the front case 111 should be performed in a way that reduces false detections by the non-contact sensor 1102. The specific configuration of the non-contact sensor 1102 and examples of specific countermeasures against false detections will be explained in detail using Figures 24 to 26. The front case 111 also has an opening 560 for a main switch.
[0128] The main switch 310 is positioned so as not to overlap with the detection range of the non-contact sensor 1102. More specifically, in the embodiment shown in Figure 10, the upper end position 1060 of the main switch 310 is located below the lower end position 1050 of the detection area of the non-contact sensor 1102. This configuration effectively reduces the possibility that the non-contact sensor 1102 may detect an input operation on the aerial image 130 even if the user 200 attempts to operate the main switch 310.
[0129] Since the non-contact sensor 1102 is located inside the front case 111 and on the front side, the entire left-right direction of the display device 100 can be covered as a detection target. In the up-down direction of the display device 100, a portion of the lower area is excluded from the detection range, so that, for example, when the main switch 310 is pressed, the non-contact sensor 1102 does not react. It is desirable that the size of the area excluded from the detection range be changeable or adjustable through updates to the display device 100 (including updates to the firmware of electronic components included in the display device 100, for example) or user settings. It is even better if, additionally or alternatively, the upper area of the display device 100 can also be excluded from the detection range, not just the lower area, in the up-down direction. A configuration in which a portion of the left and right areas of the left-right direction of the display device 100 can be excluded from the detection range will be explained using Figures 24 to 28.
[0130] In the area shown by diagonal lines below the front case 111 in Figure 10, the space between the bottom surface 1020 and the lower inner wall 530 increases as the lower inner wall 530 moves from the user 200-side opening surface 700 toward the rear side of the display device 100. The curved surfaces of the bottom case 1010 and the mount base 800 extend to the vicinity of the lower inner wall 530 of the front case 111 within the second space 1080 (1080b) enclosed by dashed lines. By having a part of the first tilt changing mechanism of the tilt changing section 120 house within the second space 1080 (1080b), a space-saving and compact configuration of the display device 100 can be achieved.
[0131] In the embodiment shown in Figure 10, the microphone 1040 is located in an area near the center of the upper inner wall portion 510 in the left-right direction. In this configuration, the microphone 1040 is mounted such that its directivity points downward from the horizontal, regardless of the tilt of the housing 110. In another embodiment, the microphone 1040 may be located in an area near the center of the upper inner wall portion 510 in the left-right direction, and in such a configuration, the microphone 1040 is mounted such that its directivity points upward from the horizontal, regardless of the tilt of the housing 110.
[0132] In the embodiment shown in Figure 10, the microphone 1040 described above may have an elliptical sound collection range that can collect sound with good sensitivity. In another embodiment, the microphone 1040 may change the shape of the range that can collect sound with good sensitivity, for example, from an elliptical shape to a circular shape, depending on the change in the tilt of the display of the aerial image 130.
[0133] With the above configuration, the display device 100 is Using microphone 1040, it becomes possible to detect the voice of user 200 viewing the aerial image 130 with higher accuracy. More specifically, it becomes easier to collect the voice of user 200 using the display device 100 regardless of the tilt of the aerial image 130 display, while making it more difficult to collect voices from other directions (e.g., noise or voices of people other than user 200). As a result, the occurrence of misrecognition in the voice recognition function is suppressed, and conversations and interactions between user 200 and the character become smoother. However, in another embodiment, if the intention is to collect voices from a wide range, a microphone with wide directivity 1040 may be used.
[0134] In yet another embodiment, a drive unit may be provided to adjust the position of the microphone 1040 so that its directivity is directed more toward the user 200, according to the tilt of the aerial image 130. This makes it possible to detect the voice of the user 200 viewing the aerial image 130 more clearly.
[0135] The above configuration is not limited to the microphone 1040, but can also be applied to other directional sensors. Such sensors may include, for example, a camera that detects the gaze and movement of user 200, a pyroelectric sensor that changes the brightness of the display depending on the presence or absence of user 200 for energy saving (an example of a human presence sensor), or a thermal camera that detects the body temperature of user 200.
[0136] As explained using Figure 5, the inner wall portions 400 (510, 520, 530, 540) of the front case 111 are inclined such that the distance between opposing inner wall portions 400 (510 and 530, 520 and 540) decreases as the distance from the opening surface 700 increases toward the back of the display device 100 from the opening surface 700 on the user 200 side. The second space 1080 (1080t, 1080b) that exists between the inner wall portions 400 and the outer circumferential surface (which may also be called the outer wall portion) of the display device 100 expands as the distance from the opening surface 700 increases toward the back of the display device 100 from the opening surface 700 on the user 200 side, in accordance with the decrease in the distance between opposing inner wall portions 400 (510 and 530, 520 and 540). By arranging the components of the display device 100 within such a second space 1080 (1080t, 1080b), it becomes possible to achieve a very compact and space-saving configuration.
[0137] In the embodiment shown in Figure 10, a microphone 1040 is located in the second space 1080 (1080t), which is shown by a dashed line at the top. Furthermore, a main switch unit is located in the second space 1080 (1080b), which is shown by a dashed line at the bottom. In addition, a portion of the tilt adjustment section 120 also extends to the second space 1080 (1080b). For example, a convex guide 1120 formed on the support surface 1110 of the mount base 800 (described later) or a concave notch (not shown) formed complementary to the bottom case 1010 may also extend to the second space 1080 (1080b).
[0138] This configuration allows for the efficient arrangement of components such as parts within the second space 1080 secured between the inclined inner wall portion 400 (510, 520, 530, 540) and the outer surface of the display device 100, thereby enabling a miniaturization of the entire display device 100. The second space 1080 also exists on the right and left sides of the display device 100 and is used for arranging non-contact sensors 1102, speakers 1104, and the like.
[0139] The above configuration, in which the inner wall portions 400 (510, 520, 530, 540) of the front case 111 are inclined, makes it possible to give the user 200 a sense of depth and floating through the aerial image 130. In addition, it is possible to realize a compact display device 100 configuration even with a tilt adjustment unit 120 for tilting the display of the aerial image 130.
[0140] Figure 11 is an example of an exploded view of a display device 100 according to one embodiment. Similar to the embodiment in Figure 10, the housing 110 consists of a front case 111 and a rear case 112, the display unit 1000 consists of a lens plate 1001, a main board 1002, an LCD 1003, and an LCD holder 1004, and the tilt changing section 120 consists of a bottom case 1010 and a mount base 800. In the embodiment in Figure 11, the mount base 800 has a support surface 1110 and a guide 1120 on its upper curved surface, and a leg portion 810 on its lower bottom surface 1020.
[0141] The display unit 1000 is housed in the space within the enclosure 110, and the main board 1002 of the display unit 1000 is fixed to the rear case 112 on the back side of the display device 100 using screws. It is preferable that the main board 1002 be covered with a resin such as rubber, as this can protect it from the physical force applied when adjusting the tilt of the display.
[0142] The convex guide 1120 formed on the support surface 1110 of the mount base 800 engages with a concave notch (not shown) formed complementary to the bottom case 1010, assisting the bottom case 1010 to slide on the support surface 1110 of the mount base 800 in only one direction (the front-to-back direction of the display device 100).
[0143] In Figure 11, in addition to the display unit 1000, the housing 110 also houses a weight 1030, a non-contact sensor 1102, a microphone 1040, left and right speakers 1104, a button unit, a supercapacitor 1070, and the like. The housing 110 can also house, for example, a temperature sensor 1631 (see Figure 16), an illuminance sensor 1632 (see Figure 16), a humidity sensor, a pressure sensor (barometric pressure sensor), a carbon dioxide concentration sensor, a carbon monoxide concentration sensor, a TVOC (total volatile organic compound) sensor, a PM2.5 sensor, an ozone sensor, an acceleration sensor, a camera, and the like.
[0144] The weight 1030 is positioned on or above the bottom case 1010, below the center of gravity of the display device 100, for example, using double-sided tape. This makes it possible to install the display device 100 in a more stable state regardless of the tilting orientation.
[0145] By appropriately selecting the ratio of the weight of the counterweight 1030 to the weight of the display device 100, the curvature of the curved surfaces of the bottom case 1010 and the mount base 800, the material properties of the bottom case 1010 and the mount base 800, particularly the coefficient of friction, the width of the convex guide 1120 and the width of the concave notch, etc., stable stopping can be achieved in any state of tilt of the housing 110 in a seamless and stepless manner. For example, the weight of the counterweight 1030 should be about 10% of the weight of the display device 100.
[0146] By selecting the width of the convex guide 1120 on the mount base 800 and the width of the concave notch on the bottom case 1010 so that the frictional force between them is of a desired magnitude, stable stopping of the tilt of the housing 110 can be achieved more reliably.
[0147] The speaker 1104 and microphone 1040 are housed in the space between the opening surface 700 and the lens plate 1001, and between the inner wall portions 400 (510, 520, 530, 540) of the housing 110 and the outer circumferential surface of the housing 110. As detailed in relation to Figures 7(a) and 7(b), the four inner wall portions 400 (510, 520, 530, 540) of the front case 111 are inclined inward from the front to the rear. As the inclination of the inner wall portions 400 (510, 520, 530, 540) causes the first space 300 to gradually decrease, the second space 1080 between the inner wall portions 400 (510, 520, 530, 540) and the outer circumferential surface of the housing 110 increases in correspondence.
[0148] By arranging the speaker 1104 and microphone 1040 in the second space 1080 between the inner wall portion 400 (510, 520, 530, 540), which increases with increasing distance from the opening surface 700, and the outer surface of the display device 100, the display device 100 can be made exceptionally space-saving and compact. The speaker 1104 is housed in a sealed space surrounded by the speaker enclosure 650 and lens plate 1001 of the front case 111, thus being configured as a sealed speaker. The speaker 1104 may be a dynamic speaker.
[0149] In the embodiment shown in Figure 11, a portion of the sound output from speaker 1104 is propagated directly towards user 200. The remaining portion of the sound output from speaker 1104 is reflected at least once by the inner wall portions 400 (510, 520, 530, 540) of the front case 111 and the front case 111 itself, before being propagated towards user 200. Since at least a portion of the reflected sound passes through the imaging surface 140 and propagates towards user 200, user 200 can perceive that the sound is being output from an aerial image 130, such as a character, displayed on the imaging surface 140.
[0150] In the embodiment shown in Figure 11, the main switch unit (main button unit) is composed of a main switch 310, an LED panel 1105, a milky white light guide plate 1106, a first sub-board (also called a sensor board) 1107, etc. The main switch unit is, for example, a capacitive touch sensor, and its detection range can be configured to be different from the size visible by the LED panel 1105, and in particular, it can be configured to be larger than the size visible by the LED panel 1105. This allows for a comfortable touch operation range for the user 200 while enabling flexible design of the display device 100.
[0151] The main switch unit is a switch for controlling a major predetermined function, such as the voice recognition of the display device 100. When user 200 presses (touches) the main switch 310, the display device 100 starts voice recognition. Voice recognition is local voice recognition performed using the voice recognition engine implemented on the main board 1002, but voice recognition may also be performed on the voice recognition server side by connecting to a voice recognition server via communication. Furthermore, the display device 100 changes the color of the light around the main switch 310 according to the status of the voice recognition process. This allows user 200 to easily understand the status of the voice recognition process.
[0152] The color of the light around the main switch 310 can be changed, for example, to blue when voice recognition is off, green when voice recognition is in standby mode, red when voice recognition is being processed (voice recognition in progress), and light blue when sound is being output from the display device 100 (when the character is speaking).
[0153] Furthermore, the main predetermined function controlled by the main switch unit may be, for example, a gesture recognition control function instead of a voice recognition control function, or a function that combines a voice recognition control function, a gesture recognition control function, and a function to switch between them. The gesture recognition function uses a camera provided in the display device 100 to recognize gestures such as sign language and body language of the user 200, and in such a configuration, even a user 200 who has difficulty speaking can fully operate the display device 100.
[0154] In the embodiment shown in Figure 11, a front panel 1101 is attached to the user 200 side of the lens plate 1001. The front panel 1101 is an optical component that has both light-transmitting and light-blocking properties. The front panel 1101 is preferably a light-blocking sheet (also called a smoke panel or smoke sheet) with a light-blocking property of about 10% transmittance, and a light-blocking sheet with a light-blocking property of about 6% transmittance is even better for allowing the user 200 to perceive the aerial image 130 as floating. The color of the front panel 1101 is gray, but other colors are also acceptable. The optical properties of the front panel 1101 are selected for the purpose of maintaining the first space 300 in a dark state. This is because it affects the sense of floating of the aerial image 130 given to the user 200. By using such a front panel 1101, the user 200 is housed inside the display device 100. This configuration makes it difficult to see the components being used. In this specification, "front panel" refers to an example of a "dimming component."
[0155] As described above, the front panel 1101 is better if it is surface-treated with a matte or textured finish (i.e., non-glossy) to reduce its light reflectivity, thereby avoiding reflections of the user 200. For example, the front panel 1101 may be made of a material with a lower specular reflectivity than that of the lens plate 1001. This reduces the reflection of the user 200 on the lens plate 1001 located inside the housing 110, making it easier for the user 200 to concentrate on the aerial image 130. Instead of directly surface-treating the front panel 1101, an anti-reflective film may be applied to the front panel 1101 in addition.
[0156] Figure 12 is an example of an exploded view illustrating the relationship between the front case 111, speaker 1104, and speaker enclosure 650. Figure 12(a) is an example of a perspective view of an enlarged exploded view of the front case 111, speaker 1104, and speaker enclosure 650, viewed from the front. Figure 12(b) is an example of a perspective view of an enlarged exploded view of the front case 111, speaker 1104, and speaker enclosure 650, viewed from the rear.
[0157] In Figure 12(a), a speaker housing 1210 is formed integrally with the front case 111 on the opposite side of the inner wall 400 (the back side of the inner wall 400). In the embodiment shown in Figure 12(a), the speaker 1104 is housed in the speaker housing 1210 and covered by a sealing plate 1103, thereby forming a sealed speaker enclosure 650 (speaker box).
[0158] The speaker 1104 may be positioned in the speaker housing 1210 with the magnet side facing the outer surface and the cone side facing the opposite side (the inner wall 400 side), with the sound emission hole 640 side facing the sound emission direction. Alternatively, the speaker may be positioned with the magnet side facing the inner wall 400 side and the cone side facing the opposite side (the outer surface side), with the sound emission hole 640 side facing a different direction. The speaker 1104 and speaker enclosure 650 may be configured as a sealed speaker as described above, but they may also be configured as a bass reflex speaker, a Kelton speaker, etc. It is desirable that they can emit sound with sufficient power even when there are space constraints for securing the speaker 1104 and speaker enclosure 650 for purposes such as miniaturizing the display device 100. The speaker 1104 and speaker enclosure 650 should be configured considering the type and characteristics of sound to be output by the display device 100, such as character voices and music.
[0159] The sealing plate 1103 is, for example, a plate-shaped member made of plastic, and is fixedly connected to the front case 111 by means of fixing based on adhesion using adhesive or double-sided tape, fixing based on shape such as fitting, or fixing based on frictional force generated by pressing the sealing plate 1103 into the corresponding part of the front case 111.
[0160] Figure 12(b) shows that, in addition to the configuration shown in Figure 12(a), the speaker enclosure 650 extends along two different inner wall sections 400 of the front case 111: the left inner wall section 520 and the lower inner wall section 530, and the right inner wall section 540 and the lower inner wall section 530. The right inner wall section 540 and the lower inner wall section 530 are connected to each other and are an example of two inner wall sections 400 facing in different directions. In Figure 12(b), the x, y, and z axes are added along the wall surface of the speaker enclosure 650.
[0161] Figure 13 is an example of an explanatory diagram illustrating the shape of the speaker enclosure 650. Figure 13(a) is an example of an explanatory diagram illustrating the shape of the speaker enclosure 650 as seen in the yz plane of Figure 12(b). Figure 13(b) is an example of an explanatory diagram illustrating the shape of the speaker enclosure 650 as seen in the xz plane of Figure 12(b).
[0162] In Figure 13(a), the lower part of the speaker enclosure 650 extends further towards the rear than the upper part of the speaker enclosure 650. In Figure 13(b), the lower part of the speaker enclosure 650 has an L-shape, extending further towards the center of the lower inner wall portion 530 (towards the main switch opening 560) than the upper part of the speaker enclosure 650.
[0163] The speaker enclosure 650 surrounds the third space 1200 with a shape that extends along two interconnected inner walls, thereby forming a larger sealed speaker 1104 within the display device 100. In order to secure a wider third space 1200, the speaker enclosure 650 may also have a shape that extends along, for example, three or more inner walls 400, such as the left inner wall 520, the lower inner wall 530, and the right inner wall 540.
[0164] Figure 14 shows an example of a perspective view of the shape of the lower part of the front case 111. Figure 14(a) is a perspective view of the lower part of the front case 111 from the rear. Figure 14(b) is a perspective view of the lower part of the front case 111 from the front.
[0165] In Figure 14(a), the lower part of the speaker enclosure 650 extends further to the rear than the upper part of the speaker enclosure 650, and the lower part of the speaker enclosure 650 extends further toward the center of the lower inner wall portion 530 (towards the main switch opening 560) on the opposite side of the inner wall surface of the lower inner wall portion 530.
[0166] In Figure 14(b), the upper part of the speaker enclosure 650 has a speaker housing section 1210, and below the speaker housing section 1210, the third space 1200 extends further toward the center side of the lower inner wall section 530 (towards the main switch opening 560), giving it an L-shape. The speaker housing section 1210 is a space for housing the speaker 1104, located within the third space 1200.
[0167] In the embodiment shown in Figure 14, the speaker 1104 housed in the speaker housing 1210 is preferably located in the area where the sound-emitting hole 640 is formed, but it may also be located in a different position. Furthermore, although the speaker 1104 is mounted approximately parallel to the left and right outer surfaces of the display device 100, the speaker 1104 housed in the speaker housing 1210 may also be mounted approximately parallel to the inclination of the left inner wall 520 and the right inner wall 540. Additionally, by selecting materials for the left inner wall 520 and the right inner wall 540, it is conceivable that these materials may function as diaphragms to improve the power of the sound output.
[0168] The configuration described using Figures 12 to 14 allows for a more spatially efficient design and the placement of a larger volume speaker enclosure 650 compared to configurations where the speaker enclosure 650 is designed in a simple cube or rectangular prism shape. This configuration suppresses the increase in the external dimensions of the display device 100, and therefore enables miniaturization of the housing 110. Furthermore, this speaker enclosure 650 makes it easier to improve the sound quality from the speaker 1104 and to ensure sufficient power for low-frequency audio output.
[0169] Furthermore, because the left and right inner walls 520 and 540 are inclined, sound is emitted from the left and right inner walls 520 and 540 toward the opening, and the sound waves converge in the center. This allows the display device 100 to output the speech sounds of the character displayed as an aerial image 130 with higher sound quality, and as if the character itself, located in the center of the image-forming surface 140, were actually speaking. As a result, the user 200 can perceive the aerial image 130 with a greater sense of immersion.
[0170] Figure 15 is an example of an explanatory diagram illustrating the connection state of the electrical components of a display device 100 according to one embodiment. In the embodiment shown in Figure 15, the main board 1002 is connected to a non-contact sensor 1102, a microphone 1040, a speaker 1104, a first sub-board (board for capacitive sensor) 1107, a second sub-board (board for tact switch) 1500, and a supercapacitor 1070. As mentioned in relation to Figure 11, the vertical orientation of the main board 1002 allows other components to be arranged under relatively loose spatial constraints, particularly in the upper and lower parts of the display device 100, thereby improving design flexibility. Furthermore, the upper and lower parts of the display device 100 can be designed to have a space-saving and slim appearance.
[0171] Figure 16 is an example of a system block diagram illustrating the electrical configuration of a display device 100 according to one embodiment. In the embodiment shown in Figure 16, the main board 1002 includes a processor module 1600, a communication module 1650, an eMMC memory 1610 (e.g., flash memory), a DDR memory 1620, a communication module 1650, and various connectors. The main board 1002 is connected to a non-contact sensor 1102, an LCD 1003, a microphone 1040, a speaker 1104, a second sub-board 1500, an antenna 1660, a power adapter 1640, and the like via connectors.
[0172] The processor module 1600 has, for example, a CPU and a GPU, and controls various parts of the main board 1002. The main board 1002 having the processor module 1600 may function as a control unit that is responsible for controlling the display device 100. The display device 100 may further have two or more second sub-boards 1500. For example, the first sub-board 1107 may have a touch key circuit 1633, etc., and the second sub-board 1500 may have a temperature sensor 1631, an illuminance sensor 1632, a touch key circuit 1633, etc. Note that the processor module 1600 of the display device 100 may be read as the control unit of the display device 100. Also, the main board 1002 having the processor module 1600 may be understood as the control unit of the display device 100.
[0173] The main board 1002, the first sub-board 1107, and the second sub-board 1500 are mounted, for example, as a Printed Circuit Board Assembly (PCBA). It is preferable that the PCBA be covered with a resin such as rubber, as this protects the PCBA from the physical forces applied when changing the tilt of the display. Furthermore, if the main board 1002, the first sub-board 1107, and the second sub-board 1500 are composed of a flexible printed circuit board (FPC board) or a rigid-flexible circuit board, in addition to a rigid board, it is possible to facilitate the manufacturing of the display device 100 and reduce the effects associated with the movement of the tilt changing section 120.
[0174] The main board 1002 has an RTC (Real-Time Clock) 1630 as a means of measuring time. The RTC 1630 has a battery for the RTC, which is provided separately from the supercapacitor 1070, and measures time by receiving power from this RTC battery. For example, if the display device 100 is configured to be connected to the internet, it is necessary to retain the time until the time is obtained from an NTP server (for example, from the time the display device 100 is powered on until it connects to the internet and the NTP server). The main board 1002 displays the time, for example, in a time notification function, so it has a battery for the RTC to retain time information even when offline.
[0175] The control performed by the main board 1002 using the supercapacitor 1070 will be explained. Because the supercapacitor 1070 is provided, even if there is a power outage in the display device 100 due to the interruption of external power supply via the power cable 910, operational malfunctions such as file corruption can be prevented. The main board 1002 operates in the event of a power outage. In this case, it is preferable to have a function that receives power from the supercapacitor 1070 and performs processing to protect the file system. The supercapacitor 1070 is charged at predetermined timings. For example, the main board 1002 may perform power control to charge the supercapacitor 1070 when the power is turned on.
[0176] The main board 1002 has a function to change the content of communication in the communication function according to the user 200's usage history of the display device 100, such as the history of communication between the character and the user 200. For example, the main board 1002 updates parameters indicating the relationship between the user 200 and the character according to whether the user 200 performed an action that increased or decreased the character's favorability. The relationship between the user 200 and the character may include a parameter indicating the character's mood towards the user 200, or a parameter indicating the intimacy between the two (e.g., intimacy level), which is stored in the eMMC memory 1610 as flash memory (an example of non-volatile memory), and the main board 1002 has a function to update these parameters.
[0177] Possible conditions for updating parameters include, for example, the time elapsed since user 200 started using the display device 100, the history of operations performed by user 200, and sensing of the surrounding environment using sensors 330, at least one of these. The main board 1002 should have a function to change the types of communication the character can engage in based on the updated parameters. Changing the communication should, in particular, increase the variety of communication. For example, the main board 1002 may change the character's actions or the phrases the character speaks. In the event of a power outage, the main board 1002 updates the parameters stored in the eMMC memory 1610 based on the latest status. This prevents malfunctions such as data corruption due to a power outage, which could cause the user 200 to lose track of the time they have spent with the character (for example, the time spent raising the character), such as the history of communication between the character and user 200.
[0178] Let's describe another example of a communication function. The main board 1002 implements a time notification function in which a character announces the time based on the time measured. The main board 1002 displays an object that displays the time in association with a character (in this example, an object that resembles a board), as shown in Figure 23(a). In this content, the character is depicted holding a board that displays the time. The main board 1002 may also display the character moving the object.
[0179] Furthermore, the main board 1002 connects to the internet via a wireless LAN or the like using the communication module 1650, communicates with a predetermined server device, and acquires weather information. The main board 1002 implements a function that tells the weather by character. As shown in Figure 23(b), for example, the main board 1002 implements a function in which a character reads out the weather information for the location of the display device 100. Here, in addition to the aforementioned Kirishima Rei, the cat character Teru is displayed as a character and reads out the weather information. In addition to or instead of weather information, other current events information such as news, or other information, may be read out.
[0180] The electrical components illustrated in Figure 16 are merely examples, and as mentioned in relation to Figure 9, the display device 100 may have, in addition to or instead of, the temperature sensor 1631 and the illuminance sensor 1632, a humidity sensor, an acceleration sensor, a camera, etc. In embodiments where the display device 100 has a camera, the display device 100 can also use the camera to perform functions such as detecting the user 200's gaze, motion detection, room monitoring, and further functions utilizing these functions.
[0181] The main board 1002 may also have connectors for wired connections during debugging, sockets for external storage devices such as microSD cards, and connection points for PCs, smartphones, etc.
[0182] Figure 17 is an example of an explanatory diagram illustrating the detection area and detection target of the non-contact sensor 1102. Figure 17(a) is an example of an explanatory diagram illustrating the state in which a character is displayed. Figure 17(b) is an example of an explanatory diagram illustrating the state in which both a character and an icon are displayed. Figure 17(c) is an example of an explanatory diagram illustrating the state in which the first setting screen 1720 is displayed. Figure 17(d) is an example of an explanatory diagram illustrating the state in which the second setting screen 1730 is displayed.
[0183] Figures 17(a) to 17(d) illustrate an icon 1700 of a hand with an index finger raised. This hand icon 1700 is an icon that represents user operation and does not represent an image or icon displayed by the display device 100. The non-contact sensor 1102 provided on the display device 100 has a detection area that is at least in the area where the aerial image 130 is displayed.
[0184] In Figure 17(a), the non-contact sensor 1102 can detect touch and gesture operations on the character by the user 200. In Figure 17(b), in addition to detecting touch operations on the character by the user 200, the non-contact sensor 1102 can also detect touch operations on the two icons displayed at the top. Figures 17(c) and 17(d) are examples of setting screens that can be accessed by tapping the setting screen access icon 1710 in Figure 17(b). The display device 100 can also detect touch operations on each icon displayed on the setting screen.
[0185] By designing the detection area of the non-contact sensor 1102 to be located at or near the aerial image 130, the user 200 can perform aerial operations, such as gesture control, with the sensation of touching the aerial image 130. For example, if the aerial image 130 is a character, the user can get the sensation of touching the character.
[0186] More specifically, the non-contact sensor 1102 can detect user 200 operations (e.g., fingers) in the air, particularly within the concave first space 300 of the display device 100, by assigning them to actions such as touching a character or selecting a menu item. The non-contact sensor 1102 can detect not only touches but also slides and shakes.
[0187] In a configuration where the detection area of the non-contact sensor 1102 is positioned closer to the display unit 1000 than the aerial image 130 (i.e., further back from the display device 100), the user 200 can access the detection area by feeling as if they are touching or pressing the aerial image 130. Similarly, in a configuration where the detection area of the non-contact sensor 1102 is positioned at or near the opening surface 700, which is closer to the user 200 in the internal space of the housing 110, the sense of three-dimensionality of the aerial image 130 perceived in conjunction with the internal space of the housing 110 is enhanced, and aerial operations and gesture operations can be performed with the feeling as if touching the aerial image 130.
[0188] Because the detection area of the non-contact sensor 1102 is located behind the imaging surface 140 of the aerial image 130 (i.e., on the back side of the display device 100), the user 200 can perform operations without consciously stopping their fingers in front of the aerial image 130. This is preferable because it makes it easier for the user 200 to be aware of their interaction with the aerial image 130, especially the character, displayed by the display device 100.
[0189] In Figures 17(b), 17(c), and 17(d), the non-contact sensor 1102 is assumed to detect so-called "touch operations" by the user 200's fingers on icons such as the settings screen call icon 1710. In contrast, Figure 17(a) is assumed to detect not only similar touch operations on characters, but also "gesture operations" in which the user 200's finger movements, such as direction, speed, and acceleration, are assigned to predetermined gestures and detected. This allows the user 200 to perform a wider variety of inputs, especially when the displayed image is a character.
[0190] Figure 24 is an example of an explanatory diagram illustrating the adjustable detection area 2410 of the non-contact sensor 1102. In the embodiment of Figure 24, the display device 100 can adjust the size of the detection area described above. In other words, the display device 100 can adjust the size of the active area, which is the area activated by the non-contact sensor 1102 as the area for detecting the presence or movement of an object. Furthermore, in the embodiment of Figure 24, the size of the adjustable detection area 2410 is smaller than the maximum detectable area 2420 in which the non-contact sensor 1102 can detect the presence, position, and movement of an object according to its specifications. An example of a configuration having a detectable area larger than the maximum detectable area 2420 in the embodiment of Figure 24 will be explained using Figures 27 and 28.
[0191] More specifically, in the embodiment shown in Figure 24, the detectable region 2420 has a length L2 (hereinafter referred to as the "horizontal length") between the left inner wall portion 520 and the right inner wall portion 540, for example, where the opening 550 for the non-contact sensor is provided. Furthermore, in the embodiment shown in Figure 24, the detectable region 2420 is divided into an adjustable detection region 2410, a first exclusion region 2430 extending along the right inner wall portion 540, and a second exclusion region 2440 extending along the left inner wall portion 520.
[0192] As will be described later using Figures 25 and 26, the non-contact sensor 1102 may detect or acquire unexpected input signals, for example, within the first exclusion area 2430, that are not due to user aerial operations, based on structural differences in the inner wall portion 400 or manufacturing tolerances of the non-contact sensor 1102 itself. By providing the first exclusion area 2430, the display device 100 can suppress the reflection of false detections and ghost touches that occur depending on the usage status and environment of the display device 100 in the display. In addition, it becomes easier to reduce the chances of the user encountering a situation in which the display of the aerial image 130 changes spontaneously even though the user is not performing any input operations on the display device 100.
[0193] In this specification, the term or phenomenon of "ghost touch" broadly refers to input operations that are not caused by the user's intention or action, or the response or change in the aerial image based on the detection of such operations. In particular, the following will describe the detection by the non-contact sensor 1102 that occurs in relation to input operations detected due to changes in reflected light from the inner walls 510, 520, 530, and 540, the response or change in the aerial image based on such detection, and means for resolving them. There are various reasons why ghost touch may occur, but an example of a situation in which ghost touch is detected will be explained later in Figures 25 and 26. The following will assume a case in which ghost touch occurs and describe methods for reducing its impact.
[0194] In the embodiment shown in Figure 24, the maximum detectable area 2420 is shown to coincide with the front opening surface (user-side opening surface) 700. However, the non-contact sensor 1102 may have a maximum detectable area 2420 that is larger than the front opening surface 700. In other words, the non-contact sensor 1102 may be capable of detecting objects at a distance longer than the length L2 in the left-right direction.
[0195] The adjustable detection area 2410 has a length L1 in the left-right direction, the first exclusion area 2430 has a length L3 in the left-right direction, and the second exclusion area 2440 has a length L4 in the left-right direction. In Figure 24, for clarity, the adjustable detection area 2410, the detectable area 2420, the first exclusion area 2430, and the second exclusion area 2440 are shown. The 440s are drawn with a slight gap between them, but such a gap is not always necessary. If this gap is not provided, the horizontal length L2 of the detectable area 2420 is equal to the sum of the horizontal lengths L1, L3, and L4 (L2 = L1 + L3 + L4).
[0196] The left-right length L3 of the first exclusion area 2430 and the left-right length L4 of the second exclusion area 2440 may be 0. In that case, the first exclusion area 2430 and the second exclusion area 2440 do not exist. In a configuration in which the first exclusion area 2430 and the second exclusion area 2440 are not set, the adjustable detection area 2410 coincides with the detectable area 2420. Furthermore, it is preferable that the display device 100 and the non-contact sensor 1102 be configured to allow continuous or stepwise adjustment of the left-right length L3 of the first exclusion area 2430 and the left-right length L4 of the second exclusion area 2440.
[0197] If the configuration is set so that only the area outside the nominal detection area of the non-contact sensor 1102 is set as the first exclusion area 2430 and the second exclusion area 2440 is not set, the entire nominal detection area of the non-contact sensor 1102 can be effectively used. Alternatively, if the configuration is set so that the area inside the nominal detection area of the non-contact sensor 1102 is also set as the first exclusion area 2430, it is possible to more reliably reduce the occurrence of false detections and ghost touches caused by reflections on the inner wall portion 540 on the right side, for example.
[0198] With these configurations, the display device 100 can effectively suppress the reflection of ghost touch effects, which occur depending on individual usage conditions and environments that differ for each display device 100 or for each user, onto the aerial image 130. This effectively reduces the likelihood of users feeling uncomfortable with the aerial image 130, and especially with the characters displayed as the aerial image 130.
[0199] In the embodiment shown in Figure 24, the adjustable detection area 2410, the detectable area 2420, the first exclusion area 2430, and the second exclusion area 2440 are all located on the same plane. The light output by the non-contact sensor 1102 (synthetic light 2500 in Figure 25) travels along the same plane until it hits an object located on that plane, or the inner wall 540 on the right side. In particular, highly directional laser light travels in a straight line. At least a portion of the light that hits the object or the inner wall 540 on the right side and is reflected returns to the non-contact sensor 1102 via the same plane and is detected by the detection unit of the non-contact sensor 1102.
[0200] The non-contact sensor 1102 has a configuration that allows it to detect the presence, position, and movement of an object within the detectable area 2420 as described above, or, if there is no structure such as the right inner wall portion 540 that blocks the light from the non-contact sensor 1102, it can even detect the presence and movement of an object outside the detectable area 2420, and has a configuration that allows it to detect the length in the left-right direction of the detectable area as described above to be longer than L2.
[0201] Even when no user operation is being performed, the non-contact sensor 1102 may detect ghost touches, such as the structure of the right inner wall 540, the upper inner wall 510, the lower inner wall 530, the reflection of ambient light or light from the non-contact sensor 1102 on the right inner wall 540, or images reflected on the upper inner wall 510, the lower inner wall 530, and the right inner wall 540, as the presence or movement of an object. Therefore, the display device 100 and the non-contact sensor 1102 can suppress the detection of ghost touches in the first exclusion area 2430 by excluding the first exclusion area 2430 from the detection area, and the display device 100 can avoid having ghost touches reflected in the display of the aerial image. Furthermore, the display device 100 can effectively avoid having detection results of actions such as a user cleaning the right inner wall 540, specifically wiping away dust and other dirt from the right inner wall 540, reflected in the display and control of the display device 100.
[0202] Similarly, even when a second exclusion area 2440 is set along the left inner wall portion 520, the display device 100 can effectively prevent detection results of actions such as cleaning the left inner wall portion 520 by the user, specifically wiping away dust and other dirt from the left inner wall portion 520, or wiping away dirt from the non-contact sensor opening 550 and its surroundings, from being reflected in the display and control of the display device 100.
[0203] The specific configuration of the non-contact sensor 1102 and ghost touch, etc., will be explained in more detail below. As already explained, the non-contact sensor 1102 is a non-contact type sensor such as an IR (infrared) sensor or a photoelectric sensor, and is designed so that the adjustable detection area 2410 and the detectable area 2420 are located at or near the aerial image 130.
[0204] In a configuration where the display device 100 is provided with a first exclusion area 2430 and a second exclusion area 2440 according to Figure 24, the processor module 1600 of the display device 100 (see Figure 16) has a function that can reduce the detection sensitivity in the first exclusion area 2430 and the second exclusion area 2440 based on its operating system (OS) and application. Alternatively, the microcontroller (MCU: Micro Controller Unit, hereinafter referred to as "microcontroller") 1670 (see Figure 16) of the non-contact sensor 1102 may have a function that can reduce the detection sensitivity in the first exclusion area 2430 and the second exclusion area 2440 based on its firmware.
[0205] Furthermore, the processor module 1600 of the display device 100 may be configured to select, depending on the situation, whether the processor module 1600 of the display device 100 performs control to reduce detection sensitivity, the microcontroller 1670 of the non-contact sensor 1102 performs control to reduce detection sensitivity, or the processor module 1600 of the display device 100 and the microcontroller 1670 of the non-contact sensor 1102 perform control to reduce detection sensitivity in cooperation.
[0206] In such an embodiment, the microcontroller 1670 of the non-contact sensor 1102 stops or suppresses the detection of objects in the first exclusion area 2430 and the second exclusion area 2440, or stops outputting detection signals as detection results in the first exclusion area 2430 and the second exclusion area 2440 to the display device 100, and especially to the processor module 1600 of the display device 100. In this way, it is possible to efficiently avoid, for example, detecting the right inner wall portion 540 itself as an object, or detecting differences in the degree of reflection of individual synchrotron radiation 2500 on the right inner wall portion 540.
[0207] In addition to or alternative to the above configuration, if the processor module 1600 of the display device 100 sets a first exclusion area 2430 and a second exclusion area 2440 according to Figure 24 based on its operating system (OS) and application, the processor module 1600 of the display device 100 may be configured to have a function to perform filtering on the detection results in the first exclusion area 2430 and the second exclusion area 2440. In such a configuration, the processor module 1600 filters the detection results obtained from the non-contact sensor 1102 that are in the first exclusion area 2430 and the second exclusion area 2440, invalidates the filtered detection results, and stops their use in subsequent control.
[0208] Alternatively, the microcontroller 1670 of the non-contact sensor 1102 may be configured to have a function that performs filtering on the detection results in the first exclusion area 2430 and the second exclusion area 2440 based on its firmware. In such a configuration, the microcontroller 1670 filters the detection results in the first exclusion area 2430 and the second exclusion area 2440 and stops outputting the filtered detection results to the display device 100.
[0209] Furthermore, the processor module 1600 of the display device 100 may be configured to allow selection, depending on the situation, whether the processor module 1600 of the display device 100 performs the filtering process, the microcontroller 1670 of the non-contact sensor 1102 performs the filtering process, or the processor module 1600 of the display device 100 and the microcontroller 1670 of the non-contact sensor 1102 perform the filtering process in cooperation.
[0210] In this way, similar to the configuration that reduces detection sensitivity as described above, it is possible to more effectively reduce, for example, the detection of the right inner wall portion 540 itself as an object, and the detection of differences in the degree of reflection of individual synchrotron radiation 2500 on the right inner wall portion 540. Furthermore, by implementing this in combination with the configuration that reduces detection sensitivity as described above, the above effect can be further improved.
[0211] Furthermore, in configurations where the display device 100 has a camera for user recognition, for example, the processor module 1600 of the display device 100 is even better configured to have a function that determines whether the detection result is due to a ghost touch based on, for example, the time period when a detection signal is detected by the non-contact sensor 1102, the detection location, the detection frequency, the presence or absence of a user within the range where the display device can be operated, and the positional relationship with the user, and sets the range in which ghost touches frequently occur as another exclusion area. This allows the display device 100 to flexibly respond to ghost touches caused by individual circumstances or environments.
[0212] In a configuration where the processor module 1600 of the display device 100 can set the first exclusion area 2430, the second exclusion area 2440, or any other exclusion area, by setting the first exclusion area 2430, the second exclusion area 2440, or any other exclusion area as needed each time, ghost touches caused by manufacturing tolerances of individual components of the display device 100, manufacturing tolerances of the display device 100 as a whole, and changes in the structure of the display device 100 over time depending on the user's usage environment and usage conditions can be suppressed for a long period of time, especially over the product life of the display device 100, so that they are reflected in the display of aerial images and their changes. As a result, even if ghost touches or false detections occur due to causes specific to each display device, such as dust adhering to the display device 100 or the degree of ambient light exposure, the processor module 1600 of the display device 100 can respond flexibly to them.
[0213] The first exclusion area 2430, the second exclusion area 2440, or any other exclusion area described above may be set for each time period. For example, if the non-contact sensor 1102 frequently detects ghost touches at a specific location on the right inner wall portion 540 within the first exclusion area 2430 during late-night hours, for example, at a location corresponding to the lights 2603-2610 in Figure 26(c), and detects no ghost touches at all or only rarely during other time periods, then the first exclusion area 2430 may be set only for such late-night hours. For example, if ghost touches are frequently detected during the time when sunlight hits the display device 100, then setting this time period on a seasonal basis would eliminate the need for the user to frequently change the installation location of the display device 100 according to the season.
[0214] Furthermore, in another embodiment, the display device 100 has a human presence sensor, and the display device 100 is configured to set the operation position and operation range, such as a ghost touch, detected when no person is present around the display device 100, as excluded positions and excluded ranges. A pyroelectric sensor or a camera can be used as the human presence sensor.
[0215] In a configuration using a camera, particularly a camera with a microcontroller, as a human presence sensor, it is preferable that the processor module 1600 of the display device 100 is configured to perform a person recognition function, particularly a person identification function, based on its operating system, or that the camera's microcontroller is configured to perform a person recognition function, particularly a person identification function, based on its firmware. In such a configuration, the processor module 1600 of the display device 100 can perform different display controls for legitimate users and other people based on the person recognition function.
[0216] In relation to the processor module 1600 of the display device 100 setting up the first exclusion area 2430, the second exclusion area 2440, or yet another exclusion area after the display device 100 has been manufactured, it is preferable that the processor module 1600 of the display device 100 outputs messages such as "The detection area will be changed" or "The detection area has been changed" from the speaker 1104 or the like, in the voice of a character displayed as an aerial image 130 of the display device 100, before the setting begins or after the setting has been made.
[0217] This allows users to have more opportunities to communicate with the displayed character, and also makes them feel more supported by the character, thus fostering a greater sense of familiarity with the character. It is preferable that the processor module 1600 of the display device 100 outputs such messages, for example, when a human presence sensor detects that a user is nearby.
[0218] Furthermore, in a configuration where the processor module 1600 outputs messages such as "Executing self-repair program" or "Self-repair program executed" from the speaker 1104 or the like to notify the user of setting changes as described above, the display device 100 can not only notify the user that settings have been changed, but also simultaneously create the impression that the character is an autonomous thinking AI, and improve the sense of presence and realism of the character that the user perceives.
[0219] As already explained, it is preferable to configure the display device 100 so that a portion of the lower area is outside the detection range, i.e., an exclusion area, in the vertical direction, so that the non-contact sensor 1102 does not react to actions such as pressing the main switch 310. However, depending on the user's operation patterns and the installation position of the display device 100, when pressing the main switch 310, the user's finger may still pass through the detection range, and the non-contact sensor 1102 may detect this as an input operation. Therefore, it is preferable that the processor module 1600 of the display device 100 and the microcontroller 1670 of the non-contact sensor 1102 be configured to allow setting a portion of the detection range as another exclusion area as needed.
[0220] Specifically, the processor module 1600 of the display device 100 records, for example, that it has acquired a detection signal for an input operation to the main switch 310 after acquiring a detection signal for an input operation to a specific range in the lower part of the detection area by the non-contact sensor 1102. The processor module 1600 of the display device 100 determines, based on the number and frequency, whether the input operation to the aforementioned specific range was an intended input operation or part of the operation of an input operation to the main switch 310. If the processor module 1600 of the display device 100 determines that the input operation to the above-mentioned specific range is part of the operation of an input operation to the main switch 310, it is preferable to configure the system to further set the above-mentioned specific range as another excluded area.
[0221] The processor module 1600 of the display device 100 and the microcontroller 1670 of the non-contact sensor 1102 are preferably configured to perform object size filtering, which stops or suppresses the detection of objects larger than a predetermined size. The predetermined size is preferably determined based on the width of a human finger, since the non-contact sensor 1102 is used in the display device 100 to detect operations by a human finger, for example, it may be 8 mm or more.
[0222] The processor module 1600 of the display device 100 may have the ability to perform this object size filtering process based on its operating system and application. In such a configuration, the processor module 1600 filters out detection results from the non-contact sensor 1102 for objects larger than a predetermined size, invalidates the filtered detection results, and stops using the filtered detection results for subsequent control.
[0223] Similarly, it is preferable that the microcontroller 1670 of the non-contact sensor 1102 has the ability to perform this object size filtering based on its firmware. In such a configuration, the microcontroller 1670 of the non-contact sensor 1102 stops detecting objects larger than a predetermined size, or stops outputting the detection result of such objects to the display device 100.
[0224] Furthermore, the processor module 1600 of the display device 100 is preferably configured to be able to select, depending on the situation, whether the processor module 1600 of the display device 100 performs the object size filtering, the microcontroller 1670 of the non-contact sensor 1102 performs the object size filtering, or the processor module 1600 of the display device 100 and the microcontroller 1670 of the non-contact sensor 1102 perform the object size filtering together.
[0225] As a result, aerial manipulation by objects smaller than 8 mm, such as fingers or pens, can be detected and reflected in the control of the aerial image. However, if a relatively large object, such as the right inner wall 540 area or a part of clothing, that exceeds 8 mm is present in the detection area, such object will not be included in the detection target, thereby reducing the frequency of detecting unintended user input, or making it less likely for the detection results of such objects to be reflected in the control of the aerial image.
[0226] By using the various configurations described above individually or in combination, the effects of ghost touches on the aerial image 130 can be effectively suppressed. This allows the user experience of the display device 100 to be optimized or improved on a case-by-case basis, even after the display device 100 has been manufactured. In addition, the design of the display device 100 is greatly improved because it can flexibly respond to ghost touches caused by various factors such as the manufacturing tolerances of the non-contact sensor 1102, the manufacturing tolerances of the display device 100, the design of the display device 100, and the deformation of the display device 100 over time. In particular, the design freedom for the incident position of the synchrotron radiation 2500 and the surrounding area is greatly improved.
[0227] Furthermore, the effects of ghost touch caused by the reflection of light from the non-contact sensor 1102 on the right inner wall 540, the image reflected on the inner wall 540, ambient light reflected by the inner wall 540 (e.g., indoor lighting, sunlight, light from a PC monitor, etc.), and dust adhering to the inner wall 540, as well as changes in these conditions over time, can also be reduced by making the following design changes to the structure of the non-contact sensor 1102, the housing 110, and especially the inner wall 400.
[0228] The non-contact sensor 1102 emits synchrotron radiation 2500 such that at the point where the synchrotron radiation 2500 from the non-contact sensor 1102 enters the inner wall portion 400 of the housing 110, particularly the right inner wall portion 540, the center line of the synchrotron radiation 2500 is inclined with respect to the surface of the housing 110. More specifically, the non-contact sensor 1102 emits synchrotron radiation 2500 with the center line of the synchrotron radiation 2500 inclined with respect to the normal of the surface of the housing 110 at the point of incidence of the synchrotron radiation 2500. The non-contact sensor 1102 may have a fixed radiation direction for the synchrotron radiation, but it is preferable that it has a configuration that allows the radiation direction of the synchrotron radiation 2500 to be changed. In this way, it is possible to effectively prevent the synchrotron radiation 2500, especially when traveling from the left inner wall 520 toward the right inner wall 540, from being reflected by the right inner wall 540 and then returning to the position of the non-contact sensor 1102 on the left inner wall 520.
[0229] The housing 110 is preferably configured to reflect the synchrotron radiation 2500 from the non-contact sensor 1102 such that the reflected light from the housing 110 is incident outside the detection area of the non-contact sensor 1102. In this way, it is possible to effectively suppress the non-contact sensor 1102 from detecting the reflected light or changes in its characteristics caused by the structure of the housing 110's inner wall 400.
[0230] The non-contact sensor 1102 is preferably configured to irradiate the synchrotron radiation 2500 such that the reflected light from the housing 110 is incident on the outside of the detection part of the non-contact sensor 1102. The non-contact sensor 1102 may have a fixed radiation direction for the synchrotron radiation 2500, but it is preferable that the radiation direction of the synchrotron radiation 2500 can be changed. In such a configuration, if reflected light comes into contact with the detection part of the non-contact sensor 1102 for any reason, the radiation direction of the synchrotron radiation 2500 can be changed each time, thereby more reliably preventing the reflected light from coming into contact with the detection part of the non-contact sensor 1102.
[0231] The housing 110 is configured to absorb the synchrotron radiation 2500 such that the intensity of the reflected light from the non-contact sensor 1102 that is reflected by the housing 110 and incident on the detection part of the non-contact sensor 1102 is less than a predetermined detection sensitivity of the non-contact sensor 1102. The predetermined detection sensitivity is, for example, the minimum value that the non-contact sensor 1102 can actually detect, or the minimum value of the detection sensitivity set for the non-contact sensor 1102. The configuration for absorbing the synchrotron radiation 2500 can be flexibly realized by, for example, using a material with high light absorption or a material that does not reflect light easily for the housing 110, attaching a material with high light absorption to the housing 110, coating the housing 110 with a material with high light absorption, or by combining these configurations. Such a configuration can not only reduce the intensity of reflected light, but also bring about optical effects such as reducing the intensity of ambient light reflection and suppressing reflections of images and users.
[0232] The housing 110 is preferably configured to diffusely reflect the synchrotron radiation 2500 from the non-contact sensor 1102 such that the intensity of the reflected light incident on the detection part of the non-contact sensor 1102, which is reflected off the surface of the housing 110, is less than a predetermined detection sensitivity of the non-contact sensor 1102. A configuration that diffusely reflects the synchrotron radiation 2500 is, for example, a configuration in which the surface of the housing 110 is textured or matte. Such a configuration not only reduces the intensity of the reflected light but also provides optical effects such as reducing the intensity of ambient light reflection and suppressing reflections of images and users.
[0233] The above configurations for absorbing the synchrotron radiation 2500 and for diffusely reflecting the synchrotron radiation 2500 can be employed simultaneously. In such a configuration, the intensity of the reflected light of the synchrotron radiation 2500 reflected by the inner wall portion 400 of the housing 110, particularly the right inner wall portion 540, can be significantly reduced.
[0234] The non-contact sensor 1102 is preferably configured to radiate synchrotron radiation 2500 from the non-contact sensor 1102 in a direction that passes through the first space 300 and directly reaches the outside of the first space 300. In such a configuration, the synchrotron radiation 2500 does not strike the housing 110, and therefore does not enter the housing 110, and therefore does not reflect off the housing 110, but is radiated toward the outside of the display device 100. Therefore, by preventing the synchrotron radiation 2500 from striking the housing 110, the non-contact sensor 1102 can significantly reduce the influence of reflection of synchrotron radiation 2500 from the housing 110 while maintaining a configuration that allows for the detection of objects in the detection area within the first space 300. Specific examples of such a configuration will be explained using Figures 27 and 28.
[0235] The non-contact sensor 1102 is preferably configured to radiate the synchrotron radiation 2500 from the non-contact sensor 1102 in a direction that passes through a void in the housing 110 that follows the first space 300 and reaches the outside of the housing 110. The "void" is a space provided in the radiation path of the synchrotron radiation 2500 from the non-contact sensor 1102. This space is connected to the first space 300 so that the synchrotron radiation 2500 can pass through. The housing 110 defines at least a portion of the space. In such a configuration, the non-contact sensor 1102 emits the synchrotron radiation 2500 toward the outside of the display device 100 by passing it through a space formed, for example, by an opening or recess in the housing 110. The structure and shape of the space can be designed as appropriate, but it should be the minimum size necessary to allow the synchrotron radiation 2500 to pass through.
[0236] For example, in a configuration where the right inner wall portion 540 has an opening of the same size as the non-contact sensor opening 550 in the left inner wall portion 520, and which connects to the outside of the display device 100, it is possible to avoid compromising the overall uniformity of the display device 100, compared to a configuration in which, for example, a part of the right inner wall portion 540 is simply removed.
[0237] Alternatively, a light guide may be provided that prevents the synchrotron radiation 2500 from passing outside the display device 100, but instead guides it into the housing 110 of the display device 100 through an opening in the right inner wall 540. The same effects as described above can be obtained with such a configuration as well.
[0238] The non-contact sensor 1102 is preferably configured to emit synchrotron radiation 2500 from the non-contact sensor 1102 toward the outside of the first space 300 such that the detection area is inclined with respect to the imaging plane 140 of the aerial image 130. A more specific configuration will be explained using Figures 27 and 28.
[0239] Below, an example of a situation in which the non-contact sensor 1102 detects the aforementioned ghost touch will be specifically explained using Figures 25 and 26.
[0240] Figure 25 is an example of an explanatory diagram illustrating a configuration in which synchrotron radiation 2500 is emitted parallel to the imaging surface 140. The non-contact sensor 1102 emits synchrotron radiation 2500 through a non-contact sensor opening 550 provided in the left inner wall portion 520, parallel to the imaging surface 140, and such that the synchrotron radiation 2500 is directly incident on the right inner wall portion 540.
[0241] In the embodiment shown in Figure 25, the synchrotron radiation 2500 emitted by the non-contact sensor 1102 enters the right inner wall portion 540 near the stepped structure 2510, on the front side F of the housing 110 of the display device 100 of the stepped structure 2510. The synchrotron radiation 2500 that enters the right inner wall portion 540 is reflected depending on the angle of emission of the synchrotron radiation 2500 to the right inner wall portion 540, as well as the structure and material of the right inner wall portion 540. Note that "reflection" refers to both "specular reflection" and "diffuse reflection".
[0242] In the embodiment shown in Figure 25, the position on the right inner wall portion 540 where the synchrotron radiation 2500 emitted by the non-contact sensor 1102 enters will be explained in detail using Figure 26(a).
[0243] Figure 26 is an example of an explanatory diagram illustrating structural variations in the non-contact sensor 1102 and the housing 110. In the embodiment of Figure 26, the non-contact sensor 1102 has multiple light sources arranged in a straight line, but each light source is arranged with structural variations based on manufacturing tolerances. Lights 2601 to 2614 in Figure 26 are emitted light 2500 from each light source and light 2600 that struck the inner wall portion 540 on the right side. Lights 2601 to 2614 of the non-contact sensor 1102 are all highly directional light, particularly laser LED light.
[0244] The stepped structures 2520a to 2520d, shown as straight lines in Figure 26, are steps provided on the right inner wall 540 facing the left inner wall 520 where the non-contact sensor 1102 is provided. However, instead of steps, grooves, recesses, or other structural parts may be used. Furthermore, the stepped structures 2520a to 2520d may be considered as straight contours of any structural part provided on the right inner wall 540, and the right inner wall 540 may have discontinuous structural differences or different characteristics on the front side F and the back side B of the stepped structures 2520a to 2520d. Discontinuous structural differences refer to steps, grooves, holes, or other surface structuring as described above. Different characteristics refer to physical properties such as different absorbance or different reflectance.
[0245] Figure 26(a) illustrates a state in which light rays 2601-2614 from the light source 2500 of non-contact sensors 1102, which are arranged in a straight line with variations according to manufacturing tolerances, strike the right inner wall portion 540, all of which strike the right inner wall portion 540 at a front F side of the stepped structure 2520a. In the embodiment of Figure 26(a), each light ray 2601-2614 is incident on the right inner wall portion 540 at a front F side of the stepped structure 2520a. Therefore, each light ray 2601-2614 is reflected at the right inner wall portion 540 in a nearly identical manner. In such a structure, the state of each reflected light is also nearly identical. Therefore, ghost touch caused by differences in reflection at the right inner wall portion 540, especially diffuse reflection (scattered reflection), is unlikely to occur.
[0246] Figure 26(b) illustrates the state in which, of the light rays 2601-2614 from the light source 2500 of the non-contact sensors 1102, which are arranged in a straight line with the same variation as in Figure 26(a), strike the right inner wall portion 540, and light rays 2601-2606 are incident at a position that overlaps with the stepped structure 2520b. In other words, the positions of light rays 2601-2606 and the stepped structure 2520b overlap in the front-to-back direction from the front to the back of the display device 100.
[0247] In the embodiment shown in Figure 26(b), light 2601-2614 is reflected in different ways by the right inner wall 540, based on the stepped structure 2520b itself, or the structural differences and different physical properties of the front side F and back side B of the stepped structure 2520b. In such a structure, for example, light 2601-2606 may experience ghosting due to differences in reflection at the right inner wall 540, particularly diffuse reflection (scattered reflection).
[0248] Figure 26(c) illustrates the state in which light 2603 to 2610, of the light 2601 to 2614 that strikes the right inner wall 540 of the synchrotron radiation 2500 emitted from light sources arranged linearly with a different variation than in Figures 26(a) and 26(b), is incident at a position that overlaps with the stepped structure 2520c. In other words, the positions of light 2603 to 2610 and the stepped structure 2520c overlap in the front-to-back direction from the front to the back of the display device 100. In the embodiment of Figure 26(c), light 2601 to 2614 is reflected in different ways by the right inner wall 540, based on the stepped structure 2520c itself, or the structural differences and different physical properties of the front side F and back side B of the stepped structure 2520c, with light 2601 to 2602, 2611 to 2614 and light 2603 to 2610 being reflected in different ways. In such a structure, for example, with respect to light 2603-2610, ghost touch may occur due to differences in reflection at the right inner wall 540, particularly diffuse reflection (scattered reflection).
[0249] Figure 26(d) illustrates the state in which, of the light rays 2601-2614 that strike the right inner wall 540 of the synchrotron radiation 2500 emitted from light sources arranged in a straight line with the same variation as in Figure 26(c), light rays 2601, 2602, 2611-2614 are incident at a position that overlaps with the stepped structure 2520d. In other words, the positions of light rays 2601, 2602, 2611-2614 and the stepped structure 2520d overlap in the front-to-back direction from the front to the back of the display device 100. In the embodiment shown in Figure 26(d), light 2601-2614 is reflected in different ways by the right inner wall 540, depending on the stepped structure 2520d itself, or the structural differences and different physical properties of the front side F and back side B of the stepped structure 2520d. Light 2601-2602, 2611-2614 and light 2603-2610 are reflected in different ways by the right inner wall 540. In such a structure, for example, light 2601-2602 and 2611-2614 may experience ghosting due to differences in reflection at the right inner wall 540, particularly diffuse reflection (scattered reflection).
[0250] The differences between Figure 26(a) and Figures 26(b) to 26(d) are, for example, deviations in mounting position or tilt that occur during the process of attaching the non-contact sensor 1102, manufacturing tolerances of the non-contact sensor 1102, deformation due to dropping or pressing the display device 100 during use by the user, and manufacturing tolerances of the housing 110. These differences may, in some cases, be unavoidable during the manufacturing stage of the display device 100 or during use of the display device 100.
[0251] In each embodiment described with reference to Figure 25, the display device 100 can suppress ghost touches that occur in situations such as those illustrated in Figures 26(b) to 26(d), depending on the circumstances. As a result, the degree of design freedom during the manufacturing stage of the display device 100 can be significantly improved. Therefore, designs that are highly appealing to users can be actively adopted.
[0252] Figure 27 is an example of an explanatory diagram illustrating a configuration in which synchrotron radiation 2500 is emitted obliquely to the imaging surface 140. The non-contact sensor 1102 emits synchrotron radiation 2500 obliquely to the imaging surface 140 and so as not to directly incident on the housing 110, particularly the inner wall portion 540 on the right side.
[0253] In the embodiment shown in Figure 27, the non-contact sensor 1102 emits synchrotron radiation 2500 into the first space 300 by passing it through the non-contact sensor aperture 550, and the synchrotron radiation 2500 intersects the imaging surface 140 at the midpoint M of the left-right length of the imaging surface 140. In other words, to the left of the midpoint M, the synchrotron radiation 2500 travels within the first space 300, and to the right of the midpoint M, it travels in the space outside the display device 100. With such a structure, in the embodiment shown in Figure 27, the non-contact sensor 1102 can emit the emitted synchrotron radiation 2500 to the outside of the display device 100 without directly incidenting on the housing 110, particularly the right inner wall portion 540, and therefore without reflection there.
[0254] In the embodiment shown in Figure 27, the distance between the imaging surface 140 and the synchrotron radiation 2500 is at its maximum length D at the positions of the left inner wall 520 and the right inner wall 540, respectively. In a configuration where the maximum length D is sufficiently small, the user can perform aerial operations while maintaining the sensation of touching the aerial image 130 displayed on the imaging surface 140, particularly the sense of distance. The maximum length D can be set appropriately according to the size of the display device 100, but it is preferable to set it to less than 10 mm, and especially less than 5 mm.
[0255] Furthermore, near the midpoint M, or in other words, near the center of the adjustable detection area 2410, the distance between the imaging plane 140 and the synchrotron radiation 2500 is shorter than the distance near the left inner wall 520 and the right inner wall 540. This further reduces the chances of the user perceiving a gap between the aerial image 130 and the adjustable detection area 2410. In such a configuration, even though a gap actually exists between the aerial image 130 and the adjustable detection area 2410, the user is less likely to feel any discomfort during aerial operations. This effect can be similarly achieved even in a configuration where the synchrotron radiation 2500 intersects the imaging plane 140 not at the midpoint M, but near the midpoint M. The position near the midpoint M is, for example, a position within approximately 10% to 20% of the left-right length of the imaging plane 140 from the midpoint M.
[0256] Alternatively, instead of the embodiment shown in Figure 26, the positional relationship between the imaging surface 140 and the non-contact sensor 1102 may be adjusted so that the non-contact sensor 1102 emits synchrotron radiation 2500 obliquely to the imaging surface 140 and toward the back side of the first space 300. In yet another embodiment, the non-contact sensor 1102 may emit synchrotron radiation 2500 obliquely to the imaging surface 140 and toward the front side without intersecting the imaging surface 140.
[0257] In the embodiment shown in Figure 27, the non-contact sensor 1102 has an additional detectable area 2710, which has a longer detection range than the left-right opening width of the first space 300. The additional detectable area 2710 has a second adjustable detectable area 2720 and a third adjustable detectable area 2730. The second adjustable detectable area 2720 and the third adjustable detectable area 2730 are shown in Figure 24 The adjustable detection region 2410, the first exclusion region 2430, and the second exclusion region 2440 can be set in the same manner as described in relation to the embodiment.
[0258] The second adjustable detection area 2720 extends between the right inner wall portion 540 and the outer surface 2740 when the display device 100 is viewed from the front. In a configuration where the housing 110 has at least one, for example, a button-shaped protrusion 2750 at the position of the housing 110 corresponding to the second adjustable detection area 2720, the non-contact sensor 1102 can detect a user's contact operation with the protrusion 2750, which is performed with the sensation of touching a button, in the second adjustable detection area 2720 which is located closer to the user than the protrusion 2750. As a result, even if the protrusion 2750 is actually formed as merely a shape-based protrusion, the user can easily perceive the protrusion 2750 as if it were an electrical button or switch.
[0259] For example, the protrusion 2750 may be a straight protrusion, in which case the user can adjust the volume of the speaker 1104 of the display device 100 or the brightness of the aerial image 130 by tracing the straight protrusion up and down. In another example, the protrusion 2750 may be a cross-shaped protrusion, in which case the user can display a cursor in the aerial image 130 and adjust the position of the displayed cursor by tracing the cross-shaped protrusion up, down, left, or right.
[0260] Furthermore, if the protrusions 2750 are, for example, braille-shaped protrusions or simple illustration-shaped protrusions, the user can also operate the device using touch in the dark, which is preferable. In another embodiment, instead of or in addition to the protrusions 2750, marks may be drawn on the surface of the housing 110 corresponding to the second adjustable detection area 2720 by painting, printing, or the like.
[0261] The protrusions 2750 of any of the above structures can be manufactured inexpensively without the need for electrical wiring, and the second adjustable detection area 2720 of the non-contact sensor 1102 can be used to make them behave as if there were actually an operating part there.
[0262] It is preferable that at least one of the processor module 1600 of the display device 100 or the microcontroller 1670 of the non-contact sensor 1102 is configured to set a third adjustable detection area 2730 outside the display device 100, more specifically outside the space defined by the outermost contour of the display device 100. In such a configuration, it is extremely difficult for anyone other than the user who has set the third adjustable detection area 2730 to be aware of its existence. Furthermore, it is preferable that the processor module 1600 of the display device 100 is configured to perform controls such as activating privacy mode or secret mode, or starting privacy settings or secret settings, based on aerial operations in the third adjustable detection area 2730 set outside the display device 100.
[0263] Furthermore, it is preferable that the additional detectable region 2710 is configured to not only have two adjustable detection regions, the second adjustable detection region 2720 and the third adjustable detection region 2730, but also to be configured to be set in combination with one or more additional adjustable detection regions and one or more additional exclusion regions, as this would allow for a more flexible design of the functional configuration. Moreover, it is even better if the processor module 1600 of the display device 100 has a function to arbitrarily deactivate either the second adjustable detection region 2720 or the third adjustable detection region 2730, or to arbitrarily change it to an exclusion region. One specific modification will be explained using Figure 28.
[0264] Figure 28 is an example of another explanatory diagram illustrating a configuration in which synchrotron radiation 2500 is emitted obliquely to the imaging surface 140. The direction of the synchrotron radiation 2500 emitted by the non-contact sensor 1102, and the positional relationship between the imaging surface 140, the housing 110, and the synchrotron radiation 2500 are the same as in the embodiment shown in Figure 27, so no further explanation is provided.
[0265] In the embodiment of Figure 28, similar to the embodiment of Figure 27, the non-contact sensor 1102 has a further detectable area 2710, which has a longer detection range than the left-right opening width of the first space 300. In the embodiment of Figure 28, unlike the embodiment of Figure 27, the further detectable area 2710 has a third exclusion area 2810 and, further beyond the display device 100, a second adjustable detection area 2820. The third exclusion area 2810 and the second adjustable detection area 2820 can be set in the same way as the adjustable detection area 2410, the first exclusion area 2430, and the second exclusion area 2440 described in relation to the embodiment of Figure 24.
[0266] In the embodiment of Figure 28, the third exclusion area 2810 extends further than the second adjustable detection area 2720 in the embodiment of Figure 27. The second adjustable detection area 2820 is set outside the display device 100, more specifically, outside the space defined by the outermost contour of the display device 100. In such a configuration, as in the embodiment of Figure 27, it is extremely difficult for anyone other than the user who set the second adjustable detection area 2820 to recognize its existence. In particular, it is better from a security standpoint if the second adjustable detection area 2820 is set in an area that does not overlap with the display device 100 when viewed directly from the front, side, or top of the display device 100. This point will be discussed later. The display device 100 is configured to perform controls such as activating privacy mode or secret mode, or starting privacy settings or secret settings, based on aerial operations in the second adjustable detection area 2820 set outside the display device 100.
[0267] With this configuration, anyone other than the user who has set the second adjustable detection area 2820 cannot know where such specific operations, such as activating privacy mode or secret mode, or starting privacy settings or secret settings, can be performed, or may not even notice the existence of such a detection area at all. Therefore, it can effectively prevent persons other than the user from performing such specific operations, improve the security of the display device 100, and protect the user's privacy more reliably.
[0268] In particular, with a configuration that allows the user to set a fourth exclusion area on the opposite side of the second adjustable detection area 2820 from the third exclusion area 2810, and arbitrarily change the extending length of the second adjustable detection area 2820, the user himself / herself can flexibly set the position of the second adjustable detection area 2820 to a position that is difficult for third parties to find or touch in accordance with, for example, the installation environment of the display device 100. This can further reduce the occurrence of intentional or unintentional performance of the aforementioned specific operations by persons other than the user, which is more favorable.
[0269] This allows the user to use the display device 100 with greater peace of mind. Furthermore, the user can set an area that can be regarded as a so-called secret input area or hidden command area outside the imaging plane 140 that is the display area of the aerial image 130, particularly outside the space recognized as the display device 100. Accordingly, the user can use the display device 100 with higher reliability.
[0270] FIG. 18 is an explanatory diagram illustrating a display device 100 according to an embodiment connected to a network 1810. In the embodiment of FIG. 18, the display device 100 is connected to a smart home appliance remote controller 1800, a television 1820, a user terminal 1830, an audio device 1840, an air conditioner 1850, a lighting fixture 1860, and a vehicle 1870 via the network 1810. In the embodiment of FIG. 18, the display device 100 has an input unit that accepts an input from a user 200, particularly a voice input. By causing the display device 100 and the smart home appliance remote controller 1800 to cooperate, the user 200 can perform an input to the smart home appliance remote controller 1800 using the display device 100.
[0271] For example, the user 200 can input commands and instructions to the television 1820, the user terminal 1830, the audio device 1840, the air conditioner 1850, the lighting fixture 1860, the vehicle 1870, etc., which are designed and set as smart home appliances, via voice, for example, words, a tap operation, or the like to the display device 100.
[0272] It should be noted that the description "to the display device 100" in this description can be rephrased as "to the character displayed by the display device 100". Thereby, the user 200 can issue or request instructions and commands for IoT control with a natural feeling to a familiar character that the user frequently visually recognizes on a daily basis. This can reduce the uncomfortable feeling of talking to a machine as in the conventional art.
[0273] For example, in addition to the display set in the display device 100, the display device 100 can additionally display a screen for operating connected devices or apparatuses. For example, when the display device 100 includes a carbon dioxide sensor as a sensor, and the carbon dioxide concentration detected by the sensor exceeds a predetermined value, the display device 100 can activate a ventilation fan or improve ventilation efficiency. Furthermore, words such as "Please open a window for ventilation" can be output with the voice of the displayed character.
[0274] With this configuration, the user 200 is more likely to accept requests and warnings from the character than from notifications from a typical machine. In the embodiment shown in Figure 18, the display device 100 can also output notifications in response to information from sensors and other sources on connected devices and equipment. In other words, the display device 100 can extend the use of sensors on connected devices and equipment.
[0275] For example, based on information from sensors installed in the vehicle 1870 and sensors installed in on-board equipment such as camera equipment, it is possible to output notifications about the shaking of the vehicle 1870, the approach of suspicious persons, the presence or absence of passengers inside the vehicle, the temperature inside the vehicle, etc. Furthermore, for example, video footage captured by the camera equipment of the vehicle 1870 can be displayed as an aerial image 130.
[0276] Furthermore, the display device 100 can also connect to a server of the company that sells the display device 100 via the network 1810. This allows the display device 100 to obtain information necessary for updates, backups, etc., from the server.
[0277] Figure 19 is an example of an explanatory diagram illustrating variations of the tilt adjustment unit 120. Figures 19(a) and 19(b) are schematic examples of tilt adjustment units 120 that can tilt (rotate up and down) and pan (rotate left and right) using a sphere or a partial sphere (hereinafter, both are collectively referred to as "sphere").
[0278] In the embodiment shown in Figure 19, the sphere 1900 is attached to the housing 110 on one side and at least partially housed in the sphere housing 1910 on the other side. The user 200 can adjust the tilt of the housing 110 by relative rotation between the sphere 1900 and the sphere housing 1910, and, in some cases, by relative rotation between the sphere 1900 and the housing 110. In this case as well, it is preferable that the adjustment be seamless or stepless, as this allows the user 200 to achieve the optimal installation state for themselves.
[0279] In addition to the sphere 1900, other components such as a circuit board can also be housed within the sphere housing section 1910. Furthermore, operating sections such as a main switch 310 and a sub-switch 320, as well as other input / output sections, can be provided on the outer surface of the sphere housing section 1910.
[0280] Figure 20 is an example of an explanatory diagram illustrating the display device 100 according to the second embodiment. Figure 20(a) is an example of a perspective view of the display device 100. Figure 20(b) is an example of a perspective view of the display device 100. In the embodiment of Figure 20, the display device 100 has a tilt changing section 120 that utilizes a sphere 1900, as explained using Figure 19. .
[0281] In the embodiment shown in Figure 20, the spherical portion of the tilt-changing section 120 is configured so that it is not visible to the user 200. As a result, the user 200 can concentrate on the image displayed by the display device 100 without recognizing the mechanism of the mechanically moving parts, and therefore without recognizing unnecessary information about the display device 100.
[0282] In the embodiment shown in Figure 20, the depth and width of the rear side of the display device 100 can be reduced by housing the tilt adjustment unit, substrate, etc., within the base unit 2010. In the embodiment shown in Figure 20, a stage-shaped base 2000 is provided at a position that coincides with the lower end of the imaging surface 140. Because the lower end of the imaging surface 140 and the upper surface of the base (also called the base surface) coincide, the display device 100 can display an image in which, for example, the feet (e.g., shoes) of a character displayed as an aerial image 130 are resting on the base.
[0283] Furthermore, it is preferable that a non-contact sensor opening 550 be provided on the upper surface of the base 2000 at a position coinciding with the lower edge of the imaging surface 140. The shape of the non-contact sensor opening 550 is preferably such that the non-contact sensor 1102 body is not visible from the user 200's line of sight Du when viewing the aerial image 130, and that it does not reduce the detection sensitivity of the non-contact sensor 1102. As a result, the user 200 can operate the display device 100 without being aware of the presence of the non-contact sensor 1102.
[0284] In another embodiment, in which the embodiment of Figure 20 is modified to tilt the imaging surface 140 without tilting the housing 110, the tilt of the display of the aerial image 130 (imaging surface 140) is changed around the lower edge of the imaging surface 140, and in conjunction with this, the detection area of the non-contact sensor 1102 is also tilted around the lower edge of the imaging surface 140. As a result, the positional relationship between the aerial image 130 and the detection area of the non-contact sensor 1102 can be maintained to the extent that the user 200 does not perceive any difference before and after the display of the aerial image 130 is tilted.
[0285] Figure 21 is an example of an explanatory diagram illustrating the display device 100 according to the third embodiment. Figure 21(a) is an example of a front view of the display device 100 according to the third embodiment. Figure 21(b) is an example of a right side view of the display device 100 according to the third embodiment. Figure 21(c) is an example of another right side view of the display device 100 according to the third embodiment. Figure 21(d) is an example of a perspective view of the display device 100 according to the third embodiment, viewed from the front right side. Figure 21(e) is an example of a perspective view of the display device 100 according to the third embodiment, viewed from the rear. Figure 21(f) is an example of another perspective view of the display device 100 according to the third embodiment.
[0286] Figure 21 illustrates a display device 100 according to a third embodiment, which differs from the embodiment in Figure 3 in that the sound collection hole 620 for the microphone 1040 and the sound emission hole 640 for the speaker 1104 are provided on the lower front. In the embodiment of Figure 21, the structure of the front case 111 can be simplified compared to that of the embodiment in Figure 3, thus further reducing manufacturing costs.
[0287] Figure 22 is an example of an explanatory diagram illustrating the display device 100 according to the fourth embodiment. Figure 22(a) is an example of a front view of the display device 100 according to the fourth embodiment. Figure 22(b) is an example of a right side view of the display device 100 according to the fourth embodiment. Figure 22(c) is an example of another right side view of the display device 100 according to the fourth embodiment. Figure 22(d) is an example of a perspective view of the display device 100 according to the fourth embodiment, viewed from the front right side. Figure 22(e) is an example of a perspective view of the display device 100 according to the fourth embodiment, viewed from the rear. Figure 22(f) is an example of another perspective view of the display device 100 according to the fourth embodiment.
[0288] Figure 22 illustrates a display device 100 according to a fourth embodiment, and differs from the embodiment in Figure 3 in that, similar to the embodiment in Figure 21, the microphone 1040, the sound collection hole 620, and the sound emission hole 640 for the speaker 1104 are provided at the lower front. In the embodiment in Figure 22, a columnar support member 2210 is further used as a tilt adjustment part, and the housing 110 is mounted to the columnar support member 2210 so as to be rotatable around a pivot axis 2200. With this configuration, it is also possible to design the housing 110 to have a wider range of angles in which it can be tilted, for example, from 0° to 180°.
[0289] In an unillustrated embodiment, the display device 100 may be provided with a lever for the user 200 to adjust the tilt of the display unit 1000, for example, at the position of the rotation shaft 2200 in FIG. 22. Thereby, the user 200 can change the display tilt of the aerial image 130 while keeping the tilt of the housing 110 of the display device 100 unchanged. As described above, the tilt changing unit can be understood as changing the tilt of the display unit 1000 without changing the tilt of the housing 110. Various modifications can be made to the image display unit exemplified by the display unit 1000 as will be described later, however, depending on the configuration of the image display unit, it is also conceivable to change the tilt of at least a part of the members constituting the optical system while keeping the tilt of the display unchanged.
[0290] Furthermore, tilting the display of the aerial image 130 may be performed by a method that does not tilt the display unit 1000. For example, image processing such as image processing may allow the object displayed by the aerial image 130 to be recognized by the user 200 as being directly facing. As described above, the tilt changing unit can be understood as changing the display tilt of the aerial image without changing the tilts of the housing 110 and the display unit 1000. In this case, for example, the main substrate 1002 may implement the function of the tilt changing unit. Even in the image display unit described later, it is conceivable to change the tilt of the aerial image while keeping the tilts of the display and the optical system unchanged. Furthermore, in the above-described embodiments, changing the display tilt of the aerial image 130 is a forward-backward tilt change with respect to the user 200 side, however, changing the tilt in other directions such as left-right tilt is also conceivable to make the image directly face the user 200.
[0291] <Modified Example of Optical System> In the above-described embodiments, the case where the optical system for displaying (i.e., imaging) an aerial image is a lens plate 1001 having a plurality of lenses arranged two-dimensionally has been described. For the optical system, for example, the following configurations may be adopted.
[0292] For example, the intermediate optical element may be provided in the space behind the front panel 1101 within the housing 110. This intermediate optical element may be placed in close contact with the front panel 1101 or at a distance from the front panel 1101. This intermediate optical element is an optical element that performs two reflections, and may be an AI plate which is a two-layer orthogonal reflector using stacked mirrors, a DCRC which is an optical element manufactured by nanoimprint press molding, or a retroreflective sheet. Even with this configuration, an aerial image 130 can be obtained.
[0293] The optical system is particularly well-suited to be a transparent, plate-shaped member positioned almost parallel to the LCD 1003 as the display. This plate-shaped member should ideally not have a reflector. As such a plate-shaped member, a microlens array arranged in two dimensions, such as a lens plate 1001, with numerous microlenses, is preferable. By arranging the LCD 1003 as the display and the microlens array as the plate-shaped member almost parallel in this way, it is considered easier to display the aerial image 130 so that it is positioned towards the user 200 while simultaneously achieving a vertically elongated housing structure for the display device 100.
[0294] The optical system may be positioned diagonally with respect to the display. For example, the LCD 1003, which serves as the display, may be positioned diagonally with respect to the lens plate 1001. Alternatively, the lens plate may have a reflector structure (e.g., an array of dihedral orthogonal reflectors or an array of dihedral corner reflectors (DCRA)), and the LCD 1003 may be positioned diagonally with respect to the lens plate. Such a lens plate may be, for example, an ASKA3D plate (see: https: / / aska3d.com / ja / index.html) or a parity mirror (see: https: / / evort.jp / store / piq / product / paritymirror).
[0295] The optical system can be a retroreflective type. For example, an LCD1003 can be placed on the bottom, with the top as the display surface, and a reflector can be placed diagonally, with a retroreflective sheet positioned vertically (reference: https: / / www.carbide.co.jp / product / airial_display / ). In this example, a portion of the image light emitted from the LCD1003 goes towards the beam splitter. The light reflected by the beam splitter goes towards the reflector. The reflector retroreflectively reflects the light arriving from the beam splitter back to the beam splitter. The light that has passed through the beam splitter is collected, and an aerial image is displayed.
[0296] <Display Method for Aerial Images> The display of aerial images may be realized by using a 3D liquid crystal display device for LCD1003. Examples of 3D liquid crystal displays include dot matrix display devices with stereoscopic display functions that enable stereoscopic viewing with the naked eye, transparent parallax barrier display panels that enable stereoscopic viewing with the naked eye, transparent display panels that enable stereoscopic viewing with the naked eye equipped with lenticular lenses, or transparent display panels that are viewed with 3D glasses equipped with polarizing filters (Reference: https: / / osusumehulu.com / wp-content / uploads / 2015 / 06 / KS001508.jpg).
[0297] A half-mirror may be provided on the display panel itself on the display side of the dot matrix display device described above. This half-mirror is made by depositing aluminum on the glass surface of the liquid crystal panel to a degree that allows light to pass through. A component that can control the transparency by switching electricity on and off may be provided on part or all of the display panel itself of the 3D liquid crystal device. In this embodiment, it is preferable to attach a dimmable film that can control the transparency by electricity to the front of the display panel (reference: https: / / www.toppan.co.jp / electronics / new_products / lc_magic). The dimming of this dimmable film should match the color of the housing 110 to the color when opaque, for example, by becoming white if the housing 110 is white, and becoming black if the housing 110 is black.
[0298] A transparent screen may be attached to part or all of the display panel of the 3D liquid crystal display device. In this embodiment, it is preferable to attach a dimmable film, whose transmittance can be controlled electrically, to the front of the display panel (Reference: http: / / www.hachinos.jp).
[0299] Furthermore, a field-of-view limiting sheet may be attached to the front of the 3D LCD device to restrict the field of view in a predetermined direction. Even with this configuration, the display of the 3D image shown by the 3D LCD device is not hindered.
[0300] By using a 3D LCD device in this way, a 3D aerial image that is easy for user 200 to view can be obtained.
[0301] <Examples of application to other forms of display devices> The embodiment shown in Figure 2 is configured as a stationary display device 100, but this embodiment can also be implemented as various types of digital signage. Furthermore, the dimensions and weight of the display device 100, and the size of the aerial image displayed, can be varied in various ways. The shape of the housing 110 may be other than a rectangular parallelepiped, for example, a cylindrical shape, a cone shape, a triangular pyramid shape, etc. For example, an embodiment not shown can also be implemented as digital signage mounted on the walls, columns, or ceilings of buildings such as train stations, department stores, offices, and factories. Note that digital signage refers to digital display signage, dynamic signage, interactive signage, digital POP, digital bulletin board, electronic bulletin board, electronic poster, electronic It is also called a board or electronic billboard.
[0302] In yet another embodiment not shown, it can be implemented as, for example, a display for an intercom in a residence or office, or a display for a man-machine interface (MMI) or human-machine interface (HMI) installed in a smart home or smart office.
[0303] In the above-mentioned embodiments not shown, the display device 100 is often embedded in building materials such as buildings, and in such configurations, the display device 100 does not necessarily require a dedicated housing 110, or it may be omitted. In such configurations, it is conceivable to adjust the tilt of the aerial image 130 display by changing the orientation of the display unit 1000 inside the display device 100 while keeping the orientation of the building material into which the display device 100 is incorporated, or by controlling the 3D display method (display method of the aerial image 130) while keeping the orientation of the component and the display unit 1000 the same.
[0304] In the above-mentioned embodiment (not shown), the aerial image 130 can also be configured to change the tilt of the display of the aerial image 130 according to the line of sight or eye height of an object recognized, for example, by an additional camera. In this case, for example, the tilt of the display is changed in the direction of the object's line of sight. Alternatively, the tilt of the display of the aerial image 130 may be changed by remote control, such as a remote control.
[0305] For example, the installation position of an intercom display can be difficult for children or people in wheelchairs to see. Therefore, it is preferable to have a configuration that allows the aerial image 130 to be tilted to match the eye level of the display user, so that the aerial image 130 can be displayed at a tilt that is more suitable for each user.
[0306] For example, in an embodiment where the display device 100 is installed on the ceiling of a corridor in a shopping mall or train station, if a person to whom the aerial image 130 is to be shown is recognized, the tilt of the displayed aerial image 130 can be gradually adjusted according to the distance to that person. More specifically, the tilt of the display, which is perpendicular to the road surface of the corridor, can be gradually adjusted downwards as the person approaches. This allows the tilt of images such as advertisements to be changed so that they are more easily visible to the target audience of the advertisement. In yet another embodiment, the display device 100 can also be installed on the floor of a corridor in a shopping mall or train station. In this case as well, the tilt of the displayed aerial image 130 can be gradually adjusted in the same manner as described above.
[0307] Furthermore, the present invention can also be applied to display devices that are worn on the body, such as head-mounted displays and VR goggles, or eyeglasses.
[0308] The opening surface 700 is not an essential component, for example, if it does not accept non-contact operation by the user 200. In such cases, a light-transmitting material such as glass or plastic, for example, a colorless and transparent material, may be provided. Thus, the position of the opening surface 700 is such that there is a portion that is understood as a light-transmitting area.
[0309] Furthermore, the control lines and information lines shown are those deemed necessary for explanatory purposes, and not all control lines and information lines are necessarily shown in the actual product. In reality, it can be assumed that almost all components are interconnected.
[0310] Furthermore, the scope of the present invention is not limited to the configurations explicitly described in the specification, but also includes combinations of various aspects of the present invention disclosed herein. While the configurations for which patent protection is sought are specified in the appended claims, we intend to include configurations disclosed herein that are not currently specified in the claims in the future.
[0311] The present invention is not limited to the configuration described in the embodiments above. The components of each embodiment and modification described above may be arbitrarily selected and combined. Furthermore, any component of each embodiment and modification may be arbitrarily combined with any component described in the means for solving the invention, or any component that embodies any component described in the means for solving the invention. The present application intends to obtain rights to these as well through amendments or divisional applications. Even if there is a description such as "in the case of..." or "when...", it is not meant to be a configuration that is limited to that case or time. Configurations that do not fall under these cases or times are also disclosed, and the present application intends to obtain rights to them. Also, even if there is a sequence of descriptions, it is not limited to that order. Configurations in which some parts are deleted or the order is changed are also disclosed, and the present application intends to obtain rights to them.
[0312] Furthermore, by converting to a design registration application, we intend to acquire rights to the overall design or a partial design. The drawing depicts the entire device with solid lines, but it is a drawing that includes not only the overall design but also partial designs claimed for parts of the device. For example, it is a drawing that includes not only a partial design for a part of the device's components, but also a partial design for a part of the device regardless of its components. A part of the device may be a component of the device, or a part of a component. We intend to acquire rights not only to the overall design, but also to a partial design where any part of the solid lines in the drawing is represented by dashed lines. In addition, all modules, components, and parts inside the device's casing that are shown in the drawing are independently tradable, and similarly, we intend to acquire rights to them by converting to a design registration application.
[0313] The above-described embodiment discloses at least the following configuration: (1) A display device having an image display unit that displays an aerial image to the user, and a tilt changing unit that changes the tilt of the display of the aerial image to the user. In this way, the user can change the tilt of the display of the aerial image and view it. For example, the user can face the aerial image directly and view it, making it easier for the user to get a greater sense of immersion when using the display device.
[0314] (2) The tilt changing unit is a display device that changes the tilt of the aerial image at least before and after its display. In this way, the user can change and adjust the tilt of the aerial image display according to the height of the display device's installation position and the user's eye level. The relative positional relationship between the user's eyes and the aerial image changes depending on the installation environment, such as the height of the display device's installation position and the user's eye level, but the user can view the aerial image directly in any installation environment.
[0315] (3) The tilt changing unit is a display device that changes the tilt of the aerial image display by changing the tilt of the image display unit. In this way, the user can change the tilt of the aerial image display and view the aerial image by changing the tilt of the image display unit. By physically tilting the image display unit, the tilt of the aerial image display changes in conjunction with it, so the configuration for changing the tilt of the aerial image display can be simplified.
[0316] (4) A display device having a housing having a first space enclosed by an inner wall, the image display unit having the inside of the housing, and the tilt changing unit changing the tilt of the image display unit and the aerial image display by changing the tilt of the housing. In this way, the user can change the tilt of the image display unit and, by extension, the aerial image display by changing the tilt of the housing and view the aerial image. Since the user can change the tilt of the image display unit and, by extension, the aerial image display in conjunction with changing the tilt of the housing, the configuration for changing the tilt of the aerial image display can be simplified.
[0317] (5) A display device wherein the inner wall portion of the housing forms an opening surface that opens to the user in the first space, and the image display portion displays the aerial image within the range of the opening surface as seen from the user. In this way, the user can simultaneously see the first space surrounded by the inner wall portion and the aerial image through the opening surface that opens to the user, and in combination with the first space, it is possible to obtain a greater sense of three-dimensionality from the aerial image. For example, in a configuration where the aerial image is a character, it is possible to obtain a sense that the user is floating in the first space.
[0318] (6) The image display unit is a display device that displays the aerial image at or near the position of the opening surface in the first space. In this way, the user can more easily perceive the three-dimensionality of the aerial image. If the aerial image is displayed further towards the user than the opening surface, the aerial image will be displayed at a position close to the user. However, displaying the aerial image at or near the position of the opening surface, which is a position close to the user in the first space inside the housing, enhances the three-dimensionality of the aerial image that the user perceives in combination with the first space.
[0319] (7) A display device wherein the inner walls are inclined such that the spacing between each inner wall decreases as the distance from the opening surface increases. In this way, the user can more easily see the inner walls, more easily perceive the depth of the first space inside the housing, get the feeling that the aerial image is located close to them, and enhance the sense of three-dimensionality of the aerial image that the user perceives in combination with the first space inside the housing.
[0320] (8) A display device in which at least one component is arranged in a second space between the inner wall portion and the outer peripheral surface of the display device, the second space which expands in accordance with the decrease in the distance from the opening surface in accordance with the decrease in the distance between each of the inner wall portions. In this way, components such as parts can be efficiently arranged in the second space between the inclined inner wall portion and the outer peripheral surface, and the entire display device can be made smaller.
[0321] (9) The inner wall portion is formed of a light-shielding material, which is a display device. In this way, the user can visually observe the aerial image floating in the first space inside the housing, which is kept in a relatively dark state, thereby enhancing the sense of depth of the aerial image perceived by the user.
[0322] (10) A display device wherein the inner wall portion is a color with lower brightness than the outer surface of the display device. In this way, the user can visually observe the aerial image floating in the first space inside the housing, which is maintained in a relatively dark state, thereby enhancing the three-dimensionality of the aerial image perceived by the user, and also making it easier to feel a sense of luxury from the bright color of the exterior of the housing.
[0323] (11) A display device having a second tilt changing unit for tilting the housing toward the rear when viewed from the user's side. In this way, even if the tilt changing unit alone cannot obtain the tilt of the aerial image display desired by the user, the housing can be further tilted toward the rear to obtain the tilt of the aerial image display desired by the user.
[0324] (12) The second tilt-changing section is a display device having legs that can protrude downward in the front area of the bottom of the display device. In this way, the user can choose whether or not to tilt the housing further to the rear by operating the legs that can protrude downward in the front area of the bottom.
[0325] (13) The display device has a first mode in which the bottom surface of the display device is grounded, and a second mode in which the legs and the rear side region of the bottom of the display device are grounded. In this way, the user can select the grounding state from the first mode and the second mode according to the usage environment, etc., so that the tilt of the housing can be adjusted more flexibly.
[0326] (14) A display device wherein the tilt changing section has a base and a sliding section that can slide on the base, the image display section is fixedly attached to the sliding section, and a weight is positioned above or on the sliding section, below the center of gravity of the image display section. In this way, the center of gravity can be moved even further below the original center of gravity of the image display section by the weight. Therefore, even if the tilt of the casing is changed, the orientation of the display device can be stabilized.
[0327] (15) A display device wherein the tilt changing section comprises a base and a sliding section that can slide on the base, the image display section is fixedly mounted to the sliding section, and the power storage section is positioned above or above the sliding section, below the center of gravity of the image display section. In this way, the center of gravity can be set low below the center of gravity of the image display section by the relatively heavy power storage section, so that the orientation of the display device can be stabilized even when the tilt of the housing is changed. In addition, when a relatively heavy power storage section such as a supercapacitor or battery is placed instead of a weight, the space can be used efficiently because no weight is used.
[0328] (16) A display device having a cable having at least one of a power line or a signal line, wherein the base has a recess in which the connector of the cable, which is connected at a position on the outer surface of the housing, is located, and the recess is configured such that the cable does not come into contact with the recess regardless of the tilt of the case. In this way, no matter how the tilt of the housing is changed, the cable will not come into contact with the recess, and thus stress on the cable can be suppressed.
[0329] (17) The image display unit is a display device comprising a display having a display surface that emits image light, and an optical system that forms an image of the aerial image based on the image light. In this way, an aerial image can be displayed in a space different from the display surface of the display by a display method that combines the display and the optical system.
[0330] (18) A display device wherein the tilt of the housing changes by an angle less than or equal to the viewing angle of the display. This reduces the possibility that the user will view the display from outside the viewing angle range of the display, thus reducing the possibility that the user may perceive that the aerial image is not displayed (for example, that the aerial image has disappeared) depending on the direction of the user's gaze.
[0331] (19) The optical system is a display device having a lens plate on which a plurality of lenses for forming an image of the aerial image are arranged in two dimensions. In this way, an aerial image can be displayed with a simple configuration by a display method that combines a display and a lens plate. In particular, if the lens plate is arranged almost parallel (including parallel) to the display surface of the display, it becomes easier to display the aerial image so that it is positioned on the user side while also making it easier to make the display device have a vertical housing structure. In particular, if the optical system does not have a reflector, it becomes even easier to make the display device have a vertical housing structure.
[0332] (20) The image display unit is a display device having a light-reducing member between the imaging surface of the aerial image and the display. In this way, the user can visually view the aerial image floating in a first space inside the housing which is kept in a relatively dark state, thereby enhancing the sense of depth of the aerial image obtained by the user.
[0333] (21) A display device wherein the reflectance of the specularly reflected light of the dimming member is lower than the reflectance of the specularly reflected light of the optical system. In this way, the dimming member reduces the reflection of the user in the optical system inside the housing, making it easier for the user to concentrate on the image displayed by the display device.
[0334] (22) A display device having a non-contact sensor in which a detection area for detecting a user's aerial operation exists at or near the position of the aerial image. In this way, the user can perform aerial operations as if they were touching the aerial image. For example, if the aerial image is a character, the user can get the feeling that they are touching the character.
[0335] (23) A display device wherein the detection area of the non-contact sensor is located on the image display side of the aerial image. In this way, the detection area of the non-contact sensor is located on the image display side (the back side of the display device) of the aerial image, so the user can access the detection area by touching or pressing on the aerial image.
[0336] (24) The image display unit is a display device in which the detection area of the non-contact sensor is located in the space between the aperture surface and the optical system. In this way, the detection area of the non-contact sensor is located on the optical system side (for example, on the back side of the display device) of the aperture surface of the concave space defined by the inner wall, so that the user can intuitively grasp the position of the detection area with respect to the aperture surface.
[0337] (25) A display device having an opening formed in the inner wall that corresponds to the length of the detection area and through which light from the non-contact sensor passes. In this way, the main body of the non-contact sensor is placed outside the user's line of sight, making it difficult for the user to recognize the presence of the non-contact sensor, while still ensuring the necessary detection area.
[0338] (26) A display device having an opening in the inner wall that corresponds to the length of one side of the detection area and through which light from the non-contact sensor passes, and a step that extends parallel to the opening along the inner wall. In this way, the opening formed in the inner wall to allow light from the non-contact sensor to pass through, in combination with the step that exists parallel to it, can be made to be a configuration that is easily recognizable to the user as part of the design of the inner wall. Such a configuration is desirable in maintaining the aesthetic appearance of the display device.
[0339] (27) The display device has a function to suppress or disable the reflection of detection results other than the user's aerial operations in the display of the aerial image. In this way, the display device can reduce the opportunities for the user to recognize changes in the display of the aerial image due to factors other than the user's own operations. As a result, the user can use the display device with less discomfort, and thereby become more engrossed in the aerial image.
[0340] (28) The display device has a detection area which is a part of the area in which it can detect reflected light from the non-contact sensor, and the display device or the non-contact sensor reduces the detection sensitivity of the non-contact sensor in areas other than the detection area. In this way, the display device or the non-contact sensor can stop detecting the presence or movement of an object in areas other than the desired area within the detection area which is made possible by the detection performance of the non-contact sensor. As a result, the user is less likely to feel any discomfort that may arise from the display of an aerial image when detection results other than the user's aerial operations in a specific area are reflected in the aerial image.
[0341] (29) The display device has a detection area which is a part of the area in which it can detect reflected light from the non-contact sensor, and the display device or the non-contact sensor invalidates the detection results in areas other than the detection area. In this way, the display device can invalidate the detection results of the presence or movement of an object in areas other than the desired area within the detection area that the detection performance of the non-contact sensor can enable, based on its operating system, etc., or the non-contact sensor can invalidate the detection results of the presence or movement of an object in areas other than the desired area, so that even if the presence or movement of an object is detected in areas other than the desired area, the detection results will not be reflected in the display of the aerial image. As a result, the user is less likely to feel any discomfort that may arise from the display of the aerial image due to the reflection of detection results other than the user's aerial operations in a specific area.
[0342] (30) A display device or a non-contact sensor that invalidates the detection result of reflected light from the non-contact sensor that is reflected by the housing in an area other than the detection area. In this way, the display device can more reliably avoid the presence or structure of the housing being reflected in the display of the aerial image based on its operating system, etc., or the non-contact sensor can do the same based on its firmware, etc. As a result, the user can use the display device in a state that is less likely to cause discomfort, regardless of the state of the housing, for example, the relationship between the location of the housing and ambient light or the reflection of images on the housing.
[0343] (31) A display device or a non-contact sensor that invalidates the detection result of reflected light from the non-contact sensor that has been reflected by an object larger than a predetermined size. In this way, the display device can more reliably avoid, based on its operating system, etc., or the non-contact sensor can more reliably avoid, in the display of an aerial image, detection results from objects larger than a predetermined size, such as fingertips or pen tips, and especially detection results from a part of the display device housing that is larger than a predetermined size. As a result, the user can use the display device in a state in which they are less likely to feel discomfort due to objects larger than fingertips or pen tips, etc., regardless of the state of the housing, for example, the relationship between the location of the housing and objects that can access the housing, such as clothes, curtains, documents, stationery, etc.
[0344] (32) A display device wherein the non-contact sensor emits light such that the intensity of the reflected light from the non-contact sensor that is reflected by the housing and incident on the detection unit of the non-contact sensor is less than a predetermined detection sensitivity of the non-contact sensor. In this way, the non-contact sensor can stop detecting the reflected light reflected by the housing by adjusting the emitted light, for example by weakening the intensity of the emitted light. As a result, the user can use the display device in a state in which they are less likely to feel discomfort due to reflections on the housing, regardless of the state of the housing, for example, the relationship between the location of the housing and ambient light or reflections of images on the housing.
[0345] (33) A display device in which the non-contact sensor emits light such that the center line of the light from the non-contact sensor is at the surface of the housing at the position where the light from the non-contact sensor is incident, and is inclined with respect to the surface from which the light from the non-contact sensor is incident. In this way, the non-contact sensor can emit light in such a way that, based on the law of reflection, the light reflected from the surface of the housing does not return to the non-contact sensor. In particular, the non-contact sensor may be able to change the direction of emission of the emitted light manually or automatically, thereby enabling the emitted light to be more reliably inclined with respect to the surface of the housing, even if, for example, deformation occurs on the surface of the housing. As a result, the user can use the display device in a state in which the influence of reflection from the housing is less likely to occur, regardless of the condition of the housing, for example, the relationship between the location of the housing and ambient light or reflection of images on the housing.
[0346] (34) A display device wherein the housing reflects light from the non-contact sensor such that the reflected light from the non-contact sensor reflected by the housing enters the outside of the detection part of the non-contact sensor. In this way, the housing can reflect the emitted light in accordance with the law of reflection so that the light reflected from the surface of the housing does not return to the non-contact sensor. As a result, the user can use the display device in a state in which the influence of reflection from the housing is less likely to occur, regardless of the state of the housing, such as the relationship between the location of the housing and ambient light or reflection of images on the housing.
[0347] (35) A display device in which the non-contact sensor emits light from the non-contact sensor such that the reflected light from the non-contact sensor reflected by the housing is incident on the outside of the detection part of the non-contact sensor. In this way, the non-contact sensor can emit light such that the light reflected by the housing is not incident on the detection part of the non-contact sensor. As a result, the user can use the display device in a state in which the influence of reflection from the housing is less likely to occur, regardless of the state of the housing, such as the relationship between the location of the housing and ambient light or the reflection of images on the housing.
[0348] (36) A display device comprising a housing that absorbs light from the non-contact sensor such that the intensity of the reflected light from the non-contact sensor reflected by the housing and incident on the detection unit of the non-contact sensor is less than a predetermined detection sensitivity of the non-contact sensor. In this manner, the housing absorbs the emitted light that is incident on the detection unit of the non-contact sensor after being reflected by the housing, and returns to the detection unit of the non-contact sensor after absorption. The intensity of reflected light can be reduced to a level where it is not detected by the non-contact sensor, allowing for relatively free selection of the type of non-contact sensor and the design of the housing. For example, even with a less expensive non-contact sensor that does not have features such as sensitivity adjustment, the occurrence and detection of ghost touches related to reflections on the housing can be reduced. As a result, users can use the display device in a state where the effects of reflections on the housing are less likely to occur, even if the display device has a symmetrical configuration.
[0349] (37) A display device wherein the housing diffusely reflects light from the non-contact sensor such that the intensity of the reflected light that is reflected by the housing and incident on the detection unit of the non-contact sensor is less than a predetermined detection sensitivity of the non-contact sensor. In this way, the housing diffusely reflects the emitted light that is incident on the detection unit of the non-contact sensor after being reflected by the housing, and the intensity of the reflected light that returns to the detection unit of the non-contact sensor after diffuse reflection is reduced to a level that is not detected by the non-contact sensor, so that the type of non-contact sensor and the design of the housing can be determined relatively freely. For example, even in a configuration using a less expensive non-contact sensor that does not have a detection sensitivity adjustment function, the occurrence and detection of ghost touches etc. related to reflection at the housing can be reduced. As a result, the user can use the display device in a state in which the influence of reflection at the housing is less likely to occur, even if the display device has a symmetrical configuration.
[0350] (38) A display device wherein the non-contact sensor radiates light from the non-contact sensor in a direction that passes through the first space directly to the outside of the first space. In this way, the non-contact sensor can radiate light directly to the outside of the display device without hitting other components of the display device, such as the housing. As a result, the user can use the display device in a state in which reflection of the radiated light from the housing, etc., is significantly less likely to occur.
[0351] (39) A display device wherein the non-contact sensor radiates light from the non-contact sensor in a direction toward the outside of the housing through a cavity in the housing that is adjacent to the first space. In this way, the non-contact sensor can radiate the emitted light directly toward the outside of the display device through a cavity in the housing without hitting other components of the display device, such as the housing, and can also improve the design freedom of the display device. As a result, users can use display devices with a wider variety of designs in a state in which reflection of emitted light from the housing and the like is significantly less likely to occur.
[0352] (40) A display device wherein the non-contact sensor emits light from the non-contact sensor toward the outside of the first space such that the detection area is inclined with respect to the plane of the aerial image. In this way, the display device can display the aerial image parallel to the front of the display device, for example, facing the user, while inclining the detection area with respect to the aerial image and emitting light toward the outside of the first space and therefore toward the outside of the display device.
[0353] (41) A display device having an operating section for activating a predetermined function, which is positioned behind the position of the aerial image as seen from the user's perspective. In this way, the operating section for activating a predetermined function, such as a voice recognition function, is provided in a position that is easily visible to the user, making it easier for the user to operate the function.
[0354] (42) A display device wherein the operating unit is located in a position that does not overlap with the detection area when viewed from the user's side. In this way, when the user operates the operating unit, the possibility that the non-contact sensor will detect the user's operation of the operating unit as an incorrect air operation can be reduced.
[0355] (43) A display device having a microphone positioned such that the direction of sound detection changes in response to a change in the tilt of the aerial image display, wherein the microphone is configured to have directionality toward the user regardless of the change in the tilt of the aerial image display. In this way, even when the microphone is positioned such that the direction of sound detection (sound collection direction) changes in response to a change in the tilt of the aerial image display, the microphone can be used to easily detect the voice of the user viewing the aerial image.
[0356] (44) A display device having a third space formed between the inner wall and the outer surface of the housing, the inner wall having sound-emitting holes that lead to the third space, and a speaker provided in the third space. In this way, a speaker enclosure is secured in the third space secured between the inner wall and the outer surface of the housing, and sound from the speaker placed in the third space for the speaker enclosure is output from the sound-emitting holes, so that the external dimensions of the display device do not increase while it is easier to secure the power of the sound output from the speaker.
[0357] (45) A display device wherein the speaker is provided at the position of the sound outlet in the third space, and the sound outlet side is provided so that the sound is emitted in a different direction. In this way, sound is output from the sound outlet of the speaker placed in the third space for the speaker enclosure, with the sound outlet side having a different sound emission direction. For example, it is possible to ensure the level of sound output from the speaker while suppressing an increase in the external dimensions of the display device.
[0358] (46) A display device wherein the third space extends along two inner walls that are connected to each other and facing in different directions. In this way, the third space for the speaker enclosure secured between the inner walls and the outer surface of the housing can be made larger in proportion to the shape of the inner walls, thereby making it easier to further increase the power of the audio output from the speaker while suppressing an increase in the external dimensions of the display device.
[0359] (47) A display device wherein the outer surface of the display device has a second operating section located behind the center in the front-to-back direction when viewed from the user's side. In this way, the second operating section operated by the user is less likely to be seen by the user viewing the aerial image, thereby enhancing the user's sense of immersion in the aerial image.
[0360] (48) A display device having a sensor section on its outer periphery, wherein the sensor window is located further back than the second operating section when viewed from the user's side. In this way, the second operating section and the sensor window, which are operated by the user, are less likely to be visible to the user, thereby enhancing the user's immersion in viewing the aerial image, and the sensor window is less likely to be covered by the user's hand even when the second operating section is being operated, thus reducing the likelihood of adverse effects on sensor detection.
[0361] (49) A display device having a control board on which a control unit for controlling the display device is mounted, wherein the control board is provided in a space formed behind the imaging plane of the aerial image, such that its surface is substantially parallel to the imaging plane of the aerial image. In this way, the size of the control board can be increased in proportion to the size of the imaging plane of the aerial image, while suppressing an increase in the dimensions of the display device as seen from the user's side.
[0362] (50) The control board is a display device that displays an image of a character as an aerial image and performs a communication function that realizes simulated communication between the character and the user. In this way, the user can get the feeling that they are facing the character and communicating with it.
[0363] (51) The display device further has a platform portion extending from the image display portion toward the user, and the control board displays an image of the character such that, as seen from the user's side, the character's feet appear to be positioned on the platform portion. In this way, the user can get the feeling that the character is standing on a platform like a stage.
[0364] The inventions described in (1) to (51) above can be combined in any way. For example, one may combine all or part of the configuration of the invention described in (1) with at least part of the configuration of at least one of the inventions described in (2) and onward. In particular, it is preferable to combine the invention described in (1) with at least part of the configuration of at least one of the inventions described in (2) and onward. Alternatively, one may extract any configuration from the inventions described in (1) to (51) and combine the extracted configurations. The applicant of this application intends to obtain rights to inventions that include these configurations. Furthermore, even if there are descriptions such as "in the case of..." or "when...", these are not meant to be descriptions that limit the configuration to that case or time. These are merely examples of better configurations, and the applicant intends to obtain rights to configurations that do not fall under these cases or times. Also, even if there is a sequence of descriptions, it is not limited to that order. Configurations with some parts deleted or the order rearranged are also disclosed, and the applicant intends to obtain rights to them as well. [Explanation of Symbols]
[0365] 100…Display device, 110…Housing, 111…Front case, 120…Tilt adjustment section, 130…Aerial image, 140…Imageing surface, 200…User, 300…First space, 400…Inner wall section, 650…Speaker enclosure, 700…(User side) opening surface, 800…Mounting base, 810…Legs, 1000…Display unit, 1010…Bottom case, 1080…Second space, 1101…Front panel, 1200…Third space
Claims
1. A display device comprising: an image display unit that displays an aerial image to the user; a housing having the image display unit inside and a first space surrounded by an inner wall; a third space formed between the inner wall and the outer surface of the housing; and a speaker provided in the third space, wherein the inner wall has sound-emitting holes that lead to the third space, and at least a portion of the sound output from the speaker is reflected at least once by the inner wall and the front case of the housing, and then propagates to the user side by passing through the imaging plane of the aerial image.
2. The display device according to claim 1, wherein a portion of the sound output from the speaker is transmitted directly to the user, and the remaining portion of the sound output from the speaker is reflected at least once by the inner wall of the front case and the front case before being transmitted to the user.
3. The display device according to claim 1 or 2, wherein the speaker is provided at the position of the sound-emitting hole in the third space and is provided so as to have a sound-emitting direction different from the sound-emitting hole side.
4. The display device according to any one of claims 1 to 3, wherein the third space extends along two inner wall portions that are connected to each other and facing in different directions.
5. The display device according to any one of claims 1 to 4, wherein a speaker housing for housing the speaker is provided in the third space, and the lower part of the speaker housing has a shape that extends longer toward the rear side of the display device than the upper part of the speaker housing.
6. The display device according to claim 5, wherein the lower part of the speaker housing has an L-shaped form that extends longer toward the center of the lower inner wall of the inner wall than the upper part of the speaker housing.
7. The display device according to any one of claims 1 to 6, wherein the speaker and the speaker enclosure housing the speaker constitute a sealed speaker.
8. The display device according to claim 7, wherein the speaker enclosure is formed by a speaker housing portion formed integrally with the front case constituting the housing, and a sealing plate covering the speaker housing portion.
9. The display device according to any one of claims 1 to 8, wherein the image display unit comprises a display having a display surface that emits image light, and an optical system that forms an aerial image based on the image light.
10. The display device according to claim 9, wherein the optical system has a lens plate in which a plurality of lenses for forming an aerial image are arranged in two dimensions.
Citation Information
Patent Citations
Display device
JP2020118815A