Aerial image display device

Abstract

To provide an aerial video display device that allows a user to easily grasp a sense of distance between the position of an aerial video and the position of the user's finger.SOLUTION: An aerial video display device comprises: a housing 2; a video display unit 3 that is arranged inside the housing; a beam splitter 4 that is installed in an opening of the housing and reflects a video displayed on the video display unit; a retroreflection sheet 5 that is installed inside the housing and retroreflects the video reflected by the beam splitter; a sensor 7 that detects the position of the finger 10a of a user 10 in a space area including an aerial video 6 that is the video retroreflected by the retroreflection sheet and formed outside the housing; and a speaker 9 that outputs a sound changing according to a distance between the position of the finger detected by the sensor and the position of the aerial video.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present application relates to an aerial image display device. [Background technology]

[0002] There is known an aerial image display device that can display an image in the air without the need for special glasses or a screen such as fog. For example, there is disclosed an aerial image display device that uses a beam splitter and a retroreflective sheet to focus an image displayed on an image display unit in space at a position that is plane symmetrical with respect to the beam splitter, thereby displaying the image (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2009-25776 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the floating image display device, a touch panel is displayed as an image displayed in the air (hereinafter referred to as the floating image), and the user can operate the touch panel with his / her finger. Since the floating image is floating in the air, there is no object around it that can serve as an indicator of distance. Therefore, there is a problem that it is difficult for the user to grasp the sense of distance between the position of the floating image and the position of his / her finger.

[0005] The present application has been made to solve the above-mentioned problems, and aims to provide an aerial image display device that makes it easy to grasp the sense of distance between the position of the aerial image and the position of the user's finger. [Means for solving the problem]

[0006] The aerial image display device of the present application includes a housing, an image display unit disposed inside the housing, a beam splitter disposed at an opening of the housing for reflecting an image displayed on the image display unit, a retroreflective sheet disposed inside the housing for retroreflecting the image reflected by the beam splitter, a sensor for detecting the position of a user's finger within a spatial region including an aerial image formed outside the housing from the image retroreflected by the retroreflective sheet, and a speaker for outputting a sound that changes according to the distance between the position of the finger detected by the sensor and the position of the aerial image. The frequency of the sound output from the speaker changes continuously according to the distance, and the sound output from the speaker stops when the position of the finger and the position of the air image match. . Effect of the Invention

[0007] The aerial image display device of the present application is provided with a speaker that outputs a sound that changes according to the distance between the position of the finger detected by the sensor and the position of the aerial image. The frequency of the sound output from the speaker changes continuously according to the distance, and the sound output from the speaker stops when the position of the finger and the position of the air image match. This makes it easier to grasp the sense of distance between the position of the aerial image and the position of the user's finger. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a schematic diagram of an aerial image display device according to first to third embodiments. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an aerial image display device according to an embodiment of the present invention will be described in detail with reference to the drawings.

[0010] Embodiment 1 FIG. 1 is a schematic diagram of an aerial image display device according to the first embodiment. The aerial image display device 1 of the present embodiment includes a housing 2, an image display unit 3 arranged inside the housing 2, a beam splitter 4 provided at an opening of the housing 2, and a retroreflective sheet 5 arranged inside the housing 2. Light emitted from the image display unit 3 is incident on the beam splitter 4, and a part of the light is reflected and incident on the retroreflective sheet 5. The retroreflective sheet 5 has a characteristic of reflecting the incident light in the incident direction. The retroreflective sheet 5 reflects the light incident from the beam splitter 4 toward the beam splitter 4. A part of the light reflected from the retroreflective sheet 5 toward the beam splitter 4 passes through the beam splitter 4. The image displayed on the image display unit 3 in this way passes through the beam splitter 4 and is imaged outside the housing 2 to become an aerial image 6. A user 10 can observe this aerial image 6. For example, a touch panel for operating various devices is displayed as the aerial image 6. A user 10 can perform a touch operation on the touch panel by bringing a finger 10a close to the touch panel displayed as the aerial image 6. The position of the finger 10a can be measured by a three-dimensional distance sensor 7 that is provided in the housing 2 and detects the position of an object in a spatial region including the aerial image 6. A liquid crystal display, an organic EL display, a display in which LED elements are arranged, or the like can be used as the image display unit 3. A half mirror, a reflective polarizing plate, or the like can be used as the beam splitter 4. A glass bead type sheet in which spherical transparent glass beads are arranged, a microprism type sheet in which transparent triangular pyramids are arranged, or the like can be used as the retroreflective sheet 5. A ToF sensor (Time of Flight Sensor), a stereo camera, or the like can be used as the three-dimensional distance sensor 7.

[0011] A user 10 can perform a touch operation by bringing finger 10a close to the touch panel displayed as aerial image 6. The distance between the position of finger 10a and aerial image 6 can be measured by a three-dimensional distance sensor 7 provided on housing 2. This touch operation is non-contact, so contamination of fingertips due to contact and the spread of harmful substances via the touch panel can be prevented.

[0012] However, because the aerial image is suspended in the air, there are no objects around it that can serve as indicators of distance, making it difficult for the user to grasp the sense of distance between the position of the aerial image and the position of their finger.

[0013] The aerial image display device 1 of the present embodiment makes it easy to grasp the sense of distance between the position of the aerial image and the position of the user's finger. For this reason, the aerial image display device 1 of the present embodiment includes a control unit 8 that calculates the separation distance between the position of the finger 10a of the user 10 detected by the three-dimensional distance sensor 7 and the position of the aerial image 6, and a speaker 9 connected to the control unit 8. The control unit 8 calculates the separation distance between the position of the finger 10a of the user 10 and the position of the aerial image 6, and causes the speaker 9 to output a sound whose frequency changes continuously according to the separation distance. For example, when the finger 10a of the user 10 approaches the aerial image 6 and the separation distance becomes smaller than a predetermined threshold, the control unit 8 starts outputting a low-frequency sound from the speaker 9, and gradually increases the frequency as the separation distance becomes smaller, changing the sound output from the speaker to a high-pitched sound.

[0014] In the aerial image display device configured in this manner, the user can recognize the distance between the position of the aerial image and the position of his or her fingers by the change in frequency of the sound output from the speaker. Therefore, in the aerial image display device of this embodiment, the user can easily grasp the sense of distance between the position of the aerial image and the position of his or her fingers.

[0015] Control unit 8 may discontinuously change the frequency of the sound output from speaker 9 when the position of the finger coincides with the position of the air image. As another method, control unit 8 may stop the sound output from speaker 9 when the position of the finger coincides with the position of the air image. By controlling in this manner, the user can recognize that his / her finger has reached the position of the air image. Note that the coincidence of the finger position with the position of the air image is not limited to when the distance between the finger position and the position of the air image becomes completely zero, but also includes the case where the distance is smaller than a predetermined distance. Note that when the user's finger passes through the air image, the frequency of the sound output from speaker 9 decreases, so that the user can recognize that his / her finger has passed the position of the air image.

[0016] In this embodiment, the control unit 8 gradually increases the frequency as the separation distance becomes smaller, changing the sound output from the speaker to a higher pitch, but it may also gradually decrease the frequency as the separation distance becomes smaller, changing the sound output from the speaker to a lower pitch.

[0017] Embodiment 2 In the aerial image display device of embodiment 1, the control unit calculates the distance between the position of the user's finger and the position of the aerial image, and causes the speaker to output a sound whose frequency changes continuously according to the distance. In the aerial image display device of embodiment 2, the control unit calculates the distance between the position of the user's finger and the position of the aerial image, and causes the speaker to output a sound whose volume changes continuously according to the distance. Note that the configuration of the aerial image display device of this embodiment is similar to the configuration of the aerial image display device of embodiment 1 shown in FIG. 1.

[0018] For example, when the finger 10a of the user 10 approaches the aerial image 6 and the distance between them becomes smaller than a predetermined threshold, the control unit 8 starts outputting a low volume of sound from the speaker 9, and increases the volume of the sound output from the speaker as the distance between them becomes smaller.

[0019] In the aerial image display device configured in this manner, the user can recognize the distance between the position of the aerial image and the position of his or her finger by the change in the volume of the sound output from the speaker. Therefore, in the aerial image display device of this embodiment, the user can easily grasp the sense of distance between the position of the aerial image and the position of his or her finger.

[0020] Control unit 8 may discontinuously change the volume of the sound output from speaker 9 when the position of the finger coincides with the position of the air image. As another method, control unit 8 may stop the sound output from speaker 9 when the position of the finger coincides with the position of the air image. By controlling in this manner, the user can recognize that his / her finger has reached the position of the air image. Note that the coincidence of the finger position with the position of the air image is not limited to when the distance between the finger position and the position of the air image becomes completely zero, but also includes the case where the distance is smaller than a predetermined distance. Note that when the user's finger passes through the air image, the volume of the sound output from speaker 9 decreases, so the user can recognize that his / her finger has passed the position of the air image.

[0021] In this embodiment, the control unit 8 gradually increases the volume of the sound output from the speaker as the separation distance decreases, but the volume of the sound output from the speaker may also be gradually decreased as the separation distance decreases.

[0022] Embodiment 3 In the aerial image display device of the first embodiment, the control unit calculates the distance between the position of the user's finger and the position of the aerial image, and causes the speaker to output a sound whose frequency changes continuously according to the distance. In the aerial image display device of the second embodiment, the control unit calculates the distance between the position of the user's finger and the position of the aerial image, and causes the speaker to output a sound whose volume changes continuously according to the distance. In the aerial image display device of the third embodiment, the control unit calculates the distance between the position of the user's finger and the position of the aerial image, and causes the speaker to output an intermittent sound whose volume changes continuously according to the distance. The configuration of the aerial image display device of this embodiment is similar to the configuration of the aerial image display device of the first embodiment shown in FIG. 1.

[0023] For example, when finger 10a of user 10 approaches aerial image 6 and the distance between them becomes smaller than a predetermined threshold, control unit 8 starts outputting intermittent sound from speaker 9. At this time, the sound output from speaker 9 is a sound of a certain length that is generated with a pause period between them, and control unit 8 gradually shortens the pause period as the distance between them becomes smaller.

[0024] In the aerial image display device configured in this manner, the user can recognize the distance between the position of the aerial image and the position of his or her finger by the change in the pause period of the sound output from the speaker. Therefore, in the aerial image display device of this embodiment, the user can easily grasp the sense of distance between the position of the aerial image and the position of his or her finger.

[0025] In this embodiment, the sound output from speaker 9 is a sound that is generated with a constant length of sound sandwiched between stop periods, and the stop periods gradually become shorter as the separation distance becomes smaller. As an alternative, the stop periods may be fixed, and the length of the generation period during which the sound is generated may be gradually shortened as the separation distance becomes smaller. As a further alternative, the cycle at which the intermittent sound generation starts may be fixed, and the period during which the sound is generated within that cycle may be gradually changed as the separation distance becomes smaller. That is, the aerial image display device of this embodiment is configured such that at least one of the stop periods and generation periods of the intermittent sound changes continuously according to the separation distance between the position of the user's finger and the position of the aerial image.

[0026] Control unit 8 may discontinuously change at least one of the stop period and the generation period of the sound output from speaker 9 when the position of the finger and the position of the air image match. As another method, control unit 8 may change at least one of the frequency and the volume of the sound output from speaker 9 when the position of the finger and the position of the air image match. As yet another method, control unit 8 may stop the sound output from speaker 9 when the position of the finger and the position of the air image match. By controlling in this manner, the user can recognize that his / her finger has reached the position of the air image. Note that the time when the position of the finger and the position of the air image match is not limited to when the distance between the position of the finger and the position of the air image becomes completely zero, but also includes the case where the distance is smaller than a predetermined distance. Note that when the user's finger passes through the air image, the stop period or the generation period of the sound output from speaker 9 becomes longer, so the user can also recognize that his / her finger has passed the position of the air image.

[0027] In addition, in the first to third embodiments, the position of finger 10a is measured by three-dimensional distance sensor 7. The aerial image display device of the first to third embodiments may include a recognition unit for calculating the position of the fingertip that will touch the touch panel from the position of finger 10a measured by three-dimensional distance sensor 7. Furthermore, in the first to third embodiments, it is also envisaged that the displayed image may be switched in response to a touch operation when the aerial image is used as a touch panel. The aerial image display device of the first to third embodiments may include a display processing unit for switching the displayed image on the image display unit based on the fingertip position calculated by the recognition unit.

[0028] Moreover, in the first to third embodiments, the aerial image display device has been described using a system using a beam splitter and a retroreflective sheet. Other aerial image display devices include a system using an optical plate called a dihedral corner reflector array and a system using an optical plate called an orthogonal mirror array. In these aerial image display devices, the retroreflective sheet is removed from the aerial image display device shown in FIG. 1, and an optical plate is placed at the position of the beam splitter. This type of aerial image display device can display an aerial image by forming an image displayed on the image display unit in a space at a position that is plane-symmetrical with respect to the optical plate. Even in this type of aerial image display device, there is a problem that it is difficult for the user to grasp the sense of distance between the position of the aerial image and the position of his / her finger. Even in this type of aerial image display device, by providing a speaker that outputs a sound that changes depending on the distance between the position of the user's finger and the position of the aerial image, the user can easily grasp the sense of distance between the position of the aerial image and the position of his / her finger.

[0029] Although the present application describes various exemplary embodiments and examples, the various features, aspects, and functions described in one or more embodiments are not limited to application to a particular embodiment, but may be applied to the embodiments alone or in various combinations. Therefore, countless variations not exemplified are assumed within the scope of the technology disclosed in the present specification, including, for example, a case where at least one component is modified, added, or omitted, and further, a case where at least one component is extracted and combined with a component of another embodiment. [Explanation of symbols]

[0030] 1 Aerial image display device, 2 Housing, 3 Image display unit, 4 Beam splitter, 5 Retroreflective sheet, 6 Aerial image, 7 Three-dimensional distance sensor, 8 Control unit, 9 Speaker, 10 User, 10a Finger.

Claims

1. A housing, A video display unit disposed inside the housing; a beam splitter that is installed in an opening of the housing and that reflects an image displayed on the image display unit; A retroreflective sheet that is installed inside the housing and retroreflects the image reflected by the beam splitter; a sensor for detecting the position of a user's finger within a spatial region including an aerial image formed outside the housing by the image retroreflected by the retroreflective sheet; a speaker that outputs a sound that changes according to a distance between the position of the finger detected by the sensor and a position of the aerial image, The aerial image display device characterized in that the frequency of the sound output from the speaker changes continuously depending on the separation distance, and the sound output from the speaker stops when the position of the finger and the position of the aerial image coincide.

2. A housing, A video display unit disposed inside the housing; a beam splitter that is installed in an opening of the housing and that reflects an image displayed on the image display unit; A retroreflective sheet that is installed inside the housing and retroreflects the image reflected by the beam splitter; a sensor for detecting the position of a user's finger within a spatial region including an aerial image formed outside the housing by the image retroreflected by the retroreflective sheet; a speaker that outputs a sound that changes according to a distance between the position of the finger detected by the sensor and a position of the aerial image, The aerial image display device is characterized in that the volume of the sound output from the speaker changes continuously depending on the separation distance, and the sound output from the speaker stops when the position of the finger and the position of the aerial image coincide.

3. A housing, A video display unit disposed inside the housing; a beam splitter that is installed in an opening of the housing and that reflects an image displayed on the image display unit; A retroreflective sheet that is installed inside the housing and retroreflects the image reflected by the beam splitter; a sensor for detecting the position of a user's finger within a spatial region including an aerial image formed outside the housing by the image retroreflected by the retroreflective sheet; a speaker that outputs a sound that changes according to a distance between the position of the finger detected by the sensor and a position of the aerial image, The sound output from the speaker is an intermittent sound, and at least one of a stop period and a generation period of the intermittent sound changes continuously depending on the separation distance, and the sound output from the speaker stops when the position of the finger and the position of the aerial image coincide.

Images