Air input device

Abstract

The present invention provides an aerial input device that allows for easy recognition of whether or not an operation is being performed on the aerial image. [Solution] The aerial input device 100 of the present invention includes an aerial image display means 110 capable of displaying an aerial image relating to an input operation, a housing display means 120 capable of displaying an image related to the aerial image on a housing surface different from the display position of the aerial image, an operation unit detection means 130 that detects the position or movement of the user's operation unit, and a control means 140 that controls the aerial image display means 110 and the fixed image display means 120 based on the detection result of the operation unit detection means 130. When the control means 140 determines that the operation unit has approached or touched the aerial image while the aerial image is being displayed, it switches the aerial image display means 110 from display to hide, and switches the housing display means 120 from hide to display.

Description

Technical Field

[0001] The present invention relates to an air input device for inputting to an aerial image displayed by retroreflection.

Background Art

[0002] Aerial Imaging by Retro - Reflection: AIRR is known. For example, in the aerial imaging device of Patent Document 1, a decorative sheet 30 is arranged between the imaging element 20 and the imaging position P so that the imaging element 20 is not observed from the outside.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] FIG. 1(A) shows an example of an air input device using an aerial image by retroreflection. The air input device 10 includes a housing 20 that houses an optical member or the like for generating an aerial image, and a capacitive touch panel 40 that detects the position and movement of an operation unit U such as a user's finger on the aerial image 30 displayed above the housing 20. The aerial image 30 includes, for example, a plurality of icons P1, P2, P3, etc. for receiving input from the user as shown in FIG. 1(B). The air input device 10 determines that an input to the aerial image 30 has been made when the touch panel 40 detects the approach or touch of the operation unit U to the aerial image 30.

[0005] Conventional aerial input devices 10 have the problem that it is not physically possible to determine whether the input to the aerial image 30 is ON or OFF. Therefore, it has been proposed to provide feedback to the operator on whether or not input has been made by changing the color or brightness of the aerial image 30 or by moving the aerial image 30 back and forth when approach to or touch of the aerial image 30 is detected. For example, as shown in Figure 1(C), when the operating unit U touches the icon P2, the color of the icon P2 changes, providing feedback to the operator that input has been made to the icon P2.

[0006] However, with the method of changing the color and brightness of the aerial image as described above, there is a problem in that the operator cannot recognize whether the input has been made correctly unless there is prior information on which color indicates ON and which indicates OFF. Also, with the method of moving the aerial image back and forth, there is a problem in that if the distance the floating aerial image moves is small, it is difficult to visually recognize the movement.

[0007] The present invention aims to solve these conventional problems and provide an aerial input device that can easily recognize whether or not an operation is being performed on the aerial image. [Means for solving the problem]

[0008] The aerial input device according to the present invention includes a first display means capable of displaying an aerial image relating to an input operation, a second display means capable of displaying an image related to the aerial image at a position different from the display position of the aerial image, a detection means for detecting the position or movement of a user's operating unit, and a display control means for controlling the first and second display means based on the detection result of the detection means, wherein the display control means switches the first display means from display to non-display and switches the second display means from non-display to display when it determines that the operating unit has approached or touched the aerial image while the first display means is displaying the aerial image. [Effects of the Invention]

[0009] According to the present invention, when the operating unit determines that the operating unit has approached or touched the aerial image while the first display means is displaying an aerial image, the first display means is switched from displaying to not displaying, and the second display means is switched from not displaying to displaying. As a result, the operator can easily recognize the status of the input operation by an image displayed at a different position from the aerial image. [Brief explanation of the drawing]

[0010] [Figure 1] Figure 1(A) shows a schematic configuration of a conventional aerial input device, and Figure 1(B) shows an example of an aerial image display. [Figure 2] This is a block diagram showing the electrical configuration of an air input device according to an embodiment of the present invention. [Figure 3] This is a schematic cross-sectional view showing the configuration of an air input device according to an embodiment of the present invention. [Figure 4] Figure 4(A) shows an example of an aerial image display, Figure 4(B) shows a top view of the housing display section, Figure 4(C) shows an example of the display of design Q2 in the housing display section, and Figure 4(D) is a cross-sectional view showing another configuration example of the housing display section. [Figure 5] This figure illustrates the first operation of an air input device according to an embodiment of the present invention. [Figure 6] Figure 6(A) is a table showing the relationship between the operation of the control unit and the display / hide status of the aerial image / enclosure display in the first operation, and Figure 6(B) is a diagram showing the flow of the first operation. [Figure 7] This figure illustrates a second operation of the air input device according to an embodiment of the present invention. [Figure 8] Figure 8(A) is a table showing the relationship between the operation of the control unit and the display / hide status of the aerial image / enclosure display in the second operation, and Figure 8(B) is a diagram showing the flow of the second operation. [Figure 9] Figure 9(A) is a table showing the relationship between the operation of the control unit and the display / hide status of the aerial image / housing display in a modified version of the second operation, and Figure 9(B) is a diagram showing the flow of a modified version of the second operation. [Modes for carrying out the invention]

[0011] Next, embodiments of the present invention will be described. The present invention relates to an aerial input device that performs input on an aerial image displayed by retroreflection. In one embodiment of the present invention, in an aerial input device that fuses decorative printing and an aerial image, when an aerial image representing a key is touched, the input key moves to the surface of the decorative printing, making it easy for even a first-time user to determine which key has been pressed. It should be noted that the drawings referenced in the following description of embodiments include exaggerations to facilitate understanding of the invention and do not represent the shape or scale of the actual product. [Examples]

[0012] Next, embodiments of the present invention will be described in detail. Figure 2 is a block diagram showing the electrical configuration of an air input device according to an embodiment of the present invention. The air input device 100 of this embodiment includes an air image display means 110 capable of displaying an air image using retroreflection, a housing display means 120 capable of displaying an image related to the air image on a housing surface different from the display position of the air image, an operation part detection means 130 that detects the position and movement of an operation part such as a user's finger or hand, and a control means 140 that controls the air image display means 110 and the housing display means 120 based on the detection results of the operation part detection means 130.

[0013] The aerial image display means 110 displays aerial images for receiving input from the user. The number, shape, size, and color of the aerial images are not particularly limited, but the aerial images may be, for example, keys or icons. The user performs input operations by bringing an operating part such as a finger or hand close to or touching the aerial image.

[0014] The housing display means 120 displays an image related to the aerial image on a housing surface different from the display position of the aerial image. This image may be exactly the same as the displayed aerial image, or it may be an image, text, or icon that can be easily recognized as being related to the aerial image.

[0015] The operation unit detection means 130 detects the position or movement of the user's operation unit. The configuration of the operation unit detection means 130 is not particularly limited. For example, the operation unit detection means 130 is configured using a capacitive touch panel (hereinafter referred to as an electrostatic sensor) or a three-dimensional distance sensor that uses irradiation light and its reflected light.

[0016] The control means 140 receives the detection result of the operation unit detection means 130, determines whether the user's operation unit is operating on the aerial image, etc., and controls the displays of the aerial image display means 110 and the housing display means 120 based on the determination result. The control means 140 is configured using hardware resources and / or software resources.

[0017] In one aspect, when the control means 140 determines that the operation unit has approached or touched the aerial image while the aerial image is being displayed, the control means 140 switches the aerial image from being displayed to not being displayed and switches the housing display means 120 from not being displayed to being displayed, thereby notifying the operation state of input ON. When the control means 140 determines that the operation unit has moved away from the position of the aerial image, the control means 140 switches the aerial image from not being displayed to being displayed and switches the housing display means 120 from being displayed to not being displayed, thereby notifying the operation state of input OFF.

[0018] Next, the specific configuration of the aerial input device of this embodiment will be described. FIG. 3 is a schematic cross-sectional view showing the configuration of the aerial input device of this embodiment. The aerial image input device 200 includes a substantially rectangular housing (or casing) 210, a display 220, an optical member 230, a retroreflective member 240, a controller 250, an electrostatic sensor 260, and a housing display unit 270.

[0019] The display 220, optical element 230, and retroreflective element 240 housed within the housing 210 constitute the aerial image display means 110. The display 220 is positioned at an angle inside the housing 210. The display 220 is the light source of the aerial image display means 110 and outputs the original image of the aerial image P in response to instructions from the controller 260. The display 220 is not particularly limited, but examples include an LED display, an organic EL display, a projector, or an LED unit with multiple LEDs arranged in two dimensions.

[0020] The optical component 230 consists of a beam splitter or a half mirror and is mounted on the surface of the housing 210. The beam splitter or half mirror is constructed, for example, by forming a dielectric multilayer film or an anti-reflective film on the surface or back surface of a substrate such as a flat glass or plastic plate. The optical component 230 reflects a portion of the light output from the display 220 toward the retroreflective component 240, transmits the light reflected by the retroreflective component 240, and forms an aerial image P.

[0021] The retroreflective member 240 is an optical member that reflects light in the same direction as the incident light, and its configuration is not particularly limited, but for example, it can be composed of a triangular pyramidal retroreflective element, a full cube corner retroreflective element, etc. The retroreflective member 240 may also include a phase difference film such as a λ / 4 plate on its surface.

[0022] The controller 250 constitutes the control means 140 and controls the display 220 and the housing display unit 270 based on the detection results of the electrostatic sensor 260. The controller 250 includes, for example, a microcontroller or microprocessor including ROM / RAM, and controls the display 220 and the housing display unit 270 by software stored in the ROM / RAM. The controller 250 also stores necessary information for controlling the display 220 and the housing display unit 270 (for example, the coordinate position where the aerial image P is formed, the coordinate position of the housing display unit 270, etc.) in a memory such as ROM / RAM.

[0023] When the controller 250 drives the display 220, the display 220 outputs the original image of the aerial image P. A portion of the light output from the display 220 is reflected by the optical element 230, and this reflected light is incident on the retroreflective element 240. The retroreflective light then passes through the optical element 230, the electrostatic sensor 260, and the housing display unit 270, forming an image of the aerial image P above the housing 210. Since the aerial image P is formed in a position symmetrical to the display 220 with respect to the optical element 230, the aerial image P is displayed at an angle above the housing 210.

[0024] The electrostatic sensor 260 is positioned above the optical element 230. The electrostatic sensor 260 is, for example, a capacitive transparent touch panel stacked on the upper surface of the optical element 230. The electrostatic sensor 260 measures capacitance at regular time intervals and detects the position or movement of the operating part based on the change in measured capacitance. This detection result is provided to the controller 250.

[0025] A housing display unit 270 is mounted above the electrostatic sensor 260. The housing display unit 270 constitutes the housing display means 120. The housing display unit 270 is controlled by a controller 250 and displays an image Q related to the aerial image P on the surface of the housing 210.

[0026] An example of the configuration of the housing display unit 270 will be explained with reference to Figure 4. Figure 4(A) is an example of the display of an aerial image P, in which the aerial image P displays three icons P1, P2, and P3. Figure 4(B) is a top view showing the schematic configuration of the housing display unit 270. The housing display unit 270 has a light guide plate 272 and light sources 274A, 274B, and 274C (collectively referred to as light sources 274) that illuminate the light guide plate 272, and designs Q1, Q2, and Q3 related to the icons P1, P2, and P3 are formed on the light guide plate 272.

[0027] The light guide plate 272 is a generally rectangular, transparent plate- or film-shaped optical component, and is made of, for example, glass, acrylic plastic, polycarbonate resin, or cycloolefin resin. The method for forming the designs Q1, Q2, and Q3 is not particularly limited, but for example, the designs can be formed by laser processing or printing on the bottom or top surface of the light guide plate 272, or by attaching a decorative film to the bottom or top surface of the light guide plate 272.

[0028] Designs Q1, Q2, and Q3 are images related to icons P1, P2, and P3. For example, if icons P1, P2, and P3 are images representing switches or keys, then designs Q1, Q2, and Q3 are similarly images representing switches or keys. In this case, designs Q1, Q2, and Q3 may be images with different colors from icons P1, P2, and P3, or images with different brightness levels from icons P1, P2, and P3. In another embodiment, designs Q1, Q2, and Q3 may be images different from icons P1, P2, and P3, or they may include text that represents a state related to an input operation.

[0029] The light guide plate 272 has a constant thickness, and light sources 274A, 274B, and 274C are arranged along one of its sides S. The light sources 274A, 274B, and 274C are, for example, light-emitting diodes or laser diodes. The light sources 274A, 274B, and 274C correspond to the positions of the designs Q1, Q2, and Q3 in the X direction, respectively. Light emitted from light source 274A enters from the side S of the light guide plate 272 and illuminates design Q1, light emitted from light source 274B enters from the side S of the light guide plate 272 and illuminates design Q2, and light emitted from light source 274C enters from the side S of the light guide plate 272 and illuminates design Q3. The controller 250 selectively drives the ON / OFF of the light sources 274A, 274B, and 274C according to the icons P1, P2, and P3 for which input operations have been performed.

[0030] Figure 4(C) shows the state when light sources 274A and 274C are turned OFF and light source 274B is turned ON. In this state, design Q2 is illuminated by light source 274B, and design Q2 is displayed on the surface of the housing 210 with a constant brightness. On the other hand, designs Q1 and Q3 are not illuminated, so those parts are transparent areas acting as light guide plates.

[0031] Note that the configuration of the housing display unit shown in Figure 4(B) is just one example, and other configurations are also possible. For example, light from a single light source may be selectively illuminated onto designs Q1, Q2, and Q3 using an optical system. Alternatively, as shown in the cross-sectional view in Figure 4(D), light sources 274A, 274B, and 274C may be arranged in the X direction along the bottom surface S1 of the light guide plate 272, and designs Q1, Q2, and Q3 may be selectively illuminated by light from light sources 274A, 274B, and 274C in the Z direction.

[0032] Next, the first operation of the aerial input device of this embodiment will be described. The first operation corresponds to the momentary operation of a general switch. As shown in Figure 5(A), the controller 250 displays the original image of the aerial image P on the display 220 and displays the aerial images P of icons P1, P2, and P3 on the surface 212 of the housing 210. Icons P1, P2, and P3 represent icons for the user to perform input operations (for example, keys or switches such as a play button, fast forward button, and stop button). This state is input OFF.

[0033] When a user brings their finger U close to icon P2 to input to icon P2, the controller 250 determines, based on the detection result of the electrostatic sensor 260, that the finger U has approached or touched icon P2. Based on this determination, the controller 250 controls the display 220 so that icon P2 is hidden, and at the same time controls the housing display unit 270 so that the design Q2 corresponding to icon P2 is displayed. This display switching represents a switch from input OFF to input ON, which is shown in Figure 5(B).

[0034] Next, when the user releases finger U, the controller 250 determines, based on the detection result of the electrostatic sensor 260, that finger U has moved away from the position of icon P2, and controls the display 220 to display icon P2, and at the same time controls the housing display unit 270 to hide the design Q2 corresponding to icon P2. This display switching represents a switch from input ON to input OFF, which is shown in Figure 5(C).

[0035] Figure 6(A) is a table showing the relationship between the operation of the control unit and the on / off status of the aerial image / housing display in the first operation of this embodiment. When the controller 250 determines, based on the detection result of the electrostatic sensor 260, that finger U is approaching or touching the aerial image, it turns OFF the display of the aerial image and ON the housing display. When it determines that finger U has moved away from the position of the aerial image, it turns ON the display of the aerial image and OFF the housing display.

[0036] Figure 6(B) is an operation flowchart when the controller 250 performs the first operation (momentary operation). The controller 250 drives the display 220 to display the aerial image (S100). At this time, the housing display device 270 is turned off. The controller 250 monitors the detection result of the electrostatic sensor 260 and determines whether or not finger U has touched the aerial image P (S110). If it determines that it has touched the image, it turns off the aerial image P and turns on the housing display (S120). Next, the controller 250 determines whether or not finger U has moved away from the image formation position of the aerial image P (S130). If it determines that it has moved away, it turns off the housing display and displays the aerial image (S140).

[0037] Thus, according to this embodiment, by displaying the input state (ON / OFF) to the aerial image not only by color but also in a position clearly different from the aerial image, the user can visually and physically determine the input state. In other words, by displaying "ON" on the casing, the status of the device can be determined simply by looking at it. Furthermore, not only do the aerial image change in color and movement forward and backward, but the display position and angle also change, making the input status to the aerial image easier to understand from a universal design perspective. Furthermore, by arranging objects of varying heights, the sense of floating in the aerial image becomes easier to understand, further improving the visibility of the aerial image.

[0038] Next, the second operation of the air input device 100 of this embodiment will be described. The second operation corresponds to the alternate operation of the switch. The input OFF shown in Figure 7(A) and the switching from input OFF to input ON shown in Figure 7(B) are the same as those described in Figures 5(A) and 5(B) in the first operation. In the second operation, as shown in Figure 7(C), even if the finger U is moved away from the image formation position of the air image, the display of design Q2 on the housing display unit 270 remains unchanged, that is, the input ON state is maintained.

[0039] Next, when finger U approaches the image formation position of the aerial image again, controller 250 controls display 220 so that the aerial image of icon P2 is displayed, and at the same time controls housing display unit 270 so that design Q2 corresponding to icon P2 is hidden. This display switching represents a switch from input ON to input OFF, which is shown in Figure 7(D).

[0040] Figure 8(A) is a table showing the relationship between the operation of the control unit and the on / off status of the aerial image / housing display in the second operation of this embodiment. When the controller 250 determines, based on the detection result of the electrostatic sensor 260, that the finger U is approaching or touching the aerial image, it turns the aerial image display OFF and the housing display ON. When the finger U moves away from the image formation position of the aerial image, it keeps the aerial image display OFF and the housing display OFF. Then, when the finger approaches the image formation position of the aerial image again, it switches the aerial image display ON and the housing display OFF.

[0041] Figure 8(B) is an operation flowchart when the controller 250 performs the second operation (alternate operation). The processing from step S100 to S130 is the same as in the first operation shown in Figure 6(B). The controller 250 determines whether the finger U has moved away from the imaging position of the aerial image P (S130), and if it determines that it has moved away, it maintains the state of the aerial image and the housing display as is (S200). Then, the controller 250 determines once again whether the finger U has approached the imaging position of the aerial image P (S210), and if it determines that it has approached, it displays the aerial image P and hides the housing display (S220).

[0042] Thus, according to this embodiment, even when the finger leaves the casing, the aerial image can be hidden while the casing display remains visible, making the input status of the aerial image easier to understand.

[0043] Next, a modified version of the second operation will be described. Figure 9(A) is a table showing the relationship between the operation of the control unit and the on / off status of the aerial image / housing display in this modified version. When finger U approaches or touches the aerial image P, the controller 250 turns OFF the display of the aerial image P and ON the housing display. When finger U moves away from the image formation position of the aerial image P, the display of the aerial image P remains OFF, and the housing display remains OFF. Up to this point, it is the same as the second operation described above, but in the modified version, when finger U approaches or touches the housing display Q, the display of the aerial image P is switched ON, and the housing display is switched OFF.

[0044] Figure 9(B) is an operation flowchart when the controller 250 performs a modified version of the second operation. The processing from step S100 to S200 is the same as in the second operation shown in Figure 8(B). The controller 250 determines whether finger U has touched the housing display unit 270 while the aerial image P is hidden and the housing display continues (S300). If input is made to icon P2, the housing display unit 270 displays design Q2, and in this case, the controller 250 determines whether finger U has touched or approached design Q. If the controller 250 determines that finger U has touched design Q, it displays the aerial image P and hides the housing display (S310).

[0045] Although preferred embodiments of the present invention have been described in detail above, the present invention is not limited to any particular embodiment, and various modifications and changes are possible within the scope of the gist of the invention as described in the claims.

[0046] For example, in the above embodiment, an example was shown in which the aerial image P includes three icons P1, P2, and P3, and the housing display unit 270 has three designs. However, this is just one example, and the number of icons and designs is arbitrary. Furthermore, the number of icons shown in the aerial image and the number of designs formed on the housing display unit 270 do not necessarily have to match. For example, it is possible to share the input states of icons P1, P2, and P3 with a single design. Moreover, in the above embodiment, a light guide plate was used to display the designs, but this is not limited to this; a transparent display may be placed on the surface of the housing, and the input state may be displayed by driving the transparent display.

[0047] The aerial input device of this embodiment can be applied to user input interfaces, such as computer devices, in-vehicle electronic devices, ATMs in banks, ticket machines in train stations, elevator input buttons, and the like. [Explanation of Symbols]

[0048] 100, 200: Aerial input device 110: Aerial image display means 120: Enclosure display means 130: Operation unit detection means 140: Control means 210: Housing 220: Display 230: Optical component 240: Retroreflective material 250: Controller 260: Electrostatic sensor 270: Enclosure display unit 272: Light guide plate 274: Light source P: Aerial image Q: Design

Claims

1. A first display means capable of displaying an aerial image related to input operations, A second display means capable of displaying an image related to the aerial image at a position different from the display position of the aerial image, A detection means for detecting the position or movement of the user's control unit, The system includes a display control means that controls the first and second display means based on the detection result of the detection means, The display control means is an aerial input device that, when it determines that the operation unit has approached or touched the aerial image while the first display means is displaying an aerial image, switches the first display means from displaying to not displaying, and switches the second display means from not displaying to displaying.

2. The aerial input device according to claim 1, wherein the display control means switches the second display means from display to non-display and the first display means from non-display to display when the operation unit determines that it has moved away from the image formation position of the aerial image.

3. The aerial input device according to claim 1, wherein the display control means maintains the first display means in a non-display state and the second display means in a display state when the operation unit determines that it has moved away from the image formation position of the aerial image.

4. The aerial input device according to claim 3, wherein the display control means, when it determines that the operation unit has approached or touched the image formation position of the aerial image, switches the second display means from display to non-display and switches the first display means from non-display to display.

5. The aerial input device according to claim 3, wherein the display control means, when it determines that the operation unit has approached or touched the image, switches the second display means from display to non-display and switches the first display means from non-display to display.

6. The display means further includes a housing capable of housing the first display means, The aerial input device according to claim 1, wherein the first display means displays an aerial image above the housing, and the second display means displays the image on the surface of the housing.

7. The aerial input device according to claim 6, wherein the second display means includes a light guide plate having a design for the image formed on it, and a light source for illuminating the light guide plate, the light guide plate being attached to the surface of the housing.

8. The aerial input device according to claim 6, wherein the second display means includes a transparent display disposed on the surface of the housing, and the transparent display displays the image.

9. The air input device according to claim 6, wherein the detection means includes an electrostatic sensor that detects the position or movement of the operating part from a change in capacitance, and the electrostatic sensor is mounted on the surface of the housing.

Images