Input Devices

The input device addresses the challenge of user recognition in gesture input devices by using a sensor and display system to clearly indicate detection points and prevent false inputs, ensuring accurate and intended user input detection.

JP7672364B2Active Publication Date: 2025-05-07OMRON CORP
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2022097311
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-06-16
Publication Date
2025-05-07
Estimated Expiration
2038-07-10

AI Technical Summary

Technical Problem

Existing gesture input devices can be difficult for users to recognize the required operations for input, leading to potential confusion and unintended inputs.

Method used

An input device comprising a sensor for non-contact detection of objects in space, an input detection unit for recognizing user inputs based on sensor data, and a display device showing an image indicating the detection points, with a second detection point positioned to prevent false inputs.

Benefits of technology

The input device effectively detects user inputs only when intended, reducing confusion and improving recognition of input operations, while maintaining a cost-effective design.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007672364000001
    Figure 0007672364000001
  • Figure 0007672364000002
    Figure 0007672364000002
  • Figure 0007672364000003
    Figure 0007672364000003
Patent Text Reader

Abstract

To realize an input device capable of detecting input only when intended by a user. [Solution] The input device 1 includes a position detection sensor 20 that detects an object (pointer F) at a detection point in space without contact, and an input detection unit that detects an input by a user in response to the detection of the object by the position detection sensor, and further includes a stereoscopic image display unit 10 that displays an image indicating the detection point in space. The position detection sensor detects the object in an area that is a predetermined first distance away in the opposite direction to the direction in which the user's input action is performed from the position where a stereoscopic image I is formed in the direction in which the user's input action is performed.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an input device. [Background technology]

[0002] Patent Document 1 discloses a gesture input device that operates a vehicle device based on the movement of a specific part of the operator's body. In the gesture input device, the display image on the display unit of the vehicle device is switched or an operation is input based on the body movement of the operator detected by a motion detection unit. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2015-184841 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the above-mentioned gesture input device, there is a concern that it may be difficult for the user to recognize what action is required to input a gesture.

[0005] An object of one aspect of the present invention is to provide an input device that allows a user to easily recognize an input action for performing an input. [Means for solving the problem]

[0006] In order to solve the above problems, an input device according to one embodiment of the present invention is an input device comprising a sensor that detects an object non-contact at a detection point in space, and an input detection unit that detects an input by a user in response to the detection of the object by the sensor, and further comprising a display device that displays an image indicating the detection point in space, and is characterized in that the sensor detects an object in an area a predetermined distance away in the opposite direction from the direction in which the input action is performed from a position where the image is formed in the direction in which the input action is performed. Effect of the Invention

[0007] According to an input device according to an aspect of the present invention, an inexpensive device can detect an input only when intended by a user. [Brief description of the drawings]

[0008] [Figure 1] 1 is a block diagram showing a configuration of a main part of an input device according to an embodiment of the present invention; [Diagram 2] FIG. 2 is a perspective view of a stereoscopic image display unit. [Diagram 3] FIG. 1A is a diagram showing an example of a position detection sensor, and FIG. 1B is a diagram showing the configuration of one limited reflection sensor. [Figure 4] FIG. 13 is a diagram illustrating the configuration of another example of a position detection sensor. [Diagram 5] FIG. 1 is a diagram illustrating a first specific example of an input device. [Figure 6] FIG. 11 is a diagram showing a modified example of the first specific example of the input device. [Figure 7] FIG. 4 is a diagram showing the positional relationship between a first detection point and a second detection point. [Figure 8] FIG. 13A is a diagram showing a second specific example of the input device, and FIG. 13B is a diagram showing an example of displaying a stereoscopic image different from the stereoscopic image in FIG. 13A in the second specific example. [Figure 9] FIG. 13 is a diagram showing an example of an image indicating the direction of an input action by a user. [Figure 10]8A and 8B are diagrams for explaining examples of installation positions of position detection sensors in the input device shown in FIGS. 7A and 7B, where (a) is an oblique view, (b) is a side view, and (c) is a top view. [Figure 11] 8A and 8B are diagrams for explaining another example of the installation position of the position detection sensor in the input device shown in FIGS. 7A and 7B, where (a) is an oblique view, (b) is a side view, and (c) is a top view. [Figure 12] FIG. 13(a) is a diagram showing a modified example of the second specific example of the input device, and (b) is a diagram showing another modified example of the second specific example of the input device. [Figure 13] 11A and 11B are diagrams for explaining examples of installation positions of position detection sensors in the input device shown in FIG. 11A and FIG. 11B, where FIG. 11A is an oblique view, FIG. 11B is a side view, and FIG. 11C is a top view. [Figure 14] 11(a) and (b), where (a) is an oblique view, (b) is a side view, and (c) is a top view, for explaining another example of the installation position of the position detection sensor in the input device shown in (a) and (b) of FIG. [Figure 15] FIG. 13 is a diagram illustrating a third specific example of an input device. [Figure 16] 13 is a diagram illustrating an example of a position detection sensor in a third specific example. FIG. [Figure 17] FIG. 13 is a diagram showing a distance measuring sensor as another example of the position detection sensor in the third specific example. [Figure 18] FIG. 13 is a diagram showing yet another example of the position detection sensor in the third specific example. [Figure 19] 13(a) to 13(c) are diagrams showing a state in which the input device is applied to an input section of an elevator. [Figure 20] FIG. 13 is a diagram showing a state in which the above-mentioned input device is applied to an input section of a warm water toilet seat washer. [Figure 21] FIG. 13 is a perspective view of an input device as a modified example of the input device according to the embodiment. [Figure 22] 3 is a cross-sectional view showing a configuration of a stereoscopic image display unit included in the input device. FIG. [Diagram 23]FIG. 2 is a plan view showing a configuration of the stereoscopic image display unit. [Figure 24] 4 is a perspective view showing a configuration of an optical path changing section included in the stereoscopic image display section. FIG. [Diagram 25] FIG. 4 is a perspective view showing an arrangement of the optical path changing units. [Figure 26] 4 is a perspective view showing a method of forming a stereoscopic image by the stereoscopic image display unit. FIG. [Figure 27] FIG. 13 is a perspective view of an input device as another modified example of the input device according to the embodiment. [Figure 28] 3 is a cross-sectional view showing a configuration of a stereoscopic image display unit included in the input device. FIG. [Figure 29] 13(a) and 13(b) are diagrams showing a display example of a display method using an optical element. [Diagram 30] 4 is a diagram showing a range in which a position detection sensor included in the input device detects an object. FIG. [Diagram 31] 1(a) and 1(b) are perspective views showing an example of a gaming machine to which the input device is applied. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment according to one aspect of the present invention (hereinafter, also referred to as "the present embodiment") will be described below with reference to the drawings.

[0010] §1 Examples of application An embodiment of the present invention will be described in detail below. For convenience of explanation, the +X direction in Fig. 2 may be referred to as the forward direction, the -X direction as the backward direction, the +Y direction as the upward direction, the -Y direction as the downward direction, the +z direction as the rightward direction, and the -z direction as the leftward direction.

[0011] Fig. 1 is a block diagram showing the configuration of the main parts of an input device 1 according to this embodiment. As shown in Fig. 1, the input device 1 includes a stereoscopic image display unit 10, a position detection sensor 20, a control unit 30, a storage unit 40, and a speaker 50 (audio output unit).

[0012] The stereoscopic image display unit 10 displays an image showing the detection points (first and second detection points described below) detected by the position detection sensor 20. This makes it easier for the user to recognize the input operation for making an input.

[0013] 2 is a perspective view of the stereoscopic image display unit 10. The stereoscopic image display unit 10 forms a stereoscopic image to be viewed by a user in a space without a screen. FIG. 2 shows the stereoscopic image display unit 10 displaying a stereoscopic image I, more specifically, a stereoscopic image I in the shape of a button on which the character "ON" is displayed. As shown in FIG. 2, the stereoscopic image display unit 10 includes a light guide plate 11 and a light source 12.

[0014] The light guide plate 11 guides the light incident from the light source 12 and emits it from the emission surface 11a, forming the image in space. The light guide plate 11 has a rectangular parallelepiped shape and is molded from a resin material having transparency and a relatively high refractive index. The material forming the light guide plate 11 may be, for example, polycarbonate resin, polymethyl methacrylate resin, glass, or the like. The light guide plate 11 has an emission surface 11a that emits light, a back surface 11b opposite to the emission surface 11a, and end surfaces 11c, 11d, 11e, and 11f that are four end surfaces. The end surface 11c is an entrance surface where the light projected from the light source 12 enters the light guide plate 11. The end surface 11d is the surface opposite to the end surface 11c. The end surface 11e is the surface opposite to the end surface 11f. The light guide plate 11 guides light from the light source 12 so as to spread it over a plane parallel to the light output surface 11a. The light source 12 is, for example, an LED (Light Emitting Diode) light source.

[0015] A plurality of optical path changing sections 13 including an optical path changing section 13a, an optical path changing section 13b, and an optical path changing section 13c are formed on the rear surface 11b of the light guide plate 11. The optical path changing sections 13 are formed substantially continuously in the Z-axis direction. In other words, the plurality of optical path changing sections 13 are formed along predetermined lines in a plane parallel to the exit surface 11a. Light projected from the light source 12 and guided by the light guide plate 11 is incident on each position of the optical path changing section 13 in the Z-axis direction. The optical path changing section 13 substantially converges the light incident on each position of the optical path changing section 13 to a fixed point corresponding to each optical path changing section 13. FIG. 2 particularly shows optical path changing section 13a, optical path changing section 13b, and optical path changing section 13c as parts of optical path changing section 13, and shows how multiple light beams emitted from optical path changing section 13a, optical path changing section 13b, and optical path changing section 13c, respectively, converge in optical path changing section 13a, optical path changing section 13b, and optical path changing section 13c, respectively.

[0016] Specifically, the optical path changing unit 13a corresponds to a fixed point PA of the stereoscopic image I. Light from each position of the optical path changing unit 13a converges to the fixed point PA. Therefore, the wavefront of the light from the optical path changing unit 13a becomes a wavefront of light that emanates from the fixed point PA. The optical path changing unit 13b corresponds to a fixed point PB on the stereoscopic image I. Light from each position of the optical path changing unit 13b converges to the fixed point PB. In this way, light from each position of any optical path changing unit 13 substantially converges to a fixed point corresponding to each optical path changing unit 13. This allows any optical path changing unit 13 to provide a wavefront of light that emanates from the corresponding fixed point. The fixed points corresponding to each optical path changing unit 13 are different from each other, and a stereoscopic image I recognized by a user is formed in space (more specifically, in the space on the exit surface 11a side from the light guide plate 11) by a collection of multiple fixed points corresponding to each optical path changing unit 13.

[0017] 2, the optical path changing section 13a, the optical path changing section 13b, and the optical path changing section 13c are formed along the lines La, Lb, and Lc, respectively. Here, the lines La, Lb, and Lc are straight lines substantially parallel to the Z-axis direction. Any optical path changing section 13 is formed substantially continuously along a straight line parallel to the Z-axis direction.

[0018] The position detection sensor 20 detects objects at a plurality of detection points in space in a non-contact manner. In this embodiment, the detection points include a first detection point for detecting a user's input action for input and a second detection point for preventing erroneous detection of the input action. In this specification, the "detection point" includes not only a point but also a certain area. When the position detection sensor 20 detects an object at a detection point, the position detection sensor 20 outputs data indicating the detected position and time to the control unit 30 and the storage unit 40.

[0019] Fig. 3(a) is a diagram showing an example of the position detection sensor 20. In the example shown in Fig. 3(a), the position detection sensor 20 has a configuration in which a plurality of limited reflection sensors 21 are combined. Each limited reflection sensor 21 detects an object at one detection point.

[0020] FIG. 3(b) is a diagram showing the configuration of one limited reflection sensor 21. The limited reflection sensor 21 is a sensor that detects an object at a detection point P1. As shown in FIG. 3(a), the limited reflection sensor 21 includes a light-emitting unit 21a, a light-projecting lens 21b, a light-receiving lens 21c, and a light-receiving unit 21d. The light-projecting lens 21b focuses the light emitted by the light-emitting unit 21a onto the detection point P1. When an object is present at the detection point, the light reflected by the object is received by the light-receiving unit 21d via the light-receiving lens 21c. The limited reflection sensor 21 detects the position of the object according to the position at which the light is received by the light-receiving unit 21d.

[0021] FIG. 4 is a diagram showing a configuration of a position detection sensor 22 as another example of the position detection sensor 20. In the example shown in FIG. 4, the position detection sensor 22 detects objects at detection points P2, P3, and P4. Specifically, the position detection sensor 22 includes a light emitting unit 22a, a light projection lens 22b, a light branching unit 22c, and a plurality of light receiving units 22d. The light projecting lens 22b focuses the light emitted by the light emitting unit 22a onto the light branching unit 22c. The light branching unit 22c branches the light in the direction of a plurality of detection points. When an object is present at each of the detection points P2, P3, and P4, the light reflected by the object is received by the light receiving unit 22d corresponding to the detection point. The number of detection points may be two or four or more. In that case, the position detection sensor 22 may include the light receiving units 22d in the same number as the number of detection points.

[0022] Such a position detection sensor 20 can be installed on the rear surface of the light guide plate 11 of the stereoscopic image display section 10. Therefore, the input device 1 can be made into a compact unit.

[0023] The control unit 30 controls the operation of the input device 1. The control unit 30 includes an input detection unit 31 and a notification unit 32.

[0024] The input detection unit 31 detects an input by a user in accordance with multiple detection results by the position detection sensor 20. Specifically, the input detection unit 31 detects the input when the position detection sensor 20 detects the object at multiple detection points in a predetermined order.

[0025] The notification unit 32 notifies the user of the detection result of the input detection unit 31. Specifically, the notification unit 32 notifies the user both when the input detection unit 31 detects an input by the user and when it does not detect the input. However, the notification unit 32 may notify the user only when the input detection unit 31 detects an input by the user or when it does not detect the input. The notification unit 32 may notify the user by using, for example, the stereoscopic image display unit 10 or the speaker 50.

[0026] The storage unit 40 stores data necessary for the control of the input device 1 by the control unit 30. The storage unit 40 stores, for example, the time when the position detection sensor 20 detects an object and the position of the detection point. Note that the input device 1 does not necessarily need to include the storage unit 40, and may be communicably connected to a storage device provided outside the input device 1.

[0027] The speaker 50 is a device for outputting sound. The speaker 50 is used for notifying the user by the above-mentioned notifying unit 32. However, when the notifying unit 32 notifies the user only by the stereoscopic image display unit 10, the input device 1 does not need to include the speaker 50.

[0028] §2 Configuration example The configuration of the present invention will be described below with reference to specific examples.

[0029] (First concrete example) Fig. 5 is a diagram showing a first specific example of the input device 1. Fig. 5 shows a stereoscopic image displayed by the stereoscopic image display unit 10 and detection points by the position detection sensor 20. In the example shown in Fig. 5, the stereoscopic image display unit 10 displays a stereoscopic image IA of one button. The detection points by the position detection sensor 20 include a first detection point PA11 located at the center of the stereoscopic image IA, and three second detection points PA21, PA22, and PA23 located around the first detection point PA11.

[0030] 5, the stereoscopic image IA is displayed stereoscopically in accordance with the position of the first detection point PA11. Therefore, the user can easily recognize the position of the first detection point PA11, which is the detection point for performing input.

[0031] When the position detection sensor 20 detects an object at the first detection point PA11, the input detection unit 31 determines whether or not the object is detected at any of the second detection points PA21 to PA23 within a predetermined first period from the time the object is detected. The length of the first period may be, for example, 0.1 to 0.2 seconds, or 0.2 to 0.4 seconds.

[0032] When the position detection sensor 20 detects an object at any of the second detection points PA21-PA23 within a predetermined first period, the input detection unit 31 detects an input. On the other hand, when the position detection sensor 20 detects an object at the first detection point PA11 within the predetermined first period from the time when the position detection sensor 20 detected an object at any of the second detection points PA21-PA23, the input detection unit 31 does not detect an input. In this case, the second detection points PA21-PA23 can be said to function as detection points for preventing malfunction of the first detection point PA11.

[0033] Therefore, the input detection unit 31 detects an input when, for example, the user places a pointer F (object) such as a finger at the center of the stereoscopic image IA and performs an action of pressing down the stereoscopic image IA. In this case, the input detection unit 31 detects an input by the position detection sensor 20 detecting the pointer F at the first detection point PA11 and then detecting the pointer F at the second detection point PA23. It is considered that the possibility of such an action being performed unintentionally by the user is small. Also, even if an insect or the like passes near the input device 1, it is considered that the possibility of passing the first detection point PA11 and the second detection points PA21 to PA23 in the above-mentioned order is small. Therefore, according to the input device 1, it is possible to detect an input only when the user intends to. Also, since the input device 1 detects an input by the position detection sensor 20, it is possible to reduce costs compared to a gesture input device such as that disclosed in Patent Document 1, for example.

[0034] The input detection unit 31 may detect an input when the position detection sensor 20 detects the pointer F at the first detection point PA11 and then detects the pointer F at the second detection point PA21 or PA22. In this case, the input detection unit 31 can handle operations in any direction. The pointer F may be, for example, a pen in addition to the user's finger.

[0035] Furthermore, the input detection unit 31 may detect that an erroneous input unintentional of the user has occurred when the position detection sensor 20 detects an object at any of the second detection points PA21 to PA23. In this case, the input detection unit 31 can prevent detection of an erroneous input under the simple condition that the position detection sensor 20 detects an object at any of the second detection points PA21 to PA23.

[0036] The number of second detection points may be three as shown in Fig. 5, or may be more than three. That is, in the input device according to the present embodiment, the number of second detection points may be, for example, three or more. In this case, erroneous detection can be prevented with high accuracy.

[0037] On the other hand, in the input device according to the present embodiment, the number of second detection points may be, for example, 2. Specifically, in the example shown in Fig. 5, the second detection point PA21 may be omitted. In this case, the input device 1 can have a simple configuration.

[0038] Fig. 6 is a diagram showing a modified example of the first specific example of the input device 1. Fig. 6 shows a stereoscopic image displayed by the stereoscopic image display unit 10 and detection points by the position detection sensor 20. In the example shown in Fig. 6, the stereoscopic image display unit 10 displays four stereoscopic images IA. The detection points by the position detection sensor 20 include first detection points PA11, PA12, PA13, and PA14 located at the center of each of the four stereoscopic images IA, and second detection points PA21, PA22, PA23, PA24, PA25, PA26, PA27, PA28, and PA29 located around the first detection points PA11 to PA14.

[0039] In the example shown in Fig. 6, the second detection point PA23 is located around both of the first detection points PA11 and PA12. Therefore, the second detection point PA23 functions as a detection point for preventing malfunction for both the first detection points PA11 and PA12. In other words, the second detection point PA23 is shared as a detection point for preventing malfunction for the first detection points PA11 and PA12. Similarly, the second detection points PA25 and PA27 are shared as detection points for preventing malfunction for two adjacent first detection points.

[0040] In this way, in the input device 1, there may be a plurality of first detection points (PA11 to PA14), and at least one of the second detection points PA21 to PA29 may be disposed between the plurality of first detection points. Here, "between the plurality of first detection points" is not limited to the middle of the straight line connecting the plurality of first detection points, but means an area that is approximately equal in distance from the plurality of first detection points. In this case, the second detection point disposed between the plurality of first detection points functions as a detection point for preventing erroneous detection of an input operation for all of the plurality of first detection points. Therefore, the number of detection points can be reduced, and the configuration of the position detection sensor 20 can be simplified.

[0041] The notification unit 32 may output different sounds from the speaker 50 when the position detection sensor 20 detects an object at any of the first detection points PA11-PA14 and when the position detection sensor 20 detects an object at any of the second detection points PA21-PA29. It is preferable that the sounds output for the first detection points PA11-PA14 and the second detection points PA21-PA29 are different from each other. In this case, the user can get a sense of operation by inputting.

[0042] Furthermore, when the position detection sensor 20 detects an object at any of the first detection points PA11-PA14 and the second detection points PA21-PA29, the notification unit 32 may notify the user of this through the stereoscopic image display unit 10. For example, the stereoscopic image display unit 10 may change the color of the stereoscopic image IA when the position detection sensor 20 detects an object at any of the first detection points PA11-PA14 and when the position detection sensor 20 detects an object at any of the second detection points PA21-PA29. Furthermore, the stereoscopic image display unit 10 may stop displaying the image when the position detection sensor 20 detects an object at any of the second detection points PA21-PA29.

[0043] Furthermore, when an object is detected at any of the second detection points PA21-PA29 and no input is detected, the notification unit 32 notifies the user of this. For example, the notification unit 32 may notify the user by changing the color of the stereoscopic image IA or by erasing the display of the stereoscopic image IA. Furthermore, the notification unit 32 may output a sound different from that output when an object has been detected at any of the first detection points PA11-PA14.

[0044] 7 is a diagram showing the positional relationship between the first detection point PA11 and the second detection points PA21 and PA22. In the example shown in FIG. 7, the second detection points PA21 and PA22 are located at a position farther away from the stereoscopic image display unit 10 than the first detection point PA11. Although not shown in FIG. 7, the second detection point PA23 may also be located at a position farther away from the stereoscopic image display unit 10 than the first detection point PA11. In this case, the second detection points PA21 to PA23 are located closer to the user than the first detection point PA11. Therefore, the input detection unit 31 can detect erroneous detection of an input operation by the position detection sensor 20 more quickly.

[0045] (Second concrete example) Fig. 8(a) is a diagram showing a second specific example of the input device 1. Fig. 8(a) shows a stereoscopic image displayed by the stereoscopic image display unit 10 and points detected by the position detection sensor 20. The second specific example differs from the first specific example in the positions of the points detected by the position detection sensor 20.

[0046] In the example shown in Fig. 8(a), the detection points detected by the position detection sensor 20 include detection point PB1 (third detection point) and detection point PB2 (fourth detection point) located at the top and bottom of the stereoscopic image IA, and detection point PB3 (fifth detection point) and detection point PB4 (sixth detection point) located at the left and right of the stereoscopic image IA. The detection points PB1 and PB2 are different from each other. In addition, the detection points PB3 and PB4 are located at both ends of a line segment (second line segment) that intersects with a line segment (first line segment) whose both ends are the detection points PB1 and PB2.

[0047] In the example shown in FIG. 8(a), the input detection unit 31 detects an input when the position detection sensor 20 detects an object at the detection point PB1, detects an object at the detection point PB2 within a predetermined second period, and does not detect an object at the detection points PB3 and PB4 during the period from the time the object is detected at the detection point PB1 to the time the object is detected at the detection point PB2. The length of the second period may be the same as the above-mentioned first period. In this case, the detection points PB3 and PB4 function as detection points for preventing malfunctions of the detection points PB1 and PB2.

[0048] When a user performs an input operation on the input device 1 shown in Fig. 8(a), the user only needs to pass a pointer F such as a finger through detection points PB1 and PB2 in sequence, as if pressing a button on the stereoscopic image IA. If the pointer F does not pass through either detection points PB3 or PB4 at this time, the input detection unit 31 of the input device 1 detects an input by the user. More specifically, the user only needs to pass the pointer F from top to bottom through detection points PB1 and PB2.

[0049] On the other hand, if an object simply passes through the space in which the stereoscopic image IA is displayed, the object is likely to be detected at least at one of the detection points PB3 and PB4 between the time it is detected at one of the detection points PB1 and PB2 and the time it is detected at the other of the detection points PB1 and PB2. Therefore, even with the example shown in (a) of FIG. 8, an input can be detected only when the user intends it to be detected.

[0050] It is preferable that the distance between each of the detection points PB3 and PB4 and the perpendicular bisector of the first line segment is less than half the length of the first line segment, which further increases the possibility that an object will be detected at at least one of the detection points PB3 and PB4 after being detected at one of the detection points PB1 and PB2 and before being detected at the other one.

[0051] In addition, some conventional input devices detect an input when an object is continuously detected at a detection point for a predetermined period of time to prevent erroneous detection. In such conventional input devices, a user needs to wait for a predetermined period of time with a finger or the like placed at the detection point. Compared to such conventional input devices, the input device 1 has the advantage of being able to detect an input in a short time.

[0052] Fig. 8(b) is a diagram showing an example of displaying a stereoscopic image IB different from the stereoscopic image IA in the second concrete example. The stereoscopic image IA displayed in the example shown in Fig. 8(a) was an image of a button whose upper surface is inclined with respect to the stereoscopic image display unit 10. On the other hand, in the example shown in Fig. 8(b), the stereoscopic image display unit 10 displays a stereoscopic image IB. The stereoscopic image IB is an image of a button whose upper surface is perpendicular to the stereoscopic image display unit 10. The input device 1 that displays such a stereoscopic image IB can also detect an input based on the detection result by the position detection sensor 20 that detects the detection points PB1, PB2, PB3, and PB4 similar to the example shown in Fig. 8(a).

[0053] Fig. 9 is a diagram showing an example of an image indicating the direction of an input action by a user. In the input device 1, in addition to the stereoscopic image IA or IB, an image indicating the direction of an input action by a user as shown in Fig. 9 may be displayed. By displaying the image, the input device 1 can show the user what action the user should perform to input.

[0054] 10 is a diagram for explaining an example of an installation position of the position detection sensor 20 in the input device 1 shown in (a) and (b) of FIG. 8, (a) being a perspective view, (b) being a side view, and (c) being a top view. In (a) to (c) of FIG. 10, the origin of the coordinate axis is located at the center of the surface of the input device 1. In (a) to (c) of FIG. 10, only the position of the position detection sensor 20 is shown. In (b) and (c) of FIG. 10, the input device 1 is omitted.

[0055] 8(a) and 8(b), the input detection unit 31 detects an input when the pointer F passes through the detection points PB1 and PB2 from top to bottom. In such an input device 1, the position detection sensor 20 is preferably disposed at a position closer to the detection point PB2 than to the detection point PB1. In other words, the position detection sensor 20 is preferably disposed downstream of the operation of detecting the input.

[0056] 10(b), if the position detection sensor 20 is disposed downstream of the operation of detecting an input, there is little risk that the indicator F will block the gap between the detection points PB2 to PB4 and the position detection sensor 20 after the indicator F is detected at the detection point PB1 and before it is detected at the detection point PB2. Therefore, the position detection sensor 20 can properly detect the user's finger at the detection points PB1 to PB4.

[0057] For comparison, consider a case where the input detection unit 31 detects an input when the position detection sensor 20 detects an object at detection point PB1 after detecting an object at detection point PB2. In this case, the position detection sensor 20 arranged on the lower side of the input device 1 is arranged upstream of the operation of the input detection unit 31 to detect the input. In this case, as shown in FIG. 10(b), after the indicator F is detected at the detection point PB2, there is a high possibility that the indicator F will block the gap between the detection points PB1, PB3, and PB4 and the position detection sensor 20 until it is detected at the detection point PB1. For this reason, there is a possibility that the position detection sensor 20 will not be able to properly detect the user's finger.

[0058] The position of the position detection sensor 20 in the left-right direction is independent of whether it is upstream or downstream of the input motion. Therefore, as shown in (a) and (c) of FIG. 10, the position detection sensor 20 may be disposed at any position in the left-right direction.

[0059] 11 is a diagram for explaining another example of the installation position of the position detection sensor 20 in the input device 1 shown in (a) and (b) of FIG. 8, where (a) is a perspective view, (b) is a side view, and (c) is a top view. In (a) to (c) of FIG. 11, the origin of the coordinate axis is located at the center of the surface of the input device 1. In (a) to (c) of FIG. 11, only the position of the position detection sensor 20 is shown. In (b) and (c) of FIG. 11, the input device 1 is also omitted.

[0060] 11(a) to 11(c), the position detection sensor 20 is located near the center in the up-down direction of the input device 1. In other words, the position of the position detection sensor 20 is neither upstream nor downstream in the operation of detecting an input by the input detection unit 31. Even when the position detection sensor 20 is located in such a position, the position detection sensor 20 can appropriately detect the pointer F at the detection points PB1 to PB4.

[0061] Fig. 12(a) is a diagram showing a modified example of the second specific example of the input device 1. In the example shown in Fig. 12(a), the stereoscopic image display unit 10 displays a stereoscopic image IC of a lever instead of a stereoscopic image IA of a button. In addition, the detection points detected by the position detection sensor 20 include a detection point PB1 located on the right side of the stereoscopic image IC, a detection point PB2 located on the left side, a detection point PB3 located on the upper side of the stereoscopic image IC, and a detection point PB4 located on the lower side.

[0062] When a user performs an input operation on the input device 1 shown in FIG. 12(a), the user simply tilts the lever of the stereoscopic image IC to cause the indicator F to pass through the detection points PB1 and PB2 in sequence.

[0063] 12(a), another detection point PB5 may be provided at the position of the tip of the lever of the stereoscopic image IC. In the input device 1 having the detection point PB5, the input detection unit 31 may detect an input when an object is detected at the detection point PB2 after an object is detected at the detection point PB5.

[0064] FIG. 12(b) is a diagram showing another modified example of the second specific example of the input device 1. In the example shown in FIG. 12(b), the stereoscopic image display unit 10 displays a stereoscopic image ID of a dial instead of a stereoscopic image IC of a lever. The positions of the detection points PB1, PB2, PB3, PB4, and PB5 are the same as those in the example shown in FIG. 12(a). Even in the input device 1 that displays such a stereoscopic image ID, the input detection unit 31 can detect an input based on the detection result by the position detection sensor 20 that detects the detection points PB1, PB2, PB3, PB4, and PB5 similar to those in the example shown in FIG. 12(a).

[0065] In this way, by matching the operation direction indicated by the displayed stereoscopic image with the order of detection points for the input detection unit 31 to detect an input, the user can intuitively perform an input operation on the input device 1.

[0066] Fig. 13 is a diagram for explaining an example of an installation position of the position detection sensor 20 in the input device 1 shown in Fig. 12(a) and (b), where (a) is a perspective view, (b) is a side view, and (c) is a top view. In Fig. 13(a) to (c), the origin of the coordinate axis is located at the center of the surface of the input device 1. In Fig. 13(a) to (c), only the position of the position detection sensor 20 is shown. In Fig. 13(b) and (c), the input device 1 is omitted.

[0067] As described above with reference to Fig. 10, in the input device 1, the position detection sensor 20 is preferably disposed downstream of the operation of the input detection unit 31 for detecting an input. For this reason, in the input device 1 shown in Fig. 12(a) and (b), the position detection sensor 20 is preferably disposed on the left side of the input device 1 as shown in Fig. 13(a) to (c). Also, in the input device 1 shown in Fig. 11(a) and (b), the position detection sensor 20 may be disposed at any position in the up-down direction as shown in Fig. 13(a) and (c).

[0068] 14 is a diagram for explaining another example of the installation position of the position detection sensor 20 in the input device 1 shown in FIG. 12(a) and (b), where (a) is a perspective view, (b) is a side view, and (c) is a top view. In FIG. 14(a) to (c), the origin of the coordinate axis is located at the center of the surface of the input device 1. Also, in FIG. 14(a) to (c), only the position of the position detection sensor 20 is shown. Also, in FIG. 14(b) and (c), the input device 1 is omitted.

[0069] 14(a) to (c), the position detection sensor 20 is located near the center in the left-right direction of the input device 1. As in the examples shown in Fig. 11(a) to (c), even when the position detection sensor 20 is located in such a position, the position detection sensor 20 can appropriately detect the user's finger at detection points PB1 to PB4.

[0070] (Third concrete example) Fig. 15 is a diagram showing a third specific example of the input device 1. In the example shown in Fig. 15, the stereoscopic image display unit 10 displays a stereoscopic image IA of one button. In addition, in the example shown in Fig. 15, among the detection points by the position detection sensor 20, the first detection point for detecting the user's input operation is only the detection point PC (first detection point) located at the center of the stereoscopic image IA. In addition, the second detection point is omitted in Fig. 15, but may be provided arbitrarily around the detection point PC.

[0071] The input detection unit 31 detects an input when the position detection sensor 20 detects an object at the same detection point PC twice (multiple times) within a predetermined third period. Here, detecting twice means that there is a period during which no object is detected between the two detections. Note that the input detection unit 31 may detect an input when the position detection sensor 20 detects an object at the detection point PC three or more times.

[0072] The user can perform an input to the input device 1, for example, by pressing the button on the stereoscopic image IA below the detection point PC and then releasing it within the third period. The third period may be, for example, the same as the first period and the second period. That is, the third period may be, for example, 0.1 to 0.2 seconds, or 0.2 to 0.4 seconds.

[0073] It is considered that the possibility of a user unintentionally performing an action that causes an object to be detected multiple times in a short period of time at the same detection point PC is small. Therefore, the input device 1 shown in FIG. 15 can also detect an input only when the user intends to do so.

[0074] In the input device 1 shown in Fig. 15, a method in which the notification unit 32 notifies the user when the input detection unit 31 detects an input will be exemplified below. For example, the notification unit 32 may change the color or brightness of the stereoscopic image IA before and after the input detection unit 31 detects the input. In addition, if the input device 1 includes a speaker, a sound indicating that the input has been detected may be output from the speaker. In addition, if the input device 1 includes a device for stimulating the user's tactile sense, such as an ultrasonic generator, the notification unit 32 may remotely stimulate the tactile sense of the finger.

[0075] Furthermore, when the input detection unit 31 detects an input, the notification unit 32 may display a stereoscopic image different from that before the input was detected. Specifically, when the input detection unit 31 detects an input, the notification unit 32 may display a stereoscopic image of a button in a pressed state. To switch between stereoscopic images in this manner, the stereoscopic image display unit 10 only needs to include (i) a light guide plate 11 and a light source 12 for displaying a stereoscopic image IA, and (ii) a light guide plate 11 and a light source 12 for displaying a stereoscopic image when the input detection unit 31 detects an input, which are superimposed on each other. The notification unit 32 can switch between stereoscopic images to be displayed by switching on and off the two light sources 12.

[0076] The notification unit 32 may display a stereoscopic image before the input detection unit 31 detects an input, and display a flat image after the input is detected. In this case, the user can easily recognize that the display has been switched. In this case, the stereoscopic image display unit 10 may be provided with only one light guide plate.

[0077] Fig. 16 is a diagram showing a TOF (Time Of Flight) sensor 23 as an example of the position detection sensor 20 in the third specific example. The TOF sensor 23 shown in Fig. 16 calculates the distance from the TOF sensor 23 to the pointer F based on the time it takes for light emitted from a light projecting unit 23a to be reflected by the pointer F and received by a light receiving unit 23b.

[0078] 17 is a diagram showing a distance measurement sensor 24 as another example of the position detection sensor 20 in the third specific example. The distance measurement sensor 24 receives light, which is irradiated through a light projecting lens and reflected by a pointer F, at a light receiving element via a light receiving lens. At this time, the distance measurement sensor 24 calculates the distance between the distance measurement sensor 24 and the pointer F by utilizing the fact that the light receiving position at the light receiving element changes depending on the distance to the pointer F.

[0079] The position detection sensor 20 in the third specific example may be, for example, a TOF sensor 23 as shown in Fig. 16 or a distance measurement sensor 24 as shown in Fig. 17. In this case, the input detection unit 31 detects an input when the position detection sensor 20 detects an object multiple times within a predetermined distance (the distance from the position detection sensor 20 to the detection point PC).

[0080] Fig. 18 is a diagram showing yet another example of the position detection sensor 20 in the third specific example. As shown in Fig. 18, the position detection sensor 20 may be a combination of a shell LED 25a and a photodiode 25b. The position detection sensor 20 shown in Fig. 18 can be said to be a simplified version of the limited reflection sensor 21.

[0081] The position detection sensor 20 in the third specific example may be a combination of a shell LED 25a and a photodiode 25b as shown in Fig. 18. In this case, the input detection unit 31 detects an input when the position detection sensor 20 detects an object multiple times in a predetermined space (a space centered on the detection point PC).

[0082] Furthermore, the position detection sensor 20 may be a sensor having another configuration capable of detecting the indicator F at the detection point PC. For example, the position detection sensor 20 may be a motion sensor that detects the position of the indicator F and detects the motion of the indicator F.

[0083] §3 Example of operation 19(a)-(c) are diagrams showing a state where the input device of the present invention is applied to an input unit of an elevator. As shown in FIG. 19(a), the input device of the present invention can be applied to, for example, an input unit 200 of an elevator. Specifically, the input unit 200 displays stereoscopic images I1-I12. The stereoscopic images I1-I12 are stereoscopic images formed by imaging displays (stereoscopic images I1-I10) that accept a user's input specifying the destination (floor) of the elevator, or displays (stereoscopic images I11-I12) that accept an instruction to open or close the elevator door. When the input unit 200 accepts a user's input for any of the stereoscopic images I, the input unit 200 changes the imaging state of the stereoscopic image I (for example, changes the color of the stereoscopic image I) and outputs an instruction corresponding to the input to a control unit of the elevator. The input unit 200 may display the stereoscopic image I only when a person approaches the input unit 200. The input unit 200 may also be disposed inside the wall of the elevator.

[0084] In the input unit 200 of the elevator, for example, when there are many people in the elevator, a part of the user's body may be located at the imaging position of the stereoscopic image I, and the input unit 200 may receive an input that is not intended by the user. Therefore, the input unit 200 may receive an input from the user only when a rotation operation is received on the stereoscopic image I by, for example, a motion sensor. Since a rotation operation is an operation that is not usually performed unless the user intends it, it is possible to prevent the input unit 200 from receiving an input that is not intended by the user. In addition, as shown in (c) of FIG. 19, the stereoscopic image I may be configured to be displayed in a recess provided on the inner wall of the elevator. In this way, an input to the stereoscopic image I is performed only when the indicator F is inserted into the recess, so it is possible to prevent the input unit 200 from receiving an input that is not intended by the user.

[0085] FIG. 20 is a diagram showing a state where the input device of the present invention is applied to an input section of a warm water toilet seat washer. As shown in FIG. 20, the input device of the present invention can be applied to, for example, an input section 300 (operation panel section) of a warm water toilet seat washer. Specifically, the input section 300 displays stereoscopic images I1 to I4. The stereoscopic images I1 to I4 are stereoscopic images formed to display a display for receiving an instruction to start / stop the cleaning function of the warm water toilet seat washer. When the input section 300 receives a user's input for any stereoscopic image I, it changes the imaging state of the stereoscopic image I (for example, changes the color of the stereoscopic image I) and outputs an instruction corresponding to the input to the control section of the warm water toilet seat washer. Many users do not like to directly touch the operation panel of a warm water toilet seat washer for hygienic reasons. In contrast, the input section 300 allows the user to operate the input section 300 without directly touching (physically touching) the input section 300. Therefore, the user can operate the input section 300 without worrying about hygiene. The input device of the present invention can also be applied to other devices where direct contact is undesirable from a hygienic standpoint. For example, the input device of the present invention is suitable for use in serial number issuing machines installed in hospitals and operating parts of moving doors that are touched by an unspecified number of people. In addition, the input device of the present invention is suitable for use in serial number issuing machines installed in hospitals that have multiple options such as surgery and internal medicine, since it can display a stereoscopic image I corresponding to each option. In addition, the input device of the present invention is suitable for use in cash registers or food ticket vending machines installed in restaurants.

[0086] In addition, the input device 1 can be applied to, for example, an input section of an ATM (Automated Teller Machine), an input section of a credit card reader, an input section for unlocking a safe, an input section of a door unlocked by a PIN number, and the like. Here, in a conventional PIN input device, input is performed by physically contacting the input section with a finger. In such a case, a fingerprint or a temperature history is left on the input section. Therefore, there is a risk that the PIN number will be known to others. In contrast, when the input device 1 is used as an input section, a fingerprint or a temperature history is not left, so that the PIN number can be prevented from being known to others. As another example, the input device 1 can be applied to a ticket vending machine installed in a station, etc.

[0087] Furthermore, the input device 1 can also be applied to a light switch for a bathroom vanity, a faucet operation switch, a range hood operation switch, a dishwasher operation switch, a refrigerator operation switch, a microwave oven operation switch, an IH cooking heater operation switch, an electrolytic water generator operation switch, an intercom operation switch, a hallway light switch, an operation switch for a compact stereo system, etc. Applying the input device 1 to these switches brings about the following advantages: (i) the switch is easy to clean since it is smooth, (ii) design is improved since a stereoscopic image can be displayed only when necessary, (iii) it is hygienic since it is not necessary to touch the switch, and (iv) it is less likely to break since there are no moving parts.

[0088] § 4 Variations Although the embodiment of the present invention has been described in detail above, the above description is merely an example of the present invention in every respect. It goes without saying that various improvements and modifications can be made without departing from the scope of the present invention. For example, the following modifications are possible. In the following, the same reference numerals are used for the same components as in the above embodiment, and the description of the same points as in the above embodiment is omitted as appropriate. The following modifications can be combined as appropriate.

[0089] <4.1> An input device 1A as a modified example of the input device 1 will be described with reference to FIGS.

[0090] Fig. 21 is a perspective view of the input device 1A. Fig. 22 is a cross-sectional view showing the configuration of a stereoscopic image display unit 10A included in the input device 1A. Fig. 23 is a plan view showing the configuration of the stereoscopic image display unit 10A. Fig. 24 is a perspective view showing the configuration of an optical path changing unit 16 included in the stereoscopic image display unit 10A.

[0091] As shown in Fig. 21, the input device 1A includes a stereoscopic image display unit 10A instead of the stereoscopic image display unit 10 in the first embodiment. The input device 1 in the first embodiment and the input device 1A in this modification have the same configuration except that the stereoscopic image I is formed by the stereoscopic image display unit 10A, so only the method of forming the stereoscopic image I by the stereoscopic image display unit 10A will be described here. Also in Figs. 21 to 26, configurations other than the stereoscopic image display unit 10A are omitted from the illustration.

[0092] As shown in FIGS. 21 and 22, the stereoscopic image display section 10A includes a light source 12 and a light guide plate 15 (first light guide plate).

[0093] The light guide plate 15 is a member that guides the light (incident light) incident from the light source 12. The light guide plate 15 is molded from a transparent resin material with a relatively high refractive index. For example, polycarbonate resin, polymethyl methacrylate resin, etc. can be used as the material for forming the light guide plate 15. In this modification, the light guide plate 15 is molded from polymethyl methacrylate resin. As shown in FIG. 22, the light guide plate 15 has an exit surface 15a (light exit surface), a back surface 15b, and an entrance surface 15c.

[0094] The exit surface 15a is a surface that emits light that has been guided inside the light guide plate 15 and has had its optical path changed by the optical path changing section 16 (described later). The exit surface 15a constitutes the front surface of the light guide plate 15. The back surface 15b is a surface that is parallel to the exit surface 15a, and is a surface on which the optical path changing section 16 (described later) is disposed. The entrance surface 15c is a surface through which the light emitted from the light source 12 enters the inside of the light guide plate 15.

[0095] The light emitted from the light source 12 and incident on the light guide plate 15 from the incident surface 15 c is totally reflected by the exit surface 15 a or the back surface 15 b , and is guided within the light guide plate 15 .

[0096] 22, the light path changing section 16 is formed on the back surface 15b inside the light guide plate 15, and is a member for changing the light path of the light guided inside the light guide plate 15 and emitting the light from the emission surface 15a. A plurality of light path changing sections 16 are provided on the back surface 15b of the light guide plate 15.

[0097] As shown in FIG. 23, the light path changing section 16 is provided in a direction parallel to the incident surface 15c. As shown in FIG. 24, the light path changing section 16 has a triangular pyramid shape and includes a reflecting surface 16a that reflects (total reflects) the incident light. The light path changing section 16 may be, for example, a recess formed on the back surface 15b of the light guide plate 15. Note that the light path changing section 16 is not limited to a triangular pyramid shape. As shown in FIG. 23, a plurality of light path changing section groups 17a, 17b, 17c... each consisting of a plurality of light path changing sections 16 are formed on the back surface 15b of the light guide plate 15.

[0098] Fig. 25 is a perspective view showing an arrangement of the optical path changing sections 16. As shown in Fig. 25, in each of the optical path changing section groups 17a, 17b, 17c..., the reflection surfaces 16a of the multiple optical path changing sections 16 are arranged on the back surface 15b of the light guide plate 15 so that the angles with respect to the incident direction of light are different from one another. As a result, each of the optical path changing section groups 17a, 17b, 17c... changes the optical path of the incident light and outputs it in various directions from the output surface 15a.

[0099] Next, a method for forming a stereoscopic image I by the stereoscopic image display unit 10A will be described with reference to Fig. 26. Here, a case will be described in which the stereoscopic image I is formed as a planar image by light whose optical path has been changed by the optical path changing unit 16 on a stereoscopic image forming plane P, which is a plane perpendicular to the exit surface 15a of the light guide plate 15.

[0100] 26 is a perspective view showing a method for forming a stereoscopic image I by the stereoscopic image display unit 10A. Note that, here, the formation of a ring mark with oblique lines as the stereoscopic image I on the stereoscopic image forming plane P will be described.

[0101] In the stereoscopic image display unit 10A, as shown in FIG. 26, for example, the light whose optical path has been changed by each optical path changer 16 of the optical path changer group 17a intersects with the stereoscopic image formation plane P at the lines La1 and La2. As a result, a line image LI, which is a part of the stereoscopic image I, is formed on the stereoscopic image formation plane P. The line image LI is a line image parallel to the YZ plane. In this manner, the line images LI of the lines La1 and La2 are formed by the light from the multiple optical path changers 16 belonging to the optical path changer group 17a. Note that the light that forms the images of the lines La1 and La2 may be provided by at least two optical path changers 16 in the optical path changer group 17a.

[0102] Similarly, the light whose optical path has been changed by each optical path changing section 16 of the optical path changing section group 17b intersects with the stereoscopic image forming plane P at lines Lb1, Lb2, and Lb3. As a result, a line image LI, which is a part of the stereoscopic image I, is formed on the stereoscopic image forming plane P.

[0103] Furthermore, the light whose optical path has been changed by each optical path changing unit 16 of the optical path changing unit group 17c intersects with the stereoscopic image formation plane P at lines Lc1 and Lc2. As a result, a line image LI, which is a part of the stereoscopic image I, is formed on the stereoscopic image formation plane P.

[0104] The positions in the X-axis direction of the line images LI formed by each of the optical path changing unit groups 17a, 17b, 17c... are different from each other. In the stereoscopic image display unit 10A, by reducing the distance between the optical path changing unit groups 17a, 17b, 17c..., it is possible to reduce the distance in the X-axis direction of the line images LI formed by each of the optical path changing unit groups 17a, 17b, 17c.... As a result, in the stereoscopic image display unit 10A, a stereoscopic image I, which is essentially a plane image, is formed on the stereoscopic image forming plane P by accumulating a plurality of line images LI formed by light whose optical paths are changed by each of the optical path changing units 16 of the optical path changing unit groups 17a, 17b, 17c....

[0105] The stereoscopic image forming plane P may be a plane perpendicular to the X-axis, a plane perpendicular to the Y-axis, or a plane perpendicular to the Z-axis. The stereoscopic image forming plane P may be a plane that is not perpendicular to the X-axis, the Y-axis, or the Z-axis. Furthermore, the stereoscopic image forming plane P may be a curved surface instead of a flat surface. That is, the stereoscopic image display unit 10A can form a stereoscopic image I on any surface (flat surface or curved surface) in space by using the optical path changing unit 16. Also, a three-dimensional image can be formed by combining multiple surface images.

[0106] <4.2> An input device 1B as another modified example of the input device 1 will be described with reference to FIGS.

[0107] Fig. 27 is a perspective view of the input device 1B. Fig. 28 is a cross-sectional view showing the configuration of a stereoscopic image display section 10B included in the input device 1B.

[0108] As shown in Fig. 27, the input device 1B includes a stereoscopic image display unit 10B instead of the stereoscopic image display unit 10. The input device 1 and the input device 1B in this modification have the same configuration except that the stereoscopic image I is formed by the stereoscopic image display unit 10B, so only the method of forming the stereoscopic image I by the stereoscopic image display unit 10B will be described here. In Figs. 27 and 28, configurations other than the stereoscopic image display unit 10B are omitted from the illustration.

[0109] 27 and 28, the stereoscopic image display unit 10B includes an image display device 81, an imaging lens 82, a collimating lens 83, a light guide plate 84 (first light guide plate), and a mask 85. The image display device 81, the imaging lens 82, the collimating lens 83, and the light guide plate 84 are arranged in this order along the Y-axis direction. The light guide plate 84 and the mask 85 are arranged in this order along the X-axis direction.

[0110] The image display device 81 displays a two-dimensional image projected in the air by the stereoscopic image display unit 10B in the display area in response to a video signal received from a control device (not shown). The image display device 81 is, for example, a general liquid crystal display that can output image light by displaying an image in the display area. In the illustrated example, the display area of ​​the image display device 81 and the incident surface 84a of the light guide plate 84 facing the display area are both arranged parallel to the XZ plane. In addition, the back surface 84b of the light guide plate 84 on which the prism 141 described later is arranged, and the exit surface 84c (light exit surface) that emits light to the mask 85 facing the back surface 84b are both arranged parallel to the YZ plane. Furthermore, the surface of the mask 85 on which the slit 151 described later is provided is also arranged parallel to the YZ plane. In addition, the display area of ​​the image display device 81 and the incident surface 84a of the light guide plate 84 may be arranged opposite to each other, or the display area of ​​the image display device 81 may be arranged at an angle with respect to the incident surface 84a.

[0111] The imaging lens 82 is disposed between the image display device 81 and the incident surface 84a. The imaging lens 82 converges the image light output from the display area of ​​the image display device 81 in a YZ plane parallel to the longitudinal direction of the incident surface 84a, and then emits the converged image light to the collimator lens 83. The imaging lens 82 may be any lens capable of converging the image light. For example, the imaging lens 82 may be a bulk lens, a Fresnel lens, or a diffractive lens. The imaging lens 82 may also be a combination of a plurality of lenses arranged along the Z-axis direction.

[0112] The collimator lens 83 is disposed between the image display device 81 and the incident surface 84a. The collimator lens 83 converts the image light converged by the imaging lens 82 into parallel light in the XY plane perpendicular to the longitudinal direction of the incident surface 84a. The collimator lens 83 outputs the parallelized image light to the incident surface 84a of the light guide plate 84. The collimator lens 83 may be a bulk lens and a Fresnel lens, as with the imaging lens 82. The imaging lens 82 and the collimator lens 83 may be arranged in the reverse order. The functions of the imaging lens 82 and the collimator lens 83 may be realized by one lens or by a combination of multiple lenses. That is, as long as the image light output from the display area of ​​the image display device 81 can be converged in the YZ plane and parallelized in the XY plane, any combination of the imaging lens 82 and the collimator lens 83 may be used.

[0113] The light guide plate 84 is made of a transparent member, and receives the image light collimated by the collimator lens 83 at an incident surface 84a and emits it from an exit surface 84c. In the illustrated example, the light guide plate 84 has a rectangular parallelepiped outer shape formed in a flat plate shape, and a surface parallel to the XZ plane facing the collimator lens 83 is the incident surface 84a. A surface parallel to the YZ plane and on the negative side of the X axis is the back surface 84b, and a surface parallel to the YZ plane and facing the back surface 84b is the exit surface 84c. The light guide plate 84 has a plurality of prisms (exit structure, optical path changing section) 141.

[0114] The multiple prisms 141 reflect the image light incident from the incident surface 84a of the light guide plate 84. The prisms 141 are provided on the back surface 84b of the light guide plate 84, protruding from the back surface 84b toward the exit surface 84c. For example, when the propagation direction of the image light is the Y-axis direction, the multiple prisms 141 are approximately triangular grooves having a predetermined width (for example, 10 μm) in the Y-axis direction and arranged at a predetermined interval (for example, 1 mm) in the Y-axis direction. The prism 141 includes a reflection surface 141a, which is a surface closer to the incident surface 84a in the light guide direction (+Y-axis direction) of the image light, among the optical surfaces of the prism 141. In the illustrated example, the multiple prisms 141 are provided on the back surface 84b in parallel with the Z-axis. As a result, image light incident from incident surface 84a propagating in the Y-axis direction is reflected by reflecting surfaces 141a of multiple prisms 141 arranged parallel to the Z-axis perpendicular to the Y-axis. Each of the multiple prisms 141 emits image light emitted from different positions in the display area of ​​image display device 81 in the X-axis direction perpendicular to the longitudinal direction of incident surface 84a from exit surface 84c, which is one surface of light guide plate 84, toward a predetermined viewpoint 100. Details of reflecting surface 141a will be described later.

[0115] The mask 85 is made of a material that is opaque to visible light, and has a plurality of slits 151. The mask 85 can transmit, using the plurality of slits 151, only light traveling toward the image point 101 on the plane 102, among the light emitted from the emission surface 84c of the light guide plate 84.

[0116] The multiple slits 151 transmit only light traveling toward the image point 101 on the plane 102, out of the light emitted from the emission surface 84c of the light guide plate 84. In the illustrated example, the multiple slits 151 are provided parallel to the Z axis. Each slit 151 corresponds to one of the multiple prisms 141.

[0117] With the above configuration, the stereoscopic image display unit 10B forms and projects an image displayed on the image display device 81 onto a virtual plane 102 outside the stereoscopic image display unit 10B. Specifically, first, the image light emitted from the display area of ​​the image display device 81 passes through the imaging lens 82 and the collimator lens 83, and then enters the entrance surface 84a, which is an end surface of the light guide plate 84. Next, the image light that has entered the light guide plate 84 propagates inside the light guide plate 84 and reaches the prism 141 provided on the back surface 84b of the light guide plate 84. The image light that has reached the prism 141 is reflected by the reflecting surface 141a of the prism 141 in the positive direction of the X axis, and is emitted from the exit surface 84c of the light guide plate 84, which is arranged so as to be parallel to the YZ plane. Among the image light emitted from the exit surface 84c, the image light that passes through the slits 151 of the mask 85 is imaged at an image forming point 101 on the plane 102. That is, the image light emitted from each point in the display area of ​​the image display device 81 can be projected onto the image forming point 101 on the plane 102 after being converged in the YZ plane and collimated in the XY plane. By performing the above-mentioned processing on all points in the display area, the stereoscopic image display unit 10B can project the image output to the display area of ​​the image display device 81 onto the plane 102. As a result, when the user looks at the virtual plane 102 from the viewpoint 100, the user can visually recognize the image projected in the air. Note that the plane 102 is a virtual plane on which the projected image is imaged, but a screen or the like may be placed to improve visibility.

[0118] <4.3> In the input device 1, the stereoscopic image display unit 10 may separately form images for a plurality of viewpoints. For example, the stereoscopic image display unit 10 may include a right-eye display pattern for forming an image for the right eye, and a left-eye display pattern for forming an image for the left eye. In this case, the stereoscopic image display unit 10 can form an image with a three-dimensional effect. Note that the stereoscopic image display unit 10 may separately form images for three or more viewpoints.

[0119] <4.4> The input devices 1, 1A, and 1B were equipped with stereoscopic image display units 10, 10A, and 10B, respectively. The stereoscopic image display units 10, 10A, and 10B changed the optical path of light guided inside light guide plates 11, 15, and 84, respectively, by an optical path changing unit, and emitted the light from an exit surface, thereby forming a stereoscopic image or a reference image.

[0120] However, the input device according to the present invention may display an image indicating the detection points in space in a manner different from that of the stereoscopic image display units 10, 10A, and 10B. For example, the stereoscopic image or the reference image may be formed by emitting light from an optical element using light emitted from an object that is the original image of the stereoscopic image or the reference image.

[0121] Examples of display devices that use light emitted from an object that is the source image to emit light from an optical element and form a stereoscopic image or a reference image include (1) a display device that uses a two-sided reflector array structure in which a plurality of mutually orthogonal mirror elements are arranged on the optical coupling element surface, as disclosed in Patent Document 2, and (2) a display device called a Pepper's Ghost that uses a half mirror. In these display devices, the two-sided reflector array structure or the optical element such as the half mirror (hereinafter referred to as the optical element 400) is transparent, and the observer can view the back side of the display device through the optical element 400.

[0122] 29(a) and (b) are diagrams showing a display example of a display method using the optical element 400. A display example when the optical element 400 is used will be described with reference to FIG.

[0123] In the example shown in FIG. 29(a), a display N1 and a display N2 (flat image display unit) that display an original image that is the source of a stereoscopic image I5 are arranged on one side of the optical element 400. The display N1 and the display N2 are arranged parallel to each other. The light emitted from the display N1 and the display N2 is incident on the optical element 400, and the light path is changed by the optical element 400 and emitted from the optical element 400. Then, the light emitted from the optical element 400 forms a plane image I5a and a plane image I5b as the stereoscopic image I5 on the opposite side of the optical element 400 from the one side. That is, the optical element 400 forms the light incident from the display N1 and the display N2 in space as the stereoscopic image I5.

[0124] As described above, in the example shown in FIG. 29(a), plane images I5a and I5b are formed (i.e., a stereoscopic image I5 is formed). That is, the stereoscopic image I5 has two planes (plane images I5a and I5b) located on different planes. As a result, even when a transparent optical element 400 is used, this display example allows the observer to feel that the plane images I5a and I5b are formed on different planes. That is, this display example allows the observer to visually recognize a stereoscopic image I5 with a three-dimensional effect. In addition, at this time, since the second detection points (for example, the second detection points PA21 to PA23 shown in FIG. 5 and the like) exist around the stereoscopic image I5, the position detection sensor 20 can appropriately detect an erroneous input by the second detection points.

[0125] In the example shown in (b) of FIG. 29, a display N1 and a display N3 are arranged on one side of the optical element 400, emitting light that is the original image of the stereoscopic image I6. The display N3 is provided with a transparent light guide plate that emits light that is the original image. The display N1 and the display N3 are arranged perpendicular to each other. The light emitted from the display N1 and the display N2 enters the optical element 400, and the light path is changed by the optical element 400 and emitted from the optical element 400. Then, the light emitted from the optical element 400 forms a plane image I6a and a plane image I6b as the stereoscopic image I6 on the opposite side of the optical element 400 from the one side. Since the display N3 is provided with a transparent light guide plate, as shown in (b) of FIG. 29, even when the display N3 is located closer to the optical element 400 than the display N1, the light emitted from the display N1 can pass through the display N3 and form a plane image I6a.

[0126] As described above, in the example shown in FIG. 29(b), plane images I6a and I6b are formed (i.e., a stereoscopic image I6 is formed). That is, the stereoscopic image I6 has two planes (plane images I6a and I6b) that are perpendicular to each other. As a result, this display example allows the viewer to feel that the plane images I6a and I6b are formed on different planes, even when a transparent optical element 400 is used. That is, this display example allows the viewer to visually recognize the stereoscopic image I6 with a sense of three-dimensionality.

[0127] In the display example 8, the display N3 is provided with a transparent light guide plate that emits light, but the present invention is not limited to this. For example, instead of the display N3, a member in which light emitters (e.g., light-emitting diodes arranged in a matrix or light-emitting wires) are attached to a transparent flat plate (e.g., a glass plate) may be used.

[0128] <4.5> Furthermore, as long as the user can recognize the detection point, the input device according to the present invention does not necessarily need to display an image indicating the detection point in space, and may display it on a flat surface such as a liquid crystal display.

[0129] <4.6> Fig. 30 is a diagram showing an example of a range A1 in which the position detection sensor 20 detects an object. As shown in Fig. 30, the position detection sensor 20 in this embodiment may detect an object present in a range A1 on the front AF side of the stereoscopic image I, a predetermined distance in front of the stereoscopic image I in a direction perpendicular to the emission surface 11a of the light guide plate 11. In other words, the position detection sensor 20 may detect the finger F in an area a predetermined distance away in the opposite direction to the direction in which the input operation of the user is performed from the position where the stereoscopic image I is formed in the direction in which the input operation is performed.

[0130] In the past, a position detection sensor was configured to detect a user's input by detecting that the user's finger was located at the position where a stereoscopic image was formed. Therefore, it took a long time for the user to realize that the input device had detected his / her input action, and there was a problem that the user was unsure whether the input device was accurately detecting the user's input.

[0131] In contrast, in the above-mentioned input device 1, the position detection sensor 20 is configured to detect an object existing in a range A1 a predetermined distance in front of the stereoscopic image I in a direction perpendicular to the emission surface 11a of the light guide plate 11. Therefore, it is possible to notify the user that the input device 1 has accepted the user's input earlier than in the past. This allows the user to feel a good sense of operation when using the input device 1.

[0132] <4.7> Next, an application example in which the input device 1 is applied to a gaming machine M will be described.

[0133] 31(a) and (b) are perspective views showing an example of a gaming machine to which the input device 1 is applied. Note that, in FIGS. 31(a) and (b), the input device 1 is omitted from the illustration.

[0134] As shown in FIG. 31(a), a stereoscopic image I may be formed by the input device 1 as at least one switch among a plurality of switches operated by a user on a control panel operated by a user on a gaming machine M1.

[0135] 31(b), a stereoscopic image I serving as a switch to be operated by the user may be formed so as to be superimposed on a screen on which a performance image for the user is displayed in the gaming machine M2, and may be formed by the input device 1. In this case, the input device 1 may display the stereoscopic image I only when it is necessary for the performance.

[0136] [Software implementation example] The control block of the input device 1 (particularly the input detection unit 31 and the notification unit 32) may be realized by a logic circuit (hardware) formed in an integrated circuit (IC chip) or the like, or may be realized by software.

[0137] In the latter case, the input device 1 includes a computer that executes instructions of a program, which is software that realizes each function. The computer includes, for example, one or more processors, and a computer-readable recording medium that stores the program. The object of the present invention is achieved by the processor reading the program from the recording medium and executing it in the computer. The processor may be, for example, a CPU (Central Processing Unit). The recording medium may be a "non-transient tangible medium," such as a ROM (Read Only Memory), as well as a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like. The input device may further include a RAM (Random Access Memory) that expands the program. The program may be supplied to the computer via any transmission medium (such as a communication network or a broadcast wave) that can transmit the program. Note that one aspect of the present invention may also be realized in the form of a data signal embedded in a carrier wave, in which the program is embodied by electronic transmission.

[0138] Alternative Expressions of the Invention The present invention can also be expressed as follows.

[0139] An input device according to one embodiment of the present invention is an input device comprising a sensor that detects objects non-contact at a plurality of detection points in space, and an input detection unit that detects an input by a user in response to the detection of the object by the sensor, wherein the detection points include a first detection point for detecting an input action of the user for the input and a second detection point for preventing erroneous detection of the input action, and further comprising a display device that displays an image indicating the detection points in space.

[0140] According to the above configuration, the input detection unit in the input device detects an input with high accuracy based on the detection results from the first detection point and the second detection point. At this time, by displaying an image indicating the detection points in space using the display device, it is possible to realize an input device that allows a user to easily recognize an input action for performing an input.

[0141] In the input device according to the aspect of the present invention, the second detection points may be two points.

[0142] According to the above configuration, by providing two second detection points, the input detection unit can prevent erroneous detection based on the detection results at the second detection points.

[0143] In the input device according to the aspect of the present invention, the second detection points may be three or more.

[0144] According to the above configuration, by providing three or more second detection points, the input sensing unit can prevent erroneous detection with higher accuracy based on the detection results at the second detection points.

[0145] In addition, in an input device according to one aspect of the present invention, the input detection unit may detect that an erroneous input has occurred unintentionally by the user when the sensor detects an object at the second detection point.

[0146] According to the above configuration, the input detection unit can prevent detection of an erroneous input under the simple condition that the sensor detects an object at the second detection point.

[0147] In the input device according to the aspect of the present invention, the first detection points may be multiple, and at least one of the second detection points may be disposed between the multiple first detection points.

[0148] According to the above configuration, the second detection points arranged between the plurality of first detection points function as detection points for preventing erroneous detection of an input operation for all of the plurality of first detection points, thereby making it possible to reduce the number of detection points.

[0149] In the input device according to the aspect of the present invention, the second detection point may be located at a position farther away from the display device than the first detection point.

[0150] According to the above configuration, the second detection point is located closer to the user than the first detection point, so that the input detection unit can detect erroneous detection of an input action more quickly.

[0151] In addition, in an input device according to one embodiment of the present invention, the detection points include (i) a third detection point and a fourth detection point which are located at different positions as the first detection point, and (ii) a fifth detection point and a sixth detection point which are located at both ends of a second line segment which intersects with a first line segment having the third detection point and the fourth detection point as both ends as the second detection point, and the input detection unit detects the input when the sensor detects the object at the third detection point, detects the object at the fourth detection point within a predetermined third period, and does not detect the object at the fifth detection point and the sixth detection point during the period from the time the object is detected at the third detection point to the time the object is detected at the fourth detection point.

[0152] According to the above configuration, if the sensor detects an object at the third detection point and the fourth detection point in this order due to an unintended action by the user, it is highly likely that after detecting the object at the third detection point, the sensor will detect an object at one or both of the fifth and sixth detection points before detecting the object at the fourth detection point. Therefore, it is possible to realize an input device that can detect an input only when intended by the user.

[0153] In the input device according to the aspect of the present invention, the sensor may be disposed at a position closer to the fourth detection point than to the third detection point.

[0154] According to the above configuration, after an object is detected at the third detection point, there is little risk that the object will block the gap between the fourth to sixth detection points and the sensor until the object is detected at the fourth detection point, so that the sensor can properly detect objects at the third to sixth detection points.

[0155] In addition, in an input device according to one aspect of the present invention, the input detection unit may detect the input when the sensor detects the object at the same first detection point multiple times within a predetermined third period.

[0156] According to the above configuration, the input detection unit detects an input based on an event that is unlikely to occur unless the user intends it, that is, the sensor detects an object at the detection point multiple times within a predetermined third period. Therefore, it is possible to realize an input device that can detect an input only when the user intends it.

[0157] In addition, in an input device according to one embodiment of the present invention, the display device may change the color of the image when the sensor detects the object at the first detection point and when the sensor detects the object at the second detection point.

[0158] According to the above configuration, the user can easily recognize whether the sensor has detected an object at the first detection point or at the second detection point.

[0159] In the input device according to the aspect of the present invention, the display device may stop displaying the image when the sensor detects the object at the second detection point.

[0160] According to the above configuration, when the sensor detects an object at the second detection point, the user can easily recognize that fact.

[0161] In addition, the input device according to one embodiment of the present invention may further include an audio output unit that outputs audio when the sensor detects the object at the first detection point or the second detection point, and the audio output unit may output different audio when the sensor detects the object at the first detection point and when the sensor detects the object at the second detection point.

[0162] According to the above configuration, the user can easily recognize through voice whether the sensor has detected an object at the first detection point or the second detection point.

[0163] In addition, in an input device according to one aspect of the present invention, the display device may include a light source and a light guide plate that guides light incident from the light source and emits it from a light emission surface to form the image in space.

[0164] According to the above configuration, the display device can form an image indicating the detection point in space by using the light source and the light guide plate.

[0165] In addition, in an input device according to one embodiment of the present invention, the display device includes a planar image display unit that displays an original image that is the basis of the image, and an optical element that focuses light incident from the planar image display unit into space as the image, and the second detection point may be present around the image.

[0166] According to the above configuration, the display device can form an image showing the detection point in space by using the planar image display unit and the optical element. Furthermore, since the second detection point exists around the formed image, the sensor can appropriately detect an erroneous input by using the second detection point.

[0167] In the input device according to the aspect of the present invention, the image may be displayed three-dimensionally in accordance with the position of the first detection point.

[0168] According to the above configuration, the user can easily recognize the position of the first detection point which is the detection point for performing an input.

[0169] In addition, in an input device according to one aspect of the present invention, the input detection unit may detect the input when the sensor detects that the object is located in an area that is a predetermined distance away in the opposite direction to the direction in which the input action is performed from the position where the image is formed in the direction in which the input action is performed.

[0170] According to the above configuration, the user's input is detected before the object reaches the position where the image is formed. Therefore, the input device can notify the user that the input has been received earlier than in the past. This allows the user to feel good about the operation of the input device.

[0171] The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention. [Explanation of symbols]

[0172] 1, 1A, 1B Input Device 10, 10A, 10B 3D image display section 12 light source 11, 15, 84 Light guide plate 11a, 15a, 84c Output surface 20 Position detection sensor (sensor) 31 Input detection unit 32 Notification Department

Claims

1. a sensor that detects an object at a detection point in space in a non-contact manner; an input detection unit that detects an input by a user in response to detection of the object by the sensor, a display device that displays in space an image for the user to recognize an input action for performing the input; the sensor detects an object in an area that is a predetermined first distance away from a position where the image is formed in a direction in which the user's input action for the input is performed, in a direction opposite to the direction in which the input action is performed; the input detection unit detects that an input by the user to the image has been received at a point in time when the sensor detects the object; the sensor is disposed at a position that is a predetermined second distance away in a direction in which the input motion is performed from a position at which the image is formed in the direction in which the input motion is performed, The sensor comprises a light-emitting unit and a light-receiving unit, and at least one of the direction from the light-emitting unit to the detection point and the direction from the detection point to the light-receiving unit coincides with the direction in which the input action is performed.

2. a sensor that detects an object at a detection point in space in a non-contact manner; an input detection unit that detects an input by a user in response to detection of the object by the sensor, a display device that displays in space an image for the user to recognize an input action for performing the input; the sensor detects an object in an area that is a predetermined first distance away from a position where the image is formed in a direction in which the user's input action for the input is performed, in a direction opposite to the direction in which the input action is performed; The input device, characterized in that the input detection unit detects the input when the sensor detects the object at the same detection point a plurality of times within a predetermined third period.

3. 3. The input device according to claim 1, wherein the image is displayed three-dimensionally in accordance with the position of the detection point.

Citation Information

Patent Citations

  • Information processing apparatus, information processing system, information processing method, and information processing program

    JP2014067164A

  • Method for operating computer and computer

    JP2015176270A

  • Gesture input device

    JP2015184841A

  • Input device

    JP2016021229A

  • Optical device and operation input device

    JP2016130832A