Input device and input system

Abstract

To improve detection accuracy by facilitating focusing regardless of a linear distance to a detection object.SOLUTION: An input device 100 comprises a detection unit 110 which detects a position of an object by using light and a reflection unit 120 which reflects the light on a detection path being a path of the light used by the detection unit 110. An operation area in which the object is detected by the detection unit 110 to acquire an operation by a user is provided within a depth of field of the detection unit 110, and the reflection unit 120 is disposed so that the linear distance from the detection unit 110 to the operation area is shorter than an optical path length of the light from the detection unit 110 to the operation area.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an input device and an input system. [Background technology]

[0002] There is known an input device (user interface device) that detects a gesture, which is a three-dimensional movement of a user's fingers or hand, and enables an operation input to a computer, etc., by the gesture. For example, Patent Document 1 discloses an input operation detection device that can suppress an increase in detection error of an input operation performed by a user. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2015-212927 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the input operation detection device disclosed in Patent Document 1, the installation angle of the distance measuring unit 13 is set so that the position where the optical axis of the distance measuring unit 13 intersects with the projected image in the Z-axis direction (the direction perpendicular to the mounting surface on which the device is placed) is on the same side of the center of the projected image as the position of the distance measuring unit 13. This makes it possible to prevent the angle of view of the imaging optical system from becoming larger than necessary, and as a result, makes it possible to prevent detection errors from becoming larger. However, in the conventional technology disclosed in Patent Document 1, when the linear distance from the distance measuring unit 13 to the detection target is short, it becomes difficult to focus, resulting in poor detection accuracy.

[0005] The present invention has been made in consideration of the above-mentioned situation, and aims to provide an input device and input system that can improve detection accuracy by making it easier to focus regardless of the straight-line distance to the detection target. [Means for solving the problem]

[0006] In order to achieve the above object, one aspect of the input device according to the present invention is to A detection unit that detects the position of an object using light; a reflecting unit that reflects the light on a detection path that is a path of the light used by the detecting unit; Equipped with an operation area in which the detection unit detects the target and acquires a user's operation is provided within a depth of field of the detection unit; The reflecting portion is disposed so that a linear distance from the detecting portion to the operation area is shorter than an optical path length of the light from the detecting portion to the operation area. Effect of the Invention

[0007] According to the present invention, it is possible to improve detection accuracy by making it easier to achieve focus regardless of the linear distance to the detection target. [Brief description of the drawings]

[0008] [Figure 1] FIG. 2 is a diagram illustrating an example of a functional configuration of the input system according to the first embodiment. [Diagram 2] FIG. 2 is a side view of the input system according to the first embodiment. [Diagram 3] FIG. 2 is a diagram showing an example of installation of the input system according to the first embodiment. [Figure 4] FIG. 1 is a diagram for explaining depth of field. [Diagram 5] 11 is a diagram comparing how the detection size changes when the subject distance is long and when the focal length is short. FIG. [Figure 6] 1A is a side view of an example of an input system including three reflecting sections according to a modification of embodiment 1. FIG. 1B is a side view of an example of an input system including two reflecting sections according to a modification of embodiment 1. [Figure 7] FIG. 11 is a diagram illustrating an example of a functional configuration of an input system according to a second embodiment. [Figure 8] 11 is a diagram showing an example of the structure of a drive unit according to the second embodiment. FIG. [Figure 9] 13 is a side view of the input system according to the second embodiment when a drive unit is moved back and forth. FIG. [Figure 10] FIG. 11 is a diagram illustrating an example of a functional configuration of an input system according to a third embodiment. [Figure 11] FIG. 11 is a diagram showing an example of installation of an input system according to a third embodiment. [Figure 12] FIG. 11 is a side view of the input system according to the third embodiment. [Figure 13] FIG. 13 is a diagram showing an example of installation of an input system according to a fourth embodiment. [Figure 14] 13 is an example of a flowchart of a guide control process according to the fourth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] An input system according to an embodiment will be described with reference to the drawings. In the drawings, the same or corresponding parts are given the same reference numerals.

[0010] (Embodiment 1) The input system 1000 according to the first embodiment includes an input device 100, a projection device 200, and a control device 300, as shown in FIG.

[0011] The input device 100 acquires an operation input (for example, a finger movement) by a user's gesture, and includes a detection unit 110 and a reflection unit 120 as a functional configuration.

[0012] The detection unit 110 includes a TOF (Time Of Flight) sensor, and can measure the distance to an object, detect the three-dimensional shape of the object, and obtain the coordinates (x, y, z) of the three-dimensional position of the object by using LiDAR (Light Detection and Ranging) technology. There are two types of LiDAR: dToF (direct Time of Flight) and iToF (indirect Time of Flight). In this embodiment, the iToF method using infrared light is used.

[0013] The dToF method is a method that calculates distance by irradiating light from a laser (LASER: Light Amplification by Stimulated Emission of Radiation) or LED (Light Emitting Diode) and measuring the time it takes for the light to reflect off the target and return, making it suitable for outdoor use and long distances.The iToF method is a method that calculates distance by irradiating light whose intensity changes periodically (such as a sine wave) and measuring the phase shift when the light returns, making it possible to obtain high-precision, high-quality 3D data over short distances.

[0014] The reflecting unit 120 is a mirror that reflects only the infrared light used for detection by the detecting unit 110, and bends the path (detection path) of the infrared light of the iToF. The mirror that reflects only the infrared light can be realized by a dichroic mirror or a DOE (Diffractive Optical Elements).

[0015] 2, the detection unit 110 of the input device 100 is placed on the projection device 200. The reflection unit 120 is inclined at 45 degrees from the direction from the detection unit 110 toward the screen 400, that is, at 45 degrees from a reference plane 250 (a plane on which the detection unit 110 and the projection device 200 are placed), and is placed at a distance s from the detection unit 110. More precisely, the distance s is the distance from the intersection x of the optical axis 115 of the infrared light output by the detection unit 110 and the reflection unit 120 to the infrared emitting end of the detection unit 110.

[0016] Then, the infrared light for detection irradiated from the detection unit 110 is reflected by the reflection unit 120 and travels upward, is reflected by the detection object and travels in the opposite direction, is reflected by the reflection unit 120 again, and returns to the detection unit 110. Therefore, the detection unit 110 can detect the three-dimensional position of the object (user's finger 600) present within the detection range 500 (a pyramid bent by the reflection unit 120) represented by the dotted line in Figures 2 and 3.

[0017] The projection device 200 is a projector, and includes an image input unit that inputs an image to be projected from a control device 300 or the like, and a projection unit that projects the image input by the image input unit. The projection unit includes a light source (such as an LD (Laser Diode)) for projecting an image, a lens, a DMD (Digital Mirror Device), and the like. Then, the projection device 200 projects the image provided by the control device 300 onto a screen, which is a projection target. For example, in this embodiment, as shown in Fig. 3, the projection device 200 projects button icons 401 from circle 1 to circle 9 and a cursor icon 410 onto a screen 400 (projection target).

[0018] The control device 300 is a PC (Personal Computer) and controls the entire input system 1000. The control device 300 includes a control unit 310, a storage unit 320, and an interface unit 330.

[0019] The control unit 310 is composed of a processor such as a CPU (Central Processing Unit). The control unit 310 executes processes for implementing various functions of the input system 1000 by using a program stored in the storage unit 320. The control unit 310 also supports multi-threading and can execute multiple processes in parallel.

[0020] The storage unit 320 stores programs executed by the control unit 310 and necessary data. The storage unit 320 may include, but is not limited to, a RAM (Random Access Memory), a ROM (Read Only Memory), a flash memory, etc. Note that the storage unit 320 may be provided inside the control unit 310.

[0021] The data of the positions (three-dimensional coordinates) of the operation area 501, the operation reference plane 502, etc. described later are stored in the storage unit 320 in advance, but when the input system 1000 is installed, a process of setting these coordinates (operation coordinate setting process) may be performed. Specifically, a calibration screen is projected by the projection device 200, and the user is asked to perform a gesture operation. Based on the position (three-dimensional coordinates) of the finger 600 detected by the input device 100 at that time, the position of the operation reference plane 502 (three-dimensional coordinates of each of the four vertices of the rectangle forming the operation reference plane 502) is set, and the position of the operation area 501 (three-dimensional coordinates of each of the eight vertices of the rectangle forming the operation area 501) is set as an area of ​​a solid (a rectangular parallelepiped in this embodiment) including the operation reference plane 502.

[0022] The interface unit 330 includes connection terminals such as a Universal Serial Bus (USB) and a High-Definition Multimedia Interface (HDMI), and is connected to other devices such as the input device 100 and the projection device 200 to transmit data to the connected devices. In this embodiment, the input device 100 and the projection device 200 are connected to the interface unit 330, and the control unit 310 can obtain a user's operation input from the input device 100 and project an operation screen or the like using the projection device 200 via the interface unit 330. In addition, the interface unit 330 can also be connected to other input devices (keyboard, mouse, etc.) and other output devices (display, etc.).

[0023] In this embodiment, as shown in FIG. 3, the projection device 200 projects a screen on which button icons 401 represented by circled numbers are arranged as a screen to be operated by the user onto the screen 400. Then, the control unit 310 controls the projection device 200 so that, when the user's finger 600 is detected in the operation area 501 within the detection range 500 of the detection unit 110, the projection device 200 projects a cursor icon 410 at a position on the screen 400 corresponding to the position of the detected finger 600. In other words, the projection device 200 only projects an image given by the control device 300, but the control unit 310 creates an image in which the cursor icon 410 is superimposed on the image in which the button icons 401 are arranged according to the position of the finger 600, and transfers the image to the projection device 200, whereby an image as shown in FIG. 3 is projected onto the screen 400. This image is an image for the user to operate, and can therefore be called an image for operation.

[0024] As shown in FIG. 3, an operation reference plane 502 represented by a dashed-dotted rectangle exists virtually within the operation area 501, and when the detection unit 110 detects that the user's finger 600 has moved from the near side of the operation reference plane 502 (the opposite side of the screen 400 across the operation reference plane 502, i.e., the side closer to the user than the operation reference plane 502) to the far side (the screen 400 side across the operation reference plane 502), the control unit 310 determines that the button with the circled number located at the position corresponding to the position of the finger 600 has been pressed. In this way, the operation acquired by the input device 100 is an operation by the user on the image projected onto the screen 400 by the projection device 200. The operation area 501 indicates a range in which the detection unit 110 detects the detection target (finger 600) and acquires the user's operation, and is located in the air as shown in FIG. 3. The operation reference plane 502 indicates a surface that serves as a reference when the user inputs an operation in the operation area 501.

[0025] 3, the operation reference surface 502 is a rectangle with a length of h and a width of w, and the operation area 501 is a rectangular parallelepiped with a height of h, a width of w, and a depth of t. For example, the rectangular operation reference surface 502 is set as the back surface, and when the rectangle is translated forward by a predetermined thickness (for example, 5 cm), the rectangular parallelepiped through which the rectangle passes becomes the operation area 501. However, the back surface of the operation area 501 and the operation reference surface 502 do not necessarily need to coincide. For example, the cross section of the rectangular parallelepiped of the operation area 501 cut by any plane parallel to the screen 400 may be set as the operation reference surface 502.

[0026] Since the user moves the finger 600 within the operation area 501 to perform the operation, it is desirable that the operation area 501 be present within a range where the user can comfortably extend his / her arm. In order to consider the ease of operation for the user, the distance from the detection unit 110 to the operation area 501 is defined as the straight-line distance from the detection unit 110 to the center c of the operation area 501 (distance k shown in FIG. 2). In addition, the height of the operation area 501 is defined as the distance from the floor surface 260 (in this embodiment, the floor surface 260 is located at a position lower than the reference surface 250 by a predetermined distance (for example, 60 cm)) to the center c of the operation area 501 (distance v shown in FIG. 2). In addition, the distance from the reflection unit 120 to the operation area 501 is defined as the distance from the intersection point x between the optical axis 115 of the infrared light output by the detection unit 110 and the reflection unit 120 to the center c of the operation area 501 (distance u shown in FIG. 2).

[0027] Since it is assumed that the user will usually perform operations near the projection device 200 (and the detection unit 110 installed thereon), it is desirable that the distance k, which is the linear distance from the detection unit 110 to the operation area 501, is a predetermined distance (for example, 60 cm or less) that is equal to or less than the length of the user's arm. In other words, if the distance from the detection unit 110 is equal to or less than the predetermined distance, the operation area 501 is within a range where the user can operate it.

[0028] Also, it is desirable that the distance v, which is the height of the operation area 501, is a predetermined height in the range from the height of the user's elbow to the height of the face (for example, 80 cm to 160 cm). In other words, if the height of the operation area 501 is a predetermined height, the operation area 501 will be within a range that the user can operate.

[0029] 2, due to the presence of the reflecting unit 120, the optical path length of the infrared light used by the detecting unit 110 (here, the length of the path of the infrared light from the infrared light emitting end of the detecting unit 110 to the center c of the operation area 501) is the distance s + the distance u. This optical path length is longer by the distance s from the detecting unit 110 to the reflecting unit 120 compared to a case where the reflecting unit 120 is not present and the detecting unit 110 emits infrared light in the upward direction (in this case, the optical path length is the distance u). As described above, the reflecting unit 120 reflects only the infrared light used by the detecting unit 110, and does not reflect the image projected by the projecting unit. In other words, the image projected by the projecting device 200 onto the screen 400 is not affected by the reflecting unit 120.

[0030] 2, the depth t of the operation area 501 is, for example, 5 cm. The distance e between the surface of the operation area 501 closest to the screen 400 and the operation reference surface 502 is arbitrary, but is, for example, 1 cm. Neither the operation area 501 nor the operation reference surface 502 is visible to the user, but as described above, when the finger 600 is placed in the operation area 501, the cursor icon 410 is projected at a position corresponding to the position of the finger 600, so that the user can recognize the operation area 501 based on the movement and position of the icon 410.

[0031] In addition, since the height and eye position differ for each user, the direction of the line of sight when viewing the screen 400 also differs. As a result, if there is a large difference between the line of sight when viewing the screen 400 and the direction of the operation area 501, some users may feel uncomfortable when moving the finger 600 in the operation area 501 to press the button icon 401 on the screen 400. Therefore, a user who uses the input system 1000 for the first time may be able to perform calibration so that the difference between the movement of the finger 600 in the operation area 501 and the movement of the cursor icon 410 on the screen 400 is as small as possible. Specifically, the user is asked to press each circled number button with the finger 600 in the operation area 501, and the control unit 310 adjusts the projection screen so that each circled number icon 401 is projected at a position on the screen 400 corresponding to the detected position of the finger 600 detected at that time.

[0032] Next, the relationship between the subject distance and the depth of field will be described with reference to Fig. 4. The TOF sensor of the detection unit 110 includes a light projecting unit that emits infrared light and a light receiving unit that receives the infrared light reflected and returned by the object, and the light receiving unit focuses the returned infrared light on the sensor surface using a lens 111.

[0033] The image plane distance (distance from the lens to the sensor plane) at which the image is in focus on the sensor plane is determined by the subject distance (distance from the lens to the object plane to be detected) a and the focal length f of the lens. However, it is not actually necessary to focus precisely on the sensor plane (focused at one point on the sensor plane), and if the size (focused light size) of the infrared light focused by the lens 111 on the sensor plane is within the resolution (pixel size) of the sensor plane, it will actually appear to be in focus. The maximum focused light size at which the image appears to be in focus is called the permissible circle of confusion d, and the range of subject distances at which the focused light size is within the permissible circle of confusion d is called the depth of field.

[0034] As shown in FIG. 4, the depth of field is the sum of the front depth of field and the rear depth of field, which can be expressed by the following equations (1) and (2). Front depth of field = dFa 2 / (f 2 +dFa) …(1) Back depth of field=dFa 2 / (f 2 -dFa) …(2) In the above equations (1) and (2), d is the diameter of the permissible circle of confusion, a is the subject distance, f is the focal length of the lens 111, and F is the F-number (the focal length f of the lens 111 divided by the lens diameter D, i.e., f / D).

[0035] When the same detection unit 110 is used, d, f, and F are the same in the above formulas (1) and (2). However, in this embodiment, the object distance a can be increased by the reflecting unit 120. In addition, both formulas (1) and (2) have a in the denominator and a in the numerator. 2Therefore, as the subject distance a increases, both the front depth of field and the rear depth of field increase, and it can be seen that the depth of field increases.

[0036] For example, when using a detection unit 110 with a sensor pixel size (= diameter d of permissible circle of confusion) of 0.0056 mm, a lens F-number of 2, and a focal length f of 5 mm, we will calculate some specific examples of how the depth of field changes depending on the subject distance a. Note that the following calculation results are based on three significant digits.

[0037] If the subject distance a is 600 mm, Depth of field = Front depth of field + Back depth of field = 0.0056×2×600 2 / (5 2 +0.0056×2×600)+0.0056×2×600 2 / (5 2 -0.0056 x 2 x 600) = 348 mm It becomes.

[0038] If the subject distance a is 900 mm, Depth of field = Front depth of field + Back depth of field = 0.0056×2×900 2 / (5 2 +0.0056×2×900)+0.0056×2×900 2 / (5 2 -0.0056×2×900)=867mm It becomes.

[0039] In the above example, by increasing the subject distance by 300 mm, the depth of field can be more than doubled. For example, if a height of about 600 mm is appropriate as the height of operation area 501 when reflector 120 does not exist, by installing reflector 120 at a position 300 mm away from detector 110 (i.e., by setting distance s=300 mm in FIG. 2), the distance of the detection path from detector 110 to operation area 501 can be set to about 900 mm, and the depth of field can be more than doubled compared to the case when reflector 120 does not exist.

[0040] Since the position of the finger 600 in the operation area 501 needs to be accurately detected, the entire operation area 501 needs to be included in the depth of field. In the above example, if there is no reflecting unit 120, the length h in the height direction of the operation area 501 needs to be kept at 348 mm or less, but by providing the reflecting unit 120, it is possible to expand h to 867 mm. In other words, even if the distance (straight-line distance) from the detection unit 110 to the operation area 501 is short (i.e., if it is a distance at which it is difficult to focus), the depth of field can be increased by providing the reflecting unit 120. As a result, regardless of the straight-line distance from the detection unit 110 to the operation area 501, it becomes easier to focus on the sensor surface of the detection unit 110, and the detection accuracy can be improved.

[0041] In this embodiment, the reflecting unit 120 is installed by adjusting the distance s from the detecting unit 110 to the reflecting unit 120 so that the operation area 501 for acquiring the user's operation is provided within the depth of field of the detecting unit 110. At that time, the distance s is adjusted so that the operation area 501 is present within a range where the user can operate.

[0042] In this embodiment, as described above, the infrared light emitted from detection unit 110 is reflected by reflection unit 120 having a 45-degree inclination, and therefore the distance and image orientation detected by detection unit 110 are rotated by 90 degrees compared to when reflection unit 120 is not present. Therefore, control unit 310 acquires the position of the detection target (such as user's finger 600) within detection range 500, taking into consideration that the distance and image orientation detected by detection unit 110 are rotated by 90 degrees.

[0043] Furthermore, looking at the above formulas (1) and (2), the focal length f of the lens 111 exists only in the denominator. Therefore, it is possible to increase the depth of field by reducing the focal length f of the lens 111. However, in this case, although the depth of field can be increased, it is not possible to increase the detection range in the horizontal direction, as will be explained with reference to FIG. 5.

[0044] First, the detection unit 110 and the reflection unit 120 with the above-mentioned specifications are used, and the object distance a a is 900 mm, the depth of field is 867 mm as calculated above. Figure 5 shows that the height h of operation area 501a that falls within detection range 500a of this detection unit 110 becomes the vertical detection size, which is the depth of field and is therefore 867 mm. Also, the width w of operation area 501a becomes the horizontal detection size, which is the value obtained by multiplying the sensor size by the magnification at the near point distance.

[0045] So then, Magnification at near point distance = near point distance ÷ focal length f-1 = (900-0.0056×2×900 2 / (5 2 +0.0056×2×900))÷5-1=127 So, if the sensor size is 3.6 mm, Horizontal detection size = 3.6 mm x 127 = 458 mm It becomes.

[0046] Next, a lens having a focal length f of 3.6 mm, which is smaller than the focal length f of the lens 111 described above, was used as the lens 111 of the detection unit 110, and the reflection unit 120 was not used, and the object distance a b The vertical detection size and horizontal detection size are calculated when the distance from the sensor to the sensor is set to 600 m. In Fig. 5, the height h of the operation area 501b that falls within the detection range 500b of the detection unit 110 is the vertical detection size, which is the depth of field as described above. The width w of the operation area 501b is the horizontal detection size, which is the value obtained by multiplying the sensor size by the magnification at the near point distance as described above.

[0047] First, in this case, the depth of field is as follows: Depth of field = Front depth of field + Back depth of field = 0.0056×2×600 2 / (3.6 2 +0.0056×2×600)+0.0056×2×600 2 / (3.6 2 -0.0056 x 2 x 600) = 851 mm In other words, it is understood that even without providing the reflecting portion 120, by reducing the focal length f, the vertical detection size can be set to 851 mm, which is close to the value (867 mm) in the above-described embodiment.

[0048] However, if the sensor size is 3.6 mm as above, the horizontal detection size is as follows: Magnification at near point distance = near point distance ÷ focal length f-1 = (600-0.0056×2×600 2 / (3.6 2 +0.0056×2×600))÷3.6-1=109 Therefore, Horizontal detection size = 3.6 mm x 109 = 392 mm This is a value that is approximately 15% smaller than the value (458 mm) in the above-described embodiment.

[0049] Therefore, when lens 111 with a short focal length is used instead of installing reflector 120, the vertical detection size is not a problem, but the horizontal detection size is smaller (about 15% in the above example) than when installing reflector 120. In other words, if you want to make operation area 501 as wide as possible, it is more effective to install reflector 120 than to use lens 111 with a short focal length.

[0050] As described above, in this embodiment, the presence of the reflecting unit 120 makes it possible to lengthen the optical path length of the infrared light used by the detection unit 110 and increase the depth of field. As a result, it becomes easier to focus on the sensor surface of the detection unit 110 regardless of the linear distance to the detection target (linear distance from the detection unit 110 to the operation area 501), and it is possible to improve the detection accuracy. In addition, in this embodiment, the presence of the reflecting unit 120 makes the linear distance k from the detection unit 110 to the operation area 501 shorter than the optical path length (distance s + distance u) of the infrared light used by the detection unit 110, as shown in FIG. 2. Therefore, the operation area 501 can be set closer to the user by this shortened amount, making it easier for the user to operate it.

[0051] (Modification of the first embodiment) In the above-mentioned first embodiment, the input device 100 has been described as including only one reflecting unit 120, but the input device 100 may include a plurality of reflecting units 120. For example, as shown in FIG. 6(a), the input device 100 may include three reflecting units 120. By reflecting the light irradiated from the detection unit 110 a plurality of times by the plurality of reflecting units 120, it is possible to increase the depth of field compared to the first embodiment described with reference to FIG. 2, with almost no effect on the position of the operation area 501.

[0052] 6(b), the input device 100 may include a reflecting unit 120a and a reflecting unit 120b, and the reflecting unit 120a may be installed so as to return the infrared light from the detection unit 110 in an almost opposite direction, and the infrared light from the reflecting unit 120a may be reflected upward by the reflecting unit 120b installed above the detection unit 110. In this way, the user can bring the finger 600 to the operation area 501 without moving away from the projection device 200. In addition, by installing in this way, the detection distance from the detection unit 110 to the operation area 501 can be extended by almost twice the distance between the detection unit 110 and the reflecting unit 120 compared to when the reflecting unit 120 is not used, and the depth of field can be increased without affecting the installation space or the position of the operation area 501.

[0053] (Embodiment 2) 2, in the above-described embodiment 1, when the distance (subject distance) from detection unit 110 to operation area 501 is constant, it can be seen that the position of operation area 501 can be changed by changing distance s between detection unit 110 and reflection unit 120. Therefore, embodiment 2 including drive unit 130 capable of moving reflection unit 120 back and forth will be described.

[0054] An input system 1001 according to the second embodiment differs from the input system 1000 according to the first embodiment in that the input device 100 is replaced with an input device 101. In other respects, the input system 1001 is similar to the input system 1000.

[0055] The input device 101 differs from the input device 100 in that it further includes a drive unit 130, as shown in Fig. 7. In other respects, the input device 101 is similar to the input device 100.

[0056] As shown in Fig. 8, the driving unit 130 includes a base 131 that supports the reflecting unit 120, a nut 132 fixed to the base 131, a screw shaft 133 that penetrates the nut 132, a motor 134 that rotates the screw shaft 133 to move the nut 132, and a ball screw mechanism including a plurality of small balls (not shown, but present between the nut 132 and the screw shaft 133) for reducing friction between the screw shaft 133 and the nut 132, and moves the reflecting unit 120 back and forth (assuming that the direction from the input device 101 toward the screen 400 is the front). The control unit 310 controls in which direction and how far the reflecting unit 120 is moved. However, the input device 101 itself may include a control unit (not shown) that sets the moving direction and amount of the driving unit 130 to move the reflecting unit 120.

[0057] 9, in this embodiment, the infrared light used by the detection unit 110 is emitted from the input device 101 toward the screen 400, so that the drive unit 130 moves the reflection unit 120 back and forth along the emission direction of the infrared light. In other words, the control unit 310 controls the drive unit 130 to move the base 131, so that the reflection unit 120 moves back and forth along the emission direction of the infrared light, and the position of the operation area 501 moves accordingly.

[0058] The position to which the driver 130 moves the reflector 120 can be set for each user. Specifically, the user indicates the height range of the operation area 501 with the finger 600, and the controller 310 controls the driver 130 to adjust the distance s from the detector 110 to the reflector 120 so that the entire range is within the depth of field of the detector 110.

[0059] 9, initially, the reflecting unit 120c is placed at a position where the distance s on the base 131c of the driving unit 130 is s1, but when the driving unit 130 moves the base 131c to the base 131d, the reflecting unit 120c moves to the reflecting unit 120d, and the distance s from the detecting unit 110 to the reflecting unit 120 becomes s2. As a result, the detection range 500c also moves to the detection range 500d, and accordingly, the operation area 501c moves to the operation area 501d.

[0060] Therefore, in the second embodiment, by adjusting the distance s in this manner, the control unit 310 can control the driving unit 130 so that the operation area 501 is within a range that the user's finger 600 can easily reach (i.e., a range in which the user's operation can be acquired) and is located within the depth of field of the detection unit 110. Specifically, a short user can perform a gesture operation after moving the reflector 120 forward (for example, to the position of the reflector 120c) so as to be able to operate within the operation area 501c, and a tall user can perform a gesture operation after moving the reflector 120 backward (for example, to the position of the reflector 120d) so as to be able to operate within the operation area 501d.

[0061] In this way, a short user can press with finger 600c on operation reference surface 502c in operation area 501c, which is located at a relatively low position, and a tall user can press with finger 600d on scanning reference surface 502d in operation area 501d, which is located at a relatively high position.

[0062] In input system 1001 according to the second embodiment, the position of operation area 501 can be changed in this way, making it easier for the user to operate. Even if the position is changed, operation area 501 is provided within the depth of field of detection unit 110, so that the detection accuracy can be improved.

[0063] (Embodiment 3) In the above-described embodiment, since the positions of the operation area 501 and the operation reference plane 502 are invisible, it may be difficult for the user to know where to perform the gesture operation. Therefore, a third embodiment will be described, which enables the user to easily recognize the operation area 501.

[0064] 10, an input system 1002 according to the third embodiment differs from the input system 1000 according to the first embodiment in that the input device 100 is replaced with an input device 102. In other respects, the input system 1002 is similar to the input system 1000.

[0065] Input device 102 differs from input device 100 in that it further includes screen output unit 140, as shown in Fig. 10. In other respects, input device 102 is similar to input device 100.

[0066] The curtain output unit 140 includes, for example, an LD (Laser Diode) that emits visible light, and a DOE (Diffractive Optical Element) that irradiates the incident light in a line shape. Instead of the DOE, the curtain output unit 140 may include a lens that irradiates the incident light in a line shape, such as a Powell lens or a Reinman lens. For example, in this embodiment, the curtain output unit 140 irradiates light in a line, and thereby a film-like object (visible light curtain 511) represented by a triangle in FIG. 11 is output.

[0067] As shown in FIG. 12, the curtain output unit 140 outputs the visible light curtain 511 so as to be present in the vicinity of the operation reference surface 502 (more specifically, in the vicinity of the front side of the operation reference surface 502 (the opposite side of the screen 400 across the operation reference surface 502, i.e., the side closer to the user than the operation reference surface 502)). In FIG. 12, the distance b between the visible light curtain 511 and the operation reference surface 502 is 2 cm or less (for example, 1 cm). In other words, the visible light curtain 511 overlaps with the operation reference surface 502 in the projection direction of the projection device 200, and is positioned with a gap between it and the operation reference surface 502. The depth length t of the operation area 501 is, for example, 5 cm. The distance e between the surface of the operation area 501 closest to the screen 400 and the operation reference surface 502 is arbitrary, but is, for example, 1 cm.

[0068] Neither the operation area 501 nor the operation reference plane 502 are visible to the user, but when the finger 600 blocks the visible light curtain 511, the light of the visible light curtain 511 hits the user's finger 600. Therefore, when the light of the visible light curtain 511 hits the finger 600, the user can recognize that the finger 600 is in front of the operation reference plane 502 in the depth direction. If the finger 600 is moved while the light of the visible light curtain 511 hits the finger 600, the cursor icon 410 moves on the screen 400 in accordance with the movement of the finger 600 while the finger 600 is within the operation area 501, so the user can recognize that the operation reference plane 502 is nearby. Therefore, in the input device 102, the curtain output unit 140 outputs the visible light curtain 511, so that the user can easily recognize the operation area 501 and the operation reference plane 502 based on the condition in which the light of the visible light curtain 511 hits the finger 600 and the movement of the cursor icon 410, and can smoothly perform gesture operations with the finger 600.

[0069] (Embodiment 4) A fourth embodiment will be described, in which the color of the visible light curtain is changed depending on the position of the user's finger 600.

[0070] The configuration of input system 1003 according to the fourth embodiment is similar to that of input system 1002 according to the third embodiment, but curtain output unit 140 can change the color of visible light curtain 511 under the control of control unit 310. To this end, input system 1003 includes curtain output unit 140A that outputs red visible light curtain 511A and curtain output unit 140B that outputs blue visible light curtain 511B, as shown in Fig. 13. When user's finger 600 is outside operation area 501 like finger 600A, red visible light curtain 511A is output, and when user's finger 600 is inside operation area 501 like finger 600B, blue visible light curtain 511B is output.

[0071] The guide control process according to the fourth embodiment will be described with reference to Fig. 14. This guide control process is a process for changing the color of the visible light curtain 511 according to the position of the user's finger 600. When the input system 1003 is started, the control unit 310 starts executing the guide control process shown in Fig. 14 following the initialization process of each device.

[0072] First, control unit 310 performs a detection operation in detection unit 110 (step S101), and determines whether or not any object is present within detection range 500 (step S102). If nothing is present within detection range 500 (step S102; No), control unit 310 stops the output of red visible light curtain 511A from curtain output unit 140A and the output of blue visible light curtain 511B from curtain output unit 140B, thereby stopping the output of the visible light curtain from curtain output unit 140 (step S103), and returns to step S101.

[0073] If any object is present within the detection range 500 (step S102; Yes), the control unit 310 determines whether or not the finger 600 is present within the operation area 501 (step S104). Since the detection unit 110 can detect the three-dimensional shape of an object present within the detection range 500, when the user's hand is present within the detection range 500, the control unit 310 can obtain the position (three-dimensional coordinates) of the user's finger 600 based on the data obtained from the detection unit 110. In step S104, the control unit 310 compares the position of the finger 600 with the position of the operation area 501 to determine whether or not the finger 600 is present within the operation area 501.

[0074] If finger 600 is present within operation area 501 (step S104; Yes), control unit 310 stops the output of red visible light curtain 511A from curtain output unit 140A and outputs blue visible light curtain 511B from curtain output unit 140B, thereby changing the color of the visible light curtain output by curtain output unit 140 to blue (step S106), and returns to step S101.

[0075] If finger 600 is not present within operation area 501 (step S104; No), control unit 310 stops output of blue visible light curtain 511B from curtain output unit 140B and outputs red visible light curtain 511A from curtain output unit 140A, thereby changing the color of the visible light curtain output by curtain output unit 140 to red (step S105), and returns to step S101.

[0076] By the above guide control process, the visible light curtain is turned off or changes color depending on the position of the user's finger 600, so that the user can more easily perform gesture operations.

[0077] In the above description, input system 1003 is described as including screen output unit 140A and screen output unit 140B, but input system 1003 does not necessarily have to include multiple screen output units 140. For example, input system 1003 may include one screen output unit 140 that can switch between multiple colors of the visible light curtain and output the visible light curtain, and control unit 310 may switch the color of the visible light curtain in the above-mentioned steps S105 and S106.

[0078] Furthermore, input system 1003 may include curtain output section 140 that cannot switch colors, and may output visible light curtain 511 when finger 600 is present within operation area 501, and may stop outputting visible light curtain 511 in other cases. That is, control section 310 may turn off visible light curtain 511 in the above-mentioned step S105 (as in step S103), and may output visible light curtain 511 in step S106.

[0079] (Modification) In the above embodiment, the detection unit 110 includes a TOF sensor using an iToF method that uses infrared light, and the reflection unit 120 is a mirror that reflects only the infrared light, but the light used for detection by the TOF sensor is not limited to infrared light. As long as the detection unit 110 can be configured so that the reflection unit 120 reflects the light used by the TOF sensor, any light can be used, not just infrared light.

[0080] The above-mentioned embodiments can also be combined. For example, the second and third embodiments may be combined, and the curtain output unit 140 may also be moved by the driving unit 130 so that the position of the visible light curtain 511 changes in accordance with the position of the reflecting unit 120. In this case, the driving unit 130 that moves the reflecting unit 120 and the driving unit 130 that moves the curtain output unit 140 may each be independent driving units 130.

[0081] In addition, in the above-described third and fourth embodiments, screen output unit 140 outputs a curtain-like object such as visible light curtain 511, but what the screen output unit outputs is not limited to a curtain-like object. For example, any medium, such as a single light beam, that can be passed through by user's finger 600 and that allows the user to recognize that finger 600 has blocked the medium when it is blocked, may be output. In other words, the screen output unit can be considered as a type of medium output unit that outputs such any medium.

[0082] In the above-described fourth embodiment, control unit 310 causes curtain output unit 140 to output a different color of visible light when finger 600 is detected inside operation area 501 and when finger 600 is detected outside operation area 501. However, in this case, the medium output by control unit 310 in the medium output unit is not limited to visible light, and the manner in which the light is changed is not limited to color. For example, control unit 310 may cause the medium output unit to output visible light curtain 511 when finger 600 is detected inside operation area 501, and may cause the medium output unit to output an air curtain by blowing air in a line shape at high speed when finger 600 is detected outside operation area 501.

[0083] In the above embodiment, the input system 1000 includes the input device 100, the projection device 200, and the control device 300, but if the control unit 310 and the storage unit 320 are included in the input device 100 or the projection device 200, the control device 300 may not be included. In that case, the above-mentioned guide control process and the like will be executed by the control unit 310 included in the input device 100 or the projection device 200. The same applies to the input systems 1001, 1002, and 1003.

[0084] Furthermore, the PC serving as the control device 300 is not limited to a normal PC, but any computer including the control unit 310, the storage unit 320, and the interface unit 330 may be used, and may be, for example, a one-board microcomputer.

[0085] In the above embodiment, the operation reference surface 502 is a rectangle, and the operation area 501 is a rectangular parallelepiped including the operation reference surface 502, but the operation reference surface 502 is not limited to a rectangle, and the operation area 501 is not limited to a rectangular parallelepiped. The operation area 501 can be set to any shape (for example, a sphere, an egg shape, etc.) as long as the shape is included in the detection range 500. In addition, the operation reference surface 502 may be any cross section of the operation area 501.

[0086] In the above embodiment, the program for the guide control process and the like executed by the control unit 310 has been described as being stored in advance in the storage unit 320. However, the program may be stored in a non-transitory computer-readable recording medium such as a flexible disk, a CD-ROM (Compact Disc Read Only Memory), a DVD (Digital Versatile Disc), an MO (Magneto-Optical disc), a memory card, a USB memory, or the like, and distributed, and the program may be read and installed in a computer to configure a computer capable of executing each of the above-mentioned processes.

[0087] Furthermore, the program may be superimposed on a carrier wave and applied via a communication medium such as the Internet. For example, the program may be distributed by posting it on a bulletin board system (BBS) on a communication network. The program may then be started and executed under the control of an OS (Operating System) in the same manner as other application programs, thereby enabling the above-mentioned processes to be performed.

[0088] In addition, the control unit 310 may be configured by any processor alone, such as a single processor, a multiprocessor, or a multi-core processor, or may be configured by combining any of these processors with a processing circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field-Programmable Gate Array).

[0089] Although the above describes a preferred embodiment of the present invention, the present invention is not limited to the specific embodiment, and the present invention includes the invention described in the claims and its equivalents. [Explanation of symbols]

[0090] 100, 101, 102...input device, 110...detection unit, 111...lens, 115...optical axis, 120, 120a, 120b, 120c, 120d...reflection unit, 130...drive unit, 131, 131c, 131d...base, 132...nut, 133...screw shaft, 134...motor, 140, 140A, 140B...curtain output unit, 200...projection device, 250...reference surface, 260...floor surface, 300...control device 310: control unit; 320: storage unit; 330: interface unit; 400: screen; 401, 410: icons; 500, 500a, 500b, 500c, 500d: detection range; 501, 501a, 501b, 501c, 501d: operation area; 502: operation reference surface; 511: visible light curtain; 600: finger; 1000, 1001, 1002, 1003: input system

Claims

1. A detection unit that detects the position of an object using light; a reflecting unit that reflects the light on a detection path that is a path of the light used by the detecting unit; Equipped with an operation area in which the detection unit detects the target and acquires a user's operation is provided within a depth of field of the detection unit; The reflecting unit is disposed so that a linear distance from the detecting unit to the operation area is shorter than an optical path length of the light from the detecting unit to the operation area. Input device.

2. the operation area exists within a range in which a straight-line distance from the detection unit to the operation area is equal to or shorter than a predetermined distance; The input device according to claim 1 .

3. Further, a driving unit is provided which moves the reflecting unit back and forth along the emission direction of the light. The input device according to claim 2 .

4. a medium output unit that outputs a medium through which the object can pass in the operation area and that allows the user to recognize that the object has blocked the medium when the object blocks the medium, the medium output unit outputs the medium in the vicinity of an operation reference plane that is a plane that serves as a reference when the user performs an operation input in the operation area. The input device according to claim 1 .

5. The medium output unit irradiates visible light in a line shape as the medium.

5. The input device according to claim 4.

6. The medium output unit includes: when the detection unit cannot detect the target, the medium is not output, and when the detection unit can detect the target, the color of the output visible light is made different depending on whether the target is detected inside the operation area or outside the operation area.

6. The input device according to claim 5.

7. A detection unit that detects the position of a detection target using light; a reflecting unit that reflects the light on a detection path that is a path of the light used by the detecting unit; A projection unit that projects an image; Equipped with an operation area in which the detection unit detects the target and acquires a user's operation is provided within a depth of field of the detection unit; the reflecting unit is disposed so that a linear distance from the detecting unit to the operation area is shorter than an optical path length of the light from the detecting unit to the operation area, The reflection unit does not reflect the image projected by the projection unit. Input system.

Images