Input device, input system, input control method, and program

Abstract

To allow for smooth operation by enabling a user to easily recognize an operation area.SOLUTION: An input device 100 comprises a medium output unit for outputting a medium, which allows an object to pass therethrough and can recognize that the medium is blocked by a user when the object blocks the medium, to an operation area in which the object is detected by a detection unit 110 for detecting a position of the object to acquire the user's operation. The medium output unit outputs the medium to the vicinity of an operation reference plane which is a plane being a reference for operation input by the user in the operation area.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an input device, an input system, an input control method, and a program. [Background technology]

[0002] There is known an input device (user interface device) that detects gestures, which are three-dimensional movements of a user's fingers or hands, and enables operation input to a computer, etc., by the gestures. For example, Patent Document 1 discloses an image projection device that can improve the responsiveness (operability) and ease of use of operations by gestures. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2015-125670 A Summary of the Invention [Problem to be solved by the invention]

[0004] The image projection device disclosed in Patent Document 1 prevents erroneous detection of a gesture by, for example, stopping the gesture operation when a hand gesture in a direction different from the gesture for operating a displayed image is detected. However, the conventional technology disclosed in Patent Document 1 has a problem in that a user cannot know the extent of the operation area in which the gesture can be detected unless the user actually performs the gesture operation.

[0005] The present invention has been made in consideration of the above-mentioned situation, and aims to provide an input device, an input system, an input control method, and a program that enable smooth operation by allowing a user to easily recognize the operation area. [Means for solving the problem]

[0006] In order to achieve the above object, one aspect of the input device according to the present invention is to a medium output unit that outputs a medium through which the object can pass, in an operation area in which a detection unit detects the position of the object to acquire a user's operation, and that outputs a medium that allows the user to recognize that the object has blocked the medium when the object blocks the medium, The medium output unit outputs the medium in the vicinity of an operation reference plane that is a plane that serves as a reference when the user performs an operation input in the operation area. Effect of the Invention

[0007] According to the present invention, a user can easily recognize an operation area, thereby enabling smooth operation. [Brief description of the drawings]

[0008] [Figure 1] FIG. 2 is a diagram illustrating an example of a functional configuration of the input system according to the first embodiment. [Diagram 2] FIG. 2 is a diagram showing an example of installation of the input system according to the first embodiment. [Diagram 3] FIG. 2 is a side view of the input system according to the first embodiment. [Figure 4] FIG. 11 is a diagram showing an example of installation of an input system according to a second embodiment. [Diagram 5] FIG. 11 is a rear view of the input system according to the second embodiment. [Figure 6] FIG. 11 is a diagram showing an example of installation of an input system according to a third embodiment. [Figure 7] FIG. 13 is a diagram showing an example of installation of an input system according to a fourth embodiment. [Figure 8] 13 is an example of a flowchart of a guide control process according to the fourth embodiment. [Figure 9] 13 is an example of a flowchart of a guide control process according to the fifth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] An input system according to an embodiment will be described with reference to the drawings. In the drawings, the same or corresponding parts are given the same reference numerals.

[0010] (Embodiment 1) The input system 1000 according to the first embodiment includes an input device 100, a projection device 200, and a control device 300, as shown in FIG.

[0011] The input device 100 acquires an operation input (for example, a finger movement) by a user's gesture, and includes a detection unit 110 and a screen output unit 120 as a functional configuration.

[0012] The detection unit 110 includes a TOF (Time Of Flight) sensor, and can measure the distance to an object, detect the three-dimensional shape of the object, and obtain the coordinates (x, y, z) of the three-dimensional position of the object by using LiDAR (Light Detection and Ranging) technology. LiDAR is broadly divided into two types, dToF (direct Time of Flight) and iToF (indirect Time of Flight), and the iToF method is used in this embodiment.

[0013] The dToF method is a method of irradiating light such as a laser (Light Amplification by Stimulated Emission of Radiation) or an LED (Light Emitting Diode) and measuring the time it takes for the light to reflect off an object and return to calculate the distance, and is suitable for outdoor and long distance use. The iToF method is a method of irradiating light (e.g., sine wave, etc.) whose intensity changes periodically and measuring the phase shift when the light returns to calculate the distance, and can obtain high-precision, high-quality three-dimensional data at close ranges. For example, in this embodiment, the detection unit 110 can detect the three-dimensional position of an object (user's finger 600) present within a detection range 500 represented by a quadrangular pyramid shown by a dotted line in FIG. 2.

[0014] The curtain output unit 120 includes, for example, an LD (Laser Diode) that emits visible light, and a DOE (Diffractive Optical Element) that irradiates the incident light in a line shape. Instead of the DOE, the curtain output unit 120 may include a lens that irradiates the incident light in a line shape, such as a Powell lens or a Reinman lens. For example, in this embodiment, the curtain output unit 120 irradiates light in a line, and thereby a film-like object (visible light curtain 511) represented by a triangle in FIG. 2 is output.

[0015] The projection device 200 is a projector, and includes an image input unit that inputs an image to be projected from a control device 300 or the like, and a projection unit that projects the image input by the image input unit. The projection unit includes a light source (such as an LD) for projecting an image, a lens, a DMD (Digital Mirror Device), and the like. Then, the projection device 200 projects the image provided by the control device 300 onto a screen, which is a projection target. For example, in this embodiment, as shown in Fig. 2, the projection device 200 projects button icons 401 from circle 1 to circle 9 and a cursor icon 410 onto a screen 400 (projection target).

[0016] The control device 300 is a PC (Personal Computer) and controls the entire input system 1000. The control device 300 includes a control unit 310, a storage unit 320, and an interface unit 330.

[0017] The control unit 310 is composed of a processor such as a CPU (Central Processing Unit). The control unit 310 executes processes for implementing various functions of the input system 1000 by using a program stored in the storage unit 320. The control unit 310 also supports multi-threading and can execute multiple processes in parallel.

[0018] The storage unit 320 stores programs executed by the control unit 310 and necessary data. The storage unit 320 may include, but is not limited to, a RAM (Random Access Memory), a ROM (Read Only Memory), a flash memory, etc. Note that the storage unit 320 may be provided inside the control unit 310.

[0019] The data of the positions (three-dimensional coordinates) of the operation area 501, the operation reference plane 502, etc. described later are stored in the storage unit 320 in advance, but when the input system 1000 is installed, a process of setting these coordinates (operation coordinate setting process) may be performed. Specifically, a calibration screen is projected by the projection device 200, and the user is asked to perform a gesture operation. Based on the position (three-dimensional coordinates) of the finger 600 detected by the input device 100 at that time, the position of the operation reference plane 502 (three-dimensional coordinates of each of the four vertices of the rectangle forming the operation reference plane 502) is set, and the position of the operation area 501 (three-dimensional coordinates of each of the eight vertices of the rectangle forming the operation area 501) is set as an area of ​​a solid (a rectangular parallelepiped in this embodiment) including the operation reference plane 502.

[0020] The interface unit 330 includes connection terminals such as a Universal Serial Bus (USB) and a High-Definition Multimedia Interface (HDMI), and is connected to other devices such as the input device 100 and the projection device 200 to transmit data to the connected devices. In this embodiment, the input device 100 and the projection device 200 are connected to the interface unit 330, and the control unit 310 can obtain a user's operation input from the input device 100 and project an operation screen or the like using the projection device 200 via the interface unit 330. In addition, the interface unit 330 can also be connected to other input devices (keyboard, mouse, etc.) and other output devices (display, etc.).

[0021] In this embodiment, as shown in FIG. 2, the projection device 200 projects a screen on which button icons 401 represented by circled numbers are arranged as a screen to be operated by the user onto the screen 400. Then, the control unit 310 controls the projection device 200 so that, when the user's finger 600 is detected in the operation area 501 within the detection range 500 of the detection unit 110, the projection device 200 projects a cursor icon 410 at a position on the screen 400 corresponding to the position of the detected finger 600. In other words, the projection device 200 only projects an image given by the control device 300, but the control unit 310 creates an image in which the cursor icon 410 is superimposed on the image on which the button icons 401 are arranged according to the position of the finger 600, and transfers the image to the projection device 200, whereby an image as shown in FIG. 2 is projected onto the screen 400. This image is an image for the user to operate, and can therefore be called an image for operation.

[0022] As shown in FIG. 2, an operation reference plane 502 represented by a dashed-dotted rectangle exists virtually within the operation area 501, and when the detection unit 110 detects that the user's finger 600 has moved from the near side of the operation reference plane 502 (the opposite side of the screen 400 across the operation reference plane 502, i.e., the side closer to the user than the operation reference plane 502) to the far side (the screen 400 side across the operation reference plane 502), the control unit 310 determines that the button with the circled number located at the position corresponding to the position of the finger 600 has been pressed. In this way, the operation acquired by the input device 100 is an operation by the user on the image projected onto the screen 400 by the projection device 200. The operation area 501 indicates a range in which the detection unit 110 detects the detection target (finger 600) and acquires the user's operation, and is located in the air as shown in FIG. 2. The operation reference plane 502 indicates a surface that serves as a reference when the user inputs an operation in the operation area 501.

[0023] 2, the operation reference surface 502 is a rectangle with a length of h and a width of w, and the operation area 501 is a rectangular parallelepiped with a height of h, a width of w, and a depth of t. For example, the rectangular operation reference surface 502 is set as the back surface, and when the rectangle is translated forward by a predetermined thickness (for example, 5 cm), the rectangular parallelepiped through which the rectangle passes becomes the operation area 501. However, the back surface of the operation area 501 and the operation reference surface 502 do not necessarily need to coincide. For example, the cross section of the rectangular parallelepiped of the operation area 501 cut by any plane parallel to the screen 400 may be set as the operation reference surface 502.

[0024] When the curtain output section 120 irradiates visible light in a line shape toward the vicinity of the operation reference surface 502, a visible light curtain 511 shown in FIGS. 2 and 3 is output.

[0025] As shown in FIG. 3, the curtain output unit 120 outputs the visible light curtain 511 so as to be present in the vicinity of the operation reference surface 502 (more specifically, in the vicinity of the front side of the operation reference surface 502 (the opposite side of the screen 400 across the operation reference surface 502, i.e., the side closer to the user than the operation reference surface 502)). In FIG. 3, the distance b between the visible light curtain 511 and the operation reference surface 502 is 2 cm or less (for example, 1 cm). In other words, the visible light curtain 511 overlaps with the operation reference surface 502 in the projection direction of the projection device 200, and is positioned with a gap between it and the operation reference surface 502. The depth length t of the operation area 501 is, for example, 5 cm. The distance e between the surface of the operation area 501 closest to the screen 400 and the operation reference surface 502 is arbitrary, but is, for example, 1 cm.

[0026] Neither the operation area 501 nor the operation reference plane 502 are visible to the user, but when the finger 600 blocks the visible light curtain 511, the light of the visible light curtain 511 hits the user's finger 600. Therefore, when the light of the visible light curtain 511 hits the finger 600, the user can recognize that the finger 600 is in front of the operation reference plane 502 in the depth direction. If the finger 600 is moved while the light of the visible light curtain 511 hits the finger 600, the cursor icon 410 moves on the screen 400 in accordance with the movement of the finger 600 while the finger 600 is within the operation area 501, so the user can recognize that the operation reference plane 502 is nearby. Therefore, in the input device 100, the curtain output unit 120 outputs the visible light curtain 511, so that the user can easily recognize the operation area 501 and the operation reference plane 502 based on the condition in which the light of the visible light curtain 511 hits the finger 600 and the movement of the cursor icon 410, and can smoothly perform gesture operations with the finger 600.

[0027] Since the height and eye position differ for each user, the direction of the line of sight when viewing the screen 400 also differs. As a result, if there is a large difference between the line of sight when viewing the screen 400 and the direction of the operation area 501, some users may feel uncomfortable when moving the finger 600 in the operation area 501 to press the button icon 401 on the screen 400. Therefore, a user who uses the input system 1000 for the first time may be able to perform calibration so that the difference between the movement of the finger 600 in the operation area 501 and the movement of the cursor icon 410 on the screen 400 is as small as possible. Specifically, the user is asked to press each circled number button with the finger 600 in the operation area 501, and the control unit 310 adjusts the projection screen so that each circled number icon 401 is projected at a position on the screen 400 corresponding to the detected position of the finger 600 detected at that time.

[0028] (Embodiment 2) In the first embodiment, input device 100 includes only one curtain output unit 120, and therefore only one visible light curtain 511 is output in the vicinity of operation reference plane 502. However, if the range of operation area 501 (for example, how far it extends to the left and right) is known, it becomes easier for the user to perform gesture operations. An input system 1001 according to a second embodiment, which allows the range of operation area 501 to be more clearly recognized, will be described.

[0029] An input system 1001 according to the second embodiment differs from the input system 1000 according to the first embodiment in that the input device 100 is replaced with an input device 101. In other respects, the input system 1001 is similar to the input system 1000.

[0030] 4, input device 101 differs from input device 100 in that it further includes screen output unit 120L and screen output unit 120R similar to screen output unit 120. In other respects, input device 101 is similar to input device 100.

[0031] 4 and 5, curtain output unit 120L outputs visible light curtain 512 to the end (left end) on the left side of operation area 501 (left when viewed from input device 101 to screen 400). Curtain output unit 120R outputs visible light curtain 513 to the end (right end) on the right side of operation area 501 (right when viewed from input device 101 to screen 400).

[0032] 5, there appears to be a slight gap between the left edge of operation area 501 and visible light curtain 512 and between the right edge of operation area 501 and visible light curtain 513, but in reality, the left edge of operation area 501 may overlap with visible light curtain 512, or the right edge of operation area 501 may overlap with visible light curtain 513. Conversely, visible light curtain 512 may be present slightly (for example, 1 cm) to the right of the left edge of operation area 501, and visible light curtain 513 may be present slightly (for example, 1 cm) to the left of the right edge of operation area 501. In any case, it is sufficient that visible light curtains 512 and 513 are present near the left and right edges of operation area 501, respectively.

[0033] In the second embodiment, visible light curtains 512, 513 are also output to the left and right of operation area 501, so that when light from visible light curtains 512, 513 hits finger 600, the user can recognize that the vicinity where the light hits is the left end or the right end of operation area 501. Therefore, not only can the user easily recognize that finger 600 is in front of operation reference plane 502 in the depth direction from visible light curtain 511, but also the user can easily recognize the left and right ends of operation area 501 from visible light curtains 512, 513, so that gesture operation with finger 600 can be performed more smoothly.

[0034] Note that the color of visible light curtain 511 output by screen output unit 120 may be different from the colors of visible light curtains 512 and 513 output by screen output units 120L and 120R. Furthermore, the color of visible light curtain 512 output by screen output unit 120L may be different from the color of visible light curtain 513 output by screen output unit 120R. For example, visible light curtain 511 may be blue light, visible light curtain 512 may be yellow light, and visible light curtain 513 may be red light. By making the colors of visible light curtains 511, 512, and 513 different from each other, the user can more easily recognize the relationship between operation area 501 and operation reference plane 502, and the position of finger 600.

[0035] In addition, by adding a curtain output unit that outputs a visible light curtain to the upper end of operation area 501 and a curtain output unit that outputs a visible light curtain to the lower end of operation area 501 to input device 101, the range of operation area 501 may be made even easier to recognize.

[0036] (Embodiment 3) In the above-described embodiment, curtain output unit 120 outputs a visible light curtain as the curtain-like object, but as long as the user can recognize where operation area 501 and operation reference plane 502 are located, what is output by curtain output unit 120 is not limited to a visible light curtain. An input system 1002 according to the third embodiment in which air is blown out in a wall shape as the curtain-like object will be described.

[0037] An input system 1002 according to the third embodiment differs from the input system 1000 according to the first embodiment in that the input device 100 is replaced with an input device 102. In other respects, the input system 1002 is similar to the input system 1000.

[0038] 6, input device 102 differs from input device 100 in that it includes curtain output unit 120A that blows out air at high speed to output air curtain 515, instead of curtain output unit 120 that outputs visible light curtain 511. In other respects, input device 102 is similar to input device 100.

[0039] Curtain output unit 120A includes a fan capable of high-speed airflow and a linear outlet for blowing air in a line. As shown in FIG. 6, curtain output unit 120A outputs air curtain 515 by blowing air at high speed from the linear outlet toward the vicinity of operation reference plane 502 inside operation area 501.

[0040] In the third embodiment, the positional relationship between air curtain 515 output by curtain output unit 120A and operation area 501 and operation reference plane 502 is the same as in the first embodiment, as shown in Fig. 3. However, since visible light curtain 511 output by curtain output unit 120 is irradiated in a line from one point of the light emitting unit of the LD of curtain output unit 120, it has an inverted triangular shape as shown in Fig. 2, making it difficult for the user to recognize the left and right ends of operation area 501. On the other hand, since air curtain 515 output by curtain output unit 120A is blown out from a linear blowing outlet, it has a rectangular shape as shown in Fig. 6, making it easy for the user to recognize the left and right ends of operation area 501.

[0041] Of course, curtain output section 120A may be added to the left and right ends of operation area 501 as in the second embodiment so as to output separate air curtains.

[0042] In addition, the curtain-like object output by curtain output unit 120, 120A is not limited to visible light curtain 511 and air curtain 515. For example, when vibrations can be emitted in a line shape by using haptics technology, a vibration curtain obtained by emitting vibrations in a line shape may be output toward the vicinity of operation reference surface 502.

[0043] (Embodiment 4) A fourth embodiment will be described, in which the color of the visible light curtain is changed depending on the position of the user's finger 600.

[0044] The configuration of input system 1003 according to the fourth embodiment is similar to that of input system 1000 according to the first embodiment, but screen output unit 120 can change the color of visible light curtain 511 under the control of control unit 310. To this end, input system 1003 includes screen output unit 120A that outputs red visible light curtain 511A and screen output unit 120B that outputs blue visible light curtain 511B, as shown in Fig. 7. When user's finger 600 is outside operation area 501 like finger 600A, red visible light curtain 511A is output, and when user's finger 600 is inside operation area 501 like finger 600B, blue visible light curtain 511B is output.

[0045] The guide control process according to the fourth embodiment will be described with reference to Fig. 8. This guide control process is a process for changing the color of the visible light curtain 511 according to the position of the user's finger 600. When the input system 1003 is started, the control unit 310 starts executing the guide control process shown in Fig. 8 following the initialization process of each device.

[0046] First, control unit 310 performs a detection operation in detection unit 110 (step S101), and determines whether or not any object is present within detection range 500 (step S102). If nothing is present within detection range 500 (step S102; No), control unit 310 stops the output of the visible light curtain from screen output unit 120 by stopping the output of red visible light curtain 511A from screen output unit 120A and the output of blue visible light curtain 511B from screen output unit 120B (step S103), and returns to step S101.

[0047] If any object is present within the detection range 500 (step S102; Yes), the control unit 310 determines whether or not the finger 600 is present within the operation area 501 (step S104). Since the detection unit 110 can detect the three-dimensional shape of an object present within the detection range 500, when the user's hand is present within the detection range 500, the control unit 310 can obtain the position (three-dimensional coordinates) of the user's finger 600 based on the data obtained from the detection unit 110. In step S104, the control unit 310 compares the position of the finger 600 with the position of the operation area 501 to determine whether or not the finger 600 is present within the operation area 501.

[0048] If finger 600 is present within operation area 501 (step S104; Yes), control unit 310 stops the output of red visible light curtain 511A from curtain output unit 120A and outputs blue visible light curtain 511B from curtain output unit 120B, thereby changing the color of the visible light curtain output by curtain output unit 120 to blue (step S106), and returns to step S101.

[0049] If finger 600 is not present within operation area 501 (step S104; No), control unit 310 stops output of blue visible light curtain 511B from curtain output unit 120B and outputs red visible light curtain 511A from curtain output unit 120A, thereby changing the color of the visible light curtain output by curtain output unit 120 to red (step S105), and returns to step S101.

[0050] By the above guide control process, the visible light curtain is turned off or changes color depending on the position of the user's finger 600, so that the user can more easily perform gesture operations.

[0051] In the above description, input system 1003 is described as including screen output unit 120A and screen output unit 120B, but input system 1003 does not necessarily have to include a plurality of screen output units 120. For example, input system 1003 may include one screen output unit that can switch between a plurality of colors and output a visible light curtain, and control unit 310 may switch the color of the visible light curtain in the above-mentioned steps S105 and S106.

[0052] Furthermore, input system 1003 may include curtain output section 120 that cannot switch colors, and may output visible light curtain 511 when finger 600 is present within operation area 501, and may stop outputting visible light curtain 511 in other cases. That is, control section 310 may turn off visible light curtain 511 in the above-mentioned step S105 (as in step S103), and may output visible light curtain 511 in step S106.

[0053] (Embodiment 5) In the above-described embodiment, the screen output unit 120 emits visible light, air, vibration, etc. in a line shape to output a screen-like object (a visible light curtain, an air curtain, a vibration curtain, etc.). The presence of this screen-like object allows the user to know the range of the operation reference surface 502 and the operation area 501, and serves as a guide when performing a gesture operation. However, if the output of the screen output unit 120 spreads, the range of the operation reference surface 502 and the operation area 501 can only be vaguely identified. Even in such a case, a fifth embodiment will be described in which the state (strength (not only the strength of vibration, but also the amount of light, wind speed, etc.), color, type, etc.) of the screen-like object output by the screen output unit 120 is changed depending on the position of the finger 600, making it easier to understand the range of the operation reference surface 502 and the operation area 501.

[0054] The input system according to the fifth embodiment has a configuration in which screen output section 120 in input system 1000 according to the first embodiment is replaced with a vibration output section that outputs vibrations.

[0055] The vibration output unit emits vibrations into the air using haptics technology. The magnitude of the vibrations can be changed by control from the control unit 310.

[0056] The guide control process according to the fifth embodiment will be described with reference to Fig. 9. This guide control process is a process for changing the magnitude of vibration output by the vibration output unit according to the position of the user's finger 600. When the input system is started, the control unit 310 starts executing the guide control process shown in Fig. 9 following the initialization process of each device.

[0057] First, the control unit 310 performs a detection operation in the detection unit 110 (step S201), and determines whether or not any object is present within the detection range 500 (step S202). If nothing is present within the detection range 500 (step S202; No), the control unit 310 stops the vibration output from the vibration output unit (step S203), and returns to step S201.

[0058] If any object is present within the detection range 500 (step S202; Yes), the control unit 310 determines whether or not the finger 600 is present within the operation area 501 (step S204). This process is similar to the process of step S104 in FIG.

[0059] If finger 600 is not present within operation area 501 (step S204; No), control unit 310 stops the output of vibration from the vibration output unit (step S203), and returns to step S201.

[0060] If the finger 600 is present within the operation area 501 (step S204; Yes), the control unit 310 judges whether or not the finger 600 is present near the operation reference surface 502 (step S205). In this step, the control unit 310 compares the position of the finger 600 with the position of the operation reference surface 502 to judge whether or not the finger 600 is present near the operation reference surface 502 (for example, the distance between the finger 600 and the operation reference surface 502 is 1 cm or less).

[0061] If the finger 600 is not present in the vicinity of the operation reference surface 502 (step S205; No), the control unit 310 causes the vibration output unit to output a slight vibration (step S206), and the process returns to step S201.

[0062] If the finger 600 is present in the vicinity of the operation reference surface 502 (step S205; Yes), the control unit 310 causes the vibration output unit to output normal vibrations larger than the micro vibrations (step S207), and the process returns to step S201.

[0063] The above guide control process causes vibration to disappear, become a slight vibration, or become a normal vibration depending on the position of the user's finger 600, so that even if the vibration output from the vibration output unit is not curtain-shaped (spread out), the user can grasp the position of the operation reference surface 502 and can easily perform gesture operations.

[0064] (Modification) The above-mentioned embodiments can be combined. For example, the second embodiment and the third embodiment can be combined to output visible light curtain 511 near operation reference plane 502 and output air curtain 515 at the left and right ends of operation area 501. That is, the form of the curtain output near operation reference plane 502 and the form of the curtain output at the ends of operation area 501 can be made different.

[0065] In the above-described embodiment, the curtain output unit outputs curtain-like objects such as visible light curtain 511 and air curtain 515, but the objects output by the curtain output unit are not limited to curtain-like objects. For example, any medium, such as a single light beam, may be output as long as the medium is passable by user's finger 600 and allows the user to recognize that finger 600 has blocked the medium. In other words, the curtain output unit can be considered as a type of medium output unit that outputs such any medium.

[0066] In the above-described fourth embodiment, control unit 310 causes curtain output unit 120 to output a different color of visible light when finger 600 is detected inside operation area 501 and when finger 600 is detected outside operation area 501. However, in this case, the medium output by control unit 310 in the medium output unit is not limited to visible light, and the manner of difference is not limited to color. For example, control unit 310 may cause curtain output unit 120 to output visible light curtain 511 when finger 600 is detected inside operation area 501, and may cause curtain output unit 120A to output air curtain 515 when finger 600 is detected outside operation area 501.

[0067] In the above embodiment, the input system 1000 includes the input device 100, the projection device 200, and the control device 300, but if the control unit 310 and the storage unit 320 are included in the input device 100 or the projection device 200, the control device 300 may not be included. In that case, the above-mentioned guide control process and the like will be executed by the control unit 310 included in the input device 100 or the projection device 200. The same applies to the input systems 1001, 1002, and 1003.

[0068] Furthermore, the PC serving as the control device 300 is not limited to a normal PC, but any computer including the control unit 310, the storage unit 320, and the interface unit 330 may be used, and may be, for example, a one-board microcomputer.

[0069] In the above embodiment, the operation reference surface 502 is a rectangle, and the operation area 501 is a rectangular parallelepiped including the operation reference surface 502, but the operation reference surface 502 is not limited to a rectangle, and the operation area 501 is not limited to a rectangular parallelepiped. The operation area 501 can be set to any shape (for example, a sphere, an egg shape, etc.) as long as the shape is included in the detection range 500. In addition, the operation reference surface 502 may be any cross section of the operation area 501.

[0070] In the above embodiment, the program for the guide control process and the like executed by the control unit 310 has been described as being stored in advance in the storage unit 320. However, the program may be stored in a non-transitory computer-readable recording medium such as a flexible disk, a CD-ROM (Compact Disc Read Only Memory), a DVD (Digital Versatile Disc), an MO (Magneto-Optical disc), a memory card, a USB memory, or the like, and distributed, and the program may be read and installed in a computer to configure a computer capable of executing each of the above-mentioned processes.

[0071] Furthermore, the program may be superimposed on a carrier wave and applied via a communication medium such as the Internet. For example, the program may be distributed by posting it on a bulletin board system (BBS) on a communication network. The program may then be started and executed under the control of an OS (Operating System) in the same manner as other application programs, thereby enabling the above-mentioned processes to be performed.

[0072] In addition, the control unit 310 may be configured by any processor alone, such as a single processor, a multiprocessor, or a multi-core processor, or may be configured by combining any of these processors with a processing circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field-Programmable Gate Array).

[0073] Although the above describes a preferred embodiment of the present invention, the present invention is not limited to the specific embodiment, and the present invention includes the invention described in the claims and its equivalents. [Explanation of symbols]

[0074] 100, 101, 102...input device, 110...detection unit, 120, 120A, 120B, 120L, 120R...curtain output unit, 200...projection device, 300...control device, 310...control unit, 320...storage unit, 330...interface unit, 400...screen, 401, 410...icon, 500...detection range, 501...operation area, 502...operation reference surface, 511, 512, 513...visible light curtain, 515...air curtain, 600...finger, 1000, 1001, 1002, 1003...input system

Claims

1. a medium output unit that outputs a medium through which the object can pass, in an operation area in which a detection unit detects the position of the object to acquire a user's operation, and that outputs a medium that allows the user to recognize that the object has blocked the medium when the object blocks the medium, the medium output unit outputs the medium in the vicinity of an operation reference plane that is a plane that serves as a reference when the user performs an operation input in the operation area. Input device.

2. The detection unit further detects a three-dimensional position of the target. The input device according to claim 1 .

3. The operation area is located in the air. The input device according to claim 1 .

4. the operation is an operation by the user on an image projected onto a projection target by a projection device, the medium output unit outputs the medium to the opposite side of the projection target across the operation reference plane. The input device according to claim 3 .

5. the medium output unit also outputs the medium to the right and left ends of the operation area.

5. The input device according to claim 4.

6. a state of the medium outputted in the vicinity of the operation reference surface is different from a state of the medium outputted at an end of the operation area; 6. The input device according to claim 5.

7. The medium output unit blows out air as the medium in a wall shape.

7. An input device according to claim 1.

8. The medium output unit irradiates visible light in a line shape as the medium.

7. An input device according to claim 1.

9. The medium output unit includes: when the detection unit cannot detect the target, the medium is not output, and when the detection unit can detect the target, the color of the output visible light is made different depending on whether the target is detected inside the operation area or outside the operation area.

9. The input device according to claim 8.

10. A detection unit that detects a three-dimensional position of an object; a medium output unit that outputs a medium through which the object can pass and that allows a user to recognize that the object has blocked the medium when the object blocks the medium; A control unit; Equipped with The control unit is and controlling the medium output unit to output the medium near an operation reference plane that is a plane that serves as a reference when the user inputs an operation in an operation area where the detection unit detects the target and acquires the user's operation. Input system.

11. The control unit is When the detection unit cannot detect the target, the medium output unit does not output the medium, and when the detection unit can detect the target, the mode of the medium output by the medium output unit is made to differ depending on whether the target is detected inside the operation area or outside the operation area. The input system according to claim 10.

12. A control unit of an input system including a detection unit that detects a three-dimensional position of an object, a medium output unit that outputs a medium through which the object can pass and allows a user to recognize that the object has blocked the medium when the object blocks the medium, and a control unit, and controlling the medium output unit to output the medium near an operation reference plane that is a plane that serves as a reference when the user inputs an operation in an operation area where the detection unit detects the target and acquires the user's operation. Input control methods.

13. A control unit of an input system including a detection unit that detects a three-dimensional position of an object, a medium output unit that outputs a medium through which the object can pass and allows a user to recognize that the object has blocked the medium when the object blocks the medium, and a control unit, and controlling the medium output unit to output the medium near an operation reference plane that is a plane that serves as a reference when the user inputs an operation in an operation area where the detection unit detects the target and acquires the user's operation. A program that executes a process.

Images