Input Devices
By introducing a double-layer detection mechanism into the input device, using the detection results of the first sensing layer and the second sensing layer for accurate judgment, the problem of misoperation in the prior art is solved, and high-precision non-contact operation of the operation screen is achieved judge.
Patent Information
- Application Number
- CN202010118480.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2019-04-02
- Filing Date
- 2020-02-26
- Publication Date
- 2024-11-12
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
The existing non-contact operation input device is prone to misjudgment of the user's body as a specific non-contact operation through the detection area, resulting in a wrong operation.
The two-layer detection mechanism is adopted to detect the passing state of the object through the first sensing layer and the second sensing layer respectively, and the determination unit makes accurate judgment based on the detection results of both to avoid erroneous operation.
High-precision determination of specific non-contact operation of the operation screen is realized, erroneous operation of the input device is avoided, and the accuracy of the operation is improved.
Smart Images

Figure CN111796694B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to an input device for accepting a specific non-contact operation of an object on an operation screen. Background Art
[0002] In the food processing field and medical field where hygiene management is strict, it is not desirable to use a touch panel display that is directly touched by a user's finger because the touch panel display may become a source of infection by pathogens. Therefore, in the above fields, it is proposed to use an input device that accepts a specific non-contact operation of the user's finger on the operation screen (for example, refer to Patent Document 1).
[0003] Conventional input devices form an aerial image (real image) representing an operation screen in an aerial display area, and detect movement of a user's finger in a detection area facing the aerial image, thereby determining that a specific non-contact operation has been performed on the operation screen.
[0004] [Prior art literature]
[0005] [Patent Document]
[0006] [Patent Document 1] Japanese Patent Application Publication No. 2014-67071 Summary of the invention
[0007] Problems to be solved by the invention
[0008] However, in the above-mentioned conventional input device, when, for example, a part of the user's body or the like accidentally passes through the detection area, it may be erroneously determined that a specific non-contact operation on the operation screen has been performed.
[0009] The present invention has been made to solve the above-mentioned problem, and an object of the present invention is to provide an input device capable of accurately determining whether or not a specific non-contact operation on an operation screen has been performed.
[0010] Technical means of solving problems
[0011] In order to achieve the above-mentioned purpose, an input device according to one embodiment of the present invention is used to accept a specific non-contact operation of an object on an operation screen, and includes: a display control unit, which displays the operation screen on a display surface; a first detection unit, which detects a passage state of the object in a first perception layer in the air formed opposite to the display surface; a second detection unit, which detects a passage state of the object in a second perception layer in the air formed between the display surface and the first perception layer; and a determination unit, which determines whether or not the specific non-contact operation of the object occurs based on the respective detection results of the first detection unit and the second detection unit.
[0012] According to this aspect, when the user intentionally performs a specific non-contact operation on the operation screen, the passing state of the object in each of the first and second perception layers is different from when a part of the user's body accidentally passes through each of the first and second perception layers. Therefore, the determination unit determines whether there is a specific non-contact operation of the object based on the passing state of the object in each of the first and second perception layers, thereby being able to accurately determine whether there is a specific non-contact operation on the operation screen. As a result, it is possible to avoid erroneous operation of a device using an input device as a user interface.
[0013] For example, the input device of one embodiment of the present invention may be configured such that the first detection unit detects the number of places where the object passes through the first sensing layer, and the second detection unit detects the number of places where the object passes through the second sensing layer.
[0014] According to this aspect, the determination unit can determine whether or not there is a specific non-contact operation of the object based on the number of locations through which the object passes in each of the first sensing layer and the second sensing layer.
[0015] For example, the input device of one embodiment of the present invention may also be configured as follows: the specific non-contact operation is a non-contact single-touch gesture of the object to a specified display on the operation screen, and the determination unit determines that the single-touch gesture has been performed when the object passes through a point on the first perception layer and a point on the second perception layer.
[0016] According to this aspect, the determination unit can determine that a single-touch gesture has been performed based on the number of locations through which the object passes in each of the first sensory layer and the second sensory layer.
[0017] For example, the input device of one embodiment of the present invention may also be configured as follows: the specific non-contact operation is a non-contact multi-touch gesture of the object to the operation screen, and the determination unit determines that the multi-touch gesture has been performed when the object passes through two locations of the first perception layer and two locations of the second perception layer.
[0018] According to this aspect, the determination unit can determine that a multi-touch gesture has been performed based on the number of locations through which the object passes in each of the first sensory layer and the second sensory layer.
[0019] For example, in the input device according to one aspect of the present invention, the determination unit may determine that the specific non-contact operation is not performed when the object passes through three or more locations in the first sensing layer and one or more locations in the second sensing layer.
[0020] According to this aspect, the determination unit can determine that the specific non-contact operation is not performed based on the number of locations through which the object passes in each of the first sensing layer and the second sensing layer.
[0021] For example, the input device according to one aspect of the present invention may be configured such that when the object passes through the first sensing layer, the display control unit causes a cursor to be displayed on the operation screen.
[0022] According to this aspect, the display control unit displays a cursor on the operation screen when the object passes through the first perception layer, thereby allowing the user to easily recognize that the object passes through the first perception layer.
[0023] For example, the input device of one embodiment of the present invention may also be constructed as follows: the first detection unit detects the size of the object in the first perception layer, the second detection unit detects the presence or absence of the object in the second perception layer, the determination unit determines that the specific non-contact operation has been performed when the size of the object in the first perception layer is below a threshold and the object is detected in the second perception layer, and determines that the specific non-contact operation has not been performed when the size of the object in the first perception layer exceeds the threshold and the object is detected in the second perception layer.
[0024] According to this aspect, the determination unit can determine whether or not there is a specific non-contact operation with an object based on the size of the object in the first sensing layer and the presence or absence of the object in the second sensing layer.
[0025] For example, an input device according to one embodiment of the present invention may also be configured as follows: the input device further includes one or more third detection units, which detect a passage state of the object in one or more third detection layers formed in the air between the display surface and the second perception layer, and the determination unit determines whether or not the specific non-contact operation of the object occurs based on the detection results of the first detection unit, the second detection unit, and the one or more third detection units.
[0026] According to this aspect, the determination unit can determine with higher accuracy whether or not a specific non-contact operation on the operation screen has been performed.
[0027] In addition, the present invention can also be implemented in the form of a program for causing a computer to function as a characteristic processing unit included in an input device, or a program for causing a computer to execute characteristic steps included in an aerial image display method. In addition, such a program can of course be circulated via a non-temporary recording medium readable by a computer such as a read-only CD (Compact Disc-Read Only Memory, CD-ROM) or a communication network such as the Internet.
[0028] Effects of the Invention
[0029] According to the input device of one aspect of the present invention, it is possible to determine with high accuracy whether or not a specific non-contact operation on the operation screen has been performed. BRIEF DESCRIPTION OF THE DRAWINGS
[0030] Figure 1 It is a plan view showing the input device of embodiment 1.
[0031] Figure 2 It is a side view showing the input device according to the first embodiment.
[0032] Figure 3 It is a block diagram showing the structure of the input device according to the first embodiment.
[0033] Figure 4 This is a flowchart showing the operation flow of the input device according to the first embodiment.
[0034] Figure 5A (a) and Figure 5A (b) is a diagram for explaining a state in which an object passes through a portion of the first sensory layer in the input device of embodiment 1.
[0035] Figure 5B (a) and Figure 5B (b) is a diagram for explaining a state in which an object passes through a portion of the second sensory layer in the input device of embodiment 1.
[0036] Figure 6 (a) and Figure 6 (b) is a diagram for explaining a state in which an object passes through two locations of the first sensing layer and the second sensing layer, respectively, in the input device of embodiment 1.
[0037] Figure 7 (a) and Figure 7 (b) is a diagram for explaining the state of an object passing through three places of the first sensing layer and the second sensing layer in the input device of embodiment 1.
[0038] Figure 8 It is a plan view showing the input device of embodiment 2.
[0039] Fig. 9 It is a block diagram showing the structure of the input device of the second embodiment.
[0040] Fig.10 This is a flowchart showing the operation flow of the input device according to the second embodiment.
[0041] Explanation of symbols
[0042] 2.2A: Input device
[0043] 4: Display unit
[0044] 6.6A: First detection unit
[0045] 8, 8A: Second detection unit
[0046] 10: Operation screen
[0047] 12: Display surface
[0048] 14: Icons
[0049] 16.16A: First Perception Layer
[0050] 18: Object
[0051] 20, 44: First light-emitting part
[0052] 22, 46: First light receiving unit
[0053] 24, 24A: Second Perception Layer
[0054] 26, 48: Second light-emitting part
[0055] 28, 50: Second light receiving unit
[0056] 30: Calculation processing unit
[0057] 32: Detection and processing department
[0058] 34: Distance measurement unit
[0059] 36: Judgment Department
[0060] 38: Action Processing Unit
[0061] 40: Display control unit
[0062] 42: Cursor
[0063] 52a: First side
[0064] 52b: Second side
[0065] 52c: The third side
[0066] 52d: The fourth side DETAILED DESCRIPTION
[0067] Hereinafter, the embodiments of the present invention will be described in detail using the accompanying drawings. In addition, the embodiments described below are all general examples or specific examples. The numerical values, shapes, materials, constituent elements, configuration positions of constituent elements, and connection forms shown in the following embodiments are examples and are not intended to limit the present invention. In addition, constituent elements that are not recorded in independent claims among the constituent elements of the following embodiments are described as arbitrary constituent elements.
[0068] (Implementation Method 1)
[0069] [1-1. Configuration of input device]
[0070] First, on the one hand, refer to Figure 1 to Figure 3 On the one hand, the structure of the input device 2 of embodiment 1 is explained. Figure 1 It is a plan view showing the input device 2 according to the first embodiment. Figure 2 It is a side view showing the input device 2 according to the first embodiment. Figure 3 This is a block diagram showing the structure of the input device 2 according to the first embodiment.
[0071] like Figure 1 and Figure 2 As shown, the input device 2 includes a display unit 4, a first detection unit 6, and a second detection unit 8. The input device 2 is applied, for example, as a user interface for operating a device (not shown) used in the food processing field or the medical field in a non-contact manner by an object 18 (e.g., a user's finger).
[0072] The display unit 4 is, for example, a liquid crystal display. The display unit 4 has a display surface 12 for displaying an operation screen 10. The operation screen 10 is, for example, a menu screen for operating the device. Figure 1 In the example shown, an icon 14 (an example of a predetermined display) indicating an operation menu of a device is displayed on the operation screen 10 .
[0073] The first detection unit 6 detects the passage of the object 18 in the first sensing layer 16 in the air that is formed facing the display surface 12 of the display unit 4. Specifically, the first detection unit 6 detects the number of locations in the first sensing layer 16 where the object 18 passes.
[0074] The first sensing layer 16 is a virtual plane (XY plane) formed in the air at a position substantially parallel to the display surface 12 of the display unit 4. The passage portion of the object 18 of the first sensing layer 16 refers to the cross-sectional area of the object 18 of the first sensing layer 16. For example, when one finger of the user passes through the first sensing layer 16, the passage portion of the object 18 of the first sensing layer 16 becomes one place. For another example, when two fingers of the user pass through the first sensing layer 16, the passage portion of the object 18 of the first sensing layer 16 becomes two places.
[0075] The first detection unit 6 includes, for example, a scanning sensor such as Figure 1 As shown in FIG. 1 , the display unit 4 is disposed opposite to the corner thereof. Figure 2As shown, the first detection unit 6 includes a first light emitting unit 20 and a first light receiving unit 22. The first light emitting unit 20 two-dimensionally scans infrared laser light in the first sensing layer 16. The first light receiving unit 22 receives and detects light reflected by the object 18 passing through the first sensing layer 16.
[0076] The second detection unit 8 detects the passing state of the object 18 of the second sensing layer 24 formed in the air between the display surface 12 of the display unit 4 and the first sensing layer 16. Specifically, the second detection unit 8 detects the number of passing locations of the object 18 of the second sensing layer 24. Figure 2 As shown, the distance D between the second sensing layer 24 and the display surface 12 of the display unit 4 is the size (for example, about 1 cm to several centimeters (cm)) to which the object 18 does not directly contact the display surface 12 of the display unit 4 when passing through the second sensing layer 24.
[0077] The second sensing layer 24 is a virtual plane (XY plane) formed in the air at a position substantially parallel to the display surface 12 of the display unit 4. The passage portion of the object 18 of the second sensing layer 24 refers to the cross-sectional area of the object 18 of the second sensing layer 24. For example, when one finger of the user passes through the second sensing layer 24, the passage portion of the object 18 of the second sensing layer 24 becomes one place. For another example, when two fingers of the user pass through the second sensing layer 24, the passage portion of the object 18 of the second sensing layer 24 becomes two places.
[0078] The second detection unit 8 includes, for example, a scanning sensor such as Figure 1 As shown in FIG. 1 , the display unit 4 is disposed opposite to the corner thereof. Figure 2 As shown, the second detection unit 8 has a second light emitting unit 26 and a second light receiving unit 28. The second light emitting unit 26 two-dimensionally scans the infrared laser in the second sensing layer 24. The second light receiving unit 28 receives and detects light reflected by the object 18 passing through the second sensing layer 24.
[0079] like Figure 3 As shown, the input device 2 further includes a calculation processing unit 30. The calculation processing unit 30 includes a detection processing unit 32, a distance measurement calculation unit 34, a determination unit 36, an operation processing unit 38, and a display control unit 40.
[0080] The detection processing unit 32 calculates the number of locations where the object 18 passes through the first sensing layer 16 based on the detection signal from the first detection unit 6. In addition, the detection processing unit 32 calculates the number of locations where the object 18 passes through the second sensing layer 24 based on the detection signal from the second detection unit 8.
[0081] The distance measurement operation unit 34 calculates the position (two-dimensional coordinates) of the object 18 in the first sensory layer 16 based on the detection signal from the first detection unit 6. In addition, the distance measurement operation unit 34 calculates the position (two-dimensional coordinates) of the object 18 in the second sensory layer 24 based on the detection signal from the second detection unit 8.
[0082] The determination unit 36 determines whether there is a specific non-contact operation of the object 18 on the operation screen 10 based on the calculation results of the detection processing unit 32 and the distance measurement operation unit 34. In addition, the specific non-contact operation is, for example, a single-point touch gesture and a multi-point touch gesture of the user's finger on the operation screen 10. The so-called single-point touch gesture is a gesture of one finger of the user (for example, the index finger), such as a gesture of tapping (tap). The so-called multi-point touch gesture is a gesture of two fingers of the user (for example, the index finger and the thumb), such as a gesture of pinching in, pinching out, and rotating. The determination process performed by the determination unit 36 will be described in detail below.
[0083] The operation processing unit 38 performs processing corresponding to a specific non-contact operation based on the calculation result of the distance measurement operation unit 34 and the determination result of the determination unit 36. For example, when the user performs a single-point touch gesture on the icon 14 on the operation screen 10 in a non-contact manner, the operation processing unit 38 performs processing such as selecting the icon 14. For another example, when the user performs a multi-point touch gesture on the operation screen 10 in a non-contact manner, the operation processing unit 38 performs processing such as enlarging or reducing the display magnification of the operation screen 10.
[0084] The display control unit 40 controls the display content of the display surface 12 of the display unit 4. Specifically, the display control unit 40 performs processing to display the operation screen 10 on the display surface 12 of the display unit 4. In addition, the display control unit 40 performs processing to display the cursor 42 (see below) when the object 18 passes through the first sensory layer 16 based on the calculation results of the detection processing unit 32 and the distance measurement calculation unit 34. Figure 5A (b)) is displayed on the operation screen 10. At this time, the cursor 42 is displayed at a position on the operation screen 10 corresponding to the position of the object 18 of the first perception layer 16.
[0085] [1-2. Operation of input device]
[0086] Next, refer to Figure 4 to Figure 7 On the one hand, the operation of the input device 2 of embodiment 1 is explained. Figure 4 This is a flowchart showing the operation flow of the input device 2 according to the first embodiment. Figure 5A (a) and Figure 5A (b) is a diagram for explaining a state in which an object 18 passes through a portion of the first sensing layer 16 in the input device 2 according to the first embodiment. Figure 5B (a) and Figure 5B (b) is a diagram for explaining a state in which the object 18 passes through a portion of the second sensory layer 24 in the input device 2 according to the first embodiment. Figure 6 (a) and Figure 6 (b) is a diagram for explaining a state in which the object 18 passes through two locations of the first sensing layer 16 and the second sensing layer 24 in the input device 2 of the first embodiment. Figure 7 (a) and Figure 6 (b) is a diagram for explaining the state in which the object 18 passes through three locations of the first sensing layer 16 and the second sensing layer 24 in the input device 2 of Embodiment 1.
[0087] First, on the one hand, refer to Figure 4 to Figure 5B (b) on the one hand, explains the operation of the input device 2 when the user performs a single-point touch gesture.
[0088] like Figure 4 and Figure 5A As shown in (a), when a finger of the user passes through the first sensing layer 16, the first detection unit 6 detects the number of passing locations of the object 18 (a finger) of the first sensing layer 16 (S101). The detection processing unit 32 calculates the number of passing locations of the object 18 of the first sensing layer 16 as "one location" based on the detection signal from the first detection unit 6 ("one location" in S102).
[0089] like Figure 5A As shown in (b), the display control unit 40 displays the cursor 42 on the operation screen 10 based on the calculation results of the detection processing unit 32 and the distance measurement operation unit 34 when the object 18 passes through the first sensory layer 16 (S103). In this state, the user moves a finger along the first sensory layer 16 (that is, in the XY plane), and the cursor 42 moves on the operation screen 10 following the movement of the user's finger. In addition, while the cursor 42 is displayed on the operation screen 10, a sound can be output from the speaker (not shown) of the display unit 4.
[0090] Then, when Figure 5B As shown in (a), when the user passes a finger through the second sensing layer 24, the second detection unit 8 detects the number of passing locations of the object 18 (a finger) in the second sensing layer 24 (S104). The detection processing unit 32 calculates the number of passing locations of the object 18 in the second sensing layer 24 as "one location" based on the detection signal from the second detection unit 8. In addition, when a user's finger passes through the first sensing layer 16, the passing location of the object 18 in the second sensing layer 24 must become one location. The determination unit 36 determines that Figure 5BAs shown in (b) of FIG. 1 , when the object 18 passes through a point of the second sensory layer 24 while the cursor 42 is superimposed on the icon 14 , it is determined that a single-point touch gesture has been performed ( S105 ).
[0091] Furthermore, when a single-touch gesture is performed, a dedicated button or icon other than icon 14 may be displayed on operation screen 10 .
[0092] Next, refer to Figure 4 as well as Figure 6 (a) and Figure 6 (b) on the one hand, explains the operation of the input device 2 when the user performs a multi-touch gesture.
[0093] like Figure 4 and Figure 6 As shown in (a), when two fingers of the user (for example, the index finger and the thumb) pass through the first sensing layer 16, the first detection unit 6 detects the number of passing locations of the object 18 (two fingers) in the first sensing layer 16 (S101). The detection processing unit 32 calculates the number of passing locations of the object 18 in the first sensing layer 16 as "two locations" based on the detection signal from the first detection unit 6 ("two locations" in S102).
[0094] The display control unit 40 controls the cursor 42 (see FIG. 1 ) to move the cursor 42 when the object 18 passes through the first sensing layer 16 based on the calculation results of the detection processing unit 32 and the distance measurement operation unit 34. Figure 5A (b)) is displayed on the operation screen 10 (S106).
[0095] Then, when the user passes the finger through the second sensing layer 24, the second detection unit 8 detects the number of the passing locations of the object 18 (fingers) of the second sensing layer 24 (S107). In addition, when two fingers of the user pass through the first sensing layer 16, the passing locations of the object 18 of the second sensing layer 24 become two locations or one location.
[0096] When Figure 6 As shown in (b), when two fingers of the user pass through the second sensing layer 24, the detection processing unit 32 calculates the number of the passing positions of the object 18 in the second sensing layer 24 as "two" based on the detection signal from the second detection unit 8 ("two" in S108). When the object 18 passes through two positions of the second sensing layer 24, the determination unit 36 determines that a multi-touch gesture has been performed (S109).
[0097] On the other hand, when one finger of the user passes through the second sensing layer 24, the detection processing unit 32 calculates the number of the passing positions of the object 18 in the second sensing layer 24 as "one place" ("one place" in S108) based on the detection signal from the second detection unit 8. The determination unit 36 determines that a single-point touch gesture has been performed after a predetermined waiting time has passed after the object 18 passes through one place in the second sensing layer 24 (S105).
[0098] Next, on the one hand Figure 4 as well as Figure 7 (a) and Figure 7 (b) , on the one hand, explains the operation of the input device 2 when the user's three fingers accidentally pass through the first sensing layer 16 and the second sensing layer 24 respectively.
[0099] like Figure 4 and Figure 7 As shown in (a), when three fingers of the user (for example, the index finger, the middle finger, and the ring finger) pass through the first sensing layer 16, the first detection unit 6 detects the number of passing locations of the object 18 (three fingers) of the first sensing layer 16 (S101). The detection processing unit 32 calculates the number of passing locations of the object 18 of the first sensing layer 16 as "three locations" based on the detection signal from the first detection unit 6 ("three locations" in S102).
[0100] The display control unit 40 controls the cursor 42 (see FIG. 1 ) to move the cursor 42 when the object 18 passes through the first sensing layer 16 based on the calculation results of the detection processing unit 32 and the distance measurement operation unit 34. Figure 5A (b)) is displayed on the operation screen 10 (S110).
[0101] Then, when the user's finger passes through the second sensing layer 24, the second detection unit 8 detects the number of the passing locations of the object 18 (fingers) of the second sensing layer 24 (S111). In addition, when three fingers of the user pass through the first sensing layer 16, the passing locations of the object 18 of the second sensing layer 24 become less than three.
[0102] When Figure 7 As shown in (b), when three fingers of the user pass through the second sensing layer 24, the detection processing unit 32 calculates the number of the passing positions of the object 18 in the second sensing layer 24 as "three positions" based on the detection signal from the second detection unit 8. When the object 18 passes through three positions of the second sensing layer 24, the determination unit 36 determines that neither the single-point touch gesture nor the multi-point touch gesture is performed (S112). At this time, when the object 18 passes through two positions or one position of the second sensing layer 24, the determination unit 36 also determines that neither the single-point touch gesture nor the multi-point touch gesture is performed.
[0103] In addition, when the object 18 passes through four or more points of the first sensing layer 16, the process proceeds from step S102 to step S110 and the processes of S110 to S112 are executed in the same manner as described above, and it is determined that neither a single-point touch gesture nor a multi-point touch gesture is performed.
[0104] [1-3. Effect]
[0105] As described above, the determination unit 36 determines whether or not there is a specific non-contact operation of the object 18 based on the number of locations through which the object 18 passes in each of the first sensing layer 16 and the second sensing layer 24 .
[0106] For example, when the user intentionally performs a specific non-contact operation on the operation screen 10 , it is considered that the number of locations where the object 18 passes through the first sensory layer 16 is one or two. Therefore, in this case, the determination unit 36 determines that the specific non-contact operation on the operation screen 10 has been performed.
[0107] On the other hand, for example, if a part of the user's body accidentally passes through the first sensory layer 16, it is considered that the number of places where the object 18 passes through the first sensory layer 16 is three or more. Therefore, in this case, the determination unit 36 determines that the specific non-contact operation on the operation screen 10 is not performed.
[0108] Therefore, the input device 2 of the first embodiment can determine with high accuracy whether or not a specific non-contact operation on the operation screen 10 has been performed, and can avoid erroneous operations of a device using the input device 2 as a user interface.
[0109] (Implementation Method 2)
[0110] [2-1. Configuration of input device]
[0111] Next, refer to Figure 8 and Fig. 9 On the one hand, the structure of the input device 2A of embodiment 2 is explained. Figure 8 It is a plan view showing an input device 2A according to the second embodiment. Fig. 9 It is a block diagram showing the structure of the input device 2A according to Embodiment 2. In this embodiment, the same components as those in Embodiment 1 are denoted by the same reference numerals, and the description thereof is omitted.
[0112] like Figure 8 As shown, in an input device 2A according to the second embodiment, the configurations of a first detection unit 6A and a second detection unit 8A are different from those of the first embodiment.
[0113] Specifically, the first detection unit 6A includes an optical array sensor having a plurality of first light emitting units 44 , a plurality of first light receiving units 46 , a plurality of second light emitting units 48 , and a plurality of second light receiving units 50 .
[0114] The plurality of first light emitting units 44 are arranged at intervals along the first side 52a of the display unit 4. The plurality of first light receiving units 46 are arranged at intervals along the second side 52b facing the first side 52a of the display unit 4. That is, the plurality of first light emitting units 44 are arranged corresponding to the plurality of first light receiving units 46. The plurality of first light emitting units 44 irradiate infrared rays ( Figure 8 The plurality of first light receiving units 46 receive infrared rays from the plurality of first light emitting units 44, respectively.
[0115] The plurality of second light emitting units 48 are arranged at intervals along the third side 52c of the display unit 4. The plurality of second light receiving units 50 are arranged at intervals along the fourth side 52d facing the third side 52c of the display unit 4. That is, the plurality of second light emitting units 48 are arranged corresponding to the plurality of second light receiving units 50. The plurality of second light emitting units 48 irradiate infrared rays ( Figure 8 The plurality of second light receiving units 50 receive infrared rays from the plurality of second light emitting units 48, respectively.
[0116] A first sensing layer 16A is formed in an area surrounded by the plurality of first light emitting portions 44, the plurality of first light receiving portions 46, the plurality of second light emitting portions 48, and the plurality of second light receiving portions 50. Figure 2 ) passes through the specified position of the first sensing layer 16A, the light from the first light emitting unit 44 and the second light emitting unit 48 corresponding to the specified position is blocked by the object 18, and is therefore not received by the first light receiving unit 46 and the second light receiving unit 50 corresponding to the specified position. Thus, the first detection unit 6A detects the size (area) of the object 18 at the specified position of the first sensing layer 16A.
[0117] The second detection unit 8A detects the presence of the object 18 on the second sensing layer 24. The second detection unit 8A includes a scanning sensor as in the first embodiment. The second detection unit 8A may include an optical array sensor as in the first detection unit 6A.
[0118] Furthermore, if Fig. 9 As shown, in the input device 2A of the second embodiment, the configurations of the detection processing unit 32A and the determination unit 36A of the calculation processing unit 30A are different from those of the first embodiment.
[0119] The detection processing unit 32A calculates the size of the object 18 in the first sensory layer 16A based on the detection signal from the first detection unit 6A. In addition, the detection processing unit 32A determines the presence or absence of the object 18 in the second sensory layer 24 based on the detection signal from the second detection unit 8A.
[0120] The determination unit 36A determines whether or not there is a specific non-contact operation of the object 18 on the operation screen 10 based on the calculation results of the detection processing unit 32A and the distance measurement operation unit 34. In this embodiment, the specific non-contact operation is, for example, a non-contact single-point touch gesture on the operation screen 10. The determination process performed by the determination unit 36A will be described in detail below.
[0121] [2-2. Operation of input device]
[0122] Next, refer to Fig.10 On the one hand, the operation of the input device 2A of embodiment 2 is explained. Fig.10 This is a flowchart showing the operation flow of the input device 2A according to the second embodiment.
[0123] like Fig.10 As shown, when the object 18 passes through the first sensing layer 16A, the first detection unit 6A detects the size of the object 18 in the first sensing layer 16A (S201). The detection processing unit 32A calculates the size of the object 18 in the first sensing layer 16A based on the detection signal from the first detection unit 6A.
[0124] When a finger of the user passes through the first sensing layer 16A, the detection processing unit 32A determines that the size of the object 18 in the first sensing layer 16A is less than the threshold value (Yes in S202). Here, the threshold value is, for example, an area equivalent to the average size of a finger. The display control unit 40 controls the cursor 42 (see FIG. 1 ) when the object 18 passes through the first sensing layer 16A based on the calculation results of the detection processing unit 32A and the distance measurement operation unit 34. Figure 5A (b)) is displayed on the operation screen 10 (S203).
[0125] Then, when one finger of the user passes through the second sensing layer 24, the second detection unit 8A detects the presence of the object 18 (one finger) in the second sensing layer 24 (S204). The detection processing unit 32A determines that the object 18 exists in the second sensing layer 24 based on the detection signal from the second detection unit 8A. When the object 18 passes through the second sensing layer 24 while the cursor 42 overlaps the icon 14, the determination unit 36A determines that a single-point touch gesture is performed (S205).
[0126] Returning to step S202 described above, for example, when the user's palm passes through the first sensing layer 16A, the detection processing unit 32A determines that the size of the object 18 in the first sensing layer 16A exceeds the threshold value (No in S202). At this time, the display control unit 40 does not display the cursor 42 on the operation screen 10.
[0127] Then, when the user's palm or finger passes through the second sensing layer 24, the second detection unit 8A detects the presence of the object 18 (palm or finger, etc.) in the second sensing layer 24 (S206). The detection processing unit 32A determines that the object 18 exists in the second sensing layer 24 based on the detection signal from the second detection unit 8A. When the object 18 passes through the second sensing layer 24, the determination unit 36A determines that a single-point touch gesture is not performed (S207).
[0128] [2-3. Effect]
[0129] As described above, the determination unit 36A determines the presence or absence of a specific non-contact operation of the object 18 based on the size of the object 18 in the first sensing layer 16A and the presence or absence of the object 18 in the second sensing layer 24 .
[0130] For example, when the user intentionally performs a specific non-contact operation on operation screen 10 , it is considered that the size of object 18 in first sensory layer 16A becomes smaller than the threshold value. Therefore, in this case, determination unit 36A determines that a specific non-contact operation on operation screen 10 has been performed.
[0131] On the other hand, for example, if a part of the user's body accidentally passes through first sensory layer 16A, the size of object 18 in first sensory layer 16A may exceed the threshold. Therefore, determination unit 36A determines that no specific non-contact operation on operation screen 10 has been performed.
[0132] Therefore, input device 2A of embodiment 2 can accurately determine whether a specific non-contact operation on operation screen 10 is performed, similarly to embodiment 1, and can avoid erroneous operation of a device using input device 2A as a user interface.
[0133] (Variation Example)
[0134] Although the input devices according to the first and second embodiments of the present invention have been described above, the present invention is not limited to these embodiments. For example, the above-described embodiments may be combined.
[0135] In the above-mentioned embodiments, the operation screen 10 is displayed on the display surface 12 of the display unit 4 including a liquid crystal display screen, but the present invention is not limited thereto. The operation screen may be, for example, an aerial image (real image) formed on the display surface as a display area in the air, or a projected image of the display surface projected on a screen by a projector.
[0136] In addition, in each of the above-mentioned embodiments, the first detection unit 6 (6A) and the second detection unit 8 (8A) are separately configured, but the present invention is not limited thereto, and these detection units may be configured as one unit. That is, the functions of the first detection unit 6 (6A) and the second detection unit 8 (8A) may be realized by one detection unit.
[0137] In addition, in each of the above-mentioned embodiments, the first sensing layer 16 (16A) and the second sensing layer 24 are formed in the air, but the present invention is not limited thereto, and one or more third sensing layers may be further formed in the air between the second sensing layer 24 and the display surface 12 of the display unit 4. In this case, the input device 2 (2A) includes one or more third detection units that detect the passing state of the object 18 of the one or more third sensing layers, and the determination unit 36 determines whether there is a specific non-contact operation of the object 18 based on the detection results of the first detection unit 6 (6A), the second detection unit 8 (8A), and the one or more third detection units. In addition, the determination unit 36 may also determine that a specific non-contact operation of the object 18 has been performed when the object 18 passes through the third sensing layer formed at a position closest to the display surface 12 of the display unit 4.
[0138] Furthermore, in the above-described embodiments, the object 18 is a finger of the user, but the present invention is not limited thereto and may be, for example, a pointing stick or the like.
[0139] (Other modifications, etc.)
[0140] In addition, specifically, each of the devices may also be configured as a computer system including a microprocessor, a read-only memory (ROM), a random access memory (RAM), a hard disk drive, a display unit, a keyboard, a mouse, etc. A computer program is stored in the RAM or the hard disk drive. The microprocessor runs according to the computer program, so that each device achieves its function. Here, the computer program is composed of a plurality of command codes representing instructions to the computer in order to achieve a specified function.
[0141] Furthermore, it is also possible to configure that part or all of the components constituting each of the devices include a system large-scale integrated circuit (LSI). The system LSI is a multifunctional LSI manufactured by integrating multiple components on a single chip, specifically a computer system including a microprocessor, ROM, and RAM. The RAM stores a computer program. The microprocessor runs according to the computer program, so that the system LSI achieves its function.
[0142] In addition, it is also possible to configure that a part or all of the components constituting each device include an integrated circuit (IC) card or a single module that can be loaded and unloaded on each device. The IC card or module is a computer system including a microprocessor, ROM, and RAM. It is also possible to configure that the IC card or module includes the super-multifunctional LSI. The IC card or module achieves its function by running the microprocessor according to the computer program. The IC card or module may also be tamper-proof.
[0143] In addition, the present invention may be implemented as the methods described above. In addition, the present invention may be implemented as a computer program for implementing these methods using a computer, or may be implemented as a digital signal including the computer program.
[0144] Furthermore, the present invention may also be configured to record the computer program or the digital signal on a non-temporary recording medium readable by a computer, such as a floppy disk, a hard disk, a CD-ROM, a magneto-optical disc (MO), a digital video disc (DVD), a read-only digital video disc (DVD-ROM), a random access digital video disc (DVD-RAM), a Blu-ray Disc (BD), a semiconductor memory, etc. In addition, the digital signal may be recorded on these non-temporary recording media.
[0145] Furthermore, the present invention may be configured such that the computer program or the digital signal is transmitted via an electric communication line, a wireless or wired communication line, a network represented by the Internet, data broadcasting, or the like.
[0146] Furthermore, the present invention may be configured as a computer system including a microprocessor and a memory, wherein the memory stores the computer program and the microprocessor operates according to the computer program.
[0147] Furthermore, the program or the digital signal may be recorded on the non-transitory recording medium and transferred, or the program or the digital signal may be transferred via the network or the like so that the program or the digital signal can be executed by another independent computer system.
[0148] In addition, in each of the above-mentioned embodiments, each component may also include dedicated hardware, or be implemented by executing a software program suitable for each component. Each component may also be implemented by a program execution unit such as a central processing unit (CPU) or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.
[0149] Industrial Applicability
[0150] The input device of the present invention can be applied as, for example, a user interface for operating a device.
Claims
1. An input device for accepting a specific non-contact operation of an object on an operation screen, the input device comprising: A display control unit, causing the operation screen to be displayed on a display surface; A first detection unit detects a passing state of the object in a first sensing layer in the air formed opposite to the display surface; a second detection unit, detecting a passing state of the object in a second sensing layer formed in the air between the display surface and the first sensing layer; as well as a distance measurement operation unit, which calculates the position of the object in the first sensing layer based on the detection signal from the first detection unit, and calculates the position of the object in the second sensing layer based on the detection signal from the second detection unit; a determination unit that determines whether or not the specific non-contact operation of the object on the operation screen is performed based on the detection results of the first detection unit, the second detection unit, and the distance measurement operation unit, The first detection unit detects the number of the passing parts of the object in the first sensing layer, and the number is greater than 1. The second detection unit detects the number of passing locations of the object in the second sensing layer, and the number is greater than 1.
2. The input device according to claim 1, wherein the specific non-contact operation is a non-contact multi-point touch gesture of the object on the operation screen, The determination unit determines that the multi-touch gesture is performed when the object passes through two locations of the first sensing layer and two locations of the second sensing layer. 3 . The input device according to claim 1 , wherein the determination unit determines that the specific non-contact operation is not performed when the object passes through three or more locations of the first sensing layer and one or more locations of the second sensing layer.
4. The input device according to claim 1 or 2, wherein the display control unit causes a cursor to be displayed on the operation screen when the object passes through the first sensing layer. 5 . The input device according to claim 3 , wherein the display control unit causes a cursor to be displayed on the operation screen when the object passes through the first sensing layer.
6. The input device according to claim 1, wherein the first detection unit detects the size of the object at the first sensing layer. The second detection unit detects the presence or absence of the object in the second sensing layer. The determination unit determines that the specific non-contact operation has been performed when the size of the object in the first sensing layer is less than a threshold value and the object is detected in the second sensing layer, When the size of the object in the first sensing layer exceeds the threshold and the object is detected in the second sensing layer, it is determined that the specific non-contact operation is not performed.
7. The input device according to claim 1, wherein the input device further comprises: One or more third detection units detect the passing state of the object in one or more third sensing layers formed in the air between the display surface and the second sensing layer, The determination unit determines whether or not the specific non-contact operation of the object is performed based on detection results of each of the first detection unit, the second detection unit, the one or more third detection units, and the distance measurement calculation unit.
Citation Information
Patent Citations
Floating touch panel
JP2014067071A
Gesture input device and gesture input method
CN102906671A
Information processing device
CN103176711A
Touch control method, user equipment, input processing method, mobile terminal and intelligent terminal
CN105511675A
Display device, display control method and recording medium
CN108874216A
