Contactless operation device

Abstract

To provide a non-contact operation device which corresponds to motion of an indication part of a user without touching an operation tool, follows to keep a predetermined interval between the indication part and the operation tool, and performs operation corresponding to an actual operation device.SOLUTION: A non-contact operation device includes: indication part detection means 120 for detecting an arrangement state of an indication part of a user; arrangement state calculation means 140 for calculating a difference between an arrangement state just before present detection, and an arrangement state during the present detection, and calculating a following shift amount for following the motion of the indication part and moving an actual operation device and an operation tool; and following shift processing means 150 for performing following processing.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a non-contact operating device in which a movable operating tool follows the movement of the operator's pointing part at a predetermined interval without being touched by the user, and operates an actual operating device in response to that movement. [Background technology]

[0002] FIG. 7 is a diagram showing a conventional device. Patent Documents 7-A and 7-B are shown in Patent Documents 1 and 2. Both are input support devices for computers or the like, which identify predetermined operations such as selecting markers such as icons on a display surface. The device in Patent Document 2 imagines a predetermined surface (virtual touch panel) that is virtually placed a predetermined distance in front of the display surface for non-contact purposes, and arbitrarily divides the marker into multiple shapes, increasing the distance between them based on the distance the user's body part is away from the predetermined surface. The smaller the distance, the smaller the distance between the multiple shapes. In contrast, the device in Patent Document 1 is a user interface that allows non-contact operations according to the display screen, and identifies a predetermined input operation when a specific part of the user's body is held at a predetermined reference position and then moves, performing processing such as identifying and selecting icons. 7-C is disclosed in Patent Document 3, and differs from Patent Document 2 in that it also includes remote control. That is, it remotely and non-contactly controls the movement of a pointer such as a mouse on the display screen of a remote display control device located in a different location from the device itself, and is equipped with a housing having an image imaging plate that displays an aerial image in a three-dimensional space visible to the user, and a 3D sensor and control unit that detects the movement of the user's hand and recognizes gesture operations. 7-D is disclosed in Patent Document 4 and is an image display device for a user interface, which detects user operations according to the distance between the user's hand and a sensing unit that detects the user's hand, and controls the image displayed on the display device based on the detection results. 7-E is shown in Patent Document 5 and is capable of recognizing gesture operations in addition to pointing operations, and determines whether the user's input is a selection operation of a point area or a gesture operation based on the change in the shape of the user's hand in the captured image as the user's hand moves. Both of these are related to the selection and identification of icons on the image display of the user interface.

[0003] 7-F to 7-H are not related to the image display of the user interface, but rather to the operation of the device. 7-H is a well-known surgical light, and by gripping and moving the handle attached to the light, the light can be moved to any position and angle. While operation by hand is usually easy, it has the disadvantage of being an undesirable device in medical settings, where contact can pose a risk of infection. No. 7-F is disclosed in Patent Document 6, and relates to basic remote control in which operation data is transmitted by operating a master manipulator to remotely move a slave manipulator. 7-G is disclosed in Patent Document 7, and uses a three-dimensional sensor formed by stacking multiple optical sensors, each with a light grid for object detection formed inside a frame, in the thickness direction to detect the movement of an object and perform remote control without contact. Although this is one means related to the operation of a device, such sensors have the disadvantage that the entire device tends to become complex and large. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent Publication No. 2021-177313 [Patent Document 2] Patent Publication No. 2014-219938 [Patent Document 3] Patent Publication No. 2018-147054 [Patent Document 4] Patent Publication No. 2013-45217 [Patent Document 5] Patent Publication No. 2014-38527 [Patent Document 6] Patent Publication No. 2001-346808 [Patent Document 7] Patent Publication No. 2013-18074 Summary of the Invention [Problem to be solved by the invention]

[0005] The object of the present application is to provide a non-contact operating device that, when operating a real operating device, follows the movement of the instruction part by the user while maintaining a predetermined distance between the instruction part and the operating tool, without touching the operating tool that operates the real operating device, and performs an operation corresponding to the real operating device. [Means for solving the problem]

[0006] The following description is based on the claims. The invention described in claim 1 is a non-contact operation device, A control means and a control unit controlled by the control means. A working device; an instruction part detection means for detecting an instruction part used by a user to operate the actual operation device in a non-contact state according to the movement of the instruction part; an operating tool disposed near the instruction unit detection means and adapted to provide a movement by the instruction unit for driving the actual operation device; a positioning state calculation means for calculating a follow-up shift amount based on a difference between a positioning state at the time of current detection detected by the indicator detection means and a positioning state at the time of detection immediately before the current detection of the indicator; a tracking shift processing means for moving the operating tool in accordance with the instruction unit so as to maintain a predetermined distance from the instruction unit, and for moving the actual operation device in accordance with the instruction unit; an operation mode designation / detection means for the user to designate whether the instruction unit of the user is in a mode for operating the operation implement and / or to detect whether the instruction unit is in a mode for operating the operation implement; Equipped with The operating tool and the actual operation device are moved so as to follow the movement of the instruction unit based on the calculated amount of following shift, The tracking of the operating tool is performed based on the results of the tracking confirmation of the actual operating device.

[0007] The invention described in claim 2 is a non-contact operation device, A control means and a control unit controlled by the control means. A working device; an instruction part detection means for detecting an instruction part used by a user to operate the actual operation device in a non-contact state according to the movement of the instruction part; an operating tool disposed near the instruction unit detection means and adapted to provide a movement by the instruction unit for driving the actual operation device; a positioning state calculation means for calculating a follow-up shift amount based on a difference between a positioning state at the time of current detection detected by the indicator detection means and a positioning state at the time of detection immediately before the current detection of the indicator; a tracking shift processing means for moving the operating tool in accordance with the instruction unit so as to maintain a predetermined distance from the instruction unit, and for moving the actual operation device in accordance with the instruction unit; an operation mode designation / detection means for the user to designate whether the instruction unit of the user is in a mode for operating the operation implement and / or to detect whether the instruction unit is in a mode for operating the operation implement; Equipped with The operating tool and the actual operation device are moved so as to follow the movement of the instruction unit based on the calculated amount of following shift, The operating tool is a mechanical element controlled by the control means, and is characterized in that the user can operate the operating tool by means of the mechanical element.

[0008] The invention of claim 3 is the non-contact operation device of claim 2, The indicator detection means is attached to the mechanical element, and moves in accordance with the movement of the indicator, thereby substituting for the operating tool.

[0009] The invention described in claim 4 is a non-contact operation device, A control means and a control unit controlled by the control means. A working device; an instruction part detection means for detecting an instruction part used by a user to operate the actual operation device in a non-contact state according to the movement of the instruction part; an operating tool disposed near the instruction unit detection means and adapted to provide a movement by the instruction unit for driving the actual operation device; a positioning state calculation means for calculating a follow-up shift amount based on a difference between a positioning state at the time of current detection detected by the indicator detection means and a positioning state at the time of detection immediately before the current detection of the indicator; a tracking shift processing means for moving the operating tool in accordance with the instruction unit so as to maintain a predetermined distance from the instruction unit, and for moving the actual operation device in accordance with the instruction unit; an operation mode designation / detection means for the user to designate whether the instruction unit of the user is in a mode for operating the operation implement and / or to detect whether the instruction unit is in a mode for operating the operation implement; Equipped with The operating tool and the actual operation device are moved so as to follow the movement of the instruction unit based on the calculated amount of following shift, The operating tool is a display device that is controlled by the control device and is displayed digitally on a screen of a display device, and the user can operate the operating tool via the display device. and, by changing the operation mode of the operating tool to a mode of movement in a plane parallel to the screen by the indication unit and a mode of movement in a Z-axis direction perpendicular to the screen, The device is characterized by having a tilt operation mode means for specifying a tilt operation mode to set a mode for tilting from an X-axis or Y-axis parallel to the screen, or / and a mode for tilting from a Z-axis perpendicular to the screen, and / or for detecting that the operation of the instruction unit is in the tilt operation mode.

[0010] The invention described in claim 5 is a non-contact operation device, A control means and a control unit controlled by the control means. A working device; an instruction part detection means for detecting an instruction part used by a user to operate the actual operation device in a non-contact state according to the movement of the instruction part; an operating tool disposed near the instruction unit detection means and adapted to provide a movement by the instruction unit for driving the actual operation device; a positioning state calculation means for calculating a follow-up shift amount based on a difference between a positioning state at the time of current detection detected by the indicator detection means and a positioning state at the time of detection immediately before the current detection of the indicator; a tracking shift processing means for moving the operating tool in accordance with the instruction unit so as to maintain a predetermined distance from the instruction unit, and for moving the actual operation device in accordance with the instruction unit; an operation mode designation / detection means for the user to designate whether the instruction unit of the user is in a mode for operating the operation implement and / or to detect whether the instruction unit is in a mode for operating the operation implement; Equipped with The operating tool and the actual operation device are moved so as to follow the movement of the instruction unit based on the calculated amount of following shift, The operating tool is a display device that is controlled by the control device and is displayed digitally on a screen of a display device, and the user can operate the operating tool via the display device. The operating tool has a tilt display device, and by displaying the tilt display device on the display screen at a position that is different from the center position of the operating tool or a predetermined position, the tilt display device indicates the tilt from the X-axis or Y-axis parallel to the screen and the tilt from the Z-axis perpendicular to the screen, thereby enabling the operating tool to move with an incline.

[0011] The invention described in claim 6 is a non-contact operation device, A control means and a control unit controlled by the control means. A working device; an instruction part detection means for detecting an instruction part used by a user to operate the actual operation device in a non-contact state according to the movement of the instruction part; an operating tool disposed near the instruction unit detection means and adapted to provide a movement by the instruction unit for driving the actual operation device; a positioning state calculation means for calculating a follow-up shift amount based on a difference between a positioning state at the time of current detection detected by the indicator detection means and a positioning state at the time of detection immediately before the current detection of the indicator; a tracking shift processing means for moving the operating tool in accordance with the instruction unit so as to maintain a predetermined distance from the instruction unit, and for moving the actual operation device in accordance with the instruction unit; an operation mode designation / detection means for the user to designate whether the instruction unit of the user is in a mode for operating the operation implement and / or to detect whether the instruction unit is in a mode for operating the operation implement; Equipped with The operating tool and the actual operation device are moved so as to follow the movement of the instruction unit based on the calculated amount of following shift, The operating tool is a display device that is controlled by the control device and is displayed digitally on a screen of a display device, and the user can operate the operating tool via the display device. Furthermore, the image of the operating tool and the image of the actual operating device are displayed on the screen of the display means, making it easier for the user to check the operation. [Effects of the Invention]

[0012] As configured as described above, when the non-contact operating device of the present invention operates the actual operating device, it can follow the movement of the instruction part by the user without touching the operating tool that moves it, while maintaining a predetermined distance between the instruction part and the operating tool, and can perform an operation corresponding to the actual operating device. [Brief explanation of the drawings]

[0013] [Figure 1] 1 is a diagram showing an embodiment of the configuration of a non-contact operation device according to the present invention; [Figure 2] 1 is a diagram showing an embodiment of an operation flow of a non-contact operation device according to the present invention. [Figure 3] 1A and 1B are diagrams showing an embodiment of operation via a mechanical element in the non-contact operation device according to the present invention. [Figure 4] 1 is a diagram showing an embodiment of an operation via a display means in a non-contact operation device according to the present invention; [Figure 5] 10A and 10B are diagrams showing details of operations performed via a display means of the non-contact operation device according to the present invention. [Figure 6] 10A and 10B are diagrams showing an embodiment of displaying the tilt of the operating implement on the display means of the non-contact operating device according to the present invention; [Figure 7] FIG. 1 is a diagram showing a conventional operating device. DETAILED DESCRIPTION OF THE INVENTION

[0014] FIG. 1 is a diagram showing an embodiment of the configuration of a non-contact operating device according to the present invention. Before explaining this diagram, we will again explain a conventional device as an example. For example, in the device shown in 7-H of Fig. 7, when you grip and move the handle, the movable connection part of the shadowless lamp moves, allowing you to change its position. This is because force is applied to the movable connection part through the handle, causing it to move. In contrast, in the device of the present application, you can operate such a device, such as a shadowless lamp, without touching the handle. For example, by bringing your hand close to the operating tool corresponding to the handle (in a non-contact state), and starting to operate it, the operating tool will move in accordance with the movement of your hand, maintaining a predetermined distance from your hand, just as if you were gripping and moving the operating tool, and the actual operating device will operate in the same way.

[0015] In FIG. 1, there is a real operation device 110, an instruction unit detection means 120 for detecting an instruction unit such as a user's hand, finger, or head to operate the real operation device in a non-contact state by the movement of the instruction unit, an operating tool 130 that is preferably arranged near the instruction unit detection means and provides the movement of the instruction unit to drive the real operation device, and a control unit 130 for calculating the difference between the positional state of the instruction unit detected by the instruction unit detection means 120 relative to the operating tool 130 or the instruction unit detection means 120 at the time of current detection and the positional state at the time of detection immediately before the current detection, and for moving the real operation device following the movement of the instruction unit. The apparatus includes a positioning state calculation means 140 that calculates the amount of following shift of the actual operation device 110, a following shift processing means 150 that moves the actual operation device 110 by following the instruction unit based on the calculated amount of following shift and simultaneously moves the operating tool 130 by following the instruction unit while maintaining a predetermined distance from the instruction unit, and preferably a display means 160, an operation mode designation / detection means 180 that allows the user to designate whether or not the instruction unit of the user is in a mode for operating the operating tool and / or detects whether or not the instruction unit is in a mode for operating the operating tool, and a control means 190 that controls these. Note that the actual operation device 110 may be moved via a transmission means 170.

[0016] The indicator detection means 120 can use a camera that captures an image of the indicator and / or a distance measurement means such as an infrared sensor or laser sensor. The placement state calculation means 140 calculates the difference in placement state between the current detection and the detection immediately before the current detection from the data of the indicator detection means 120. To achieve precise tracking, indicator detection and placement state calculation are performed at appropriate time intervals, such as 0.1 seconds, and tracking shift processing is performed. Examples of the operation mode designation / detection means 180 include a foot switch, a voice-activated switch, or other hands-free switch that can be used to turn the operation mode on / off, or the operation mode can be turned on / off when a predetermined movement (gesture) of the user's hand, finger, or head is detected in an image captured by a camera.

[0017] FIG. 2 is a diagram showing an embodiment of the operation flow of the non-contact operation device according to the present invention. 1) Determine whether the operation mode is ON or OFF. When the operation mode is ON, 2) Detect the instruction unit (operator). 3) The arrangement state (movement direction, movement distance, tilt angle difference, etc.) of the operating tool and the indicator at the time of the current detection and the time of the detection immediately before the current detection is calculated, and the amount of tracking shift required to keep the relative arrangement constant is determined. 4) Performs tracking shift processing / display processing for driving actual operating devices and operating tools. Return to 1) at appropriate time intervals and repeat.

[0018] FIG. 3 shows one embodiment of operation via mechanical elements in the non-contact operation device according to the present invention. In FIG. 3-A, an operation tool 130 mounted on a mechanical element of an actual operation device 110 that is movable in the X, Y, Z, and / or θ directions (rotation and tilt) is operated with the instruction unit. The instruction unit is detected by instruction unit detection means 120, and the above-mentioned calculation of the placement state and the tracking shift process are performed via the mechanical element. In FIG. 3-B, the device is configured with mechanical elements connected to arms that are rotatable about three or more axes, and the rest is the same as in FIG. 3-A. In both cases, the tracking shift process is performed by electrically moving the movable elements of the mechanical element under the control of control means 190 shown in FIG. 1. The pointing unit detecting means 120 such as a camera can be used in place of the operating tool 130. In this case, the pointing unit detecting means 120 such as a camera moves in accordance with the pointing unit. The indicator detection means 120 itself must be installed on a movable mechanical element.

[0019] 4 is a diagram showing an embodiment of operation via display means in the non-contact operation device according to the present invention. The operation tool 130 is a display object within the screen of the digitally displayed display means, and is operated. As shown in 4-A, since the operating tool 130 (e.g., a marker (circle) on the operation screen) on the display unit screen is operated without contact, it is preferable that the indicator detection means 120 be attached to the display unit 160 itself or its periphery in order to detect the indicator. When the user's finger, which is the indicator in this example of the human body, moves diagonally downward, for example, relative to the marker serving as the operating tool 130 on the operation screen, as described above, the difference in the position of the indicator relative to the marker serving as the operating tool 130 between the detection immediately before the current detection (shown by the dotted line) and the current detection (shown by the solid line) is calculated. Based on this, the actual operating device 110 is moved, and the tracking shift processing means 150 performs a shift operation so that the marker follows the indicator and maintains a predetermined positional state. In this example, an image of the actual operating device 110 is displayed on the right side of the screen, allowing the user to feel the shift operation. In 4-B, as the indicator moves from point A to point B, the marker, which was initially at point a, moves to point b and finally becomes a large solid-line marker. The size of the marker changes from small to large at each point, indicating that it is moving away in the Z direction (perpendicular to the marker display) and closer to the user. Therefore, this figure indicates movement in the X, Y, and Z directions. 4-C shows that the marker that functions as the operating tool 130 is displayed larger the further it is from the display surface in the perpendicular direction (closer to the user). This display is based on the idea that the closer the indicator is to the user and the closer the operating tool 130 is to the user, the larger the operating tool 130 appears to the user's eyes.

[0020] FIG. 5 is a diagram showing details of operations performed via the display means of the non-contact operation device according to the present invention. The display states of the marker as the operating tool 130 at the time of detection immediately before the current detection (shown by dotted lines) and at the time of the current detection (shown by solid lines) of the user's pointing part are shown. In 5-A, the indicator is moved away from the display surface by ΔZ in the Z direction, and the size of the marker (operating tool) increases accordingly. 5-B is the opposite case to 5-A, where the indicator is moved closer to the display surface. 5-C is the case where the Z direction remains the same (the marker size remains unchanged) but the marker moves by ΔX and ΔY parallel to the screen (X and Y directions). 5-D is the case where the X, Y, and Z directions change, and is a combination of both 5-A and 5-C.

[0021] FIG. 6 is a diagram showing an embodiment of displaying the tilt of the operating implement on the display means of the non-contact operating device according to the present invention. 6-A shows the operating tool 130 on the display screen. In this example, it moves from the right side of the screen toward the left and downwards, approaching the user. In addition, at the final position (solid line and circle) on the screen, the operating tool 130 is tilted at an angle α from the Y axis (or the X axis) and an angle β from the Z axis, as indicated by the position of the tilt indicator 131. As shown in 6-B and 6-D, the tilt angle β from the Z axis is zero at the center of the circle and, for example, 90° (or 180°) on the circumference. The angle is distributed between these angles. In this example, the center of the circle is considered to be the reference position, and tilt is indicated by a position spaced apart from the center; however, it goes without saying that a predetermined position other than the center of the circle may be used as the reference position. Although it is possible to express the shape as other than a circle, for example, as a polygon such as an octagon, a circle is the most appropriate. Also, as in 6-C, it is possible to display the center position (reference position without tilt) and the alternate edge of the circumference that indicates the position that hits the circumference, without displaying the circle. When the user operates the tilting mechanism, the tilting mechanism must be tilted by moving the indicator. To this end, tilting operation mode means 200 is provided in the operation mode designation / detection means, the indicator detection means 120, or the like, and performs the following operations. For example, pressing the foot switch once enters the operation mode, and the indicator can move within the X-axis and Y-axis planes parallel to the display screen. However, if the foot switch is continued to be pressed in the operation mode, the tilt operation mode means 200 detects this and switches to tilt operation mode, and the indicator can move not within the X-axis and Y-axis planes but by tilting from the Z-axis perpendicular to the display screen. To cancel the tilt operation mode, the foot switch that has been pressed can be released. To cancel the operation mode, the foot switch can be pressed twice in succession with a short time interval, like a "tap tap." As an example without using a foot switch, the tilt operation mode can be specified by voice, or by holding up a specific finger, such as the little finger, in a so-called gesture state. The tilt operation mode can then be specified, and the tilt operation mode means 200 can detect this gesture from the output of the indicator detection means 120 and respond to the tilt operation by operation.

[0022] Furthermore, it is convenient that the quantitative relationship between the movement of the indicator and the movement of the actual operation device can be determined not only one-to-one but also by a predetermined or required magnification factor that can be applied at any time. In other words, the movement of the actual operation device can be made larger (for large movements) or smaller (for precise movements) than the movement of the indicator. This is particularly easy when operating via a display means. Furthermore, the movement of the actual operation device following the movement of the instruction unit naturally includes cases where the amount of movement or the direction of movement is different from the movement of the operation tool, as described above in the description of the magnification. For example, this includes cases where the actual movement is a larger amount of movement (the above magnification) than the operation tool and moves in the opposite direction. Furthermore, the control device can receive an execution result signal indicating that a remote actual operation device has performed a shift process, and can display the tracking of the operating tool after confirming the execution. In addition, when in operation mode, the standby mode for terminating or interrupting operation is the same as turning off the operation mode. In addition, when specifying the operation mode of the operation mode specifying / detecting means, it is advantageous to have an operation axis fixing means for fixing any axis among the X, Y, and Z axes to eliminate deviation during operation, or for specifying the axis to be moved. [Industrial Applicability]

[0023] As described above, the non-contact operating device of the present invention can, when operating an actual operating device, follow the movement of the indicator by the user without touching the operating tool that moves it, while maintaining a predetermined distance between the indicator and the operating tool, and can perform a following operation that corresponds to the actual operating device, making it extremely advantageous for industrial use.

[0024] 110 Actual operating device 120 indicator detection means 130 Operating tools 131 Tilt indicator 140 Placement state calculation means 150 Follow-up shift processing means 160 Display means 170 Means of communication 180 Operation mode designation and detection means 190 Control Means 200 tilt operation mode means

Claims

1. A control means and a control unit controlled by the control means. A working device; an instruction part detection means for detecting an instruction part used by a user to operate the actual operation device in a non-contact state according to the movement of the instruction part; an operating tool disposed near the instruction unit detection means and adapted to provide a movement by the instruction unit for driving the actual operation device; a positioning state calculation means for calculating a tracking shift amount based on a difference between a positioning state at the time of current detection detected by the indicator detection means and a positioning state at the time of detection immediately before the current detection of the indicator; a tracking shift processing means for moving the operating tool in accordance with the instruction unit so as to maintain a predetermined distance from the instruction unit, and for moving the actual operation device in accordance with the instruction unit; an operation mode designation / detection means for the user to designate whether the instruction unit of the user is in a mode for operating the operation implement and / or to detect whether the instruction unit is in a mode for operating the operation implement; Equipped with The operating tool and the actual operation device are moved so as to follow the movement of the instruction unit based on the calculated amount of following shift, A non-contact operating device characterized in that the operating implement is tracked based on the results of the tracked operation confirmation of the actual operating device.

2. A control means and a control unit controlled by the control means. A working device; an instruction part detection means for detecting an instruction part used by a user to operate the actual operation device in a non-contact state according to the movement of the instruction part; an operating tool disposed near the instruction unit detection means and adapted to provide a movement by the instruction unit for driving the actual operation device; a positioning state calculation means for calculating a tracking shift amount based on a difference between a positioning state at the time of current detection detected by the indicator detection means and a positioning state at the time of detection immediately before the current detection of the indicator; a tracking shift processing means for moving the operating tool in accordance with the instruction unit so as to maintain a predetermined distance from the instruction unit, and for moving the actual operation device in accordance with the instruction unit; an operation mode designation / detection means for the user to designate whether the instruction unit of the user is in a mode for operating the operation implement and / or to detect whether the instruction unit is in a mode for operating the operation implement; Equipped with The operating tool and the actual operation device are moved so as to follow the movement of the instruction unit based on the calculated amount of following shift, The operating tool is a mechanical element controlled by the control means, and the non-contact operating device is characterized in that the user can perform an operation using the mechanical element.

3. The non-contact operating device according to claim 2, characterized in that the indicator detection means is attached to the mechanical element, and the indicator detection means moves in accordance with the movement of the indicator, thereby substituting for the operating tool.

4. A control means and a control unit controlled by the control means. A working device; an instruction part detection means for detecting an instruction part used by a user to operate the actual operation device in a non-contact state according to the movement of the instruction part; an operating tool disposed near the instruction unit detection means and adapted to provide a movement by the instruction unit for driving the actual operation device; a positioning state calculation means for calculating a tracking shift amount based on a difference between a positioning state at the time of current detection detected by the indicator detection means and a positioning state at the time of detection immediately before the current detection of the indicator; a tracking shift processing means for moving the operating tool in accordance with the instruction unit so as to maintain a predetermined distance from the instruction unit, and for moving the actual operation device in accordance with the instruction unit; an operation mode designation / detection means for the user to designate whether the instruction unit of the user is in a mode for operating the operation implement and / or to detect whether the instruction unit is in a mode for operating the operation implement; Equipped with The operating tool and the actual operation device are moved so as to follow the movement of the instruction unit based on the calculated amount of following shift, The operating tool is a display device that is controlled by the control device and is displayed digitally on a screen of a display device, and the user can operate the operating tool via the display device. and, by changing the operation mode of the operating tool to a mode of movement in a plane parallel to the screen by the instruction unit and a mode of movement in a Z-axis direction perpendicular to the screen, A non-contact operation device characterized by having a tilt operation mode means for specifying a tilt operation mode to set a mode for tilting from an X-axis or Y-axis parallel to the screen, or / and a mode for tilting from a Z-axis perpendicular to the screen, and / or for detecting that the operation of the instruction unit is in the tilt operation mode.

5. A control means and a control unit controlled by the control means. A working device; an instruction part detection means for detecting an instruction part used by a user to operate the actual operation device in a non-contact state according to the movement of the instruction part; an operating tool disposed near the instruction unit detection means and adapted to provide a movement by the instruction unit for driving the actual operation device; a positioning state calculation means for calculating a tracking shift amount based on a difference between a positioning state at the time of current detection detected by the indicator detection means and a positioning state at the time of detection immediately before the current detection of the indicator; a tracking shift processing means for moving the operating tool in accordance with the instruction unit so as to maintain a predetermined distance from the instruction unit, and for moving the actual operation device in accordance with the instruction unit; an operation mode designation / detection means for the user to designate whether the instruction unit of the user is in a mode for operating the operation implement and / or to detect whether the instruction unit is in a mode for operating the operation implement; Equipped with The operating tool and the actual operation device are moved so as to follow the movement of the instruction unit based on the calculated amount of following shift, The operating tool is a display device that is controlled by the control device and is displayed digitally on a screen of a display device, and the user can operate the operating tool via the display device. The operating tool has a tilt display device, and by displaying the tilt display device on the display screen at a position that is different from the center position of the operating tool or a predetermined position, the tilt display device indicates the tilt from the X-axis or Y-axis parallel to the screen and the tilt from the Z-axis perpendicular to the screen, thereby enabling the operating tool to move with an inclination.

6. A control means and a control unit controlled by the control means. A working device; an instruction part detection means for detecting an instruction part used by a user to operate the actual operation device in a non-contact state according to the movement of the instruction part; an operating tool disposed near the instruction unit detection means and adapted to provide a movement by the instruction unit for driving the actual operation device; a positioning state calculation means for calculating a tracking shift amount based on a difference between a positioning state at the time of current detection detected by the indicator detection means and a positioning state at the time of detection immediately before the current detection of the indicator; a tracking shift processing means for moving the operating tool in accordance with the instruction unit so as to maintain a predetermined distance from the instruction unit, and for moving the actual operation device in accordance with the instruction unit; an operation mode designation / detection means for the user to designate whether the instruction unit of the user is in a mode for operating the operation implement and / or to detect whether the instruction unit is in a mode for operating the operation implement; Equipped with The operating tool and the actual operation device are moved so as to follow the movement of the instruction unit based on the calculated amount of following shift, The operating tool is a display device that is controlled by the control device and is displayed digitally on a screen of a display device, and the user can operate the operating tool via the display device. and a non-contact operation device characterized in that the image of the operating tool and the image of the actual operating device are displayed on the screen of the display means, thereby making it easier for the user to confirm the operation.

Images