Non-contact input device, non-contact input system, and program

Abstract

To provide a non-contact input device in which a display unit for receiving a touch operation can be operated.SOLUTION: A non-contact input device includes an image forming unit that forms a display image of a display unit receiving a touch operation, as an aerial image in the air, a detection unit that detects information concerning a user operation to the aerial image corresponding to the touch operation, and a control unit that sends information concerning the operation to the display unit.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to a non-contact input device, a non-contact input system, and a program. [Background technology]

[0002] Conventionally, there has been known a non-contact input device that focuses an image displayed on a display unit of an image display device on an imaging plane in the air and displays the image (hereinafter referred to as an aerial image) on the imaging plane, as disclosed in Patent Document 1. Such a non-contact input device has an imaging unit that focuses an image displayed on the display unit as an aerial image. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2014-67071 Summary of the Invention [Problem to be solved by the invention]

[0004] In the case of the non-contact input device described above, the display unit is pre-installed in the non-contact input device, and therefore, it is not intended to use a display unit that can accept touch operations.

[0005] An object of the present invention is to provide a non-contact input device, a non-contact input system, and a program that can operate a display unit that accepts touch operations. [Means for solving the problem]

[0006] One aspect of the non-contact input device according to the present invention is an imaging unit that forms an aerial image in the air from an image displayed on a display unit that accepts touch operations; a detection unit that detects information about a user's operation on the aerial image corresponding to a touch operation; and a control unit that sends information about the operation to the display unit.

[0007] One aspect of the non-contact input system according to the present invention is a terminal having a display unit that accepts touch operations; The non-contact input device is provided.

[0008] One aspect of the program according to the present invention is A program that operates on a terminal that is incorporated into the non-contact input device and has a display unit that accepts touch operations, By executing the program, the terminal Acquire information about the operation from the non-contact input device; converting the acquired operation information into operation information corresponding to the touch operation; The display on the display unit of the terminal is controlled based on the operation information. [Effects of the Invention]

[0009] According to the present invention, it is possible to provide a non-contact input device, a non-contact input system, and a program that can operate a display unit that accepts touch operations. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is a perspective view of a non-contact input system according to an embodiment of the present invention. [Figure 2] FIG. 2 is a cross-sectional view of a non-contact input system. [Figure 3] FIG. 3 is a functional block diagram of the non-contact input system. [Figure 4] FIG. 4 is a schematic diagram showing a state in which a user operates an aerial image. [Figure 5] FIG. 5 is a cross-sectional view of a non-contact input device according to the first modification. [Figure 6] FIG. 6 is a cross-sectional view of a non-contact input device according to the second modification. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, examples of a non-contact input device, a non-contact input system, and a program according to the present invention will be described in detail with reference to the drawings. Note that the non-contact input device, the non-contact input system, and the program described below are examples of the non-contact input device, the non-contact input system, and the program according to the present invention, and the present invention is not limited to the embodiments described below.

[0012] [Embodiment] The configurations of the non-contact input system A and the non-contact input device 1 will be described with reference to FIGS.

[0013] Fig. 1 is a perspective view of a non-contact input system A. Fig. 2 is a cross-sectional view of the non-contact input device 1. In Fig. 2, the magnitude relationship between the user U and the non-contact input system A differs from the actual magnitude relationship.

[0014] The non-contact input system A is a device equipped with a so-called air display, which projects information and images into the air.

[0015] The non-contact input system A is used as a terminal for a user U to input information or a terminal for a user U to obtain information in various places (stores, public facilities, medical facilities, factories, etc.).

[0016] In particular, in the case of the non-contact input system A according to this embodiment, a terminal (for example, a smartphone or a tablet) personally owned by the user U can be used as a display unit 81 (see FIG. 2) described later. Such a terminal has a display unit (for example, a display) that accepts touch operations.

[0017] The non-contact input system A forms an aerial image from an image displayed on a display unit 81 of the terminal of the user U. The user U operates the terminal by operating the aerial image instead of touching the display unit of the terminal. In other words, the user U operates the terminal via the aerial image.

[0018] In the following description, when explaining the structures of the non-contact input system A and the non-contact input device 1, the Cartesian coordinate system (X, Y, Z) shown in FIGS. 1 and 2 may be used. The X direction corresponds to the front-to-back direction of the non-contact input system A and the non-contact input device 1. The positive side of the X direction corresponds to the front side of the non-contact input system A and the non-contact input device 1. The negative side of the X direction corresponds to the rear side of the non-contact input system A and the non-contact input device 1.

[0019] Furthermore, the Y direction corresponds to the left-right direction and width direction of the non-contact input system A and the non-contact input device 1. The + side of the Y direction corresponds to the left side when the non-contact input system A and the non-contact input device 1 are viewed from the front of the non-contact input system A and the non-contact input device 1. The - side of the Y direction corresponds to the right side when the non-contact input system A and the non-contact input device 1 are viewed from the front of the non-contact input system A and the non-contact input device 1.

[0020] The Z direction corresponds to the up-down direction of the non-contact input system A and the non-contact input device 1. The +Z direction side corresponds to the upper side of the non-contact input system A and the non-contact input device 1. The -Z direction side corresponds to the lower side of the non-contact input system A and the non-contact input device 1.

[0021] The non-contact input system A includes a non-contact input device 1 and a terminal 8 .

[0022] The non-contact input device 1 includes a housing 2, an imaging unit 3, a light adjusting unit 4, an input detecting unit 5, and a control unit 6.

[0023] Non-contact input device 1 according to this embodiment is a so-called horizontally placed non-contact input device. In the case of a horizontally placed non-contact input device, aerial image G1 is displayed above imaging unit 3 of non-contact input device 1, as shown in Fig. 2. Note that the non-contact input device is not limited to a horizontally placed non-contact input device.

[0024] The non-contact input device may be a so-called vertically-placed non-contact input device. A vertically-placed non-contact input device has a configuration similar to that of non-contact input device 1 shown in Fig. 2 rotated 90° counterclockwise in Fig. 2. In the case of a vertically-placed non-contact input device, aerial image G1 is displayed in front of imaging unit 3 of non-contact input device 1.

[0025] The non-contact input device 1 according to this embodiment may be used in a state where it is fixed to a predetermined place as a first usage mode, or may be used in a state where it is not fixed to a predetermined place as a second usage mode.

[0026] When the non-contact input device 1 is used in the second usage mode, it is preferable that the size of the non-contact input device 1 be small enough for the user U to carry around.

[0027] The housing 2 is box-shaped and is a member for housing or supporting each element that constitutes the non-contact input device 1. In this embodiment, the housing 2 is a rectangular parallelepiped that is long in the front-rear direction.

[0028] However, the shape of the housing is not limited to the shape of the housing 2 of this embodiment. The shape of the housing may be determined appropriately depending on the environment in which the non-contact input device 1 is used. The shape of the housing 2 is not limited to a box shape. The shape of the housing 2 may be various shapes that can accommodate or support each element that constitutes the non-contact input device 1.

[0029] The housing 2 has a front plate 2a, a rear plate 2b, a left plate 2c, a right plate 2d, and a bottom plate 2e. The front plate 2a, the rear plate 2b, the left plate 2c, the right plate 2d, and the bottom plate 2e are combined to form a box shape that is open at the top.

[0030] The housing 2 has an accommodating space 21, an insertion opening 22, and a support portion .

[0031] The accommodation space 21 is a space surrounded by the front plate portion 2a, the rear plate portion 2b, the left plate portion 2c, the right plate portion 2d, and the bottom plate portion 2e.

[0032] The insertion opening 22 is provided in the right side plate portion 2d. The insertion opening 22 is a through-hole that passes through the right side plate portion 2d in the left-right direction. The insertion opening 22 has a shape and size that allows the terminal 8 (see FIG. 2) to pass through. The outer opening of the insertion opening 22 may be closed by, for example, a cover member (not shown).

[0033] A user U attaches a first end of a cable (not shown) to a terminal 8 in the external space of the non-contact input device 1. The cable connects the terminal 8 to the control unit 6. A second end of the cable is connected to the control unit 6.

[0034] After attaching a cable to the terminal 8, the user U inserts the terminal 8 from the external space of the housing 2 into the accommodation space 21 through the insertion port 22. The terminal 8 inserted into the accommodation space 21 through the insertion port 22 may be automatically supported by a support portion 23 described below.

[0035] The configuration of the insertion slot is not limited to the above-described configuration of insertion slot 22. Modified examples of the insertion slot will be described with reference to Figs.

[0036] 5 is a cross-sectional view of a non-contact input system Aa according to Modification 1. The non-contact input system Aa has a different configuration of an insertion slot 22a from the insertion slot 22 of the non-contact input system A according to the above-described embodiment.

[0037] Specifically, the insertion opening 22a is provided in the bottom plate portion 2e. The insertion opening 22a is a through-hole that passes through the bottom plate portion 2e in the vertical direction. The insertion opening 22a has a shape and size that allows the terminal 8 to pass through. The outer opening of the insertion opening 22a may be closed by, for example, a cover member (not shown).

[0038] A user U attaches a first end of a cable (not shown) to a terminal 8 in the external space of the non-contact input device 1. The cable connects the terminal 8 to the control unit 6. A second end of the cable is connected to the control unit 6.

[0039] After attaching a cable to the terminal 8, the user U inserts the terminal 8 from the external space of the housing 2 into the accommodation space 21 through the insertion opening 22a. The terminal 8 inserted into the accommodation space 21 through the insertion opening 22a may be automatically supported by the support portion 23.

[0040] In the case of the non-contact input system Aa according to the first modification, the insertion slot 22a is provided in the bottom plate portion 2e. This configuration can prevent light from the external space from entering the accommodation space 21 through the insertion slot 22a.

[0041] 6 is a cross-sectional view of a non-contact input system Ab according to Modification 2. The non-contact input system Ab has a different configuration of an insertion slot 22b from the insertion slot 22 of the non-contact input system A according to the above embodiment.

[0042] Specifically, the insertion opening 22b is provided in the front side plate portion 2a. The insertion opening 22b is a through-hole that penetrates the front side plate portion 2a in the front-rear direction. The insertion opening 22b has a shape and size that allows the terminal 8 to pass through. The outer opening of the insertion opening 22b may be closed by, for example, a cover member (not shown).

[0043] A user U attaches a first end of a cable (not shown) to a terminal 8 in the external space of the non-contact input device 1. The cable connects the terminal 8 to the control unit 6. A second end of the cable is connected to the control unit 6.

[0044] After attaching a cable to the terminal 8, the user U inserts the terminal 8 from the external space of the housing 2 into the accommodation space 21 through the insertion opening 22b. The terminal 8 inserted into the accommodation space 21 through the insertion opening 22b may be automatically supported by the support portion 23.

[0045] The support portion 23 is provided in the storage space 21. The support portion 23 supports the terminal 8, which will be described later. Specifically, the support portion 23 detachably supports the terminal 8. The support portion 23 is also capable of adjusting the angle θ1 (see FIG. 2) of the terminal 8. The support portion 23 is also capable of adjusting the height of the terminal 8.

[0046] The operation of the support unit 23 may be controlled by the control unit 6, which will be described later. For example, under the control of the control unit 6, the support unit 23 switches between a state in which the terminal 8 is attached to the support unit 23 and a state in which the terminal 8 is detached from the support unit 23.

[0047] When the terminal 8 is detached from the support part 23, the support part 23 may eject the terminal 8 from the accommodation space 21 to the external space. At this time, the terminal 8 passes through the insertion opening 22 and moves from the accommodation space 21 to the external space.

[0048] Furthermore, for example, the support unit 23 adjusts the angle of the terminal 8 under the control of the control unit 6. Furthermore, the support unit 23 adjusts the height of the terminal 8 under the control of the control unit 6. Note that the control unit 6 may control the operation of the support unit 23 based on an operation input by the user U.

[0049] The housing 2 has a light absorbing section 24 that absorbs light other than the light to be imaged within the housing 2 (that is, the accommodation space 21).

[0050] The light to be imaged is light of the display image displayed by display unit 81 of terminal 8, which will be described later, that is imaged as aerial image G1 on imaging surface S by imaging unit 3, which will be described later. Light other than the light to be imaged is light of the display image displayed by display unit 81 of terminal 8 that is not imaged as aerial image G1 on imaging surface S by imaging unit 3, which will be described later.

[0051] The light absorbing portion 24 is, for example, a black sheet. The light absorbing portion 24 is provided on the inner surface of the housing 2. In other words, the light absorbing portion 24 is provided on the inner surfaces of the front plate portion 2a, the rear plate portion 2b, the left plate portion 2c, the right plate portion 2d, and the bottom plate portion 2e.

[0052] The housing 2 also has sound transmission units 25 on the side plates (specifically, the left side plate 2c and the right side plate 2d) of the housing 2. The sound transmission units 25 transmit sounds generated by the terminal 8 in the internal space of the housing 2 (i.e., the storage space 21) to the external space of the housing 2.

[0053] In this embodiment, the sound transmission part 25 is configured by a plurality of through holes provided in the left side plate part 2c and the right side plate part 2d. Note that the sound transmission part 25 provided in the left side plate part 2c is omitted in Fig. 1. The sound transmission part 25 provided in the left side plate part 2c is provided in a position facing the sound transmission part 25 provided in the right side plate part 2d in the left-right direction.

[0054] Sound generated by the terminal 8 in the internal space of the housing 2 (that is, the storage space 21) is transmitted to the external space through the sound transmission parts 25 provided on the left and right plate parts 2c and 2d.

[0055] The housing 2 may also have a shock absorbing mechanism (not shown). The shock absorbing mechanism absorbs shock acting on the housing 2. The shock acting on the housing 2 is, for example, shock acting on the housing 2 when the non-contact input device 1 is dropped.

[0056] The shock absorbing mechanism may be a cushioning material made of, for example, polyurethane foam, polystyrene, polypropylene, or polystyrene. The shock absorbing mechanism may be provided on the front plate portion 2a, the rear plate portion 2b, the left plate portion 2c, the right plate portion 2d, and the bottom plate portion 2e. The shock absorbing mechanism may be provided on the inner surface and / or outer surface of the front plate portion 2a, the rear plate portion 2b, the left plate portion 2c, the right plate portion 2d, and the bottom plate portion 2e.

[0057] The shock absorbing mechanism may be embedded in the front plate 2 a, the rear plate 2 b, the left plate 2 c, the right plate 2 d, and the bottom plate 2 e. Such a shock absorbing mechanism can prevent the non-contact input device 1 from being damaged by a shock.

[0058] The housing 2 may also have a heat insulating mechanism (not shown). The heat insulating mechanism prevents heat from the external space of the housing 2 from being transferred to the internal space of the housing 2.

[0059] The heat insulating mechanism may be a heat insulating material made of, for example, foamed polyurethane, polystyrene, polypropylene, or polystyrene. The heat insulating mechanism may be provided on the front plate portion 2a, the rear plate portion 2b, the left plate portion 2c, the right plate portion 2d, and the bottom plate portion 2e. The heat insulating mechanism may be provided on the inner surface and / or outer surface of the front plate portion 2a, the rear plate portion 2b, the left plate portion 2c, the right plate portion 2d, and the bottom plate portion 2e.

[0060] The heat insulating mechanism may be embedded in the front plate 2 a, the rear plate 2 b, the left plate 2 c, the right plate 2 d, and the bottom plate 2 e. Such a heat insulating mechanism can prevent malfunction of the components (e.g., terminal 8) constituting the non-contact input device 1 due to high or low temperatures.

[0061] Therefore, by incorporating the terminal 8 into the non-contact input device 1, the user U can use the terminal 8 even in a severe temperature environment where the terminal 8 cannot be used.

[0062] The housing 2 may also have a waterproof mechanism (not shown). The waterproof mechanism prevents water from the external space of the housing 2 from entering the internal space of the housing 2 (that is, the storage space 21).

[0063] The waterproof mechanism may be a sealant made of, for example, silicone or urethane. The waterproof mechanism may be provided at the boundary between the housing 2 and the imaging unit 3, which will be described later. The waterproof mechanism may be provided in a gap in the housing 2 that allows water to pass from the external space to the internal space.

[0064] Such a waterproof mechanism can prevent the components (for example, the terminal 8) constituting the non-contact input device 1 from coming into contact with water. Therefore, the user U can use the terminal 8 by incorporating the terminal 8 into the non-contact input device 1 in an environment where water is present in the external space.

[0065] As shown in Figure 2, imaging unit 3 is a plate-shaped member. Imaging unit 3 is made of transparent resin or glass. Imaging unit 3 is arranged parallel in the front-to-back and left-to-right directions. Imaging unit 3 forms an image of the image displayed on display unit 81 on imaging surface S as an aerial image G1.

[0066] In this embodiment, the imaging unit 3 has a plurality of light-reflecting surfaces (not shown). As shown in Fig. 2, light of a display image on the display unit 81 is incident on the imaging unit 3 from the direction indicated by arrow A1. Hereinafter, the light of the display image incident on the imaging unit 3 may also be referred to as "incident light related to the display image."

[0067] Incident light related to the display image is reflected multiple times (for example, twice) by multiple light-reflecting surfaces and emitted from imaging unit 3 in the direction indicated by arrow A2 in Figure 2. The emitted light related to the display image is then imaged as aerial image G1 on imaging surface S. The light of the display image emitted from imaging unit 3 is sometimes referred to as "emitted light related to the display image."

[0068] The incident angle of the incident light relative to the display image is equal to the inclination angle θ1 of the display unit 81 relative to the virtual line α1. In this embodiment, the incident angle of the incident light relative to the display image is 45°. In addition, the exit angle of the exit light relative to the display image is equal to the incident angle of the incident light relative to the display image. In this embodiment, the exit angle of the exit light relative to the display image is 45°.

[0069] The light adjusting unit 4 suppresses leakage of light other than the light to be imaged in the emitted light related to the display image into the air through the imaging unit 3. Note that the light adjusting unit 4 does not need to suppress leakage of all light other than the light to be imaged in the emitted light related to the display image.

[0070] The light adjustment unit 4 also passes light to be imaged in the emitted light related to the display image, and blocks light directed from the display unit 81 of the terminal 8 toward the user U in use (i.e., the user U in FIG. 2).

[0071] With this configuration, light directed from display unit 81 toward user U in use is blocked, making display unit 81 invisible to user U. As a result, the visibility of aerial image G1 can be improved.

[0072] The light adjusting unit 4 is provided on the outer surface (sometimes referred to as the first surface) of the imaging unit 3. Specifically, the light adjusting unit 4 is made up of a louver film.

[0073] The light adjusting section 4 is not limited to a louver film, and may be any of various members that can achieve the same function as a louver film.

[0074] In this way, because light adjustment unit 4 is provided on the outer surface of imaging unit 3, light reflected from the surface of terminal 8 (in other words, display unit 81) can be blocked by light adjustment unit 4. This makes it possible to make terminal 8 (in other words, display unit 81) invisible to user U when in use. As a result, the visibility of aerial image G1 can be improved.

[0075] Furthermore, in this embodiment, it is possible to block light reflected by the surfaces of components housed in housing 2 or light emitted by components housed in housing 2. This makes it possible to prevent user U from seeing the components housed in housing 2 when in use. From this perspective as well, this embodiment can improve the visibility of aerial image G1.

[0076] In this embodiment, the light adjusting section 4 has a pattern (that is, a design) on the upper surface (that is, the outer surface). Such a configuration can improve the design of the non-contact input device 1.

[0077] Furthermore, by forming the pattern on the upper surface of the light adjusting part 4 in accordance with the environment in which the non-contact input device 1 is used, the non-contact input device 1 can be made to blend in with the environment in which it is used.

[0078] The position of the light adjusting unit is not limited to the position of the above-described light adjusting unit 4. For example, the light adjusting unit may be provided on the inner surface of the imaging unit 3 (sometimes referred to as the second surface).

[0079] Furthermore, the light adjustment unit may be provided on the surface of the display unit 81 of the terminal 8. In the present embodiment, the terminal 8 is owned by the user U. Therefore, when a configuration is adopted in which the light adjustment unit is provided on the surface of the display unit 81, it is preferable that the light adjustment unit be configured to be detachable from the display unit 81.

[0080] Furthermore, the light adjusting unit may be provided at a predetermined position between the terminal 8 and the imaging unit 3 in the housing space 21 of the housing 2.

[0081] Input detection unit 5 is an example of a detection unit, and detects information (hereinafter referred to as operation input information) related to an operation input by user U (see FIG. 2) to aerial image G1. The operation input by user U (see FIG. 2) to aerial image G1 corresponds to a touch operation received from user U by display unit 81 of terminal 8.

[0082] The input detection unit 5 sends the detected operation input information to the control unit 6. The input detection unit 5 is supported by the housing 2. However, the input detection unit 5 may be provided in a location other than the housing 2.

[0083] The input detection unit 5 is composed of a plurality of sensors (not shown). The sensors constituting the input detection unit 5 are, for example, motion sensors that detect the input action of the user U. In other words, the input detection unit 5 detects information relating to the input action of the user U (also referred to as input action information). The input action information may be included in the operation input information.

[0084] Input detection unit 5 detects, for example, information (also referred to as operation position information) relating to the position in aerial image G1 operated by user U. The operation position information may be included in the operation input information.

[0085] The operation position information may be, for example, information about coordinates in the aerial image G1 (also referred to as operation coordinate information). The operation coordinate information may be three-dimensional coordinates consisting of coordinates in the X direction, coordinates in the Y direction, and coordinates in the Z direction.

[0086] Hereinafter, the coordinate in the X direction of aerial image G1 will be referred to as the X coordinate of aerial image G1, the coordinate in the Y direction of aerial image G1 will be referred to as the Y coordinate of aerial image G1, and the coordinate in the Z direction of aerial image G1 will be referred to as the Z coordinate of aerial image G1.

[0087] The X coordinate of aerial image G1 corresponds to the X coordinate of the display image displayed by display unit 81. The Y coordinate of aerial image G1 corresponds to the Y coordinate of the display image displayed by display unit 81.

[0088] When the display image displayed by display unit 81 corresponds to a three-dimensional image, the Z coordinate of aerial image G1 corresponds to the Z coordinate of the display image displayed by display unit 81.

[0089] As described above, the coordinates of aerial image G1 correspond to the coordinates of the display image displayed by display unit 81, and therefore, an operation by user U on aerial image G1 corresponds to an operation by user U on the display image displayed by display unit 81. In other words, user U can operate the display image of display unit 81 by operating aerial image G1.

[0090] In this embodiment, the input action of the user U detected by the input detection unit 5 corresponds to the input action received by the display unit 81 from the user U.

[0091] The input actions of the user U may include, for example, a tap action, a double tap action, a long tap action, a swipe action, a flick action, a drag action, a multi-tap action, a multi-swipe action, a pinch-in action, and a pinch-out action, as well as three-dimensional actions that cannot be performed on a touch panel. Three-dimensional actions may include, for example, pinching and stretching an image, flicking an image with a finger, and the like.

[0092] The tapping action is an action in which user U lightly taps aerial image G1 with finger F (see FIG. 4).

[0093] A double tap action is an action in which user U taps aerial image G1 with finger F twice at a short interval.

[0094] A long tap action is an action in which user U presses one spot on aerial image G1 with finger F for a predetermined time (for example, one second).

[0095] The swipe action is an action in which user U moves finger F up, down, left, and right while pressing aerial image G1 with finger F.

[0096] The flick action is a motion in which the finger F is placed on the screen and then swept up, down, left, and right.

[0097] A dragging motion is a motion in which user U presses and holds one point on aerial image G1 with finger F for a predetermined time (for example, one second), and then moves finger F while still touching aerial image G1.

[0098] Moreover, a multi-tap action is an action in which user U taps aerial image G1 with two or more fingers F simultaneously.

[0099] The multi-swipe action is an action in which user U touches aerial image G1 with two or more fingers F and moves fingers F up, down, left, and right.

[0100] The pinch-in motion is a motion in which user U touches aerial image G1 with two fingers F apart and narrows the distance between the two fingers F.

[0101] The pinch-out motion is a motion in which user U touches aerial image G1 with two fingers F apart and then widens the distance between the two fingers F.

[0102] The control unit 6 sends the operation input information acquired from the input detection unit 5 to the terminal 8 (in other words, the display unit).

[0103] The control unit 6 may actually be configured such that a CPU, a ROM, a RAM, and a HDD are connected via a bus, or may be configured such as a one-chip LSI.

[0104] Next, a description will be given of the terminal 8. The terminal 8 is, for example, a smartphone or tablet owned by the user U.

[0105] The terminal 8 is inserted into the housing space 21 of the housing 2 through the insertion opening 22 of the housing 2. Then, the terminal 8 is supported by the support portion 23 of the housing 2. While being supported by the support portion 23, the terminal 8 is connected to the non-contact input device 1 (specifically, the control unit 6) in a communicable state.

[0106] The terminal 8 and the non-contact input device 1 (specifically, the control unit 6) may be connected by wire or wirelessly.

[0107] The terminal 8 has a display unit 81 and a terminal-side control unit 82. The terminal 8 can also be regarded as a display unit.

[0108] The display unit 81 may be, for example, any of various displays (for example, a liquid crystal display) that display images. The display unit 81 accepts touch operations. The display unit 81 (in other words, the terminal 8) faces the imaging unit 3 and diagonally upward and rearward.

[0109] Specifically, the display unit 81 is supported by the support part 23 in a state in which the front end of the display unit 81 is tilted at a predetermined angle θ1 in a direction approaching the imaging unit 3 with respect to an imaginary line α1 parallel to the horizontal direction. In the present embodiment, the predetermined angle θ1 is 45°.

[0110] Display unit 81 emits light for an image. The light for the image displayed by display unit 81 is focused as an aerial image G1 on imaging surface S by imaging unit 3, which will be described later. Aerial image G1 is an example of a real image. Imaging surface S is a virtual region that exists in the air outside housing 2.

[0111] Of the light of the display image displayed by display unit 81, the light that is imaged as aerial image G1 on imaging surface S by imaging unit 3 is the light to be imaged.

[0112] The light of the display image displayed by display unit 81 also includes non-image target light, which is light other than the light imaged as aerial image G1 on imaging surface S by imaging unit 3.

[0113] Imaging plane S may be considered as a virtual area large enough to image at least aerial image G1.

[0114] Furthermore, the imaging plane S is a virtual area that exists at a position that is plane-symmetrical to the display unit 81 with respect to the imaging unit 3 (in other words, the virtual line α2). The virtual line α2 is a virtual line that passes through the imaging unit 3 and is parallel to the horizontal direction. The virtual line α2 also passes through the imaging unit 3 and indicates a plane that is parallel to the imaging unit 3.

[0115] Specifically, the imaging surface S is a virtual area inclined at a predetermined angle θ2 with respect to a virtual line α3 parallel to the horizontal direction in a direction in which the front end of the imaging surface S approaches the imaging unit 3. In the present embodiment, the predetermined angle θ2 is 45°.

[0116] The display operation of the display unit 81 is controlled by the terminal-side control unit 82 based on operation input information received from the control unit 6 of the non-contact input device 1.

[0117] The terminal side control unit 82 may actually be configured with a CPU, ROM, RAM, HDD, etc. connected via a bus, or may be configured with a one-chip LSI, etc.

[0118] The terminal-side control unit 82 controls the operation of the display unit 81 by executing a program installed in the terminal 8. The terminal-side control unit 82 is also a control unit that controls the operation of the terminal 8. The program is a program that runs on the terminal 8.

[0119] The program may be provided in a form recorded on a recording medium that can be read by the CPU.

[0120] Examples of recording media include flexible disks, CD-ROMs, CD-Rs, CD-RWs, MOs, DVDs, Blu-ray discs, and portable hard disks. Semiconductor memories such as USB (Universal Serial Bus) memories are also examples of recording media.

[0121] The terminal-side control unit 82 converts the operation input information acquired from the control unit 6 (in other words, the non-contact input device 1) into operation information (hereinafter referred to as touch operation information) corresponding to a touch operation for operating the display unit 81 on the terminal 8.

[0122] Hereinafter, the touch operation for operating the display unit 81 of the terminal 8 may be simply referred to as the "touch operation of the terminal 8."

[0123] Then, the terminal-side control unit 82 controls the terminal 8 (in other words, the display unit 81) based on the acquired touch operation information.

[0124] The above-described operation of the terminal-side control unit 82 is realized by the terminal-side control unit 82 (in other words, the terminal 8) executing a program.

[0125] In other words, the terminal-side control unit 82 (in other words, the terminal 8) executes a program to acquire operation input information from the control unit 6 (in other words, the non-contact input device 1).

[0126] Next, the terminal-side control unit 82 executes a program to convert the acquired operation input information into touch operation information corresponding to the touch operation on the terminal 8.

[0127] Then, the terminal-side control unit 82 (in other words, the terminal 8) executes the program to control the terminal 8 (in other words, the display unit 81) based on the acquired touch operation information.

[0128] (Operation, effects and benefits of the non-contact input system) Below, the operation of the non-contact input system will be briefly explained, and the effects and advantages of the non-contact input system A according to this embodiment will be explained.

[0129] First, the user U sets the terminal 8 in the non-contact input device 1. At this time, the terminal 8 is powered on. The non-contact input device 1 may have a function to switch the power state of the terminal 8. Furthermore, the non-contact input device 1 may have a function to cancel the sleep state of the terminal 8 when the terminal 8 is in a sleep state.

[0130] Next, the user U turns on the power of the non-contact input device 1. Then, the light to be imaged (light L1 in FIG. 2 ) out of the light of the image displayed on the display unit 81 of the terminal 8 is incident on the imaging unit 3. The light to be imaged (light L1 in FIG. 2 ) that has entered the imaging unit 3 is emitted from the imaging unit 3.

[0131] Then, the light to be imaged (light L1 in FIG. 2) emitted from imaging unit 3 passes through light adjustment unit 4 and is imaged on imaging surface S as aerial image G1.

[0132] 4 shows an example of aerial image G1 formed by non-contact input device 1. Aerial image G1 is a display image displayed on display unit 81 of terminal 8.

[0133] The aerial image G1 includes a cursor image G10 that resembles the shape of a user's hand. The cursor image G10 is an image displayed by the terminal control unit 82 of the terminal 8. The user U performs an input action to operate the cursor image G10.

[0134] The shape of the cursor image G10 is not particularly limited. The shape of the cursor image G10 may be various shapes such as a circle, a polygon, an arrow, etc. Also, the cursor image G10 may be omitted.

[0135] The input detection unit 5 of the non-contact input device 1 detects operation input information (in other words, input motion information) of the user U with respect to the aerial image G1 (specifically, the cursor image G10). The input detection unit 5 sends the detected operation input information to the control unit 6. Then, the control unit 6 sends the operation input information acquired from the input detection unit 5 to the terminal 8.

[0136] Next, the terminal-side control unit 82 of the terminal 8 acquires the operation input information. Then, the terminal-side control unit 82 converts it into operation information (i.e., touch operation information) corresponding to the touch operation of the terminal 8. Then, the terminal-side control unit 82 controls the terminal 8 (in other words, the display unit 81) based on the acquired touch operation information.

[0137] As described above, according to non-contact input system A of the present embodiment, user U can operate terminal 8 incorporated in non-contact input device 1 by operating aerial image G1. In this case, the input action performed by user U on aerial image G1 is the same as the input action performed by user U to directly operate terminal 8. Therefore, user U can operate aerial image G1 with the same feeling as when directly operating terminal 8.

[0138] (Addendum) When implementing the non-contact input device 1 according to the above-described embodiment, the non-contact input device 1 may preferably include a stimulus applying mechanism 7 (see FIG. 2). The stimulus applying mechanism 7 applies a stimulus to the hand of the user U (specifically, the pads of the fingers F) in response to an operation of the user U on the aerial image G1.

[0139] The stimulus applying mechanism 7 is, for example, a haptic mechanism. The stimulus applied by the stimulus applying mechanism 7 to the hand of the user U (specifically, the pad of the finger F) is, for example, a start. The stimulus applying mechanism 7 applies a stimulus (vibration) to the hand of the user U (specifically, the pad of the finger F) by irradiating the hand of the user U (specifically, the pad of the finger F) with ultrasound.

[0140] The operation of the stimulus mechanism 7 may be controlled by the above-mentioned control unit 6. The control unit 6 controls the operation of the stimulus mechanism 7 (also referred to as a stimulus operation) in accordance with the operation input information acquired from the input detection unit 5.

[0141] The pattern of the stimulus applied by the stimulus applying mechanism 7 to the hand of the user U may correspond to the pattern of the input motion of the user U. The pattern of the input motion of the user U is as described above. In this case, the control unit 6 determines the pattern of the stimulus applied by the stimulus applying mechanism 7 to the hand of the user U based on the operation input information (specifically, input motion information) acquired from the input detection unit 5. Then, the control unit 6 controls the operation of the stimulus applying mechanism 7 according to the determined stimulus pattern. [Industrial Applicability]

[0142] The present invention can be applied to non-contact input devices used for various purposes. [Explanation of symbols]

[0143] A, Aa, Ab contactless input system 1. Non-contact input device 2. Case 2a Front plate 2b Rear plate part 2c Left side plate 2d Right side plate 2e Bottom plate part 21 Containment Space 22, 22a, 22b insertion slots 23 Support part 24 Light absorbing part 25 Sound transmission section 3 Imaging section 4 Light adjustment section 5 Input detection section 6 Control Unit 7. Stimulation mechanism 8 Terminals 81 Display section 82 Terminal side control unit G1 Aerial Image G10 cursor image U User F finger S image plane

Claims

1. an imaging unit that forms an aerial image in the air from an image displayed on a display unit that accepts touch operations; a detection unit that detects information regarding a user's operation on the aerial image corresponding to the touch operation; a control unit that sends information about the operation to the display unit, Non-contact input device.

2. coordinates in the aerial image correspond to coordinates in the display image; The non-contact input device according to claim 1 .

3. Further provided is a support portion that detachably supports the display portion. The non-contact input device according to claim 1 .

4. Further comprising a housing that houses the display unit, the imaging unit forms an image of light to be imaged, which is incident on the imaging unit, out of light of the display image, as the aerial image; the housing has a light absorbing portion that absorbs light other than the light to be imaged within the housing; The non-contact input device according to claim 1 .

5. the imaging unit forms an image of light to be imaged, which is incident on the imaging unit, out of light of the display image, as the aerial image; the non-contact input device further includes a light adjustment unit that suppresses leakage of light of the display image other than the light to be imaged into the air through the image formation unit; The non-contact input device according to claim 1 .

6. a stimulus applying mechanism that applies a stimulus to the user's hand in response to an operation of the user on the aerial image, The non-contact input device according to claim 1 .

7. a housing that houses the display unit; a sound transmission unit that transmits sound generated by the display unit in the internal space of the housing to an external space of the housing, The non-contact input device according to claim 1 .

8. Further comprising a housing that houses the display unit, The housing includes: an impact absorbing mechanism that absorbs impact acting on the housing; a heat insulating mechanism that prevents heat from being transferred from the exterior space of the housing to the interior space of the housing; or a waterproofing mechanism that prevents water from entering the interior space of the housing from the exterior space of the housing; The non-contact input device according to claim 1 .

9. Further comprising a housing that houses the display unit, The housing includes: an accommodation space that accommodates the display unit; an insertion opening for inserting the display unit from an external space of the housing into the accommodation space; a support portion that is provided in the accommodation space and that detachably supports the display portion inserted through the insertion opening, The display unit is connected to the control unit while being supported by the support unit. The non-contact input device according to claim 1 .

10. a terminal having a display unit that accepts touch operations; and the non-contact input device according to claim 1. Contactless input system.

11. 10. A program that operates on a terminal that is incorporated into the non-contact input device according to claim 1 and has a display unit that accepts touch operations, By executing the program, the terminal acquiring information about the operation from the non-contact input device; converting the acquired information about the operation into operation information corresponding to the touch operation; Controlling the terminal based on the operation information. program.

Images