Aerial video input terminal

Abstract

To provide an aerial video input terminal with which erroneous selection can be suppressed also in an environment that is affected by swinging, such as the inside of a vehicle.SOLUTION: An aerial video input terminal 10 includes: a video display unit 11 having a display surface 11a for displaying a video; a 3D plate 12 capable of imaging the video on an aerial imaging surface 13 as a real image; a gesture detection unit for detecting a swipe gesture operation on the aerial imaging surface 13; and an operation input acquisition unit for acquiring an operation input that indicates a selection decision of an icon by a user, among a plurality of icons displayed on the aerial imaging surface 13. The plurality of icons are arranged so as to be movable on the aerial imaging surface 13 along a predetermined path according to the swipe gesture operation. The operation input acquisition unit sets a selection decision possible area on the aerial imaging surface 13, and allows only the icons in the selection decision possible area, to be selection decision possible.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an aerial video input terminal. [Background technology]

[0002] An aerial imaging device for automobiles that forms a real image in the air inside the automobile has been proposed (Patent Document 1). This device can be operated without contact using the image formed in the air. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 7121080 Summary of the Invention [Problem to be solved by the invention]

[0004] However, in in-vehicle terminals such as car navigation systems, which are affected by shaking caused by driving, there is a risk of incorrect selection, such as accidentally selecting an adjacent icon, when selecting and deciding on an icon formed as a real image in the air.

[0005] Therefore, an object of the present invention is to provide an aerial video input terminal that can reduce erroneous selections even in an environment that is affected by shaking, such as inside a car. [Means for solving the problem]

[0006] In order to achieve the above object, the aerial image input terminal of the present invention comprises: an image display unit having a display surface for displaying an image; a 3D plate that enables the image to be formed as a real image on an imaging surface in the air; a gesture detection unit that detects a swipe gesture operation on the aerial imaging plane; an operation input acquisition unit that acquires an operation input indicating a selection of an icon by a user from among a plurality of icons displayed on the aerial imaging plane; Including, the plurality of icons are arranged so as to be movable along a predetermined path on the aerial imaging plane by the swipe gesture operation; The operation input acquisition unit sets a selectable / decidable area on the aerial imaging plane, and only the icon within the selectable / decidable area can be selected and decided. [Effects of the Invention]

[0007] According to the aerial video input terminal of the present invention, only icons that have been moved into the selection area by a swipe gesture operation can be selected, thereby reducing erroneous selections even in environments affected by shaking, such as inside a car. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a schematic cross-sectional view showing an example of the configuration of an aerial image input terminal of the present invention. [Figure 2] FIG. 2 is a diagram showing an example of an image displayed on an aerial imaging plane in the present invention. [Figure 3] FIG. 3 is a diagram illustrating an example of an operation indicating selection and confirmation in the present invention. [Figure 4] FIG. 4 is a diagram showing another example of an image displayed on an aerial imaging plane in the present invention. [Figure 5] FIG. 5 is a diagram showing yet another example of an image displayed on an aerial imaging plane in the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0009] The aerial video input terminal of the present invention will be described using examples. However, the present invention is not limited to the following examples. In the following Figures 1 to 5, the same parts are given the same reference numerals, and their description may be omitted. Furthermore, in the drawings, for the sake of convenience, the structure of each part may be shown in an appropriately simplified manner, and the dimensional ratios of each part may be shown schematically and different from the actual ones.

[0010] FIG. 1 is a schematic cross-sectional view showing an example of the configuration of a floating image input terminal of the present invention. As shown in FIG. 1, the floating image input terminal 10 of this example includes an image display unit 11, a 3D plate 12, a sensor 14, and a housing 15. The housing 15 is a hollow rectangular parallelepiped with a rectangular opening formed at the top. Although not shown, the floating image input terminal 10 also includes a control unit disposed inside the housing 15. The sensor 14 and the control unit function as a gesture detection unit and an operation input acquisition unit, which will be described later. Note that the presence or absence of the housing 15 is optional for the floating image input terminal 10 of this example, and the floating image input terminal 10 does not necessarily have to include it.

[0011] The image display unit 11 has a display surface 11a for displaying an image. As the image display unit 11, for example, a conventionally known image display device such as a liquid crystal display can be used.

[0012] The 3D plate 12 enables the video to be focused as a real image on an aerial imaging plane 13. The 3D plate 12 is a flat plate made of, for example, a glass material or a translucent resin material having a two-layer mirror structure arranged perpendicular to each other, and is placed in the upper opening of the housing 15. A commercially available product may be used as the 3D plate 12. An example of the commercially available product is the ASKA 3D plate manufactured by Asukanet Corporation.

[0013] The angle θ1 between the 3D plate 12 and the aerial imaging plane 13 is not particularly limited and may be, for example, 30° to 60°, 40° to 50°, or 45°. The angle θ2 between the image display unit 11 and the 3D plate 12 is also not particularly limited and may be, for example, approximately the same as the angle θ1. Although not shown, the image display unit 11 is fixed inside the housing 15 so that the angle θ2 is a desired size.

[0014] The sensor 14 and the control unit function as a gesture detection unit that detects a swipe gesture operation on the aerial imaging plane 13, and an operation input acquisition unit that acquires an operation input indicating the user's selection of an icon from among multiple icons displayed on the aerial imaging plane 13.

[0015] The sensor 14 may be, for example, a distance measuring sensor including a light emitting unit and a light receiving unit. The light emitting unit scans the aerial imaging plane 13 with an infrared laser. The distance measuring sensor can detect the position of the fingers or operating tool on the aerial imaging plane 13 based on the time and angle from when the infrared laser is emitted from the light emitting unit to when the reflected infrared laser is reflected by the user's fingers or an operating tool held by the user located on the aerial imaging plane 13 and received by the light receiving unit. Note that in the aerial video input terminal of the present invention, the means for detecting the position of the fingers or operating tool is not limited to means using the sensor 14, and any conventionally known means may be used.

[0016] Examples of the control unit include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an APU (Accelerated Processing Unit), a microprocessor, a microcontroller, etc., and may be a combination of two or more of these.

[0017] Next, an example of an image displayed on the aerial imaging plane 13 will be described with reference to Fig. 2. Fig. 2 shows an example in which the aerial image input terminal of the present invention is used as an input terminal for a car navigation system. Note that, thanks to the function of the 3D plate 12 described above, the image is an image displayed on the display surface 11a of the image display unit 11 that is imaged as a real image on the aerial imaging plane 13.

[0018] The image includes a plurality of (eight in this example) icons 16a1 to 16a8 that are arranged so as to be movable along a predetermined path (circular in this example) by the swipe gesture operation. A selection / decision possible area 17 is set on the aerial imaging plane 13 on which the image is displayed by the operation input acquisition unit that is composed of sensor 14 and the control unit. In this example, the selection / decision possible area 17 is set at the center of the lower part of the aerial imaging plane 13, and icon 16a1 is displayed in this location. Note that in FIG. 2, the thick line of the rectangle that indicates the selection / decision possible area 17 is shown for the sake of convenience of explanation, and does not need to be displayed in reality.

[0019] As shown in FIG. 2(A), the plurality of icons 16a1 to 16a8 may all be displayed at approximately the same size, or as shown in FIG. 2(B), the display area of ​​the icon in the selection / decision area 17 (icon 16a1 in this example) may be set to the largest. The display area of ​​the icon in the selection / decision area 17 may be, for example, 1000 mm 2 That's all, and the display area of ​​other icons is, for example, 0.2 to 1 times that.

[0020] Next, taking the case shown in FIG. 2(B) as an example, an example of an operation indicating selection confirmation in the present invention will be described with reference to FIG.

[0021] FIG. 3A illustrates an example in which the operation indicating the selection confirmation is a tap operation after a swipe gesture operation on the aerial imaging plane 13. Specifically, first, the gesture detection unit, which is composed of the sensor 14 and the control unit, detects a swipe gesture operation on the aerial imaging plane 13 by the user. In this example, the swipe gesture operation is a swipe operation from right to left that rotates (moves) multiple icons 16a1 to 16a8, which are movably arranged along a circular path, clockwise, as indicated by the arrow in FIG. 3A. Next, the operation input acquisition unit, which is composed of the sensor 14 and the control unit, acquires a tap operation, which is an operation input indicating the selection confirmation of an icon (icon 16a1 in this example) by the user. At this time, the operation input acquisition unit is configured to select and confirm only icons (icon 16a1 in this example) within the set selection confirmation area 17. As a result, the aerial video input terminal of this example can reduce erroneous selections even in an environment affected by shaking, such as the inside of a car. In this example, the direction in which the icons 16a1 to 16a8 can move (rotate) is not limited to the clockwise direction shown in FIG. 3(A), but may be counterclockwise, or may be both clockwise and counterclockwise. This is the same as in the case shown in FIG. 3(B) described later. In this example, among the icons 16a1 to 16a8, an icon in the selection / decision area 17 (icon 16a1 in this example) may be highlighted. Examples of such highlighting include highlighting (increasing the brightness of the icon) and displaying a thick line surrounding the icon as shown in FIG. 3(A). In FIG. 3(A), the thick line is black for convenience, but the thick line may be any color, such as red. This highlighting is the same as in the cases shown in FIG. 2 described above and in FIGS. 3(B), 4, and 5 described below.

[0022] FIG. 3B shows an example in which the operation indicating the operation confirmation is a swipe operation in a direction perpendicular to the swipe direction of the swipe gesture operation after the swipe gesture operation on the aerial imaging plane 13. Specifically, first, a swipe gesture operation by a user on the aerial imaging plane 13 is detected, similar to the example shown in FIG. 3A. Next, the operation input acquisition unit, which is composed of the sensor 14 and the control unit, acquires a swipe operation in a direction perpendicular to the swipe gesture operation (upward in this example), which is an operation input indicating the user's selection and confirmation of an icon (icon 16a1 in this example). At this time, the operation input acquisition unit is configured to select and confirm only icons (icon 16a1 in this example) within the set selection and confirmation area 17. This makes it possible to reduce erroneous selections even in an environment affected by shaking, such as the inside of a car, using the aerial video input terminal of this example.

[0023] Next, another example of an image displayed on the aerial imaging plane 13 will be described with reference to FIGS.

[0024] 4(A) shows an example of a case where a plurality of icons displayed on the aerial imaging plane 13 are arranged movably along a path in the horizontal direction (left and right direction). In this example, of the plurality of icons 16a1 to 16a8 arranged in a circle in the example shown in FIGS. 2 and 3, only five icons 16a1, 16a2, 16a3, 16a7, and 16a8 are displayed on the aerial imaging plane 13. In this example, the selection / decision area 17 is set approximately in the center of the aerial imaging plane 13. In this example, if the number of icons is eight as shown in Figures 2 and 3, when the gesture detection unit, which is composed of sensor 14 and the control unit, detects a swipe gesture operation from right to left by the user, the icons displayed to the right of icon 16a7 displayed on the left end will disappear from the aerial imaging surface 13, and instead, icon 16a4, icon 16a5, and icon 16a6, which were not displayed on the aerial imaging surface 13 at the stage shown in Figure 4(A), will be displayed in order from the right end of the aerial imaging surface 13, and then icon 16a7 and subsequent icons that had once disappeared from the aerial imaging surface 13 will be displayed in order from the right end of the aerial imaging surface 13. On the other hand, in this example, when the gesture detection unit, which is composed of the sensor 14 and the control unit, detects a swipe gesture operation from left to right by the user, the icons displayed on the left side of icon 16a3 displayed on the right end disappear from the aerial imaging plane 13. Instead, icon 16a6, icon 16a5, and icon 16a4, which were not displayed on the aerial imaging plane 13 at the stage shown in FIG. 4A, are displayed in order from the left end of the aerial imaging plane 13. Then, the icons from icon 16a3 onwards that had once disappeared from the aerial imaging plane 13 are displayed in order from the left end of the aerial imaging plane 13. In this case, if there are five icons, the rightmost icon that disappears from the aerial imaging plane 13 due to a swipe gesture operation from left to right by the user is immediately displayed again from the left end of the aerial imaging plane 13.In this example, the plurality of icons displayed on the aerial imaging plane 13 may be arranged to be movable along a vertical (up-down) path instead of being arranged to be movable along a horizontal (left-right) path as shown in Fig. 4(A). The operation indicating the operation decision in this example is the same as that described using Fig. 3.

[0025] FIG. 4(B) is an example of a case where there are multiple (two in this example) horizontal (left-right) paths along which multiple icons can move in the example shown in FIG. 4(A). Specifically, this example is an example of two paths: a path below the aerial imaging plane 13 that includes icons 16a1-16a5, and a path above the aerial imaging plane 13 that includes icons 16b1-16b5. In this example, the operation input acquisition unit, which is composed of the sensor 14 and the control unit, sets a selection determinable area for each of the multiple paths. In the example shown in FIG. 4(B), two selection determinable areas are set: selection determinable area 17a, which is approximately at the bottom center of the aerial imaging plane 13, and selection determinable area 17b, which is approximately at the top center of the aerial imaging plane 13. Other than these, it is the same as the example shown in FIG. 4(A).

[0026] 5 shows an example in which the paths along which multiple icons can move are two orthogonal paths: a horizontal (left-right) path and a vertical (up-down) path. Specifically, this example shows an example in which there are two paths: a horizontal (left-right) path that includes icons 16a1 to 16a5, and a vertical (up-down) path that includes icons 16a1, 16b1, and 16b2. In this example, the operation input acquisition unit, which is composed of sensor 14 and the control unit, sets a selection / decision area 17 at approximately the center of aerial imaging plane 13, which is the intersection of the two paths. Other than this, it is the same as the example shown in FIG. 4(A).

[0027] The image displayed on the aerial imaging plane 13 exemplified in Figures 2 to 5 may include icons other than the plurality of icons. Examples of icons other than the plurality of icons include an icon (cancel button, back button) that has a function to cancel the operation indicating the selection confirmation. If the cancel (back) button is provided, for example, by operating the button after the image has been switched by the operation indicating the selection confirmation, it becomes possible to return to the image displaying the plurality of icons exemplified in Figures 2 to 5. The display location and display area of ​​the cancel (back) button are not particularly limited, and it may be displayed in an appropriate location on the aerial imaging plane 13 with an appropriate size. [Explanation of symbols]

[0028] 10. Aerial video input terminal 11 Video display section 11a Display surface 12 3D plates 13 Aerial image plane 14 sensors 15 Case 16a1~16a8, 16b1~16b5 icons 17, 17a, 17b Selection decision area

Claims

1. an image display unit having a display surface for displaying an image; a 3D plate that enables the image to be formed as a real image on an imaging surface in the air; a gesture detection unit that detects a swipe gesture operation on the aerial imaging plane; an operation input acquisition unit that acquires an operation input indicating a selection of an icon by a user from among a plurality of icons displayed on the aerial imaging plane; Including, the plurality of icons are arranged so as to be movable along a predetermined path on the aerial imaging plane by the swipe gesture operation; The operation input acquisition unit sets a selectable / determinable area on the aerial imaging surface, and only the icon within the selectable / determinable area can be selected / determined.

2. The display area of ​​the icon in the selectable area is 1000 mm ２ 2. The aerial video input terminal according to claim 1.

3. The aerial image input terminal according to claim 1 or 2, wherein the operation indicating the selection is a tap operation after the swipe gesture operation.

4. The aerial image input terminal according to claim 1 or 2, wherein the operation indicating the selection is a swipe operation in a direction perpendicular to a swipe direction in the swipe gesture operation after the swipe gesture operation.

5. The aerial image input terminal according to any one of claims 1 to 4, wherein the display area of ​​the icon within the selection / decision area among the plurality of icons is maximized.

6. The aerial image input terminal according to any one of claims 1 to 5, wherein the icon within the selection / decision area among the plurality of icons is highlighted.

7. The aerial video input terminal according to any one of claims 1 to 6, wherein the predetermined path is a loop.

8. 8. The aerial image input terminal according to claim 7, wherein said selectable / determinable area is the lower center of said aerial imaging plane.

9. There are a plurality of the predetermined routes, The aerial image input terminal according to any one of claims 1 to 6, wherein the operation input acquisition unit sets the selection determinable area for each of the plurality of predetermined routes.

10. The predetermined paths are two, the two predetermined paths are orthogonal; The aerial image input terminal according to any one of claims 1 to 6, wherein the operation input acquisition unit sets the selection determinable area at an intersection of the two predetermined paths.

11. the image displayed on the aerial imaging plane includes an icon other than the plurality of icons, The aerial image input terminal according to any one of claims 1 to 10, wherein icons other than the plurality of icons include an icon having a function to cancel an operation indicating the selection decision.

Images