Aerial video input terminal

Abstract

To provide an aerial video input terminal capable of suppressing erroneous selection even in an environment affected by shaking such as inside a vehicle. [Solution] An aerial video input terminal 10 including an image display unit 11 having a display surface 11a for displaying an image, a 3D plate 12 capable of forming the image as a real image on an aerial imaging surface 13, a gesture detection unit that detects a swipe gesture operation on the aerial imaging surface 13, and an operation input acquisition unit that acquires operation input indicating a user's selection of an icon from among a plurality of icons displayed on the aerial imaging surface 13, wherein the plurality of icons are arranged so that they can be moved along a predetermined path on the aerial imaging surface 13 by the swipe gesture operation, and the operation input acquisition unit sets a selection decision area on the aerial imaging surface 13, and only the icons within the selection decision area can be selected.

Description

[Technical field]

[0001] The present invention relates to an aerial image input terminal. [Background technology]

[0002] An aerial imaging device for automobiles that forms a real image in the air inside the automobile has been proposed (Patent Document 1). The device can be operated without contact using the image formed in the air. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 7121080 Summary of the Invention [Problem to be solved by the invention]

[0004] However, in vehicle-mounted terminals such as car navigation systems that are affected by shaking caused by driving, the operation to select and confirm an icon formed as a real image in the air may result in an erroneous selection, such as accidentally selecting an adjacent icon.

[0005] Therefore, an object of the present invention is to provide an aerial video input terminal that can reduce erroneous selections even in an environment affected by shaking, such as inside a car. [Means for solving the problem]

[0006] In order to achieve the above object, the aerial image input terminal of the present invention comprises: an image display unit having a display surface for displaying an image; a 3D plate that can form a real image on an aerial imaging surface on which the image is formed; a gesture detection unit that detects a swipe gesture operation on the aerial imaging plane; an operation input acquisition unit that acquires an operation input indicating a selection of an icon by a user from among a plurality of icons displayed on the aerial imaging plane; Including, the plurality of icons are arranged so as to be movable along a predetermined path on the aerial imaging plane by the swipe gesture operation; The operation input acquisition unit sets a selectable / decidable area on the aerial imaging plane, and allows only the icon within the selectable / decidable area to be selected / decided. Effect of the Invention

[0007] According to the aerial video input terminal of the present invention, only icons that have been moved into the selection area by a swipe gesture operation can be selected, so that erroneous selections can be reduced even in environments that are subject to shaking, such as the inside of a car. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a schematic cross-sectional view showing an example of the configuration of an aerial image input terminal of the present invention. [Diagram 2] FIG. 2 is a diagram showing an example of an image displayed on an aerial imaging plane in the present invention. [Diagram 3] FIG. 3 is a diagram for explaining an example of an operation indicating selection confirmation in the present invention. [Figure 4] FIG. 4 is a diagram showing another example of an image displayed on the aerial imaging plane in the present invention. [Diagram 5] FIG. 5 is a diagram showing yet another example of an image displayed on an aerial imaging plane in the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] The aerial video input terminal of the present invention will be described with examples. However, the present invention is not limited to the following examples. In the following Figs. 1 to 5, the same parts are given the same reference numerals, and their description may be omitted. In addition, in the drawings, for convenience of description, the structure of each part may be appropriately simplified, and the dimensional ratio of each part may be shown diagrammatically, different from the actual one.

[0010] FIG. 1 is a schematic cross-sectional view showing an example of the configuration of the aerial video input terminal of the present invention. As shown in FIG. 1, the aerial video input terminal 10 of this example includes a video display unit 11, a 3D plate 12, a sensor 14, and a housing 15. The housing 15 is a hollow rectangular parallelepiped, and a rectangular opening is formed at the top. Although not shown, the aerial video input terminal 10 further includes a control unit disposed inside the housing 15. The sensor 14 and the control unit function as a gesture detection unit and an operation input acquisition unit described later. Note that the presence or absence of the housing 15 is optional in the aerial video input terminal 10 of this example, and the aerial video input terminal 10 does not need to include it.

[0011] The image display unit 11 has a display surface 11a for displaying an image. As the image display unit 11, for example, a conventionally known image display device such as a liquid crystal display can be used.

[0012] The 3D plate 12 enables the video to be formed as a real image on an imaging plane 13 in the air. The 3D plate 12 is, for example, a flat plate made of a glass material or a translucent resin material having a two-layer mirror structure arranged perpendicular to each other, and is disposed at an upper opening of the housing 15. A commercially available product may be used as the 3D plate 12. An example of the commercially available product is the ASKA 3D plate manufactured by Asukanet Co., Ltd.

[0013] The angle θ1 between the 3D plate 12 and the aerial imaging plane 13 is not particularly limited and may be, for example, 30° to 60°, 40° to 50°, or 45°. The angle θ2 between the image display unit 11 and the 3D plate 12 is also not particularly limited and may be, for example, approximately the same as the angle θ1. Although not shown, the image display unit 11 is fixed inside the housing 15 so that the angle θ2 is a desired value.

[0014] The sensor 14 and the control unit function as a gesture detection unit that detects a swipe gesture operation on the aerial imaging plane 13, and an operation input acquisition unit that acquires an operation input indicating a user's selection of an icon from among multiple icons displayed on the aerial imaging plane 13.

[0015] As the sensor 14, for example, a distance measuring sensor including a light emitting unit and a light receiving unit may be used. The light emitting unit scans an infrared laser on the aerial imaging plane 13. The distance measuring sensor can detect the position of the fingers or the operating tool on the aerial imaging plane 13 based on the time and angle from when the infrared laser is irradiated from the light emitting unit to when the infrared laser is reflected by the user's fingers or the operating tool held by the user located on the aerial imaging plane 13 and the reflected infrared laser is received by the light receiving unit. Note that in the aerial video input terminal of the present invention, the means for detecting the position of the fingers or the operating tool is not limited to the means using the sensor 14, and any conventionally known means may be used.

[0016] The control unit may be, for example, a central processing unit (CPU), a graphics processing unit (GPU), an accelerated processing unit (APU), a microprocessor, a microcontroller, or the like, or may be a combination of a plurality of these.

[0017] Next, an example of an image displayed on the aerial imaging plane 13 will be described with reference to Fig. 2. Fig. 2 shows an example in which the aerial image input terminal of the present invention is used as an input terminal for a car navigation system. Note that, due to the function of the 3D plate 12 described above, the image is an image displayed on the display surface 11a of the image display unit 11 that is imaged as a real image on the aerial imaging plane 13.

[0018] The image includes a plurality of (eight in this example) icons 16a1 to 16a8 arranged to be movable along a predetermined path (circular in this example) by the swipe gesture operation. A selectively determinable area 17 is set on the aerial imaging plane 13 on which the image is displayed by the operation input acquisition unit composed of the sensor 14 and the control unit. In this example, the selectively determinable area 17 is set at the center of the lower part of the aerial imaging plane 13, and the icon 16a1 is displayed in that location. Note that in FIG. 2, the thick line of the rectangle indicating the selectively determinable area 17 is shown for convenience of explanation, but does not need to be displayed in reality.

[0019] As shown in FIG. 2(A), the icons 16a1 to 16a8 may all be displayed at approximately the same size, or as shown in FIG. 2(B), the display area of ​​the icon in the selection / decision area 17 (icon 16a1 in this example) may be the largest. The display area of ​​the icon in the selection / decision area 17 may be, for example, 1000 mm 2 The display area of ​​the other icons is, for example, 0.2 to 1 times that of the icon.

[0020] Next, taking the case shown in FIG. 2(B) as an example, an example of an operation indicating selection confirmation in the present invention will be described with reference to FIG.

[0021] FIG. 3(A) is an example of a case where the operation indicating the selection decision is a tap operation after a swipe gesture operation on the aerial imaging plane 13. Specifically, first, the gesture detection unit configured with the sensor 14 and the control unit detects a swipe gesture operation on the aerial imaging plane 13 by the user. In this example, the swipe gesture operation is a swipe operation from right to left that rotates (moves) a plurality of icons 16a1 to 16a8 arranged movably along a circular path in a clockwise direction as shown by an arrow in FIG. 3(A). Next, the operation input acquisition unit configured with the sensor 14 and the control unit acquires a tap operation, which is an operation input indicating the selection decision of an icon (icon 16a1 in this example) by the user. At this time, the operation input acquisition unit is capable of selecting and deciding only icons (icon 16a1 in this example) within the set selection decision possible area 17. As a result, according to the aerial image input terminal of this example, it is possible to suppress erroneous selection even in an environment affected by shaking such as inside a car. In this example, the direction in which the icons 16a1 to 16a8 can move (rotate) is not limited to the clockwise direction shown in FIG. 3(A), but may be counterclockwise, or may be both clockwise and counterclockwise, and this is the same as in the case shown in FIG. 3(B) described later. In this example, among the icons 16a1 to 16a8, an icon in the selection / decision area 17 (icon 16a1 in this example) may be highlighted. Examples of the highlighting include highlighting (a display in which the brightness of the icon is increased) and a thick line display surrounding the icon as shown in FIG. 3(A). In FIG. 3(A), the thick line is black for convenience, but the thick line may be any color, such as red. This highlighting is the same as in the cases shown in FIG. 2 described above, and in FIG. 3(B), FIG. 4, and FIG. 5 described below.

[0022] FIG. 3B is an example of a case where the operation indicating the operation decision is a swipe operation in a direction perpendicular to the swipe direction in the swipe gesture operation after the swipe gesture operation on the aerial imaging plane 13. Specifically, first, a swipe gesture operation on the aerial imaging plane 13 by a user is detected in the same manner as the example shown in FIG. 3A. Next, the operation input acquisition unit composed of the sensor 14 and the control unit acquires a swipe operation in a direction perpendicular to the swipe gesture operation (upward in this example), which is an operation input indicating the selection and decision of an icon (icon 16a1 in this example) by the user. At this time, the operation input acquisition unit is capable of selecting and deciding only icons (icon 16a1 in this example) within the set selection and decision possible area 17. This makes it possible to suppress erroneous selection even in an environment affected by shaking such as inside a car, even with the aerial image input terminal of this example.

[0023] Next, another example of an image displayed on the aerial imaging plane 13 will be described with reference to FIGS.

[0024] 4(A) is an example of a case where a plurality of icons displayed on the aerial imaging plane 13 are arranged movably along a horizontal (left-right) path. In this example, of the plurality of icons 16a1 to 16a8 arranged in a ring shape in the example shown in FIG. 2 and FIG. 3, only five icons 16a1, 16a2, 16a3, 16a7, and 16a8 are displayed on the aerial imaging plane 13. In this example, the selection and decision possible area 17 is set at approximately the center of the aerial imaging plane 13. In this example, when the number of icons is eight as shown in Figures 2 and 3, when the gesture detection unit composed of sensor 14 and the control unit detects a swipe gesture operation from right to left by the user, the icons displayed to the right of icon 16a7 displayed on the left end will no longer be displayed on the aerial imaging surface 13, and instead, icon 16a4, icon 16a5, and icon 16a6, which were not displayed on the aerial imaging surface 13 at the stage shown in Figure 4(A), will be displayed in order from the right end side of the aerial imaging surface 13, and then icon 16a7 and subsequent icons that were once no longer displayed on the aerial imaging surface 13 will be displayed in order from the right end side of the aerial imaging surface 13. On the other hand, in this example, when the gesture detection unit composed of the sensor 14 and the control unit detects a swipe gesture operation from the left to the right by the user, the icons displayed on the left side of the icon 16a3 displayed on the right end are not displayed on the aerial imaging plane 13, and instead, the icons 16a6, 16a5, and 16a4 that were not displayed on the aerial imaging plane 13 at the stage shown in FIG. 4(A) are displayed in order from the left end side of the aerial imaging plane 13, and then the icons after the icon 16a3 that were once not displayed on the aerial imaging plane 13 are displayed in order from the left end side of the aerial imaging plane 13. In this case, when there are five icons, the rightmost icon that is not displayed on the aerial imaging plane 13 due to a swipe gesture operation from the left to the right by the user is immediately displayed again from the left end side of the aerial imaging plane 13.In this example, the icons displayed on the aerial imaging plane 13 may be arranged to be movable along a vertical (up-down) path instead of being arranged to be movable along a horizontal (left-right) path as shown in Fig. 4(A). The operation indicating the operation decision in this example is the same as that described with reference to Fig. 3.

[0025] FIG. 4(B) is an example of a case where there are multiple (two in this example) horizontal (left-right) paths along which multiple icons can move in the example shown in FIG. 4(A). Specifically, this example is an example of two paths: a path below the aerial imaging plane 13 including the icons 16a1-16a5, and a path above the aerial imaging plane 13 including the icons 16b1-16b5. In this example, the operation input acquisition unit, which is composed of the sensor 14 and the control unit, sets a selectively determinable area for each of the multiple paths. In the example shown in FIG. 4(B), two selectively determinable areas are set: a selectively determinable area 17a at approximately the center below the aerial imaging plane 13, and a selectively determinable area 17b at approximately the center above the aerial imaging plane 13. Other than these, it is the same as the example shown in FIG. 4(A).

[0026] 5 shows an example in which the paths along which a plurality of icons can move are two orthogonal paths, a horizontal path (left-right direction) and a vertical path (up-down direction). Specifically, this example shows an example in which there are two paths, a horizontal path (left-right direction) including icons 16a1 to 16a5, and a vertical path (up-down direction) including icons 16a1, 16b1, and 16b2. In this example, the operation input acquisition unit, which is composed of sensor 14 and the control unit, sets a selection decision possible area 17 at approximately the center of aerial imaging plane 13, which is the intersection of the two paths. Other than these, it is the same as the example shown in FIG. 4(A).

[0027] The image displayed on the aerial imaging plane 13 exemplified in Figs. 2 to 5 may include icons other than the plurality of icons. Examples of icons other than the plurality of icons include an icon (cancel button, back button) having a function of canceling the operation indicating the selection confirmation. If the cancel (back) button is provided, for example, by operating the button after the image has been switched by the operation indicating the selection confirmation, it becomes possible to return to the image displaying the plurality of icons exemplified in Figs. 2 to 5. The display location and display area of ​​the cancel (back) button are not particularly limited, and it may be displayed in an appropriate location on the aerial imaging plane 13 with an appropriate size. [Explanation of symbols]

[0028] 10. Aerial video input terminal 11 Video display section 11a Display surface 12 3D Plates 13 Aerial image plane 14 Sensors 15. Cabinet 16a1~16a8, 16b1~16b5 Icons 17, 17a, 17b Selection decision possible area

Claims

1. an image display unit having a display surface for displaying an image; a 3D plate that can form the image as a real image on an aerial imaging plane that is a plane in the air; a gesture detection unit that detects a swipe gesture operation on the aerial imaging plane; an operation input acquisition unit that acquires an operation input indicating a selection of an icon by a user from among a plurality of icons displayed on the aerial imaging plane; Including, an angle between the 3D plate and the aerial imaging plane, and an angle between the display surface of the image display unit and the 3D plate are each 30° to 60°; the plurality of icons are arranged temporarily stationary on the same aerial imaging plane, and are arranged so as to be movable along a predetermined path on the aerial imaging plane by the swipe gesture operation; The operation input acquisition unit sets a selectable / determinable area on the aerial imaging surface, and only the icons within the selectable / determinable area can be selected and determined, thereby preventing erroneous selection of the icons in an environment affected by shaking.

2. The display area of ​​the icon within the selectable area is 1000 mm ２ The aerial image input terminal according to claim 1,

3. The aerial image input terminal according to claim 1 , wherein the operation indicating the selection is a tap operation after the swipe gesture operation.

4. The aerial image input terminal according to claim 1 , wherein the operation indicating the selection is a swipe operation in a direction perpendicular to a swipe direction in the swipe gesture operation after the swipe gesture operation.

5. 2. The aerial image input terminal according to claim 1, wherein the display area of ​​the icon within the selectable / determinable area among the plurality of icons is maximized.

6. The aerial image input terminal according to claim 1 , wherein the icon within the selectable / decidable area out of the plurality of icons is highlighted.

7. 2. The aerial image input terminal according to claim 1, wherein the predetermined path is a loop.

8. 8. The aerial image input terminal according to claim 7, wherein the selectable / determinable area is the lower center of the aerial imaging surface.

9. There are a plurality of the predetermined paths, The aerial image input terminal according to claim 1 , wherein the operation input acquisition unit sets the selection determinable area for each of the plurality of predetermined routes.

10. the image displayed on the aerial imaging plane includes an icon other than the plurality of icons; 2. The aerial image input terminal according to claim 1, wherein an icon other than said plurality of icons includes an icon having a function of canceling an operation indicating said selection confirmation.

Images