Input device for deriving location information through the collection of multiple images

Abstract

The present invention provides an input device for deriving position information through the collection of multiple images, comprising: a panel unit having a predetermined area and formed in a rectangular shape capable of outputting an image; a plurality of camera units provided along the perimeter of the panel unit, each capturing a specific image such that a designated means at a position adjacent to the panel unit and a reflected image of the designated means reflected from the panel unit are simultaneously displayed; and a control unit that converts and displays the position coordinates of the designated means in the plurality of captured images captured by the camera unit into the coordinate system of the panel unit through a homography algorithm, wherein the control unit derives the vertical separation distance between the panel unit and the designated means based on the midpoint of the separation distance between the position of the designated means in the captured image and the position of the designated means in the reflected image.

Description

Technology Field

[0001] The present invention relates to an input device for deriving location information through the collection of a plurality of images, wherein the device is equipped with a plurality of camera units along the perimeter of a panel unit to derive the location coordinates of a designated means through images collected from each unit, and can output and display the coordinates. Background Technology

[0003] Recently, technology is being developed for display panels that not only simply recognize touch but also collect location information regarding a separate designated means prior to the touch, enabling it to be output as a video screen through a display device.

[0004] However, this technology requires collecting three-dimensional positional information of the designated means using numerous sensors and cameras, which presents a problem as it necessitates many additional devices.

[0005] In particular, conventionally, location information of the designated means was collected through independent detection sensors or detection cameras separate from the display panel, which resulted in the problem of the device becoming complex.

[0006] Therefore, along with solving these problems, there is a need to develop a technology that can reliably derive the position coordinates of a designated means with only a simple structure and two cameras. The problem to be solved

[0008] The present invention is devised to solve the problems of the aforementioned prior art and provides an input device that can be intuitively recognized by deriving the location of a designated means through images collected from multiple locations and outputting it from a panel unit.

[0009] The problems of the present invention are not limited to those mentioned above, and other unmentioned problems will be clearly understood by those skilled in the art from the description below. means of solving the problem

[0011] An input device according to one aspect of the present invention for achieving the above-mentioned purpose comprises: a panel unit having a predetermined area and formed in a rectangular shape capable of outputting an image; a plurality of camera units provided along the perimeter of the panel unit, each capturing a respective image so as to simultaneously display a designation means at a position adjacent to the panel unit and a reflected image of the designation means reflected from the panel unit; and a control unit that converts and displays the position coordinates of the designation means in the plurality of captured images captured by the camera unit into the coordinate system of the panel unit through a homography algorithm, wherein the control unit derives the vertical separation distance between the panel unit and the designation means based on the midpoint of the separation distance between the position of the designation means in the captured image and the position of the designation means in the reflected image.

[0012] In addition, the control unit may be characterized by calculating the difference in position coordinates from the panel unit to the captured image using trigonometry to additionally derive and verify the position of the designation means.

[0013] In addition, the control unit may be characterized by displaying an output image to the user in a form pre-set in the panel unit in correspondence with the detected position of the designated means.

[0014] In addition, the control unit may be characterized in that the output image displayed changes according to the distance the designation means is offset forward from the planar coordinates of the panel unit.

[0015] In addition, the control unit can control the size of the output image displayed to increase or decrease as the distance between the designated means and the panel unit decreases.

[0016] In addition, the control unit can control the color or density of the output image displayed to change as the distance between the designation means and the panel unit decreases.

[0017] In addition, the control unit may determine that the corresponding location has been clicked by changing the motion of the output image when the designated means and the panel unit come into contact or the distance between them becomes close within a preset range.

[0018] Additionally, the camera unit may include a first capturing unit that is positioned along the perimeter of the panel unit toward the center at a predetermined position and captures the panel unit and the designated means together to collect a first image, and a second capturing unit that is positioned along the perimeter of the panel unit spaced apart from the first capturing unit and faces toward the center, and captures the panel unit and the designated means together to collect a second image.

[0019] In addition, the camera unit may have the first shooting unit and the second shooting unit spaced apart and positioned at different corner portions of the panel unit.

[0020] In addition, the above-mentioned designation means may be used by recognizing a pre-set separate device or a user's body part.

[0021] In addition, the panel unit may be characterized by having a surface that has a certain level of reflectivity and is capable of displaying the designated means in the reflected image.

[0022] In addition, the above panel unit may be characterized as being composed of a touchscreen. Effects of the invention

[0024] The input device of the present invention for deriving location information through the collection of multiple images to solve the above-mentioned problem has the following effects.

[0025] The input device for deriving location information through the collection of a plurality of images according to the present invention collects independent captured images through a plurality of capturing units provided along the perimeter of a panel unit, and analyzes them to derive three-dimensional location coordinates of a designated means in the panel unit.

[0026] In addition, in the present invention, three-dimensional position coordinates of a designated means can be derived by collecting captured images using only two capturing units.

[0027] The effects of the present invention are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art from the description in the claims. Brief explanation of the drawing

[0029] FIG. 1 is a schematic diagram showing an input device that derives location information through the collection of a plurality of images according to an embodiment of the present invention; FIG. 2 is a drawing showing a captured image taken by a shooting module in an input device that derives location information through the collection of a plurality of images of FIG. 1; FIG. 3 is a diagram showing the derivation of the position of a designated means through a captured image from the input device of FIG. 1; FIG. 4 is a drawing showing the derivation of the separation distance between a designation means and a panel unit through a reflected image captured by the input device of FIG. 1. Figure 5 is a diagram showing that the image output changes according to the distance between the designated means and the panel unit in the input device of Figure 1. Specific details for implementing the invention

[0030] Preferred embodiments of the present invention, in which the objectives of the present invention can be specifically realized, will be described below with reference to the attached drawings. In describing these embodiments, the same names and reference numerals are used for identical components, and additional explanations thereof will be omitted.

[0031] In addition, in describing the embodiments of the present invention, it is stated in advance that while the same names and symbols are used for components having the same function, they are not substantially identical to the prior art.

[0032] Furthermore, the terms used in the embodiments of the present invention are used merely to describe specific embodiments and are not intended to limit the invention. The singular expression includes the plural expression unless the context clearly indicates otherwise.

[0033] Furthermore, in the embodiments of the present invention, terms such as "comprising" or "having" are intended to specify the existence of the features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, and should be understood as not excluding in advance the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.

[0034] First, with reference to FIGS. 1 to 4, we will examine the configuration of an input device that derives location information through the collection of a plurality of images according to the present invention.

[0035] FIG. 1 is a schematic diagram showing an input device that derives location information through the collection of a plurality of images according to an embodiment of the present invention, and FIG. 2 is a diagram showing a captured image taken by a shooting module in the input device that derives location information through the collection of a plurality of images of FIG. 1.

[0036] And Fig. 3 is a diagram showing the position of a designated means derived through a captured image from the input device of Fig. 1, and Fig. 4 is a diagram showing the distance between a designated means and a panel unit derived through a reflected image captured from the input device of Fig. 1.

[0037] The input device for deriving location information through the collection of a plurality of images according to the present invention derives the location of the designated means (10) by taking images using a plurality of cameras on a general panel-type display and analyzing the images.

[0038] The present invention largely comprises a panel unit (100) for outputting an image, a camera unit (200) for collecting images of different locations using at least two cameras, and a control unit for converting and analyzing images captured by the camera unit (200) to derive the location of a designation means (10).

[0039] The above panel unit (100) is a general display panel that selectively outputs a preset image and is configured to allow the user to operate it through a separate designation means (10).

[0040] In the present invention, the panel unit (100) has an area of ​​a predetermined size and is formed in a rectangular shape to output an image, and is controlled through the operation of the designation means (10). At this time, the panel unit (100) is configured as a general touchscreen or is configured to additionally output the position of the designation means (10) recognized by the camera unit (200).

[0041] Here, the designation means (10) of the present invention may be used by recognizing a separate device or a user's body part that has been set up, and in this embodiment, it may be made of a touch pen or the tip of the user's finger may be recognized so that the touch status is displayed on the panel unit (100).

[0042] In addition, in the present invention, the panel unit (100) is configured to be a capacitive or piezoelectric touchscreen and to recognize contact with the designated means (10) or proximity of a certain distance or more, thereby recognizing that the displayed screen has been clicked.

[0043] As such, the panel unit (100) is an image display device with a preset area as illustrated, and can be touched by the designation means (10), and the touch status can be displayed together.

[0044] Additionally, the panel unit (100) has a reflectance of a certain level or higher and is configured to allow partial spraying of the actual shape in front. In the present invention, the panel unit (100) has a reflectance of a certain level and has a surface capable of displaying the designation means (10) in the reflected image.

[0045] Accordingly, the camera unit (200) described below captures the surface of the panel unit (100) together with the designation means (10) when capturing an image, and simultaneously collects the reflected image reflected on the surface of the panel unit (100).

[0046] In this way, the panel unit (100) according to the present invention outputs a preset image or video, and at the same time, when the position of the designation means (10) is detected, it outputs it together by reflecting it.

[0047] Meanwhile, the above camera unit (200) is provided in multiple numbers along the perimeter of the panel unit (100), and each takes a captured image independently.

[0048] Specifically, the camera unit (200) captures each image so that the designated means (10) at a position adjacent to the panel unit (100) and the reflected image of the designated means (10) reflected from the panel unit (100) are displayed simultaneously.

[0049] At this time, the camera unit (200) includes a plurality of cameras, each of which simultaneously captures the image, and the captured image is captured in a different form depending on the position of the designation means (10) and the distance from the panel unit (100).

[0050] In this embodiment, the camera unit (200) includes a first shooting unit (210) in the form of a camera and a second shooting unit (220) spaced apart therefrom, wherein the first shooting unit (210) is located at the upper left corner of the panel unit (100) and the second shooting unit (220) is located at the upper right corner of the panel unit (100) to capture an image.

[0051] The first shooting unit (210) is positioned along the perimeter of the panel unit (100) from a predetermined position toward the center and collects a first image by photographing the panel unit (100) and the designated means (10) together. Then, the second shooting unit (220) is positioned along the perimeter of the panel unit (100) spaced apart from the first shooting unit and positioned toward the center, and collects a second image by photographing the panel unit (100) and the designated means (10) together.

[0052] The first shooting unit (210) and the second shooting unit (220) arranged in this manner each take a first image and a second image as shown in FIG. 2, and through the two images, the control unit described later derives the three-dimensional coordinates of the designation means (10) on the panel unit (100).

[0053] Here, the camera unit (200) captures each image so that a designated means (10) at a position adjacent to the panel unit (100) and a reflected image of the designated means (10) reflected from the panel unit (100) are displayed simultaneously.

[0054] That is, the first image and the second image are each captured so that the panel unit (100), the designation means (10), and the reflected image are simultaneously visible.

[0055] Next, the control unit converts the position coordinates of the designation means (10) in the plurality of captured images taken by the camera unit (200) into the coordinate system of the panel unit (100) through a homography algorithm and displays them.

[0056] Specifically, the control unit collects the first image and the second image, which are the captured images, and derives the position coordinates of the designation means (10) through a separate algorithm.

[0057] At this time, when the control unit derives the position coordinates of the designation means (10), it may first derive them through a homography algorithm, and additionally calculate the difference in position coordinates between the first image and the second image using trigonometry in the panel unit (100) to additionally derive and verify the position of the designation means (10).

[0058] That is, in the present invention, the control unit derives the position coordinates of the designation means (10) using both a homography method and a trigonometry method, respectively, and verifies them together to derive the accurate position of the designation means (10).

[0059] In the present invention, the method by which the control unit derives the position coordinates of the designation means (10) is examined in more detail by deriving the X-axis and Y-axis positions in the coordinate system of the panel unit (100) through the analysis of the first image and the second image. At this time, the X-axis and Y-axis of the designation means (10) represent the horizontal and vertical directions of the panel unit (100), respectively, and the Z-axis represents the vertical separation direction between the panel unit (100) and the designation means (10).

[0060] In the present invention, the control unit first analyzes each of the first image and the second image to derive the position coordinates of the designation means (10) by converting them into a coordinate system on the panel unit (100).

[0061] At this time, the first shooting unit (210) and the second shooting unit (220) are spaced apart at different corners of the panel unit (100) and generate a calibration map through a commonly used homography algorithm.

[0062] Specifically, looking at FIG. 3, when the first capturing unit (210) and the second capturing unit (220) calculate matching pairs looking at the designated means (10) for each of the first image and the second image, we can calculate extrinsic parameters between the two capturing units, namely Rotation and Translation.

[0063] Through this, the control unit can derive the X-axis coordinate and Y-axis coordinate of the designation means (10) on the panel unit (100), respectively.

[0064] Subsequently, the control unit derives the vertical separation distance between the panel unit (100) and the designation means (10) based on the midpoint of the separation distance between the position of the designation means (10) in the captured image and the position of the designation means (10') in the reflected image, as shown in FIG. 4.

[0065] That is, the Z-axis position of the designation means (10) on the panel unit (100) can be derived.

[0066] Through this process, the control unit can derive the three-dimensional position coordinates of the designated means (10) through the captured image collected from the camera unit (200).

[0067] As described above, the input device according to the present invention can collect independent images through a plurality of shooting units provided along the perimeter of the panel unit (100), and analyze them to derive three-dimensional position coordinates of the panel unit (100) from the panel unit (100).

[0068] In particular, in the case of the present invention, the camera unit (200) can collect the captured image using only two shooting units and derive the position coordinates of the designated means (10).

[0069] Next, with reference to FIG. 5, we examine the feature of the control unit according to the present invention controlling the output image in the panel unit (100) according to the position coordinates of the designation means (10).

[0070] FIG. 5 is a diagram showing that the image output changes according to the distance between the designation means (10) and the panel unit (100) in the input device of FIG. 1.

[0071] The control unit according to the present invention displays an output image to the user in a form pre-set in the panel unit (100) corresponding to the detected position of the designation means (10).

[0072] Specifically, the control unit may be displayed in various ways when indicating the location of the designation means (10), and in this embodiment, it is displayed on the panel unit (100) in the form of a pre-set shape.

[0073] At this time, the X-axis and Y-axis position of the above-mentioned designation means (10) is displayed at a corresponding position in the panel unit (100), and the output image displayed for the Z-axis position changes according to the distance.

[0074] That is, the control unit changes the output image displayed according to the distance the designation means (10) is separated from the planar coordinates of the panel unit (100).

[0075] For example, the control unit may be configured such that the size of the output image displayed increases or decreases as the distance between the designation means (10) and the panel unit (100) decreases, or alternatively, such that the color or density of the output image displayed changes as the distance between the designation means (10) and the panel unit (100) decreases.

[0076] Looking at FIG. 5, in this embodiment, when the vertical distance between the designation means (10) and the panel unit (100) increases, the size of the output image increases.

[0077] Specifically, looking at FIG. 5(a), the designated means (10) is detected to derive corresponding position coordinates on the panel unit (100) and display them in a circle.

[0078] At this time, the control unit adjusts the size of the output image in correspondence with the distance from the corresponding position of the designated means (10) indicated on the panel unit (100).

[0079] And as shown in Fig. 5(b), when the designation means (10) moves toward the panel unit (100) and becomes relatively close, the control unit transforms the output image so that its size gradually increases.

[0080] That is, the control unit displays the designation means (10) in the form of a preset output image corresponding to the position coordinates on the panel unit (100), and by changing the size of the output image according to the distance, the distance between the designation means (10) and the panel unit (100) can be intuitively known.

[0081] Of course, in contrast to this, the size of the output image may increase depending on the distance between the above-mentioned designation means (10) and the above-mentioned panel unit (100), and the shape or color itself may also be configured to change.

[0082] Meanwhile, as shown in Fig. 5(c), when the control unit contacts the designated means (10) and the panel unit (100) or the distance between them becomes close within a preset range, it changes the motion of the output image and determines that the corresponding location has been clicked.

[0083] Specifically, the control unit changes the output image in response when the designated means (10) approaches the panel unit (100) by a certain distance or more, but controls it in a way that triggers additional motion or changes color, unlike the form in which the distance simply decreases.

[0084] In this embodiment, as illustrated, when the designation means (10) comes into contact with the panel unit (100) or approaches it by a distance greater than a preset distance, the color changes and it is recognized as having come into contact, and an operation can be performed accordingly.

[0085] Additionally, the control unit may be configured to detect in a similar manner not only when the designated means (10) simply moves closer to the panel unit (100) than a preset distance, but also when it operates with a preset motion.

[0086] For example, when the above-mentioned designation means (10) operates with a preset motion at a location adjacent to the panel unit (100), the control unit determines that the above-mentioned designation means (10) has come into contact with the panel unit (100), and in response, can output the output image in a form where the color changes.

[0087] As such, the control unit according to the present invention not only derives the position coordinates of the designation means (10) through the analysis of the first image and the second image, but also changes the output image according to the distance or motion between the designation means (10) and the panel unit (100), allowing the user to intuitively recognize it.

[0089] As described above, preferred embodiments according to the present invention have been examined. It is obvious to those skilled in the art that, in addition to the embodiments described above, the present invention may be embodied in other specific forms without departing from its spirit or scope. Therefore, the embodiments described above should be regarded as illustrative rather than restrictive, and accordingly, the present invention is not limited to the description above but may be modified within the scope of the appended claims and their equivalents. Explanation of the symbols

[0091] 10: Designated means 100: Panel unit 200: Camera unit 210: 1st Camera Department 220: 2nd Filming Department

Claims

Claim 1 An input device comprising: a panel unit having a predetermined area and formed in a rectangular shape capable of outputting an image; a plurality of camera units provided along the perimeter of the panel unit, each capturing a specific image such that a designated means at a position adjacent to the panel unit and a reflected image of the designated means reflected from the panel unit are simultaneously displayed; and a control unit that converts and displays the position coordinates of the designated means in the plurality of captured images captured by the camera unit into the coordinate system of the panel unit through a homography algorithm, wherein the control unit derives the vertical separation distance between the panel unit and the designated means based on the midpoint of the separation distance between the position of the designated means in the captured image and the position of the designated means in the reflected image. Claim 2 An input device according to claim 1, wherein the control unit calculates the difference in position coordinates from the panel unit to the captured image using trigonometry to additionally derive and verify the position of the designation means. Claim 3 An input device according to claim 1, wherein the control unit displays an output image to the user in a form pre-set in the panel unit in correspondence with the detected position of the designated means. Claim 4 In paragraph 3, the control unit is an input device characterized in that the output image displayed changes according to the distance the designation means is spaced forward from the planar coordinates of the panel unit. Claim 5 In paragraph 4, the control unit is an input device that controls the size of the output image displayed as the distance between the designation means and the panel unit decreases, so that the size increases or decreases. Claim 6 In paragraph 4, the control unit is an input device that controls the color or density of the output image displayed as the distance between the designation means and the panel unit decreases. Claim 7 In paragraph 4, the control unit is an input device that determines that the corresponding location has been clicked by changing the motion of the output image when the designated means and the panel unit come into contact or the distance between them becomes close within a preset range. Claim 8 An input device according to claim 1, wherein the camera unit comprises: a first capturing unit that is positioned along the perimeter of the panel unit toward the center at a predetermined position and captures the panel unit and the designated means together to collect a first image; and a second capturing unit that is positioned along the perimeter of the panel unit spaced apart from the first capturing unit and faces toward the center, and captures the panel unit and the designated means together to collect a second image. Claim 9 In claim 8, the camera unit is an input device in which the first shooting unit and the second shooting unit are spaced apart and disposed at different corner portions of the panel unit. Claim 10 In paragraph 1, the designation means is an input device used by recognizing a pre-set separate device or a user's body part. Claim 11 An input device according to claim 1, wherein the panel unit has a surface having a certain level of reflectance and capable of displaying the designation means in the reflected image. Claim 12 An input device according to claim 1, wherein the panel unit is composed of a touchscreen.

Images