Projection indication devices and methods thereof

Abstract

Projection indication devices and methods thereof are provided. The projection indication device includes an image capturing unit, a detection unit, a processing unit, and a projection unit. The image capturing unit obtains an image corresponding to a field. The detection unit detects a field state corresponding to the field, and detects a target distance of a first object in the field state. The processing unit uses a calculation module to determine a first position of the first object and a second position of a second object in the image, and calculates a result based on the first position, the second position, and the target distance. The projection unit projects the result into the field as a projected image, wherein a length of the projected image changes based on the target distance.

Description

Technical Field

[0001] This invention relates to a projection indicator device and method, and more particularly to a projection indicator device and method that can combine image and field detection and use projection to assist in ball sports. Prior Technology

[0002] In recent years, laser rangefinders have replaced traditional ranging methods as the mainstream ranging system. Laser ranging can be divided into three methods: triangulation, time-of-flight (ToF) measurement, and confocal measurement. Currently, the most common method is time-of-flight (ToF), which measures the round-trip time of the laser. The principle of ToF is to use a sight or rangefinder to emit coded laser light from a pulsed infrared source to the target object. The ToF camera then receives the laser light reflected back from the target object and calculates the distance to the target object using a ranging formula. Due to the unique principle of lasers, measurements can be taken even if the target is inconvenient to approach.

[0003] On the other hand, LiDAR technology is becoming increasingly mature and widespread. LiDAR is a sensing technology that emits low-power, eye-safe laser light to perform pulse measurements and measures the time required for the laser light to travel round-trip between the sensor and the target. The resulting data can be used to generate 3D images, while providing spatial location and depth information for identifying, classifying, and tracking moving objects.

[0004] In some ball sports, such as golf, beginners often find it difficult to judge the direction and force of their swing. Therefore, this invention provides a projection indicator device and method as a guide for beginners in ball sports. Summary of the Invention

[0005] In view of this, the present invention provides a projection pointing device and a method thereof.

[0006] An embodiment of the present invention provides a projection pointing device comprising an image capturing unit, a detection unit, a processing unit, and a projection unit. The image capturing unit acquires an image of a corresponding field. The detection unit detects a field state corresponding to the field state and detects a target distance of a first object within that field state. The processing unit uses a calculation module based on the image to determine a first position of the first object and a second position of a second object in the image, and calculates a result based on the first position, the second position, and the target distance. The projection unit projects this result as an image onto the field. The length of the image varies according to the target distance.

[0007] An embodiment of the present invention provides a projection indication method. First, an image of a corresponding field is acquired using an image capturing unit. Next, a detection unit detects the field state corresponding to the field and detects the target distance of a first object within the corresponding field state. Then, based on the image, a calculation module determines a first position of the first object and a second position of a second object in the image, and calculates a result based on the first position, the second position, and the target distance, the result including the length of an image. Then, the length of the image is adjusted according to the target distance, and the image is projected using a projection unit based on the result to display the image.

[0008] In some embodiments, the result includes a direction and the length of the image, and the length of the image is proportional to the target distance.

[0009] In some embodiments, the field status includes a topographic map, a wind speed, a humidity, a light intensity, an obstacle distribution, or a grass line status.

[0010] In some embodiments, the projection unit includes a light source and a light deflector. The light source emits visible light, and the visible light is projected onto the image between the first position and the second position in the field via the light deflector.

[0011] In some embodiments, the detection unit includes a photodiode that emits a vertical cavity surface-emitting laser (VCSEL) in a flash manner and receives the reflected laser beams in four zones in turn through a single-photon avalanche diode (SPAD) sensor, and calculates the distance to the target using time-of-flight (ToF) ranging.

[0012] In some embodiments, the field includes a green, a table, or a course, the first object being a flagpole, a goal, or a hole, and the second object being a ball.

[0013] In some embodiments, a housing is further included, in which the detection unit, the projection unit and the image capturing unit are disposed. The detection unit is disposed between the projection unit and the image capturing unit, and in a usage state, the projection unit is away from a plane of the field, and the image capturing unit is close to the plane of the field.

[0014] In some embodiments, the projection indicator device meets at least one of the following conditions: 1≦LDF / CF≦2; 92≦(LDP x LDW) / V≦420; 0.7≦PF / CF≦1.5, wherein LDF is any field of view of one of the detection units; CF is any field of view of one of the image capturing units; LDP is a pixel value of one of the detection units; LDW is a weight of one of the detection units; V is a volume of one of the projection indicator devices; and PF is any field of view of one of the projection units.

[0015] The method described above can exist through program code. When the program code is loaded and executed by a machine, the machine becomes an apparatus for implementing the present invention.

[0016] To make the above-mentioned objects, features and advantages of the present invention more apparent and understandable, specific embodiments are described below in conjunction with the accompanying drawings, and detailed in detail are as follows. Simple Explanation of the Diagram

[0017] Figure 1 is a schematic diagram showing a projection indicator device according to an embodiment of the present invention.

[0018] Figure 2 is a schematic diagram showing a detection unit according to an embodiment of the present invention.

[0019] Figure 3 is a schematic diagram showing a projection unit according to an embodiment of the present invention.

[0020] Figure 4 is a schematic diagram showing an example of a projection indicator device according to another embodiment of the present invention.

[0021] Figure 5 is a flowchart illustrating a projection indication method according to an embodiment of the present invention.

[0022] Figure 6 is a flowchart illustrating a projection indication method for a golf ball application according to an embodiment of the present invention.

[0023] Figure 7 is a schematic diagram showing an example of projection indication according to an embodiment of the present invention. Implementation

[0024] Figure 1 shows a projection pointing device according to an embodiment of the present invention. The projection pointing device 100 according to an embodiment of the present invention includes at least an image capturing unit 110, a detection unit 120, a projection unit 130, a calculation module 140, and a processing unit 150. The image capturing unit 110 may be a camera having at least one lens, used to capture an image of a corresponding field. In some embodiments, the field may be any moving environment, such as a golf green, a billiards table, a cricket field, a billiards field, an archery range, etc. It should be noted that the aforementioned fields are merely examples and the present invention is not limited thereto. Figure 2 shows a detection unit according to an embodiment of the present invention. The detection unit 120 in this embodiment includes at least a laser emitter 122 and a photosensor 124. In other embodiments, the detection unit may also include an anemometer, a hygrometer, a light intensity meter, an ultrasonic sensor, or a triangulation module (not shown). In some embodiments, the laser emitter 122 may be a vertical cavity surface-emitting laser (VCSEL) with a wavelength of 905nm, capable of detecting a range of 8m and a field of view (FOV) of 60° x 45° or 30° x 30°. In some embodiments, the photosensor 124 may be a single-photon avalanche diode (SPAD) sensor. It must be noted that the aforementioned laser emitter 122 and photosensor 124 are merely examples of this invention and are not limited thereto; any light source can be applied to this invention. In some embodiments, the detection unit 120 may use the laser emitter 122 to emit the VCSEL in a flash manner, and the photosensor 124, such as a single-photon avalanche diode (SPAD) sensor, may receive the reflected laser beams in four zones in turn, and calculate the distance using time-of-flight (ToF) ranging. The detection unit 120 can detect the field status of a corresponding field, including a topographic map of terrain undulations, as well as wind speed, humidity, light intensity, obstacle distribution or grass line status, and detect the distance of specific objects in the corresponding field.

[0025] Figure 3 shows a projection unit according to an embodiment of the present invention. The projection unit 130 according to an embodiment of the present invention includes at least a light source 132 and a light deflector 134. In some embodiments, the light source 132 may be a 1.3W, Φ 9mm light source using visible light with a wavelength of 650nm-652nm, and its projection angle range (field of view of the projection unit) may be 40° x 24°. In some embodiments, the light deflector 134 may be a 2D MEMS (Micro-Electro-Mechanical Systems) galvanometer. In one embodiment, the size of one of the galvanometers can be 1.0 mm x 1.2 mm, but is not limited thereto, as long as the galvanometer area (ML) is 1~1.3 mm2 (inclusive), and the scanning angle can be + / -10° (Fast); + / -6° (Slow), and the overall size (MV) of the 2D MEMS is 10.8 x 5.6 x 2.5 (mm), but is not limited thereto, as long as the 2D MEMS volume (MV) is 150~152 mm2 (inclusive). In some embodiments, the light source 132 projects visible light through the light deflector 134. The light deflector 134 can cause the laser to be incident on the reflector, and by controlling the reflection angle of the reflector, the laser beam LB is deflected to project an image onto a projection surface, such as the ground. In this embodiment, the image is a straight line. It is worth noting that in some embodiments, the image can be a curved shape, an arrow shape, etc. In some embodiments, the light deflector can be a prism, a plane mirror, or a curved mirror. In some embodiments, a light deflector may not be provided, and the light source may be directly projected onto a surface or a plane.

[0026] The computing module 140 can be trained using an artificial intelligence learning model and can identify the position, distance, and field state of objects in the images captured by the image capturing unit 110, such as topographic maps, to calculate / generate the movement path of a specific object, such as the trajectory of a golf ball, billiard ball, or pool ball, and calculate the corresponding movement direction and force. The processing unit 150 can execute the projection indication method of this invention, the details of which will be explained later.

[0027] Figure 4 shows an example of a projection indicator device according to another embodiment of the present invention. In this example, the projection indicator device 100 is designed as a cuboid. It is worth noting that the shape of the aforementioned projection indicator device is only an example of this case, and the present invention is not limited to any shape. Any shape, such as a circle, cube, or prism, can be applied to the present invention. In this example, the projection indicator device 100 can be mounted on a tripod T, and the detection unit 120 is disposed between the projection unit 130 and the image capturing unit 110. The projection unit 130, the detection unit 120, and the image capturing unit 110 are arranged sequentially from top to bottom. For example, when the projection indicator device 100 of the present invention is used on a billiard table, the projection unit 130 is away from the tabletop (plane), and the image capturing unit 110 is close to the tabletop; as another example, if used on a golf ball, the projection unit 130 is away from the green (plane), and the image capturing unit 110 is close to the green. It should be noted that the arrangement of the aforementioned components on the projection indicator device 100 is merely an example of this case, and the present invention is not limited thereto.

[0028] It must be noted that, in some embodiments, the projection indicator device meets at least one of the following conditions: 1≦LDF / CF≦2; 92≦(LDP x LDW) / V≦420; 0.7≦PF / CF≦1.5, 1064≦((CW x PW) / MV)+PF≦1448, where LDF is any field of view of one of the detection units; CF is any field of view of one of the image capturing units; LDP is a pixel value of one of the detection units; LDW is the weight of one of the detection units; V is the volume of one of the projection indicator devices; PF is any field of view of one of the projection units; CW is the weight of one of the image capturing units; PW is the weight of one of the projection units; and MV is the volume of one of the steering components.

[0029] The following table reveals the design parameters and conditions for two embodiments of this case: length is in millimeters (mm), volume is in cubic millimeters (mm3), angle is in degrees, weight is in grams (g), and pixel value is in pixels.

[0030]

[0031]

[0032] It is worth noting that, taking the LDF of Example 1 as an example, its field of view can be 60 degrees x 60 degrees, 60 degrees x 45 degrees, or 45 degrees x 45 degrees, and the same applies to other field of view angles. It must also be noted that the above table is only an example of this case, and the present invention is not limited thereto.

[0033] Figure 5 shows a projection indication method according to an embodiment of the present invention. The projection indication method according to an embodiment of the present invention is applicable to an electronic device, such as the projection indication device in Figure 1.

[0034] First, as in step S510, an image of a corresponding field is acquired using an image capturing unit. It is worth noting that in some embodiments, the field can be any moving environment, such as a golf green, a billiards table, a cricket field, an archery range, etc. It should be noted that the aforementioned field is merely an example in this case, and the invention is not limited thereto. Next, as in step S520, a laser is used to detect the field state corresponding to the field and to detect the distance (hereinafter referred to as the target distance) of a first object in the corresponding field state. As mentioned earlier, in some embodiments, the laser can emit a vertical cavity surface-emitting laser in a flash manner and receive the reflected laser beams in four zones in turn through a single-photon avalanche diode sensor, calculating the distance using time-of-flight ranging. In some embodiments, the field state can be a topographic map including terrain undulations. Then, as in step S530, based on the image acquired by the image capturing unit, a calculation module is used to determine the first position of the first object and the second position of the second object in the image. It should be noted that in some embodiments, the aforementioned field may be a green environment of a golf course, and the first object is a flagstick or a hole, and the second object is a golf ball. In some embodiments, the aforementioned field may be a billiard table, and the first object is a hole, and the second object is a billiard ball. It must be stated that the aforementioned field, first object, and second object are merely examples of this case, and the present invention is not limited thereto. Next, as in step S540, a direction and a force are calculated using a calculation module based on the first position of the first object, the second position of the second object, the target distance from the first object, and the field state. It is worth noting that in some embodiments, the projection indicator device may include an inertial sensor to detect attitude data corresponding to the projection indicator device. In some embodiments, the calculation module may further calculate the direction and force based on the attitude data. It should be noted that in some embodiments, the calculation module may correct the aforementioned target distance based on the first position of the first object and the second position of the second object. Subsequently, as in step S550, the calculated direction and force are projected using a projection unit to display a quantized guide line. As previously mentioned, the projection unit can project visible light through a light deflector. The light deflector directs the laser onto a reflector and deflects the laser by controlling the reflection angle of the reflector, thus projecting the guide line onto a projection surface, such as the ground. Notably, in some embodiments, the guide line can be a straight line, a curve, or an arrow. Notably, in some embodiments, greater distance indicates greater force required; therefore, the calculation module quantifies and displays the force as the length of the image. In other embodiments, headwinds, surface roughness, or grass line conditions also affect the force; therefore, in such embodiments, the calculation unit adjusts the image length based on the distance, wind speed, humidity, light intensity, obstacle distribution, or grass line condition.In some embodiments, the flagpole, goal, or hole and the ball are not on the same plane, so an angle (not shown) will also affect the magnitude of the image. For example, in Figure 7, the flagpole OB1 is at the top of the hill and the golf ball OB2 is at the bottom, which is an elevation angle; or the flagpole OB1 is at the bottom of the hill and the golf ball OB2 is at the top, which is a depression angle. The calculation unit calculates this angle and adjusts the image length accordingly. When the angle is an elevation angle, the larger the elevation angle, the longer the image; when the angle is a depression angle, the larger the depression angle, the shorter the image. In summary, the image length is positively correlated or proportional to the target distance. It is worth noting that an image with a far target distance but a small elevation angle may have the same image length as an image with a small target distance but a large elevation angle. Additionally, in some embodiments, the projection unit can display this guide line at a second position of the corresponding second object.

[0035] As previously described, in some embodiments, the field can be a green environment of a golf course, and the first object is a flagstick or a hole, and the second object is a golf ball. Figure 6 shows a method for calculating the direction and force of a golf ball application according to an embodiment of the present invention. In this embodiment, the field state can be a topographic map of the green environment, and the field state includes the grass line state of the green environment, i.e., the growth direction of the grass on the green. First, as in step S610, the calculation module calculates the path that the corresponding golf ball should take based on the position of the flagstick or hole, the position of the golf ball, the topographic map, and the grass line state, and as in step S620, obtains the direction and force according to the path. Similarly, the projection unit can project based on the calculated direction and force to display a quantized guide line. Similarly, the guide line can be a straight line or a curve, and the quantized guide line will be longer when the force is greater. In addition, in some embodiments, the projection unit can display this guide line at the position of the golf ball.

[0036] Figure 7 shows an example of a projection indicator according to an embodiment of the present invention. In this example, there is a flagstick OB1 and a golf ball OB2 on the green 700, and the projection indicator device PD can be placed at a distance of about 1 meter behind the golf ball OB2. The projection indicator device PD can acquire an image of the green 700 including the flagstick OB1 and the golf ball OB2 through the image capturing unit, and the light of the projection indicator device PD can detect the field status of the entire green environment, i.e., the topographic map, the flagstick OB1, the golf ball OB2, and the state of the grass lines. Based on the position of the flagstick, the position of the golf ball, the topographic map, and the state of the grass lines, the calculation module of the projection indicator device PD can calculate the trajectory TR that the golf ball OB2 should travel, as well as the corresponding direction and force. The projection unit of the projection indicator device PD can perform laser projection PLB according to the calculated direction and force to display a quantified guide line IL on the grass. Therefore, the user can control the direction and force of the shot according to the direction and length of the guide line IL.

[0037] Therefore, the projection indicator device and method of this case can combine image and light detection and use projection to assist in ball sports, thereby reducing the difficulty for users to use related auxiliary equipment and further increasing their interest in learning related sports.

[0038] The method, or a specific form or part thereof, of this invention may exist in the form of program code. The program code may be contained in physical media, such as floppy disks, optical discs, hard disks, or any other machine-readable (e.g., computer-readable) storage media, or may be a computer program product, not limited to an external form. When the program code is loaded and executed by a machine, such as a computer, that machine becomes a device for participating in this invention. The program code may also be transmitted via some transmission medium, such as wires or cables, optical fibers, or any transmission method. When the program code is received, loaded, and executed by a machine, such as a computer, that machine becomes a device for participating in this invention. When implemented in a general-purpose processing unit, the program code, combined with the processing unit, provides a unique device that operates similarly to an application-specific logic circuit.

[0039] 100: Projection indicator device

[0040] 110: Image Capture Unit

[0041] 120: Detection Unit

[0042] 122: Laser Emitter

[0043] 124: Light sensor

[0044] 130: Projection Unit

[0045] 132: Light source

[0046] 134: Light steering component

[0047] LB: Laser Beam

[0048] 140: Computing Module

[0049] 150: Processing Unit

[0050] T: tripod

[0051] S510, S520, S530, S540, S550: Steps

[0052] 610, 620: Steps

[0053] 700: Green

[0054] OB1: Flagpole

[0055] OB2: Golf ball

[0056] PD: Projection indicator device

[0057] TR: Moving the ball's trajectory

[0058] PLB: Laser Projection

[0059] IL: Guidance Line

Claims

1. A projection pointing device, comprising: An image capturing unit is used to acquire an image of a corresponding field; a detection unit is used to detect a field state of the corresponding field and detect the distance of a first object in the corresponding field state; a processing unit is used to use a calculation module to determine a first position of the first object and a second position of a second object in the image based on the image, and calculate a result based on the first position of the first object, the second position of the second object, and the distance; and a projection unit is used to project the result as an image onto the field; wherein the length of the image changes with the distance; wherein the result includes the length of the image, and the length of the image is positively correlated or proportional to the distance.

2. A projection indication method, comprising the following steps: acquiring an image of a corresponding field using an image capturing unit; detecting a field state of the corresponding field using a detection unit, and detecting a distance of a first object in the corresponding field state; determining a first position of the first object and a second position of a second object in the image using a calculation module based on the image; calculating a result using the calculation module based on the first position of the first object, the second position of the second object, and the distance, the result including a length of an image, wherein the length of the image is positively correlated with or proportional to the distance; adjusting the length of the image based on the distance; and projecting the image using a projection unit based on the result to display the image.

3. A projection pointing device, comprising: An image capturing unit is used to acquire an image of a corresponding field; a detection unit is used to detect a field state corresponding to the field and detect the distance of a first object in the corresponding field state; a processing unit is used to determine a first position of the first object and a second position of a second object in the image using a calculation module based on the image, and calculate a result based on the first position of the first object, the second position of the second object, and the distance; and a projection unit is used to project the result as an image onto the field; wherein the length of the image changes according to the distance; wherein the projection indicator meets at least one of the following conditions: 1 ≤ LDF / CF ≤ 2; 92 ≤ (LDP x LDW) / V≦420; 0.7≦PF / CF≦1.5 where LDF is any field of view of the detection unit; CF is any field of view of the image capturing unit; LDP is a pixel value of the detection unit; LDW is the weight of the detection unit; V is the volume of the projection indicator device; and PF is any field of view of the projection unit.

4. A projection indication method, comprising the following steps: acquiring an image of a corresponding field using an image capturing unit; detecting a field state corresponding to the field using a detection unit, and detecting a distance of a first object in the corresponding field state; determining a first position of the first object and a second position of a second object in the image using a calculation module based on the image; calculating a result using the calculation module based on the first position of the first object, the second position of the second object, and the distance, the result including a length of an image; adjusting the length of the image based on the distance; and projecting the image using a projection unit based on the result to display the image, wherein the projection unit includes a light source emitting visible light, the visible light projecting the image between the first position and the second position in the field, and satisfying at least one of the following conditions: 1 ≤ LDF / CF ≤ 2; 92 ≤ (LDP x LDW) / V≦420; 0.7≦PF / CF≦1.5; 967.9≦((CWxPW) / MV)+PF≦1607.9, where, LDF is any field of view of the detection unit; CF is any field of view of the image capturing unit; LDP is a pixel value of the detection unit; LDW is the weight of the detection unit; V is the volume of the projection indicator; PF is any field of view of the projection unit; CW is the weight of the image capturing unit; PW is the weight of the projection unit; and MV is the volume of the steering component.

5. The projection pointing device as described in any one of claims 1 to 4, wherein the projection unit includes a light source and a light deflector, the light source emitting visible light, the visible light being directed by the light deflector to project an image onto the field between the first position and the second position, satisfying the condition 967.9≦((CWxPW) / MV)+PF≦1607.9, wherein... CW is the weight of one of the image capturing units, PW is the weight of one of the projection units, MV is the volume of one of the steering components, and PF is any field of view of one of the projection units.

6. The projection indicator device as described in claim 5, wherein the field status includes a topographic map, a wind speed, a humidity, a light intensity, an obstacle distribution, or a grass line status.

7. The projection pointing device as described in claim 5, wherein the detection unit includes a photodiode that emits a vertical cavity surface-emitting laser (VCSEL) in a flash manner and receives the reflected laser beams in four zones in turn through a single-photon avalanche diode (SPAD) sensor, and calculates the distance using time-of-flight (ToF) ranging.

8. The projection indicator device as described in claim 5, wherein the field includes a corresponding green, a table or a ball field, the first object is a flagpole, a goal or a hole, and the second object is a sphere.

9. The projection pointing device as described in claim 5 further includes a housing, in which the detection unit, the projection unit and the image capturing unit are disposed, the detection unit is disposed between the projection unit and the image capturing unit, and in a state of use, the projection unit is away from a plane of the field, and the image capturing unit is close to the plane of the field.

Images