Projection device with dynamic depth sensing and projection method thereof

Abstract

The present application provides a projection device and a projection method with dynamic depth sensing. The projection device has a projection unit, a depth sensing unit and a processor. The depth sensing unit is arranged in a fixed relative position with the projection unit and faces the same direction with the same angle of view as the projection unit. The processor is configured to project a projection picture with a target object to a projection area by the projection unit, acquire a distance parameter representing the distance from the projection unit to the projection area by the depth sensing unit, and adjust the target object in the projection picture based on the distance parameter. The size of the specific target object in the projection picture is not affected by the distance.

Description

Technical Field

[0001] This invention relates to a projection device and projection method, and more particularly to a projection device and projection method with dynamic depth sensing. Background Technology

[0002] In existing technologies, the projection screen size and the size of the content objects in a typical projection system are maintained at a fixed ratio. If the projection screen size is changed, the size of the content objects will be scaled proportionally, which will also change the physical position of the content objects on the projection area. Such a projection system is inconvenient to use in certain situations. Summary of the Invention

[0003] In view of this, the present invention provides a projection device and a projection method with dynamic depth sensing. The projection device with dynamic depth sensing of the present invention includes a projection unit, a depth sensing unit, and a processor. The depth sensing unit is positioned in a fixed relative position to the projection unit and faces the same direction with the projection unit at the same viewing angle. The processor is coupled to the projection unit and the depth sensing unit. The processor is configured to: project a projection image containing a target object onto a projection area via the projection unit; acquire a distance parameter representing the distance from the projection unit to the projection area via the depth sensing unit; and adjust the target object in the projection image based on the distance parameter.

[0004] A projection method with dynamic depth sensing according to the present invention includes: projecting a projection image containing a target object onto a projection area via a projection unit; acquiring a distance parameter representing the distance from the projection unit to the projection area via a depth sensing unit; and adjusting the target object in the projection image based on the distance parameter.

[0005] Based on the above, the projection device and projection method with dynamic depth sensing of the present invention can utilize the projector combined with depth measurement technology to ensure that the size and relative position of the content objects in the projected image remain the same at any scaling size. This improves the ease of use of the projection device and projection method, and expands their application scenarios. Attached Figure Description

[0006] Figure 1 This is a schematic diagram of a projection device with dynamic depth sensing according to an embodiment of the present invention;

[0007] Figure 2 This is a flowchart illustrating a projection method according to an embodiment of the present invention;

[0008] Figure 3 This is a schematic diagram illustrating the adjustment of a target object in a projected image according to pixel size parameters, as shown in an embodiment of the present invention.

[0009] Figure 4 This is a schematic diagram illustrating the adjustment of a target object in a projected image based on pixel position parameters, according to an embodiment of the present invention.

[0010] Figure 5 This is a schematic diagram illustrating the effective working distance according to an embodiment of the present invention.

[0011] Explanation of icon numbers

[0012] 100: Projection device

[0013] 110: Processor

[0014] 120: Storage Media

[0015] 130: Projection Unit

[0016] 140: Depth Sensing Unit

[0017] 20'', 40'', 80'', 120'': Projection screen size

[0018] H: Target physical altitude parameter

[0019] H px1 H px2 :Pixel height parameter

[0020] K: Target physical width parameter

[0021] K px1 K px2 :pixel width parameter

[0022] KB: Target

[0023] S210, S220, S230: Steps

[0024] S h Resolution height parameter

[0025] S W Resolution width parameter

[0026] W: Physical width

[0027] WD1, WD2: Working distance

[0028] X p0 Target physical horizontal position parameters

[0029] Y p0 Target physical vertical position parameters

[0030] X s : Pixel horizontal position parameter

[0031] Ys :Pixel vertical position parameter Detailed Implementation

[0032] Figure 1 This is a schematic diagram of a projection device 100 with dynamic depth sensing according to an embodiment of the present invention. In this embodiment, the projection device 100 may include a processor 110, a storage medium 120, a projection unit 130, and a depth sensing unit 140. The processor 110 may be coupled to the storage medium 120, the projection unit 130, and the depth sensing unit 140.

[0033] The processor 110 may be, for example, a central processing unit, or other programmable general-purpose or special-purpose microprocessor, digital signal processor, programmable controller, application-specific integrated circuit or other similar components or combinations thereof.

[0034] Storage medium 120 is used to store various software, data, and program codes required for the operation of projection device 100, such as the throw ratio parameters described later. Storage medium 120 may be, for example, non-transient fixed or removable random access memory, read-only memory, flash memory, hard disk, solid-state drive, or other similar components or combinations thereof.

[0035] The projection unit 130 is used to project a projection image onto a projection area. The projection area may be, for example, the entire area, a specific area, or any area corresponding to a wall or projection screen, etc., and the present invention is not limited thereto. In this embodiment, the size of the projection image projected by the projection device 100 is determined based on the distance between the projection unit 130 and the projection area and the throw ratio parameter. The throw ratio parameter can be expressed as the following formula (1):

[0036] (1)

[0037] In formula (1), T is the projection ratio parameter, D is the distance parameter representing the distance between the projection unit 130 and the projection area, and W is the physical width of the projected image on the projection area. In this embodiment, the projection ratio parameter of the projection unit 130 of each projection device 100 is a fixed value. That is, the projection device 100 of this embodiment changes the size of the projected image by changing the distance between the projection unit 130 and the projection area, which is different from the existing projection system that changes the size of the projected image by changing the projection range parameter through hardware or software.

[0038] The depth sensing unit 140 is used to obtain the distance between the projection unit 130 and the projection area. The depth sensing unit 140 may be, for example, an ultrasonic distance sensor, a light detection and ranking (LiDAR) sensor, a structured light depth sensor, or other sensing devices that can sense the distance or depth between the projection unit 130 and the projection area, and the present invention is not limited thereto.

[0039] In this embodiment, the depth sensing unit 140 is positioned in a fixed relative position to the projection unit 130, and faces the same direction from the same viewing angle as the projection unit 130. This improves the accuracy of the distance between the projection unit 130 and the projection area measured by the depth sensing unit 140.

[0040] Figure 2 This is a flowchart illustrating a projection method according to an embodiment of the present invention, wherein the projection method can be derived from... Figure 1 The processor 110 of the projection device 100 is used to implement this.

[0041] In step S210, the processor 110 projects a projection image of the target object onto the projection area via the projection unit 130. For example, the projection device 100 may be configured with a Universal Serial Bus (USB), and the processor 110 of the projection device 100 may receive an image signal of the target object from an external electronic device via the USB and project a projection image corresponding to the image signal onto the projection area.

[0042] In step S220, a distance parameter representing the distance from the projection unit 130 to the projection area is acquired by the depth sensing unit 140. In this embodiment, the value of the distance parameter may be in centimeters, for example, but the invention is not limited thereto.

[0043] In step S230, the processor 110 adjusts the target object in the projected image based on the distance parameters. Specifically, the processor 110 monitors whether the distance parameters change. When the distance parameters do not change, in this embodiment, it means that the size of the projected image does not change, therefore the size and position of the target object on the projected image do not change, and thus there is no need to adjust the parameters corresponding to the target object. When the distance parameters change, it means that the size of the projected image has changed, therefore it is necessary to adjust the parameters corresponding to the target object to keep the physical size of the target object on the projected image and / or its distance from the center of the projected image constant.

[0044] Please refer to Figure 3 , Figure 3 This is a schematic diagram illustrating the adjustment of a target object in a projected image based on pixel size parameters, according to an embodiment of the present invention. Figure 3In the diagram, 20'' and 40'' represent examples of projected image sizes of 20 inches and 40 inches, respectively. (0,0) is the origin (center point) of the projected image. W is the physical width of the projected image on the projection area. KB is the target object. H is the target object's physical height parameter. K is the target object's physical width parameter. S W This is the resolution width parameter of the projected image, representing the number of pixels in the width direction of the projected image. h K is the resolution height parameter of the projected image, representing the number of pixels in the height direction of the projected image. px1 and K px2 H is the pixel width parameter of the target object on the projection plane, representing the number of pixels of the target object in the width direction. px1 and H px2 This is the pixel height parameter of the target object on the projection surface, representing the number of pixels of the target object in the height direction.

[0045] exist Figure 3 In one embodiment, the processor 110 of the projection device 100, in response to a change in the distance parameter, obtains the resolution width parameter corresponding to the projected image from the storage medium 120; calculates the pixel size parameter corresponding to the target object based on the distance parameter and the resolution width parameter; and adjusts the target object in the projected image according to the pixel size parameter.

[0046] Specifically, the processor 110 can obtain from the storage medium the target physical width parameters and target physical height parameters corresponding to the target object, as well as the projection ratio parameters corresponding to the projection unit 130.

[0047] The processor 110 can use the following formula (2) to calculate the pixel width parameter in the pixel size parameter:

[0048] (2)

[0049] In formula (2), K px Let K be the pixel width parameter of the target object on the projection surface, and F be the width proportion of the target object in the projection image. From formula (2), we can see that the pixel width parameter K... px For example, it can be based on the resolution and width parameter S of the projected image. W It is calculated from the target physical width parameter K, the projection ratio parameter T, and the distance parameter D.

[0050] The processor 110 can use the following formula (3) to calculate the pixel height parameter in the pixel size parameter:

[0051] (3)

[0052] In formula (3), H pxH is the pixel height parameter of the target object on the projection surface, and K is the target physical width parameter of the target object. From formula (3), it can be seen that the pixel height parameter H... px For example, it can be based on the resolution and width parameter S of the projected image. W It is calculated from the target physical height parameter H, the projection ratio parameter T, and the distance parameter D.

[0053] In other words, the processor 110 can adjust the target object in the projected image according to the pixel width and pixel height parameters calculated using formulas (2) and (3) above. In this way, when the projection device 100 projects a 20'' or 40'' image onto the projection area, the physical width and physical height of the target object in the projection area are the same as the physical width and physical height corresponding to the target physical width and target height parameters.

[0054] Please refer to Figure 4 , Figure 4 This is a schematic diagram illustrating the adjustment of a target object in a projected image based on pixel position parameters, according to an embodiment of the present invention. For Figure 4 Implementation examples and Figure 3 Elements identical in the embodiments are labeled with the same reference numerals and their descriptions are omitted. Figure 4 In the middle, X s Y represents the horizontal position parameter of the target object, indicating the number of pixels the target object has shifted in the horizontal coordinate relative to the center of the projected image. s X is the vertical position parameter of the target object's pixels, representing the number of pixels the target object has shifted in the vertical coordinate system relative to the center of the projected image. p0 Y represents the target's physical horizontal position parameter with the center of the projected image as the origin. p0 The target's physical vertical position parameters are defined with the center of the projected image as the origin.

[0055] exist Figure 4 In this embodiment, the processor 110 of the projection device 100, in response to a change in the distance parameter, obtains the resolution width parameter corresponding to the projected image from the storage medium 120; calculates the pixel position parameter corresponding to the target object based on the distance parameter and the resolution width parameter; and adjusts the target object in the projected image according to the pixel position parameter.

[0056] Specifically, the processor 110 can obtain from the storage medium the target's physical horizontal position parameters and physical vertical position parameters with the center of the projected image as the origin, as well as the projection ratio parameters corresponding to the projection unit 130.

[0057] The processor 110 can use the following formula (4) to calculate the pixel horizontal position parameter among the pixel position parameters:

[0058] (4)

[0059] In formula (4), X s X is the horizontal position parameter of the pixel, and W is the physical width of the projected image on the projection area. From formula (4), we can see that the horizontal position parameter X... s For example, it can be based on the target's physical horizontal position parameter X. p0 The resolution and width parameters of the projected image, S W It is calculated from the projection ratio parameter T and the distance parameter D.

[0060] The processor 110 can use the following formula (5) to calculate the pixel horizontal position parameter among the pixel position parameters:

[0061] (5)

[0062] In formula (5), Y s Here, L is the vertical position parameter of the pixel, and S is the physical height of the projected image on the projection area. h Let Y be the resolution height parameter of the projected image, and W be the physical width of the projected image on the projection area. From formula (5), we can see that the pixel vertical position parameter Y... s For example, it can be based on the target's physical vertical position parameter Y. p0 The resolution and width parameters of the projected image, S W It is calculated from the projection ratio parameter T and the distance parameter D.

[0063] In other words, the processor 110 can adjust the target object in the projected image according to the pixel horizontal position parameters and pixel vertical position parameters calculated using formulas (4) and (5) above. In this way, when the projection device 100 projects a 20'' or 40'' image onto the projection area, the physical horizontal and physical vertical positions of the target object relative to the center of the projection image in the projection area are the same as the physical horizontal and physical vertical positions corresponding to the target physical horizontal and vertical position parameters.

[0064] In one embodiment, the processor 110 of the projection device 100 can adjust the target object in the projected image based on pixel size parameters and pixel position parameters. That is, the target object in the projected image is adjusted based on calculated pixel width and height parameters, as well as calculated pixel horizontal and vertical position parameters. In this way, even if the distance between the projection device 100 and the projection area changes, and the size of the projected image changes, the physical size of the target object in the projection area and the distance between the target object and the center of the projected image will not change. In other words, regardless of the distance between the projection device 100 and the projection area, the physical size of a specific target object in the projected image is not affected.

[0065] Regarding the application scenarios of the projection device 100, in applications where the projection device 100 is used to project presentations as the projected image, the target object KB can be, for example, an interactive virtual keyboard. Furthermore, the projection device 100 allows users to customize parameters related to the size and / or position of the interactive virtual keyboard. In this way, even if the distance between the projection device 100 and the projection area changes, the projection device 100 can project a user-defined interactive virtual keyboard with a fixed physical size and / or a fixed distance from the center of the projected image, allowing users to easily operate the interactive virtual keyboard during presentations.

[0066] The projection device 100 of the present invention is also suitable for other application scenarios. For example, in the application scenario of holding a traveling exhibition, the target object KB may be, for example, a virtual picture, and the projection area may be, for example, a canvas in a picture frame. The curator can appropriately set the parameters related to the size and / or position of the virtual picture. In this way, even if the distance between the projection device 100 and the projection area needs to be changed in different exhibition venues due to the size of the exhibition venue, the virtual picture can be projected onto the corresponding canvas at an appropriate size and position.

[0067] The quality of the projected image is affected when the distance between the projection unit 130 and the projection area is too close or too far. Therefore, in one embodiment, in addition to adjusting the target object in the projected image, the processor 110 of the projection device 100 can further determine whether the distance parameter obtained by the depth sensing unit 140 is within the effective working distance range. Specifically, when the processor 110 determines that the distance parameter is lower than a first threshold, it outputs a first warning message indicating that the projected image will be cropped. When the processor determines that the distance parameter is higher than a second threshold, it outputs a second warning message indicating that the clarity of the projected image will decrease. The first and second warning messages can be displayed independently as text or image information on the projected image, or can be used to warn the user in other ways; the present invention is not limited thereto.

[0068] Please refer to Figure 5 , Figure 5This is a schematic diagram illustrating the effective working distance according to an embodiment of the present invention. Figure 5 The working distance represented by WD1 only includes invalid distances below the first threshold, while the working distance represented by WD2 includes valid working distances below the second threshold and above the first threshold, as well as the invalid working distances corresponding to WD1. 20'', 40'', 80'', and 120'' are examples of projection screen sizes of 20 inches, 40 inches, 80 inches, and 120 inches, respectively. Additionally, Figure 5 This indicates that the physical size of the target object KB projected by the projection device 100 on the projection area and the distance between the target object and the center of the projection screen remain unchanged regardless of the size of the projected image. In this embodiment, WD1 and the aforementioned first threshold can be, for example, 50 cm, and WD2 and the aforementioned second threshold can be, for example, 300 cm. However, the present invention is not limited to these. WD1 and WD2, as well as the corresponding first and second thresholds, can be determined according to the hardware specifications of the projection unit 130 and the target physical size of the target object.

[0069] In summary, the projection device and method with dynamic depth sensing of the present invention can utilize the technology of combining a projector with depth measurement and the concept of effective working distance to ensure that the size and relative position of the content objects in the projected image remain the same at any scaling size. This improves the ease of use of the projection device and method, and expands its application scenarios.

Claims

1. A projection device with dynamic depth sensing, characterized in that, The projection device includes: Projection unit; A depth sensing unit is positioned relative to the projection unit, and is arranged with the projection unit facing the same direction and viewing the same angle; and A processor, coupled to the projection unit and the depth sensing unit, and configured to: The projection unit projects a projection image of the target object onto the projection area. The distance parameter representing the distance from the projection unit to the projection area is obtained through the depth sensing unit; and The target object in the projected image is adjusted based on the distance parameter.

2. The projection device according to claim 1, characterized in that, The projection device further includes a storage medium coupled to the processor, and the processor is further configured to: In response to the determination that the distance parameter has changed, a resolution width parameter corresponding to the projected image is obtained from the storage medium. The pixel size parameter corresponding to the target object is calculated based on the distance parameter and the resolution width parameter. as well as Adjust the target object in the projected image according to the pixel size parameters.

3. The projection device according to claim 2, characterized in that, The processor is further configured to: The target physical width parameter and aspect ratio parameter corresponding to the target object, as well as the projection ratio parameter corresponding to the projection unit, are obtained from the storage medium. The pixel width parameter of the pixel size parameter is calculated based on the distance parameter, the resolution width parameter, the target physical width parameter, and the projection ratio parameter. as well as The pixel height parameter is calculated based on the pixel width parameter and the aspect ratio parameter.

4. The projection device according to claim 1, characterized in that, The projection device further includes a storage medium coupled to the processor, and the processor is further configured to: In response to the determination that the distance parameter has changed, the resolution width parameter corresponding to the projected image is obtained from the storage medium; The pixel position parameters corresponding to the target object are calculated based on the distance parameter and the resolution width parameter. as well as Adjust the target object in the projected image according to the pixel position parameters.

5. The projection device according to claim 4, characterized in that, The processor is further configured to: The storage medium is used to obtain the target's physical horizontal position parameters and vertical position parameters, with the center of the projected image as the origin, as well as the projection ratio parameters corresponding to the projection unit. The pixel horizontal position parameter of the pixel position parameter is calculated based on the distance parameter, the resolution width parameter, the target physical horizontal position parameter, and the projection ratio parameter. as well as The pixel vertical position parameter of the pixel position parameter is calculated based on the distance parameter, the resolution width parameter, the target physical vertical position parameter, and the projection ratio parameter.

6. The projection device according to claim 1, characterized in that, The processor is further configured to: When the distance parameter is determined to be lower than a first threshold, a first warning message is output; and When the distance parameter is determined to be higher than the second threshold, a second warning message is output.

7. A projection method with dynamic depth sensing, applicable to a projection device, the projection device comprising a projection unit and a depth sensing unit, wherein the depth sensing unit is arranged with a fixed relative position to the projection unit and facing the same direction as the projection unit at the same viewing angle, characterized in that... The projection method includes: The projection unit projects a projection image of the target object onto the projection area. The distance parameter representing the distance from the projection unit to the projection area is obtained through the depth sensing unit; and The target object in the projected image is adjusted based on the distance parameter.

8. The projection method according to claim 7, characterized in that, Also includes: In response to the determination that the distance parameter has changed, the resolution width parameter corresponding to the projected image is obtained; The pixel size parameter corresponding to the target object is calculated based on the distance parameter and the resolution width parameter. as well as Adjust the target object in the projected image according to the pixel size parameters.

9. The projection method according to claim 8, characterized in that, Also includes: Obtain the target physical width parameter and aspect ratio parameter corresponding to the target object, as well as the projection ratio parameter corresponding to the projection unit; The pixel width parameter of the pixel size parameter is calculated based on the distance parameter, the resolution width parameter, the target physical width parameter, and the projection ratio parameter. as well as The pixel height parameter of the pixel size parameter is calculated based on the pixel width parameter and the aspect ratio parameter.

10. The projection method according to claim 7, characterized in that, Also includes: In response to the determination that the distance parameter has changed, the resolution width parameter corresponding to the projected image is obtained; The pixel position parameters corresponding to the target object are calculated based on the distance parameter and the resolution width parameter. as well as Adjust the target object in the projected image according to the pixel position parameters.

11. The projection method according to claim 10, characterized in that, Also includes: Obtain the target's physical horizontal position parameters and vertical position parameters with the center of the projected image as the origin, corresponding to the target object, as well as the projection ratio parameters corresponding to the projection unit; The pixel horizontal position parameter of the pixel position parameter is calculated based on the distance parameter, the resolution width parameter, the target physical horizontal position parameter, and the projection ratio parameter. as well as The pixel vertical position parameter of the pixel position parameter is calculated based on the distance parameter, the resolution width parameter, the target physical vertical position parameter, and the projection ratio parameter.

12. The projection method according to claim 7, characterized in that, Also includes: When the distance parameter is determined to be lower than the first threshold, a first warning message is output; as well as When the distance parameter is determined to be higher than the second threshold, a second warning message is output.

Images