Electronic device, projection system and projection method thereof

Abstract

The invention provides an electronic device, a projection system and a projection method thereof. The electronic device is in communication connection with the projection device. The electronic device includes a camera, a processor, and a memory storing an application program. The processor is coupled to the camera and the memory, and is configured to execute the following steps of the application program: controlling the projection device to project a mark image with a preset mark to a target area; controlling the camera to shoot a first image of the target area, wherein the first image comprises a foreground object and a background object of the target area; analyzing the first image to obtain a foreground contour corresponding to the foreground object; and superimposing the selected pattern in the foreground contour to generate a second image, and controlling the projection device to project the second image to the target area. Therefore, the convenience of light sculpture projection is improved.

Description

Technical Field

[0001] The present invention relates to a device, a system and a method, and more particularly to an electronic device, a projection system and a projection method thereof. Background Art

[0002] In projection mapping, a projection device is used to project an image onto a surface of an object, and the projected image often fits or adapts to the direction of the surface of the object, thereby creating rich visual effects.

[0003] However, to establish projection mapping, special equipment and very complicated operation and control procedures are currently required. These complicated procedures require professional installation companies and professional projection devices, peripheral equipment and audio and video editing outputs to set up according to environmental conditions. In particular, audio and video editing often requires professional audio and video production companies to produce professional special projection videos according to the application occasions and environment of projection mapping. These applications do not allow ordinary users to perform projection mapping at any time at home or when going out.

[0004] The "background technology" section is only used to help understand the content of the present invention. Therefore, the content disclosed in the "background technology" section may contain some known technologies that are not known to those skilled in the art. The content disclosed in the "background technology" section does not mean that the content or the problems to be solved by one or more embodiments of the present invention have been known or recognized by those skilled in the art before the application of the present invention. Summary of the invention

[0005] The present invention provides an electronic device, a projection system and a projection method thereof, which improve the convenience of light mapping. Other purposes and advantages of the present invention can be further understood from the technical features disclosed in the present invention.

[0006] To achieve one or part or all of the above purposes or other purposes, the electronic device of the present invention is communicatively connected to a projection device. The electronic device includes a camera, a processor, and a memory storing an application. The processor is coupled to the camera and the memory, and is configured to execute the following steps of the application: controlling the projection device to project a marked image with a preset mark to a target area; controlling the camera to capture a first image of the target area, wherein the first image includes a foreground object and a background object of the target area; analyzing the first image to obtain a foreground contour corresponding to the foreground object; and superimposing a selected pattern on the foreground contour to generate a second image, and controlling the projection device to project the second image to the target area.

[0007] To achieve one or part or all of the above purposes or other purposes, a projection system of the present invention includes a projection device and an electronic device, wherein: the projection device includes a camera and a first processor, wherein: the camera captures a first image of a target area, wherein the first image includes depth information of a foreground object and a background object in the target area; and the first processor is used to receive the first image and obtain a foreground contour of the corresponding foreground object by analyzing the depth information of the first image; the electronic device is communicatively connected to the projection device, and the electronic device includes a second processor, which is used to execute: superimposing a selected pattern on the foreground contour to generate a second image, and providing the second image to the projection device, so that the projection device projects the second image to the target area.

[0008] To achieve one or part or all of the above purposes or other purposes, a projection method of the present invention is used to control a projection device, the projection method comprising: controlling the projection device to project a marked image having a plurality of preset marks to a target area; capturing a first image of the target area, wherein the first image includes a foreground object and a background object of the target area; analyzing the first image to obtain a foreground contour corresponding to the foreground object; and superimposing a selected pattern on the foreground contour to generate a second image, and controlling the projection device to project the second image to the target area.

[0009] To achieve one or part or all of the above purposes or other purposes, a projection method of the present invention is used to control a projection system, wherein the projection system includes a projection device and an electronic device, the projection device includes a camera and a first processor, and the projection method includes: using the camera of the projection device to shoot a first image of a target area, wherein the first image includes depth information of a foreground object and a background object in the target area; using the first processor to obtain and analyze the first image to obtain a foreground contour of the corresponding foreground object based on the depth information of the first image; and using the electronic device to superimpose a selected pattern on the foreground contour to generate a second image, and providing the second image to the projection device, so that the projection device projects the second image to the target area.

[0010] Based on the above, the electronic device, projection system and projection method of the present invention can simply identify the foreground object in the target area, and superimpose the selected pattern on the foreground contour corresponding to the foreground object and project it, effectively improving the operational convenience of the light carving system. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] Figure 1 FIG. 1 is a schematic diagram of an electronic device and a projection device according to an embodiment of the present invention.

[0012] Figure 2 The figure is a flow chart of a projection method according to an embodiment of the present invention.

[0013] Figure 3AA schematic diagram of a marking image according to an embodiment of the present invention is shown.

[0014] Figure 3B A schematic diagram of a first image according to an embodiment of the present invention is shown.

[0015] Figure 3C A schematic diagram showing a selected pattern being superimposed on a foreground outline according to an embodiment of the present invention is shown.

[0016] Figure 3D A schematic diagram showing a second image being projected onto a target area according to an embodiment of the present invention is shown.

[0017] Figures 4A to 4C A schematic diagram of the operation process of an electronic device executing an application to determine a selected pattern according to an embodiment of the present invention is depicted.

[0018] Figure 5 FIG. 1 is a block diagram of a projection system according to an embodiment of the present invention.

[0019] Figure 6 The figure is a flow chart of a projection method according to an embodiment of the present invention.

[0020] Fig. 7A A schematic diagram of a first image according to an embodiment of the present invention is shown.

[0021] Figure 7B A schematic diagram of a foreground profile according to an embodiment of the present invention is depicted.

[0022] Figure 7C A schematic diagram showing a selected pattern being superimposed on a foreground outline according to an embodiment of the present invention is shown.

[0023] Fig.7D A schematic diagram showing a second image being projected onto a target area according to an embodiment of the present invention is shown.

[0024] Description of reference numerals:

[0025] 5: Projection system

[0026] 10, 50: Electronic devices

[0027] 11, 51: Projection device

[0028] 31: Tag images

[0029] 31A: Preset Mark

[0030] 32, 71: First Image

[0031] 33, 72: Foreground outline

[0032] 33A, 71A: Foreground objects

[0033] 33B, 71B: Background objects

[0034] 33C, 72A: Selected pattern

[0035] 34, 73: Second Image

[0036] 341: Select background

[0037] 100: Camera

[0038] 101: Memory

[0039] 102: Processor

[0040] 500: Second processor

[0041] 510: Camera

[0042] 511: The first processor

[0043] S21~S24, S61~S63: Steps DETAILED DESCRIPTION

[0044] The above-mentioned other technical contents, features and effects of the present invention will be clearly presented in the following detailed description of a preferred embodiment with reference to the accompanying drawings. The directional terms mentioned in the following embodiments, such as up, down, left, right, front or back, etc., are only the directions with reference to the accompanying drawings. Therefore, the directional terms used are used to illustrate and not to limit the present invention.

[0045] Figure 1 FIG. 1 is a schematic diagram of an electronic device 10 and a projection device 11 according to an embodiment of the present invention. Figure 2 The figure is a flow chart of a projection method according to an embodiment of the present invention. Figure 3A A schematic diagram of a marking image 31 according to an embodiment of the present invention is shown. Figure 3B A schematic diagram of a first image 32 according to an embodiment of the present invention is shown. Figure 3C FIG. 1 is a schematic diagram showing a selected pattern being superimposed on a foreground outline 33 according to an embodiment of the present invention. Figure 3D A schematic diagram of a second image 34 projected onto a target area is shown in accordance with an embodiment of the present invention. Figure 1 The electronic device 10 is communicatively connected to the projection device 11 to control the projection operation of the projection device 11 and adjust the projection image of the projection device 11. The electronic device 10 includes a camera 100, a memory 101 and a processor 102. The camera 100 can be used to capture images. The memory 101 stores an application program. The processor 102 coupled to the camera 100 and the memory 101 can access the memory 101 to execute the application program. Please refer to Figure 1 Matching Figures 3A to 3D, the processor 102 can execute an application program to control the projection device 11 to project a marked image 31 having a plurality of preset marks 31A to a target area; control the camera 100 to capture a first image 32 of the target area, wherein the first image 32 includes a foreground object 33A and a background object 33B of the target area, wherein the background object 33B may refer to, for example, a projection screen or a wall; analyze the first image 32 to obtain a foreground contour 33 corresponding to the foreground object 33A; and superimpose a selected pattern 33C on the foreground contour 33 to generate a second image 34, and control the projection device to project the second image 34 to the target area, such as Figure 3D In this embodiment, Figure 3D The presented second image 34 also includes a selected background 341. It is worth noting that the processor 102 superimposes the selected pattern 33C on the foreground outline 33 to generate the following Figure 3D Before the second image 34 is formed, the foreground outline 33 is first superimposed on the selected background 341, and then the selected pattern 33C is superimposed on the position of the foreground outline 33 to produce the following: Figure 3D In some embodiments, whether the selected background 341 is to be presented can be selected by the user. For example, on the display screen of the electronic device 10, there will be an option (not shown) to select whether to present the selected background 341. If the user chooses to present the selected background 341, the following will be presented: Figure 3D If you do not choose to present the selected background 341, only the following will be presented: Figure 3C In the target area, the selected background 341 is not used.

[0046] In short, the electronic device 10 can determine the foreground contour 33 corresponding to the foreground object 33A by shooting the first image 32 including the marker image 31. Further, the electronic device 10 can provide the selected background 341 by executing the application program, superimpose the foreground contour 33 on the selected background 341, and then superimpose the appropriate selected pattern 33C on the foreground contour 33 to generate the second image 34, and control the projection device 11 to project the second image 34, so that the selected pattern 33C can be appropriately projected on the foreground object 33A. The selected background 341 can be selected by the user to present the projection effect of the scene, or the selected background 341 is not used, and only the selected pattern 33C superimposed on the foreground contour 33 is presented.

[0047] Specifically, the electronic device 10 may be, for example (but not limited to), a mobile phone, a mobile station, an advanced mobile station (AMS), a server, a client, a desktop computer, a notebook computer, a network computer, a workstation, a personal digital assistant (PDA), a personal computer (PC), a tablet computer, a scanner, a telephone device, a television, a handheld game console, a music device, a wireless sensor, or other suitable electronic devices. The electronic device 10 may be connected to the projection device 11 by wired or wireless communication to transmit images to the projection device 11 and control the projection operation of the projection device 11.

[0048] In some embodiments, the memory 101 may be, for example (but not limited to), any type of fixed or removable random access memory (RAM), read-only memory (ROM), flash memory, hard disk drive (HDD), solid state drive (SSD) or similar elements or a combination of the above elements, and is used to store application programs or operation instructions that can be executed by the processor 102. The processor 102 is coupled to the camera 100 and the memory 101, and is communicatively connected to the projection device 11. Specifically, the processor 102 can execute the application program by controlling the operation of the camera 100 and the projection device 11. In some embodiments, the processor 102 may be, for example (but not limited to), a central processing unit (CPU), or other programmable general-purpose or special-purpose micro control unit (MCU), microprocessor, digital signal processor (DSP), programmable controller, application specific integrated circuit (ASIC), graphics processing unit (GPU), arithmetic logic unit (ALU), complex programmable logic device (CPLD), field programmable gate array (FPGA), any other type of integrated circuit, state machine, processor based on advanced reduced instruction set machine (ARM), or other similar elements or combinations of the above elements. Alternatively, the processor 102 may be a hardware circuit designed and implemented through hardware description language (HDL) or any other digital circuit design method known to those skilled in the art.

[0049] Please refer to Figures 3A to 3D Matching Figure 2 The projection method can be obtained by Figure 1 The electronic device 10 is used to execute. Figure 2The projection method includes steps S21 to S24. In step S21, the electronic device 10 can control the projection device 11 to project a marked image 31 having a preset mark 31A to the target area. In step S22, the electronic device 10 can shoot a first image 32 for the target area by the camera 100, wherein the first image 32 includes a foreground object 33A and a background object 33B of the target area. In step S23, the electronic device 10 can analyze the first image 32 to obtain a foreground contour 33 corresponding to the foreground object 33A. In step S24, the electronic device 10 can superimpose the selected pattern 33C on the foreground contour 33 to generate a second image 34, and control the projection device to project the second image 34 to the target area.

[0050] Next, regarding the electronic device 10 executing Figure 2 In the content of the projection method, please match Figures 3A to 3D , to better understand the operational details of the projection method.

[0051] The operation of step S21 will be combined with Figure 3A First, in step S21, when the electronic device 10 starts to execute the application program, the electronic device 10 can control the projection device 11 to project, for example, Figure 3A Specifically, the mark image 31 has at least two preset marks 31A, which are distributed at at least two corners of the mark image 31. In this embodiment, the mark image 31 has four preset marks 31A of two-dimensional bar codes, which are respectively set at the four corners of the mark image 31. The projection device 11 can receive the control of the electronic device 10 to project the mark image 31 into the target area.

[0052] The operation of step S22 will be combined with Figure 3B In step S22, the processor 102 of the electronic device 10 may control the camera 100 to capture the first image 32 of the target area. Specifically, the marker image 31 is projected by the projection device 11 into the target area having a foreground object 33A (e.g., a snowman doll) and a background object 33B (e.g., a wall or a screen). The first image 32 captured by the electronic device 10 may include the complete marker image 31 projected onto the target area.

[0053] The operation of step S23 will be combined with Figures 3B to 3CIn step S23, the processor 102 of the electronic device 10 analyzes the first image 32 to obtain the foreground contour 33 of the foreground object 33A in the first image 32. More specifically, the processor 102 performs background removal on the first image 32, and removes the background object 33B in the first image 32, thereby obtaining the coordinate trajectory of the foreground contour 33 corresponding to the foreground object 33A in the first image 32.

[0054] In some embodiments, after the processor 102 determines the foreground contour 33, the application executed by the electronic device 10 may overlay the selected pattern 33C on the foreground contour 33 of the first image 32 and display it on the screen of the electronic device 10, thereby generating the following image: Figure 3C In other words, the electronic device 10 can overlay the selected pattern 33C on the foreground outline 33 of the first image 32, thereby providing the user with a preview of the visual effect of the selected pattern 33C being projected onto the foreground object 33A.

[0055] Regarding the operation of the electronic device 10 executing the application to determine the selected pattern, please refer to Figure 3C , 4A ~4C contents will be explained together. Figures 4A to 4C The schematic diagram of the operation process of an electronic device executing an application to determine a selected pattern according to an embodiment of the present invention is shown. The memory 101 of the electronic device 10 may store a plurality of patterns to be selected (e.g. Figure 4A Alternatively, the electronic device 10 may be connected to a cloud server to download the selected pattern to the memory 101 of the electronic device 10. The electronic device 10 may receive a pattern input by the user or automatically selected from the selected patterns as the selected pattern, and select the selected pattern according to the selected pattern. Figure 4A The selected pattern is scaled by adjusting the coordinate track size of the foreground contour 33 shown in the middle, and finally the selected pattern is superimposed on the foreground contour 33 in the first image 32 to provide a preview to the user. Figure 4B A similar decision process is provided for the selected pattern, except that Figure 4B The pattern provided on the left is a portrait pattern. Figure 4C In the middle, it is a combination of Figure 4A , 4B The selected pattern determines the process, in Figure 4C The left side of the display provides multiple portrait patterns, expression patterns and accessory patterns for users to choose from, and Figure 4CThe right side of the foreground outline 33 shows the visual effect of the selected patterns being scaled to the same size as the foreground outline 33 and superimposed on the foreground outline 33. Therefore, the application executed by the electronic device 10 can provide the user with a simulated projection effect experience in advance, thereby determining an appropriate selected pattern.

[0056] In some embodiments, when the processor 102 executes the application, it first provides the selected background 341, and then superimposes the foreground outline 33 on the selected background 341. Figure 3C In addition to displaying the selected pattern 33C on the electronic device 10, the projection device 11 also projects a second image 34 having a selected background 341 and the selected pattern 33C onto the target area. In this way, the user can Figure 3C ) and the instant visual effect (such as Figure 3D ) to correct and adjust the size and position of the selected background 341 and the selected pattern 33C.

[0057] Please continue to match Figures 3B to 3D In some usage scenarios, the shooting direction of the electronic device 10 and the projection direction of the projection device 11 may be the same or similar, and the shooting range of the first image 32 shot by the electronic device 10 and the projection range of the second image 34 projected by the projection device 11 are also the same or similar. In this case, the processor 102 can directly identify the coordinate trajectory of the foreground contour 33 in the first image 32 as the foreground contour in the second image 34 projected by the projection device 11, and the selected pattern 33C displayed on the electronic device 10 and the selected pattern projected to the target area by the projection device 11 will have the same position and coordinate relationship in the first image 32 and the second image 34 respectively. Therefore, the processor 102 can superimpose the selected pattern 33C on the foreground contour 33 to generate the second image 34 having the selected pattern 33C.

[0058] Same match Figures 3B to 3D In some usage scenarios, the shooting direction of the electronic device 10 and the projection direction of the projection device 11 may have a deviation angle greater than the preset angle. As a result, the shooting range of the first image 32 shot by the electronic device 10 and the second image 34 projected by the projection device 11 have a certain degree of offset or deviation in both angle and range. Therefore, the foreground outline 33 in the first image 32 shot by the electronic device 10 needs to be calibrated to present the foreground outline in the second image 34 projected by the actual projection device 11.

[0059] For more details, please refer to Figures 3A to 3D The processor 102 may first determine the relative relationship between the first image 32 and the second image 34, and then use the relative relationship between the first image 32 and the second image 34 to determine the relative relationship between the first image 32 and the second image 34. Figure 3B The foreground contour 33 in the first image 32 is converted into Figure 3D Specifically, the processor 102 can first determine the projection range of the marker image 31 projected on the target area by identifying the position or coordinates of the preset marker 31A captured in the first image 32, and then determine the image range conversion relationship between the second image 34 and the first image 32. Then, according to the image range conversion relationship between the second image 34 and the first image 32, the processor 102 can convert the coordinate trajectory of the foreground contour 33 in the first image 32 into the coordinate trajectory of the foreground contour in the second image 34. Finally, the processor 102 superimposes the selected pattern 33C on the foreground contour 33, so that the foreground contour in the second image 34 also presents the selected pattern.

[0060] In addition, when the user adjusts the selected pattern 33C by operating the electronic device 10, since the second image 34 having the selected pattern is projected on the projection device 11, the adjustments made to the selected pattern 33C on the electronic device 10 (such as scaling, adjusting position, adjusting transparency, adjusting color, etc.) will also be updated on the second image 34 projected by the projection device 11, providing the user with instant visual feedback.

[0061] The operation of step S24 will be combined with Figure 3D In step S24, the processor 102 of the electronic device 10 may control the projection device 11 to project the second image 34 to the target area. Specifically, when the projection device 11 projects the second image 34 to the target area, the foreground contour 33 in the second image 34 corresponds to the foreground object 33A in the target area, so that the projected selected pattern 33C is projected exactly on the foreground object 33A.

[0062] In some embodiments, the processor 102 can obtain a plurality of candidate backgrounds by accessing the memory 101 or the cloud server, and the processor 102 can select a selected background from the candidate backgrounds automatically or by user input as the selected background 341. In this embodiment, the selected background 341 in the second image 34 is, for example, a snow scene, and after the selected background 341 is selected, the foreground outline 33 is superimposed on the selected background 341, and the selected pattern 33C can be superimposed on the foreground outline 33, thereby generating the second image 34.

[0063] Figure 5 FIG. 5 is a block diagram of a projection system 5 according to an embodiment of the present invention. Figure 6 The figure is a flow chart of a projection method according to an embodiment of the present invention. Fig. 7AA schematic diagram of a first image according to an embodiment of the present invention is shown. Figure 7B A schematic diagram of a foreground profile according to an embodiment of the present invention is depicted. Figure 7C A schematic diagram showing a selected pattern being superimposed on a foreground outline according to an embodiment of the present invention is shown. Fig.7D A schematic diagram of a second image projected onto a target area according to an embodiment of the present invention is shown. Figure 5 , the projection system 5 includes an electronic device 50 and a projection device 51, and the electronic device 50 is communicatively connected to the projection device 51. The projection device 51 includes a camera 510 and a first processor 511. The electronic device 50 includes a second processor 500. In short, although not shown, the electronic device 50 has a memory storing an application program. The second processor 500 coupled to the memory can access the memory to execute the application program. Please refer to Figure 5 Matching Figures 7A to 7D , the second processor 500 can execute the application program to control the projection device 51 to perform the following steps: control the camera 510 of the projection device 511 to capture the first image 71 of the target area to be projected, wherein the first image 71 includes the depth information of the foreground object 71A and the background object 71B of the target area; and receive the first image 71 through the first processor 511, and obtain the foreground contour 72 corresponding to the foreground object 71A by analyzing the depth information of the first image 71. Then, the second processor 500 can superimpose the selected pattern 72A on the foreground contour 72 to generate the second image 73, and provide the second image 73 to the projection device 51, so that the projection device 51 projects the second image 73 to the target area, such as Fig.7D .

[0064] Specifically, the electronic device 50 may be, for example (but not limited to), a mobile phone, a mobile station, an advanced mobile station (AMS), a server, a client, a desktop computer, a notebook computer, a network computer, a workstation, a personal digital assistant (PDA), a personal computer (PC), a tablet computer, a scanner, a telephone device, a television, a handheld game console, a music device, a wireless sensor, or other suitable electronic devices. The electronic device 50 may be connected to the projection device 51 by wired or wireless communication to transmit images to the projection device 51 and control the projection operation of the projection device 51.

[0065] In some embodiments, the camera 510 is, for example, a three-dimensional (3D) camera, a time of flight (ToF) camera, a structured light (Structured Light), a dual-lens camera, or other suitable cameras that can capture depth information. Therefore, the camera 510 can obtain depth information of objects in the image when shooting, and generate a first image with depth information accordingly.

[0066] In some embodiments, the first processor 511 and the second processor 500 may be, for example (but not limited to), a central processing unit (CPU), or other programmable general-purpose or special-purpose micro control unit (MCU), microprocessor, digital signal processor (DSP), programmable controller, application specific integrated circuit (ASIC), graphics processing unit (GPU), arithmetic logic unit (ALU), complex programmable logic device (CPLD), field programmable gate array (FPGA), any other type of integrated circuit, state machine, processor based on advanced reduced instruction set machine (ARM), or other similar elements or combinations of the above elements. Alternatively, the first processor 511 and the second processor 500 may be hardware circuits designed and implemented through hardware description language (HDL) or any other digital circuit design method known to those skilled in the art.

[0067] Please refer to Figures 7A to 7D Matching Figure 6 Flowchart of the process. Figure 6 The projection method can be obtained by Figure 5 The projection system 5 is used for execution. Figure 6The projection method includes steps S61 to S63. In step S61, the projection system 5 can capture a first image 71 of the target area by means of a camera 510 of the projection device 51, wherein the first image 71 includes depth information of a foreground object 71A and a background object 71B of the target area. In step S22, the projection system 5 can obtain and analyze the first image 71 by means of a first processor 511 of the projection device 51, so as to obtain a foreground contour 72 corresponding to the foreground object 71A according to the depth information of the first image 71. In step S23, the projection system 5 can generate a second image 73 by means of an electronic device 50 by superimposing a selected pattern 72A on the foreground contour 72, and provide the second image 73 to the projection device 51, so that the projection device 51 projects the second image 73 onto the target area.

[0068] Next, regarding the projection system 5 execution Figure 6 In the content of the projection method, please match Figures 7A to 7D , to better understand the operational details of the projection method.

[0069] The operation of step S61 will be combined with Fig. 7A First, in step S61, the camera 510 of the projection device 5 can shoot a first image 71 of the target area. The first image 71 shot by the camera 510 has depth information of all objects in the target area (including the foreground object 71A and the background object 71B).

[0070] The operation of step S62 will be combined with Figure 7B In step S62, the first image 71 captured by the camera 510 of the projection device 5 is provided to the first processor 511, so that the first processor 511 analyzes the depth of field information in the first image 71 and removes the background object 71B in the first image 71 accordingly, so as to obtain the following. Figure 7B A foreground outline 72 corresponding to the foreground object 71A is shown in FIG.

[0071] The operation of step S63 will be combined with Figure 7C , 7D In step S63, the foreground contour 72 obtained by the first processor 511 is provided to the second processor 500 of the electronic device 50, and the second processor 500 can determine the selected pattern by executing the application program. In some embodiments, the electronic device 50 can store multiple patterns to be selected, and the electronic device 50 can receive user input or automatically select from the multiple patterns to be selected and use it as the selected pattern (for example, Figure 7C The selected pattern 72A) and according to Figure 7CAfter the coordinate track size of the foreground contour 72 shown in is adaptively scaled to the same size as the foreground contour 72, the selected pattern 72A is superimposed on the foreground contour 72 to generate a second image 73, as shown in FIG. Fig.7D The electronic device 50 also provides the user with a preview of the image of the selected pattern 72A superimposed on the foreground outline 72 .

[0072] In some embodiments, the projection system 5 provides a user with a method of operating the electronic device 50 to display, for example, Figure 7C Specifically, the screen of the electronic device 50 may display a second image (eg, Fig.7D The second image 73 is displayed, and the selected pattern 72A is superimposed on the foreground outline 72 of the second image. In this way, when the user adjusts the selected pattern 72A by controlling the electronic device 50 (e.g., scaling, adjusting the position, adjusting the transparency, adjusting the color, etc.), the selected pattern in the second image 73 will also be updated on the second image 73 projected by the projection device 51, providing the user with instant visual feedback.

[0073] Please refer to Fig.7D After the user confirms the selected pattern and its settings, the second image 73 will be displayed as Fig.7D The projection device 51 is shown projected onto the target area. Fig.7D In some embodiments, the second processor 500 superimposes the selected pattern 72A on the foreground outline 72 to generate Fig.7D Before the second image 73 is displayed, the foreground outline 72 is first superimposed on the selected background (not shown), and then the selected pattern 72A is superimposed on the foreground outline 72 to generate the superimposed second image 73. Whether the selected background 341 is to be displayed can be selected by the user, as described above. Figure 3A to Figure 3D The implementation method is not described in detail here.

[0074] In summary, the electronic device, projection system and projection method of the present invention allow users to conveniently determine the foreground contour corresponding to the foreground object in the target area to be projected by executing an application program, and provide convenient visual feedback when the user adjusts the selected object, so that different selected objects can be accurately projected on the foreground object, producing rich visual effects. In this way, the electronic device, projection system and projection method of the present invention can improve the convenience and accuracy of traditional projectors in performing light mapping operations, and effectively enhance the three-dimensional effect of the selected pattern projected on the foreground object.

[0075] However, the above is only a preferred embodiment of the present invention, and it cannot be used to limit the scope of the implementation of the present invention. That is, all simple equivalent changes and modifications made according to the claims and the content of the invention of the present invention are still within the scope of the patent of the present invention. In addition, any embodiment or claim of the present invention does not need to achieve all the purposes, advantages or features disclosed by the present invention. In addition, the abstract and title (invention name) are only used to assist in the retrieval of patent documents, and are not used to limit the scope of rights of the present invention. In addition, the terms "first", "second", etc. mentioned in this specification or claims are only used to name the name of the element or distinguish different embodiments or scopes, and are not used to limit the upper or lower limit on the number of elements.

Claims

1. An electronic device, which is communicatively connected to a projection device, characterized in that: The electronic device comprises a camera, a memory and a processor, wherein: The memory stores an application program; and The processor is coupled to the camera and the memory, and the processor is configured to execute the following steps of the application: Controlling the projection device to project a marked image having a plurality of preset marks onto a target area; Controlling the camera to capture a first image of the target area, wherein the first image includes a foreground object and a background object of the target area; analyzing the first image to obtain a foreground contour corresponding to the foreground object; and The selected pattern is superimposed on the foreground outline to generate a second image, and the projection device is controlled to project the second image onto the target area.

2. The electronic device according to claim 1, characterized in that: The plurality of preset marks are respectively distributed at at least two corner positions in the mark image.

3. The electronic device according to claim 1, characterized in that: The first image includes a complete image of the marker projected onto the target area.

4. The electronic device according to claim 1, characterized in that: The processor obtains the foreground contour corresponding to the foreground object in the first image by removing the background object in the first image.

5. The electronic device according to claim 1, characterized in that: The processor is used to perform the following steps: Determining multiple positions of the multiple preset marks in the first image, and determining a projection range of the mark image projected on the target area according to the multiple positions; as well as Relative relationship information between the foreground contour and the marked image in the first image is calculated according to the projection range and the foreground contour.

6. The electronic device according to claim 5, characterized in that: The processor further scales the selected pattern according to the relative relationship information between the foreground contour and the mark image in the first image, so that the size of the scaled selected pattern matches the size of the foreground contour.

7. The electronic device according to claim 5, characterized in that: Before the processor superimposes the selected pattern on the foreground outline to generate the second image, the processor is further configured to perform the following steps: providing a selected background, and superimposing the foreground outline on the selected background; as well as The scaled selected pattern is superimposed on the position of the foreground contour according to the relative relationship information to generate the second image.

8. The electronic device according to claim 7, characterized in that: The selected pattern and the selected background are stored in the memory of the electronic device or downloaded from a cloud server to the memory of the electronic device.

9. The electronic device according to claim 1, characterized in that: The multiple preset marks are multiple two-dimensional barcodes.

10. A projection system, characterized in that: The projection system comprises a projection device and an electronic device, wherein: The projection device includes a camera and a first processor, wherein: The camera captures a first image of the target area, wherein the first image includes depth information of a foreground object and a background object in the target area; and The first processor is used to receive the first image and obtain a foreground contour corresponding to the foreground object by analyzing depth information of the first image; and The electronic device is communicatively connected to the projection device, and the electronic device includes a second processor for executing: A selected pattern is superimposed on the foreground outline to generate a second image, and the second image is provided to the projection device so that the projection device projects the second image onto the target area.

11. The projection system according to claim 10, characterized in that: The first processor removes the background object in the first image according to the depth information of the first image, thereby obtaining the foreground contour corresponding to the foreground object in the first image.

12. The projection system according to claim 10, characterized in that: The first processor is used to perform the following steps: Relative relationship information of the foreground contour in the first image is calculated according to the depth information of the first image and the foreground contour.

13. The projection system according to claim 12, characterized in that: The second processor further scales the selected pattern according to the relative relationship information of the foreground contour in the first image, so that the size of the scaled selected pattern matches the size of the foreground contour.

14. The projection system according to claim 12, characterized in that: Before the second processor superimposes the selected pattern on the foreground outline to generate the second image, the second processor is further configured to perform the following steps: providing a selected background, and superimposing the foreground outline on the selected background; as well as The scaled selected pattern is superimposed on the position of the foreground contour according to the relative relationship information to generate the second image.

15. The projection system according to claim 14, characterized in that: The selected pattern and the selected background are stored in the projection device or the electronic device, or the selected pattern and the selected background are downloaded from a cloud server to the projection device or the electronic device.

16. A projection method for controlling a projection device, characterized in that: The projection method comprises: Controlling the projection device to project a marked image having a plurality of preset marks onto a target area; Taking a first image of the target area, wherein the first image includes a foreground object and a background object of the target area; analyzing the first image to obtain a foreground contour corresponding to the foreground object; and The selected pattern is superimposed on the foreground outline to generate a second image, and the projection device is controlled to project the second image onto the target area.

17. The projection method according to claim 16, characterized in that: The plurality of preset marks are respectively distributed at at least two corner positions in the mark image.

18. The projection method according to claim 16, characterized in that: The first image includes a complete image of the marker projected onto the target area.

19. The projection method according to claim 16, characterized in that: The foreground outline corresponding to the foreground object in the first image is obtained by removing the background object in the first image.

20. The projection method according to claim 16, characterized in that: The projection method further comprises: Determining multiple positions of the multiple preset marks in the first image, and determining a projection range of the mark image projected on the target area according to the multiple positions; and Relative relationship information between the foreground contour and the marked image in the first image is calculated according to the projection range and the foreground contour.

21. The projection method according to claim 20, characterized in that: The projection method further comprises: The selected pattern is scaled according to the relative relationship information between the foreground contour and the mark image in the first image, so that the size of the scaled selected pattern matches the size of the foreground contour.

22. The projection method according to claim 20, characterized in that: Before superimposing the selected pattern on the foreground outline to generate the second image, the method further includes the following steps: providing a selected background, and superimposing the foreground outline on the selected background; and The scaled selected pattern is superimposed on the position of the foreground contour according to the relative relationship information to generate the second image.

23. The projection method according to claim 16, characterized in that: The multiple preset marks are multiple two-dimensional barcodes.

24. A projection method for controlling a projection system, characterized in that: The projection system includes a projection device and an electronic device, the projection device includes a camera and a first processor, and the projection method includes: Using the camera of the projection device to capture a first image of the target area, wherein the first image includes depth information of a foreground object and a background object of the target area; Acquiring and analyzing the first image by the first processor to obtain a foreground contour corresponding to the foreground object according to depth information of the first image; and The electronic device superimposes the selected pattern on the foreground outline to generate a second image, and provides the second image to the projection device, so that the projection device projects the second image to the target area.

25. The projection method according to claim 24, characterized in that: The foreground contour corresponding to the foreground object in the first image is obtained by removing the background object in the first image by the first processor according to the depth information of the first image.

26. The projection method according to claim 24, characterized in that: The projection method further comprises: The first processor calculates relative relationship information of the foreground contour in the first image according to the depth information of the first image and the foreground contour.

27. The projection method according to claim 26, characterized in that: The projection method further comprises: The selected pattern is scaled according to the relative relationship information of the foreground contour in the first image, so that the size of the scaled selected pattern matches the size of the foreground contour.

28. The projection method according to claim 26, characterized in that: Before the selected pattern is superimposed on the foreground contour to generate the second image, the following steps are also included: providing a selected background, and superimposing the foreground outline on the selected background; and The scaled selected pattern is superimposed on the position of the foreground contour according to the relative relationship information to generate the second image.

Images