Projection control method and device, electronic equipment and storage medium
By identifying the type of edge leakage of the projected image, processing the depth image to determine the edge leakage area, and adjusting the projected image, the edge leakage problem during projector projection is solved, and the visual effect of the projection is improved.
Patent Information
- Application Number
- CN202311467883.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-11-06
- Publication Date
- 2025-05-13
AI Technical Summary
When the projector projects an image to the surface of the object, there is a problem of edge leakage, resulting in poor visual effects of the projection.
By determining the target leakage edge type corresponding to the projected image, a depth image of the projected object is obtained, and the depth image is processed according to the morphological processing method corresponding to the leakage edge type, and the processed target depth image is obtained. Then, the leakage edge area is determined based on the depth image and the target depth image, and the projected image is adjusted and projected.
By accurately identifying and adjusting the leaked edge area, the overlap between the projected image and the projected object is improved, and the visual effect of the projection is improved.
Smart Images
Figure CN119996640A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of projection control technology, and more specifically, to a projection control method, device, electronic device and storage medium. Background Art
[0002] With the development of technology, images can be projected on the surface of objects in the real world to enhance the visual effect of the object. However, when a projector projects an image on the surface of an object, there will be a problem of missing edges, resulting in poor visual effects of the projection.
[0003] Therefore, there is an urgent need for a projection control solution to improve the visual effect of projection. Summary of the invention
[0004] In view of the above problems, the present application proposes a projection control method, device, electronic device and storage medium.
[0005] In a first aspect, an embodiment of the present application provides a projection control method for an electronic device, the method comprising: determining a target leakage edge type corresponding to the projection image according to a projection result of the projection image on the projected object; acquiring a depth image corresponding to the projected object; performing morphological processing on the depth image according to a target morphological processing method corresponding to the target leakage edge type to obtain a processed target depth image; one leakage edge type corresponds to one morphological processing method; determining a target leakage edge area corresponding to the projection image according to the depth image and the target depth image; adjusting the projection image according to the target leakage edge area to obtain a target projection image, and projecting the target projection image onto the projected object.
[0006] In a second aspect, an embodiment of the present application provides a projection control device, which is characterized in that it is used in an electronic device, and the device includes:
[0007] A first determination module is used to determine the target leaking edge type corresponding to the projection image according to the projection result of the projection image projected on the projected object;
[0008] An acquisition module, used to acquire a depth image corresponding to the projected object;
[0009] A processing module, used for performing morphological processing on the depth image according to the target morphological processing method corresponding to the target leaky edge type, to obtain a processed target depth image; one leaky edge type corresponds to one morphological processing method;
[0010] A second determination module is used to determine the target missing edge area corresponding to the projection image according to the depth image and the target depth image;
[0011] The projection module is used to adjust the projection image according to the target edge leakage area to obtain the target projection image, and project the target projection image onto the projected object.
[0012] In a third aspect, an embodiment of the present application provides an electronic device, including:
[0013] one or more processors;
[0014] Memory;
[0015] One or more applications, wherein the one or more applications are stored in a memory and configured to be executed by one or more processors, and the one or more programs are configured to execute the method of the first aspect above.
[0016] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, in which a program code is stored, wherein when the program code is executed by a processor, the method of the first aspect described above is executed.
[0017] The embodiments of the present application provide a projection control method, device, electronic device and storage medium. In the present application, a depth image corresponding to a projected object is morphologically processed according to a target leakage edge type corresponding to a projection image to obtain a processed target depth image. Different leakage edge types correspond to different morphological processing methods. Then, according to the depth image and the target depth image, a target leakage edge area corresponding to the projection image is determined. The depth image is more convenient for distinguishing the projected object from the depth image, and the accuracy of obtaining the target leakage edge area is higher. When the target projection image determined according to the target leakage edge area is projected onto the projected object, the leakage edge problem is improved, thereby improving the visual effect of the projection. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.
[0019] Figure 1 A flow chart of a projection control method proposed in an embodiment of the present application is shown.
[0020] Figure 2 A schematic diagram of a projected object in an embodiment of the present application is shown.
[0021] Figure 3 A schematic diagram of a target leaky edge area in an embodiment of the present application is shown.
[0022] Figure 4A schematic diagram of another target leaky edge area in an embodiment of the present application is shown.
[0023] Figure 5 A schematic diagram showing the application process of a projection control method proposed in an embodiment of the present application is shown.
[0024] Figure 6 A flowchart of a projection control method proposed in yet another embodiment of the present application is shown.
[0025] Figure 7 A block diagram of a projection control device proposed in one embodiment of the present application is shown.
[0026] Figure 8 A block diagram of an electronic device proposed in yet another embodiment of the present application is shown.
[0027] Fig. 9 A structural block diagram of a computer-readable storage medium according to an embodiment of the present application is shown. DETAILED DESCRIPTION
[0028] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. According to the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0029] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.
[0030] Reference Figure 1 , Figure 1 A flowchart of a projection control method proposed in one embodiment of the present application is shown. The method is used in an electronic device and includes:
[0031] S101 , determining a target edge leakage type corresponding to the projection image according to a projection result of the projection image on the projection object.
[0032] The projected image can be a picture, a video frame of a projected animation, a specified projected image, or a rendered image obtained by 3D projection (3D Mapping). 3DMapping projection is a technology that converts objects or environments in the real world into three-dimensional digital models. The rendered image is obtained by rendering the three-dimensional digital model of the projected object according to the projection requirements, and obtaining the rendering result as the rendered image corresponding to the projected object. The projection result can be a projection screen obtained by projecting the projection image.
[0033] A projected image is an image projected onto an object. The object can be any object, such as a building. Figure 2 The background area of the projected object is the projection background, e.g. Figure 2 Background of three-dimensional sculpture.
[0034] After the projection image is projected onto the projected object, the human eye can determine whether the projection screen corresponding to the projection image and the projected object overlap. If the projection screen and the projected object do not completely overlap, there is a leakage edge phenomenon when the projection image is projected on the projected object. Then it is necessary to determine the leakage edge type of the leakage edge phenomenon. There are two types of leakage edge types: one is external leakage edge, in which the projection screen corresponding to the projection image exceeds the projected object, and part of the projection screen is projected on the projection background; the other is internal leakage edge, in which the projection screen corresponding to the projection image is retracted into the projected object, and there is a part of the projected object without the projection screen.
[0035] S102: Acquire a depth image corresponding to the projected object.
[0036] Among them, the depth image is also called the range image, which refers to an image that uses the distance (depth) from the image collector to each point in the scene as the pixel value. There is a distance between the projected object and the projection background. Generally, the projected object is located in front of the projection background. The projected object on the depth image is a highlighted area.
[0037] In some implementations, a depth image corresponding to the projected object may be acquired through binocular stereo vision, TOF camera ranging, structured light, lidar ranging, or the like.
[0038] In 3D Mapping technology, depth images are generally obtained through structured light methods. Structured light is projected onto the projected object, and the image sensor captures the corresponding pattern image with structured light. Then, the position and deformation degree of the structured light in the pattern image are obtained through the template image of the structured light. The depth information of each point in the scene can be calculated using the triangulation principle, thereby obtaining a depth image.
[0039] S103 . Perform morphological processing on the depth image according to the target morphological processing method corresponding to the target leaky edge type to obtain a processed target depth image.
[0040] Among them, one leaky edge type corresponds to one morphological processing method. Morphological processing is mainly used to extract image components that are meaningful for expressing and depicting the shape of the region from the image, so that the subsequent recognition work can grasp the most essential shape features of the target object, such as boundaries and connected areas. There are many types of morphological processing, such as corrosion, expansion, opening and closing operations.
[0041] In some embodiments, when the target leaky edge type is an external leaky edge, the target morphological processing method is dilation processing, and morphological processing is performed on the depth image to obtain a processed target depth image, which may include: dilating the depth image according to a first convolution kernel to obtain a processed target depth image.
[0042] The dilation process is to find the local maximum value within the range of the convolution kernel. When performing the dilation process, a convolution kernel needs to be given. The convolution kernel scans each pixel in the image one by one, and replaces the pixel value of the area covered by the convolution kernel with the local maximum value of the area covered by the convolution kernel. In other words, dilation is to expand the highlighted area. The area corresponding to the projected object in the target depth image obtained after the dilation process is larger than the area corresponding to the projected object in the depth image.
[0043] A convolution kernel is a kernel that, when processing an image, takes a weighted average of pixels in a small area of the input image to become each corresponding pixel in the output image, where the weights are defined by a function called a convolution kernel.
[0044] In some embodiments, when the target leaky edge type is an inner leaky edge, the target morphological processing method is corrosion processing, and the depth image is morphologically processed to obtain a processed target depth image, including: corroding the depth image according to a second convolution kernel to obtain a processed target depth image.
[0045] Erosion processing is to find the local minimum value within the range of the convolution kernel. When performing corrosion processing, a convolution kernel needs to be given. The convolution kernel scans each pixel in the image one by one, and replaces the pixel value of the area covered by the convolution kernel with the local minimum value of the area covered by the convolution kernel. In other words, corrosion is to reduce the highlight area. The area corresponding to the projected object in the target depth image obtained after corrosion processing is smaller than the area corresponding to the projected object in the depth image.
[0046] In some implementations, the sizes of the first convolution kernel and the second convolution kernel may be the same or different.
[0047] S104: Determine a target missing edge region corresponding to the projection image according to the depth image and the target depth image.
[0048] After obtaining the target depth image, the target depth image obtained by the dilation process is divided into the projected object and the projection background. Figure 2 As shown in the figure, the highlight area of the target depth image is larger than the highlight area of the depth image, and the difference between the highlight area of the target depth image and the highlight area of the depth image is the target leakage edge area, such as Figure 3 As shown, Figure 3 The middle highlighted area is the target edge leakage area.
[0049] For the target depth image obtained by corrosion processing, the projected object and the projection background are still Figure 2 As shown in the figure, the highlight area of the target depth image is smaller than the highlight area of the depth image, and the difference between the highlight area of the depth image and the highlight area of the target depth image is the target leakage edge area, such as Figure 4 As shown, Figure 4 The middle highlighted area is the target edge leakage area.
[0050] contrast Figure 2 Middle area 210, Figure 3 Middle area 310 and Figure 4 In the middle area 410 , it can be seen that the target leaking edge area of the outer leaking edge is located on the projection background, and the target leaking edge area of the inner leaking edge is located on the projected object.
[0051] S105 , adjusting the projection image according to the target edge missing area to obtain a target projection image, and projecting the target projection image onto the projection object.
[0052] In 3D mapping technology, the rendering content and rendering area of the area on the three-dimensional digital model corresponding to the target leaking edge area can be adjusted, such as blocking the rendering content of the corresponding area, displaying special rendering content (halo, outline, gradient color...), etc., to obtain a new rendering image as the target projection image, and project the target projection image onto the projected object.
[0053] In some embodiments, Figure 5As shown, after S105, it can include: if the intermediate projection result corresponding to the target projection image projected on the projected object does not meet the preset conditions, determine the leakage edge type corresponding to the target projection image as the intermediate leakage edge type; obtain the target projection image as a new projection image and obtain the intermediate leakage edge type as a new target leakage edge type; adjust the convolution kernel size used by the morphological processing method corresponding to the new target leakage edge type, and obtain the adjusted morphological processing method as the new target morphological processing method; return to execute the step of performing morphological processing on the depth image according to the target morphological processing method corresponding to the target leakage edge type to obtain a processed target depth image, until the intermediate projection result meets the preset conditions; obtain the target projection image obtained for the last time as the final projection image; and project the final projection image onto the projected object.
[0054] The preset condition may be that the intermediate projection result corresponding to the target projection image projected on the projected object is completely overlapped with the projected object when observed by human eyes. The intermediate leakage edge type may be the same as or different from the target leakage edge type, and the convolution kernel size may be increased or decreased.
[0055] Return to executing the target morphological processing method corresponding to the target leakage edge type, perform morphological processing on the depth image, and obtain the step of the processed target depth image (that is, return to execute step S103), then determine the target leakage edge area corresponding to the new projection image according to the depth image and the new target depth image, adjust the new projection image according to the new target leakage edge area, obtain a new target projection image, and project the new target projection image onto the projected object to obtain a new intermediate projection result. If the new intermediate projection result meets the preset conditions, the new target projection result is the target projection image obtained last time, then obtain the new target projection image as the final projection image; project the final shadow image onto the projected object; if the new intermediate projection result does not meet the preset conditions, return to execute step S103 again until the intermediate projection result meets the preset conditions; obtain the target projection image obtained last time as the final projection image; and project the final shadow image onto the projected object.
[0056] In this embodiment, the depth image corresponding to the projected object is morphologically processed according to the target leakage edge type corresponding to the projection image to obtain a processed target depth image. Different leakage edge types correspond to different morphological processing methods. Then, according to the depth image and the target depth image, the target leakage edge area corresponding to the projection image is determined. The depth image is more convenient to distinguish the projected object from the depth image, and the accuracy of obtaining the target leakage edge area is higher. When the target projection image determined according to the target leakage edge area is projected onto the projected object, the leakage edge problem is improved, thereby improving the visual effect of the projection.
[0057] Reference Figure 6 , Figure 6 A flowchart of a projection control method proposed in another embodiment of the present application is shown. The method is used in an electronic device and includes:
[0058] S201 : Determine a target edge leakage type corresponding to the projection image according to a projection result of the projection image on the projection object.
[0059] S202, obtaining a depth image corresponding to the projected object; performing morphological processing on the depth image according to a target morphological processing method corresponding to the target leaking edge type, to obtain a processed target depth image.
[0060] The description of S201-S202 refers to the description of S101-S103 above and will not be repeated here.
[0061] S203, calculating the depth difference between the depth image and the target depth image; obtaining an area where the depth difference is greater than a depth difference threshold as the target missing edge area.
[0062] If the target depth image is a depth image obtained by dilation processing, the depth image is subtracted from the target depth image to obtain a depth difference. If the target depth image is a depth image obtained by erosion processing, the depth image is subtracted from the target depth image to obtain a depth difference.
[0063] Among them, the depth difference threshold can be adjusted according to needs.
[0064] S204: adjusting the projection image according to the target edge missing area to obtain a target projection image, and projecting the target projection image onto the projection object.
[0065] The description of S204 refers to the description of S105 above and will not be repeated here.
[0066] S205: If the intermediate projection result corresponding to the target projection image projected on the projected object does not meet the preset condition, determine the leakage edge type corresponding to the target projection image as the intermediate leakage edge type.
[0067] Among them, the preset condition can be that the intermediate projection result corresponding to the target projection image projected on the projected object observed by human eyes completely coincides with the projected object, the intermediate leakage edge type and the target leakage edge type can be the same or different, and the intermediate leakage edge type is an outer leakage edge or an inner leakage edge.
[0068] If the intermediate projection result corresponding to the target projection image projected on the projection object meets the preset condition, step S205 and subsequent steps do not need to be performed.
[0069] S206: Adjust the depth difference threshold to obtain the adjusted depth difference threshold as a new depth difference threshold.
[0070] The depth difference threshold affects the size of the target edge leakage region. The smaller the depth difference threshold, the larger the area is determined as the target edge leakage region, and the larger the depth difference threshold, the smaller the area is determined as the edge leakage region.
[0071] The adjustment of the depth difference threshold is related to the intermediate leakage edge type and the target leakage edge type. For example, if the target leakage edge type and the intermediate leakage edge type are both inner leakage edges, it means that the depth difference threshold is too large, resulting in the determined target leakage edge area being too small. The target projection image determined based on the target leakage edge area is not sufficient to eliminate the inner leakage edge.
[0072] S207 , obtaining a target projection image as a new projection image and obtaining an intermediate leakage edge type as a new target leakage edge type.
[0073] In some embodiments, when the new target leaky edge type is an external leaky edge, the target morphological processing method is dilation processing, and morphological processing is performed on the depth image to obtain a processed target depth image, which may include: dilating the depth image according to a first convolution kernel to obtain a processed target depth image.
[0074] In some embodiments, if the new target leaky edge type is an inner leaky edge, the target morphological processing method is corrosion processing, and the depth image is morphologically processed to obtain a processed target depth image, including: corroding the depth image according to the second convolution kernel to obtain a processed target depth image.
[0075] In some implementations, the sizes of the first convolution kernel and the second convolution kernel may be the same or different.
[0076] S281. Return to the step of performing morphological processing on the depth image according to the target morphological processing method corresponding to the target leaking edge type to obtain a processed target depth image until the intermediate projection result meets the preset conditions; obtain the target projection image obtained for the last time as the final projection image; and project the final projection image onto the projected object.
[0077] Return to executing the target morphological processing method corresponding to the target leaking edge type, perform morphological processing on the depth image, and obtain the step of obtaining the processed target depth image (that is, return to executing step S202), then calculate the depth difference between the depth image and the new target depth image, and obtain the area where the depth difference is greater than the new depth difference threshold as the target leaking edge area, and adjust the new projection image according to the new target leaking edge area to obtain a new target projection image, and project the new target projection image onto the projected object to obtain a new intermediate projection result. If the new intermediate projection result meets the preset conditions, the new target projection result is the target projection image obtained last time, and the new target projection image is obtained as the final projection image; the final shadow image is projected onto the projected object; if the new intermediate projection result does not meet the preset conditions, return to executing step S202 again until the intermediate projection result meets the preset conditions; obtain the target projection image obtained last time as the final projection image; and project the final shadow image onto the projected object.
[0078] S282. Adjust the convolution kernel size used by the morphological processing method corresponding to the new target leaky edge type, and obtain the adjusted morphological processing method as the new target morphological processing method.
[0079] Among them, the size of the convolution kernel affects the result of morphological processing. A larger convolution kernel can capture information in a larger range and is used to detect the boundaries of larger areas, while a smaller convolution kernel is suitable for capturing more subtle area boundaries.
[0080] By adjusting the depth difference threshold and the size of the convolution kernel at the same time, the target light leakage area can be determined more accurately.
[0081] S292, return to execute the target morphological processing method corresponding to the target leaking edge type, perform morphological processing on the depth image, and obtain the processed target depth image step until the intermediate projection result meets the preset conditions; obtain the target projection image obtained for the last time as the final projection image; and project the final projection image onto the projected object.
[0082] Return to executing the target morphological processing method corresponding to the target leaking edge type, perform morphological processing on the depth image, and obtain the step of obtaining the processed target depth image (that is, return to executing step S202), then calculate the depth difference between the depth image and the new target depth image, and obtain the area where the depth difference calculated this time is greater than the new depth difference threshold as the new target leaking edge area, adjust the new projection image according to the new target leaking edge area to obtain a new target projection image, and project the new target projection image onto the projected object to obtain a new intermediate projection result. If the new intermediate projection result meets the preset conditions, the new target projection result is the target projection image obtained last time, and the new target projection image is obtained as the final projection image; the final shadow image is projected onto the projected object; if the new intermediate projection result does not meet the preset conditions, return to executing step S202 again until the intermediate projection result meets the preset conditions; obtain the target projection image obtained last time as the final projection image; and project the final shadow image onto the projected object.
[0083] In this embodiment, by calculating the depth difference between the depth image and the target depth image, the area where the depth difference is greater than the depth difference threshold is obtained as the target leaking edge area, so that a more accurate target leaking edge area can be obtained, and the target projection image is obtained according to the target leaking edge area. If the intermediate projection result corresponding to the target projection image does not meet the preset conditions, the depth difference threshold and / or the convolution kernel size used by the morphological processing method is adjusted, and then a new target projection image is obtained according to the adjusted depth difference threshold and / or the convolution kernel size used by the morphological processing method. This process is repeated until the intermediate projection result corresponding to the target projection image meets the preset conditions, that is, the leaking edge problem is solved, thereby obtaining the final projection image and projecting it onto the projected object, thereby improving the visual effect of the projection.
[0084] Reference Figure 7 , Figure 7 A block diagram of a projection control device proposed in one embodiment of the present application is shown, which is used in electronic equipment. The device 600 includes:
[0085] A first determination module 601 is used to determine the target leaking edge type corresponding to the projection image according to the projection result of the projection image on the projection object;
[0086] An acquisition module 602 is used to acquire a depth image corresponding to the projected object;
[0087] The processing module 603 is used to perform morphological processing on the depth image according to the target morphological processing method corresponding to the target leaky edge type to obtain a processed target depth image; one leaky edge type corresponds to one morphological processing method;
[0088] A second determination module 604 is used to determine the target missing edge area corresponding to the projection image according to the depth image and the target depth image;
[0089] The projection module 605 is used to adjust the projection image according to the target edge leakage area to obtain a target projection image, and project the target projection image onto the projection object.
[0090] Optionally, when the target leaky edge type is an external leaky edge, the target morphological processing method is dilation processing, and the processing module 603 is further configured to perform dilation processing on the depth image according to the first convolution kernel to obtain a processed target depth image.
[0091] Optionally, when the target leaky edge type is an inner leaky edge, the target morphological processing method is erosion processing, and the processing module 603 is further configured to perform erosion processing on the depth image according to the second convolution kernel to obtain a processed target depth image.
[0092] Optionally, the projection module 605 is also used to determine the leakage edge type corresponding to the target projection image as the intermediate leakage edge type if the intermediate projection result corresponding to the target projection image projected on the projected object does not meet the preset conditions; obtain the target projection image as a new projection image and obtain the intermediate leakage edge type as a new target leakage edge type; adjust the convolution kernel size used by the morphological processing method corresponding to the new target leakage edge type, and obtain the adjusted morphological processing method as the new target morphological processing method; return to execute the step of performing morphological processing on the depth image according to the target morphological processing method corresponding to the target leakage edge type to obtain a processed target depth image, until the intermediate projection result meets the preset conditions; obtain the target projection image obtained for the last time as the final projection image; and project the final projection image onto the projected object.
[0093] Optionally, the second determination module 604 is further configured to calculate a depth difference between the depth image and the target depth image; and obtain a region where the depth difference is greater than a depth difference threshold as a target missing edge region.
[0094] Optionally, the projection module 605 is also used to determine the leakage edge type corresponding to the target projection image as the intermediate leakage edge type if the intermediate projection result corresponding to the target projection image projected on the projected object does not meet the preset conditions; adjust the depth difference threshold to obtain the adjusted depth difference threshold as the new depth difference threshold; obtain the target projection image as the new projection image and obtain the intermediate leakage edge type as the new target leakage edge type; return to execute the target morphological processing method corresponding to the target leakage edge type, perform morphological processing on the depth image, and obtain the processed target depth image, until the intermediate projection result meets the preset conditions; obtain the target projection image obtained for the last time as the final projection image; and project the final projection image onto the projected object.
[0095] Optionally, the projection module 605 is also used to determine the leakage edge type corresponding to the target projection image as the intermediate leakage edge type if the intermediate projection result corresponding to the target projection image projected on the projected object does not meet the preset conditions; adjust the depth difference threshold to obtain the adjusted depth difference threshold as the new depth difference threshold; obtain the target projection image as the new projection image and obtain the intermediate leakage edge type as the new target leakage edge type; adjust the convolution kernel size used by the morphological processing method corresponding to the new target leakage edge type to obtain the adjusted morphological processing method as the new target morphological processing method; return to execute the step of performing morphological processing on the depth image according to the target morphological processing method corresponding to the target leakage edge type to obtain a processed target depth image, until the intermediate projection result meets the preset conditions; obtain the target projection image obtained for the last time as the final projection image; and project the final projection image onto the projected object.
[0096] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and modules can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here.
[0097] In several embodiments provided in the present application, the coupling or direct coupling or communication connection between the modules shown or discussed may be an indirect coupling or communication connection through some interfaces, devices or modules, which may be electrical, mechanical or other forms.
[0098] In addition, each functional module in each embodiment of the present application can be integrated into a processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The above integrated modules can be implemented in the form of hardware or software functional modules.
[0099] Reference Figure 8 , Figure 8A block diagram of an electronic device proposed in another embodiment of the present application is shown. The electronic device 700 may include one or more of the following components: a processor 710, a memory 720, and one or more application programs, wherein the one or more application programs may be stored in the memory 720 and configured to be executed by the one or more processors 710, and the one or more programs are configured to execute the method described in the aforementioned method embodiment.
[0100] The processor 710 may include one or more processing cores. The processor 710 uses various interfaces and lines to connect various parts of the entire electronic device 700, and executes various functions and processes data of the electronic device 700 by running or executing instructions, programs, code sets or instruction sets stored in the memory 720, and calling data stored in the memory 720. Optionally, the processor 710 can be implemented in at least one hardware form of digital signal processing (DSP), field-programmable gate array (FPGA), and programmable logic array (PLA). The processor 110 can integrate one or a combination of a central processing unit (CPU), a graphics processing unit (GPU), and a modem. Among them, the CPU mainly processes the operating system, user interface, and application programs; the GPU is responsible for rendering and drawing display content; and the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 710, but may be implemented separately through a communication chip.
[0101] The memory 720 may include a random access memory (RAM) or a read-only memory (ROM). The memory 720 may be used to store instructions, programs, codes, code sets or instruction sets. The memory 720 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the following various method embodiments, etc. The data storage area may also store data (such as a phone book, audio and video data, chat record data) created by the terminal 700 during use.
[0102] Please refer to Fig. 9 , Fig. 9The structure block diagram of a computer-readable storage medium in an embodiment of the present application is shown. The computer-readable medium 800 stores program codes, which can be called by a processor to execute the method described in the above method embodiment.
[0103] The computer readable storage medium 800 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read-only memory), an EPROM, a hard disk, or a ROM. Optionally, the computer readable storage medium 800 includes a non-transitory computer-readable storage medium. The computer readable storage medium 800 has storage space for program code 810 that performs any method step of the above method. These program codes can be read from or written to one or more computer program products. The program code 810 can be compressed, for example, in an appropriate form.
[0104] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.
Claims
1. A projection control method, characterized in that: The method comprises: Determine the target leaking edge type corresponding to the projection image according to the projection result of the projection image on the projected object; Acquire a depth image corresponding to the projected object; According to the target morphological processing method corresponding to the target leaky edge type, the depth image is morphologically processed to obtain a processed target depth image; one leaky edge type corresponds to one morphological processing method; Determine a target missing edge region corresponding to the projection image according to the depth image and the target depth image; The projection image is adjusted according to the target edge missing area to obtain a target projection image, and the target projection image is projected onto the projection object.
2. The method according to claim 1, characterized in that In the case where the target leaky edge type is an external leaky edge, the target morphological processing method is dilation processing, and the morphological processing of the depth image to obtain a processed target depth image includes: The depth image is expanded according to the first convolution kernel to obtain a processed target depth image.
3. The method according to claim 1, characterized in that In the case where the target leaky edge type is an inner leaky edge, the target morphological processing method is corrosion processing, and the morphological processing of the depth image to obtain a processed target depth image includes: The depth image is corroded according to the second convolution kernel to obtain a processed target depth image.
4. The method according to claim 1, characterized in that: After projecting the target projection image onto the projection object, the method further includes: If the intermediate projection result corresponding to the target projection image projected on the projected object does not meet the preset condition, determining the leakage edge type corresponding to the target projection image as the intermediate leakage edge type; Acquire the target projection image as a new projection image and acquire the intermediate leakage edge type as a new target leakage edge type; Adjusting the convolution kernel size used by the morphological processing method corresponding to the new target leaky edge type to obtain the adjusted morphological processing method as the new target morphological processing method; Returning to the step of executing the target morphological processing method corresponding to the target leaky edge type, performing morphological processing on the depth image to obtain a processed target depth image, until the intermediate projection result meets the preset condition; obtaining the last obtained target projection image as the final projection image; The final shadow image is projected onto the projected object.
5. The method according to claim 1, characterized in that: The determining, according to the depth image and the target depth image, a target leakage edge area corresponding to the projection object comprises: Calculating a depth difference between the depth image and the target depth image; The area where the depth difference is greater than the depth difference threshold is obtained as the target leaking edge area.
6. The method according to claim 5, characterized in that After projecting the target projection image onto the projection object, the method further comprises: If the intermediate projection result corresponding to the target projection image projected on the projected object does not meet the preset condition, determining the leakage edge type corresponding to the target projection image as the intermediate leakage edge type; Adjusting the depth difference threshold to obtain the adjusted depth difference threshold as a new depth difference threshold; Acquire the target projection image as a new projection image and acquire the intermediate leakage edge type as a new target leakage edge type; Returning to the step of executing the target morphological processing method corresponding to the target leaky edge type, performing morphological processing on the depth image to obtain a processed target depth image, until the intermediate projection result meets the preset condition; obtaining the last obtained target projection image as the final projection image; The final shadow image is projected onto the projected object.
7. The method according to claim 5, characterized in that After projecting the target projection image onto the projection object, the method further comprises: If the intermediate projection result corresponding to the target projection image projected on the projected object does not meet the preset condition, determining the leakage edge type corresponding to the target projection image as the intermediate leakage edge type; Adjusting the depth difference threshold to obtain the adjusted depth difference threshold as a new depth difference threshold; Acquire the target projection image as a new projection image and acquire the intermediate leakage edge type as a new target leakage edge type; Adjusting the convolution kernel size used by the morphological processing method corresponding to the new target leaky edge type to obtain the adjusted morphological processing method as the new target morphological processing method; Returning to the step of executing the target morphological processing method corresponding to the target leaky edge type, performing morphological processing on the depth image to obtain a processed target depth image, until the intermediate projection result meets the preset condition; obtaining the last obtained target projection image as the final projection image; The final shadow image is projected onto the projected object.
8. A projection control device, characterized in that: The device comprises: A first determination module, configured to determine a target leaking edge type corresponding to the projection image according to a projection result of the projection image on the projection object; An acquisition module, used to acquire a depth image corresponding to the projected object; A processing module, configured to perform morphological processing on the depth image according to a target morphological processing method corresponding to the target leaky edge type, to obtain a processed target depth image; one leaky edge type corresponds to one morphological processing method; A second determination module, configured to determine a target missing edge region corresponding to the projection image according to the depth image and the target depth image; The projection module is used to adjust the projection image according to the target edge leakage area to obtain a target projection image, and project the target projection image onto the projection object.
9. An electronic device, characterized in that: include: one or more processors; Memory; One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, and the one or more applications are configured to execute the method according to any one of claims 1-7.
10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a program code executable by a processor, and when the program code is executed by the processor, the processor executes the method according to any one of claims 1 to 7.