Projection prompting method and device, electronic equipment and storage medium

Abstract

The invention discloses a projection prompting method and device, electronic equipment and a storage medium, and relates to the technical field of projection. The method comprises the following steps: projecting a white field image to a target object through a plurality of first projectors, carrying out image shooting through a camera to obtain a first image, projecting a black field image to the target object through a plurality of first projectors, and carrying out image shooting through the camera to obtain a second image; determining a projection display area based on a difference image between the first image and the second image; determining a plurality of shadow areas of the target object in the projection display area according to the gray value of each pixel point in the projection display area in the first image and at least one gray threshold; and according to a preset filling strategy, performing color filling on the multiple shadow areas in the first image to obtain and display a third image. Thus, a user is assisted in adjusting the target object and / or the first projector, the shadow of the projected object is rapidly reduced or eliminated, and a better projection display effect is presented.

Description

Technical Field

[0001] The present application relates to the field of projection technology, and in particular to a projection prompting method, device, electronic device and storage medium. Background Art

[0002] In a multi-projector system, in order to solve the problem of uneven brightness in overlapping areas (commonly known as the "shadow effect"), a brightness compensation solution is usually used to achieve a smooth transition between projection images and eliminate projection shadows, thereby avoiding visual discomfort for the audience and enhancing the continuity and consistency of the overall image.

[0003] However, in the related art, users or technicians often use their naked eyes to judge and adjust objects to the appropriate position, which is cumbersome and time-consuming, affecting the user experience. Summary of the invention

[0004] The present application proposes a projection prompt method, device, electronic device and storage medium to help users quickly eliminate the shadow of a projected object and present a better projection effect.

[0005] In a first aspect, an embodiment of the present application provides a projection prompt method, which is applied to a projection system, wherein the projection system includes a camera and a plurality of first projectors, wherein the shooting range of the camera covers the total projection range of the plurality of first projectors, and the method includes: projecting a white field image onto a target object through the plurality of first projectors, and capturing the image through the camera to obtain a first image, and projecting a black field image onto a target object through the plurality of first projectors, and capturing the image through the camera to obtain a second image; acquiring a difference image between the first image and the second image, and determining a projection display area formed by projections of the plurality of first projectors in the first image based on the difference image; determining a target shadow area of ​​the target object in the projection display area according to a grayscale value of each pixel point of the projection display area in the first image and at least one grayscale threshold, wherein the target shadow area is a place that all the first projectors cannot project to; marking the target shadow area in the first image according to a preset marking strategy to obtain a third image; and displaying the third image to prompt a user to adjust the position of the target object and / or the projector position of at least one first projector to reduce or eliminate the target shadow area.

[0006] In a second aspect, an embodiment of the present application provides a projection prompt device, which is applied to a projection system, wherein the projection system includes a camera and a plurality of first projectors, the shooting range of the camera covers the total projection range of the plurality of first projectors, and the device includes: an image acquisition module, which is used to project a white field image to a target object through the plurality of first projectors, and to capture the image through the camera to obtain a first image, and to project a black field image to a target object through the plurality of first projectors, and to capture the image through the camera to obtain a second image; a display area determination module, which is used to acquire a difference image between the first image and the second image, and to determine, based on the difference image, a display area in the first image a projection display area formed by projections of the multiple first projectors in the first image; a shadow area determination module, used to determine a target shadow area of ​​the target object in the projection display area according to the grayscale value of each pixel point of the projection display area in the first image and at least one grayscale threshold, wherein the target shadow area is a place that all the first projectors cannot project to; a marking module, used to mark the target shadow area in the first image according to a preset marking strategy to obtain a third image; a display module, used to display the third image to prompt a user to adjust the position of the target object and / or the projector position of at least one first projector to reduce or eliminate the target shadow area.

[0007] In a third aspect, an embodiment of the present application provides an electronic device, comprising: one or more processors; a memory; and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are configured to execute the above-mentioned method.

[0008] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, in which a program code is stored. The program code can be called by a processor to execute the above method.

[0009] In the solution provided by the present application, a white field image is projected onto a target object by a plurality of first projectors, and an image is captured by a camera to obtain a first image, and a black field image is projected onto a target object by a plurality of first projectors, and an image is captured by a camera to obtain a second image; a difference image between the first image and the second image is obtained, and based on the difference image, a projection display area formed by projections of a plurality of first projectors in the first image is determined; a target shadow area of ​​the target object in the projection display area is determined according to the gray value of each pixel point in the projection display area in the first image and at least one gray threshold, and the target shadow area is a place where all the first projectors cannot project; the target shadow area in the first image is marked according to a preset marking strategy to obtain a third image; the third image is displayed to prompt the user to adjust the position of the target object and / or the projector position of at least one first projector to reduce or eliminate the target shadow area. In this way, the user can quickly learn about the shadow area that each first projector cannot project by viewing the displayed third image, so that the user can be assisted to quickly reduce or eliminate the shadow area of ​​the projected object by adjusting the target object and / or the first projector to present a better projection display effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0011] Figure 1 A schematic flow chart of a projection prompting method provided in an embodiment of the present application is shown.

[0012] Figure 2 A system architecture diagram of a projection system provided in an embodiment of the present application is shown.

[0013] Figure 3 Shows Figure 1 A schematic flow chart of the sub-steps of step S120 in one implementation manner.

[0014] Figure 4 A schematic flow chart of a projection prompting method provided in another embodiment of the present application is shown.

[0015] Figure 5 A schematic diagram of a third image provided in an embodiment of the present application is shown.

[0016] Figure 6 A schematic diagram of a first image provided by an embodiment of the present application is shown.

[0017] Figure 7 It is a block diagram of a projection prompting device provided according to an embodiment of the present application.

[0018] Figure 8 It is a block diagram of an electronic device for executing the projection prompt method according to an embodiment of the present application.

[0019] Fig. 9 It is a storage unit of an embodiment of the present application for storing or carrying a program code for implementing the projection prompt method according to an embodiment of the present application. DETAILED DESCRIPTION

[0020] In order to enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0021] It should be noted that in some processes described in the specification, claims and the above-mentioned drawings of the present application, multiple operations that appear in a specific order are included, and these operations may not be executed or executed in parallel in the order in which they appear in this article. The sequence numbers of operations such as S110, S120, etc. are only used to distinguish different operations, and the sequence numbers themselves do not represent any execution order. In addition, these processes may include more or less operations, and these operations may be executed in sequence or in parallel. And, the terms "first", "second", etc. in the specification, claims and the above-mentioned drawings of the present application are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequential order. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described here can be implemented in an order other than those illustrated or described here. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or server that includes a series of steps or sub-modules is not necessarily limited to those steps or sub-modules explicitly listed, but may include other steps or sub-modules that are not explicitly listed or that are inherent to these processes, methods, products, or devices.

[0022] The inventor proposes a projection prompting method, device, electronic device and storage medium. The projection prompting method provided by the embodiment of the present application is described in detail below.

[0023] Please refer to Figure 1 , Figure 1A flowchart of a projection prompt method provided in an embodiment of the present application is applied to a projection system, wherein the projection system includes a camera and a plurality of first projectors, and the shooting range of the camera covers the total projection range of the plurality of first projectors. Figure 1 The projection prompt method provided in the embodiment of the present application is described in detail. The projection prompt method may include the following steps:

[0024] Step S110: projecting a white field image onto the target object through the multiple first projectors and capturing the image through the camera to obtain a first image, and projecting a black field image onto the target object through the multiple first projectors and capturing the image through the camera to obtain a second image.

[0025] In this embodiment, if Figure 2 As shown, the projection system 10 may include a plurality of first projectors (i.e., projectors 111, 112, and 113) and a camera 12, wherein the shooting range of the camera 121 covers the total projection range of the plurality of first projectors, and the camera 121 may be a black and white camera or a color camera, which is not limited in this embodiment. Of course, the projection system 10 may also include a plurality of first projectors (i.e., projectors 111, 112, and 113) and a camera 121. Figure 2 The present embodiment does not limit the number of projectors other than the three projectors shown in FIG. Figure 2 The bear model shown in the figure may also be other objects in a real scene, and this embodiment does not limit this. Before using multiple first projectors to perform three-dimensional projection rendering on the target object, in order to avoid the shadow of the target object affecting the final projection rendering effect due to the projection, the position of the shadow generated by the target object can be determined in advance by projecting a white field image and a black field image, so as to prompt the user to adjust the camera and / or the first projector to eliminate the shadow.

[0026] Specifically, first, multiple first projectors are controlled to project a white field image onto the target object, and then the camera is controlled to capture the area behind the target object to obtain a first image; wherein the white field image can be understood as a pure white image. Further, multiple first projectors are controlled to project a black field image onto the target object, and then the camera is controlled to capture the area behind the target object to obtain a second image; wherein the black field image can be understood as a pure black image.

[0027] Step S120: acquiring a difference image between the first image and the second image, and determining, based on the difference image, a projection display area formed by projections of the plurality of first projectors in the first image.

[0028] Optionally, if the camera is a color camera, the first image is first converted into a grayscale image to obtain a first grayscale image, and the second image is converted into a grayscale image to obtain a second grayscale image; then a difference image between the first grayscale image and the second grayscale image is obtained. The difference image can be used to reflect the pixel point area with significant differences between the first image and the second image.

[0029] Optionally, if the camera is a black and white camera, the first image and the second image captured are both grayscale images, so the difference image between the first image and the second image can be directly obtained. It should be noted that the execution subject of the present application is an electronic device with data processing capability in the projection system 10 (not in Figure 2 As shown in the figure), the electronic device establishes a communication connection with the camera and each first projector, and can transmit data and control signals.

[0030] Further, in some embodiments, see Figure 3 How to determine the projection display area in step S120 may include the contents of steps S121 to S123:

[0031] Step S121: binarizing the difference image to obtain a binarized image corresponding to the difference image.

[0032] Among them, the binarization process can be understood as setting a gray value threshold, mapping the gray values ​​of pixels greater than or equal to the gray value threshold to 255, that is, processing the pixels greater than or equal to the gray value threshold as white; and mapping the gray values ​​of pixels less than the gray value threshold to 0, that is, processing the pixels less than the gray value threshold as black. In other words, through the binarization process, the difference image of the gray image is converted into a black and white image, that is, the binarized image corresponding to the obtained difference image is a gray-white image. The binarized image can also be understood as a mask image that excludes ambient light.

[0033] Step S122: Obtaining the region position of the white region in the binary image.

[0034] Step S123: determining an image area corresponding to the area position of the white area from the first image as a projection display area formed by projection by the multiple first projectors.

[0035] In the binary image, the pixel area mapped as the white area is the pixel area with significant difference between the first image and the second image. Therefore, the area position of the white area composed of white pixels can be obtained according to the pixel position of all white pixels in the binary image; this white area can be understood as the projection display area formed by the projection of multiple first projectors captured by the camera. Therefore, the image area corresponding to the area position of the white area can be determined from the first image as the projection display area formed by the projection of multiple first projectors.

[0036] Step S130: determining a target shadow area of ​​the target object in the projection display area according to the grayscale value of each pixel point in the projection display area in the first image and at least one grayscale threshold, wherein the target shadow area is a place that all first projectors cannot project.

[0037] It is understandable that different projectors are placed in different positions. Therefore, when different projectors project white field images onto the target object, the positions of the corresponding shadows generated behind the target object are also different. Obviously, the grayscale value of the shadow area formed by a single shadow is obviously different from the shadow area formed by the overlap of multiple shadows. For example, the shadow area formed by the overlap of two shadows has a darker grayscale than the shadow area formed by a single shadow, that is, the grayscale value of the shadow area formed by the overlap of two shadows is greater than the shadow area formed by a single shadow; similarly, the grayscale value of the shadow area formed by the overlap of three shadows is greater than the shadow area formed by the overlap of two shadows, and so on. This embodiment will not be repeated here. Among them, the number of shadows is generally the same as the number of first projectors, that is, when each first projector projects a white field image onto the target object, a corresponding shadow will be generated behind the target object.

[0038] The target shadow area is actually a place that all the first projectors cannot project to, which can also be called a hard shadow area; that is, no matter how the parameters of the multiple first projectors are adjusted, the target shadow area cannot be eliminated. Based on this, at least one grayscale threshold can be pre-set, so that the target shadow area is divided from the projection display area based on the grayscale value of each pixel point in the projection display area and at least one grayscale threshold.

[0039] Step S140: Mark the target shadow area in the first image according to a preset marking strategy to obtain a third image.

[0040] Optionally, the preset marking strategy may be a color filling strategy, i.e., filling a preset color in the target shadow area in the first image to obtain a third image; wherein the preset color is a pre-set color, for example, red, which is not limited in the present application. Optionally, the preset marking strategy may also be a character marking strategy, i.e., marking at least one preset character in the target shadow area in the first image. Optionally, the preset marking strategy may also be a line filling strategy, i.e., filling a plurality of parallel lines in the target shadow area in the first image. In other words, any strategy that can highlight the target shadow area in the first image can be used as the preset marking strategy of the present application, and will not be described one by one with examples.

[0041] Step S150: displaying the third image to prompt the user to adjust the position of the target object and / or the projector position of at least one first projector to reduce or eliminate the target shadow area.

[0042] Furthermore, the third image is displayed so that the user can quickly know the position of the target shadow area behind the target object by viewing the third image. Furthermore, the position of the target object and / or the projector position of at least one of the multiple projectors can be adjusted according to the position of the target shadow area in the third image to reduce or eliminate the target shadow area.

[0043] In this embodiment, by shooting the projection area with a camera, the shadow area that cannot be projected by all the first projectors is determined according to the brightness of the shadow area, thereby determining the target shadow area, and marking the target shadow area in the first image to obtain the third image. In this way, the user can quickly know the shadow area that cannot be projected by each first projector by viewing the displayed third image, thereby assisting the user to quickly reduce or eliminate the shadow area of ​​the projected object by adjusting the target object and / or the first projector to present a better projection display effect.

[0044] Please refer to Figure 4 , Figure 4 A flowchart of a projection prompt method provided in another embodiment of the present application is applied to a projection system, wherein the projection system includes a camera and a plurality of first projectors, and the shooting range of the camera covers the total projection range of the plurality of first projectors. Figure 4 The projection prompt method provided in the embodiment of the present application is described in detail. The projection prompt method may include the following steps:

[0045] Step S201: projecting a white field image onto a target object through the multiple first projectors and capturing the image through the camera to obtain a first image, and projecting a black field image onto a target object through the multiple first projectors and capturing the image through the camera to obtain a second image.

[0046] Step S202: Acquire a difference image between the first image and the second image, and determine a projection display area formed by projections of the plurality of first projectors in the first image based on the difference image.

[0047] In this embodiment, the specific implementation of step S210 to step S220 can refer to the content of the above-mentioned embodiment, which will not be repeated here.

[0048] Step S203: determining the number of the grayscale thresholds according to the number of projectors of the plurality of first projectors.

[0049] It can be understood that the number of types of shadow areas is the same as the number of projectors. For example, if the number of projectors is 3, only 3 types of shadow areas are included, such as the shadow area formed by the shadow produced by a single projector, the shadow area formed by the superposition of 2 shadows produced by 2 projectors, and the shadow area formed by the superposition of 3 shadows produced by 3 projectors. Obviously, the brightness of the 3 shadow areas is different, that is, different types of shadow areas can be divided by 1 grayscale threshold, that is, the 3 shadow areas can be divided by setting 2 grayscale thresholds. Therefore, the difference between the number of projectors and 1 can be obtained as the threshold number of the grayscale threshold; that is, the number of projectors of the multiple first projectors is N, and the threshold number of the corresponding determined grayscale threshold is N-1.

[0050] Step S204: Determine the value of each grayscale threshold according to the number of thresholds and the average grayscale value of the first image.

[0051] Furthermore, the value of the grayscale threshold can be determined based on the overall brightness of the first image; that is, the overall brightness of the first image obtained by shooting is different when the ambient light of the target object is different, and thus the brightness of each shadow area generated will also be different.

[0052] Specifically, the average grayscale value of the first image can be obtained according to the grayscale value of each pixel in the first image. It can be understood that in the first image, other areas except the shadow area are areas illuminated by the white field images projected by multiple first projectors. Therefore, the grayscale values ​​of other areas are relatively large, and may even be close to the grayscale value 255 corresponding to white; while the brightness of the shadow area is relatively low, and its corresponding grayscale value is much smaller than the grayscale value of other areas, and may even be close to the grayscale value 0 corresponding to black. Since the area of ​​the shadow area is often much smaller than that of other areas, the average grayscale value of the first image obtained above will also be relatively small.

[0053] Furthermore, a preset proportionality coefficient can be determined based on the number of grayscale thresholds, and based on the preset proportionality coefficient, a division is performed between 0 and the average grayscale value to determine the value of the grayscale threshold. For example, if the number of shadow areas is 3, the corresponding number of grayscale thresholds is 2, and the preset proportionality coefficients 1 / 3 and 2 / 3 can be determined accordingly, and the average grayscale value is 168, then the two grayscale thresholds of 168×1 / 3=56 and 168×2 / 3=112 can be determined.

[0054] Step S205: If there are multiple grayscale thresholds, determine the minimum grayscale threshold from the multiple grayscale thresholds as the minimum grayscale threshold.

[0055] Step S206: If there are multiple pixels in the projection display area whose grayscale values ​​are all smaller than the minimum grayscale threshold, then determine the area formed by the multiple pixels as the target shadow area.

[0056] In this embodiment, if there are multiple pixels in the projection display area in the first image whose grayscale values ​​are all less than the minimum grayscale threshold, the region formed by the multiple pixels is characterized as the target shadow region in the projection display area, that is, the darkest part of the projection display area. The target shadow region is the region that cannot be projected by any of the multiple first projectors.

[0057] Optionally, if the number of grayscale thresholds is 1, and there are multiple pixels in the projection display area whose grayscale values ​​are all smaller than the 1 grayscale threshold, then the area formed by the multiple pixels can be determined as a hard shadow area.

[0058] Step S207: determining at least one non-hard shadow region according to other grayscale thresholds among the multiple grayscale thresholds except the minimum grayscale threshold.

[0059] Exemplarily, taking the case where multiple grayscale thresholds include a first grayscale threshold and a second grayscale threshold, the first grayscale threshold is the minimum grayscale threshold, and the second grayscale threshold is another grayscale threshold; based on this, if there are multiple first pixel points in the projection display area of ​​the first image whose grayscale values ​​are greater than or equal to the first grayscale threshold and less than the second grayscale threshold, then the area composed of multiple first pixel points is determined to be a non-hard shadow area A; if there are multiple second pixel points in the projection display area of ​​the first image whose grayscale values ​​are greater than or equal to the second grayscale threshold and less than the average grayscale value, then the area composed of multiple second pixel points is determined to be a non-hard shadow area B. Among them, the non-hard shadow area is a shadow area that can be projected by at least one of the multiple first projectors. It can be seen that three shadow areas will eventually be determined, namely the target shadow area, the non-hard shadow area A and the non-hard shadow area B. In a specific embodiment, the non-hard shadow area A can be determined as the target non-hard shadow area.

[0060] Step S208: marking the target shadow area and the at least one non-hard shadow area according to the preset marking strategy to obtain the third image.

[0061] The preset marking strategy can be understood as a marking strategy for highlighting and distinguishing the target shadow area and all non-hard shadow areas in the first image, so that the user can quickly know the position of the target shadow area and the position of each non-hard shadow area by observing the third image.

[0062] Taking the color filling strategy as the preset marking strategy as an example, the number of shadow area types is the same as the number of filled color types. Figure 2 For example, if it is determined that the first image contains three kinds of shadow areas, different colors are filled for each shadow area according to the color filling strategy. The color filling strategy can pre-set preset filling colors corresponding to different kinds of shadow areas; of course, the user can also adjust the color filling strategy before color filling the first image according to actual needs, so that the filled third image meets the actual needs of the user.

[0063] For example, see Figure 5 , Figure 5 The third image obtained by color filling when the projection system 10 is used as an example for projection is shown. Figure 5 The shadow area filled with red is the shadow area formed by three shadows, that is, the shadow area formed by the superposition of the three shadows projected by the three first projectors; Figure 5 The shadow area filled with yellow is the shadow area formed by the superposition of two shadows projected by the two first projectors; Figure 5The shadow area filled with green is a shadow area formed by the shadow projected by the first projector. In this way, by filling with different colors, the user can quickly distinguish different types of shadow areas.

[0064] Step S209: displaying the third image and first prompt information, wherein the first prompt information is used to prompt the user to adjust the position of the target object and / or the projector position of at least one first projector to reduce or eliminate the target shadow area.

[0065] In this embodiment, the first prompt information can also be specifically displayed at the position corresponding to the hard shadow area in the third image. In this way, the user can be more intuitively reminded to use different adjustment methods for different types of shadow areas to improve the user's adjustment efficiency and improve the projection display effect more quickly. Based on this, after the third image is displayed, the user can intuitively know the position of the target shadow area and each non-hard shadow area by viewing the third image. At this time, no matter how the user adjusts the projection brightness parameters of any first projector, since any first projector cannot project the target shadow area; at this time, the user can move the position of the target object to reduce the hard shadow area; or, when multiple first projectors are not fixed, the user can also move the position of at least one of the multiple first projectors to eliminate the hard shadow area.

[0066] Step S210: adjusting a projection brightness parameter of at least one first projector among the plurality of first projectors to reduce or eliminate the at least one non-hard shadow area.

[0067] At the same time, the brightness of the non-hard shadow area can be compensated by increasing the projection brightness parameter of the first projector that can project onto the non-hard shadow area, so as to improve the brightness compensation efficiency of the non-hard shadow area to a certain extent.

[0068] In some embodiments, after step S210, when the input shadow detection instruction is received, the plurality of first projectors will again project a white field image onto the target object after adjusting the position, and the camera will capture the image to obtain a fourth image, and the plurality of first projectors will project a black field image onto the target object after adjusting the position, and the camera will capture the image to obtain a fifth image. A difference image between the fourth image and the fifth image is obtained, and based on the difference image between the fourth image and the fifth image, a new projection display area formed by the projection of the plurality of first projectors after adjusting the position in the fourth image is determined. The specific principle of how to obtain the difference image between the fourth image and the fifth image is similar to the principle of obtaining the difference image in the aforementioned embodiment, and the contents in the aforementioned embodiment can be referred to, and will not be repeated here.

[0069] Optionally, if only the target non-hard shadow area is determined from the new projection display area based on multiple new grayscale thresholds, the target non-hard shadow area in the fourth image is marked according to a preset marking strategy to obtain a sixth image; the sixth image is displayed to prompt the user to adjust the position of the target object and / or the projector position of at least one first projector to reduce or eliminate the target non-hard shadow area. The specific implementation method of how to determine the target non-hard shadow area is the same as the implementation method of determining at least one non-hard shadow area mentioned above, and can refer to the above content, which will not be repeated here. In this way, in the area where the effect is very poor (i.e., there is still a certain degree of shadow) after a certain degree of brightness compensation is performed on the non-hard shadow area in step S210, the re-determined target non-hard shadow area is marked in the fourth image, and the sixth image obtained after marking is displayed, so as to prompt the user to further fine-tune the position of the target object or the position of at least one first projector to minimize or eliminate the target non-hard shadow area.

[0070] That is to say, after the user moves the target object or the position of the first projector and increases the projection brightness parameter of the first projector, it will be identified again whether there is a shadow area, and if there is a shadow area, the corresponding third image will continue to be displayed to assist the user in adjusting the shadow area until it disappears. Optionally, after the user moves the position of the target object or the position of the first projector, the area size of the hard shadow area will have a changing trend. According to the changing trend, a direction adjustment mark is generated and displayed in the third image accordingly to prompt the user to continue moving the target object or the position of the first projector so that the area of ​​the hard shadow area gradually decreases until it disappears.

[0071] Optionally, if the third image only includes a non-hard shadow area, the non-hard shadow area may be compensated for brightness by increasing the projection brightness parameter of the first projector that can project onto the non-hard shadow area, so as to eliminate the non-hard shadow area. Figure 6 As shown in FIG. 1 , there is only a single shadow area (i.e., a non-hard shadow area) behind the target object, which is formed by the projection of a single first projector. At this time, the brightness of the non-hard shadow area can be compensated by increasing the projection brightness parameter of the first projector that can project onto the non-hard shadow area, so as to eliminate the hard shadow area. Figure 6 Similarly, if the brightness compensation cannot completely eliminate part of the non-hard shadow area, it is still possible to determine only the target non-hard shadow area from the newly projected display area as described above, mark the target non-hard shadow area in the fourth image according to a preset marking strategy, and obtain a sixth image; the sixth image is displayed to prompt the user to adjust the position of the target object and / or the projector position of at least one first projector to minimize or eliminate the target non-hard shadow area.

[0072] In other embodiments, after step S207, the preset filling color of each shadow area can be determined according to the preset filling strategy; the regional position of each shadow area in the real scene where the target object is located can be determined according to the relative position relationship between the camera and the second projector; and the color filling image corresponding to the preset filling color of each shadow area can be projected to its regional position in the real scene where the target object is located through the second projector. In other words, it is equivalent to projecting and filling each shadow area with a different color through projection, so that the user can more intuitively know the regional position of different shadow areas in the real scene, which is convenient for adjusting the position of the target object and / or the first projector, and timely eliminating various shadow areas to ensure the effect of projection display.

[0073] In some other embodiments, different first projectors are controlled to display different numbers while projecting a white field image, so that it can be more intuitively displayed to the user which shadow areas are produced by which first projector. In this way, when it is necessary to adjust the projection brightness parameters of the projector, the user can more quickly know which first projector's projection brightness parameters need to be adjusted.

[0074] In this embodiment, the user can quickly know the shadow area that cannot be projected by each first projector by viewing the displayed third image, thereby assisting the user to quickly eliminate the hard shadow area of ​​the target object by adjusting the position of the target object and / or the position of at least one first projector; and then adjust the projection brightness parameters of at least one first projector to quickly eliminate all non-hard shadow areas of the target object to present a better projection display effect.

[0075] Please refer to Figure 7 , which shows a structural block diagram of a projection prompting device 300 provided by an embodiment of the present application, which is applied to a projection system, wherein the projection system includes a camera and a plurality of first projectors, and the shooting range of the camera covers the total projection range of the plurality of first projectors. The device 300 may include: an image acquisition module 310, a display area determination module 320, a shadow area determination module 330, a marking module 340 and a display module 350.

[0076] The image acquisition module 310 is used to project a white field image onto the target object through the multiple first projectors and capture the image through the camera to obtain a first image, and to project a black field image onto the target object through the multiple first projectors and capture the image through the camera to obtain a second image.

[0077] The display area determination module 320 is used to obtain a difference image between the first image and the second image, and determine a projection display area formed by projections of the plurality of first projectors in the first image based on the difference image.

[0078] The shadow area determination module 330 is used to determine the target shadow area of ​​the target object in the projection display area according to the grayscale value of each pixel point in the projection display area in the first image and at least one grayscale threshold, and the target shadow area is a place that all first projectors cannot project.

[0079] The marking module 340 is used to mark the target shadow area in the first image according to a preset marking strategy to obtain a third image.

[0080] The display module 350 is used to display the third image to prompt the user to adjust the position of the target object and / or the projector position of at least one first projector to reduce or eliminate the target shadow area.

[0081] In some embodiments, the display area determination module 320 can be specifically used to: binarize the difference image to obtain a binarized image corresponding to the difference image; obtain the area position of the white area in the binarized image; and determine the image area corresponding to the area position of the white area from the first image as a projection display area formed by projections from the multiple first projectors.

[0082] In some embodiments, the projection prompting device 300 may further include: a threshold quantity determination module and a threshold value determination module. The threshold quantity determination module may be used to determine the threshold quantity of the grayscale threshold according to the number of projectors of the plurality of projectors before determining the shadow area of ​​the target object in the projection display area according to the grayscale value of each pixel point in the projection display area in the first image and at least one grayscale threshold. The threshold value determination module may be used to determine the value of each grayscale threshold according to the threshold quantity and the average grayscale value of the first image.

[0083] In some embodiments, the shadow area determination module 330 can be specifically used to: if there are multiple grayscale thresholds, then determine the minimum grayscale threshold from the multiple grayscale thresholds as the minimum grayscale threshold; if there are multiple pixel points in the projection display area whose grayscale values ​​are all less than the minimum grayscale threshold, then determine the area formed by the multiple pixel points as the target shadow area; and determine at least one non-hard shadow area based on the other grayscale thresholds among the multiple grayscale thresholds except the minimum grayscale threshold.

[0084] In this manner, the marking module 340 may be specifically configured to mark the target shadow region and the at least one non-hard shadow region according to the preset marking strategy to obtain the third image.

[0085] In this manner, the display module 350 can be specifically used to display the third image and the first prompt information, wherein the first prompt information is used to prompt the user to adjust the position of the target object or the position of at least one first projector to reduce or eliminate the target shadow area. The projection prompt device 300 can also include: a parameter adjustment module, wherein the parameter adjustment module can be used to adjust the projection brightness parameter of at least one first projector among the multiple first projectors to reduce or eliminate the at least one non-hard shadow area.

[0086] In some embodiments, the image acquisition module 310 can be specifically used to, after adjusting the projection brightness parameters of at least one of the plurality of first projectors, project a white field image to the target object after the position is adjusted through the plurality of first projectors, and capture the image through the camera to obtain a fourth image, and project a black field image to the target object after the position is adjusted through the plurality of first projectors, and capture the image through the camera to obtain a fifth image. The display area determination module 320 can be specifically used to obtain a difference image between the fourth image and the fifth image, and determine a new projection display area formed by the projections of the plurality of first projectors after the position is adjusted in the fourth image based on the difference image between the fourth image and the fifth image. The marking module 340 can be specifically used to, if a target non-hard shadow area is determined from the new projection display area based on a plurality of new grayscale thresholds, mark the target non-hard shadow area in the fourth image according to a preset marking strategy to obtain a sixth image. The display module 350 may be specifically configured to display the sixth image to prompt the user to adjust the position of the target object and / or the projector position of at least one first projector to reduce or eliminate the target non-hard shadow area.

[0087] In some embodiments, the display area determination module 320 may include a difference image acquisition unit. The difference image acquisition unit may be specifically used to: if the camera is a color camera, convert the first image into a grayscale image to obtain a first grayscale image, and convert the second image into a grayscale image to obtain a second grayscale image; obtain a difference image between the first grayscale image and the second grayscale image; if the camera is a black and white camera, obtain a difference image between the first image and the second image.

[0088] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and modules can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here.

[0089] In several embodiments provided in the present application, the coupling between modules may be electrical, mechanical or other forms of coupling.

[0090] In addition, each functional module in each embodiment of the present application can be integrated into a processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The above integrated modules can be implemented in the form of hardware or software functional modules.

[0091] In summary, a first image is obtained by projecting a white field image onto a target object through multiple first projectors and capturing the image through a camera, and a second image is obtained by projecting a black field image onto the target object through multiple first projectors and capturing the image through a camera; a difference image between the first image and the second image is obtained, and based on the difference image, a projection display area formed by projections of multiple first projectors in the first image is determined; according to the grayscale value of each pixel point in the projection display area in the first image and at least one grayscale threshold, multiple shadow areas of the target object in the projection display area are determined, and different types of shadow areas contain different numbers of shadows of the target object; according to a preset filling strategy, the multiple shadow areas in the first image are filled with colors to obtain a third image, wherein different types of shadow areas are filled with different colors; the third image is displayed to prompt that the position of the target object, the projection brightness parameters of at least one projector among the multiple projectors, and / or the projector position of at least one projector are adjusted based on the third image to eliminate the multiple shadow areas. In this way, the user can quickly know the shadow area that cannot be projected by each first projector by viewing the displayed third image, thereby assisting the user to quickly eliminate the hard shadow area of ​​the target object by adjusting the position of the target object and / or the position of at least one first projector; and then adjust the projection brightness parameters of at least one first projector to quickly eliminate all non-hard shadow areas of the target object to present a better projection display effect.

[0092] The following will be combined Figure 8 An electronic device provided by the present application is described.

[0093] Reference Figure 8 , Figure 8 The structural block diagram of an electronic device 400 provided in an embodiment of the present application is shown, and the above method provided in an embodiment of the present application can be executed by the electronic device 400. The electronic device can be an electronic terminal with a data processing function, and the electronic terminal includes but is not limited to a smart phone, a tablet computer, a laptop computer, and a desktop computer.

[0094] The electronic device 400 in the embodiment of the present application may include one or more of the following components: a processor 401, a memory 402, and one or more applications, wherein the one or more applications may be stored in the memory 402 and configured to be executed by one or more processors 401, and the one or more programs are configured to execute the method as described in the aforementioned method embodiment.

[0095] The processor 401 may include one or more processing cores. The processor 401 uses various interfaces and lines to connect the various parts of the entire electronic device 400, and executes various functions and processes data of the electronic device 400 by running or executing instructions, programs, code sets or instruction sets stored in the memory 402, and calling data stored in the memory 402. Optionally, the processor 401 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). The processor 401 can integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU) and a modem. Among them, the CPU mainly processes the operating system, user interface and application programs; the GPU is responsible for rendering and drawing display content; and the modem is used to process wireless communications. It can be understood that the above-mentioned modem can also be integrated into the processor 401 and implemented separately through a communication chip.

[0096] The memory 402 may include a random access memory (RAM) or a read-only memory (ROM). The memory 402 may be used to store instructions, programs, codes, code sets or instruction sets. The memory 402 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the following various method embodiments, etc. The data storage area may also store data (such as the various corresponding relationships described above) created by the electronic device 400 during use.

[0097] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and modules can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here.

[0098] In several embodiments provided in the present application, the coupling or direct coupling or communication connection between the modules shown or discussed may be an indirect coupling or communication connection through some interfaces, devices or modules, which may be electrical, mechanical or other forms.

[0099] In addition, each functional module in each embodiment of the present application can be integrated into a processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The above integrated modules can be implemented in the form of hardware or software functional modules.

[0100] Please refer to Fig. 9 , which shows a structural block diagram of a computer-readable storage medium provided in an embodiment of the present application. The computer-readable medium 500 stores program codes, which can be called by a processor to execute the method described in the above method embodiment.

[0101] The computer readable storage medium 500 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read-only memory), an EPROM, a hard disk, or a ROM. Optionally, the computer readable storage medium 500 includes a non-transitory computer-readable storage medium. The computer readable storage medium 500 has storage space for program code 510 that performs any method step of the above method. These program codes can be read from or written to one or more computer program products. The program code 510 can be compressed, for example, in an appropriate form.

[0102] In some embodiments, a computer program product or computer program is provided, the computer program product or computer program includes computer instructions, the computer instructions are stored in a computer-readable storage medium. A processor of an electronic device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the electronic device performs the steps in the above-mentioned method embodiments.

[0103] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A projection prompting method, characterized in that: Applied to a projection system, the projection system includes a camera and a plurality of first projectors, the shooting range of the camera covers the total projection range of the plurality of first projectors, and the method includes: Projecting a white field image onto a target object through the plurality of first projectors and capturing the image through the camera to obtain a first image, and projecting a black field image onto a target object through the plurality of first projectors and capturing the image through the camera to obtain a second image; Acquire a difference image between the first image and the second image, and determine, based on the difference image, a projection display area formed by projections of the plurality of first projectors in the first image; Determine a target shadow area of ​​the target object in the projection display area according to the grayscale value of each pixel point in the projection display area in the first image and at least one grayscale threshold, wherein the target shadow area is a place that all first projectors cannot project; Marking the target shadow area in the first image according to a preset marking strategy to obtain a third image; The third image is displayed to prompt the user to adjust the position of the target object and / or the projector position of at least one first projector to reduce or eliminate the target shadow area.

2. The method according to claim 1, characterized in that The step of determining, based on the difference image, a projection display area formed by projections of the plurality of first projectors in the first image comprises: Performing binarization processing on the difference image to obtain a binarized image corresponding to the difference image; Obtaining the area position of the white area in the binary image; An image area corresponding to the area position of the white area is determined from the first image as a projection display area formed by projection by the plurality of first projectors.

3. The method according to claim 1, characterized in that Before determining the shadow area of ​​the target object in the projection display area according to the grayscale value of each pixel point in the projection display area in the first image and at least one grayscale threshold, the method further includes: Determining the number of thresholds of the grayscale threshold according to the number of projectors of the plurality of first projectors; The value of each grayscale threshold is determined according to the number of thresholds and the average grayscale value of the first image.

4. The method according to claim 1, characterized in that The determining, according to the grayscale value of each pixel point in the projection display area in the first image and at least one grayscale threshold, a target shadow area of ​​the target object in the projection display area comprises: If there are multiple grayscale thresholds, then determine the minimum grayscale threshold from the multiple grayscale thresholds as the minimum grayscale threshold; If there are multiple pixels in the projection display area whose grayscale values ​​are all smaller than the minimum grayscale threshold, then determining the area formed by the multiple pixels as the target shadow area; The method further comprises: Determining at least one non-hard shadow area according to other grayscale thresholds among the multiple grayscale thresholds except the minimum grayscale threshold; The step of marking the target shadow area in the first image according to a preset marking strategy to obtain a third image includes: According to the preset marking strategy, the target shadow area and the at least one non-hard shadow area are marked to obtain the third image.

5. The method according to claim 4, characterized in that The displaying of the third image comprises: displaying the third image and first prompt information, wherein the first prompt information is used to prompt the user to adjust the position of the target object or the position of at least one first projector to reduce or eliminate the target shadow area; The method further comprises: A projection brightness parameter of at least one first projector among the plurality of first projectors is adjusted to reduce or eliminate the at least one non-hard shadow area.

6. The method according to claim 5, characterized in that After adjusting the projection brightness parameter of at least one first projector among the plurality of first projectors, the method further includes: Projecting a white field image onto the target object after adjusting the position through the multiple first projectors and capturing the image through the camera to obtain a fourth image, and projecting a black field image onto the target object after adjusting the position through the multiple first projectors and capturing the image through the camera to obtain a fifth image; Acquire a difference image between the fourth image and the fifth image, and determine, based on the difference image between the fourth image and the fifth image, a new projection display area formed by projections of the plurality of first projectors after adjusting positions in the fourth image; If a target non-hard shadow area is determined from the new projection display area based on multiple new grayscale thresholds, the target non-hard shadow area in the fourth image is marked according to the preset marking strategy to obtain a sixth image; The sixth image is displayed to prompt the user to adjust the position of the target object and / or the projector position of at least one first projector to reduce or eliminate the target non-hard shadow area.

7. The method according to any one of claims 1 to 5, characterized in that: The acquiring a difference image between the first image and the second image comprises: If the camera is a color camera, converting the first image into a grayscale image to obtain a first grayscale image, and converting the second image into a grayscale image to obtain a second grayscale image; Acquire a difference image between the first grayscale image and the second grayscale image; If the camera is a black and white camera, a difference image between the first image and the second image is acquired.

8. A projection prompting device, characterized in that: Applied to a projection system, the projection system comprises a camera and a plurality of first projectors, the shooting range of the camera covers the total projection range of the plurality of first projectors, and the device comprises: An image acquisition module, configured to project a white field image onto a target object through the plurality of first projectors and capture the image through the camera to obtain a first image, and to project a black field image onto a target object through the plurality of first projectors and capture the image through the camera to obtain a second image; a display area determination module, configured to obtain a difference image between the first image and the second image, and determine, based on the difference image, a projection display area formed by projections of the plurality of first projectors in the first image; a shadow area determination module, configured to determine a target shadow area of ​​the target object in the projection display area according to a grayscale value of each pixel point in the projection display area in the first image and at least one grayscale threshold, wherein the target shadow area is a place that all the first projectors cannot project; A marking module, used for marking the target shadow area in the first image according to a preset marking strategy to obtain a third image; The display module is used to display the third image to prompt the user to adjust the position of the target object and / or the projector position of at least one first projector to reduce or eliminate the target shadow area.

9. An electronic device, characterized in that: The electronic device comprises: one or more processors; Memory; One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are configured to execute the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores program code, which can be called by a processor to execute the method according to any one of claims 1 to 7.

Images