Projection fusion display control method

Abstract

The invention relates to a projection fusion display control method, which comprehensively monitors ambient light through a light sensor and a camera, analyzes light intensity, color and direction, and calculates an influence value of light on a projection effect so as to accurately adjust the brightness and color of a projection portrait. And secondly, detecting the flatness of the projection surface by using a high-precision laser range finder, generating a flatness influence value, correcting the image, and compensating the effect influence caused by the unevenness of the projection surface. In addition, the technical scheme also relates to the identification of the projection plane image to obtain the display template, the regional picture correction of the image is carried out according to the template and the display parameters, and finally the optimal image display frame is generated through fusion for projection. According to the scheme, the definition and the color rendition degree of the projection picture are improved, the stability and the consistency of the projection effect are enhanced, and better projection experience is brought to a user. By finely processing the ambient light and the flatness of the projection surface, the technical scheme effectively improves the overall application effect of the projection technology.

Description

Technical Field

[0001] The present invention relates to the field of projection display, and in particular to a projection fusion display control method. Background Art

[0002] In the current field of image display, traditional projection methods are facing unprecedented challenges. The core problem lies in the strict limitation of the display range and the monotonous and boring display effect. Traditional projection technology is often limited by specific spatial conditions, such as having to operate in a dark room or an environment with blackout curtains to ensure the clarity and recognizability of the projected image. This spatial limitation greatly narrows the application scope of projection technology, especially in outdoor environments or places with strong light, where the display effect will be significantly reduced. At the same time, since traditional projection equipment is usually bulky and not easy to carry, it is particularly difficult to use projection technology in occasions such as temporary displays, touring exhibitions or outdoor activities.

[0003] In addition, traditional projection methods have extremely stringent requirements for projection surfaces, and can often only adapt to flat, fixed projection surfaces, such as projection screens or walls. Traditional methods are often helpless for projection surfaces with irregular shapes or in dynamic changes, which undoubtedly limits the diversity and innovation of display effects. In terms of image presentation, affected by multiple factors such as ambient light and projection surface flatness, traditional projection methods are difficult to ensure high quality of the projected image, and often have problems such as blurred, distorted or uneven brightness, which seriously affects the audience's viewing experience.

[0004] More importantly, with the continuous upgrading of modern display needs, the display method of a single projection image can no longer meet people's growing aesthetic and functional needs. In many cases, multiple projection images need to be merged to create a more shocking and three-dimensional visual effect. However, the traditional projection method is unable to do so and it is difficult to achieve effective fusion of projection images, thus limiting the further improvement of the display effect. Summary of the invention

[0005] The present invention aims to solve the technical problems existing in the prior art and provide an innovative projection fusion display control method. The method aims to overcome the limitations of traditional projection methods in terms of space limitation, single display effect and insufficient projection fusion capability, and realize more flexible, diverse and high-quality image display.

[0006] The technical solution of the present invention to solve the above technical problems is as follows: a projection fusion display control method, comprising: S101, obtaining a projection image and a light source influence value of a projection terminal; S102, identifying the projection surface image to obtain a display template corresponding to the projection surface image; S103, considering the impact value of the flatness of the projection surface, detecting the ranging flatness and generating display parameters; S104, performing regional picture correction on the image based on the display template and the display parameters; S105, fusing the corrected images to generate a final image display frame for projection display.

[0007] Preferably, the step S101 of obtaining the light source influence value includes: Use a light meter to measure the ambient light intensity in the projection area; Identify the source of ambient light by analyzing spectral characteristics; During projection, continuously monitor changes in ambient light; Conduct detailed analysis of the collected data.

[0008] Preferably, the detailed analysis of the collected data includes: According to the data provided by the light sensor, the intensity value I of the ambient light can be obtained, usually in lux Lx; Using image processing technology, the color components R, G, and B of light are extracted from the image captured by the camera. These components represent the intensity of red, green, and blue light respectively; Based on the collected light intensity I and color components R, G, B, calculate the impact of light on the projection effect; this includes the brightness adjustment coefficient and color correction coefficients ; and is a constant coefficient, I is the light intensity measured by the light sensor, D is the desired projection brightness, R, G, B are the color components of the light captured by the camera, , , It is the color output value of the projection device under standard lighting conditions; Calculate the light source influence value I_env:

[0009] Among them, I_ambient represents the average intensity of ambient light, which can be measured by a light intensity meter; I_direct represents the intensity of light directly irradiated on the projection surface.

[0010] Preferably, the S103, ranging flatness detection method, includes: Use a high-precision laser rangefinder as a measuring tool and calibrate the rangefinder; Evenly arrange multiple measuring points on the projection surface and record the position information of each measuring point; Use a rangefinder to measure the distance of each measuring point and record the actual distance value of each point. At the same time, record the initial distance between the rangefinder and the projection surface as a reference distance.

[0011] Compare the actual distance value of each measuring point with the reference distance, and calculate the flatness deviation δ of each point; the flatness deviation can be calculated by the formula: δ=|actual distance-reference distance|; According to the flatness deviation δ, the distance adjustment value Δd is calculated, and Δd=h(δ), where h is a function for calculating the distance adjustment value according to the flatness deviation; Projection surface flatness influence value formula:

[0012] Where n is the number of measurement points, is the flatness deviation of the i-th measuring point, It is the maximum value of the distance adjustment value among all measurement points, which is used to normalize the flatness deviation.

[0013] Preferably, the S101 further includes: S201, calibrating the coordinates of the light-emitting points for different types of light sources; S202, calculating the distance, angle and light intensity from each luminous point coordinate to the projection surface and recording them as luminous point set information; S203, merging and calculating the information of each light-emitting point set in the influence layer to obtain the influence value of the superposition of multiple projection light sources.

[0014] Preferably, the light point set information includes: The calculation formula of the luminous point set information L_effect is as follows:

[0015] The distance calculation uses the distance formula in three-dimensional space to calculate the vertical distance from each light point to the projection surface. The formula is as follows: , where (x1, y1, z1) are the coordinates of the light-emitting point, and (x2, y2, z2) are the coordinates of a point on the projection surface; The angle is calculated by using the vector dot product and the modulus to calculate the cosine value of the angle. The angle is then obtained by the inverse cosine function. The formula is as follows: , is the direction vector of the light from the emitting point, is the normal vector of the projection surface; The light intensity data provided by the light sensor is recorded as I.

[0016] Preferably, the S203 includes: The impact layer is a virtual layer that is located in front of the projection surface; Assume that region R contains m points, then the multi-projection light source impact value of region R is It can be expressed as the average of the multi-projection light source influence values ​​of all points in the area: .

[0017] Preferably, the S203 further includes: S301, according to the distance from the projection light source to the projection surface, a distance threshold is preset to divide the space into multiple influence layers; S302, for each projection light source, determine a detection surface according to the angle between its point position and the screen; S303, in each impact layer, for each projection light source, calculating its light intensity distribution on the detection surface; S304, in each influence layer, superimposing the influence values ​​of all projection light sources to obtain the total light intensity distribution of the influence layer; S305: Combine the total light intensity distributions of all impact layers to obtain a comprehensive impact value of the multiple projection light sources on the projection surface.

[0018] Preferably, the step S301, dividing the space into a plurality of impact layers, includes: Determine the maximum and minimum distances from the projection light source to the projection surface; According to the distance range, N distance thresholds are preset to divide the space into N+1 influence layers; Each influence layer corresponds to a specific distance range, and the i-th influence layer corresponds to the distance range [d_i,d_{i+1}).

[0019] Preferably, the S301 further includes: S401, partitioning each virtual layer according to multiple angles of the light source, and calculating the angular intensity of the partitioned light source; S402, further dividing each virtual layer into a plurality of small area partitions, each partition corresponding to a specific light source angle range; S403, for each partition, calculating the angular intensity of all light sources in the partition; S404, for each virtual layer, superimposing the angular intensities of all partitions to obtain a total angular intensity distribution of the layer; S405 , merging the total angular intensity distributions of all virtual layers to obtain a comprehensive angular intensity distribution of the multi-light sources projected on the projection surface.

[0020] The beneficial effects of the present invention are: 1. By deploying light sensors and cameras to fully monitor ambient light, including natural light and lighting, the impact of light on the projection effect is accurately obtained, and the brightness and color of the projected image are finely adjusted to perfectly match the ambient light, effectively avoiding distortion of the projection effect. At the same time, a high-precision laser rangefinder is used to detect the flatness of the projection surface, generate accurate flatness impact values, and correct the image accordingly to compensate for the effects caused by the uneven projection surface, thereby significantly improving the clarity, color reproduction, stability and consistency of the projection image.

[0021] 2. When calculating the comprehensive impact of multiple projection light sources on the projection surface, this technical solution first accurately calibrates the coordinates of the light-emitting points of each light source, and uses the three-dimensional space distance formula, vector dot product and module length to calculate the vertical distance from the light point to the projection surface, the angle between the light and the normal of the projection surface, and combines the light intensity data provided by the light sensor to fully obtain the collective information of the light points. Subsequently, by introducing a virtual influence layer, the influence value of each light point is calculated and superimposed on this layer, and the comprehensive impact value of multiple projection light sources for all points in the area is obtained by comprehensively considering factors such as light intensity, distance and angle. This method not only accurately evaluates the lighting effect of multiple projection light sources, but also provides strong support for the optimization of light source layout. It has good versatility and scalability and is suitable for various light sources and projection surface shapes.

[0022] 3. By presetting the distance threshold to divide the influence layer and independently calculating the influence of the light source in each layer, the calculation efficiency is significantly improved. At the same time, the light intensity is adjusted by combining the light intensity attenuation formula and the cosine value of the angle, making the calculation closer to physical reality and enhancing the reliability of the results. In addition, this technology can also generate a detailed light intensity distribution map, providing strong support for the optimization of light source layout and the improvement of lighting effects. By comprehensively evaluating the influence of multiple projection light sources on the projection surface, it intuitively guides the adjustment of the light source layout, and further improves the accuracy and visualization of the results through smoothing.

[0023] 4. Through a sophisticated layering and partitioning strategy, combined with a rigorous method for calculating the angle intensity of the light source, the virtual layer is first subdivided into multiple small areas according to the projection angle of the light source, and the light source brightness, distance, and angle with the normal of the projection surface are comprehensively considered. The angle intensity of the light source in each partition is accurately calculated using the laws of physics. Subsequently, the angle intensity of each partition is superimposed layer by layer and the total angle intensity distribution of all virtual layers is combined, while considering the mutual influence and occlusion effects between layers, and finally the comprehensive angle intensity distribution on the entire projection surface is obtained. This technical solution not only significantly improves the calculation accuracy and efficiency, but also enhances adaptability, can flexibly respond to complex projection scenes and light source configurations, provides a solid data foundation for projection applications, and demonstrates significant technical advantages and application value. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1It is a schematic flow chart of the projection fusion display control method of the present invention. DETAILED DESCRIPTION

[0025] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of this application.

[0026] In the description of this application, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this application, "plurality" means two or more, unless otherwise clearly and specifically defined.

[0027] In the description of the present application, the term "for example" is used to mean "used as an example, illustration or description". Any embodiment described as "for example" in the present application is not necessarily to be construed as being more preferred or advantageous than other embodiments. The following description is given to enable any technician in the field to implement and use the present invention. In the following description, details are listed for the purpose of explanation. It should be understood that a person of ordinary skill in the art can recognize that the present invention can be implemented without using these specific details. In other examples, well-known structures and processes will not be elaborated in detail to avoid unnecessary details to obscure the description of the present invention. Therefore, the present invention is not intended to be limited to the embodiments shown, but is consistent with the widest scope consistent with the principles and features disclosed in the present application.

[0028] Embodiment 1: Figure 1 It is a flowchart of a projection fusion display control method according to an embodiment of the present invention.

[0029] like Figure 1 As shown, the projection fusion display control method includes the following steps: S101, obtaining a projection image and a light source influence value of a projection terminal.

[0030] Among them, the projected image represents the basic image or image that the projection device can refract. The projection surface image can be the entire image of the projection surface of the projection terminal, or it can be the image in the projection area. The projection area can be a wall projection area or a screen projection area, which is not limited here.

[0031] Light sensors and cameras are deployed at the projection terminal to detect and measure the light sources in the current environment, including natural light, lighting, etc., and analyze factors such as the intensity, color, and direction of these lights to determine their impact on the projection effect.

[0032] Specifically, obtaining the light source impact value includes: Use a light meter to measure the ambient light intensity in the projection area; this usually involves taking measurements at multiple locations to get a more comprehensive picture of the light intensity distribution.

[0033] Identify the source of ambient light by analyzing its spectral characteristics; for example, sunlight usually has a specific spectral distribution, while lamplight may have a different color temperature or spectral characteristics.

[0034] During projection, continuously monitor changes in ambient light; because ambient light may change with time (such as sunrise and sunset, cloud changes) or human factors (such as turning lights on and off).

[0035] The collected data is analyzed in detail; first, based on the data provided by the light sensor, the intensity value I of the ambient light can be obtained, usually in lux (Lx). Secondly, using image processing technology, the color components R, G, and B of the light are extracted from the image captured by the camera. These components represent the intensity of red, green, and blue light respectively.

[0036] Based on the collected light intensity I and color components R, G, B, the impact of light on the projection effect is calculated; this includes the brightness adjustment coefficient B and the color correction coefficient C.

[0037] Among them, the calculation formula of the light source impact value includes: First, the brightness adjustment coefficient B is calculated to adjust the brightness of the projected image to match the current ambient light conditions. The calculation formula can be expressed as:

[0038] and is a constant coefficient and needs to be calibrated according to the actual projection equipment and environment ( and Calibration is an iterative process. For the specific calibration process, please refer to the calibration process in the prior art for matching the projection image brightness with the ambient light conditions); I is the light intensity measured by the light sensor; D is the desired projection brightness, which can be set according to user needs or preset values.

[0039] Secondly, the color correction coefficient C is calculated to adjust the color of the projected image to match the color of the ambient light. The calculation formula can be expressed as:

[0040] Among them, R, G, and B are the color components of light captured by the camera; , , The color output value of the projection device under standard lighting conditions. These values ​​can be obtained through calibration. The smaller the value of C, the closer the ambient light is to the color output of the projection device, and the less color correction is needed.

[0041] Finally, to calculate the influence value of the light source, an influence value I_env can be introduced, which can be calculated by the following formula:

[0042] Among them, I_ambient represents the average intensity of ambient light, which can be measured by a light intensity meter; I_direct represents the intensity of light directly irradiated on the projection surface.

[0043] It should be noted that the constant coefficient in the above formula is and And standard color output values , , Both need to be calibrated and set according to the actual projection equipment and environment. In addition, as the ambient light changes, the brightness adjustment coefficient B and color correction coefficient C also need to be dynamically adjusted to ensure the optimization of the projection effect.

[0044] A light source impact value memory bank can be pre-set on the display terminal. The memory bank includes the impact values ​​I_env of different light sources corresponding to various types of ambient light on the projected image. When receiving an image, the projection terminal can directly retrieve the light source and select the impact value of the current light source to match the light source impact value in the current environment.

[0045] S102, identifying the projection surface image to obtain a display template corresponding to the projection surface image.

[0046] Among them, the display template determines the basic shape and layout of the image display frame.

[0047] Specifically, the projection surface information is parsed to obtain the size information and image space arrangement information corresponding to the projection surface image; a target display template matching the size information and image space arrangement information is determined from a display template library; and the target display template is determined as the display template corresponding to the projection surface image.

[0048] The projection terminal obtains detailed information about the projection surface by identifying the projection surface image, including size, image spatial arrangement, and possible material information. Then, it searches for a display template that matches this information in the preset display template library. If a suitable template is found, it is used directly; if not, the projection terminal generates a new display template based on the specific information of the projection surface, and ensures that this template can completely cover the projection surface and will not be blocked by any obstacles. The newly generated template will be added to the display template library so that it can be used directly in similar situations in the future, thereby improving efficiency.

[0049] In addition, users can also personalize the color of the selected display template according to the material of the projection surface and the usage scenario. For example, if the projection surface is a metal curtain and the original template is colorful and bright, when used at night, users may want to reduce the brightness and contrast for a more comfortable viewing experience. This custom adjustment function increases the flexibility of projection and user satisfaction.

[0050] S103, considering the impact value of the projection surface flatness, detecting the ranging flatness and generating display parameters.

[0051] The display parameter set P includes: a light source influence value I_env and a projection surface flatness influence value, and generates a set of display parameters including the light source and the current projection conditions.

[0052] Specifically, the ranging flatness detection method includes: Use a high-precision laser rangefinder (resolution accuracy can reach 0.25mm or higher) as a measuring tool and calibrate the rangefinder to ensure the accuracy of the measurement data and the stability of the equipment.

[0053] Arrange multiple measuring points evenly on the projection surface and record the position information of each measuring point; these points should cover the entire area of ​​the projection surface to ensure the comprehensiveness of the measurement.

[0054] Use a rangefinder to measure the distance of each measuring point and record the actual distance value of each point. At the same time, record the initial distance between the rangefinder and the projection surface as a reference distance.

[0055] Compare the actual distance value of each measuring point with the reference distance, and calculate the flatness deviation δ of each point (indicating the deviation between each point on the projection surface and the actual plane); the flatness deviation can be calculated by the following formula: δ=|actual distance-reference distance|.

[0056] According to the flatness deviation δ, the distance adjustment value Δd is calculated (calculated according to the flatness deviation δ and used to adjust the distance between the projection device and the projection surface); Δd=h(δ), where h is a function for calculating the distance adjustment value according to the flatness deviation, and this function can be fitted or adjusted according to the actual situation. This adjustment value is used to adjust the distance between the projection device and the projection surface to compensate for the impact of the flatness deviation.

[0057] The projection surface flatness impact value is a comprehensive indicator used to evaluate the impact of projection surface flatness on the projection effect. It can be calculated using the following formula:

[0058] n is the number of measurement points, is the flatness deviation of the i-th measuring point, It is the maximum value of the distance adjustment value among all measurement points, which is used to normalize the flatness deviation.

[0059] The above formula calculates the average value of the sum of squares of the flatness deviations of all measurement points and normalizes it to the maximum range of the distance adjustment value to obtain the projection surface flatness impact value. The larger this value is, the worse the flatness of the projection surface is, and the greater the impact on the projection effect is.

[0060] It should be noted that the distance adjustment function h(δ) and the flatness influence value calculation formula in the above formula are fitted or adjusted based on experience and actual conditions. In actual applications, calibration and correction may be required according to specific projection equipment and environmental conditions.

[0061] S104: performing regional picture correction on the image based on the display template and the display parameters.

[0062] Specifically, a display template matching the projection surface image is loaded from the display template library, which includes the basic shape, layout and possible personalized color adjustment information of the image display frame.

[0063] According to the previously calculated light source impact value I_env, adjust the brightness and color of the projected image. Use the brightness adjustment coefficient B to adjust the brightness of the image to match the ambient light conditions; use the color correction coefficient C to adjust the color of the image to coordinate with the color of the ambient light.

[0064] According to the projection surface flatness impact value, the image is further corrected. This includes adjusting a certain area of ​​the image to compensate for the unevenness of the projection surface to ensure the consistency and clarity of the projection effect.

[0065] S105, fusing the corrected images to generate a final image display frame for projection display.

[0066] Specifically, the rectified image is fused with a presentation template; this typically involves placing the image within an image presentation box defined by the presentation template and further personalizing it according to the layout and color adjustments of the template.

[0067] After the presentation templates are merged, the final image presentation frame is generated; this presentation frame contains all necessary image information and presentation parameters, ready for projection presentation.

[0068] Use a projection device to project the final image display frame onto the projection surface; ensure that the distance, angle and projection parameters between the projection device and the projection surface are set correctly to obtain the best projection effect.

[0069] During the projection process, continuously monitor the changes in ambient light and the status of the projection surface; if any factors affecting the projection effect are found (such as changes in ambient light, movement of the projection surface, etc.), the projection parameters should be adjusted in time or the image should be re-corrected to ensure the stability and quality of the projection effect.

[0070] The technical solutions in the above embodiments of the present application have at least the following technical effects or advantages: 1. In terms of processing ambient light, the technical solution deploys light sensors and cameras to comprehensively monitor and analyze the sources of light in the environment, including natural light and lighting. By measuring light intensity, analyzing spectral characteristics, and continuously monitoring changes in ambient light, the technical solution can accurately obtain the impact of light on the projection effect. This impact value not only takes into account the intensity of light, but also fully considers the color and direction of light, so that the brightness and color of the projected image can be accurately adjusted to perfectly match the ambient light conditions. This fine processing of ambient light effectively avoids distortion or blurring of the projection effect caused by changes in ambient light, ensuring the clarity and color reproduction of the projected image.

[0071] 2. In the processing of the flatness of the projection surface, the technical solution uses a high-precision laser rangefinder to perform distance measurement and flatness detection, ensuring the accuracy of the measurement data and the stability of the equipment. By measuring the distance of multiple measurement points on the projection surface and calculating the flatness deviation, the technical solution can generate an accurate projection surface flatness impact value. This impact value reflects the direct impact of the projection surface flatness on the projection effect, and provides an important basis for subsequent image correction. During the projection process, the technical solution further corrects the image according to the flatness impact value, effectively compensating for the impact of the projection effect caused by the unevenness of the projection surface. This precise correction of the flatness of the projection surface not only improves the overall quality of the projection image, but also enhances the stability and consistency of the projection effect.

[0072] Embodiment 2: The above-mentioned first embodiment effectively solves the problems of limited display range and single display effect by flexibly adapting to different projection surfaces, dynamically adjusting projection parameters, personalized display templates, high-precision image correction, and intelligent adaptation to ambient light, and realizes the diversification and quality improvement of display effects. In actual application, the external (non-projection projection light source) light source is not unique, and multiple projection light sources at the same time may affect the projected image. In order to further obtain an image with a normal display range and effect under the influence of multiple projection light sources, step S101 of the first embodiment is further improved: S201, calibrating the coordinates of the light-emitting points for different types of light sources.

[0073] The luminous point is the precise position of each light source in three-dimensional space.

[0074] S202, calculating the distance, angle and light intensity from the coordinates of each light-emitting point to the projection surface and recording them as light-emitting point set information.

[0075] The distance calculation uses the distance formula in three-dimensional space to calculate the vertical distance from each light point to the projection surface. The formula is as follows: , where (x1, y1, z1) are the coordinates of the light-emitting point, and (x2, y2, z2) are the coordinates of a point on the projection surface (usually the center point of the projection surface or a point on the normal line); The angle is calculated by using the vector dot product and the modulus to calculate the cosine value of the angle. The angle is then obtained by the inverse cosine function. The formula is as follows: , is the direction vector of the light from the emitting point, is the normal vector of the projection surface; The light intensity data provided by the light sensor is recorded as I.

[0076] The calculation formula of the luminous point set information L_effect is as follows:

[0077] The above formula takes into account the contribution of light intensity, distance and angle to the impact value of the projection light source. The greater the light intensity (I), the greater the impact value of the projection light source; the greater the distance (d), the smaller the impact value of the projection light source (because the light intensity will decay with the square of the distance); the larger the angle (θ) (that is, the less perpendicular the angle between the light and the projection surface), the smaller the impact value of the projection light source (because the effective light intensity will decrease).

[0078] S203, merging and calculating the information of each light-emitting point set in the influence layer to obtain the influence value of the superposition of multiple projection light sources.

[0079] Among them, the impact layer is a virtual layer located in front of the projection surface and is used to simulate and evaluate the impact of multiple projection light sources on the projection surface.

[0080] Specifically, suppose that region R contains m points, then the multi-projection light source influence value of region R is It can be expressed as the average of the multi-projection light source influence values ​​of all points in the area:

[0081] The technical solutions in the above embodiments of the present application have at least the following technical effects or advantages: 1. When calculating the impact value of multiple projection light sources on the projection surface, it is necessary to first accurately calibrate the coordinates of the light points of different types of light sources, which is the basis for subsequent calculations. Through the distance formula in three-dimensional space, the vertical distance from each light point to the projection surface can be accurately calculated. At the same time, the vector dot product and modulus length are used to obtain the angle between the light and the normal of the projection surface. Combined with the light intensity data provided by the light sensor, the complete set of information for each light point can be obtained, including distance, angle and light intensity. This information fully reflects the impact of the projection light source on the projection surface. The increase in light intensity means an increase in the impact value of the projection light source, the increase in distance leads to a decrease in the impact value of the projection light source, and the increase in angle will also reduce the impact value of the projection light source. This is determined by the basic laws of optics.

[0082] 2. In order to evaluate the comprehensive impact of multiple projection light sources on the projection surface, a virtual impact layer is introduced, which is located in front of the projection surface. By calculating the collective information of each light-emitting point on this impact layer and considering the superposition effect of light intensity, the impact value of multiple projection light sources for all points in the area can be obtained. This value is obtained by calculating the average of the impact values ​​of multiple projection light sources for all points in the area, which can accurately reflect the quality of the lighting effect of multiple projection light sources. The advantage of this method is that it provides a way to accurately calculate the impact value of multiple projection light sources on the projection surface. By comprehensively considering multiple factors such as light intensity, distance and angle, it provides strong support for the optimization of projection light source layout and the improvement of lighting effects. At the same time, this method also has good versatility and scalability, and is suitable for different types of light sources and projection surface shapes.

[0083] Embodiment three: The above-mentioned second embodiment can accurately evaluate the lighting effects of different projection light sources on the projection surface by comprehensively considering factors such as light intensity, distance and angle. This method not only improves the accuracy of calculation, but also provides strong support for optimizing the layout of projection light sources and improving the lighting effect. At the same time, the technical solution also has good versatility and scalability, and can be applied to different types of light sources and projection surface shapes, providing a more flexible and reliable solution for lighting design. Because the influence values ​​of multiple projection light sources calculated by simply adding and overlapping multiple projection light sources are inaccurate, the interference results are uncontrollable and the amount of calculation is large, in order to further improve the accuracy of calculating the multi-source influence values ​​and improve the display effect of the image on the projection device, step S203 of the first embodiment is now further improved: S301, according to the distance from the projection light source to the projection surface, a distance threshold is preset to divide the space into a plurality of influence layers.

[0084] Each influence layer corresponds to a specific distance range, which is used to isolate and separately calculate the influence of the projection light source within the range.

[0085] Specifically, the space is divided into multiple impact layers, including: Determine the maximum and minimum distances from the projection light source to the projection surface; According to the distance range, N distance thresholds are preset to divide the space into N+1 influence layers; Each influence layer corresponds to a specific distance range, and the i-th influence layer corresponds to the distance range [d_i,d_{i+1}).

[0086] S302: For each projection light source, a detection surface is determined according to the angle between the point position of the light source and the screen.

[0087] The detection surface is a plane parallel to the screen and containing the light source point, which is used to calculate the projection effect of the light source on a specific impact layer. For each projection light source, the angle θ between its point and the screen normal is calculated. Based on the angle θ and the light source point, a detection surface parallel to the screen and containing the light source point is determined.

[0088] S303 , in each impact layer, for each projection light source, calculate its light intensity distribution on the detection surface.

[0089] Specifically, for each projection light source, within its influence layer, calculate its distance r to any point P on the detection surface; Calculate the light intensity I_P of the light source at point P using the formula: I_P=I_0 / r^2, where I_0 is the initial light intensity of the light source and r is the distance from the light source to point P; Considering the angle θ between the light and the detection surface, the cosine value of the angle is used to adjust the light intensity to obtain the actual light intensity I_P_actual at point P. The formula is: I_P_actual=I_P*cos(θ), where cos(θ) is the cosine value of the angle between the light and the detection surface.

[0090] S304: In each influence layer, the influence values ​​of all projection light sources are superimposed to obtain the total light intensity distribution of the influence layer.

[0091] Specifically, for each impact layer, a light intensity distribution map (which can be a two-dimensional array or an image) is initialized, and all projection light sources in the impact layer are traversed. For each light source, its light intensity distribution on the detection surface is superimposed on the light intensity distribution map to obtain the total light intensity distribution map of the impact layer.

[0092] S305: Combine the total light intensity distributions of all impact layers to obtain a comprehensive impact value of the multiple projection light sources on the projection surface.

[0093] Specifically, a comprehensive light intensity distribution map (of the same size as the projection surface) is initialized, and all the impact layers are traversed. For each impact layer, its total light intensity distribution is superimposed on the comprehensive light intensity distribution map. If necessary, the comprehensive light intensity distribution map is smoothed to obtain the final comprehensive impact value of the multi-projection light source on the projection surface.

[0094] The technical solutions in the above embodiments of the present application have at least the following technical effects or advantages: 1. This technical solution also has significant computational efficiency advantages. By dividing the influence layer by presetting the distance threshold and calculating the influence of the light source separately in each influence layer, the overall calculation amount is greatly reduced. At the same time, the light intensity is adjusted using the light intensity attenuation formula and the cosine value of the angle, making the calculation process more in line with physical reality and improving the reliability of the results.

[0095] 2. This technical solution can also generate detailed light intensity distribution maps, providing strong support for optimizing light source layout and improving lighting effects. By superimposing the total light intensity distribution of each impact layer, the comprehensive impact value of multiple projection light sources on the projection surface can be obtained, which can intuitively evaluate the lighting effect and guide the adjustment of light source layout. At the same time, smoothing the comprehensive light intensity distribution map can further improve the accuracy and visualization of the results.

[0096] Embodiment 4: The above-mentioned third embodiment significantly improves the accuracy of the calculation of the impact value of multiple projection light sources by finely dividing the space into multiple impact layers and performing separate calculations for the projection light sources in each impact layer. This layered processing method effectively isolates the impact of light sources within different distance ranges, reduces the mutual interference between light sources, and makes the calculation in each impact layer more accurate and controllable. Because a single layer still has multi-angle light intensity interference, each impact layer is now partitioned, and step S301 of the first embodiment is further improved: S401, partitioning each virtual layer according to the light source at multiple angles, and calculating the angular intensity of the partitioned light source.

[0097] S402, further dividing each virtual layer into a plurality of small area partitions, each partition corresponding to a specific light source angle range.

[0098] Specifically, the virtual layer is divided into several small areas according to the projection angle of the light source (horizontal angle, vertical angle, acute angle, obtuse angle or direct geometric division). Each small area represents a specific angle range for subsequent calculation of the light source angle intensity.

[0099] S403: For each partition, calculate the angular intensity of all light sources in the partition.

[0100] In each partition, consider all light sources within the angular range of the partition. For each light source, calculate its angular intensity within the partition. This usually involves factors such as the brightness of the light source, the distance from the light source to the projection surface, and the angle between the light source and the normal of the projection surface (i.e., the angle of incidence). The calculation formula is: I_angle=I_0*cos(θ) / r^2, where I_angle represents the angular intensity of the light source in a specific partition, I_0 represents the initial light intensity or brightness of the light source, cos(θ) represents the cosine value of the angle between the light source and the normal of the projection surface, which is used to consider the effect of the incident angle on the light intensity (Lambert's cosine law), and r^2 represents the square of the distance from the light source to a point on the projection surface, which is used to consider the attenuation of light intensity with distance (inverse square law).

[0101] S404: For each virtual layer, superimpose the angular intensities of all partitions to obtain a total angular intensity distribution of the layer.

[0102] Specifically, in each virtual layer, the angle intensities calculated from all partitions are superimposed. This can be achieved through a simple addition operation, that is, the angle intensity values ​​of all light sources in each partition are added together to obtain the total angle intensity distribution of the layer. The calculation formula is: I_layer_total=ΣI_angle_i, where I_layer_total represents the total angle intensity of a virtual layer, and Σ represents the summation symbol, indicating that the angle intensities of all partitions are accumulated. I_angle_i represents the angle intensity of the i-th partition.

[0103] S405 , merging the total angular intensity distributions of all virtual layers to obtain a comprehensive angular intensity distribution of the multi-light sources projected on the projection surface.

[0104] Specifically, the total angular intensity distributions of all virtual layers are combined. This usually involves superimposing the angular intensity distributions of each layer according to its position in space to obtain a comprehensive angular intensity distribution on the entire projection surface. This step may also need to consider the mutual influence and occlusion effects between different layers. The calculation formula is: I_total=ΣI_layer_total_j, where I_total represents the comprehensive angular intensity on the projection surface, and Σ represents the summation symbol, indicating the accumulation of the total angular intensity of all virtual layers. I_layer_total_j represents the total angular intensity of the jth virtual layer.

[0105] It should be noted that I_0 and I_angle: I_0 is the initial light intensity of the light source, which is the basis for calculating I_angle. I_angle takes into account the projection angle of the light source and the light intensity after distance attenuation.

[0106] cos(θ): is the cosine value of the angle between the light source and the normal of the projection surface, and is used to adjust the light intensity to reflect the relative angle between the light and the projection surface. When the light is projected vertically (θ=0°), cos(θ)=1, and the light intensity is not affected by the angle; when the light is projected obliquely, cos(θ) decreases and the light intensity decreases accordingly.

[0107] r: is the distance from the light source to a point on the projection surface, used to calculate the attenuation of light intensity with distance. According to the inverse square law, light intensity is inversely proportional to the square of the distance.

[0108] I_layer_total and I_angle: I_layer_total is the total angular intensity of a virtual layer, which is obtained by superimposing the I_angle of all partitions in the layer.

[0109] I_total and I_layer_total: I_total is the comprehensive angular intensity on the projection surface, which is obtained by combining the I_layer_total of all virtual layers.

[0110] The technical solutions in the above embodiments of the present application have at least the following technical effects or advantages: 1. Accurately obtain the comprehensive angular intensity distribution of multiple light sources projected on the projection surface through sophisticated layering and partitioning strategies, as well as rigorous light source angle intensity calculation methods. In the specific implementation process, the virtual layer is first further subdivided into multiple small area partitions according to the projection angle of the light source, and each partition corresponds to a specific light source angle range. Subsequently, in each partition, the brightness of the light source, the distance to the projection surface, and the angle between the light source and the projection surface normal are comprehensively considered, and the angular intensity of the light source in the partition is accurately calculated using Lambert's cosine law and the inverse square law. This step not only reflects a deep understanding of the physical properties of the light source, but also ensures the accuracy and reliability of the calculation results.

[0111] 2. By superimposing the angular intensity of each partition layer by layer, the total angular intensity distribution of each virtual layer is obtained. This process is achieved through a simple addition operation, but it contains a deep understanding of the distribution and interaction of light sources in space. Finally, the total angular intensity distribution of all virtual layers is merged, and the mutual influence and occlusion effects between different layers are taken into account to finally obtain the comprehensive angular intensity distribution on the entire projection surface. This integration step not only improves the comprehensiveness of the calculation, but also makes the projection effect closer to reality, providing a solid data foundation for subsequent projection applications. The entire technical solution not only improves the calculation accuracy and efficiency, but also enhances adaptability, and can flexibly cope with various complex projection scenes and light source configurations, showing significant technical advantages and application value.

[0112] It should be noted that in the above embodiments, the description of each embodiment has its own emphasis, and for parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0113] It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Furthermore, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0114] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded computer, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0115] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0116] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0117] Although the preferred embodiments of the present invention have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present invention.

[0118] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. A projection fusion display control method, characterized in that: include: S101, obtaining a projection image and a light source influence value of a projection terminal; S102, identifying the projection surface image to obtain a display template corresponding to the projection surface image; S103, considering the impact value of the flatness of the projection surface, detecting the ranging flatness and generating display parameters; S104, performing regional picture correction on the image based on the display template and the display parameters; S105, fusing the corrected images to generate a final image display frame for projection display.

2. The projection fusion display control method according to claim 1, characterized in that: The step S101, obtaining the light source influence value, includes: Use a light meter to measure the ambient light intensity in the projection area; Identify the source of ambient light by analyzing spectral characteristics; During projection, continuously monitor changes in ambient light; Conduct detailed analysis of the collected data.

3. The projection fusion display control method according to claim 2 is characterized in that: The collected data is analyzed in detail, including: According to the data provided by the light sensor, the intensity value I of the ambient light can be obtained, usually in lux Lx; Using image processing technology, the color components R, G, and B of light are extracted from the image captured by the camera. These components represent the intensity of red, green, and blue light respectively; Based on the collected light intensity I and color components R, G, B, calculate the impact of light on the projection effect; this includes the brightness adjustment coefficient and color correction coefficients ; and is a constant coefficient, I is the light intensity measured by the light sensor, D is the desired projection brightness, R, G, B are the color components of the light captured by the camera, , , It is the color output value of the projection device under standard lighting conditions; Calculate the light source influence value I_env: Among them, I_ambient represents the average intensity of ambient light, which can be measured by a light intensity meter; I_direct represents the intensity of light directly irradiated on the projection surface.

4. The projection fusion display control method according to claim 1, characterized in that: The S103, ranging flatness detection method, comprises: Use a high-precision laser rangefinder as a measuring tool and calibrate the rangefinder; Evenly arrange multiple measuring points on the projection surface and record the position information of each measuring point; Use a distance meter to measure the distance of each measuring point, record the actual distance value of each point, and at the same time, record the initial distance between the distance meter and the projection surface as the reference distance; Compare the actual distance value of each measuring point with the reference distance, and calculate the flatness deviation δ of each point; the flatness deviation can be calculated by the formula: δ=|actual distance-reference distance|; According to the flatness deviation δ, the distance adjustment value Δd is calculated, and Δd=h(δ), where h is a function for calculating the distance adjustment value according to the flatness deviation; Projection surface flatness influence value formula: Where n is the number of measurement points, is the flatness deviation of the i-th measuring point, It is the maximum value of the distance adjustment value among all measurement points, which is used to normalize the flatness deviation.

5. The projection fusion display control method according to claim 1, characterized in that: The S101 further includes: S201, calibrating the coordinates of the light-emitting points for different types of light sources; S202, calculating the distance, angle and light intensity from each luminous point coordinate to the projection surface and recording them as luminous point set information; S203, merging and calculating the information of each light-emitting point set in the influence layer to obtain the influence value of the superposition of multiple projection light sources.

6. The projection fusion display control method according to claim 5, characterized in that: The luminous point set information includes: The calculation formula of the luminous point set information L_effect is as follows: The distance calculation uses the distance formula in three-dimensional space to calculate the vertical distance from each light point to the projection surface. The formula is as follows: , where (x1, y1, z1) are the coordinates of the light-emitting point, and (x2, y2, z2) are the coordinates of a point on the projection surface; The angle is calculated by using the vector dot product and the modulus to calculate the cosine value of the angle. The angle is then obtained by the inverse cosine function. The formula is as follows: , is the direction vector of the light from the emitting point, is the normal vector of the projection surface; The light intensity data provided by the light sensor is recorded as I.

7. The projection fusion display control method according to claim 5, characterized in that: The S203 includes: The impact layer is a virtual layer that is located in front of the projection surface; Assume that region R contains m points, then the multi-projection light source impact value of region R is It can be expressed as the average of the multi-projection light source influence values ​​of all points in the area: .

8. The projection fusion display control method according to claim 5, characterized in that: The S203 further includes: S301, according to the distance from the projection light source to the projection surface, a distance threshold is preset to divide the space into multiple influence layers; S302, for each projection light source, determine a detection surface according to the angle between its point position and the screen; S303, in each impact layer, for each projection light source, calculating its light intensity distribution on the detection surface; S304, in each influence layer, superimposing the influence values ​​of all projection light sources to obtain the total light intensity distribution of the influence layer; S305: Combine the total light intensity distributions of all impact layers to obtain a comprehensive impact value of the multiple projection light sources on the projection surface.

9. The projection fusion display control method according to claim 8, characterized in that: The step S301 divides the space into a plurality of influence layers, including: Determine the maximum and minimum distances from the projection light source to the projection surface; According to the distance range, N distance thresholds are preset to divide the space into N+1 influence layers; Each influence layer corresponds to a specific distance range, and the i-th influence layer corresponds to the distance range [d_i,d_{i+1}).

10. The projection fusion display control method according to claim 8, characterized in that: The S301 further includes: S401, partitioning each virtual layer according to multiple angles of the light source, and calculating the angular intensity of the partitioned light source; S402, further dividing each virtual layer into a plurality of small area partitions, each partition corresponding to a specific light source angle range; S403, for each partition, calculating the angular intensity of all light sources in the partition; S404, for each virtual layer, superimposing the angular intensities of all partitions to obtain a total angular intensity distribution of the layer; S405 , merging the total angular intensity distributions of all virtual layers to obtain a comprehensive angular intensity distribution of the multi-light sources projected on the projection surface.

Images