Image enhancement processing method, device, terminal and medium for spherical screen display
By performing three-dimensional processing and enhancement processing on the displayed image, the accuracy and effect problems of the LED dome screen display when displaying in the ball are solved, and a higher quality dome screen image display is achieved.
Patent Information
- Application Number
- CN202510096346.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2025-01-22
- Publication Date
- 2025-05-23
- Estimated Expiration
- 2045-01-22
AI Technical Summary
When the LED dome screen is displayed in the ball, the display effect is reduced and the image accuracy is low.
By obtaining the first attribute information of the target spherical screen, three-dimensional processing of the image to be displayed is obtained, and the reference display image is enhanced, the target display image is obtained, and the target display image is finally displayed through the target spherical screen.
Improve the accuracy of dome screen image display, improve the display effect, and provide a higher quality visual experience.
Smart Images

Figure CN119559038B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of spherical screen display and image processing technology, and in particular to an image enhancement image processing method, device, terminal and medium for spherical screen display. Background Art
[0002] With the development of science and technology, spherical screens are increasingly used in a variety of image and video display scenarios. At present, the playback mode of LED spherical screens mostly adopts the combination playback mode of image sequence frames. For example, since the display area of LED spherical screens is very large, multiple images are usually collected when the original display image is collected and fused for display. In the existing scheme, the fused image is usually displayed directly. However, since the LED spherical screen displays the image in the sphere, the display effect will be reduced, resulting in low accuracy when displaying the image. Summary of the invention
[0003] The embodiments of the present application provide an image enhancement processing method, device, terminal and medium for a spherical screen display, which can perform three-dimensional processing on an image to be displayed and then perform enhancement processing to obtain a target display image, and finally display the target display image, thereby improving the accuracy of spherical screen image display.
[0004] A first aspect of an embodiment of the present application provides an image enhancement processing method for a spherical screen display, the method comprising:
[0005] Obtaining the first attribute information of the target ball screen;
[0006] Performing three-dimensional processing on the image to be displayed according to the first attribute information to obtain a reference display image;
[0007] Performing enhancement processing on the reference display image to obtain a target display image;
[0008] The target display image is displayed through the target ball screen.
[0009] In a possible implementation, the step of performing enhancement processing on the reference display image to obtain a target display image includes:
[0010] Extracting second attribute information of the LED display module of the target ball screen from the first attribute information;
[0011] Splitting the reference display image according to the second attribute information of the LED display module to obtain k sub-reference display images;
[0012] Obtaining light beam divergence direction information of the LED display module corresponding to k sub-reference display images, and obtaining k light beam divergence direction information;
[0013] Determine the initial display interference information when the corresponding sub-reference display image is being displayed based on the k beam divergence direction information, and obtain k initial display interference information;
[0014] Determine the display enhancement information of the k sub-reference display images based on the k initial display interference information and the pixel values of the k sub-reference display images, and obtain k display enhancement information;
[0015] Use the k display enhancement information to perform enhancement processing on the corresponding sub-reference display images, and obtain k sub-target display images;
[0016] Perform a combination process on the k sub-target display images to obtain the target display image.
[0017] In a possible implementation manner, the determining the beam divergence direction corresponding to each LED display module according to the second attribute information of the LED display module includes:
[0018] Obtain the second attribute information of the LED display module to determine the light emission direction information of the peripheral LED lamp beads of each LED display module, and obtain a first set of light emission direction information;
[0019] Determine the edge beam divergence information of each LED display module according to the first set of light emission direction information;
[0020] Determine the central beam direction information of each LED display module according to the second attribute information of the LED display module, and obtain a set of central beam direction information;
[0021] Determine the beam divergence direction corresponding to each LED display module according to the central beam direction information in the set of central beam direction information and the corresponding edge beam divergence information.
[0022] In a possible implementation manner, the determining the initial display interference information when the corresponding sub-reference display image is being displayed based on the k beam divergence direction information, and obtaining k initial display interference information includes:
[0023] Determine the beam overlap information between the corresponding LED display modules according to the k beam divergence direction information, and obtain k sets of beam overlap information;
[0024] Determine the initial display interference information when the corresponding reference display image is being displayed according to the k sets of beam overlap information, and obtain k initial display interference information.
[0025] In a possible implementation manner, the determining the display enhancement information of the k sub-reference display images based on the k initial display interference information and the pixel values of the k sub-reference display images, and obtaining k display enhancement information includes:
[0026] determining a display brightness value of a first sub-reference display image according to a pixel value of the first sub-reference display image, wherein the first sub-reference display image is any one of the k sub-reference display images;
[0027] Determining intermediate display interference information according to the display brightness value and the corresponding initial display interference information;
[0028] determining the display enhancement information according to the intermediate display interference information;
[0029] Repeat the above method of determining the display brightness value of the first sub-reference display image according to the pixel value of the first sub-reference display image, and determining the display enhancement information according to the intermediate display interference information, until the display enhancement information of k sub-reference display images is obtained, and k display enhancement information is obtained.
[0030] A second aspect of an embodiment of the present application provides an image enhancement image processing device for a spherical screen display, the device comprising:
[0031] An acquisition unit, used for acquiring first attribute information of a target spherical screen;
[0032] A processing unit, configured to perform three-dimensional processing on the image to be displayed according to the first attribute information to obtain a reference display image;
[0033] An enhancement unit, used for performing enhancement processing on the reference display image to obtain a target display image;
[0034] The display unit is used to display the target display image through the target ball screen.
[0035] In a possible implementation, the enhancement unit is specifically configured to:
[0036] Extracting second attribute information of the LED display module of the target ball screen from the first attribute information;
[0037] Splitting the reference display image according to the second attribute information of the LED display module to obtain k sub-reference display images;
[0038] Obtaining light beam divergence direction information of the LED display module corresponding to k sub-reference display images, and obtaining k light beam divergence direction information;
[0039] Determine initial display interference information of the corresponding sub-reference display image when displaying according to the k light beam divergence direction information, and obtain k initial display interference information;
[0040] Determine display enhancement information of k sub-reference display images according to k initial display interference information and pixel values of k sub-reference display images, to obtain k display enhancement information;
[0041] Using k display enhancement information to enhance the corresponding sub-reference display images, to obtain k sub-target display images;
[0042] The k sub-target display images are combined to obtain the target display image.
[0043] In a possible implementation, in determining the light beam divergence direction corresponding to each LED display module according to the second attribute information of the LED display module, the enhancement unit is specifically used to:
[0044] Acquire the second attribute information of the LED display module to determine the light emitting direction information of the peripheral LED lamp beads of each LED display module, and obtain a first light emitting direction information set;
[0045] Determine edge light beam divergence information of each LED display module according to the first light emitting direction information set;
[0046] Determine the central light beam direction information of each LED display module according to the second attribute information of the LED display module, and obtain a central light beam direction information set;
[0047] The light beam divergence direction corresponding to each LED display module is determined according to the central light beam direction information and the corresponding edge light beam divergence information in the central light beam direction information set.
[0048] In a possible implementation, in determining the initial display interference information of the corresponding sub-reference display image when displaying according to the k light beam divergence direction information to obtain the k initial display interference information, the enhancement unit is specifically used to:
[0049] Determine the beam overlap information between the corresponding LED display modules according to the k beam divergence direction information, and obtain k beam overlap information sets;
[0050] Initial display interference information when the corresponding reference display image is displayed is determined according to the k light beam overlap information sets to obtain k initial display interference information.
[0051] In a possible implementation, the display enhancement information of the k sub-reference display images is determined according to the k initial display interference information and the pixel values of the k sub-reference display images to obtain the k display enhancement information, and the enhancement unit is specifically used to:
[0052] determining a display brightness value of a first sub-reference display image according to a pixel value of the first sub-reference display image, wherein the first sub-reference display image is any one of the k sub-reference display images;
[0053] Determining intermediate display interference information according to the display brightness value and the corresponding initial display interference information;
[0054] determining the display enhancement information according to the intermediate display interference information;
[0055] Repeat the above method of determining the display brightness value of the first sub-reference display image according to the pixel value of the first sub-reference display image, and determining the display enhancement information according to the intermediate display interference information, until the display enhancement information of k sub-reference display images is obtained, and k display enhancement information is obtained.
[0056] A third aspect of an embodiment of the present application provides a terminal, comprising a processor, an input device, an output device and a memory, wherein the processor, input device, output device and memory are interconnected, wherein the memory is used to store a computer program, the computer program comprises program instructions, and the processor is configured to call the program instructions to execute the step instructions in the first aspect of the embodiment of the present application.
[0057] The fourth aspect of the embodiments of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program for electronic data exchange, wherein the computer program enables a computer to execute part or all of the steps described in the first aspect of the embodiments of the present application.
[0058] A fifth aspect of the embodiments of the present application provides a computer program product, wherein the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute some or all of the steps described in the first aspect of the embodiments of the present application. The computer program product may be a software installation package.
[0059] The implementation of the embodiments of the present application has the following beneficial effects:
[0060] By acquiring the first attribute information of the target spherical screen, the image to be displayed is three-dimensionally processed according to the first attribute information to obtain a reference display image, the reference display image is enhanced to obtain a target display image, and the target display image is displayed through the target spherical screen. Therefore, the image to be displayed can be three-dimensionally processed and then enhanced to obtain a target display image, and finally the target display image is displayed, thereby improving the accuracy of spherical screen image display. BRIEF DESCRIPTION OF THE DRAWINGS
[0061] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0062] Figure 1 A flowchart of an image enhancement image processing method for a spherical screen display is provided for an embodiment of the present application;
[0063] Figure 2 A schematic diagram of the structure of a terminal provided in an embodiment of the present application;
[0064] Figure 3 A structural schematic diagram of an image enhancement image processing device for a spherical screen display is provided for an embodiment of the present application. DETAILED DESCRIPTION
[0065] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0066] The terms "first", "second", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes steps or units that are not listed, or optionally includes other steps or units inherent to these processes, methods, products or devices.
[0067] Reference to "embodiments" in this application means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described in this application may be combined with other embodiments.
[0068] In order to better understand the image enhancement processing method for a spherical screen display provided in an embodiment of the present application, the image enhancement processing method for a spherical screen display in an existing solution is briefly introduced below. In the existing solution, when performing a spherical screen display, the image after fusion processing is usually displayed directly. Because the special curved surface structure of the spherical screen is not fully considered, the image is easily stretched, deformed and distorted when mapped to the spherical surface, and the clarity and proportion of each area of the picture are unbalanced; there is a lack of targeted optimization for different viewing angles and viewing distances, and there will be blurring, color distortion, content occlusion, etc. when viewing at a specific viewing angle or distance; the reflection and scattering characteristics of light inside the spherical screen are not considered, resulting in uneven distribution of image contrast and brightness, which seriously affects the display accuracy and visual effects, and it is difficult to provide a high-quality, high-fidelity visual experience.
[0069] In order to solve the above-mentioned problems, an embodiment of the present application provides an image enhancement image processing method for a spherical screen display, which can fuse and three-dimensionally process the image to be displayed, and directly display the three-dimensional target display image, thereby improving the accuracy of the spherical screen image display and improving the display effect.
[0070] See also Figure 1 , Figure 1 The present invention provides a flowchart of an image enhancement method for a spherical screen display. Figure 1 As shown, the method includes:
[0071] 101. Obtain first attribute information of the target spherical screen.
[0072] The first attribute information may be used to indicate a collection of various characteristic parameters and related description information related to the target ball screen. The first attribute information may include, but is not limited to, the geometric shape characteristics of the ball screen, such as size (radius, diameter, etc.), curvature (the overall spherical curvature, the curvature change in different regions, etc.), the optical properties of the display material used (such as transmittance, reflectivity, etc.), and the specific properties of the light-emitting diode (LED) display module constituting the ball screen display, such as the distribution density of LED lamp beads, the luminous intensity of a single LED lamp bead, the arrangement of LED display modules in different regions, the size specifications of each module, etc.
[0073] By acquiring the first attribute information of the target spherical screen, the image can be processed specifically according to the characteristics of the spherical screen in subsequent steps, and how to adapt and adjust the image can be determined based on the first attribute information to achieve a better display effect.
[0074] 102. Perform three-dimensional processing on the image to be displayed according to the first attribute information to obtain a reference display image.
[0075] The camera can be used to capture multiple sets of static images of real scenes to obtain images to be displayed. Optionally, four cameras can be used to capture static images of the target scene, and the four cameras can respectively capture images of four different areas in the target scene to obtain four images to be displayed, which is not limited in this application.
[0076] The reference display image can be an intermediate product obtained after the image to be displayed is processed into three dimensions. The reference display image can be based on the first attribute information of the target dome (such as the geometric shape, curvature, distribution of LED display modules, etc. of the dome), converting the two-dimensional image to be displayed into an image form that adapts to the three-dimensional surface of the dome. The reference display image is the basis for subsequent enhancement processing and provides a preliminary reference data for adapting to the shape of the dome for further optimizing the display effect.
[0077] Based on the first attribute information of the target spherical screen obtained, corresponding deformation, mapping and other operations are performed, and a three-dimensional conversion operation can be performed on the image to be displayed, so that the original two-dimensional plane image can fit the three-dimensional curved surface structure of the spherical screen. For example, according to the curvature changes at different positions of the spherical screen, various parts of the image are stretched, twisted and adjusted, so that each element of the image can fit naturally and accurately on the surface of the spherical screen after processing, avoiding image deformation and distortion caused by shape mismatch when the plane image is directly projected onto the spherical screen, thereby generating a reference display image that can be displayed relatively reasonably on the spherical screen, which can lay the foundation for further optimization of the display effect in the future.
[0078] 103. Perform enhancement processing on the reference display image to obtain a target display image.
[0079] Among them, the target display image can be used to indicate the image generated after a series of operations such as three-dimensional processing and enhancement processing. The target display image fully considers the various characteristics of the target ball screen and the interference factors that may appear during the display process. Compared with the original image to be displayed, it has significantly improved in terms of fitting the ball screen shape and picture display quality. It is the final image version that can be used for display on the target ball screen and can bring high-quality visual experience to viewers.
[0080] After obtaining the reference display image, in order to overcome various factors that may affect the display effect in the ball screen display, optimization operations can be performed on the image, such as enhancement processing, to comprehensively consider multiple factors, such as the second attribute information of the LED display module, the direction of light beam divergence, and the resulting display interference information. Optionally, the reference display image can be split, the display conditions corresponding to each part can be analyzed, the pixel value, brightness, contrast and other attributes of each area of the image can be adjusted in a targeted manner, and the image can be compensated and corrected to improve the overall display quality of the image, reduce problems such as uneven brightness and color deviation caused by overlapping light, and finally obtain an optimized target display image, so that it can present a clearer, more accurate, and better visual effect when displayed on the ball screen.
[0081] 104. Display the target display image through the target ball screen.
[0082] The target display image obtained through the above steps is presented using the target spherical screen as a specific display carrier. Optionally, the corresponding display control system can be used to accurately map the pixel information of the target display image to the corresponding positions on the spherical screen. With the help of the display function of the spherical screen, the image can be displayed with the expected high-quality effect, so that the viewer can see the optimized spherical screen image, completing the complete process from image preparation to final display.
[0083] In this example, by acquiring the first attribute information of the target spherical screen, the image to be displayed is three-dimensionally processed according to the first attribute information to obtain a reference display image, the reference display image is enhanced to obtain a target display image, and the target display image is displayed through the target spherical screen. Therefore, the image to be displayed can be three-dimensionally processed and then enhanced to obtain a target display image, and finally the target display image is displayed, thereby improving the accuracy of spherical screen image display.
[0084] In a possible implementation, this example uses four images to be displayed as an example for illustration. Specifically, a method for performing enhancement processing on the reference display image to obtain a target display image may include the following steps:
[0085] A1. extracting second attribute information of the LED display module of the target ball screen from the first attribute information;
[0086] A2. Split the reference display image according to the second attribute information of the LED display module to obtain k sub-reference display images;
[0087] A3, obtaining the light beam divergence direction information of the LED display module corresponding to k sub-reference display images, and obtaining k light beam divergence direction information;
[0088] A4, determining initial display interference information of the corresponding sub-reference display image when it is displayed according to the k light beam divergence direction information, and obtaining k initial display interference information;
[0089] A5. Determine display enhancement information of k sub-reference display images according to the k initial display interference information and the pixel values of the k sub-reference display images to obtain k display enhancement information;
[0090] A6. Use k display enhancement information to enhance the corresponding sub-reference display images to obtain k sub-target display images;
[0091] A7. Combining the k sub-target display images to obtain the target display image.
[0092] Among them, the second attribute information of the LED display module of the target ball screen can be used to describe a set of parameters related to the characteristics of the LED display module in the target ball screen. The second attribute information of the LED display module can include but is not limited to the detailed characteristics of the LED display module in terms of physical structure, optical performance, etc., such as the arrangement and layout of LED lamp beads in the module (whether they are evenly distributed or arranged in a specific pattern), the density of the lamp beads (the number of lamp beads contained per unit area, which affects the fineness of the display and the uniformity of brightness), the luminous intensity of a single LED lamp bead (determines the brightness of its own light), the luminous angle range (reflects the angle of light divergence, affecting the coverage and interaction of light), and the splicing method between each LED display module (how to combine together to form a complete ball screen display surface, affecting the coherence of the image) and the size of the module itself (modules of different sizes have different effects on image segmentation and display effects), etc.
[0093] According to the extracted second attribute information of the LED display module, the three-dimensionally processed reference display image can be split to obtain k sub-reference display images. The k sub-reference display images can be understood as multiple local images. Since different LED display modules on the spherical screen have different performances and influences when displaying images, subdividing the overall reference display image according to the LED display modules can more accurately analyze the specific situation faced by the image corresponding to each local area in the subsequent display process, which is convenient for subsequent differentiated processing according to the characteristics of each module, so that each sub-reference display image can be better adapted to the corresponding LED display module.
[0094] For each LED display module corresponding to a sub-reference display image, its light beam divergence direction information is obtained, and k light beam divergence direction information can be obtained. The k light beam divergence direction information can be used to indicate the specific direction in which the light beam emitted by each LED display module spreads outward. Because when the LED lamp beads emit light, their light is not absolutely parallel, but has a certain divergence angle. Different LED display modules have different light beam divergence directions due to factors such as their internal lamp bead layout and the characteristics of the lamp beads themselves. Accurately grasping the light beam divergence direction information can more accurately judge the propagation and interaction of light in the spherical screen and the impact on image display, which is conducive to better analysis of display interference in the future.
[0095] Based on the beam divergence direction information of the LED display module corresponding to each sub-reference display image, the interference situation caused by the most initial and direct influence of light propagation during the image display process is analyzed, and k initial display interference information can be obtained. For example, when the light beams of different LED display modules overlap after divergence, the overlapping area may cause uneven brightness (may be too bright or too dark), mixed color deviation, etc., or some areas may appear darker due to insufficient light exposure. The above-mentioned information related to various phenomena caused by light propagation and interaction that are not conducive to normal and high-quality display of images is the initial display interference information. Through the initial display interference information, it is possible to clarify the key issues that need to be solved in the subsequent image enhancement processing.
[0096] The k display enhancement information can be understood as a set of related information used to optimize and enhance the sub-reference display image in a targeted manner after comprehensively considering the initial display interference information of the sub-reference display image and the pixel value characteristics of the sub-reference display image itself. The display enhancement information may include but is not limited to specific parameters or strategies for brightness adjustment, color correction, clarity optimization, and other aspects of the image.
[0097] The k optimized local images obtained after enhancing each sub-reference display image using the corresponding display enhancement information can be used as the above-mentioned k sub-target display images. It can be understood that compared with the original sub-reference display image, the sub-target display image overcomes the display interference problem analyzed previously, and its brightness is more uniform and reasonable, the color is more accurate and realistic, and the image is clearer and sharper. It can better adapt to the display requirements of the corresponding LED display module on the dome screen, and lay a good local foundation for the final integration to form a high-quality target display image.
[0098] The target display image is the complete image obtained by combining all enhanced sub-target display images according to their original corresponding position relationship and splicing order on the ball screen. The target display image can comprehensively consider the characteristics of different LED display modules on the ball screen and possible display interference. After layer-by-layer optimization, it can present better visual effects when displayed on the target ball screen, effectively improving the quality and accuracy of image display.
[0099] In a possible implementation, a method for determining the light beam divergence direction corresponding to each LED display module according to the second attribute information of the LED display module may include the following steps:
[0100] B1. Obtain the second attribute information of the LED display module to determine the light emitting direction information of the peripheral LED lamp beads of each LED display module, and obtain a first light emitting direction information set;
[0101] B2. Determine the edge light beam divergence information of each LED display module according to the first light emitting direction information set;
[0102] B3. Determine the central light beam direction information of each LED display module according to the second attribute information of the LED display module, and obtain a central light beam direction information set;
[0103] B4. Determine the beam divergence direction corresponding to each LED display module according to the central beam direction information and the corresponding edge beam divergence information in the central beam direction information set.
[0104] By analyzing the second attribute information of the LED display module, the light emission direction of the peripheral LED lamp beads of each LED display module is obtained, and the above-mentioned first light emission direction information set can be obtained. Among them, the first light emission direction information set can include the light emission direction vector of each peripheral LED lamp bead, and the direction vector can represent the light emission direction of the lamp bead in a coordinate system. For example, in a two-dimensional rectangular coordinate system, the two components of the vector can represent the angle relationship between the light emission direction and the coordinate axis, and this application does not limit this.
[0105] Based on the first light emitting direction information set, the outward diffusion of the light beam in the edge area of the LED display module is further determined, and the edge light beam divergence information of each LED display module mentioned above can be obtained. The edge light beam divergence information may include information such as the direction trend and degree of divergence of the light beam in the edge area. Among them, the degree of divergence can be measured in many ways, such as the angle between the light emitting direction vectors of adjacent lamp beads, the change in the range covered by the light after a certain propagation distance, etc., and this application does not limit this.
[0106] By analyzing the distribution characteristics of LED lamp beads in the central area of the LED display module, the light emission direction and other attribute information, and calculating (such as weighted average method), a set of light beam direction vectors representing the central area can be obtained. The light beam direction vector representing the central area can describe the main emission direction of the light in the central area of each LED display module, and can reflect the main trend of light propagation in the central part of the module.
[0107] For each LED display module, a comprehensive analysis is performed in combination with its central beam direction information and edge beam divergence information. For example, taking the central beam direction as a reference and considering the influence of the edge beam divergence information on the overall beam divergence morphology, a beam divergence model can be constructed with the central beam direction as the axis of symmetry and the left and right sides gradually opening outward at a certain angle. Optionally, a mathematical function can be used to describe the above beam divergence direction, such as using a polar coordinate equation, with the center of the LED display module as the pole and the central beam direction as the polar axis direction, and determining the parameters in the function according to the edge beam divergence angle, thereby accurately representing the beam divergence direction corresponding to the LED display module.
[0108] The above-mentioned beam divergence direction can comprehensively describe the propagation trend of the light emitted by each LED display module in space, which is conducive to more accurately analyzing the interaction between the light beams of different modules and the impact on image display in the subsequent process, and helps to determine more accurate display interference information and perform more precise image enhancement processing.
[0109] In a possible implementation, a method for determining initial display interference information of a corresponding sub-reference display image when displaying the image according to k light beam divergence direction information to obtain k initial display interference information may include the following steps:
[0110] C1. Determine the beam overlap information between the corresponding LED display modules according to the k beam divergence direction information, and obtain a set of k beam overlap information;
[0111] C2. Determine initial display interference information when the corresponding reference display image is displayed according to the k light beam overlap information sets, and obtain k initial display interference information.
[0112] Based on the analysis of the k light beam divergence direction information, k light beam overlap information sets can be obtained to describe the intersection and overlap of light between the LED display modules corresponding to each sub-reference display image. Since the light beams emitted by each LED display module have their own specific divergence direction, in a spatial environment such as a dome screen, the light beams emitted by different modules may intersect together, and the k light beam overlap information sets can be used to specifically describe the intersection.
[0113] Further analysis based on the above-mentioned k sets of light beam overlap information can determine the relevant information used to describe the interference to the normal display of the image caused by the mutual overlap between light beams and other possible light propagation problems when the reference display image is displayed, that is, the above-mentioned k initial display interference information. The initial display interference information can cover multiple aspects of information, such as abnormal brightness caused by the superposition of light in the overlapping area (it may be too bright so that some details of the image are lost, or the light is unevenly mixed, causing local overbrightness or local overdarkness, etc.), color deviation (the overlapping and mixing of light beams of different colors changes the original color of the image, making the color inaccurate), and unclear image display and dark areas caused by the lack of light coverage or uneven coverage in certain areas.
[0114] For example, if the red and blue LED light beams in a certain overlapping area overlap more, the original image in this area should be displayed as green, but after mixing, it becomes cyan. This situation may be interference information regarding color deviation. If in an image area that should be displayed evenly and brightly, an obviously too bright light spot appears due to the overlapping of light beams, making it impossible to see the image details in this area, this situation may be interference information regarding brightness, and the present application does not impose any restrictions on this.
[0115] In this example, by determining k initial display interference information, various display problems caused by the divergence and overlap of light beams of each LED display module of the dome screen can be comprehensively and meticulously analyzed, so as to provide highly targeted data for subsequent image enhancement processing, so that during the correction process, targeted processing can be performed according to the specific interference conditions of each sub-reference display image, thereby effectively improving the brightness uniformity, color accuracy and detail clarity of the image when displayed on the dome screen, greatly enhancing the optimization accuracy of image display effects and visual experience, and allowing the dome screen display system to adapt to complex light propagation environments more intelligently and accurately, laying a solid foundation for presenting high-quality and high-fidelity images.
[0116] In a possible implementation, a method for determining display enhancement information of k sub-reference display images according to k initial display interference information and pixel values of k sub-reference display images to obtain k display enhancement information may include the following steps:
[0117] D1. determining a display brightness value of a first sub-reference display image according to a pixel value of the first sub-reference display image, where the first sub-reference display image is any one of the k sub-reference display images;
[0118] D2. determining intermediate display interference information according to the display brightness value and the corresponding initial display interference information;
[0119] D3. determining the display enhancement information according to the intermediate display interference information;
[0120] D4. Repeat the above method of determining the display brightness value of the first sub-reference display image according to the pixel value of the first sub-reference display image, and determining the display enhancement information according to the intermediate display interference information, until the display enhancement information of k sub-reference display images is obtained, and k display enhancement information is obtained.
[0121] This embodiment takes the processing of the first sub-reference display image as an example for illustration, and does not constitute a limitation on the present application. A specific algorithm or calculation rule can be used to extract relevant data about brightness from these pixel values, and then determine the display brightness value of the first sub-reference display image. For example, the brightness components of each pixel in the image (in some color spaces such as the Red-Green-Blue (RGB) color space, the brightness can be calculated from the three components of red, green, and blue by a specific formula) can be weighted averaged and the brightness values of all pixels can be merged to obtain a value that can represent the overall brightness of the first sub-reference display image, that is, the above-mentioned display brightness value.
[0122] After obtaining the display brightness value of the first sub-reference display image, the initial display interference information for the sub-reference display image obtained from the previous analysis (such as brightness anomalies and color deviations caused by light beam overlap) can be combined to further analyze and determine the intermediate display interference information, so as to comprehensively consider the original brightness state of the image and the interference caused by various light factors, so as to more accurately quantify the actual impact of these interferences on the image display.
[0123] Further, according to the intermediate display interference information obtained through analysis, corresponding strategies are formulated and specific adjustment parameters are determined, that is, the above-mentioned display enhancement information is determined. The display enhancement information can eliminate or reduce the adverse effects on the image display quality described by the intermediate display interference information through certain image processing means, such as adjusting brightness, color correction, image sharpening, etc., so that the first sub-reference display image can achieve better effects in subsequent display.
[0124] It is understandable that for each of the k sub-reference display images, the above series of operations from determining the display brightness value, to determining the intermediate display interference information in combination with the initial display interference information, and then to determining the display enhancement information can be performed. By processing each sub-reference display image in turn until the relevant calculation and analysis of all the sub-reference display images in the k sub-reference display images are completed, k display enhancement information corresponding to the k sub-reference display images can be obtained, so as to provide a comprehensive and accurate basis for the subsequent targeted enhancement processing of each sub-reference display image, which is conducive to improving the overall image display effect.
[0125] In this example, the display brightness value is determined by the pixel value, so that the original brightness state of the sub-reference display image can be quantified, providing basic data for subsequent processing; the intermediate display interference information is determined in combination with the initial display interference information, so that the actual degree of interference of the image can be accurately analyzed, so as to comprehensively consider the brightness of the image itself and the interference factors; the display enhancement information is determined according to the intermediate display interference information, so that an optimization strategy can be formulated for each sub-reference display image in a targeted manner to ensure that the display problem is effectively corrected; these steps are repeated for all sub-reference display images to obtain k display enhancement information, so as to achieve comprehensive and accurate enhancement of the entire image, thereby effectively improving the overall display quality of the image on the dome screen.
[0126] For the above embodiments, please refer to Figure 2 , Figure 2 A schematic diagram of the structure of a terminal provided in an embodiment of the present application, such as Figure 2 As shown, it includes a processor, an input device, an output device and a memory, which are connected to each other, wherein the memory is used to store a computer program, the computer program includes program instructions, the processor is configured to call the program instructions, and the program includes instructions for executing the following steps;
[0127] Obtaining the first attribute information of the target ball screen;
[0128] Performing three-dimensional processing on the image to be displayed according to the first attribute information to obtain a reference display image;
[0129] Performing enhancement processing on the reference display image to obtain a target display image;
[0130] The target display image is displayed through the target ball screen.
[0131] The above mainly introduces the scheme of the embodiment of the present application from the perspective of the execution process on the method side. It is understandable that in order to realize the above functions, the terminal includes a hardware structure and / or software module corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of each example described in the embodiments provided herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0132] The embodiment of the present application can divide the terminal into functional units according to the above method example. For example, each functional unit can be divided according to each function, or two or more functions can be integrated into one processing unit. The above integrated unit can be implemented in the form of hardware or in the form of software functional units. It should be noted that the division of units in the embodiment of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation.
[0133] In line with the above, see Figure 3 , Figure 3 The present invention provides a schematic diagram of the structure of an image enhancement image processing device for a spherical screen display. Figure 3 As shown, the device comprises:
[0134] An acquisition unit 301 is used to acquire first attribute information of a target spherical screen;
[0135] A processing unit 302 is used to perform three-dimensional processing on the image to be displayed according to the first attribute information to obtain a reference display image;
[0136] The enhancement unit 303 is used to perform enhancement processing on the reference display image to obtain a target display image;
[0137] The display unit 304 is used to display the target display image through the target ball screen.
[0138] In a possible implementation, the enhancement unit 303 is specifically configured to:
[0139] Extracting second attribute information of the LED display module of the target ball screen from the first attribute information;
[0140] Splitting the reference display image according to the second attribute information of the LED display module to obtain k sub-reference display images;
[0141] Obtaining light beam divergence direction information of the LED display module corresponding to k sub-reference display images, and obtaining k light beam divergence direction information;
[0142] Determine initial display interference information of the corresponding sub-reference display image when displaying according to the k light beam divergence direction information, and obtain k initial display interference information;
[0143] Determine display enhancement information of k sub-reference display images according to k initial display interference information and pixel values of k sub-reference display images, to obtain k display enhancement information;
[0144] Using k display enhancement information to enhance the corresponding sub-reference display images, to obtain k sub-target display images;
[0145] The k sub-target display images are combined to obtain the target display image.
[0146] In a possible implementation, in determining the light beam divergence direction corresponding to each LED display module according to the second attribute information of the LED display module, the enhancing unit 303 is specifically configured to:
[0147] Acquire the second attribute information of the LED display module to determine the light emitting direction information of the peripheral LED lamp beads of each LED display module, and obtain a first light emitting direction information set;
[0148] Determine edge light beam divergence information of each LED display module according to the first light emitting direction information set;
[0149] Determine the central light beam direction information of each LED display module according to the second attribute information of the LED display module, and obtain a central light beam direction information set;
[0150] The light beam divergence direction corresponding to each LED display module is determined according to the central light beam direction information and the corresponding edge light beam divergence information in the central light beam direction information set.
[0151] In a possible implementation, in determining the initial display interference information of the corresponding sub-reference display image when displaying according to the k light beam divergence direction information to obtain the k initial display interference information, the enhancing unit 303 is specifically used to:
[0152] Determine the beam overlap information between the corresponding LED display modules according to the k beam divergence direction information, and obtain k beam overlap information sets;
[0153] Initial display interference information when the corresponding reference display image is displayed is determined according to the k light beam overlap information sets to obtain k initial display interference information.
[0154] In a possible implementation, in determining the display enhancement information of the k sub-reference display images according to the k initial display interference information and the pixel values of the k sub-reference display images to obtain the k display enhancement information, the enhancement unit 303 is specifically configured to:
[0155] determining a display brightness value of a first sub-reference display image according to a pixel value of the first sub-reference display image, wherein the first sub-reference display image is any one of the k sub-reference display images;
[0156] Determining intermediate display interference information according to the display brightness value and the corresponding initial display interference information;
[0157] determining the display enhancement information according to the intermediate display interference information;
[0158] Repeat the above method of determining the display brightness value of the first sub-reference display image according to the pixel value of the first sub-reference display image, and determining the display enhancement information according to the intermediate display interference information, until the display enhancement information of k sub-reference display images is obtained, and k display enhancement information is obtained.
[0159] An embodiment of the present application also provides a computer storage medium, wherein the computer storage medium stores a computer program for electronic data exchange, and the computer program enables a computer to execute part or all of the steps of any one of the image enhancement image processing methods for spherical screen display recorded in the above method embodiments.
[0160] An embodiment of the present application also provides a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program enables a computer to execute part or all of the steps of any image enhancement image processing method for spherical screen display recorded in the above method embodiments.
[0161] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described order of actions, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.
[0162] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0163] In the several embodiments provided in the present application, it should be understood that the disclosed device can be implemented in other ways. For example, the device embodiments described above are only schematic, such as the division of the units, which is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, and the indirect coupling or communication connection of the device or unit can be electrical or other forms.
[0164] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0165] In addition, the functional units in the various embodiments of the application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated units may be implemented in the form of hardware or in the form of software program modules.
[0166] If the integrated unit is implemented in the form of a software program module and sold or used as an independent product, it can be stored in a computer-readable memory. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a memory, including a number of instructions to enable a computer device (which can be a personal computer, server or network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned memory includes: U disk, read-only memory (ROM), random access memory (RAM), mobile hard disk, disk or optical disk, etc., and other media that can store program codes.
[0167] A person of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable memory, which can include: a flash drive, a read-only memory, a random access memory, a magnetic disk or an optical disk, etc.
[0168] The embodiments of the present application are introduced in detail above. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method and core idea of the present application. At the same time, for general technical personnel in this field, according to the idea of the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.
Claims
1. A method for image enhancement processing of a spherical screen display, characterized in that: The method comprises: Obtaining the first attribute information of the target ball screen; Performing three-dimensional processing on the image to be displayed according to the first attribute information to obtain a reference display image; Performing enhancement processing on the reference display image to obtain a target display image; Displaying the target display image through the target ball screen; The step of performing enhancement processing on the reference display image to obtain a target display image includes: Extracting second attribute information of the LED display module of the target ball screen from the first attribute information, the second attribute information including the arrangement layout of LED lamp beads in the module, the density of the lamp beads, the luminous intensity of a single LED lamp bead, and the luminous angle range; Splitting the reference display image according to the second attribute information of the LED display module to obtain k sub-reference display images; Obtaining light beam divergence direction information of the LED display module corresponding to k sub-reference display images, and obtaining k light beam divergence direction information; Determine initial display interference information of the corresponding sub-reference display image when displaying according to the k light beam divergence direction information, and obtain k initial display interference information; Determine display enhancement information of k sub-reference display images according to k initial display interference information and pixel values of k sub-reference display images, to obtain k display enhancement information; Using k display enhancement information to enhance the corresponding sub-reference display images, to obtain k sub-target display images; Combining k sub-target display images to obtain the target display image; The step of determining the display enhancement information of the k sub-reference display images according to the k initial display interference information and the pixel values of the k sub-reference display images to obtain the k display enhancement information includes: determining a display brightness value of a first sub-reference display image according to a pixel value of the first sub-reference display image, wherein the first sub-reference display image is any one of the k sub-reference display images; Determining intermediate display interference information according to the display brightness value and the corresponding initial display interference information; determining the display enhancement information according to the intermediate display interference information; Repeat the above method of determining the display brightness value of the first sub-reference display image according to the pixel value of the first sub-reference display image, and determining the display enhancement information according to the intermediate display interference information, until the display enhancement information of k sub-reference display images is obtained, and k display enhancement information is obtained.
2. The image enhancement processing method for spherical screen display according to claim 1, characterized in that: The step of determining the light beam divergence direction corresponding to each LED display module according to the second attribute information of the LED display module comprises: Acquire the second attribute information of the LED display module to determine the light emitting direction information of the peripheral LED lamp beads of each LED display module, and obtain a first light emitting direction information set; Determine edge light beam divergence information of each LED display module according to the first light emitting direction information set; Determine the central light beam direction information of each LED display module according to the second attribute information of the LED display module, and obtain a central light beam direction information set; The light beam divergence direction corresponding to each LED display module is determined according to the central light beam direction information and the corresponding edge light beam divergence information in the central light beam direction information set.
3. The image enhancement processing method for spherical screen display according to claim 2, characterized in that: The step of determining initial display interference information of a corresponding sub-reference display image when displaying the image according to the k light beam divergence direction information to obtain k initial display interference information includes: Determine the beam overlap information between the corresponding LED display modules according to the k beam divergence direction information, and obtain k beam overlap information sets; Initial display interference information when the corresponding reference display image is displayed is determined according to the k light beam overlap information sets to obtain k initial display interference information.
4. An image enhancement image processing device for a spherical screen display, characterized in that: The device comprises: An acquisition unit, used for acquiring first attribute information of a target spherical screen; A processing unit, configured to perform three-dimensional processing on the image to be displayed according to the first attribute information to obtain a reference display image; an enhancement unit, configured to perform enhancement processing on the reference display image to obtain a target display image; A display unit, used for displaying the target display image through the target ball screen; The enhancement unit is specifically used for: Extracting second attribute information of the LED display module of the target ball screen from the first attribute information; Splitting the reference display image according to the second attribute information of the LED display module to obtain k sub-reference display images; Obtaining light beam divergence direction information of the LED display module corresponding to k sub-reference display images, and obtaining k light beam divergence direction information; Determine initial display interference information of the corresponding sub-reference display image when displaying according to the k light beam divergence direction information, and obtain k initial display interference information; Determine display enhancement information of k sub-reference display images according to k initial display interference information and pixel values of k sub-reference display images, to obtain k display enhancement information; Using k display enhancement information to enhance the corresponding sub-reference display images, to obtain k sub-target display images; Combining k sub-target display images to obtain the target display image; In the aspect of determining the display enhancement information of the k sub-reference display images according to the k initial display interference information and the pixel values of the k sub-reference display images to obtain the k display enhancement information, the enhancement unit is specifically used to: determining a display brightness value of a first sub-reference display image according to a pixel value of the first sub-reference display image, wherein the first sub-reference display image is any one of the k sub-reference display images; Determining intermediate display interference information according to the display brightness value and the corresponding initial display interference information; determining the display enhancement information according to the intermediate display interference information; Repeat the above method of determining the display brightness value of the first sub-reference display image according to the pixel value of the first sub-reference display image, and determining the display enhancement information according to the intermediate display interference information, until the display enhancement information of k sub-reference display images is obtained, and k display enhancement information is obtained.
5. The image enhancement image processing device for spherical screen display according to claim 4, characterized in that: In the aspect of determining the light beam divergence direction corresponding to each LED display module according to the second attribute information of the LED display module, the enhancement unit is specifically used for: Acquire the second attribute information of the LED display module to determine the light emitting direction information of the peripheral LED lamp beads of each LED display module, and obtain a first light emitting direction information set; Determine edge light beam divergence information of each LED display module according to the first light emitting direction information set; Determine the central light beam direction information of each LED display module according to the second attribute information of the LED display module, and obtain a central light beam direction information set; The light beam divergence direction corresponding to each LED display module is determined according to the central light beam direction information and the corresponding edge light beam divergence information in the central light beam direction information set.
6. A terminal, characterized in that: The invention comprises a processor, an input device, an output device and a memory, wherein the processor, the input device, the output device and the memory are interconnected, wherein the memory is used to store a computer program, the computer program comprises program instructions, and the processor is configured to call the program instructions to execute the image enhancement image processing method for a spherical screen display as described in any one of claims 1 to 3.
7. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, which includes program instructions. When the program instructions are executed by a processor, the processor executes the image enhancement image processing method for spherical screen display according to any one of claims 1 to 3.
Citation Information
Patent Citations
Back projection dome screen edge fusion method, system and device and storage medium
CN114666556A
Light field image engine method and apparatus for generating projected 3D light field
CN114815287A
Dome screen LED real-time image processing and software control method
CN117557446A