Aperiodic coding method for suppressing three-dimensional display distortion and related equipment

Abstract

The invention discloses an aperiodic coding method for suppressing three-dimensional display distortion and related equipment, and relates to the technical field of image processing. The method comprises the following steps: acquiring a to-be-processed image displayed by a three-dimensional display; obtaining a distortion coefficient of the to-be-processed image relative to a standard image; acquiring an aperiodic code of the to-be-processed image based on the distortion coefficient; and adjusting a coding module of a display unit corresponding to a light control structure in the three-dimensional display based on the non-periodic coding. By implementing the technical scheme provided by the invention, the problem that a traditional fixed compensation parameter scheme is difficult to deal with dynamic distortion is avoided, so that the image quality of the three-dimensional display system in different display areas is effectively improved, and a large-view-field light field design system is realized.

Description

Technical Field

[0001] The present invention relates to the field of image processing technology, and in particular to a non-periodic encoding method for suppressing three-dimensional display distortion and related equipment. Background Art

[0002] 3D display technology can provide viewers with a more realistic and immersive visual experience by reconstructing stereoscopic images in space, and is widely used in medical imaging, educational display, industrial design and other fields. In practical applications, 3D displays usually use light control structures to modulate the light field distribution to form a stereoscopic image at a specific viewpoint.

[0003] At present, common 3D display technologies mainly reduce display distortion by optimizing the optical system design, such as using high-precision optical elements, adding compensation optical systems, etc. Another solution is to introduce fixed compensation parameters in the encoding process of the display unit to try to offset the distortion effect introduced by the optical system.

[0004] However, due to the processing errors of the light control structure in the actual optical system and the changes in the use environment, the display distortion often shows nonlinear and irregular characteristics. The existing method of using fixed compensation parameters is difficult to adapt to this dynamically changing distortion characteristic, resulting in different degrees of distortion in different areas of the displayed image, which seriously affects the viewing effect of 3D display. Summary of the invention

[0005] The present invention provides a non-periodic encoding method and related equipment for suppressing three-dimensional display distortion, which avoids the problem that traditional fixed compensation parameter solutions are difficult to cope with dynamic distortion, thereby effectively improving the image quality of a three-dimensional display system in different display areas.

[0006] In a first aspect of the present invention, a non-periodic encoding method for suppressing three-dimensional display distortion is provided, comprising: Acquire the image to be processed displayed by the three-dimensional display; Obtaining a distortion coefficient of the image to be processed relative to a standard image; Based on the distortion coefficient, obtaining a non-periodic code of the image to be processed; An encoding module of a display unit corresponding to a light control structure in a three-dimensional display is adjusted based on the non-periodic encoding.

[0007] In a second aspect of the present invention, a non-periodic encoding device for suppressing three-dimensional display distortion is provided, comprising: A module for acquiring an image to be processed, used for acquiring an image to be processed displayed on a three-dimensional display; A distortion coefficient acquisition module, used to acquire the distortion coefficient of the image to be processed relative to the standard image; A non-periodic code acquisition module, used for acquiring the non-periodic code of the image to be processed based on the distortion coefficient; A non-periodic coding adjustment module is used to adjust the coding module of the display unit corresponding to the control light structure in the three-dimensional display based on the non-periodic coding.

[0008] In a third aspect of the present invention, an electronic device is provided, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the non-periodic encoding method for suppressing three-dimensional display distortion as described in any one of the above is implemented.

[0009] In a fourth aspect of the present invention, a non-transitory computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the non-periodic encoding method for suppressing three-dimensional display distortion as described in any one of the above is implemented.

[0010] In a fifth aspect of the present invention, a computer program product is provided, comprising a computer program, wherein when the computer program is executed by a processor, the non-periodic encoding method for suppressing three-dimensional display distortion as described in any one of the above is implemented.

[0011] In summary, one or more technical solutions provided in the present invention have at least the following technical effects or advantages: By acquiring the image to be processed displayed on the three-dimensional display and obtaining its distortion coefficient relative to the standard image, the actual distortion state introduced by the light control structure in the display system can be reflected in real time; non-periodic coding is generated based on the obtained distortion coefficient, and the coding module of the display unit corresponding to the light control structure is adjusted accordingly, so that the coding compensation can adapt to the nonlinear characteristics of the distortion; the above-mentioned non-periodic coding method based on real-time distortion feedback avoids the problem that traditional fixed compensation parameter solutions are difficult to cope with dynamic distortion, thereby effectively improving the image quality of the three-dimensional display system in different display areas. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0013] Figure 1 It is a schematic diagram of an optical path of an ideal three-dimensional display optical system provided by an embodiment of the present invention.

[0014] Figure 2 It is a schematic diagram of an optical path of a distorted three-dimensional display optical system provided by an embodiment of the present invention.

[0015] Figure 3 It is a schematic diagram of the arrangement of non-periodic image units produced by distortion provided by an embodiment of the present invention.

[0016] Figure 4 The present invention is a flowchart of a non-periodic encoding method for suppressing three-dimensional display distortion provided by an embodiment of the present invention.

[0017] Figure 5 This is a before and after comparison diagram of suppressing three-dimensional distortion provided by an embodiment of the present invention.

[0018] Figure 6 It is a structural schematic diagram of a non-periodic encoding device for suppressing three-dimensional display distortion provided by an embodiment of the present invention.

[0019] Figure 7 It is a structural schematic diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0020] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the drawings of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0021] As a display device that can present stereoscopic images, three-dimensional displays have been widely used in the fields of medical treatment, education, industrial design, etc. The basic principle of achieving stereoscopic display is: first, multi-viewpoint images are processed through specific synthetic coding parameters, then the processed images are loaded onto a two-dimensional display panel, and finally, a light control device is used to form a viewpoint display area with different parallax in space. When the left and right eyes of the observer are located in different viewpoint areas, they can perceive the stereoscopic effect because they receive image information with parallax.

[0022] However, in actual naked-eye 3D display systems, the display effect is often affected by many aspects due to the inherent characteristics of the optical system. The most critical issue is the non-uniformity of the magnification of the optical system, which is also called "field magnification non-uniformity" or "field curvature". Ideally, the optical system should ensure that all object points have consistent magnification when imaging to maintain image clarity and consistency. However, in actual optical systems, the on-axis object points and the object points at the edge of the field of view experience different light paths, resulting in differences in the convergence points of the light beams. This difference is mainly due to the inherent limitations of optical elements such as lenses or gratings, which causes the magnification to change with the change of the field of view position, thereby affecting the presentation of the stereoscopic visual effect.

[0023] This magnification non-uniformity is particularly evident in the large field of view boundary area. When the boundary image points of the display unit pass through the light control device, the actual viewpoint display area formed in space will deviate significantly from the ideal design position. This deviation directly leads to the reduction of the effective field of view, making it difficult for the system to achieve the expected large field of view display effect. What's more serious is that this field of view magnification non-uniformity will also cause deviations in depth perception between the field of view edge image and the on-axis image, seriously affecting the coherence of the stereoscopic visual experience.

[0024] In addition to the problem of magnification non-uniformity, the deviation between the actual optical path and the ideal optical path will also lead to uneven viewpoint distribution. When the viewpoint interval cannot be kept consistent, the entire acquisition and display process will be distorted. This distortion causes the audience to see incorrect perspective content at certain viewpoints, destroying the accuracy of the stereoscopic display. This problem is more prominent in a large field of view naked-eye 3D display system because the optical path difference between the on-axis object point and the object point at the edge of the field of view is greater when imaging.

[0025] In addition, there are inevitably processing errors in the actual production of optical components. These errors, combined with the distortion aberration of the system itself, will further reduce the quality of the display effect. This effect is particularly obvious under large field of view conditions, because a larger field of view means that the light needs to propagate through a more complex optical path, which further amplifies the impact of various error factors.

[0026] Therefore, the key to achieving a high-quality 3D display system is how to increase the display field of view while effectively compensating for the optical path effects caused by distortion. This requires precise design and adjustment of the optical system to ensure a consistent stereoscopic visual experience over a large field of view by reducing changes in magnification. Although 3D display technology has become a hot topic in the research field, there is still a lack of high-quality display solutions that can effectively solve the above problems. Breaking through this technical bottleneck is of great significance to improving the overall performance of 3D display systems.

[0027] In the development of 3D display technology, the performance of the display system is often constrained by the interaction of multiple parameters. There is an inevitable trade-off between key parameters such as field of view, depth of field, resolution, and spatial information capacity (number of viewpoints). This inherent constraint makes 3D display solutions that can achieve excellent levels of overall display quality particularly valuable.

[0028] As a complex optical system, 3D displays are inevitably affected by optical aberrations. Among them, the problem of parallax image deformation caused by distortion is particularly significant. This deformation mainly affects the display effect in two ways: on the one hand, it is reflected in the impact of the viewpoints at the edge of the viewing area on the large field of view 3D light field, and on the other hand, it is reflected in the impact of the viewpoints inside the viewing area on the display clarity and depth of field.

[0029] The distortion problem is particularly prominent in the boundary area of ​​the viewing zone. Since the viewpoints at the boundary of the viewing zone are often close to those of the adjacent viewing zone, and the viewpoint content between different viewing zones is significantly different, this leads to a serious break in the viewing experience. Specifically, the distortion will cause jump delays between the viewing zones of the 3D display system. What's more serious is that the degree of distortion shows an increasing trend with the increase in the distance from the optical axis. This means that the larger the field of view angle of the display system, the more seriously it will be affected by the distortion. Not only will it be difficult to achieve the expected large field of view display effect, but it will also aggravate the incoherence of switching between viewing zones. The existence of this problem greatly limits the actual performance of high-quality 3D display systems.

[0030] The influence of distortion inside the viewing area cannot be ignored either. The viewpoints inside the viewing area will also be disturbed by the distortion, causing the system to be unable to accurately construct the light field according to the ideal optical path. This problem makes it difficult for even a well-designed 3D display system to present an ideal display effect. To understand this phenomenon, it is necessary to start with the formation mechanism of the light field viewpoint information.

[0031] Ideally, the light emitted by the image unit (pixel or sub-pixel) in the display unit should be accurately converged to form evenly distributed viewpoints in space after passing through the corresponding optical lens. Each angle of light carries the three-dimensional viewpoint information in a specific direction. According to the principle of reversibility of the optical path, please refer to Figure 1 , Figure 1 A schematic diagram of an optical path of an ideal three-dimensional display optical system provided by an embodiment of the present invention is shown in FIG. Figure 1 As shown in the figure, after passing through the ideal optical lens, the light ray v01 should reach the position of the element image unit p01 accurately. Under this ideal state, the 3D display system can construct multiple accurate viewpoints in the complete viewing area, and provide the audience with an ideal stereoscopic visual experience by filling the corresponding parallax images at these viewpoints.

[0032] However, aberrations are unavoidable in actual optical devices, especially distortion, which is the optical aberration that has the most significant impact on display quality. Figure 2 , Figure 2 A schematic diagram of a light path of a distorted three-dimensional display optical system provided by an embodiment of the present invention. Figure 2As shown in the figure, due to the distortion, the light ray v01 may deviate from the expected path and arrive at the position of the element image unit p02. This optical path deviation not only leads to the incorrect construction of the 3D reconstruction information, but also becomes more obvious as the distance from the optical axis increases. Therefore, when we perform reverse tracing analysis on the single-viewpoint optical path, we will find a significant phenomenon: in the area close to the optical axis, the image units are relatively sparsely distributed, while in the area far from the optical axis, the image units are densely arranged, forming the following Figure 3 The non-periodic image unit arrangement pattern shown, Figure 3 A schematic diagram of the arrangement of non-periodic image units produced by distortion provided in an embodiment of the present invention.

[0033] The consequences of this non-periodic arrangement are serious. Since the parallax image content of each viewpoint comes from lens units at different positions on the display screen, the non-periodic arrangement caused by distortion makes it impossible to accurately converge the image content from the same viewpoint. This means that the image seen by the audience at a certain viewpoint will be interfered with by the content of adjacent viewpoints. What's more troublesome is that as the depth of field of the displayed content increases, the content difference between adjacent viewpoints will also increase, further reducing the display quality of each viewpoint. The existence of distortion essentially limits the overall performance of the display system in terms of clarity and depth of field.

[0034] Although current light field display technology has the ability to adapt to display screens of different sizes, there is still a lack of effective solutions to the problem of non-periodic image units caused by optical distortion. Breaking through this technical bottleneck is of key significance for achieving higher quality 3D display effects.

[0035] Based on the problems existing in the above prior art, please refer to Figure 4 , Figure 4 The present invention provides a flowchart of a non-periodic coding method for suppressing three-dimensional display distortion provided by an embodiment of the present invention. The method can be implemented by a computer program, can be implemented by a single-chip microcomputer, or can be run on a non-periodic coding system for suppressing three-dimensional display distortion based on a von Neumann system. The computer program can be integrated into an application or run as an independent tool application. Specifically, the method may include the following steps: S101, obtaining an image to be processed displayed on a three-dimensional display.

[0036] Among them, the image to be processed refers to an image that is distorted when displayed on a three-dimensional display, and the distortion is mainly caused by the optical characteristics of the light control structure and manufacturing errors. In the embodiment of the present invention, it can be understood that: due to the deviation between the actual light path and the ideal light path, the viewpoint display area formed in the space after the display unit passes through the light control structure deviates greatly from the ideal area, which makes the parallax image appear non-uniformly deformed when displayed. For example, when the boundary image points of the display unit pass through the light control structure, due to the severe distortion, it will cause problems such as a smaller field of view and uneven viewpoint spacing. The image to be processed is used to obtain the distortion coefficient through comparative analysis with the standard image, and then perform non-periodic coding compensation based on the distortion coefficient to achieve correction of the three-dimensional display distortion, and finally ensure that the observer can obtain a continuous and uniform stereoscopic visual effect.

[0037] Based on the above embodiment, as an optional embodiment, in S101: the step of obtaining the image to be processed displayed by the three-dimensional display may further include the following steps: S201: Acquire a first image in a three-dimensional display.

[0038] The first image refers to the original image of the display screen of the three-dimensional display directly captured by the camera. In the embodiment of the present invention, it can be understood that: based on the initial synthesis coding parameter matrix, the three-dimensional display synthesizes and encodes the multi-viewpoint images and displays the image, which may or may not be distorted. The first image is used for comparative analysis with the standard image, and by calculating the distortion value and comparing it with the distortion threshold, it is determined whether the three-dimensional display has display distortion that needs to be corrected, and then it is determined whether to use it as the image to be processed.

[0039] Specifically, in order to determine whether a three-dimensional display has display distortion and make corresponding corrections, it is first necessary to obtain the first image in the three-dimensional display. In practical applications, an initial synthesis coding parameter matrix is ​​set in the three-dimensional display, which is used to synthesize and encode the input multi-viewpoint image so that it presents a three-dimensional effect on the display panel. In the specific acquisition process, it is necessary to select a light field camera with high resolution and no obvious distortion. The camera should be placed in front of the display screen and horizontally centered. At the same time, the acquisition distance needs to be adjusted accordingly according to the size of the display screen. For example, for a 65-inch LCD display screen, the camera should be placed 1.2 meters in front of the display screen. Since the image captured by the camera may contain content outside the display frame, it is necessary to crop the captured image through image processing algorithms such as edge detection to limit the range of the first image to the effective display area of ​​the three-dimensional display. Acquiring the first image in this standardized acquisition method can ensure the accuracy and reliability of the data when comparing and analyzing with the standard image later, and provide good basic data support for determining whether the three-dimensional display has distortion.

[0040] S202: Obtain a distortion value of the first image relative to a standard image.

[0041] The distortion value refers to a quantitative index calculated by the relative distortion value solution model, which is used to characterize the degree of deviation of the first image from the standard image. This value reflects the actual display deviation caused by the optical characteristics of the light control structure and manufacturing errors. The distortion value is used to determine whether the display distortion of the three-dimensional display has reached the degree that needs to be corrected by comparing with the preset distortion threshold, so as to decide whether to determine the first image as the image to be processed, and then perform subsequent non-periodic encoding compensation processing.

[0042] Based on the above embodiment, as an optional embodiment, in S202: the step of obtaining the distortion value of the first image relative to the standard image may further include the following steps: S301, acquiring imaging point matrices of a first image and a standard image.

[0043] Among them, the standard image refers to a reference image without distortion in an ideal state, which reflects the ideal display effect of the three-dimensional display system without optical distortion. In the embodiment of the present invention, it can be understood as: without considering the optical characteristics of the light control structure and the influence of manufacturing errors, a standard checkerboard pattern is obtained by an ideal optical path design, in which the display areas of each viewpoint are evenly distributed and the parallax image content is continuous. The standard image is used as a reference benchmark for evaluating the degree of distortion of the first image, and the display distortion is quantified by comparative analysis with the first image.

[0044] Correspondingly, the imaging point matrix refers to a two-dimensional data array that describes the spatial distribution of feature points in an image. In the embodiment of the present invention, it can be understood as: a point position data matrix obtained based on a set checkerboard corner point array, wherein matrix A corresponds to the corner point position data of the first image, and matrix B corresponds to the corner point position data of the standard image, and each matrix element contains the physical size coordinates of the corresponding corner point in the x and y directions of the image plane. The imaging point matrix is ​​used to calculate the distortion value through the relative distortion value solution model, and then evaluate the display distortion degree of the three-dimensional display, providing a basis for subsequent non-periodic coding compensation.

[0045] S302: Calculate the similarity between the imaging point matrices of the first image and the standard image to obtain a distortion value of the first image relative to the standard image.

[0046] Specifically, after obtaining the imaging point matrix, it is necessary to quantitatively evaluate the degree of display distortion by calculating the similarity between the imaging point matrix of the first image and the standard image. In practical applications, the relative distortion value solution model is used to build the connection between the two groups of imaging point matrices. The specific calculation formula is: ; Where A is the dot matrix of the first image, B is the dot matrix of the standard image, and Dist is the relative distortion value between the two; When there is an optical property deviation or manufacturing error in the light control structure, the corner point position in the first image will be offset relative to the standard image, and this offset will be directly reflected in the numerical difference of the imaging point matrix. For example, in the presence of radial distortion, the position offset of the corner point away from the center of the optical axis will be more obvious, resulting in a larger difference in the corresponding matrix elements; ideally, the corresponding elements of the two sets of matrices should be basically the same. Through this calculation method based on matrix similarity, the quantitative index of display distortion can be accurately obtained, which can not only objectively reflect the display quality of the three-dimensional display, but also provide reliable data support for the subsequent judgment of whether distortion correction is needed.

[0047] S203: Determine whether the distortion value is greater than a distortion threshold. If the distortion value is greater than the distortion threshold, determine that the 3D display has 3D display distortion, and determine the first image as an image to be processed.

[0048] Specifically, after obtaining the distortion value, it is necessary to compare it with the preset distortion threshold to determine whether the three-dimensional display has display distortion that needs to be corrected. In practical applications, the calculated relative distortion value is compared with the set distortion threshold, where the set distortion threshold represents the maximum distortion tolerance acceptable to the three-dimensional display system. The setting of this value is related to the specific application requirements of the display system. The higher the display requirements, the lower the value of the maximum distortion tolerance should be. When the comparison result shows that the distortion value is greater than, it indicates that the light control structure in the three-dimensional display has a distortion effect on the display effect that exceeds the tolerance range. At this time, the first image needs to be determined as the image to be processed to prepare for subsequent distortion correction processing.

[0049] For example, when the viewpoint display area formed in space by the boundary image points of the display unit after passing through the light control structure deviates greatly from the ideal area, resulting in a smaller field of view or uneven viewpoint spacing, the distortion value often exceeds the threshold. The above processing method based on threshold judgment can effectively identify the display content that needs to be distorted and avoid unnecessary processing of images with less distortion. At the same time, this method also provides a clear processing object for subsequent non-periodic coding compensation, which helps to achieve accurate distortion correction and ultimately ensure that the observer can obtain a continuous and uniform stereoscopic visual effect.

[0050] When the relative distortion value is less than or equal to the set distortion threshold, it indicates that the display distortion of the 3D display is within an acceptable range and no distortion correction is required. In practical applications, this means that the light control structure has little effect on the display effect, and the deviation between the viewpoint display area formed in space by the display unit after the light control structure and the ideal area is within the allowable range.

[0051] For example, when the processing precision of the optical elements in the display system is high, or the displayed content is mainly distributed in the central area with small distortion, the distortion value often does not exceed the threshold. At this time, the corner point position in the first image is basically consistent with the standard image, and the display effect of the parallax image is good, which can ensure that the observer obtains an ideal stereoscopic visual experience.

[0052] S102: Obtain a distortion coefficient of the image to be processed relative to a standard image.

[0053] Among them, the distortion coefficient refers to a set of quantitative parameters that describe the degree of geometric deformation of the display content caused by the control light structure in the three-dimensional display. In the embodiment of the present invention, it can be understood as a five-dimensional vector containing radial distortion coefficients (k1, k2, k3) and tangential distortion coefficients (p1, p2), where the radial distortion coefficient describes the degree of nonlinear deformation along the radial direction, and the tangential distortion coefficient describes the degree of tangential deformation perpendicular to the radial direction. The distortion coefficient is used to establish a mapping relationship between the actual display point position and the ideal display point position through a distortion transformation model, and then guide the subsequent non-periodic coding compensation process to achieve accurate correction of three-dimensional display distortion.

[0054] Based on the above embodiment, as an optional embodiment, in S102: the step of obtaining the distortion coefficient of the image to be processed relative to the standard image may further include the following steps: S301 : determining radial distortion and tangential distortion of the image to be processed based on imaging point matrices of the image to be processed and the standard image.

[0055] Among them, radial distortion and tangential distortion refer to the two main types of geometric deformation caused by the light control structure in the 3D display system. Among them, radial distortion refers to the nonlinear deformation generated along the radial direction from the center of the optical axis to the outside, which is manifested as the image is enlarged or reduced to varying degrees as the distance from the center of the optical axis increases; tangential distortion refers to the position offset perpendicular to the radial direction, which is mainly caused by the installation deviation or manufacturing error of the light control structure.

[0056] In an optional implementation, the radial distortion and tangential distortion of the image to be processed can be accurately calculated by the Brown algorithm. In practical applications, the algorithm measures the similarity between the image to be processed and the standard image by constructing a distortion transformation model, and determines the optimal distortion coefficient by iterative optimization. Specifically, the distortion transformation model can be established: ; ; The distortion coefficient can be expressed as: ,in, is the ideal image point matrix coordinate, To generate pixel matrix coordinates, is the coordinate of the center point of the optical axis, usually .

[0057] In the process of solving the model, the algorithm optimizes the distortion coefficient by continuously merging adjacent data clusters until the position error of the corresponding point between the image to be processed and the standard image under the current distortion coefficient is less than the preset threshold. The distortion coefficient obtained at this time is the final result. This solution method based on iterative optimization can simultaneously consider the influence of radial distortion and tangential distortion. It can not only accurately describe the distortion characteristics of the light control structure at different positions, but also ensure the stability and reliability of the solution results, providing accurate parameter support for subsequent non-periodic coding compensation.

[0058] S302: Taking radial distortion and tangential distortion as distortion coefficients of the image to be processed relative to the standard image.

[0059] S103: Obtain a non-periodic code of the image to be processed based on the distortion coefficient.

[0060] Among them, the non-periodic encoding of the image to be processed refers to the mapping relationship of re-encoding the display unit of the image to be processed based on the distortion coefficient. The encoding no longer follows the traditional equi-periodic arrangement rule, but is adaptively adjusted according to the distortion characteristics generated by the light control structure at different positions.

[0061] In the embodiments of the present invention, it can be understood that a remapping scheme of distorted pixels to ideal positions is established by reverse tracing of the optical path, wherein the encoding position of each display unit is determined by the degree of distortion suffered by the unit, that is, the final encoding position is determined by the actual offset calculated based on the radial distortion coefficient and the tangential distortion coefficient.

[0062] When a display unit is located in an area with large distortion, its pixels may be encoded in the area of ​​an adjacent display unit; in an area with small distortion, the offset of the pixel encoding position is relatively small. The non-periodic encoding of the image to be processed is used to compensate for the optical distortion caused by the light control structure. By re-encoding and mapping the display unit, the actual display effect after the light control structure can match the ideal display effect, and finally achieve effective correction of 3D display distortion.

[0063] Based on the above embodiment, as an optional embodiment, in S103: the step of obtaining the non-periodic encoding of the image to be processed based on the distortion coefficient may further include: S401: Determine the distortion coefficient of each pixel of the image to be processed.

[0064] Specifically, in order to achieve accurate non-periodic encoding, it is first necessary to determine the specific distortion coefficient of each pixel in the image to be processed to accurately describe the distortion characteristics of display units at different positions. In practical applications, based on the radial distortion coefficient and tangential distortion coefficient obtained in the above steps, it is necessary to calculate the specific distortion parameters of each pixel in the image to be processed.

[0065] Specifically, for any pixel in the image to be processed, it is necessary to first determine the distance from the point to the center of the optical axis, and then calculate the distortion components of the pixel in the radial and tangential directions based on the distance. In this way, the specific distortion parameters of each pixel in the image to be processed in the horizontal and vertical directions can be obtained, and these parameters accurately quantify the degree of geometric deformation of the point. For example, for pixels far away from the center of the optical axis, their radial distortion components are often more significant; while for tangential distortion caused by installation deviation, it is mainly reflected in the position offset in a specific direction.

[0066] S402: Based on the principle of optical path reversibility, a mapping relationship between the pixel position corresponding to the distortion coefficient and the ideal pixel position is constructed.

[0067] Specifically, after obtaining the distortion coefficient of each pixel, a mapping relationship needs to be constructed based on the principle of optical path reversibility to determine the specific distortion compensation solution. In practical applications, since the distortion of the light control structure will cause the light propagation path to deviate, the ideal display position of the pixel can be determined by tracing the light path in reverse.

[0068] Specifically, the actual light propagation path of each pixel in the image to be processed after passing through the light control structure is first analyzed, and then based on the distortion coefficient of the pixel, the light propagation path under the ideal state is reversely deduced, thereby establishing a correspondence between the actual pixel position and the ideal pixel position. For example, when a display unit in a certain edge area is severely distorted, its corresponding pixel may deviate from the expected position during actual display. At this time, the correct position of these pixels under the ideal display state can be determined by reverse tracing of the light path, thereby establishing an accurate position mapping relationship. This mapping method based on the principle of reversibility of the light path can accurately restore the influence of the light control structure on the propagation of light. It can not only determine the ideal display position of each pixel, but also determine whether the pixel needs to be reallocated to an adjacent display unit, thereby achieving accurate compensation for display distortion.

[0069] S403: Generate a non-periodic code of the image to be processed based on the mapping relationship.

[0070] Specifically, after the mapping relationship is constructed, it is necessary to generate a non-periodic encoding of the image to be processed based on the mapping relationship to achieve effective compensation for display distortion. In practical applications, the display position of each pixel is re-encoded so that it can present an ideal display effect after passing through the light control structure.

[0071] Specifically, first determine the target position of each pixel after compensating for distortion based on the established position mapping relationship, then adjust the encoding method of the display unit to reallocate the pixel information to the corresponding display position. When a display unit is located in a severely distorted area, its pixels may be encoded into the area of ​​an adjacent display unit and no longer follow the traditional equiperiodic arrangement rule; in areas with less distortion, only slight adjustments to the pixel position are required.

[0072] For example, for the edge display area far from the center of the optical axis, due to the large radial distortion, the corresponding pixel points may need to be offset a certain distance inward for encoding; while in the central area, due to the small distortion, the adjustment range of the pixel encoding is also correspondingly small. This non-periodic encoding method based on mapping relationships can effectively compensate for the distortion caused by the light control structure in different areas by adaptively adjusting the encoding position of the pixels, ensuring that the entire display area can obtain a uniform and continuous three-dimensional display effect.

[0073] S104, adjusting the coding module of the display unit corresponding to the control light structure in the three-dimensional display based on the non-periodic coding.

[0074] The light control structure includes at least one of a slit grating, a cylindrical lens grating, a micro-hole array, and a lens array, or a combination thereof.

[0075] After obtaining the non-periodic code of the image to be processed, the display unit corresponding to the light control structure in the three-dimensional display needs to be adjusted based on the code to reorganize the display light to achieve distortion correction. In practical applications, the light distribution of the three-dimensional light field display system is optimized by adjusting the voxels projected by the corresponding light control unit in the form of non-periodic code.

[0076] Specifically, the non-periodic coded information is first converted into the projection parameters of the light control unit, and different projection strategies are adopted for display units in different positions, so that the projected light can be accurately converged to the desired observation position. When the display unit is located at the edge of the large field of view, since the voxel projection path is affected by large distortion, part of the voxel information needs to be redistributed to the adjacent light control unit for projection; while in the center of the field of view, the projection direction of the voxel is mainly slightly adjusted.

[0077] For example, for areas affected by severe radial distortion, the projection parameters of the corresponding light control unit are adjusted so that its voxels can be accurately projected into the designed observation space; for areas with optical path differences, the projection path of the voxels is optimized to compensate for the impact of the optical path error. This light reconstruction method based on voxel projection can effectively optimize the reconstruction process of the three-dimensional light field by adjusting the light control unit through non-periodic coding, ensuring the formation of accurate stereoscopic images within a large field of view, so that the observer can obtain an ideal naked-eye three-dimensional display effect.

[0078] Please refer to Figure 5 , Figure 5 A comparison diagram before and after suppressing three-dimensional distortion provided by an embodiment of the present invention. The present invention provides a non-periodic encoding method for suppressing three-dimensional display distortion, which effectively suppresses optical distortion in a three-dimensional display system through a systematic distortion detection and compensation mechanism. The method first uses a high-precision camera to capture the actual display image of the three-dimensional display from a specific viewing angle, that is, the initial generated image, and simultaneously obtains the corresponding ideal display image. By comparing and analyzing the two groups of images, the relative distortion ratio between them is calculated to quantitatively evaluate the degree of distortion in the display system.

[0079] When the relative distortion ratio is detected to exceed the preset distortion threshold, it means that the distortion in the display system has reached the level that needs to be corrected. At this time, the method will start the distortion compensation process. In the compensation process, the synthetic coding parameter matrix that produces the initial generated image is first adjusted. This adjustment is based on the Brown algorithm, which can accurately extract the distortion characteristics in the system and generate corresponding distortion coefficients. These distortion coefficients accurately describe the geometric deformation characteristics in the display system and provide a reliable mathematical basis for subsequent distortion compensation.

[0080] After obtaining the distortion coefficients, these coefficients can be integrated with the pixel coding algorithm to establish a non-periodic pixel coding scheme. This coding scheme breaks through the limitations of traditional equi-periodic coding and can adaptively adjust the pixel coding method according to the degree of distortion at different locations. Through this non-periodic coding compensation mechanism, the system can effectively offset the geometric deformation caused by optical distortion.

[0081] After the coding adjustment is completed, the multi-viewpoint image is re-encoded using the updated synthetic coding parameter matrix to generate a new display image. The system will continue to monitor the relative distortion ratio between the newly generated image and the ideal image, and iteratively optimize when necessary until the distortion ratio is reduced below the set threshold. This closed-loop optimization mechanism ensures the accuracy and reliability of distortion compensation.

[0082] Please refer to Figure 6 , Figure 6A schematic diagram of the structure of a non-periodic encoding device for suppressing three-dimensional display distortion provided by an embodiment of the present invention, the non-periodic encoding device for suppressing three-dimensional display distortion comprises: A module for acquiring an image to be processed, used for acquiring an image to be processed displayed on a three-dimensional display; A distortion coefficient acquisition module, used to acquire the distortion coefficient of the image to be processed relative to the standard image; A non-periodic code acquisition module, used for acquiring the non-periodic code of the image to be processed based on the distortion coefficient; A non-periodic coding adjustment module is used to adjust the coding module of the display unit corresponding to the control light structure in the three-dimensional display based on the non-periodic coding.

[0083] Based on the above embodiment, as an optional embodiment, the module for acquiring images to be processed is further used to acquire a first image in a three-dimensional display; acquire a distortion value of the first image relative to the standard image; determine whether the distortion value is greater than a distortion threshold; if the distortion value is greater than the distortion threshold, determine that the three-dimensional display has three-dimensional display distortion, and determine the first image as the image to be processed.

[0084] Based on the above embodiment, as an optional embodiment, the module for acquiring the image to be processed is also used to acquire the imaging point matrix of the first image and the standard image; calculate the similarity of the imaging point matrix of the first image and the standard image, and obtain the distortion value of the first image relative to the standard image.

[0085] On the basis of the above embodiment, as an optional embodiment, the distortion coefficient acquisition module is also used to determine the radial distortion and tangential distortion of the image to be processed based on the imaging point matrix of the image to be processed and the standard image; and use the radial distortion and the tangential distortion as the distortion coefficients of the image to be processed relative to the standard image.

[0086] On the basis of the above embodiments, as an optional embodiment, the non-periodic coding acquisition module is also used to determine the distortion coefficient of each pixel point of the image to be processed; based on the principle of optical path reversibility, construct a mapping relationship between the pixel point position corresponding to the distortion coefficient and the ideal pixel point position; based on the mapping relationship, generate the non-periodic coding of the image to be processed.

[0087] Figure 7 An example of a physical structure diagram of an electronic device is shown in FIG. Figure 7As shown, the electronic device may include: a processor 710, a communication interface 720, a memory 730 and a communication bus 740, wherein the processor 710, the communication interface 720 and the memory 730 communicate with each other through the communication bus 740. The processor 710 may call the logic instructions in the memory 730 to execute the non-periodic encoding method for suppressing three-dimensional display distortion.

[0088] In addition, the logic instructions in the above-mentioned memory 730 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when it is sold or used as an independent product. Based on this understanding, the technical solution of the present invention can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium, including several instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc. Various media that can store program codes.

[0089] On the other hand, the present invention also provides a computer program product, which includes a computer program. The computer program can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the non-periodic encoding method for suppressing three-dimensional display distortion provided by the above methods.

[0090] On the other hand, the present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which is implemented when the computer program is executed by a processor to execute the non-periodic encoding method for suppressing three-dimensional display distortion provided by the above methods.

[0091] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.

[0092] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0093] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A non-periodic encoding method for suppressing three-dimensional display distortion, characterized in that: include: Acquire the image to be processed displayed by the three-dimensional display; Obtaining a distortion coefficient of the image to be processed relative to a standard image; Based on the distortion coefficient, obtaining a non-periodic code of the image to be processed; An encoding module of a display unit corresponding to a light control structure in a three-dimensional display is adjusted based on the non-periodic encoding.

2. The non-periodic encoding method for suppressing three-dimensional display distortion according to claim 1, characterized in that: The step of obtaining an image to be processed with three-dimensional display distortion includes: Acquiring a first image in a three-dimensional display; Acquire a distortion value of the first image relative to the standard image; Determining whether the distortion value is greater than a distortion threshold; If the distortion value is greater than the distortion threshold, it is determined that the three-dimensional display has three-dimensional display distortion, and the first image is determined as an image to be processed.

3. The non-periodic encoding method for suppressing three-dimensional display distortion according to claim 2, characterized in that: The obtaining of the distortion value of the first image relative to the standard image includes: Acquire imaging point matrices of the first image and the standard image; The similarity between the imaging point matrices of the first image and the standard image is calculated to obtain a distortion value of the first image relative to the standard image.

4. The non-periodic encoding method for suppressing three-dimensional display distortion according to claim 1, characterized in that: The step of obtaining the distortion coefficient of the image to be processed relative to the standard image includes: Determining radial distortion and tangential distortion of the image to be processed based on imaging point matrices of the image to be processed and the standard image; The radial distortion and the tangential distortion are used as distortion coefficients of the image to be processed relative to the standard image.

5. The non-periodic encoding method for suppressing three-dimensional display distortion according to claim 1, characterized in that: The step of obtaining the non-periodic encoding of the image to be processed based on the distortion coefficient includes: Determining the distortion coefficient of each pixel of the image to be processed; Based on the principle of optical path reversibility, a mapping relationship between the pixel position corresponding to the distortion coefficient and the ideal pixel position is constructed; The non-periodic code of the image to be processed is generated based on the mapping relationship.

6. The non-periodic encoding method for suppressing three-dimensional display distortion according to claim 1, characterized in that: The light control structure includes at least one of a slit grating, a cylindrical lens grating, a micro-hole array, and a lens array.

7. A non-periodic encoding device for suppressing three-dimensional display distortion, characterized in that: include: A module for acquiring an image to be processed, used for acquiring an image to be processed displayed on a three-dimensional display; A distortion coefficient acquisition module, used to acquire the distortion coefficient of the image to be processed relative to the standard image; A non-periodic code acquisition module, used for acquiring the non-periodic code of the image to be processed based on the distortion coefficient; A non-periodic coding adjustment module is used to adjust the coding module of the display unit corresponding to the control light structure in the three-dimensional display based on the non-periodic coding.

8. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, the non-periodic encoding method for suppressing three-dimensional display distortion as claimed in any one of claims 1 to 6 is implemented.

9. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the non-periodic encoding method for suppressing three-dimensional display distortion as claimed in any one of claims 1 to 6 is implemented.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the non-periodic encoding method for suppressing three-dimensional display distortion as claimed in any one of claims 1 to 6 is implemented.

Images