Non-periodic encoding method for suppressing three-dimensional display distortion and related device

Abstract

The application discloses a non-periodic coding method for inhibiting three-dimensional display distortion and related equipment, and relates to the technical field of image processing. The method comprises the following steps: acquiring a to-be-processed image displayed by a three-dimensional display; acquiring a distortion coefficient of the to-be-processed image relative to a standard image; acquiring a non-periodic code of the to-be-processed image based on the distortion coefficient; and adjusting a coding module of a display unit corresponding to a control light structure of the three-dimensional display based on the non-periodic code. The technical scheme provided by the application avoids the problem that a traditional fixed compensation parameter scheme is difficult to cope with dynamic distortion, thereby effectively improving the image quality of a three-dimensional display system in different display regions and realizing a large-view-field light field design system.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of image processing, and in particular to a non-periodic encoding method for suppressing three-dimensional display distortion and related equipment. BACKGROUND

[0002] Three-dimensional display technology can provide a more realistic and immersive visual experience for viewers by reconstructing a three-dimensional image in space, and is widely used in medical imaging, educational display, industrial design and other fields. In practical applications, three-dimensional displays usually use light control structures to modulate light field distribution, thereby forming a stereoscopic image at a specific viewing point.

[0003] Currently, common three-dimensional display technologies mainly reduce display distortion by optimizing optical system design, such as using high-precision optical elements, increasing compensation optical systems, and other methods. Another solution is to introduce fixed compensation parameters in the encoding process of the display unit, in an attempt to offset the distortion effects introduced by the optical system.

[0004] However, due to the machining errors of the light control structure in the actual optical system and the changes in the use environment, the display distortion often exhibits nonlinear and irregular characteristics. The existing method of using fixed compensation parameters is difficult to adapt to such dynamically changing distortion characteristics, resulting in different degrees of distortion in different areas of the displayed image, which seriously affects the viewing effect of three-dimensional display. SUMMARY

[0005] The present application provides a non-periodic encoding method for suppressing three-dimensional display distortion and related equipment, which avoids the problem that the traditional fixed compensation parameter scheme is difficult to cope with dynamic distortion, thereby effectively improving the image quality of the three-dimensional display system in different display areas.

[0006] In a first aspect of the present application, a non-periodic encoding method for suppressing three-dimensional display distortion is provided, comprising:

[0007] obtaining a to-be-processed image displayed by a three-dimensional display;

[0008] obtaining a distortion coefficient of the to-be-processed image relative to a standard image;

[0009] based on the distortion coefficient, obtaining a non-periodic encoding of the to-be-processed image;

[0010] adjusting the encoding module of the display unit corresponding to the light control structure in the three-dimensional display based on the non-periodic encoding.

[0011] In a second aspect of the present application, a non-periodic encoding device for suppressing three-dimensional display distortion is provided, comprising:

[0012] a to-be-processed image acquisition module for obtaining a to-be-processed image displayed by a three-dimensional display;

[0013] a distortion coefficient obtaining module, configured to obtain a distortion coefficient of the to-be-processed image relative to a standard image;

[0014] a non-periodic code obtaining module, configured to obtain a non-periodic code of the to-be-processed image based on the distortion coefficient;

[0015] a non-periodic code adjusting module, configured to adjust an encoding module of a display unit corresponding to a light control structure of a three-dimensional display based on the non-periodic code.

[0016] In a third aspect of the present application, an electronic device is provided, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the non-periodic code method for suppressing distortion of a three-dimensional display when executing the computer program.

[0017] In a fourth aspect of the present application, a non-transitory computer-readable storage medium is provided, which stores a computer program executable by a processor to implement the non-periodic code method for suppressing distortion of a three-dimensional display.

[0018] In a fifth aspect of the present application, a computer program product is provided, comprising a computer program executable by a processor to implement the non-periodic code method for suppressing distortion of a three-dimensional display.

[0019] In summary, the one or more technical solutions provided in the present application have at least the following technical effects or advantages:

[0020] By obtaining a to-be-processed image displayed by a three-dimensional display and obtaining a distortion coefficient of the to-be-processed image relative to a standard image, the actual distortion state introduced by a light control structure of the display system can be reflected in real time; a non-periodic code is generated based on the obtained distortion coefficient, and the encoding module of a display unit corresponding to the light control structure is adjusted based on the non-periodic code, so that the encoding compensation can adapt to the nonlinear characteristics of the distortion; the above non-periodic code method based on real-time distortion feedback avoids the problem that the traditional fixed compensation parameter scheme is difficult to cope with dynamic distortion, thereby effectively improving the image quality of the three-dimensional display system in different display regions. BRIEF DESCRIPTION OF DRAWINGS

[0021] In order to more clearly illustrate the technical solutions in the present application or the prior art, the following will briefly introduce the drawings needed to be used in the embodiments or prior art description. Obviously, the drawings in the following description are some embodiments of the present application, and for those skilled in the art, other drawings can also be obtained without creative labor.

[0022] Figure 1is a schematic diagram of an optical path of a three-dimensional display optical system provided by an embodiment of the present application.

[0023] Figure 2 is a schematic diagram of an optical path of a three-dimensional display optical system with distortion provided by an embodiment of the present application.

[0024] Figure 3 is a schematic diagram of a non-periodic image unit arrangement caused by distortion provided by an embodiment of the present application.

[0025] Figure 4 is a schematic diagram of a flow of a non-periodic encoding method for suppressing three-dimensional display distortion provided by an embodiment of the present application.

[0026] Figure 5 is a comparison diagram before and after suppressing three-dimensional distortion provided by an embodiment of the present application.

[0027] Figure 6 is a schematic diagram of a non-periodic encoding device for suppressing three-dimensional display distortion provided by an embodiment of the present application.

[0028] Figure 7 is a schematic diagram of an electronic device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0029] In order to make the objects, technical solutions and advantages of the present application clearer, the technical solutions in the present application will be described clearly and completely below with reference to the drawings in the present application. Obviously, the described embodiments are some of the embodiments of the present application, but not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the scope of protection of the present application.

[0030] A three-dimensional display is a display device capable of presenting a stereoscopic image, and has been widely used in medical, educational, industrial design and other fields. The basic principle of realizing stereoscopic display is as follows: first, a multi-viewpoint image is processed by a specific synthesis encoding parameter, then the processed image is loaded onto a two-dimensional display panel, and finally a light control device is used to form a viewpoint display area with different parallax in space. When the left and right eyes of the observer are located in different viewpoint areas, the stereoscopic effect can be perceived due to the reception of image information with parallax.

[0031] However, in actual naked-eye three-dimensional display systems, the display effect is often affected in multiple aspects due to the inherent characteristics of the optical system. The most critical problem is the non-uniformity of the magnification of the optical system, which is also known as "field magnification non-uniformity" or "field curvature". In an ideal state, the optical system should ensure that all object points have consistent magnification when imaging to maintain the clarity and consistency of the image. However, in actual optical systems, on-axis object points and field edge object points experience different light paths, resulting in differences in the beam convergence points. This difference is mainly due to the inherent limitations of optical elements such as lenses or gratings, causing the magnification to change with the position of the field of view, thereby affecting the presentation of stereoscopic vision.

[0032] This magnification non-uniformity is particularly evident at the boundary of a large field of view. When the boundary image points of the display unit pass through the light control device, the actual viewpoint display area formed in space will deviate significantly from the ideal design position. This deviation directly leads to the reduction of the effective field of view, making it difficult for the system to achieve the expected large field of view display effect. More seriously, this non-uniformity of field magnification also causes the deviation of the field edge image and the on-axis image in depth perception, seriously affecting the coherence of the stereoscopic vision experience.

[0033] In addition to the problem of magnification non-uniformity, the deviation between the actual light path and the ideal light path also leads to non-uniformity of the viewpoint distribution. When the viewpoint interval cannot be maintained consistently, distortion occurs in the entire acquisition and display process. This distortion causes the audience to see incorrect perspective relationship content at certain viewpoint positions, disrupting the accuracy of stereoscopic display. This problem is more pronounced in large field of view naked-eye three-dimensional display systems, as the difference in light paths between on-axis object points and field edge object points is greater when imaging.

[0034] Furthermore, optical elements in actual production inevitably have machining errors, which are superimposed with the distortion aberration of the system itself, further reducing the quality of the display effect. This impact is particularly evident in large field of view conditions, as a larger field of view means that light needs to travel a more complex light path, further amplifying the impact of various error factors.

[0035] Therefore, to achieve a high-quality three-dimensional display system, the key lies in how to increase the display field of view while effectively compensating for the light path impact caused by distortion. This requires precise design and adjustment of the optical system to ensure consistent stereoscopic vision experience in a large field of view range by reducing the variation of magnification. Although three-dimensional display technology has become a hot research area, there is still a lack of high-quality display solutions that can effectively solve the above problems. The breakthrough of this technical bottleneck is of great significance for improving the overall performance of three-dimensional display systems.

[0036] In the development of three-dimensional display technology, the performance of display system is often restricted by the mutual constraint between multiple parameters. There is an inevitable trade-off relationship between the key parameters such as field of view, depth of field, resolution and spatial information capacity (number of viewpoints). This inherent constraint makes the three-dimensional display scheme that can achieve excellent overall display quality particularly valuable.

[0037] As a complex optical system, three-dimensional display is inevitably affected by optical aberration. Among them, the parallax image distortion problem caused by distortion is particularly significant. This distortion mainly affects the display effect through two ways: on the one hand, it is reflected in the influence of the view area boundary on the large field of view three-dimensional light field, and on the other hand, it is reflected in the influence of the view area internal viewpoint on the display clarity and depth of field range.

[0038] In the view area boundary region, the distortion problem is particularly prominent. Because the view area boundary point is often close to the view area of the adjacent view area, and the view area content is significantly different between different view areas, which leads to a serious break in the viewing experience. Specifically, distortion will cause the view area of the three-dimensional display system to have a jump delay phenomenon. More seriously, with the increase of the distance from the optical axis, the degree of distortion shows an increasing trend. This means that the larger the field of view of the display system, the more serious the influence of distortion, not only difficult to achieve the expected large field of view display effect, but also aggravate the incoherence of view area switching. The existence of this problem greatly limits the actual performance of high-quality three-dimensional display system.

[0039] And in the view area, the influence of distortion cannot be ignored. The view area inside the view point will also be disturbed by the distortion, causing the system to be unable to accurately construct the light field according to the ideal light path. This problem makes it difficult for even a well-designed three-dimensional display system to present an ideal display effect. To understand this phenomenon, we need to start from the formation mechanism of light field viewpoint information.

[0040] In the ideal case, the light emitted by the image unit (pixel or sub-pixel) in the display unit should accurately converge to form uniformly distributed viewpoints in space after passing through the corresponding optical lens, and each angle of light carries specific directional three-dimensional viewpoint information. According to the light path reversibility principle, please refer to Figure 1 , Figure 1 An ideal three-dimensional display optical system light path schematic diagram provided by the embodiment of the present application is shown in Figure 1 After passing through the ideal optical lens, the light v01 should accurately reach the position of the elemental image unit p01. In this ideal state, the three-dimensional display system can construct multiple accurate viewpoints in the complete view area, and by filling the corresponding parallax images at these viewpoint positions, an ideal stereoscopic visual experience can be provided for the audience.

[0041] However, aberrations inevitably exist in actual optical devices, especially distortion, which is the most significant optical aberration affecting display quality. Please refer to Figure 2 , Figure 2 A three-dimensional display optical system with distortion provided by an embodiment of the present application is shown in the optical path diagram. As shown in Figure 2 , due to the influence of distortion, light ray v01 may deviate from the expected path and reach the position of element image unit p02. This deviation of the optical path not only leads to the incorrect construction of three-dimensional reconstruction information, but also the deviation becomes more and more obvious with the increase of the distance from the optical axis. Therefore, when we perform reverse tracking analysis on the single-view optical path, we find a significant phenomenon: in the area close to the optical axis, the image unit distribution is relatively sparse, while in the area away from the optical axis, the image units are densely arranged, forming a non-periodic image unit arrangement mode as shown in Figure 3 , Figure 3 A non-periodic image unit arrangement diagram generated by distortion provided by an embodiment of the present application is shown in the figure.

[0042] The consequence of this non-periodic arrangement is serious. Since the parallax image content of each view point comes from the lens units at different positions on the display screen, the non-periodic arrangement caused by distortion makes the image content from the same view point unable to accurately converge. This means that the image seen by the audience at a certain view point will be disturbed by the content of adjacent view points. More troublesome is that as the depth range of the display content increases, the difference between the contents of adjacent view points will also increase, further reducing the display quality of each view point. The existence of distortion essentially limits the overall performance of the display system in terms of clarity and depth range.

[0043] Although the current light field display technology has the ability to adapt to different sizes of display screens, it still lacks effective solutions to the non-periodic problem of image units caused by optical distortion. The breakthrough of this technical bottleneck is of great significance to achieve higher quality three-dimensional display effect.

[0044] Based on the problems existing in the prior art, please refer to Figure 4 , Figure 4 A flowchart of a non-periodic encoding method for suppressing three-dimensional display distortion provided by an embodiment of the present application is shown in the figure. The method can be implemented by relying on a computer program, can be implemented by relying on a single-chip microcomputer, and can also run on a non-periodic encoding system for suppressing three-dimensional display distortion based on the von Neumann system. The computer program can be integrated in an application, or can be run as an independent tool application. Specifically, the method can include the following steps:

[0045] S101, obtaining a to-be-processed image displayed by a three-dimensional display.

[0046] The to-be-processed image refers to an image with distortion when displayed on a three-dimensional display, and the distortion is mainly caused by the optical characteristics and manufacturing errors of the light control structure. In the embodiments of the present application, it can be understood that due to the deviation between the actual light path and the ideal light path, the display unit forms a large deviation between the ideal region and the viewpoint display region in space after passing through the light control structure, and then the parallax image appears as a non-uniformly deformed image when displayed. For example, when the boundary image point of the display unit passes through the light control structure, due to the influence of serious distortion, it will cause the field of view to become small, the interval between the viewpoints to be uneven, and other problems. The to-be-processed image is used to obtain the distortion coefficient by comparison and analysis with the standard image, and then the non-periodic coding compensation is performed based on the distortion coefficient, so as to correct the three-dimensional display distortion, and finally ensure that the observer can obtain continuous and uniform stereoscopic visual effect.

[0047] On the basis of the above-mentioned embodiments, as an optional embodiment, in S101, the step of obtaining the to-be-processed image displayed by the three-dimensional display specifically further includes the following steps:

[0048] S201, obtaining a first image in the three-dimensional display.

[0049] The first image refers to an original image of a display picture of the three-dimensional display directly collected by a camera. In the embodiments of the present application, it can be understood that based on the initial synthesis coding parameter matrix, the image displayed by the three-dimensional display after synthesizing and coding the multi-viewpoint image may or may not have distortion. The first image is used for comparison and analysis with the standard image, the distortion value is calculated and compared with the distortion threshold value, whether the three-dimensional display has display distortion that needs to be corrected is judged, and then it is determined whether to take it as the to-be-processed image.

[0050] Specifically, in order to determine whether the three-dimensional display exists display distortion and make corresponding correction, first need to obtain the first image in the three-dimensional display. In practical applications, the three-dimensional display is provided with an initial synthesis encoding parameter matrix, which is used for synthesizing and encoding the input multi-view image, so as to present a stereoscopic effect on the display panel. In the specific acquisition process, a light field camera with high resolution and no obvious distortion itself is selected, the camera is placed in the front and center of the display screen, and the collection distance is adjusted according to the size of the display screen, for example, for a 65-inch LCD display screen, the camera is preferably placed at a distance of 1.2 meters in front of the display screen. Since the camera-acquired picture may contain content outside the display frame, image processing algorithms such as edge detection are needed to crop the collected picture to limit the range of the first image within the effective display area of the three-dimensional display. The first image obtained by this standardized acquisition method can ensure the accuracy and reliability of the data when compared with the standard image for subsequent analysis, providing good basic data support for determining whether the three-dimensional display exists distortion.

[0051] S202, obtaining a distortion value of the first image relative to the standard image.

[0052] The distortion value refers to a quantitative index for characterizing the deviation degree of the first image relative to the standard image, which is calculated by a relative distortion value solving model. The value reflects the actual display deviation degree caused by the optical properties and manufacturing errors of the light control structure. The distortion value is used to compare with a preset distortion threshold value to determine whether the display distortion of the three-dimensional display reaches a degree that needs to be corrected, so as to determine whether the first image is determined as a to-be-processed image, and then perform subsequent non-periodic encoding compensation processing.

[0053] On the basis of the above embodiment, as an optional embodiment, in S202, the step of obtaining the distortion value of the first image relative to the standard image can further include the following steps:

[0054] S301, obtaining imaging point matrices of the first image and the standard image.

[0055] The standard image refers to a reference image without distortion in an ideal state, which reflects the ideal display effect of the three-dimensional display system without optical distortion. In the embodiment of the application, it can be understood that: under the influence of the optical properties and manufacturing errors of the light control structure, the standard checkerboard pattern is obtained by ideal light path design, wherein the display areas of each view point are uniformly distributed, and the parallax image content is continuous. The standard image is used as a reference benchmark for evaluating the distortion degree of the first image, and the display distortion is quantified by comparing and analyzing the first image.

[0056] Correspondingly, the imaging point matrix refers to a two-dimensional data array describing the spatial distribution of feature points in the image. In the embodiments of the present application, it can be understood as a point position data matrix obtained based on the set checkerboard corner point array, wherein matrix A corresponds to the corner point position data of the first image, matrix B corresponds to the corner point position data of the standard image, and each matrix element contains the physical size coordinates of the corresponding corner point in the x and y directions of the image plane. The imaging point matrix is used to calculate the distortion value by the relative distortion value solving model, and then evaluate the display distortion degree of the three-dimensional display, so as to provide a basis for subsequent non-periodic coding compensation.

[0057] S302, calculate the similarity of the imaging point matrix of the first image and the standard image, and obtain the distortion value of the first image relative to the standard image.

[0058] Specifically, after obtaining the imaging point matrix, the display distortion degree needs to be quantitatively evaluated by calculating the similarity of the imaging point matrix of the first image and the standard image. In actual application, a relative distortion value solving model is used to construct the relationship between the two groups of imaging point matrices. The specific calculation formula is:

[0059] ;

[0060] Wherein A is the point matrix of the first image, B is the point matrix of the standard image, and Dist is the relative distortion value between the two;

[0061] When the light control structure has optical property deviation or manufacturing error, the corner point position in the first image will be offset relative to the standard image, and this offset will be directly reflected in the numerical difference of the imaging point matrix. For example, in the case of radial distortion, the corner point position offset away from the center of the optical axis will be more obvious, resulting in a larger difference value of the corresponding matrix element; and in the ideal case, the corresponding elements of the two matrices should be basically consistent. Through this matrix similarity-based calculation method, the quantitative index of display distortion can be accurately obtained, which not only objectively reflects the display quality of the three-dimensional display, but also provides reliable data support for subsequent judgment of whether distortion correction is needed.

[0062] S203, judge whether the distortion value is greater than the distortion threshold value, if the distortion value is greater than the distortion threshold value, determine that the three-dimensional display has three-dimensional display distortion, and determine the first image as the image to be processed.

[0063] Specifically, after the distortion value is obtained, it is necessary to compare the distortion value with a preset distortion threshold to determine whether the three-dimensional display has display distortion that needs to be corrected. In actual application, the calculated relative distortion value is compared with the set distortion threshold, where the set distortion threshold represents the maximum distortion tolerance acceptable by the three-dimensional display system. The setting of this value is related to the specific application requirements of the display system. The higher the display requirement, the lower the value of the maximum distortion tolerance should be. When the comparison result shows that the distortion value is greater than the set distortion threshold, it indicates that the light control structure in the three-dimensional display has a distortion influence on the display effect that exceeds the tolerance range. At this time, the first image needs to be determined as the image to be processed, in order to prepare for subsequent distortion correction processing.

[0064] For example, when the boundary point of the display unit forms a view point display area in space after passing through the light control structure, which deviates greatly from the ideal area, resulting in a smaller field of view or uneven view point spacing, the distortion value often exceeds the threshold. The above-mentioned threshold-based processing method can effectively identify the display content that needs to be corrected for distortion, avoiding unnecessary processing of images with small distortion. At the same time, this method also provides a clear processing object for subsequent non-periodic encoding compensation, which helps to achieve accurate distortion correction and ultimately ensures that the observer can obtain continuous and uniform stereoscopic visual effect.

[0065] When the relative distortion value is less than or equal to the set distortion threshold, it indicates that the display distortion of the three-dimensional display is within an acceptable range, and no distortion correction processing is needed. In actual application, this situation means that the light control structure has a small influence on the display effect, and the deviation between the view point display area formed by the display unit after passing through the light control structure and the ideal area is within the allowable range.

[0066] For example, when the optical element in the display system has high processing precision, or the display content is mainly distributed in the central area with small distortion, the distortion value often does not exceed the threshold. At this time, the corner point position in the first image is basically the same as that in the standard image, and the display effect of the parallax image is good, which can ensure that the observer obtains ideal stereoscopic visual experience.

[0067] S102, obtaining a distortion coefficient of the image to be processed relative to the standard image.

[0068] The distortion coefficients refer to a set of quantitative parameters describing the degree of geometric deformation of the display content caused by the light control structure in the three-dimensional display. In the embodiments of the present application, it can be understood as a five-dimensional vector including radial distortion coefficients (k1, k2, k3) and tangential distortion coefficients (p1, p2), wherein the radial distortion coefficients describe the degree of nonlinear deformation along the radial direction, and the tangential distortion coefficients describe the degree of tangential deformation perpendicular to the radial direction. The distortion coefficients are used to establish a mapping relationship between the actual display point position and the ideal display point position through a distortion transformation model, and then guide the subsequent non-periodic encoding compensation process, so as to realize accurate correction of the three-dimensional display distortion.

[0069] On the basis of the above-mentioned embodiments, as an optional embodiment, in S102, the step of obtaining the distortion coefficients of the to-be-processed image relative to the standard image can further include the following steps:

[0070] S301, based on the imaging point matrix of the to-be-processed image and the standard image, determining the radial distortion and the tangential distortion of the to-be-processed image.

[0071] The radial distortion and the tangential distortion refer to two main types of geometric deformation caused by the light control structure in the three-dimensional display system. The radial distortion refers to nonlinear deformation along the radial direction from the optical axis center, which is manifested as different degrees of magnification or reduction of the image with the increase of the distance from the optical axis center; the tangential distortion refers to the position offset perpendicular to the radial direction, which is mainly caused by the installation deviation or manufacturing error of the light control structure.

[0072] In an optional implementation, the radial distortion and the tangential distortion of the to-be-processed image can be accurately calculated by the Brown algorithm. In actual application, the algorithm measures the similarity between the to-be-processed image and the standard image by constructing a distortion transformation model, and determines the optimal distortion coefficients through iterative optimization. Specifically, the distortion transformation model can be established as follows:

[0073] ;

[0074] ;

[0075] The distortion coefficients can be expressed as: wherein, is the ideal image point matrix coordinate, is the generated image point matrix coordinate, is the optical axis center point coordinate, and is usually .

[0076] In the model solving process, the algorithm optimizes the distortion coefficient by continuously merging adjacent data clusters until the position error of the corresponding points of the to-be-processed image and the standard image under the action of the current distortion coefficient is less than a preset threshold, and the distortion coefficient obtained at this time is the final result. This solving method based on iterative optimization can consider the influence of radial distortion and tangential distortion at the same time, can accurately describe the distortion characteristics of the light control structure at different positions, and can ensure the stability and reliability of the solving result, thereby providing accurate parameter support for subsequent non-periodic coding compensation.

[0077] S302, taking the radial distortion and the tangential distortion as the distortion coefficient of the to-be-processed image relative to the standard image.

[0078] S103, obtaining the non-periodic coding of the to-be-processed image based on the distortion coefficient.

[0079] The non-periodic coding of the to-be-processed image refers to a mapping relationship of re-encoding the display unit of the to-be-processed image based on the distortion coefficient. The coding no longer follows the traditional equal-period arrangement rule, but is adaptively adjusted according to the distortion characteristics of the light control structure at different positions.

[0080] In the embodiment of the application, it can be understood that the remapping scheme of the distorted pixel to the ideal position is established by optical path backtracking, wherein the encoding position of each display unit is determined by the degree of distortion suffered by the unit, that is, the actual offset amount calculated according to the radial distortion coefficient and the tangential distortion coefficient is used to determine the final encoding position.

[0081] When the display unit is located in a region with large distortion, the pixel thereof may be encoded into the region of the adjacent display unit; and in a region with small distortion, the offset amount of the pixel encoding position is relatively small. The non-periodic coding of the to-be-processed image is used to compensate for the optical distortion caused by the light control structure, the display unit is re-encoded and mapped, so that the actual display effect after the light control structure can match the ideal display effect, and finally the three-dimensional display distortion is effectively corrected.

[0082] On the basis of the above embodiment, as an optional embodiment, in S103, the step of obtaining the non-periodic coding of the to-be-processed image based on the distortion coefficient can further include:

[0083] S401, determining the distortion coefficient of each pixel point of the to-be-processed image.

[0084] Specifically, in order to realize accurate non-periodic coding, it is necessary to first determine the specific distortion coefficient of each pixel point in the to-be-processed image to accurately describe the distortion characteristics of the display unit at different positions. In actual application, based on the radial distortion coefficient and the tangential distortion coefficient obtained in the foregoing steps, the specific distortion parameter of each pixel point in the to-be-processed image needs to be calculated.

[0085] Specifically, for any pixel point in the image to be processed, first, the distance of the point to the center of the optical axis needs to be determined, and then the distortion components of the pixel point in the radial direction and the tangential direction are calculated based on the distance. In this way, the specific distortion parameters of each pixel point in the image to be processed in the horizontal direction and the vertical direction can be obtained, which accurately quantifies the degree of geometric deformation of the point. For example, for a pixel point far from the center of the optical axis, its radial distortion component is often more significant; while for the tangential distortion caused by the installation deviation, it is mainly reflected in the position offset in a certain direction.

[0086] S402, based on the optical path reversibility principle, a mapping relationship between the distortion coefficient corresponding pixel point position and the ideal pixel point position is constructed.

[0087] Specifically, after obtaining the distortion coefficients of each pixel point, a mapping relationship needs to be constructed based on the optical path reversibility principle to determine the specific scheme of distortion compensation. In actual application, since the distortion of the light control structure will cause the deviation of the light propagation path, the ideal display position of the pixel point can be determined by reversing the tracking of the light path.

[0088] Specifically, first, the actual light propagation path of each pixel point in the image to be processed after passing through the light control structure is analyzed, and then based on the distortion coefficient of the pixel point, the light propagation path in the ideal state is reversely deduced, thereby establishing the corresponding relationship between the actual pixel point position and the ideal pixel point position. For example, when a display unit in the edge region is severely affected by distortion, the corresponding pixel point may deviate from the expected position during actual display, at which time the correct position of these pixel points in the ideal display state can be determined by light path reverse tracking, and an accurate position mapping relationship is established. This mapping method based on the optical path reversibility principle can accurately restore the influence of the light control structure on the light propagation, not only can determine the ideal display position of each pixel point, but also can judge whether the pixel point needs to be re-allocated to the adjacent display unit, and realize accurate compensation for display distortion.

[0089] S403, generating non-periodic encoding of the image to be processed based on the mapping relationship.

[0090] Specifically, after constructing the mapping relationship, the non-periodic encoding of the image to be processed needs to be generated based on the mapping relationship to realize effective compensation for display distortion. In actual application, by re-encoding the display position of each pixel point, it can present the ideal display effect after passing through the light control structure.

[0091] Specifically, first, the target position of each pixel point after distortion compensation is determined according to the established position mapping relationship, and then the encoding mode of the display unit is adjusted, and the pixel information is redistributed to the corresponding display position. When the display unit is located in a severely distorted area, its pixels may be encoded into the area of the adjacent display unit, no longer following the traditional equal period arrangement rule; while in the area with smaller distortion, only a slight adjustment of the pixel position is needed.

[0092] For example, for the edge display area far from the center of the optical axis, due to the existence of large radial distortion, the corresponding pixel point may need to be encoded to the inside by a certain distance; while in the central area, due to the smaller distortion, the adjustment range of pixel encoding is also smaller. This non-periodic encoding method based on the mapping relationship can effectively compensate for the distortion of the light control structure in different areas, and ensure that the entire display area can obtain uniform and continuous three-dimensional display effect.

[0093] S104, adjusting the encoding module of the display unit corresponding to the light control structure in the three-dimensional display based on the non-periodic encoding.

[0094] The light control structure includes at least one of a slit grating, a cylindrical lens grating, a micro-hole array, a lens array, or a combination thereof.

[0095] After non-periodic encoding of the image to be processed, the display unit corresponding to the light control structure in the three-dimensional display needs to be adjusted based on the encoding to recombine the display light to realize distortion correction. In actual application, by adjusting the voxel projected by the corresponding light control unit in a non-periodic encoding form, the light distribution of the three-dimensional light field display system is optimized.

[0096] Specifically, first, the non-periodic encoding information is converted into the projection parameters of the light control unit, different projection strategies are adopted for display units at different positions, so that the projection light can accurately converge to the expected observation position. When the display unit is located in the edge area of the large field of view, due to the influence of the large distortion of the voxel projection path, part of the voxel information needs to be redistributed to the adjacent light control unit for projection; while in the central area of the field of view, only a slight adjustment of the projection direction of the voxel is needed.

[0097] For example, for the area affected by severe radial distortion, the projection parameters of the corresponding light control unit are adjusted so that the voxel can be accurately projected to the designed observation space; for the area with optical path difference, the projection path of the voxel is optimized to compensate for the influence of the optical path error. This light recombination method based on voxel projection can effectively optimize the reconstruction process of three-dimensional light field by non-periodic encoding adjustment of the light control unit, ensure the formation of accurate stereoscopic image in a large field of view, and make the observer obtain ideal naked-eye three-dimensional display effect.

[0098] Please refer to Figure 5 , Figure 5 A three-dimensional display distortion suppression method is provided. The method includes the following steps: acquiring an initial generated image of a three-dimensional display device from a specific view angle by using a high-precision camera, and acquiring a standard image corresponding to the initial generated image; calculating a relative distortion ratio between the initial generated image and the standard image; and adjusting a synthesis encoding parameter matrix of the initial generated image based on a Brown algorithm when the relative distortion ratio exceeds a preset distortion threshold.

[0099] When the relative distortion ratio exceeds the preset distortion threshold, it indicates that the distortion in the display system has reached a level that needs to be corrected. At this time, the method will start the distortion compensation process. In the compensation process, the synthesis encoding parameter matrix of the initial generated image is first adjusted. This adjustment is based on the Brown algorithm, which can accurately extract the distortion characteristics of the system and generate corresponding distortion coefficients. These distortion coefficients accurately describe the geometric deformation characteristics of the display system, providing a reliable mathematical basis for subsequent distortion compensation.

[0100] After obtaining the distortion coefficients, the coefficients can be fused with the pixel encoding algorithm to establish a non-periodic pixel encoding scheme. This encoding scheme breaks through the limitations of traditional equal-period encoding and can adaptively adjust the encoding method of pixels according to the distortion degree at different positions. Through this non-periodic encoding compensation mechanism, the system can effectively offset the geometric deformation caused by optical distortion.

[0101] After completing the encoding adjustment, the multi-view image is re-encoded using the updated synthesis encoding parameter matrix to generate a new display picture. The system will continue to monitor the relative distortion ratio between the newly generated picture and the ideal image, and iteratively optimize when necessary until the distortion ratio is reduced below the set threshold. This closed-loop optimization mechanism ensures the accuracy and reliability of distortion compensation.

[0102] Please refer to Figure 6 , Figure 6 A structure diagram of a non-periodic encoding device for suppressing three-dimensional display distortion is provided. The non-periodic encoding device for suppressing three-dimensional display distortion includes:

[0103] An image to be processed acquisition module is configured to acquire an image to be processed displayed by a three-dimensional display device.

[0104] A distortion coefficient acquisition module is configured to acquire distortion coefficients of the image to be processed relative to a standard image.

[0105] The non-periodic code obtaining module is configured to obtain non-periodic code of the image to be processed based on the distortion coefficient.

[0106] The non-periodic code adjusting module is configured to adjust the code module of the display unit corresponding to the light control structure of the three-dimensional display based on the non-periodic code.

[0107] On the basis of the above embodiment, as an optional embodiment, the image to be processed obtaining module is further configured to obtain a first image in the three-dimensional display; obtain a distortion value of the first image relative to the standard image; determine whether the distortion value is greater than a distortion threshold value; if the distortion value is greater than the distortion threshold value, determine that the three-dimensional display has three-dimensional display distortion, and determine the first image as the image to be processed.

[0108] On the basis of the above embodiment, as an optional embodiment, the image to be processed obtaining module is further configured to obtain imaging point matrices of the first image and the standard image; calculate the similarity of the imaging point matrices of the first image and the standard image to obtain a distortion value of the first image relative to the standard image.

[0109] On the basis of the above embodiment, as an optional embodiment, the distortion coefficient obtaining module is further configured to determine radial distortion and tangential distortion of the image to be processed based on the imaging point matrices of the image to be processed and the standard image; and take the radial distortion and the tangential distortion as the distortion coefficient of the image to be processed relative to the standard image.

[0110] On the basis of the above embodiment, as an optional embodiment, the non-periodic code obtaining module is further configured to determine the distortion coefficient of each pixel point of the image to be processed; construct a mapping relationship between the pixel point position corresponding to the distortion coefficient and the ideal pixel point position based on the optical path reversibility principle; and generate the non-periodic code of the image to be processed based on the mapping relationship.

[0111] Figure 7 An example of an entity structure diagram of an electronic device is shown in FIG. 7. Figure 7 As shown in FIG. 7, the electronic device can include a processor 710, a communications interface 720, a memory 730, and a communications bus 740, wherein the processor 710, the communications interface 720, and the memory 730 can communicate with each other through the communications bus 740. The processor 710 can invoke a logical instruction in the memory 730 to execute the non-periodic code method for suppressing three-dimensional display distortion.

[0112] In addition, the logic instructions in the memory 730 described above can be implemented in the form of software function units and sold or used as independent products, and can be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application essentially or the parts that contribute to the prior art or parts of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium, and includes a number of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of the present application. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk or an optical disk, and various media that can store program codes.

[0113] In another aspect, the present application also provides a computer program product, which comprises a computer program, the computer program can be stored on a non-transitory computer readable storage medium, and the computer program can be executed by a processor to enable a computer to execute the non-periodic encoding method for suppressing three-dimensional display distortion provided by the above-mentioned methods.

[0114] In another aspect, the present application also provides a non-transitory computer readable storage medium, which stores a computer program, and the computer program is executed by a processor to implement the non-periodic encoding method for suppressing three-dimensional display distortion provided by the above-mentioned methods.

[0115] The device embodiments described above are only schematic, wherein the units described as separate components can or can not be physically separate, and the components displayed as units can or can not be physical units, i.e., they can be located in one place, or distributed on multiple network units. Part or all of the modules can be selected according to actual needs to achieve the purpose of the present embodiment. Those skilled in the art can understand and implement without creative labor.

[0116] From the above description of the embodiments, those skilled in the art can clearly understand that the embodiments can be implemented by means of software and the necessary general hardware platform, and of course, can also be implemented by hardware. Based on such understanding, the technical solutions described above essentially or the parts that contribute to the prior art can be embodied in the form of a software product. The computer software product can be stored in a computer readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes a number of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in various embodiments or some parts of the embodiments.

[0117] It should be pointed out finally that the above embodiments are only used to illustrate the technical solutions of the present application, but not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that the technical solutions recorded in the foregoing embodiments can still be modified, or some technical features therein can be replaced equivalently; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A non-periodic encoding method for suppressing distortion in three-dimensional display, characterized by, The method comprises the following steps: acquiring a to-be-processed image displayed by a three-dimensional display; acquiring a distortion coefficient of the to-be-processed image relative to a standard image; acquiring a non-periodic code of the to-be-processed image based on the distortion coefficient; adjusting a coding module of a display unit corresponding to a light control structure in the three-dimensional display based on the non-periodic code; the acquiring of the to-be-processed image with three-dimensional display distortion comprises: acquiring a first image in the three-dimensional display; acquiring a distortion value of the first image relative to the standard image; judging whether the distortion value is greater than a distortion threshold value; if the distortion value is greater than the distortion threshold value, it is determined that the three-dimensional display has three-dimensional display distortion, and the first image is determined as the to-be-processed image; the acquiring of the distortion coefficient of the to-be-processed image relative to the standard image comprises: determining radial distortion and tangential distortion of the to-be-processed image based on imaging point matrices of the to-be-processed image and the standard image; taking the radial distortion and the tangential distortion as the distortion coefficient of the to-be-processed image relative to the standard image; the acquiring of the non-periodic code of the to-be-processed image based on the distortion coefficient comprises: determining distortion coefficients of each pixel point of the to-be-processed image; constructing a mapping relationship between a pixel point position corresponding to the distortion coefficient and an ideal pixel point position based on the optical path reversibility principle; generating the non-periodic code of the to-be-processed image based on the mapping relationship; the generating of the non-periodic code of the to-be-processed image based on the mapping relationship comprises: determining target positions of each pixel point after compensation of distortion according to the mapping relationship; adjusting a coding mode of the display unit according to the target positions, and re-distributing pixel information to corresponding display positions. The light control structure comprises at least one of a slit grating, a column lens grating, a micro-hole array and a lens array. The adjusting of the coding module of the display unit corresponding to the light control structure in the three-dimensional display based on the non-periodic code comprises: adjusting a voxel projected by a corresponding light control unit according to the non-periodic code to determine light distribution of the three-dimensional display.

2. The non-periodic encoding method of claim 1, wherein, The acquiring of the distortion value of the first image relative to the standard image comprises: acquiring imaging point matrices of the first image and the standard image; calculating a similarity of the imaging point matrices of the first image and the standard image to obtain the distortion value of the first image relative to the standard image.

3. A non-periodic encoding device for suppressing distortion in a three-dimensional display, characterized by comprising: The method comprises the following steps: a to-be-processed image acquisition module is configured to acquire a to-be-processed image displayed by a three-dimensional display; a distortion coefficient acquisition module is configured to acquire a distortion coefficient of the to-be-processed image relative to a standard image; a non-periodic code acquisition module is configured to acquire a non-periodic code of the to-be-processed image based on the distortion coefficient; a non-periodic code adjustment module is configured to adjust a coding module of a display unit corresponding to a light control structure in the three-dimensional display based on the non-periodic code; the to-be-processed image acquisition module is specifically configured to: acquire a first image in the three-dimensional display; acquire a distortion value of the first image relative to the standard image; judge whether the distortion value is greater than a distortion threshold value; If the distortion value is greater than the distortion threshold value, it is determined that the three-dimensional display has three-dimensional display distortion, and the first image is determined as a to-be-processed image; The distortion coefficient acquisition module is specifically configured to: Determine radial distortion and tangential distortion of the to-be-processed image based on an imaging point matrix of the to-be-processed image and a standard image; The radial distortion and the tangential distortion are taken as distortion coefficients of the to-be-processed image relative to the standard image; The non-periodic code acquisition module is specifically configured to: Determine distortion coefficients of each pixel point of the to-be-processed image; Based on the light path reversibility principle, a mapping relationship between the distortion coefficient corresponding pixel point position and the ideal pixel point position is constructed; Based on the mapping relationship, a non-periodic code of the to-be-processed image is generated; The non-periodic code of the to-be-processed image is generated based on the mapping relationship, including: According to the mapping relationship, a target position of each pixel point after compensation distortion is determined; According to the target position, the encoding mode of the display unit is adjusted, and pixel information is re-allocated to the corresponding display position. The light control structure includes at least one of a slit grating, a cylindrical lens grating, a micropore array, and a lens array. The encoding module for adjusting the display unit corresponding to the light control structure in the three-dimensional display based on the non-periodic code includes: According to the non-periodic code, the light distribution of the three-dimensional display is determined by adjusting the voxel projected by the corresponding light control unit.

4. An electronic device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that, The processor executes the computer program to implement the non-periodic code method for suppressing three-dimensional display distortion according to any one of claims 1 or 2.

5. A non-transitory computer-readable storage medium having stored thereon a computer program, characterized in that, The computer program is executed by the processor to implement the non-periodic code method for suppressing three-dimensional display distortion according to any one of claims 1 or 2.

6. A computer program product comprising a computer program, characterized in that, The computer program is executed by the processor to implement the non-periodic code method for suppressing three-dimensional display distortion according to any one of claims 1 or 2.

Images