Method for correcting multi-display light field fusion conflict

Abstract

The invention discloses a method for correcting light field fusion conflicts of multiple displayers, and relates to the technical field of display equipment, the multiple displayers are formed by splicing a plurality of LCD panels, a cylindrical lens grating plate is arranged in front of the LCD panels, a plurality of cameras are arranged opposite to the cylindrical lens grating plate, and the cameras are connected into a camera correction system; the correction process of the camera correction system is as follows: S1, acquiring initial light path data; s2, acquiring effective light path data; s3, constructing a light path data matrix; and S4, image correction iterative optimization. According to the method for correcting the light field fusion conflict of the multiple displays, light field crosstalk is corrected, continuous light fields are generated among the multiple display areas, and the display effect is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of display devices, and in particular to a method for correcting light field fusion conflicts of multiple displays. Background Art

[0002] Light field fusion display technology can present images or videos to the audience in a three-dimensional form. By simulating the human eye's perception of depth, it can provide users with a more realistic and immersive visual experience. In the fields of entertainment, education, medical care, industry and military, it can put users in a virtual three-dimensional environment and achieve an immersive feeling. The development of this technology is inseparable from the progress of hardware equipment, image processing algorithms and other technologies. With the continuous upgrading of display devices, continuous progress and innovation have brought users a richer and more immersive visual experience, and also promoted the development and application of related technologies such as virtual reality, augmented reality and mixed reality.

[0003] At present, the ideal light field fusion display technology can perfectly reproduce the real three-dimensional space and has different and broad application potentials in various fields. However, due to the limitations of the size of light field display devices, it is impossible to produce two-dimensional display screens of various sizes to generate three-dimensional information. Therefore, it is necessary to fuse multiple display devices to adapt to three-dimensional screens with different needs. However, the assembly errors of multiple light field display units will inevitably introduce crosstalk. The observer will see the superimposed image content from different light control units at one position, which is intuitively manifested as blurred three-dimensional images, resulting in a decrease in the quality of three-dimensional images, which makes it impossible for multiple light field display units to be accurately fused.

[0004] In addition, due to the aberrations and processing errors of optical devices, there is always a gap between the ideal optical path and the actual optical path, and the viewpoint spacing cannot be guaranteed to be absolutely the same. If the uniformity of the viewpoints is not guaranteed, there will be differences in the acquisition and display processes, and the audience will see incorrect perspective content in certain viewpoints of the light field display unit. In addition, the density of the viewpoints can ensure the smooth parallax of the light field, and the sparseness of local viewpoints will destroy the comfortable parallax transition. Even when the viewpoint interval is greater than the audience's pupil distance, it will not provide the viewer with a sense of stereo. In the fusion of multiple light field display units, the uniformity of the viewpoint density must be guaranteed.

[0005] In short, although light field display technology can be adapted to different screens, there is still a lack of high-quality three-dimensional display solutions that can improve the light field fusion conflict problem caused by multiple light field display units. Summary of the invention

[0006] The purpose of the present invention is to provide a method for correcting the light field fusion conflict of multiple displays, correcting the light field crosstalk, generating a continuous light field between multiple display areas, and improving the display effect.

[0007] To achieve the above object, the present invention provides a method for correcting the light field fusion conflict of multiple displays, wherein the multiple displays are formed by splicing multiple LCD panels, a cylindrical lens grating plate is arranged in front of the LCD panel, and one or more cameras are arranged opposite to the cylindrical lens grating plate, and the cameras are connected to a camera correction system; The correction process of the camera correction system is as follows: S1. Obtaining initial light path data: Turn on the sub-pixels on the LCD panel in a preset order until all sub-pixels are traversed. The light emitted by each sub-pixel at different times passes through the cylindrical lens grating plate, and the different light distributions formed are recorded by the camera as initial light path data; S2, obtaining effective optical path data: filtering and weighting the initial optical path data recorded at different times to obtain effective optical path data; S3, constructing a light path data matrix: constructing a screen light path model based on each valid light path data, and obtaining a light path data matrix with errors to be corrected for the entire light field by fitting the light path model data; S4. Iterative optimization of image correction: Compare the optical path data matrix with errors with the ideal optical path data matrix, determine the correction parameters based on the comparison results, perform preliminary correction on the optical path data matrix with errors, repeat the comparison and correction steps for multiple times to perform iterative optimization and obtain the final corrected image.

[0008] Preferably, in S2, for each camera, the luminous area in the initial light path data obtained at each moment is the effective area, which contains sub-pixel position coordinate information and effective brightness value information. The initial light path data is weighted with the effective brightness value as the weight factor, and then the weighted data is smoothed to obtain a valid data matrix.

[0009] Preferably, in S4, the process of correcting the actual image includes: adjusting the spatial position coordinates mapped by the cylindrical lens grating plate corresponding to the sub-pixel.

[0010] Therefore, the present invention adopts a method for correcting the conflict of multi-display light field fusion using the above steps. In order to perfectly fuse the visual areas of the multi-display light fields, the ideal light path and the actual light path are compared and corrected. In order to make the correction result as accurate as possible, multiple iterations of the camera calculation results are performed. In the display system thus formed, the light field crosstalk is corrected, a continuous light field is generated between the multiple display areas, and the display effect is improved.

[0011] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1A schematic diagram of multiple displays and cameras according to an embodiment of a method for correcting light field fusion conflicts of multiple displays of the present invention; Figure 2 A schematic diagram of a correction process according to an embodiment of the present invention; Figure 3 A schematic diagram of a non-corrected display effect according to an embodiment of the present invention; Figure 4 A schematic diagram of a display effect after correction according to an embodiment of the present invention; Figure 5 Schematic diagram of viewpoint and object point distribution according to an embodiment of the present invention.

[0013] Reference numerals 1. Camera; 2. Multiple displays; 3. Cylindrical lens grating plate. DETAILED DESCRIPTION

[0014] The technical solution of the present invention is further described below through the accompanying drawings and embodiments.

[0015] Example like Figure 1 and Figure 2 As shown, the multi-display 2 is composed of multiple LCD panels, a cylindrical lens grating plate 3 is arranged in front of the LCD panel, and one or more cameras 1 are arranged opposite the cylindrical lens grating plate 3, and the camera 1 is connected to the camera correction system. Light is emitted from the sub-pixels on the LCD panel, and the emitted light is collimated in the vertical direction and diverged in the horizontal direction.

[0016] by Figure 3 Taking the three horizontal naked-eye 3D light field unit fusion display effects as an example, according to the setting of the view area content, in the ideal pure viewpoint, the three light field units should all be displayed as pure white. In the view area setting of this group of multi-displays 2, there is only one viewpoint whose display content is a pure white image, and the display content of other viewpoints in the view area is all black. The pure white viewpoint has been severely crosstalked by the black viewpoint, which means that the light field fusion has a conflict. The correction process through the camera correction system is as follows: S1, obtaining initial light path data: turning on the sub-pixels on the LCD panel in a preset order until all the sub-pixels are traversed, and the light emitted by each sub-pixel at different times passes through the cylindrical lens grating plate 3, and the different light distributions formed are recorded by the camera 1 as initial light path data; S2. Obtain effective light path data: Filter and weight the initial light path data recorded at different times to obtain effective light path data. For each camera 1, the luminous area in the initial light path data obtained at each moment is the effective area. In the process from the initial data to the effective data, the part of the light path data with high brightness is taken, and the dark light path data is filtered out. The effective area contains sub-pixel position coordinate information and effective brightness value information. The effective brightness value is the brightness, which represents the bright part marked by the initial light path data at each moment. The initial light path data is weighted with the effective brightness value as the weight factor, and the fusion of the bright position displayed by the sub-pixel through the cylindrical lens is obtained by weighting. The weighted data is then smoothed to obtain an effective data matrix.

[0017] S3, constructing an optical path data matrix: In order to avoid the fragmentation of weighted data acquired by a single camera 1, it is necessary to perform fitting processing on the effective optical path data matrices of multiple cameras 1. That is, after constructing a screen optical path model for each effective optical path data, the final optical path data matrix of the entire light field display system is obtained by fitting the optical path model data, which is also the optical path data matrix with errors to be corrected.

[0018] S4, iterative optimization of image correction: compare the optical path data matrix with errors with the ideal optical path data matrix, and the optical path data matrix with errors is reflected on the display surface to form an actual image with defects. The direction of the image correction is the ideal image without defects, and the intrinsic parameters of the ideal image are the ideal optical path data matrix. According to the comparison results, the correction parameters are determined, and the optical path data matrix with errors is preliminarily corrected. Repeat the comparison and correction steps for multiple times to iteratively optimize and obtain the final corrected image. The correction process includes: adjusting the spatial position coordinates of the cylindrical lens grating plate mapping corresponding to the sub-pixel.

[0019] The corrected multi-display 2 light field is as follows Figure 4 As shown in the figure, the light field crosstalk is corrected, and a continuous light field is generated between the multiple display areas, which improves the display effect.

[0020] To achieve the natural fusion of multiple light field display units, the purity (low crosstalk) of each viewpoint in the constructed three-dimensional light field must be strictly guaranteed. If the crosstalk between viewpoints is not resolved, the audience will see superimposed image content from different viewpoints at one position, which is intuitively manifested as a decrease in the quality of the displayed three-dimensional image, making it impossible for multiple light field display units to be accurately fused.

[0021] In addition, the uniformity of viewpoints in space will also affect the fusion quality of multi-light field display units. Figure 5As shown, there is always a gap between the ideal optical path and the actual optical path, and the viewpoint interval cannot be guaranteed to be absolutely the same. If the uniformity of the viewpoint is not guaranteed, there will be differences in the acquisition and display processes, and the audience will see the wrong perspective relationship content in some viewpoints of the light field display unit.

[0022] The 3D display method uses ray tracing to fill in viewpoint content. This method encodes the synthetic image based on the ideal light path of the light field constructed by the 3D display system. However, the ray tracing synthetic image method that relies on the ideal light path often does not meet expectations in practical applications. There is always crosstalk between the viewpoints constructed by the 3D display system, which poses a great challenge to the fusion of the 2 light fields of multiple displays. The synthetic image method of ray tracing can provide high-quality viewpoints for the audience in the viewing area.

[0023] Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that they can still modify or replace the technical solution of the present invention with equivalents, and these modifications or equivalent replacements cannot cause the modified technical solution to deviate from the spirit and scope of the technical solution of the present invention.

Claims

1. A method for correcting multi-display light field fusion conflicts, characterized by: The multi-display is composed of multiple LCD panels. A cylindrical lens grating plate is arranged in front of the LCD panel. One or more cameras are arranged opposite to the cylindrical lens grating plate. The cameras are connected to the camera correction system. The correction process of the camera correction system is as follows: S1. Obtaining initial light path data: Turn on the sub-pixels on the LCD panel in a preset order until all sub-pixels are traversed. The light emitted by each sub-pixel at different times passes through the cylindrical lens grating plate, and the different light distributions formed are recorded by the camera as initial light path data; S2. Obtaining effective optical path data: filtering and weighting the initial optical path data recorded at different times to obtain effective optical path data; S3, constructing a light path data matrix: constructing a screen light path model based on each valid light path data, and obtaining a light path data matrix with errors to be corrected for the entire light field by fitting the light path model data; S4. Iterative optimization of image correction: Compare the optical path data matrix with errors with the ideal optical path data matrix, determine the correction parameters based on the comparison results, perform preliminary correction on the optical path data matrix with errors, repeat the comparison and correction steps for multiple times to perform iterative optimization and obtain the final corrected image.

2. The method for correcting multi-display light field fusion conflict according to claim 1, characterized in that: In S2, for each camera, the luminous area in the initial light path data obtained at each moment is the effective area, which contains sub-pixel position coordinate information and effective brightness value information. The initial light path data is weighted with the effective brightness value as the weight factor, and then the weighted data is smoothed to obtain a valid data matrix.

3. The method for correcting multi-display light field fusion conflict according to claim 1, characterized in that: In S4, the process of correcting the actual image includes: adjusting the spatial position coordinates mapped by the cylindrical lens grating plate corresponding to the sub-pixel.

Images