A fast spatial channel construction method for stereoscopic display

Abstract

In order to solve the problem of light coverage on the lens and the image element generation speed in the traditional integrated imaging method of obtaining image elements describing the viewpoint position, the present invention proposes a method for quickly constructing a spatial channel for stereoscopic display. This method no longer generates image elements describing the viewpoint position by virtually shooting the viewpoint position, but obtains a viewpoint space function that can cover the entire lens format by reverse tracing the viewpoint position, and describes the viewpoint space position with the viewpoint space function. The space function can directly generate image elements describing the viewpoint position using a computer program, that is, quickly establish a channel from the lens array and the viewpoint recording layer to the human eye position, thereby meeting the real-time requirements of viewpoint generation.

Description

Technical Field

[0001] The present invention belongs to the field of stereoscopic display technology, and more specifically, relates to a method for quickly constructing a spatial channel for stereoscopic display. Background Art

[0002] The Chinese invention patent "A stereoscopic display device based on viewpoint morphology recording" (publication number: CN116990983A) discloses a device that records viewpoints by a lens array and a viewpoint recording layer, and provides parallax images by a transparent liquid crystal display panel to form a stereoscopic display; further, in order to solve the viewpoint position planning problem, the Chinese invention patent "A viewpoint planning component for stereoscopic display" (publication number: CN117939106A) discloses a viewpoint acquisition method based on an integrated imaging shooting method, which uses a traditional integrated imaging virtual shooting method to enable the generated viewpoint to meet the viewpoint setting needs of any number of viewers and any viewing position. However, the above-mentioned disclosed technologies are all based on the virtual shooting technology of integrated imaging to obtain image elements describing the viewpoint position, and the calculation process requires a lot of time, which is difficult to meet the needs of the stereoscopic display to adjust the viewpoint generation position in real time according to the position of the human eye; in addition, the traditional integrated imaging shooting method is also difficult to solve the problem of lens light coverage, that is, the light transmitted through any lens at the viewpoint position should cover all the widths of the lens.

[0003] To this end, the present invention proposes a method for quickly constructing a spatial channel for stereoscopic display. The method no longer generates image elements describing the viewpoint position by virtually shooting the viewpoint position, but obtains a viewpoint space function that can cover the entire lens format by reverse tracing the viewpoint position, and describes the viewpoint space position with the viewpoint space function. The spatial function can directly generate image elements describing the viewpoint position using a computer program, that is, quickly establish a channel from the lens array and the viewpoint recording layer to the human eye position, thereby meeting the real-time requirements of viewpoint generation. Summary of the invention

[0004] In order to solve the two major problems in the method of obtaining image elements describing the viewpoint position by traditional integrated imaging shooting, that is, the light propagated through any lens at the viewpoint position is difficult to cover all the formats of the lens, and the traditional integrated imaging shooting method has a large amount of calculation and is difficult to meet the requirement of real-time change of image elements with the viewpoint position, the present invention proposes a method for quickly constructing a spatial channel for stereoscopic display.

[0005] The method configures a lens array and a viewpoint recording layer as a spatial channel construction system in hardware, wherein the lens array is placed before the viewpoint recording layer and is aligned with the viewpoint recording layer; the spatial channel construction system can construct a spatial channel from the viewpoint recording layer to the viewpoint destination position via the lens array, and the construction of the spatial channel is specifically realized by projecting image elements on the viewpoint recording layer via the lens array; a transparent liquid crystal display panel is placed in the imaging optical path of the spatial channel construction system; when the lens array and the viewpoint recording layer construct a spatial channel pointing to a certain viewpoint destination position, the transparent liquid crystal display panel provides a parallax image corresponding to the viewpoint position, so that the human eye can see the corresponding parallax image at the reproduced viewpoint position, thereby realizing stereoscopic display.

[0006] The method for the viewpoint recording layer to quickly construct the spatial channel through the lens array to the viewpoint destination is as follows:

[0007] (1) Assume that the pitch of the lens array is p , the distance from the lens array to the viewpoint recording layer is l , the size of a certain viewpoint sink is q , the distance from the viewpoint signal sink to the lens array is d , the distance from the center of the viewpoint signal sink to the central axis of the lens array is u ( x , y ),in x is the distance from the center of the viewpoint sink to the center axis of the lens array in the horizontal direction, y is the distance from the center of the viewpoint signal sink to the central axis of the lens array in the vertical direction; then the viewpoint space function can be generated, specifically including the viewpoint space periodic function t , viewpoint space displacement function s , and the viewpoint space radius function r , t , s and r An image element used to describe the spatial channel of the lens array and the viewpoint recording layer pointing to the viewpoint sink element position;

[0008] (2) Viewpoint periodic space function t = p ×( d + l ) / d ;

[0009] (3) Viewpoint space displacement function s Contains horizontal displacement component s ( x ) and vertical displacement component s ( y );

[0010] (4) If the number of columns of the lens array is even, then s ( x ) = ( x + p / 2) × l / d + p / 2;

[0011] (5) If the number of columns of the lens array is an odd number, then s ( x ) = x × l / d ;

[0012] (6) If the number of rows of the lens array is even, then s ( y ) = ( y + p / 2) × l / d + p / 2;

[0013] (7) If the number of rows of the lens array is odd, then s ( y ) = y × l / d ;

[0014] (8) Viewpoint space radius function r = q × l / d + φ , φ The distance to the lens array is d The diameter of the imaging spot of any point light source at the position on the viewpoint recording layer through any lens;

[0015] Preferably, φ By setting up the optical model in the optical software and substituting the structural parameters of the distance from the lens array to the viewpoint recording layer l , the distance from the viewpoint sink to the lens array d and lens focal length f After simulation, it is obtained and summarized as an empirical function;

[0016] (9) The image element of the spatial channel of the lens array and the viewpoint recording layer pointing to the viewpoint sink element position is based on t , s and r Function to generate ， The image element is t Construct a bright spot array image for the period, sis the offset of the bright spot array relative to the central axis of the lens array, r is the diameter of each bright spot in the light source array;

[0017] Optionally, the process of generating image elements from viewpoint space functions is implemented with Matlab program code.

[0018] Optionally, the lens array is replaced by a cylindrical lens grating and generates image elements with the same viewpoint space function, but the image elements are t Construct a one-dimensional bright stripe array image for the period, s is the one-dimensional offset of the one-dimensional bright fringe array relative to the central axis of the cylindrical lens grating, r is the width of each bright stripe in the one-dimensional bright stripe array.

[0019] When there is an occlusion relationship between different sink elements relative to the lens array, the sink elements farther from the lens array do not need to generate spatial channels.

[0020] In the above process, the spatial position of the known viewpoint destination d , u and q In the case of p , l and f The viewpoint space function can be quickly obtained through the formula, and the image element can be quickly generated through the code, thus avoiding the long and complicated process of obtaining the image element by modeling and rendering with the camera array in the traditional method. φ Parameters are entered from optical simulation software l , d and lens focal length f After determining the parameters, the reverse tracing of the light can ensure that the light covers the entire lens format, thereby solving the problem of light coverage of the lens in traditional integrated imaging methods. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 It is a schematic diagram of the hardware structure of the present invention.

[0022] Figure 2 It is a schematic diagram of the calculation principle of the present invention when the number of rows and columns of the lens array is an even number.

[0023] Figure 3 It is a schematic diagram of the calculation principle of the present invention when the number of rows and columns of the lens array is an odd number.

[0024] Icon: 100 - viewpoint recording layer; 200 - lens array; 300 - viewpoint destination element; 400 - transparent liquid crystal display panel; 101 - bright spot.

[0025] It should be understood that the above drawings are only schematic and are not drawn to scale. DETAILED DESCRIPTION

[0026] Figure 1 A schematic diagram of the hardware structure of a method for rapidly constructing a spatial channel for stereoscopic display provided in this embodiment.

[0027] The method configures a viewpoint recording layer 100 and a lens array 200 in hardware as a spatial channel construction system, wherein the lens array 200 is placed in front of the viewpoint recording layer 100 and is aligned with the viewpoint recording layer 100; the spatial channel construction system can construct a spatial channel from the viewpoint recording layer 100 to the viewpoint destination position via the lens array 200, and the construction of the spatial channel is specifically achieved by projecting image elements on the viewpoint recording layer 100 via the lens array 200; a transparent liquid crystal display panel 400 is placed in the imaging optical path of the spatial channel construction system; when the lens array 200 and the viewpoint recording layer 100 construct a spatial channel pointing to a certain viewpoint destination position, the transparent liquid crystal display panel 400 provides a parallax image corresponding to the viewpoint position, so that the human eye can see the corresponding parallax image at the reproduced viewpoint position, thereby achieving stereoscopic display.

[0028] For hardware configuration, please refer to Figure 2 In the first embodiment when the number of rows and columns of the lens array 200 is an even number, the method for the viewpoint recording layer 100 to quickly construct a spatial channel through the lens array 200 to reach the viewpoint destination is as follows:

[0029] (1) Assume that the pitch of the lens array 200 is p is 8.47 mm, and the distance from the lens array 200 to the viewpoint recording layer 100 l 5 mm, the size of the sink element 300 at a certain viewpoint q is 5 mm, the distance from the viewpoint sink element 300 to the lens array 200 d is 495 mm, and the distance from the center of the viewpoint sink element 300 to the central axis of the lens array 200 is u ( x , y ),in x = 20 mm is the distance from the center of the viewpoint sink element 300 to the central axis of the lens array 200 in the horizontal direction, y= 40 mm is the distance from the center of the viewpoint sink element 300 to the central axis of the lens array 200 in the vertical direction; the focal length of the lens array f= 5 mm; then the viewpoint space function can be generated, including the viewpoint space periodic function t , viewpoint space displacement function s , and the viewpoint space radius function r .t , s and r An image element used to describe the spatial channel of the lens array 200 and the viewpoint recording layer 100 pointing to the position of the viewpoint sink element 300;

[0030] (2) Viewpoint periodic space function t =8.56 mm, which satisfies t = p ×( d + l ) / d ;

[0031] (3) Viewpoint space displacement function s Contains horizontal displacement component s ( x ) and vertical displacement component s ( y );

[0032] (4) Since the number of columns of the lens array 200 is an even number, s ( x ) =4.48 mm, which satisfies s ( x ) = ( x + p / 2) × l / d + p / 2;

[0033] (5) Since the number of rows of the lens array 200 is an even number, s ( y ) =4.68 mm, which satisfies s ( y )= ( y + p / 2) × l / d + p / 2;

[0034] (6) Viewpoint space radius function r =0.13 mm, which satisfies r = q × l / d + φ , φ =0.08 mm is the distance to the lens array 200 d The diameter of the imaging spot of any point light source at the position on the viewpoint recording layer through any lens;

[0035] φBy setting up the optical model in the optical software and substituting the structural parameters of the distance from the lens array to the viewpoint recording layer l , the distance from the viewpoint sink to the lens array d and lens focal length f After simulation, it is obtained and summarized as an empirical function;

[0036] (7) The image element of the spatial channel of the lens array 200 and the viewpoint recording layer 100 pointing to the position of the viewpoint sink element 300 is based on t , s and r Function to generate ， The image element is t Construct an array of image highlights for the cycle, s is the offset of the image bright spot array relative to the central axis of the lens array 200, r is the diameter of each bright spot 101 in the image bright spot array, such as Figure 1 As shown;

[0037] The above process of generating image elements from viewpoint space functions is implemented with Matlab program script code.

[0038] For hardware configuration, please refer to Figure 3 In the second embodiment when the number of rows and columns of the lens array 200 are all odd numbers, the method for the viewpoint recording layer 100 to quickly construct a spatial channel through the lens array 200 to reach the viewpoint destination is as follows:

[0039] (a) Suppose the pitch of the lens array 200 is p is 8.47 mm, and the distance from the lens array 200 to the viewpoint recording layer 100 l 5 mm, the size of the sink element 300 at a certain viewpoint q is 5 mm, the distance from the viewpoint sink element 300 to the lens array 200 d is 495 mm, and the distance from the center of the viewpoint sink element 300 to the central axis of the lens array 200 is u ( x , y ),in x = 20 mm is the distance from the center of the viewpoint sink element 300 to the central axis of the lens array 200 in the horizontal direction, y= 40 mm is the distance from the center of the viewpoint sink element 300 to the central axis of the lens array 200 in the vertical direction; the focal length of the lens array f= 5 mm; then the viewpoint space function can be generated, including the viewpoint space periodic function t , viewpoint space displacement function s , and the viewpoint space radius function r . t ,s and r An image element used to describe the spatial channel of the lens array 200 and the viewpoint recording layer 100 pointing to the position of the viewpoint sink element 300;

[0040] (b) Viewpoint periodic space function t =8.56 mm, which satisfies t = p ×( d + l ) / d ;

[0041] (c) Viewpoint space displacement function s Contains horizontal displacement component s ( x ) and vertical displacement component s ( y );

[0042] (d) Since the number of columns of the lens array 200 is an odd number, s ( x ) = 0.2 mm, which satisfies s ( x ) = x × l / d ;

[0043] (e) Since the number of rows of the lens array 200 is an odd number, s ( y ) = 0.4 mm, which satisfies s ( y ) = y × l / d ;

[0044] (f) Viewpoint space radius function r =0.13 mm, which satisfies r = q × l / d + φ , φ =0.08 mm is the distance to the lens array 200 d The diameter of the imaging spot of any point light source at the position on the viewpoint recording layer through any lens;

[0045] φ By setting up the optical model in the optical software and substituting the structural parameters of the distance from the lens array to the viewpoint recording layer l , the distance from the viewpoint sink to the lens array d and lens focal length f After simulation, it is obtained and summarized as an empirical function;

[0046] (g) The image element of the spatial channel of the lens array 200 and the viewpoint recording layer 100 pointing to the viewpoint sink element 300 is based on t , s and r Function to generate ， The image element is t Construct an array of image highlights for the cycle, s is the offset of the image bright spot array relative to the central axis of the lens array 200, r is the diameter of each bright spot 101 in the image bright spot array, such as Figure 1 As shown;

[0047] The above process of generating image elements from viewpoint space functions is implemented with Matlab program script code.

[0048] For hardware configuration, please refer to Figure 3 , the lens array 200 is replaced by a cylindrical lens grating, and the number of columns of the cylindrical lens grating is an odd number, which constitutes the third embodiment of the present invention. The method for the viewpoint recording layer 100 to quickly construct a spatial channel via the cylindrical lens grating to reach the viewpoint destination is as follows:

[0049] ① Assume the pitch of the cylindrical lens grating p The distance from the cylindrical lens grating to the viewpoint recording layer is 8.47 mm. l 5mm, the size of the sink element 300 at a certain viewpoint q is 5 mm, and the distance from the viewpoint sink element 300 to the cylindrical lens grating d is 495 mm, and the distance from the center of the viewpoint sink element 300 to the central axis of the cylindrical lens grating is u ( x ),in x = 20 mm is the distance from the center of the viewpoint sink element 300 to the central axis of the cylindrical lens grating in the horizontal direction, and the cylindrical lens focal length of the cylindrical lens grating f= 5 mm; then the viewpoint space function can be generated, including the viewpoint space periodic function t , viewpoint space displacement function s , and the viewpoint space radius function r . t , s and r An image element used to describe the spatial channel of the cylindrical lens grating and the viewpoint recording layer 100 pointing to the position of the viewpoint sink element 300;

[0050] ②Viewpoint periodic space function t =8.56 mm, which satisfies t = p ×( d +l ) / d ;

[0051] ③Viewpoint space displacement function s Contains horizontal displacement component s ( x ), which does not contain vertical displacement components due to the use of cylindrical lens gratings s ( y );

[0052] ④ Since the number of columns of the cylindrical lens grating is an odd number, s ( x ) = 0.2 mm, which satisfies s ( x ) = x × l / d ;

[0053] ⑤ Viewpoint space radius function r =0.13 mm, which satisfies r = q × l / d + φ , φ =0.08 mm is the distance to the cylindrical lens grating. d The width of the bright stripe on the viewpoint recording layer from any point light source at the position through any cylindrical lens;

[0054] φ By setting up the optical model in the optical software and substituting the structural parameters of the distance from the lens array to the viewpoint recording layer l , the distance from the viewpoint sink to the lens array d and lens focal length f After simulation, it is obtained and summarized as an empirical function;

[0055] ⑥ The image element of the spatial channel of the cylindrical lens grating and the viewpoint recording layer 100 pointing to the viewpoint sink element 300 is based on t , s and r Function to generate ， The image element is t Construct a one-dimensional bright stripe array image for the period, s is the one-dimensional offset of the one-dimensional bright fringe array relative to the central axis of the cylindrical lens grating, r is the width of each bright stripe in the one-dimensional bright stripe array.

[0056] The above process of generating image elements from viewpoint space functions is implemented with Matlab program script code.

[0057] In the first embodiment, the second embodiment and the third embodiment, when the spatial position of the viewpoint sink is known, d , u and q In the case of p , l and f The viewpoint space function can be quickly obtained through the formula, and the image element can be quickly generated through the code, thus avoiding the long and complicated process of obtaining the image element by modeling and rendering with the camera array in the traditional method. φ Parameters are entered from optical simulation software l , d and lens focal length f After determining the parameters, the reverse tracing of the light can ensure that the light covers the entire lens format, thereby solving the problem of light coverage of the lens in traditional integrated imaging methods.

Claims

1. A method for quickly constructing a spatial channel for stereoscopic display, characterized in that: The method sets a lens array and a viewpoint recording layer as a spatial channel construction system in hardware, wherein the lens array is placed before the viewpoint recording layer and is aligned with the viewpoint recording layer; the spatial channel construction system is used to construct a spatial channel from the viewpoint recording layer to the viewpoint destination position via the lens array, and the construction of the spatial channel is specifically realized by projecting image elements on the viewpoint recording layer via the lens array; a transparent liquid crystal display panel is placed in the imaging optical path of the spatial channel construction system; when the lens array and the viewpoint recording layer construct a spatial channel pointing to a certain viewpoint destination position, the transparent liquid crystal display panel provides a parallax image corresponding to the viewpoint position, so that human eyes can see the corresponding parallax image at the reproduced viewpoint position, thereby realizing stereoscopic display; The method for the viewpoint recording layer to quickly construct the spatial channel through the lens array to the viewpoint destination is as follows: (1) Assume that the pitch of the lens array is p , the distance from the lens array to the viewpoint recording layer is l , the size of a certain viewpoint sink is q , the distance from the viewpoint signal sink to the lens array is d , the distance from the center of the viewpoint signal sink to the central axis of the lens array is u ( x , y ),in x is the distance from the center of the viewpoint sink to the center axis of the lens array in the horizontal direction, y is the distance from the center of the viewpoint sink to the central axis of the lens array in the vertical direction; based on the above parameters, a viewpoint space function is generated, which specifically includes a viewpoint space periodic function t , viewpoint space displacement function s , and the viewpoint space radius function r , t , s and r An image element used to describe the spatial channel of the lens array and the viewpoint recording layer pointing to the viewpoint sink element position; (2) Viewpoint periodic space function t = p ×( d + l ) / d ; (3) Viewpoint space displacement function s Contains horizontal displacement component s ( x ) and vertical displacement component s ( y ); (4) If the number of columns of the lens array is even, then s ( x ) = ( x + p / 2) × l / d + p / 2; (5) If the number of columns of the lens array is an odd number, then s ( x ) = x × l / d ; (6) If the number of rows of the lens array is even, then s ( y ) = ( y + p / 2) × l / d + p / 2; (7) If the number of rows of the lens array is odd, then s ( y ) = y × l / d ; (8) Viewpoint space radius function r = q × l / d + φ , φ The distance to the lens array is d The diameter of the imaging spot of any point light source at the position on the viewpoint recording layer through any lens; (9) The image element of the spatial channel of the lens array and the viewpoint recording layer pointing to the viewpoint sink element position is based on t , s and r Function to generate ， The image element is t Construct a bright spot array image for the period, s is the offset of the bright spot array relative to the central axis of the lens array, r is the diameter of each bright spot in the light source array; When there is an occlusion relationship between different sink elements relative to the lens array, the sink elements farther from the lens array do not need to generate spatial channels.

2. A method for rapidly constructing spatial channels for stereoscopic display according to claim 1, characterized in that: φ By setting up the optical model in the optical software and substituting the structural parameters of the distance from the lens array to the viewpoint recording layer l , the distance from the viewpoint sink to the lens array d and lens focal length f It is then simulated and summarized as an empirical function.

3. The method for rapidly constructing a spatial channel for stereoscopic display according to claim 1, characterized in that: The lens array is replaced by a cylindrical lens grating, and the image element is generated with the same viewpoint space function, but the image element is t Construct a one-dimensional bright stripe array image for the period, s is the one-dimensional offset of the one-dimensional bright fringe array relative to the central axis of the cylindrical lens grating, r is the width of each bright stripe in the one-dimensional bright stripe array.

Images