Multi-view naked-eye 3D content generation method for simulating off-axis camera

Abstract

The invention discloses a multi-view naked-eye 3D content generation method for simulating an off-axis camera, and the method comprises the steps: arranging a plurality of wide-angle cameras at the same horizontal position, calculating camera parameters through combining an observation visual angle, a shooting distance and the number of viewpoints, carrying out the distortion correction and image cutting through a calibration grid, and finally generating multi-view 3D content through real shooting. The problems of mechanical installation deviation, visual angle deviation, edge dislocation, focusing difficulty and the like of a traditional off-axis camera array are solved, the definition, depth and display compatibility of a 3D light field are improved, and the method is suitable for content production of a naked eye 3D display system.

Description

Technical Field

[0001] This invention belongs to the field of stereoscopic vision display technology and relates to a method for generating multi-view naked-eye 3D content by simulating an off-axis camera. Background Technology

[0002] Off-axis camera arrays are one of the mainstream technologies for generating multi-view naked-eye 3D content. They simulate human parallax by arranging multiple cameras off-axis to acquire multi-angle image information, which is then combined with naked-eye 3D display technology to recreate stereoscopic vision. Compared to parallel optical axis arrays, off-axis arrangement more closely resembles the convergence characteristics of the human eye, expanding the field of view and enhancing depth information. However, off-axis camera arrays have the following significant problems in practical applications: 1) The camera optical axis must be precisely pointed to the center of the scene; installation deviations can easily lead to viewpoint shifts and edge misalignments, affecting the natural transition of multi-view images; 2) The magnitude of parallax is determined by the camera spacing and off-axis angle; excessive parallax can cause viewing dizziness, while insufficient parallax weakens the stereoscopic effect; 3) Off-axis cameras are difficult to focus on the zero plane (focal plane), affecting image clarity and content accuracy; 4) Camera array adjustments are difficult, requiring high compatibility with shooting scenes and display devices, limiting its application scope. Therefore, there is an urgent need for a multi-view naked-eye 3D content generation method that can retain the advantages of off-axis shooting while avoiding its mechanical and optical defects. Summary of the Invention

[0003] The technical solution of this invention is used to solve the problems of high mechanical installation accuracy requirements and easy occurrence of viewing angle shift and edge misalignment in off-axis camera arrays.

[0004] The present invention solves the above-mentioned technical problems through the following technical solutions:

[0005] This invention provides a method for generating multi-view naked-eye 3D content using a simulated off-axis camera, comprising the following steps: S1. Determine the observable angle of view, shooting distance, focusing shooting range and number of viewpoints, and calculate the camera placement range, distance between adjacent cameras, shooting range and camera half field of view. S2. Place multiple wide-angle cameras at the same horizontal position according to their calculated positions, with consistent parameters; S3. Connect the camera and the capture card to achieve synchronous image capture; S4. Determine the zero plane and place the calibration grid to perform distortion correction and image cropping; S5. Place the object to be photographed within the zero plane area and shoot it to generate multi-view 3D content.

[0006] Furthermore, the formula for calculating the camera placement range is: (1) Where b represents the half-range where the camera is placed. For observational perspective, This refers to the shooting distance.

[0007] Furthermore, the formula for calculating the distance between adjacent cameras is as follows: (2) in, denoted as , where is the distance between adjacent cameras, and i is the number of viewpoints.

[0008] Furthermore, the formula for calculating the camera's shooting range is as follows: (3) in, 'a' represents the camera's shooting range, and 'a' represents the focusing shooting range.

[0009] Furthermore, the formula for calculating the camera's half field of view is: (4) Where α is the half field of view of the camera.

[0010] Furthermore, the cropping range of the image is: The cropped area on the left side of the image is as follows: (5) The cropped area on the right side of the image is as follows: (6) in, For counting factors, .

[0011] Furthermore, the cropped area is smaller than the camera's shooting area, and the cropped images have a consistent resolution.

[0012] Furthermore, the distortion correction includes, but is not limited to, trapezoidal distortion correction and fisheye distortion correction.

[0013] The present invention also provides an electronic device, including a memory and a processor, wherein the memory is used to store a program that supports the processor in executing the above-described method for generating multi-view naked-eye 3D content based on a simulated off-axis camera captured in real-life shooting, and the processor is configured to execute the program stored in the memory.

[0014] The present invention also provides a storage medium storing a computer program, which, when run by a processor, executes the steps of the above-described method for generating multi-view naked-eye 3D content using a simulated off-axis camera.

[0015] The beneficial effects of this invention are as follows: The technical solution of this invention avoids perspective shift and edge misalignment by horizontally arranging the camera and precisely cropping, thereby improving the clarity of 3D content; it eliminates the need for complex off-axis mechanical structures, reducing installation and adjustment difficulty; it is applicable to various naked-eye 3D optical solutions, expanding the range of shooting scenarios; it reduces dizziness and enhances stereoscopic visual effects through controllable parallax and image calibration; and it uses ordinary wide-angle cameras and standardized processes, reducing equipment costs and manufacturing difficulty. Attached Figure Description

[0016] Figure 1 This is a flowchart of the method of the present invention; Figure 2 This is a schematic diagram of the method of the present invention; Figure 3 This is a calibration grid diagram of the method of the present invention; Figure 4 This is a schematic diagram of the method of the present invention; Figure 5 This is a comparison image of the image captured by the method of the present invention and the image captured by an off-axis camera; Figure 6 It is a grid image taken using the method of this invention; Figure 7 It is a grid image taken with an off-axis camera. Detailed Implementation

[0017] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below in conjunction with the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0018] The technical solution of the present invention will be further described below with reference to the accompanying drawings and specific embodiments: Example 1 like Figure 1 As shown, a method for generating multi-view naked-eye 3D content based on a simulated off-axis camera captured in real-world shooting includes the following steps: Step 1, as follows Figure 2 As shown, based on the observable viewing angle, shooting distance, focused shooting range, and number of viewpoints of the naked-eye 3D light field, the range for placing the camera, the distance between adjacent cameras, the camera's shooting range, and the camera's half field of view are calculated; the specific calculation formulas are as follows: (1) (2) (3) (4) in, For observational perspective, Where 'a' is the shooting distance, 'i' is the focusing shooting range, 'i' is the number of viewpoints, and 'b' is the half-range where the camera is positioned (e.g., ...). Figure 2 (As shown in the middle left half) The distance between adjacent cameras. α represents the camera's field of view, where α is the camera's half-field of view.

[0019] Step 2: Place the cameras at the calculated positions on the same horizontal plane, with all cameras having the same parameters. Placing them on the same horizontal plane makes it easier to focus on the zero plane compared to off-axis shooting, ensuring clear and accurate capture.

[0020] Step 3: Connect the camera and the capture card to ensure the images are synchronized.

[0021] Step 4: Determine the zero plane, place a calibration grid at the zero plane, correct the distortion of the calibration grid, and crop all selected shooting range images.

[0022] The zero plane is the focal plane of the camera. The calibration grid covers the camera's shooting range. Distortion correction includes, but is not limited to, trapezoidal distortion correction and fisheye distortion correction. The cropped area is smaller than the camera's shooting range, and all cropped images have the same resolution.

[0023] The formula for calculating the cropping range of the image is as follows: The cropped area on the left side of the image is as follows: (5) The cropped area on the right side of the image is as follows: (6) in, For counting factors, .

[0024] Step 5: After completing the calibration in Step 4, place the object to be photographed within the set zero-plane shooting range and take a live shot to generate multi-view 3D content.

[0025] like Figure 5 As shown, this is a grid image taken using the method of the present invention. Figure 6 The image shown is a grid image taken with an off-axis camera, for comparison. Figure 5 and Figure 6 It can be seen that, from the same viewpoint, Figure 6Off-axis cameras often produce viewpoint shifts in their images. In contrast, the method of this invention uses real-world shooting at the same horizontal position, and then crops the captured image to generate multi-view 3D content. This improves the clarity of the 3D light field display, increases the display depth of the light field, and solves the problems of viewpoint shift and edge misalignment caused by the difficulty of off-axis cameras to focus on the zero plane, as well as the problems of weak optical compatibility and limited shooting scenarios caused by the difficulty of adjusting the viewpoint of off-axis camera arrays.

[0026] Example 2 An electronic device includes a memory and a processor, the memory being used to store a program that supports the processor in executing the multi-view naked-eye 3D content generation method based on a simulated off-axis camera as described in Embodiment 1, the processor being configured to execute the program stored in the memory.

[0027] Example 3 A storage medium storing a computer program, which, when executed by a processor, performs the steps of the multi-view naked-eye 3D content generation method based on a simulated off-axis camera in Embodiment 1.

[0028] The above embodiments are only used to illustrate the technical solutions of the present invention, and are not intended to limit it. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for generating multi-view naked-eye 3D content simulating an off-axis camera, characterized in that, Includes the following steps: S1. Determine the observable angle of view, shooting distance, focusing shooting range and number of viewpoints, and calculate the camera placement range, distance between adjacent cameras, shooting range and camera half field of view. S2. Place multiple wide-angle cameras at the same horizontal position according to their calculated positions, with consistent parameters; S3. Connect the camera and the capture card to achieve synchronous image capture; S4. Determine the zero plane and place the calibration grid to perform distortion correction and image cropping; S5. Place the object to be photographed within the zero plane area and shoot it to generate multi-view 3D content.

2. The method for generating multi-view naked-eye 3D content using a simulated off-axis camera according to claim 1, characterized in that, The formula for calculating the camera placement range is: （1） Where b represents the half-range where the camera is placed. For observational perspective, This refers to the shooting distance.

3. The method for generating multi-view naked-eye 3D content using a simulated off-axis camera according to claim 2, characterized in that, The formula for calculating the distance between adjacent cameras is: （2） in, denoted as , where is the distance between adjacent cameras, and i is the number of viewpoints.

4. The method for generating multi-view naked-eye 3D content using a simulated off-axis camera according to claim 3, characterized in that, The formula for calculating the camera's shooting range is: （3） in, 'a' represents the camera's shooting range, and 'a' represents the focusing shooting range.

5. The method for generating multi-view naked-eye 3D content using a simulated off-axis camera according to claim 4, characterized in that, The formula for calculating the camera's half field of view is: （4） Where α is the half field of view of the camera.

6. The method for generating multi-view naked-eye 3D content using a simulated off-axis camera according to claim 3, characterized in that, The cropping range of the image is: The cropped area on the left side of the image is as follows: （5） The cropped area on the right side of the image is as follows: （6） in, For counting factors, .

7. The method for generating multi-view naked-eye 3D content using a simulated off-axis camera according to claim 1, characterized in that, The cropped area is smaller than the camera's shooting area, and all cropped images have the same resolution.

8. The method for generating multi-view naked-eye 3D content using a simulated off-axis camera according to claim 1, characterized in that, The distortion correction includes trapezoidal distortion correction and fisheye distortion correction.

9. An electronic device, comprising a memory and a processor, characterized in that, The memory is used to store a program that supports the processor in executing a multi-view naked-eye 3D content generation method simulating an off-axis camera as described in any one of claims 1 to 8, and the processor is configured to execute the program stored in the memory.

10. A storage medium storing a computer program, characterized in that, When a computer program is run by a processor, it executes the steps of a multi-view naked-eye 3D content generation method based on any one of claims 1 to 8, as described in claims 1 to 8.

Images