Super-vision-field 3D stereo double-shooting technology system

Abstract

The invention discloses a super-vision-field 3D stereoscopic double-shooting technology system (hyper3D for short), and belongs to the technical field of 3D image double-shooting. Aiming at the problems of insufficient three-dimensional depth caused by a fixed baseline parameter (6-6.5 cm) and parallax distortion brightness loss and dizziness caused by a 2D-to-3D technology in the traditional 3D double camera, the invention provides a technical system based on cooperative displacement of double camera units and later parameter control. Through horizontal lateral displacement (12-30 cm) and angle rotation (1-3 degrees) of a left shooting unit, an optical parameter control module with the forced focal length larger than or equal to 50 mm is combined, the double-shooting vision field is expanded by 20%-50%, a later-stage reverse displacement compensation algorithm (close shot 1-3%, middle shot 3-5% and long shot 5-10%) is utilized, a picture body is aligned to the natural focusing position of human eyes, and the focusing effect is achieved. The high-immersion imaging effect that the three-dimensional layering sense is enhanced by 2-3 times and distortion is avoided is achieved. Technical parameters of the scheme are independent, mutual conversion with a traditional 3D video cannot be achieved, content quality is ensured from the source, and the method is suitable for the fields of movies and televisions, VR, element universe and the like.

Description

Technical Field

[0001] The present invention is a collaborative system for the displacement and rotation of dual-camera units and post-production parameter control. Through a parallax enhancement algorithm and parameter control system, it breaks through the natural field of view of the human eye to achieve a visual and tactile experience, giving people the feeling of going from watching a movie to touching the movie screen. It is suitable for scene construction of highly immersive 3D film and television production, VR, games, metaverses and related content. Background Art

[0002] Traditional 3D dual cameras have three major pain points; (1) Traditional 3D dual-camera parameters are single. According to Article 5.1 of GB / T 32003-2015 "Technical Specifications for 3D Film and Television Production", the baseline interpupillary distance is fixed at 6-6.5cm, resulting in insufficient three-dimensional depth and spatial layering of the picture effect.

[0003] (2) The image relies on analog technology to convert 2D to 3D, resulting in distorted brightness and parallax of the image, and severe loss of texture. Long-term viewing can easily cause dizziness and fatigue.

[0004] (3) The lack of unified system technical standards has led to uneven quality of 3D-related content and declining market acceptance year by year.

[0005] The Super 3D of this invention will solve the above pain points. Super 3D has an extremely strict and unique dual-camera technology solution. Through the 12-30cm dual-camera unit baseline displacement, rotation, and post-combination operations, the stereoscopic effect presented is 2-3 times that of the 6-6.5cm baseline of the traditional dual-camera unit. The effect is significant when tested on a 150-inch large screen and in VR, making 3D video images a breakthrough viewing experience that is within reach. Super 3D uses optical parameters with a focal length of no less than 50mm, which completely eliminates the edge perspective distortion caused by the stretching distortion of the wide-angle lens (24-35mm) in traditional 3D, and suppresses the causes of dizziness from a physical level. Super 3D videos are not interchangeable with traditional 3D videos, and 2D videos cannot be converted to Super 3D videos. Super 3D movies can be watched in the same theater as traditional 3D movies without changing equipment. In the future, AI will be irreplaceable in Super 3D. Therefore, it is necessary to invent a more standardized 3D dual-camera technology system solution with a super visual immersion experience to ensure the authoritative quality of 3D movies and related 3D content. Summary of the Invention (1) Technical issues to be resolved For traditional 3D dual cameras (such as Figure 1 ) in the presence of a fixed pupillary distance (e.g. Figure 1 20), resulting in insufficient stereo depth, reliance on 2D to 3D technology causing parallax brightness distortion and viewing fatigue, and the lack of unified technical standards leading to uneven content quality. Super 3D technology system solutions (such as Figure 2) provides a super-visual-range 3D stereoscopic imaging dual-camera technology achieved through unit displacement, precise optical parameter control and post-parallax enhancement algorithm, breaking through the limitations of the natural field of view of the human eye and building a highly immersive, dizziness-free 3D content production standard.

[0006] (2) Technical solution

[0007] Structured representation of the dual-camera collaborative module; 1. Right camera unit; fixed (such as Figure 2 17) The right eye viewing angle reference is located at the center of the pupil and is used to capture images within the standard field of view.

[0008] 2. Left camera unit; horizontal displacement (such as Figure 2 65) (displacement range 12-30cm flexible adjustment, offset to the left) and (such as Figure 2 (19) Clockwise rotation angle range 1°-3°, fixed the dual camera unit according to the subject-object distance of each lens. If the subject moves from far to near, the fixed medium distance parameters are used: - Near view (2-3m) ≤1°; - Medium ground (3-5m) ≤ 2°; - Long-range vision (5-20m) ≤ 3°.

[0009] Super visual field acquisition design; the left camera unit range exceeds the natural visual field of the human eye by 20%-50%, covering a wider left field of view (such as Figure 1 ) Traditional 3D dual-camera solution can only capture 10 to 15 images. Figure 2 The super 3D dual-camera unit solution can capture 10 to 15+7 shots, and the dual-camera unit can capture more and more three-dimensional content.

[0010] Later compensation mechanism; Figure 3 Taking the primary and secondary relationship as an example, Figure 3 22 to 27 are the main body, Figure 3 28 to 51 are secondary bodies, and the dual-camera unit takes the right unit as the reference to shoot the complete picture (such as Figure 4 55), the left camera unit completes the shooting (such as Figure 4 56), the left camera unit needs to be shifted to the right to adjust the focus. The width of the left camera unit is shifted according to the object distance. The right shift processing is 1-3% for close-up shots, 3-5% for mid-range shots, and 5-10% for distant shots. This allows the main subject of the image to be aligned with the natural pupil focus position, forming a super-visual field stereoscopic imaging parallax. The human monocular field of view (such as Figure 5 52, 53) 120° natural eye field of view, forming the best parallax range for focusing (such as Figure 5 54) The optimal field of view for human stereoscopic imaging (e.g. Figure 5 57) focus position, (such as Figure 528) is the focus point, which is the horizontal position of the visual screen and can be moved according to the visual performance needs of the subject (such as Figure 4 55, 56 in 28 ~ 51) the same digital focus flexible adjustment, (such as Figure 5 57) focus position, (such as Figure 5 28) is the focus point, (such as Figure 6 58) Focus point, (such as Figure 6 40) in the middle is the focus point.

[0011] Forced dual camera focal length ≥ 50mm, (such as Figure 2 The focal length of 62 and 63 is 50mm, which is better than the traditional ones (such as Figure 1 The focal length of 60 and 61 is 35mm, which makes the picture fuller and eliminates the need to use a wide-angle lens to enhance the three-dimensional effect, effectively avoiding picture stretching and distortion.

[0012] Optical parameter control system matching rules: 1. Basic optical parameter matching rules: - Working focal length: ≥50mm (50-135mm fixed-focus lens required); - Aperture value: f / 4-5.0 (balances depth of field and light intake to avoid image blur and motion blur); - Dual-camera subject distance: minimum 2m, maximum 20m (to ensure a three-dimensional sense of depth within the depth of field).

[0013] 2. Subject-object distance-focal length matching rules: - Close-up (2-3m): focal length 50-65mm; - Medium shot (3-5m): focal length 50-85mm; - Long shot (5-20m): focal length 50-135mm.

[0014] Core performance stereoscopic perception enhancement By fixing the right unit as the main baseline and displacing the left unit (12-30cm), the depth information of the captured image is increased, exceeding the natural field of view of the human eye by 20%-50%. Combined with the post-production offset adjustment of the parallax of the left and right eye images (the picture rendering output needs to be 20% larger than the original size), the depth perception neural circuit of the visual cortex is activated, forming an "at-hand" stereoscopic visual effect. The presented stereoscopic effect is 2-3 times that of the 6-6.5cm baseline of the traditional dual-camera unit.

[0015] Optimized viewing comfort By forcing a focal length of ≥50mm (to avoid wide-angle distortion) and an aperture of f / 4-5.0 (to balance depth of field), the camera physically reduces edge stretching distortion by over 70% (compared to a traditional 35mm lens), reducing the processing load on the visual cortex. After a 12-30cm displacement and 1°-3° rotation of the left camera unit, and through post-production compensation of 1%-10% reverse displacement, the subject parallax error is controlled to ≤0.3 pixels (the human brain's comfortable fusion threshold is ≤0.5 pixels). Testing with 30 subjects of various ages (18-65, encompassing adolescents, young adults, and the elderly) showed that 97% achieved natural focus on the first viewing, without any complaints of dizziness or eye fatigue. Typical test scenario parameter configuration: When shooting a mid-ground scene (object distance 4m), the left camera unit was displaced 18cm, rotated 2°, and had a focal length of 70mm. A 4% rightward displacement was compensated in post-production, achieving a parallax gradient of 1.0 (the human brain's optimal fusion gradient is 0.8-1.2). This validates the technical logic of this solution, which uses parameter coordination to control parallax within a natural processing range.

[0016] Building technical barriers The parallax parameter system of Super 3D video is completely independent from that of traditional 3D and 2D videos. The composite shooting technology principle of the dual-camera collaborative module baseline range (12-30cm), the left-camera 1°-3°, and the mandatory focal length ≥50mm is the uniqueness of Super 3D stereoscopic imaging, forming a technical feature that cannot be converted from traditional 3D, eliminating the impact of traditional low-quality 3D content and 2D-to-3D conversion on content quality from the source.

[0017] Super 3D technology novelty Prior art search results: Searching for keywords such as "dual-camera displacement + 3D shooting" and "super-viewing parallax enhancement" in professional databases (such as CNKI and WIPO) did not find any identical technical solutions. This was verified by non-patent literature. In academic conference paper repositories such as IEEE and SPIE, no 3D dual-camera solutions similar to "left camera lateral displacement + rotation compound motion" were found. The academic paper "Dynamic Baseline Adjustment for Stereo Vision" proposed an AI-based baseline optimization model, but did not incorporate hardware compound motion.

[0018] Application areas of super 3D technology Suitable for scenes lasting ≤10 minutes, such as VR / metaverses, trade shows, and theme parks, this system utilizes a 12-30cm baseline to enhance interactive immersion, such as touching virtual exhibits and experiencing giant-screen special effects. Each experience is limited to 5-10 minutes. For feature films, this system uses a gradual transition: 10-30 minutes of traditional 3D mode (6.5cm baseline) establishes visual cognition. From 30-80 minutes, the baseline linearly expands from 12cm to 20cm for mid- to long-range environments, interspersed with buffer shots. From 80-120 minutes, a 25-30cm baseline focuses on the climax. Strong stereoscopic shots are ≤30 seconds per shot, totaling ≤3 minutes. BRIEF DESCRIPTION OF THE DRAWINGS Figure 1 : Schematic diagram of the traditional 3D dual-camera unit fixing the simulated human eye baseline. Figure 2 : Schematic diagram of the displacement of the left camera unit of the super 3D dual-camera system. Figure 3 : Schematic diagram of the relationship between primary and secondary bodies in super 3D shooting. Figure 4 : Schematic diagram of the left and right eye images captured by the super 3D dual-camera unit. Figure 5 : Schematic diagram of super 3D post-production adjustment. Figure 6 : Schematic diagram of super 3D post-production adjustment of focus position. Figure 7 : Schematic diagram of super 3D post-production adjustment of focus position. Figure 8 : Schematic diagram of the displacement of the right camera unit of the super 3D dual-camera system.

Claims

1. A super-visual-range 3D stereoscopic imaging dual-camera technology system, characterized in that: It includes a dual-camera collaboration module, an optical parameter control module, and a post-parallax adjustment module. It achieves supernatural stereo imaging through baseline extension and parallax enhancement algorithms. Specifically, it includes: Dual-camera collaborative module: -The first camera unit is fixed in the reference position, simulating a monocular perspective and capturing images within the natural field of view; -The second camera unit performs horizontal displacement and angular rotation through a composite motion mechanism; The horizontal displacement range is 12-30 cm, and the displacement direction corresponds to the position of the first camera unit (if the first camera unit is the right camera unit, the second camera unit is displaced to the left; if the first camera unit is the left camera unit, the second camera unit is displaced to the right); The rotation angle range is 1°-3°. The rotation direction matches the displacement direction (clockwise for leftward displacement and counterclockwise for rightward displacement). The rotation angle is adjusted according to the subject-object distance. The dual-camera unit is fixed according to the subject-object distance of each lens. If the subject moves from far to near, the medium-shot parameters are fixed: - Near view (2-3m) with a displacement of 12-15cm and an angle of ≤1°; - Medium shot (3-5m) with a displacement of 15-20cm and an angle of ≤2°; - Long-range view (5-20m) with a displacement of 20-30cm and an angle of ≤3°. Later, the image of the second camera unit is subjected to reverse displacement processing (the displacement direction is opposite to the displacement direction of the second camera unit), and the displacement range is: 1-3% for close-up, 3-5% for mid-range, and 5-10% for distant view, so that the main body of the image is aligned with the natural pupil focus position of the human eye (such as 57 in Figure 5, 58 in Figure 6, and 59 in Figure 7). Optical parameter control module: Working focal length ≥ 50mm, using 50-135mm fixed focus lens, based on the subject-object distance: - Close-up (2-3m): focal length 50-65mm; -Mid-ground (3-5m): focal length 50-85mm; - Long shot (5-20m): focal length 50-135mm. The aperture value is f / 4-5.0, and the dual-camera subject distance range is 2-20m. Post-processing parallax adjustment module; Based on the displacement parameters of the second camera unit, its picture is proportionally reversely displaced to form a super-visual-range stereoscopic parallax effect.

2. The super-visual-range 3D stereoscopic imaging dual-camera technology system according to claim 1, characterized in that: The first camera unit is the right camera unit, and the second camera unit is the left camera unit (as shown in Figure 2): Left camera unit: Horizontally move left (as shown by 65 in Figure 2) 12-30cm, and rotate clockwise 1°-3°. - Near view (2-3m) with a displacement of 12-15cm and an angle of ≤1°; - Medium shot (3-5m) with a displacement of 15-20cm and an angle of ≤2°; - Long-range view (5-20m) with a displacement of 20-30cm and an angle of ≤3°. - In the later stage, the left camera unit image is shifted to the right by a percentage based on the distance to the subject, with close shots shifted to the right by 1-3%, mid shots by 3-5%, and distant shots by 5-10%.

3. The super-visual-range 3D stereoscopic imaging dual-camera technology system according to claim 1, characterized in that: The first camera unit is the left camera unit, and the second camera unit is the right camera unit (as shown in Figure 8): Right camera unit: horizontally move rightward (as shown by 65 in Figure 8) by 12-30 cm, and rotate counterclockwise by 1°-3°. - Near view (2-3m) with a displacement of 12-15cm and an angle of ≤1°; - Medium shot (3-5m) with a displacement of 15-20cm and an angle of ≤2°; - Long-range view (5-20m) with a displacement of 20-30cm and an angle of ≤3°. - In the later stage, the right camera unit image is shifted to the left by a percentage based on the distance to the subject, with a 1-3% shift for close shots, 3-5% for mid shots, and 5-10% for long shots.

Images