Ultra-vision 3D stereo dual camera technology system

Abstract

The application discloses a kind of super visual field 3D stereoscopic double camera technology systems (referred to as "super 3D"), belong to 3D image double camera technical field.Aiming at the problem of insufficient stereoscopic depth caused by fixed baseline parameter (6-6.5cm) in traditional 3D double camera, the parallax distortion and dizziness caused by 2D to 3D technology, this scheme proposes a kind of technical system based on double camera unit cooperative displacement and post parameter control.Through left camera unit horizontal transverse displacement (12-30cm) and angle rotation (1°-3°), combined with forced focal length ≥50mm optical parameter control module, expand double camera visual field 20%-50%, and use post reverse displacement compensation algorithm (close range 1-3%, medium 3-5%, long distance 5-10%), the main body of picture is aligned to natural focusing position of human eye, realize stereoscopic level enhancement 2-3 times, no distortion high immersive imaging effect.This scheme technical parameter is independent, and cannot be converted with traditional 3D video, ensure content quality from source, applicable to film and television, VR, metaverse and other fields.

Description

Technical Field

[0001] This invention is a collaborative system for the displacement, rotation, and post-processing parameter control of dual-camera units. Through parallax enhancement algorithms and parameter control systems, it breaks through the natural field of vision of the human eye to achieve a visual-tactile experience, giving the feeling of touching the movie screen as if watching a movie. It is suitable for the scene construction of highly immersive 3D film and television production, VR, games, metaverse, and related content. Background Technology

[0002] Traditional 3D dual cameras have three major pain points;

[0003] (1) Traditional 3D dual cameras have a single parameter, with a fixed pupil distance baseline of 6-6.5cm, resulting in insufficient three-dimensional depth and spatial layering in the image.

[0004] (2) The images rely on 2D to 3D conversion simulation technology, resulting in distortion of image parallax and brightness, severe loss of texture, and long-term viewing can easily cause dizziness and fatigue.

[0005] (3) The lack of unified system technical standards has led to uneven quality of 3D-related content and a year-by-year decrease in market acceptance.

[0006] This invention, Super 3D, addresses the aforementioned pain points. Super 3D employs an extremely rigorous and unique dual-camera technology solution. Through baseline displacement, rotation, and post-processing of the 12-30cm dual-camera unit, the resulting stereoscopic effect is 2-3 times greater than that of traditional dual-camera units with a 6-6.5cm baseline. Tests on a 150-inch screen and in VR have shown significant results, making 3D video images a truly groundbreaking visual experience. Super 3D uses an optical parameter with a focal length of no less than 50mm, completely eliminating edge perspective distortion caused by the stretching distortion of wide-angle lenses (24-35mm) in traditional 3D. This physically suppresses dizziness-inducing factors. Furthermore, Super 3D videos are not interchangeable with traditional 3D videos, and 2D videos cannot be converted to Super 3D. Super 3D movies are compatible with traditional 3D cinemas without requiring equipment changes. Future AI conversions to Super 3D will also be irreplaceable. Therefore, it is necessary to invent a more standardized 3D dual-camera technology system solution with a superior visual immersive experience to ensure the authority of 3D films and related 3D content. Summary of the Invention

[0007] This invention addresses three major pain points of traditional 3D dual-camera technology: insufficient stereoscopic effect due to its adherence to the interpupillary distance of the human eye (approximately 6.5cm), image distortion and viewing dizziness caused by relying on 2D to 3D conversion, and inconsistent 3D content quality due to the lack of unified standards.

[0008] This invention aims to provide a novel dual-camera system solution that does not rely on the physiological limits of the human eye. Through the synergy of dual camera units at the physical level and precise compensation by post-processing algorithms, it actively creates stereoscopic vision that surpasses the natural field of vision of the human eye, thereby constructing a highly immersive, dizziness-free, and technically standardized 3D content production system.

[0009] The core of the beyond-field 3D stereo dual-camera technology system lies in:

[0010] 1. Dual-camera unit with coordinated motion: The system is set to fix the right camera unit (e.g., ...). Figure 2 The middle unit (17) serves as the spatial reference; the left camera unit can be horizontally displaced, expanding the baseline range to 12-30cm (e.g., ...). Figure 2 The camera can rotate clockwise from 1° to 3° (65°). The rotation angle is precisely matched according to the distance of the subject being photographed (near, medium, and far).

[0011] 2. Beyond-the-Field Acquisition and Algorithm Compensation: The left camera unit achieves beyond-the-field acquisition through displacement. In post-processing, the image from the right camera unit (e.g., ...) is used for acquisition. Figure 4 Based on the central 55), the left camera unit image (such as...) Figure 4 (56) Perform a percentage shift to the right (1-3% for foreground, 3-5% for midground, 5-10% for background) to align the main subject of the image to the natural focus position (e.g., ...). Figure 5 (57) to form enhanced stereoscopic parallax.

[0012] 3. Mandatory optical parameter system: The system mandates the use of lenses with a focal length of at least 50mm (e.g., ...). Figure 2 With apertures of f / 62, f / 63 and f / 4-5.0, it fundamentally eliminates the limitations of traditional wide-angle lenses (such as...). Figure 1 The distortion of 60 and 61 degrees is reduced to ensure image quality and viewing comfort.

[0013] A qualitative leap in stereoscopic effect: Through a large baseline displacement of 12-30cm and post-processing parallax enhancement, the stereoscopic depth and spatial layering presented are 2-3 times that of traditional dual cameras, achieving a groundbreaking visual experience that is "within reach".

[0014] Fundamentally improves viewing comfort: The forced telephoto lens and optimized aperture eliminate more than 70% of edge distortion; precise post-processing displacement compensation controls parallax error within the natural imaging zone of the human eye, effectively preventing dizziness and fatigue.

[0015] An insurmountable technical barrier has been built: the composite parameter system adopted in this invention (such as 12-30cm baseline, 1°-3° rotation, and forced ≥50mm focal length) is unique, making the generated super 3D video impossible to convert to traditional 3D or 2D video. This establishes a technical standard from the source, ensuring the high quality and authority of 3D content. Attached Figure Description

[0016] Figure 1 : Schematic diagram of a traditional 3D dual-camera unit with a fixed simulated human eye baseline.

[0017] Figure 2 Schematic diagram of the displacement of the left camera unit in the super 3D dual-camera system.

[0018] Figure 3 : Schematic diagram of the relationship between primary and secondary elements in super 3D shooting.

[0019] Figure 4 : A schematic diagram of the left and right eye images captured by the super 3D dual-camera unit.

[0020] Figure 5 : Schematic diagram of post-production adjustments for Super 3D.

[0021] Figure 6 : Schematic diagram of adjusting focus position in post-processing of Super 3D.

[0022] Figure 7 : Schematic diagram of adjusting focus position in post-processing of Super 3D.

[0023] Figure 8 : Schematic diagram of the displacement of the right camera unit in the super 3D dual-camera system. Detailed Implementation

[0024] (a) Technical problems to be solved

[0025] For traditional 3D dual cameras (such as Figure 1 The fixed interpupillary distance (e.g.) exists in ) Figure 1 The lack of a unified technical standard (e.g., 20) leads to insufficient stereoscopic depth, parallax and brightness distortion and viewing fatigue due to reliance on 2D-to-3D conversion technology, and inconsistent content quality. Ultra 3D technology system solutions (such as...) Figure 2 This technology provides a dual-camera 3D stereoscopic imaging system that achieves super-field-of-view imaging through unit displacement, precise optical parameter control, and post-processing parallax enhancement algorithms. It breaks through the limitations of the natural field of vision of the human eye and builds a highly immersive and dizzying standard for 3D content production.

[0026] (II) Technical Solution

[0027] Structured representation of the dual-camera unit collaborative module;

[0028] 1. Right camera unit; fixed (e.g., ...) Figure 2 17) The reference angle for the right eye is located at the center of the pupil and is used to acquire images within the standard field of view.

[0029] 2. Left camera unit; horizontal displacement (e.g.) Figure 2 (65) (Displacement range 12-30cm, adjustable flexibly, offset to the left) and (as...) Figure 219) Rotate clockwise by 1°-3°. The dual-camera unit is fixed according to the subject distance for each lens. If the subject moves from far to near, then the medium shot parameters are fixed.

[0030] - Close-up (2-3m) angle ≤ 1°;

[0031] -Medium shot (3-5m) ≤2°;

[0032] -Distant view (5-20m) ≤ 3°.

[0033] Beyond-field-of-view acquisition design; the left camera unit extends 20%-50% beyond the natural field of view of the human eye, covering a wider left-side field of view (e.g., Figure 1 Traditional 3D dual-camera solutions can only capture 10-15 sides of an image, while Figure 2 The super 3D dual-camera unit solution can capture 10 to 15+7 images, with the dual-camera units capturing more and more three-dimensional content.

[0034] Post-compensation mechanism; Figure 3 Taking the primary and secondary relationship as an example, Figure 3 The main body consists of 22 to 27. Figure 3 The middle 28-51 are secondary bodies; the dual-camera units use the right unit as the reference to capture the complete image (e.g., ...). Figure 4 (55 in the middle), the left camera unit captures the completed image (e.g., ...). Figure 4 (56) The left camera unit needs to be refocused by shifting the image to the right. The width of the left camera unit's image needs to be shifted by a percentage based on the object distance: 1-3% for close-ups, 3-5% for mid-range shots, and 5-10% for distant shots. This rightward shift aligns the main subject with the natural pupil focus position, creating a super-field-of-view stereoscopic parallax, within the human monocular field of view (e.g., ...). Figure 5 (52, 53) 120° natural eye field of view range, forming the optimal parallax range for focusing (e.g. Figure 5 54) The optimal field of view for stereoscopic imaging in the human eye (e.g.) Figure 5 (57) Focus position, (e.g.) Figure 5 (28) is the focus point, which is the position of the horizontal line on the visual screen. It can be moved according to the needs of the main visual expression (e.g., Figure 4 In the 55 and 56 sections (28-51), the same digital focus can be flexibly adjusted (e.g., ...). Figure 5 (57) Focus position, (e.g.) Figure 5 (e.g., 28) is the focus point. Figure 6 (58) Focus point, (e.g.) Figure 6 (40) is the focus point.

[0035] Forced dual-camera focal length ≥ 50mm, (e.g.) Figure 2 The focal length of the 62mm and 63mm lenses is 50mm, compared to traditional (e.g.) Figure 1The 60mm and 61mm focal lengths are 35mm, resulting in a fuller image. There is no need to use a wide-angle lens to enhance the sense of depth, which can effectively avoid image stretching and distortion.

[0036] Matching rules for optical parameter control system:

[0037] 1. Basic optical parameter matching rules:

[0038] - Working focal length: ≥50mm (forced 50-135mm prime lens);

[0039] - Aperture value: f / 4-5.0 (balances depth of field and light intake to avoid image distortion and motion blur);

[0040] - Dual-camera subject distance: minimum 2m, maximum 20m (to ensure a sense of three-dimensional depth within the field of view).

[0041] 2. Subject distance-focal length matching rules:

[0042] - Close-up (2-3m): Focal length 50-65mm;

[0043] -Medium shot (3-5m): Focal length 50-85mm;

[0044] -Distant view (5-20m): Focal length 50-135mm.

[0045] Enhanced 3D Perception of Core Performance

[0046] By fixing the right unit as the main baseline and shifting the left unit (12-30cm), the depth information of the captured image is increased, exceeding the natural field of vision of the human eye by 20%-50% for super-field acquisition. Combined with post-processing offset adjustment of the parallax between the left and right eye images (the image rendering output needs to be 20% larger than the original size), the depth perception neural circuit of the visual cortex is activated, forming a "touchable" stereoscopic visual effect. The stereoscopic effect presented is 2-3 times that of the traditional dual-camera unit with a baseline of 6-6.5cm.

[0047] Optimized viewing comfort

[0048] By forcing a focal length of ≥50mm (to avoid wide-angle distortion) and an aperture of f / 4-5.0 (to balance depth of field), edge stretching distortion is reduced by more than 70% from a physical perspective (compared to a traditional 35mm lens), thus reducing the processing load on the visual cortex. After the left camera unit is shifted by 12-30cm and rotated by 1°-3°, the subject parallax error is controlled to ≤0.3 pixels (the human brain's fusion comfort threshold is ≤0.5 pixels) through post-processing 1%-10% reverse displacement compensation. In tests with 30 subjects of different ages (18-65 years old, covering teenagers, young adults, and the elderly), 97% of the subjects were able to focus naturally on the first viewing without any feedback of dizziness or eye fatigue. Typical test scenario parameter configuration: When shooting a medium shot (object distance 4m), the left camera unit is shifted by 18cm and rotated by 2°, with a focal length of 70mm. In post-processing, 4% rightward displacement compensation is applied to achieve a parallax gradient of 1.0 (the optimal fusion gradient for the human brain is 0.8-1.2). This verifies the technical logic of this solution to control parallax within the natural processing range through parameter collaboration.

[0049] Building technological barriers

[0050] Super 3D video has a completely independent parallax parameter system from traditional 3D and 2D video. The uniqueness of Super 3D stereoscopic imaging lies in the composite shooting technology principle of the dual-camera unit collaborative module baseline range (12-30cm) and the left camera unit's 1°-3° and forced focal length ≥50mm. This creates a technical characteristic that cannot be converted from traditional 3D, thus eliminating the impact of traditional inferior 3D content and 2D-to-3D conversion on content quality from the source.

Claims

1. A dual-camera technology system for beyond-field 3D stereoscopic imaging, characterized in that, It includes a dual-camera unit collaboration module, an optical parameter control module, and a post-processing parallax adjustment module. Through baseline extension and parallax enhancement algorithms, it achieves stereoscopic imaging within a supernatural field of view, specifically including: Dual-camera unit collaborative module: - The first camera unit is fixed at a reference position to simulate a monocular perspective and capture images within the natural field of view; -The second camera unit performs horizontal displacement and angular rotation through a composite motion mechanism; The horizontal displacement range is 12-30cm, and the displacement direction corresponds to the position of the first camera unit. If the first camera unit is the right camera unit, the second camera unit will move to the left; if the first camera unit is the left camera unit, the second camera unit will move to the right. The rotation angle range is 1°-3°, and the rotation direction matches the displacement direction. It rotates clockwise when moving left and counter-clockwise when moving right. The rotation angle adjusts according to the subject distance. The dual-camera unit is fixed based on the subject distance for each lens. If the subject movement is from far to near, medium-range parameters are used. - The close-up view is 2-3m, the horizontal displacement is 12-15cm and the angle is ≤1°; - Medium shot is 3-5m, horizontal displacement is 15-20cm and angle ≤2°; - The distance is 5-20m, the horizontal displacement is 20-30cm and the angle is ≤3°; In post-processing, the image of the second camera unit is reverse-shifted, with the shift direction opposite to that of the second camera unit. The shift range is 1-3% for close-up, 3-5% for mid-range, and 5-10% for distant scenes, so that the main subject of the image is aligned with the natural focus position of the human eye's pupil. Optical parameter control module: The working focal length is ≥50mm, using a 50-135mm fixed focal length lens, and the focal length is controlled according to the subject distance: - Close-up shots are at 2-3m, with a focal length of 50-65mm; - Medium distance: 3-5m, focal length: 50-85mm; -Distant views are 5-20m, with a focal length of 50-135mm; The aperture value is f4-f5, and the subject distance for dual cameras ranges from 2-20m. Post-processing parallax adjustment module: Based on the displacement parameters of the second camera unit, its image is proportionally reversed to create a super-field-of-view stereoscopic parallax effect.

Images